Title:
AN APPARATUS FOR PERFORMING MULTI-FRAME DE-FENCING AND METHOD THEREOF
Document Type and Number:
WIPO Patent Application WO/2024/043428
Kind Code:
A1
Abstract:
The present disclosure provides methods, apparatuses, and computer-readable mediums for performing multi-frame de-fencing by a device. In an embodiment, a method includes obtaining an image burst having at least one portion of a background scene obstructed by an opaque obstruction. The method further includes generating a plurality of obstruction masks marking the at least one portion of the background scene obstructed by the opaque obstruction in images of the image burst. The method further includes computing a motion of the background scene, with respect to a keyframe selected from the plurality of images, by applying an occlusion-aware optical flow model. The method further includes reconstructing the selected keyframe by providing a combination of features to an image fusion and inpainting network. The method further includes providing, to the user, the reconstructed keyframe comprising an unobstructed version of the background scene of the image burst.
Inventors:
TSOGKAS STAVROS (CA)
ZHANG FENGJIA (CA)
LEVINSHTEIN ALEKSAI (CA)
JEPSON ALLAN DOUGLAS (CA)
ZHANG FENGJIA (CA)
LEVINSHTEIN ALEKSAI (CA)
JEPSON ALLAN DOUGLAS (CA)
Application Number:
PCT/KR2023/005282
Publication Date:
February 29, 2024
Filing Date:
April 19, 2023
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
International Classes:
G06T5/00; G06T3/40; G06T7/10; G06T15/06; H04N23/80
Domestic Patent References:
| WO2022093283A1 | 2022-05-05 |
Foreign References:
| US20210327031A1 | 2021-10-21 | |||
| US20190138889A1 | 2019-05-09 |
Other References:
GUPTA DIVYANSHU; JAIN SHORYA; TRIPATHI UTKARSH; CHATTOPADHYAY PRATIK; WANG LIPO: "A robust and efficient image de-fencing approach using conditional generative adversarial networks", SIGNAL, IMAGE AND VIDEO PROCESSING, SPRINGER LONDON, LONDON, vol. 15, no. 2, 1 January 1900 (1900-01-01), London , pages 297 - 305, XP037367195, ISSN: 1863-1703, DOI: 10.1007/s11760-020-01749-6
JONNA SANKARAGANESH; NAKKA KRISHNA K.; SAHAY RAJIV R.: "My camera can see through fences: A deep learning approach for image de-fencing", 2015 3RD IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), IEEE, 3 November 2015 (2015-11-03), pages 261 - 265, XP032910060, DOI: 10.1109/ACPR.2015.7486506
JONNA SANKARAGANESH; NAKKA KRISHNA K.; SAHAY RAJIV R.: "My camera can see through fences: A deep learning approach for image de-fencing", 2015 3RD IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), IEEE, 3 November 2015 (2015-11-03), pages 261 - 265, XP032910060, DOI: 10.1109/ACPR.2015.7486506
Attorney, Agent or Firm:
Y.P.LEE, MOCK & PARTNERS (KR)
Download PDF: