Title:
DEPTH ESTIMATION METHOD AND SYSTEM USING CYCLE GAN AND SEGMENTATION
Document Type and Number:
WIPO Patent Application WO/2021/206284
Kind Code:
A1
Abstract:
The present invention relates to a depth estimation method and system using cycle GAN and segmentation, the method and the system estimating depth information about an image by using only a single image through cycle GAN and segmentation without using special equipment or a camera. A depth estimation method using cycle GAN and segmentation, according to an embodiment of the present invention, comprises the steps of: (S10) generating depth information and segmentation image information about an input RGB image of a standard database by using a generator; (S20) reconstructing an RGB image by using the generated depth information and segmentation image information; and (S30) calculating a loss and a discrimination probability by comparing the generated depth information and segmentation image information, and the reconstructed RGB image with the standard database, and discriminating same, respectively. In addition, the depth estimation method comprises the steps of: (S40) determining whether the loss and the discrimination probability value satisfy a preset reference convergence value, on the basis of the calculated result values; (S50) adjusting training on the basis of the determination result so that the loss and the discrimination probability value of a discriminator converge on the preset reference convergence value, and repeating steps (S10) to (S40); and (S60) estimating depth information about the RGB image by using a generator generated through steps (S10) to (S50).
More Like This:
Inventors:
LEE SEUNGHO (KR)
KWAK DONG HOON (KR)
KWAK DONG HOON (KR)
Application Number:
PCT/KR2021/001803
Publication Date:
October 14, 2021
Filing Date:
February 10, 2021
Export Citation:
Assignee:
UNIV NAT HANBAT IND ACAD COOP FOUND (KR)
International Classes:
G06T7/50; G06N20/00; G06T5/00
Foreign References:
| US20200074674A1 | 2020-03-05 | |||
| KR102127153B1 | 2020-06-26 |
Other References:
GWN KIN; REDDY KISHORE; GIERING MICHAEL; BERNAL EDGAR A.: "Generative Adversarial Networks for Depth Map Estimation from RGB Video", 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), IEEE, 18 June 2018 (2018-06-18), pages 1258 - 12588, XP033475459, DOI: 10.1109/CVPRW.2018.00163
JAFARI OMID HOSSEINI; GROTH OLIVER; KIRILLOV ALEXANDER; YANG MICHAEL YING; ROTHER CARSTEN: "Analyzing modular CNN architectures for joint depth prediction and semantic segmentation", 2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), IEEE, 29 May 2017 (2017-05-29), pages 4620 - 4627, XP033127279, DOI: 10.1109/ICRA.2017.7989537
ZHAO SHANSHAN; FU HUAN; GONG MINGMING; TAO DACHENG: "Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimation", 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), IEEE, 15 June 2019 (2019-06-15), pages 9780 - 9790, XP033686751, DOI: 10.1109/CVPR.2019.01002
KWAK, DONG-HOON: "A study on depth estimation method using cycle GAN and segmentation", MASTER THESIS, February 2020 (2020-02-01), Korea, pages 1 - 51, XP009531287
KWAK, DONG-HOON ET AL.: "A Technique for Generating Depth Information of RGB Images using a Learning-based Cycle GAN", INSTITUTE OF KOREAN ELECTRICAL AND ELECTRONICS ENGINEERS SUMMER CONFERENCE 2019, 8 August 2019 (2019-08-08), pages 29 - 32
JAFARI OMID HOSSEINI; GROTH OLIVER; KIRILLOV ALEXANDER; YANG MICHAEL YING; ROTHER CARSTEN: "Analyzing modular CNN architectures for joint depth prediction and semantic segmentation", 2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), IEEE, 29 May 2017 (2017-05-29), pages 4620 - 4627, XP033127279, DOI: 10.1109/ICRA.2017.7989537
ZHAO SHANSHAN; FU HUAN; GONG MINGMING; TAO DACHENG: "Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimation", 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), IEEE, 15 June 2019 (2019-06-15), pages 9780 - 9790, XP033686751, DOI: 10.1109/CVPR.2019.01002
KWAK, DONG-HOON: "A study on depth estimation method using cycle GAN and segmentation", MASTER THESIS, February 2020 (2020-02-01), Korea, pages 1 - 51, XP009531287
KWAK, DONG-HOON ET AL.: "A Technique for Generating Depth Information of RGB Images using a Learning-based Cycle GAN", INSTITUTE OF KOREAN ELECTRICAL AND ELECTRONICS ENGINEERS SUMMER CONFERENCE 2019, 8 August 2019 (2019-08-08), pages 29 - 32
Attorney, Agent or Firm:
LEE, Un Cheol (KR)
Download PDF:
Previous Patent: BATTERY MODULE AND MANUFACTURING METHOD THEREOF
Next Patent: ROTATION APPARATUS OF POLE SYSTEM FOR PHOTOVOLTAIC POWER GENERATION
Next Patent: ROTATION APPARATUS OF POLE SYSTEM FOR PHOTOVOLTAIC POWER GENERATION