Title:
ELECTRONIC DEVICE AND CONTROLLING METHOD THEREOF
Document Type and Number:
WIPO Patent Application WO/2020/242170
Kind Code:
A1
Abstract:
An electronic apparatus and a method thereof are provided. The method for controlling an electronic device comprising obtaining an input data including a point cloud with a neural descriptor for each point and a camera parameter for the point cloud, estimating the viewpoint direction based on the input data, rasterizing the points of the point cloud with a z-buffer algorithm using the neural descriptor concatenated with the viewpoint direction as pseudo-colors, obtaining the resulting image by passing the rasterized points through a neural rendering network, and learning the neural descriptor for every point and the neural rendering network, and rendering, using a loss function, the resulting image on a display as a ground truth.
More Like This:
Inventors:
ALIEV KARA-ALI ALIBULATOVICH (RU)
LEMPITSKY VICTOR SERGEEVICH (RU)
ULYANOV DMITRY VLADIMIROVICH (RU)
LEMPITSKY VICTOR SERGEEVICH (RU)
ULYANOV DMITRY VLADIMIROVICH (RU)
Application Number:
PCT/KR2020/006777
Publication Date:
December 03, 2020
Filing Date:
May 26, 2020
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
International Classes:
G06T15/40; G06T17/00
Foreign References:
| US20190065824A1 | 2019-02-28 | |||
| US20180096527A1 | 2018-04-05 |
Other References:
THIES JUSTUS JUSTUS.THIES@TUM.DE; ZOLLHÖFER MICHAEL ZOLLHOEFER@CS.STANFORD.EDU; NIESSNER MATTHIAS NIESSNER@TUM.DE: "Deferred neural rendering", ACM TRANSACTIONS ON GRAPHICS, ACM, NY, US, vol. 38, no. 4, 12 July 2019 (2019-07-12), US, pages 1 - 12, XP058452138, ISSN: 0730-0301, DOI: 10.1145/3306346.3323035
LU WEIXIN; WAN GUOWEI; ZHOU YAO; FU XIANGYU; YUAN PENGFEI; SONG SHIYU: "DeepVCP: An End-to-End Deep Neural Network for Point Cloud Registration", 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), IEEE, 27 October 2019 (2019-10-27), pages 12 - 21, XP033723373, DOI: 10.1109/ICCV.2019.00010
BUI GIANG; LE TRUC; MORAGO BRITTANY; DUAN YE: "Point-based rendering enhancement via deep learning", VISUAL COMPUTER, SPRINGER, BERLIN, DE, vol. 34, no. 6, 11 May 2018 (2018-05-11), DE, pages 829 - 841, XP036515456, ISSN: 0178-2789, DOI: 10.1007/s00371-018-1550-6
LU WEIXIN; WAN GUOWEI; ZHOU YAO; FU XIANGYU; YUAN PENGFEI; SONG SHIYU: "DeepVCP: An End-to-End Deep Neural Network for Point Cloud Registration", 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), IEEE, 27 October 2019 (2019-10-27), pages 12 - 21, XP033723373, DOI: 10.1109/ICCV.2019.00010
BUI GIANG; LE TRUC; MORAGO BRITTANY; DUAN YE: "Point-based rendering enhancement via deep learning", VISUAL COMPUTER, SPRINGER, BERLIN, DE, vol. 34, no. 6, 11 May 2018 (2018-05-11), DE, pages 829 - 841, XP036515456, ISSN: 0178-2789, DOI: 10.1007/s00371-018-1550-6
Attorney, Agent or Firm:
KIM, Tae-hun et al. (KR)
Download PDF: