Title:
ACCELERATED TRAINING OF NEURAL RADIANCE FIELDS-BASED MACHINE LEARNING MODELS
Document Type and Number:
WIPO Patent Application WO/2022/155933
Kind Code:
A1
Abstract:
Described herein are systems, methods, and non-transitory computer-readable media configured to obtain a set of content items to train a neural radiance field-based (NeRF-based) machine learning model for object recognition. Depth maps of objects depicted in the set of content items can be determined. A first set of training data comprising reconstructed content items depicting only the objects can be generated based on the depth maps. A second set of training data comprising one or more optimal training paths associated with the set of content items can be generated based on the depth maps. The one or more optimal training paths are generated based at least in part on a dissimilarity matrix associated with the set of content items. The NeRF-based machine learning model can be trained based on the first set of training data and the second set of training data.
Inventors:
ZHAO FUQIANG (CN)
WU MINYE (CN)
XU LAN (CN)
YU JINGYI (CN)
WU MINYE (CN)
XU LAN (CN)
YU JINGYI (CN)
Application Number:
PCT/CN2021/073426
Publication Date:
July 28, 2022
Filing Date:
January 22, 2021
Export Citation:
Assignee:
UNIV SHANGHAI TECH (CN)
International Classes:
G06K9/62; G06N3/02
Foreign References:
| CN112037324A | 2020-12-04 |
Other References:
MILDENHALL BEN, SRINIVASAN PRATUL P., TANCIK MATTHEW, BARRON JONATHAN T., RAMAMOORTHI RAVI, NG REN: "NeRF : representing scenes as neural radiance fields for view synthesis", COMMUNICATIONS OF THE ACM, ASSOCIATION FOR COMPUTING MACHINERY, INC, UNITED STATES, vol. 65, no. 1, 3 August 2020 (2020-08-03), United States , pages 99 - 106, XP055953603, ISSN: 0001-0782, DOI: 10.1145/3503250
LINGJIE LIU; JIATAO GU; KYAW ZAW LIN; TAT-SENG CHUA; CHRISTIAN THEOBALT: "Neural Sparse Voxel Fields", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 6 January 2021 (2021-01-06), 201 Olin Library Cornell University Ithaca, NY 14853 , XP081852946
KAI ZHANG; GERNOT RIEGLER; NOAH SNAVELY; VLADLEN KOLTUN: "NeRF++: Analyzing and Improving Neural Radiance Fields", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 October 2020 (2020-10-15), 201 Olin Library Cornell University Ithaca, NY 14853 , XP081787064
LINGJIE LIU; JIATAO GU; KYAW ZAW LIN; TAT-SENG CHUA; CHRISTIAN THEOBALT: "Neural Sparse Voxel Fields", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 6 January 2021 (2021-01-06), 201 Olin Library Cornell University Ithaca, NY 14853 , XP081852946
KAI ZHANG; GERNOT RIEGLER; NOAH SNAVELY; VLADLEN KOLTUN: "NeRF++: Analyzing and Improving Neural Radiance Fields", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 October 2020 (2020-10-15), 201 Olin Library Cornell University Ithaca, NY 14853 , XP081787064
Attorney, Agent or Firm:
SHANGHAI SAVVY INTELLECTUAL PROPERTY AGENCY (CN)
Download PDF: