Title:
METHOD AND APPARATUS FOR INTERACTION BETWEEN COGNITIVE MESH INFORMATION GENERATED IN THREE-DIMENSIONAL SPACE AND VIRTUAL OBJECTS
Document Type and Number:
WIPO Patent Application WO/2023/120770
Kind Code:
A1
Abstract:
In order to implement augmented reality technology that synthesizes virtual objects in a certain space, the present invention relates to a method that creates pieces of three-dimensional cognitively segmented mesh information for an interaction between a virtual object and updates information on a position, direction, and state of the virtual object such that the virtual object interacts with a real space, thereby enhancing a user's sense of presence and manipulability. More specifically, three-dimensional space information is generated by estimating a geometric relationship by using continuous images obtained from a camera, and cognitive domain segmentation is performed on the images of the current space by using a convolutional neural network, and this is combined with the space information to generate segmented cognitive mesh information. The present invention relates to a method and an apparatus for implementing an interaction between cognitive mesh information generated in a three-dimensional space and virtual objects by continuously updating location information, direction information, and state information in which the virtual objects disposed in the three-dimensional space may physically exist, determining whether the virtual objects can actually exist at the current location by using the cognitive mesh information to cause the virtual objects and the cognitive mesh information to interact with each other, and comparing the positional relationship between the virtual objects and the 3-dimensional mesh information to represent occlusion.
More Like This:
| JP2022110415 | IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM |
| JP2022128087 | MEASUREMENT SYSTEM AND MEASUREMENT PROGRAM |
| WO/2019/219861 | MULTI-MODAL IMAGE REGISTRATION |
Inventors:
HAN SANGJOON (KR)
Application Number:
PCT/KR2021/019669
Publication Date:
June 29, 2023
Filing Date:
December 22, 2021
Export Citation:
Assignee:
NSENSE KOREA CORP (KR)
International Classes:
G06T7/33; G06T7/11; G06T7/73; G06T17/20; G06T19/00
Foreign References:
| KR20170081964A | 2017-07-13 | |||
| KR20210036212A | 2021-04-02 | |||
| KR102333682B1 | 2021-11-30 | |||
| KR20200130903A | 2020-11-23 |
Other References:
FELIX JÄREMO LAWIN, DANELLJAN MARTIN, TOSTEBERG PATRIK, BHAT GOUTAM, FAHAD SHAHBAZ KHAN, FELSBERG MICHAEL: "Deep Projective 3D Semantic Segmentation", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, ARXIV.ORG, ITHACA, 9 May 2017 (2017-05-09), Ithaca, XP093073947, Retrieved from the Internet [retrieved on 20230816]
Download PDF: