Title:
ELECTRONIC DEVICE FOR PROCESSING MULTI-MODAL DATA AND OPERATION METHOD THEREOF
Document Type and Number:
WIPO Patent Application WO/2022/158847
Kind Code:
A1
Abstract:
The present invention relates to an electronic device for performing a pre-set task by using a deep neural network (DNN), wherein an input interface for receiving inputs of first type input data and second type input data, a memory for storing one or more instructions, and a processor for executing the one or more instructions stored in the memory obtain first sub-feature information corresponding to the first type input data and second sub-feature information corresponding to the second type input data, obtain feature information from each of a plurality of layers of the DNN by using the first sub-feature information and the second sub-feature information as inputs of the DNN, calculate a weight for each type, which corresponds to each of the plurality of layers, on the basis of the feature information, the first sub-feature information, and the second sub-feature information, and obtain a final output value corresponding to the pre-set task by applying the weight for each type in each of the plurality of layers.
Inventors:
KU JEONGHOE (KR)
Application Number:
PCT/KR2022/000977
Publication Date:
July 28, 2022
Filing Date:
January 19, 2022
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
International Classes:
G06N3/08; G06N3/04
Foreign References:
| KR20180101959A | 2018-09-14 | |||
| KR20190119863A | 2019-10-23 | |||
| US9971958B2 | 2018-05-15 | |||
| US9633282B2 | 2017-04-25 |
Other References:
MOHLA SATYAM; PANDE SHIVAM; BANERJEE BIPLAB; CHAUDHURI SUBHASIS: "FusAtNet: Dual Attention based SpectroSpatial Multimodal Fusion Network for Hyperspectral and LiDAR Classification", 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), IEEE, 14 June 2020 (2020-06-14), pages 416 - 425, XP033798952, DOI: 10.1109/CVPRW50498.2020.00054
Attorney, Agent or Firm:
Y.P.LEE, MOCK & PARTNERS (KR)
Download PDF: