Title:
QUERY RESPONSE DEVICE AND METHOD
Document Type and Number:
WIPO Patent Application WO/2020/117028
Kind Code:
A1
Abstract:
A query response method performed by a query response device comprises the steps of: classifying an image frame, audio data, and subtitle data that are included in video data of a data set in one shot unit, on the basis of one same subtitle; extracting a shot feature vector by calculating a feature vector of each of an image frame, audio data, and subtitle data that are included in a shot; extracting, from a pair of query responses included in the data set, a feature vector of question data and a feature vector of each of a plurality of pieces of option data corresponding to the question data; calculating a video feature vector by inputting the shot feature vector to a neural network including a plurality of layers, assigning an attention weight calculated on the basis of the question data to an output vector of each of the layers, and then summing results; and selecting a final answer from among the plurality of pieces of option data, on the basis of a similarity between the video feature vector and an option feature vector.
Inventors:
ZHANG BYOUNG-TAK (KR)
CHOI SEONG-HO (KR)
CHOI SEONG-HO (KR)
Application Number:
PCT/KR2019/017311
Publication Date:
June 11, 2020
Filing Date:
December 09, 2019
Export Citation:
Assignee:
SEOUL NAT UNIV R&DB FOUNDATION (KR)
International Classes:
G06F16/783; G06F16/432; G06F16/73; G06N3/08
Foreign References:
| KR20180101948A | 2018-09-14 | |||
| JPS5238339B2 | 1977-09-28 | |||
| US20170154314A1 | 2017-06-01 | |||
| KR20030065860A | 2003-08-09 | |||
| KR20170062290A | 2017-06-07 |
Attorney, Agent or Firm:
ISQUARE PATENT & LAW FIRM (KR)
Download PDF: