Title:
MULTIMODAL TRANSLATION METHOD, APPARATUS, ELECTRONIC DEVICE AND COMPUTER-READABLE STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2022/065811
Kind Code:
A1
Abstract:
A method for providing multimodal translation of a content in a source language is provided. The method includes receiving a user input with respect to a translation request of text included in the content, in response to receiving the user input, acquiring a multimodal input from the content, the multimodal input including location information related to the content other multimodal inputs, generating scene information representing the multimodal input related to the content by using a fusion layer based on the location information and the other multimodal inputs, identifying a candidate word set in a target language, determining at least one candidate word from the candidate word set based on the scene information, and translating the text included in the content into the target language using a translation model based on the determined at least one candidate word.
Inventors:
TU MEI (CN)
ZHANG FAN (CN)
WANG LIJIE (CN)
ZHANG FAN (CN)
WANG LIJIE (CN)
Application Number:
PCT/KR2021/012735
Publication Date:
March 31, 2022
Filing Date:
September 16, 2021
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
BEIJING SAMSUNG TELECOM R&D CT (CN)
BEIJING SAMSUNG TELECOM R&D CT (CN)
International Classes:
G06F40/58; G06F16/908; G06F16/909; G06F40/263; G06F40/30; G06N3/08
Foreign References:
| KR20200023013A | 2020-03-04 | |||
| US20060083431A1 | 2006-04-20 | |||
| KR20200073967A | 2020-06-24 | |||
| US20200226328A1 | 2020-07-16 | |||
| KR20140049922A | 2014-04-28 |
Attorney, Agent or Firm:
Y.P.LEE, MOCK & PARTNERS (KR)
Download PDF: