Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SYSTEM AND METHOD FOR CROSS-MODAL INTERACTION BASED ON PRE-TRAINED MODEL
Document Type and Number:
WIPO Patent Application WO/2024/045866
Kind Code:
A1
Abstract:
A method is provided for data processing performed by a processing system. The method comprises determining a set of first tokens for first data and a set of second token for second data, each token comprising information associated with a segment of the respective data, determining pair-wise similarities between the set of first tokens and the set of second tokens, each pair comprising a first token in the set of first tokens and a second token in the set of second tokens, determining, for each first token in the set of first tokens, a maximum similarity based on the determined pair-wise similarities between the respective first token and the second tokens in the set of second tokens, and determining a first similarity between the first data and the second data by aggregating the maximum similarities corresponding to the first tokens in the set of first set of tokens.

Inventors:
XU HANG (CN)
HOU LU (CN)
LU GUANSONG (CN)
NIU MINZHE (CN)
LI ZHENGUO (CN)
HUANG RUNHUI (CN)
YAO LEWEI (CN)
XU CHUNJING (CN)
LIANG XIAODAN (CN)
Application Number:
PCT/CN2023/104350
Publication Date:
March 07, 2024
Filing Date:
June 30, 2023
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06V10/74
Foreign References:
CN114743029A2022-07-12
CN110059198A2019-07-26
US20210200795A12021-07-01
Download PDF: