Title:
SYSTEMS AND METHODS FOR VIDEO RETRIEVAL AND GROUNDING
Document Type and Number:
WIPO Patent Application WO/2023/083341
Kind Code:
A1
Abstract:
Methods and systems are described for performing video retrieval together with video grounding. A word-based query for a video is and encoded into a query representation using a trained query encoder. One or more similar video representations are identified, from a plurality of video representations that are similar to the query representation. Each similar video representation represents a respective relevant video. A grounding is generated for each relevant video by forward propagating each respective similar video representation together with the query representation through a trained grounding module. The relevant videos or identifiers of the relevant videos are outputted together with the grounding generated for each relevant video.
Inventors:
MONDAL ARNAB KUMAR (CA)
SRIDHAR DEEPAK (CA)
QUADER NIAMUL (CA)
LU JUWEI (CA)
DAI PENG (CA)
XING CHAO (CA)
SRIDHAR DEEPAK (CA)
QUADER NIAMUL (CA)
LU JUWEI (CA)
DAI PENG (CA)
XING CHAO (CA)
Application Number:
PCT/CN2022/131593
Publication Date:
May 19, 2023
Filing Date:
November 14, 2022
Export Citation:
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06F16/783; G06F16/78
Domestic Patent References:
| WO2018081751A1 | 2018-05-03 | |||
| WO2017070656A1 | 2017-04-27 |
Foreign References:
| CN110598049A | 2019-12-20 | |||
| US20210109966A1 | 2021-04-15 | |||
| US20110085734A1 | 2011-04-14 |
Download PDF: