Title:
METHOD OF PERSONALIZED IMAGE AND VIDEO SEARCHING BASED ON A NATURAL LANGUAGE QUERY, AND AN APPARATUS FOR THE SAME
Document Type and Number:
WIPO Patent Application WO/2022/177150
Kind Code:
A1
Abstract:
A method of personalized image retrieval includes obtaining a natural language query including a name; replacing the name in the natural language query with a generic term to provide an anonymized query and named entity information; obtaining a plurality of initial ranking scores and a plurality of attention weights corresponding to a plurality of images using a trained scoring model that inputs the anonymized query and the plurality of images; obtaining a plurality of delta scores corresponding to the plurality of images using a re-scoring model that inputs the plurality of attention weights and the named entity information; and obtaining a plurality of final ranking scores by modifying the plurality of initial ranking scores based on the plurality of delta scores. The trained scoring model performs semantic based searching and the re-scoring model determines a probability that faces detected in the plurality of images correspond to the name.
More Like This:
Inventors:
ZHANG HAOTIAN (US)
JEPSON ALLAN (US)
MOHOMED IQBAL ISMAIL (US)
DERPANIS KONSTANTINOS (US)
ZHANG RAN (US)
FAZLY AFSANEH (US)
JEPSON ALLAN (US)
MOHOMED IQBAL ISMAIL (US)
DERPANIS KONSTANTINOS (US)
ZHANG RAN (US)
FAZLY AFSANEH (US)
Application Number:
PCT/KR2022/000270
Publication Date:
August 25, 2022
Filing Date:
January 07, 2022
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
International Classes:
G06F16/2457; G06F16/532; G06F16/538; G06F16/583; G06F16/9535; G06N20/00
Foreign References:
| US20130218858A1 | 2013-08-22 | |||
| US20080130960A1 | 2008-06-05 | |||
| US6816858B1 | 2004-11-09 | |||
| US20090292685A1 | 2009-11-26 | |||
| US20160170994A1 | 2016-06-16 |
Other References:
See also references of EP 4232914A4
Attorney, Agent or Firm:
KIM, Tae-hun et al. (KR)
Download PDF: