Title:
SOCIAL RELATION ANALYSIS METHOD AND SYSTEM BASED ON MULTI-MODAL DATA, AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2024/031933
Kind Code:
A1
Abstract:
The present invention provides a social relation analysis method based on multi-modal data. The method comprises: S1, extracting social texts and social image information of personnel, respectively converting same into text features and image features, collecting statistics about personnel intimacy, and constructing a personnel social network graph on the basis of the personnel intimacy; S2, inputting the text features and the image features into a transformer-based multi-modal fusion model to obtain fused features; and S3, analyzing the personnel social network graph by using a Si-SCAN graph clustering algorithm to obtain a social relation clustering result, wherein the Si-SCAN graph clustering algorithm is constructed by introducing the personnel intimacy and fused feature information on the basis of the SCAN algorithm. According to the present invention, social relations are deeply analyzed on the basis of information of text and image modalities. By means of the design of the multi-modal information fusion model, cross-modal interaction relationships are learned, and multi-modal fused graph node embedding representations are generated. By means of graph clustering analysis, deep relation analysis of social networks is realized, so that potential social associations can be effectively found.
Inventors:
CHEN SIMENG (CN)
ZHAO JIANQIANG (CN)
CHEN CHENG (CN)
PENG CHUANG (CN)
ZHANG HUI (CN)
HAN MINGXI (CN)
ZHAO JIANQIANG (CN)
CHEN CHENG (CN)
PENG CHUANG (CN)
ZHANG HUI (CN)
HAN MINGXI (CN)
Application Number:
PCT/CN2023/072957
Publication Date:
February 15, 2024
Filing Date:
January 18, 2023
Export Citation:
Assignee:
XIAMEN MEIYA PICO INFORMATION (CN)
International Classes:
G06Q50/00
Foreign References:
| CN115293920A | 2022-11-04 | |||
| CN114820011A | 2022-07-29 | |||
| US20120087548A1 | 2012-04-12 | |||
| CN112508077A | 2021-03-16 | |||
| US20160019411A1 | 2016-01-21 |
Other References:
JIA-ZHOU CHEN ，, CHEN ZHANG-ZHANG, QIN, XU-JIA: "Photo-based Social Relationship Visualization Method", JOURNAL OF CHINESE COMPUTER SYSTEMS, vol. 41, no. 10, 15 October 2020 (2020-10-15), pages 2194 - 2199, XP093137148
Attorney, Agent or Firm:
XIAMEN FUBEI INTELLECTUAL PROPERTY AGENCY (GP) (CN)
Download PDF:
Previous Patent: STORAGE SERVER STARTUP DETECTION METHOD, SYSTEM AND APPARATUS, DEVICE, AND STORAGE MEDIUM
Next Patent: DISTRIBUTING DEVICE
Next Patent: DISTRIBUTING DEVICE