Title:
DRIVER BEHAVIOR RECOGNITION METHOD, SYSTEM AND APPARATUS, AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2023/197503
Kind Code:
A1
Abstract:
Disclosed in the present invention are a driver behavior recognition method, system and apparatus, and a storage medium. The method comprises: acquiring video data filmed by a camera, and extracting driver skeleton key point coordinates on the basis of the video data; respectively extracting a visual feature and a driver pose feature using a pose-guided visual feature extractor and a vision-guided pose feature extractor; and by means of a multi-modal bidirectional interaction mechanism, realizing bidirectional information interaction between two modalities, thereby improving a representation capability of a model, and outputting a driver behavior recognition result. By means of the present invention, complementary information between modalities is effectively utilized, and a stronger representation capability is achieved, such that the accuracy of a driver behavior recognition result is higher. The present invention can be widely applied to the technical field of intelligent recognition.
Inventors:
TAN MINGKUI (CN)
NI GENGQIN (CN)
ZENG RUNHAO (CN)
WU XIANGMIAO (CN)
NI GENGQIN (CN)
ZENG RUNHAO (CN)
WU XIANGMIAO (CN)
Application Number:
PCT/CN2022/115290
Publication Date:
October 19, 2023
Filing Date:
August 26, 2022
Export Citation:
Assignee:
UNIV SOUTH CHINA TECH (CN)
International Classes:
G06V20/59; G06N3/04; G06N3/08; G06V10/25; G06V10/34; G06V10/764; G06V10/82; G06V40/10
Foreign References:
| CN114743183A | 2022-07-12 | |||
| CN114241458A | 2022-03-25 | |||
| CN114078243A | 2022-02-22 | |||
| US20220044022A1 | 2022-02-10 |
Attorney, Agent or Firm:
JIAQUAN IP LAW (CN)
Download PDF: