JOINT ENCODING METHOD FOR MULTIPLE MODALITY INFORMATION SOURCES

WIPO Patent Application WO/2024/032119

A1

A joint encoding method for multiple modality information sources. The joint encoding method comprises: first extracting features from a plurality of modality information sources by means of corresponding first encoders, and removing internal redundancy of each modality signal, so as obtain corresponding feature maps; then connecting the plurality of feature maps and inputting same into a second encoder, such that the feature maps are decoupled into a common feature map and personalized feature maps, wherein the common feature map represents the common part among the different modality information sources, and each personalized feature map represents the unique feature of each modality information source; and finally, decoding the personalized feature maps and the common feature map of the plurality of modality information sources by means of corresponding decoders, and reconstructing corresponding modality information sources, i.e. respectively converting, by means of entropy encoding, the feature maps into binary code streams, and storing or transmitting the binary code streams, and after entropy decoding is performed on the binary code streams at a decoding end, respectively restoring the binary code streams by means of the corresponding decoders, so as to obtain the corresponding modality information sources. The present invention reduces, by using the correlation between different information sources, the repeated transmission of related information, such that a transmission bandwidth is reduced, and a storage space is saved on; and a decoding end restores different modality information sources, thereby achieving the scalability of the modalities.

JPH06245078	ENCODING DEVICE FOR DIGITAL PICTURE DATA
JP4831114	Image coding device, image coding program, image decoding device and image decoding program
JP2011014948	IMAGE ENCODING METHOD, IMAGE ENCODING DEVICE, AND IMAGE RECORDING AND REPRODUCING DEVICE USING THEM

SONG XIAODAN (CN)
LI FU (CN)
GAO DAHUA (CN)
XIE XUEMEI (CN)
SHI GUANGMING (CN)

PCT/CN2023/098536

February 15, 2024

June 06, 2023

Click for automatic bibliography generation  

UNIV XIDIAN (CN)

H04N19/136; H04N19/40; H04N19/91

CN115604475A	2023-01-13
CN114202024A	2022-03-18
CN110807122A	2020-02-18
CN112800292A	2021-05-14
CN113591902A	2021-11-02
US20190347523A1	2019-11-14
JP2019220974A	2019-12-26

XI'AN CYDA INTELLECTUAL PROPERTY AGENCY (CN)

View/Download PDF      PDF Help

Previous Patent: OVERVOLTAGE PROTECTION CIRCUIT AND METHOD, AND POWER SUPPLY SYSTEM

Next Patent: COMMUNICATION METHOD AND APPARATUS