VIDEO TRANSLATION METHOD, SYSTEM AND DEVICE, AND STORAGE MEDIUM

WIPO Patent Application WO/2022/110354

A1

A video translation method, system and device, and a storage medium. The method comprises the following steps: obtaining video data; performing voice segmentation on the video data to obtain a voice segment and a video segment corresponding to the voice segment (S1); performing voice recognition on the voice segment to obtain a first text, and translating the first text to obtain a second text (S2); obtaining a synthesized voice according to the second text, and adjusting the synthesized voice and the video segment corresponding thereto, such that the synthesized voice matches with the video segment (S3); and detecting and adjusting a lip shape in the video segment, such that the lip shape synchronously matches with the synthesized voice (S4). By means of the method, the function of automatically translating a video is realized, an audio of a target language sound can be generated, a video having the sound matching the lip shape is generated, the communication obstacle between different languages is solved, manual dubbing is not needed, and the translation cost is reduced. The method can be widely applied to the field of video processing.

JP3599538	MOVING PICTURE AND SYNCHRONIZING SYSTEM BETWEEN TEXT AND VOICE CONVERTER
JP2002140196	INFORMATION REPRODUCING DEVICE AND INFORMATION RECORDING MEDIUM
JP2833138	[Title of Invention] Karaoke device

WANG LUNJI (CN)
YE JUEJIE (CN)
LI QUAN (CN)
CHENG QIUXI (CN)
HU YUZHEN (CN)
LI JIAXIONG (CN)
ZHU JIE (CN)
HAN LANQING (CN)

PCT/CN2020/136743

June 02, 2022

December 16, 2020

Click for automatic bibliography generation  

RES INST TSINGHUA PEARL RIVER DELTA (CN)
CYAGEN BIOSCIENCES GUANGZHOU INC (CN)

G10L21/10

US20150242394A1	2015-08-27
US20130195428A1	2013-08-01
CN104520923A	2015-04-15
CN104239394A	2014-12-24

JIAQUAN IP LAW (CN)

View/Download PDF      PDF Help

Previous Patent: MEMS GYROSCOPE

Next Patent: MAKE-AND-BREAK TESTING DEVICE AND METHOD FOR PRODUCT HOUSING