Title:
LEARNING METHOD FOR GENERATING LIP-SYNC VIDEO ON BASIS OF MACHINE LEARNING AND LIP-SYNC VIDEO GENERATING DEVICE FOR EXECUTING SAME
Document Type and Number:
WIPO Patent Application WO/2022/255529
Kind Code:
A1
Abstract:
Disclosed are a learning method for generating a lip-sync video on the basis of machine learning, and a lip-sync video generating device for executing the method. A lip-sync video generating device based on machine learning according to a disclosed embodiment comprises: a video synthesis model which is an artificial neural network model, and generates a lip-sync video by using a person background video and an utterance audio signal as an input; and a lip-sync determination model which is an artificial neural network model, and determines a degree of accordance between the lip-sync video generated by the video synthesis model and the utterance audio signal input to the video synthesis model.
More Like This:
Inventors:
CHAE GYEONG SU (KR)
Application Number:
PCT/KR2021/007643
Publication Date:
December 08, 2022
Filing Date:
June 17, 2021
Export Citation:
Assignee:
DEEPBRAIN AI INC (KR)
International Classes:
G10L21/10; G06N3/04; G06N3/08; G10L19/00; G10L25/30; G10L25/57
Foreign References:
| KR20020022504A | 2002-03-27 | |||
| JP2008148084A | 2008-06-26 | |||
| US20060139490A1 | 2006-06-29 | |||
| KR100300962B1 | 2001-10-27 |
Other References:
K R PRAJWAL; RUDRABHA MUKHOPADHYAY; VINAY NAMBOODIRI; C V JAWAHAR: "A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild", ARXIV.ORG, 23 August 2020 (2020-08-23), pages 1 - 10, XP081746748, DOI: 10.1145/3394171.3413532
Attorney, Agent or Firm:
CHANG, Young Tae (KR)
Download PDF:
Previous Patent: POWER CONNECTION MODULE-EQUIPPED ELECTRIC PILE DRIVER
Next Patent: ITEM DELIVERY MANAGEMENT METHOD AND APPARATUS THEREFOR
Next Patent: ITEM DELIVERY MANAGEMENT METHOD AND APPARATUS THEREFOR