Title:
RENDERING MODEL TRAINING METHOD AND APPARATUS, VIDEO RENDERING METHOD AND APPARATUS, AND DEVICE AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2023/174182
Kind Code:
A1
Abstract:
The present application belongs to the technical field of image processing. Disclosed are a rendering model training method and apparatus, a video rendering method and apparatus, and a device and a storage medium. The rendering model training method comprises: acquiring a first video, which comprises the face of a target object (201); on the basis of a three-dimensional face model, mapping a facial action of the target object in the first video, so as to obtain a second video, which comprises a three-dimensional face (202); and using the second video as an input of an initial rendering model and using the first video as an output of the initial rendering model to perform supervision, and training the initial rendering model, so as to obtain a target rendering model (203). A second video generated on the basis of a three-dimensional face model is used as a sample for training a rendering model, so as to avoid the need to record a large number of low-definition videos under a relatively high recording requirement before the rendering model is trained, thereby reducing the computation resources and time required when the rendering model is trained.
Inventors:
ZHANG ZIYANG (CN)
WANG YAOYUAN (CN)
LI MINGLEI (CN)
HE WEIHUA (CN)
ZHANG YUHAN (CN)
CHENG JIE (CN)
WANG YAOYUAN (CN)
LI MINGLEI (CN)
HE WEIHUA (CN)
ZHANG YUHAN (CN)
CHENG JIE (CN)
Application Number:
PCT/CN2023/080880
Publication Date:
September 21, 2023
Filing Date:
March 10, 2023
Export Citation:
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06T15/00
Foreign References:
| CN113822977A | 2021-12-21 | |||
| CN111783986A | 2020-10-16 | |||
| US20200013212A1 | 2020-01-09 | |||
| CN202210273192A | 2022-03-18 |
Attorney, Agent or Firm:
BEIJING SAN GAO YONG XIN INTELLECTUAL PROPERTY AGENCY CO., LTD. (CN)
Download PDF: