Title:
PARAMETER ESTIMATION MODEL TRAINING METHOD AND APPARATUS, AND DEVICE AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2022/095721
Kind Code:
A1
Abstract:
Provided are a parameter estimation model training method and apparatus, and a device and a storage medium. The parameter estimation model training method comprises: inputting each training sample in a facial image training set into a pre-constructed neural network model, estimating reconstruction parameters specified by 3D facial reconstruction, and inputting the reconstruction parameters into a pre-constructed 3D morphable model, so as to reconstruct a 3D face corresponding to the training sample; calculating a plurality of loss functions, under a plurality of pieces of 2D supervision information, between the 3D face and the training sample, and adjusting a weight corresponding to each loss function; and generating a fitting loss function on the basis of each loss function and the weight corresponding to each loss function, and performing inverse correction on the neural network model by using the fitting loss function, so as to obtain a trained parameter estimation model.
Inventors:
ZHANG XIAOWEI (CN)
HU ZHONGYUAN (CN)
LIU GENGDAI (CN)
HU ZHONGYUAN (CN)
LIU GENGDAI (CN)
Application Number:
PCT/CN2021/125575
Publication Date:
May 12, 2022
Filing Date:
October 22, 2021
Export Citation:
Assignee:
BIGO TECH PTE LTD (SG)
ZHANG XIAOWEI (CN)
ZHANG XIAOWEI (CN)
International Classes:
G06T17/00
Foreign References:
| CN112529999A | 2021-03-19 | |||
| CN109978989A | 2019-07-05 | |||
| CN110414370A | 2019-11-05 | |||
| US20160314619A1 | 2016-10-27 |
Other References:
"Master Thesis", 20 March 2020, UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA, article LUO YAO: "Research on the Method of 3D Face Reconstruction from a Single Image", pages: 1 - 82, XP055928390, DOI: 10.27005/d.cnki.gdzku.2020.001634
"Master Thesis", 1 May 2018, WUHAN UNIVERSITY OF TECHNOLOGY, article CHEN KE: "3D Face Reconstruction from Single Facial Image Based on Convolutional Neural Network", pages: 1 - 73, XP055928392
ZHOU JIAN, HUANG ZHANGJIN: "3D face reconstruction and dense face alignment method based on improved 3D morphable model", JOURNAL OF COMPUTER APPLICATIONS, JISUANJI YINGYONG, CN, vol. 40, no. 11, 10 November 2020 (2020-11-10), CN , pages 3306 - 3313, XP055928397, ISSN: 1001-9081, DOI: 10.11772/j.issn.1001-9081.2020030420
"Master Thesis", 1 May 2018, WUHAN UNIVERSITY OF TECHNOLOGY, article CHEN KE: "3D Face Reconstruction from Single Facial Image Based on Convolutional Neural Network", pages: 1 - 73, XP055928392
ZHOU JIAN, HUANG ZHANGJIN: "3D face reconstruction and dense face alignment method based on improved 3D morphable model", JOURNAL OF COMPUTER APPLICATIONS, JISUANJI YINGYONG, CN, vol. 40, no. 11, 10 November 2020 (2020-11-10), CN , pages 3306 - 3313, XP055928397, ISSN: 1001-9081, DOI: 10.11772/j.issn.1001-9081.2020030420
Attorney, Agent or Firm:
BEYOND ATTORNEYS AT LAW (CN)
Download PDF: