GENERATING THREE-DIMENSIONAL FACIAL DATA

WIPO Patent Application WO/2021/008444

A1

Generating 3D facial data using a neural network. According to a first aspect, this specification describes a computer implemented method of generating three-dimensional facial data using a generator neural network, the method comprising: inputting, into the generator neural network, initialization data, the initialization data comprising noise data (2.1); processing the initialization data through a plurality of neural network layers of the generator neural network to generate UV maps in a plurality of modalities, the UV maps comprising a shape UV map of a face, a texture UV map of the face, and a normal UV map of the face (2.2); and outputting, from the generator neural network, facial data comprising the UV maps in the plurality of modalities (2.3). The generator neural network (302) comprises: an initial set (320) of neural network layers configured to generate a plurality of feature maps (322) from the initialization data; a first branch (326) of neural network layers configured to generate the shape UV map (314) of the face from one or more of the plurality of feature maps (322); a second branch (328) of neural network layers configured to generate the texture UV map (316) of the face from one or more of the plurality of feature maps (322); and a third branch (330) of neural network layers configured to generate the normal UV map (318) of the face from one or more of the plurality of feature maps (322).

WO/2019/011740	A METHOD AND APPARATUS FOR ENCODING/DECODING A POINT CLOUD REPRESENTING A 3D OBJECT
JP4799010	Patient tomography 3D display filtering method and medical tomography system
WO/2015/086036	METHOD FOR THE POSITIONALLY ACCURATE PROJECTION OF A MARK ONTO AN OBJECT, AND PROJECTION APPARATUS

GECER BARIC (GB)
ZAFEIRIOU STEFANOS (GB)

PCT/CN2020/101206

January 21, 2021

July 10, 2020

Click for automatic bibliography generation  

HUAWEI TECH CO LTD (CN)

G06T17/00

CN108805977A	2018-11-13
US20170046563A1	2017-02-16
US20180365874A1	2018-12-20

DENG, JIANKANG ET AL.: "UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition", 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, 17 December 2018 (2018-12-17), pages 7093 - 7100, XP033473628, DOI: 327A
GUI, JIAMIN ET AL.: "Real-time 3D Facial Subtle Expression Control Based on Blended Normal Maps", 2015 8TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN, 12 May 2016 (2016-05-12), XP032899776, DOI: 20200928161512A

View/Download PDF      PDF Help

Previous Patent: INTELLIGENT BURIED LIGHT FOR VEHICLE-ROAD COOPERATION SIGNAL-CONTROLLED INTERSECTION

Next Patent: RAPID DETECTION AND DETERMINATION METHOD FOR FDY NETWORK ANOMALY