Title:
METHOD OF GENERATING FULLBODY ANIMATABLE PERSON AVATAR FROM SINGLE IMAGE OF PERSON, COMPUTING DEVICE AND COMPUTER-READABLE MEDIUM IMPLEMENTING THE SAME
Document Type and Number:
WIPO Patent Application WO/2024/095077
Kind Code:
A1
Abstract:
The present application relates AI-based image synthesis and processing. Disclosed is a computer-implemented method of generating fullbody animatable avatar of a person from a single image of the person. This method involves improving the rendering of a person's image to create a full-body avatar in a new pose. The process includes obtaining the person's image and a body model with pose, shape, and camera parameters, creating a mapping between image pixels and texture coordinates, sampling the texture and generating texture using an encoder-generator network. This generated texture is combined with the original texture and filled in using an inpainting model. The full-body avatar is then rendered in a new pose using a neural renderer. This approach enhances rendering quality for unseen body parts and may reduce memory and computing resource consumption by using compressed latent features for inpainting.
Inventors:
SVITOV DAVID VIACHESLAVOVICH (RU)
GUDKOV DMITRII IUREVICH (RU)
BASHIROV RENAT MARATOVICH (RU)
LEMPITSKY VICTOR SERGEEVICH (RU)
GUDKOV DMITRII IUREVICH (RU)
BASHIROV RENAT MARATOVICH (RU)
LEMPITSKY VICTOR SERGEEVICH (RU)
Application Number:
PCT/IB2023/059427
Publication Date:
May 10, 2024
Filing Date:
September 25, 2023
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
International Classes:
G06T13/40; G06N3/0455; G06T5/00; G06T15/04; G06T15/20
Domestic Patent References:
| WO2017137948A1 | 2017-08-17 |
Foreign References:
| US20220207810A1 | 2022-06-30 | |||
| US20220036626A1 | 2022-02-03 | |||
| US20120218262A1 | 2012-08-30 | |||
| US20190035149A1 | 2019-01-31 |
Attorney, Agent or Firm:
KIM, Tae-hun et al. (KR)
Download PDF: