Title:
PREDICTING THE COMPLEXION OF THE SKIN USING A 3D FACIAL MODEL
Document Type and Number:
WIPO Patent Application WO/2023/198728
Kind Code:
A1
Abstract:
The invention relates to a method for determining the colour of the skin in an area of interest on a user, comprising: (i) importing at least one image containing a representation of the area of interest on the user; (ii) reconstructing the area of interest in 3D in order to generate the 3D model of the area of interest; (iii) UV unwrapping the 3D model onto at least one projected plane in order to obtain a UV map for each projected plane; (iv) processing the UV map using a learning model;(v) evaluating the colour of the skin in the area of interest.
Inventors:
BA SILEYE (FR)
PERROT MATTHIEU (FR)
DUPONT DE DINECHIN LOUIS (FR)
MALHERBE EMMANUEL (FR)
PERROT MATTHIEU (FR)
DUPONT DE DINECHIN LOUIS (FR)
MALHERBE EMMANUEL (FR)
Application Number:
PCT/EP2023/059472
Publication Date:
October 19, 2023
Filing Date:
April 12, 2023
Export Citation:
Assignee:
OREAL (FR)
International Classes:
G06V40/16; G06V10/60
Domestic Patent References:
| WO2014168678A9 | 2015-10-29 |
Foreign References:
| US10936853B1 | 2021-03-02 | |||
| US20210209427A1 | 2021-07-08 | |||
| US20200041350W | 2020-07-09 |
Other References:
CARLOS ALIAGA ET AL: "Estimation of Spectral Biophysical Skin Properties from Captured RGB Albedo", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 26 January 2022 (2022-01-26), XP091140987
KIPS ROBIN ET AL: "Beyond color correction: Skin color estimation in the wild through deep learning", ELECTRONIC IMAGING, 1 January 2020 (2020-01-01), XP055850777, Retrieved from the Internet [retrieved on 20211013], DOI: 10.2352/ISSN.2470-1173.2020.5.MAAP-082
FENG YAO YFENG@TUEBINGEN MPG DE ET AL: "Learning an animatable detailed 3D face model from in-the-wild images", ACM TRANSACTIONS ON GRAPHICS, ACM, NY, US, vol. 40, no. 4, 19 July 2021 (2021-07-19), pages 1 - 13, XP058930478, ISSN: 0730-0301, DOI: 10.1145/3450626.3459936
SONG GUOXIAN ET AL: "Recovering facial reflectance and geometry from multi-view images", IMAGE AND VISION COMPUTING, ELSEVIER, GUILDFORD, GB, vol. 96, 27 February 2020 (2020-02-27), XP086141792, ISSN: 0262-8856, [retrieved on 20200227], DOI: 10.1016/J.IMAVIS.2020.103897
ROBIN KIPS ET AL: "CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 24 August 2020 (2020-08-24), XP081890729, DOI: 10.1007/978-3-030-67070-2_17
KIPS ROBIN ET AL: "Beyond color correction: Skin color estimation in the wild through deep learning", ELECTRONIC IMAGING, 1 January 2020 (2020-01-01), XP055850777, Retrieved from the Internet
FENG YAO YFENG@TUEBINGEN MPG DE ET AL: "Learning an animatable detailed 3D face model from in-the-wild images", ACM TRANSACTIONS ON GRAPHICS, ACM, NY, US, vol. 40, no. 4, 19 July 2021 (2021-07-19), pages 1 - 13, XP058930478, ISSN: 0730-0301, DOI: 10.1145/3450626.3459936
SONG GUOXIAN ET AL: "Recovering facial reflectance and geometry from multi-view images", IMAGE AND VISION COMPUTING, ELSEVIER, GUILDFORD, GB, vol. 96, 27 February 2020 (2020-02-27), XP086141792, ISSN: 0262-8856, [retrieved on 20200227], DOI: 10.1016/J.IMAVIS.2020.103897
ROBIN KIPS ET AL: "CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 24 August 2020 (2020-08-24), XP081890729, DOI: 10.1007/978-3-030-67070-2_17
Attorney, Agent or Firm:
L'OREAL (FR)
Download PDF: