Title:
BLEND SHAPE VALUE OUTPUT METHOD, STORAGE MEDIUM AND ELECTRONIC APPARATUS
Document Type and Number:
WIPO Patent Application WO/2023/011221
Kind Code:
A1
Abstract:
A blend shape value output method and apparatus, and a storage medium and an electronic apparatus. The method comprises: performing feature extraction on acquired target audio data, so as to obtain a target audio feature vector (S102); inputting the target audio feature vector and a target identifier into an audio driving animation model (S104); inputting the target audio feature vector into an audio encoding layer which includes a plurality of convolutional layers, determining an input feature vector of the next layer at a moment (2t-n)/2 according to an input feature vector of the previous layer between a moment t and a moment t-n, determining, to be an effective feature vector, a feature vector which has a causal relationship with the input feature vector of the previous layer, sequentially outputting a target audio encoding feature according to the effective feature vector of each layer, and inputting the target identifier into a one-hot encoding layer to perform binary vector encoding, so as to obtain a target identifier encoding feature, wherein n < t (S106); and according to the target audio encoding feature and the target identifier encoding feature, outputting, by means of the audio driving animation model, a blend shape value corresponding to the target audio data (S108).
Inventors:
SIMA HUAPENG (CN)
TANG CUICUI (CN)
LIAO ZHENG (CN)
TANG CUICUI (CN)
LIAO ZHENG (CN)
Application Number:
PCT/CN2022/107491
Publication Date:
February 09, 2023
Filing Date:
July 22, 2022
Export Citation:
Assignee:
NANJING SILICON INTELLIGENCE TECH CO LTD (CN)
International Classes:
G06T13/20
Foreign References:
| CN113592985A | 2021-11-02 | |||
| CN111489424A | 2020-08-04 | |||
| CN110751708A | 2020-02-04 | |||
| CN1860504A | 2006-11-08 | |||
| US20200302667A1 | 2020-09-24 |
Attorney, Agent or Firm:
CHINABLE IP (CN)
Download PDF:
Previous Patent: DATA SYNCHRONISATION METHOD, TERMINAL, AND SYSTEM
Next Patent: STENT FOR BLOOD VESSEL
Next Patent: STENT FOR BLOOD VESSEL