Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SYSTEMS AND METHODS FOR MULTI-FRAME VIDEO FRAME INTERPOLATION
Document Type and Number:
WIPO Patent Application WO/2021/175041
Kind Code:
A1
Abstract:
Systems and methods for multi-frame video frame interpolation. Higher-order motion modeling, such as cubic motion modeling, achieves predictions of intermediate optical flow between multiple interpolated frames, assisted by relaxation of the constraints imposed by the loss function used in initial optical flow estimation. A temporal pyramidal optical flow refinement module performs coarse-to-fine refinement of the optical flow maps used to generate the intermediate frames, focusing a proportionally greater amount of refinement attention to the optical flow maps for the high-error middle frames. A temporal pyramidal pixel refinement module performs coarse-to-fine refinement of the generated intermediate frames, focusing a proportionally greater amount of refinement attention to the high-error middle frames. A generative adversarial network (GAN) module calculates a loss function for training the neural networks used in the optical flow estimation module, temporal pyramidal optical flow refinement module, and/or temporal pyramidal pixel refinement module.

Inventors:
CHI ZHIXIANG (CA)
MOHAMMADI NASIRI RASOUL (CA)
LIU ZHENG (CA)
TANG JIN (CA)
LU JUWEI (CA)
Application Number:
PCT/CN2021/073451
Publication Date:
September 10, 2021
Filing Date:
January 23, 2021
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06N3/04
Domestic Patent References:
WO2019168765A12019-09-06
Foreign References:
US20170221218A12017-08-03
US20190138889A12019-05-09
CN109949221A2019-06-28
US20180091768A12018-03-29
Download PDF:
View/Download PDF      PDF Help



 
Previous Patent: VIDEO PROCESSING METHOD AND RELATED DEVICE

Next Patent: SUSPENSION DEVICE, SUSPENSION DAMPING DEVICE AND SIX-WHEEL BIONIC CHASSIS