Title:
STEREO VIDEO GENERATION METHOD BASED ON 3D CONVOLUTIONAL NEURAL NETWORK
Document Type and Number:
WIPO Patent Application WO/2018/119808
Kind Code:
A1
Abstract:
A stereo video generation method based on a 3D convolutional neural network, used to convert a source 2D video into a stereo video playable on a 3D stereo display apparatus. The method comprises the following steps: preparing a sufficient number of non-animated 3D films as training data, and separating 3D source videos into left-eye image sequences and right-eye image sequences; removing opening portions, credits portions, and blank frames, then employing the fuzzy C-means clustering algorithm to perform shot segmentation on the left-eye image sequences, organizing a training file by using shot as unit, calculating a mean value for all of the left-eye image sequences, subtracting the mean value from the images, and using the right-eye image sequences as a training objective; and using the training data to train a constructed 3D convolutional neural network until convergence. In this way, the present invention enables acquisition of a stereo video by performing shot segmentation on a 2D source video to be converted into a stereo video, subtracting a training image mean therefrom, inputting the subtraction result into the 3D convolutional neural network acquired via training to obtain a right-eye video image sequence of the 2D video, and then combining the 2D video and the right-eye video image sequence to form the stereo video.
Inventors:
WANG XUN (CN)
ZHU LEQING (CN)
WANG HUIYAN (CN)
ZHU LEQING (CN)
WANG HUIYAN (CN)
Application Number:
PCT/CN2016/112812
Publication Date:
July 05, 2018
Filing Date:
December 29, 2016
Export Citation:
Assignee:
UNIV ZHEJIANG GONGSHANG (CN)
International Classes:
G06T3/00
Foreign References:
| CN106504190A | 2017-03-15 | |||
| CN105979244A | 2016-09-28 | |||
| CN103716615A | 2014-04-09 | |||
| CN102932662A | 2013-02-13 | |||
| CN102223553A | 2011-10-19 | |||
| US20120051625A1 | 2012-03-01 |
Attorney, Agent or Firm:
HANGZHOU QIUSHI PATENT OFFICE CO., LTD. (CN)
Download PDF: