To provide a system for stereoscopically matching a video image sequence real time.

A real time stereoscopic video matching system comprises a video processing unit 12 for converting videos input from left and right side cameras 10 and 11 into digital signals, calculating a prescribed matching cost from pixel pair of one scanning line of the converted digital video signals, tracing a deciding value for deciding a minimum matching cost, and outputting a decided value by prescribed active information for deciding whether it is operated or not as a binocular difference inferred value. Thus, an effect capable of stereo matching real time by parallel processing the video image sequence by using an algorithm based on new dynamic programming optimized by a Bayesian sense.