To suppress the increase of a generation code amount when scene change is generated and to improve picture quality by providing a selection means for directly introducing the video signals of a frame immediately after the scene change passed through a second filter to an orthogonal transformation means when the scene change is detected or the like.

When a scene change detection circuit 3 detects the scene change, scene change detection signals are outputted to a selection circuit 8 and the output of a filter 7 whose upper limit value of a pass band is lowest is selected. The output video signals of the filter 7 selected when the scene cange detection signals are inputted by the selection circuit 8 are the frame immediately after the scene change. Thus, the video signals of the least information amount are selected in the selection circuit 8 and inputted to a subtraction circuit 9. Also, when the scene change detection circuit 3 detects the scene change, a switch 18 is opened, the video signals passed through the filter 7 are supplied to an orthogonal transformation circuit 10 and quantization is performed in a quantization circuit 11 for an obtained coefficient.