To provide a video tracking apparatus, a video tracking method and a video tracking program that can efficiently produce an accurate tracking result in tracking an object in video.

In an image processing system 100, one of a plurality of frame images stored in a storage section 40 is displayed as an initial image on a display section 20. When an operation section 4 is used to set a tracking condition in the initial image and command a start of tracking, a tracking operation is executed in the initial image and subsequent frame images. When the operation section 4 is used after a stop or end of the tracking operation to instruct any one of the plurality of frame images to be displayed as a new initial image, the new initial image is displayed on the display section 20. When the operation section 4 is further used to set a tracking condition again in the new initial image and command a start of tracking, a tracking operation is executed in the new initial image and subsequent frame images.