To provide an apparatus and method for processing output data from an image sensor that can obtain high image quality even when a difference of the intensity in different colors sensed by optional pixels of the image sensor is not constant and also not constant and can be adapted to horizontal edges, vertical edges, diagonal line edges, corner edges, and thick or thin edges of a video image.

The apparatus is provided with; line modules; a delay module, a selector for directivity coefficient; and an adaptive interpolation unit, and processes output data of the image sensor by utilizing a plurality of directivity coefficients. A plurality of the directivity coefficients are a first directivity coefficient that denotes whether an edge has a horizontal component, a vertical component or a diagonal line component, a second directivity coefficient that indicates a degree of the horizontal edge components, and a third directivity coefficient that denotes a degree of the vertical edge component.