To enable a user to designate utilization of a real scene for an image control apparatus in the image control apparatus for a video game or the like wherein an image on a display screen of a television or the like is changed reacting to an operation of the user.

A real image represented with a luminance/color difference signal 114 outputted by a video signal converting circuit 103 based upon an image pickup operation by a CCD 101 is mixed with a CG image transferred from a ROM 107 by a VDP 104, and stored in a VRAM 105 as background data or object data. The VDP 104 discriminates whether the background data or object data read out of the VRAM 105 to be displayed are codes or the luminance/color difference signals, and generates corresponding digital RGB signals 115 for image display.