To allow even a user who does not have any special operation knowledge or technique to operate this device by providing a substitute processing mechanism visualized on a metaphor environment.

This metaphor interface device is provided with an inputting device 2 for detecting the input coordinate position of a user corresponding to a display device 1 and converting it into event data corresponding to the state of a metaphor environment, an operation substitute device 5 for receiving a substitute processing procedure, outputting event data equivalent to those obtained by the operation of the user and realizing the substitute executing function of the user operation, an event interpreting device 3 for receiving the event data, selectively executing the corresponding function from the function group, outputting the executed result, generating a substitute processing procedure corresponding to a certain operation at the time of receiving event data requesting the substitute execution of the operation and outputting it to the operation substitute means, and a metaphor environment generating device 4 for forming a new display screen expressing the executed result by using a metaphor and outputting the state of the new metaphor environment to the inputting device 2.