To provide a virtual surgery simulation system simulating the work of a surgery at the same sight line as the actual surgery without using models.

When a user stands in front of a three-dimensional image display device 10, puts on a liquid crystal shutter type spectacles 40, and moves a grip 51, this virtual surgery simulation system 1 allows a main PC 20 to display a parallax error image three-dimensionally displayed when looking through the liquid crystal shutter type spectacles 40 on the three-dimensional image display device 10 based on a human model data and surgical appliance model data. Then, the main PC three-dimensionally displays a virtual surgical appliance and the virtual human body overlapped on the grip 51 in front of the user and, when the virtual surgical appliance approaches to the virtual body, the main PC 20 calculates the operation that the virtual surgical appliance is elastically deformed, cuts, or penetrates relative to the virtual human body, displays the virtual human body formed by updating the human model data, and produces a repulsive force at the grip 51 responding to the operation applied to the virtual human body by an inner force sense device 50.