To provide an entering and leaving managing system in which use frequency such as the number of entering and leaving for prescribed areas can be clearly obtained, and whether or not an object to be detected is present in the prescribed areas can be detected.

In an entering and leaving management system 1, sensor means 11-19 are arranged at the doorway or windows or the like of prescribed areas(for example, a building 3, rooms 31-35, or corridor 36). Those sensor means 11-19 photograph an entering and leaving object to be detected, and executes a picture processing for calculating the number of the objects to be detected and the moving direction based on a photographed picture signal. The data of the number of the objects to be detected and the moving direction obtained by those sensor means 11-19 are inputted to a managing means 20 provided in a managing room 51. A managing means 20 manages the objects to be detected entering or leaving the prescribed areas (for example, the building 3, rooms 31-35, or corridor 36) based on the data from the sensor means 11-19.