To adequately reduce labor loads of a driver of a vehicle, and to adequately and efficiently perform cargo handling to the vehicle in a cargo handling system realized by the vehicle transporting a cargo and a cargo center handling the transported cargo.

This cargo handling system consists of the vehicle T transporting the cargo P and the cargo center S handling the transported cargo P. The cargo center S includes a truck yard 100 allowing the vehicle T to stop with its rear side directed, and a carrying device 200 arranged in the truck yard 100 and carrying the cargo P to the rear side of the vehicle T. The truck yard 100 has width allowing a plurality of vehicles T to stop in parallel. The carrying device 200 includes a conveying table 200a advancing/retracting the cargo P to the rear side of the vehicle T, and a lateral movement mechanism 200b moving the conveying table 200a in the parallel direction of the vehicle T with the cargo P placed thereon. The vehicle T includes a cargo handling device 400 for a vehicle performing cargo handling work to a loading space B for loading the cargo P.