To provide a damper device and a structure that can be manufactured comparatively easily and at lower cost and that can maintain initial performance.

By arranging packing concrete 13 on the surface of a shear panel 14 via an insulation material 17 and a gap and restricting out-of-plane deformation of the shear panel 14 by the packing concrete 13, a damper device 10 can be obtained which does not require welding joint of ribs in all directions on the shear panel 14, which can prevent the change of mechanical properties by heat at the time of welding and the local concentration of stress, that can obtain a good deformation performance which hardly causes metal fatigue, and which is excellent in energy absorbing performance. Since welding can be made unnecessary, the quantity of steel materials can be reduced. Moreover, since an out-of-plane deformation restricting means is structured with the packing concrete 13 filled into the steel pipe 12 (a binding means) and mortar, the damper device 10 can be manufactured comparatively easily and at lower cost and the manufacturing cost can be reduced.