To obtain a highly moisture-absorbing and releasing woven or knit fabric having a multilayer structure, giving little stuffy feeling in summer season and excellent heat-insulation in winter season and having excellent appearance by using a yarn containing a specific highly moisture-absorbing and releasing staple fiber as a part of the system and placing the yarn at a part of the fabric excluding the outermost layer of the woven or knit fabric having a multilayer structure.

A yarn containing a highly moisture-absorbing and releasing staple such as highly crosslinked polyacrylate fiber at least in a part of the yarn (preferably containing filaments mixed in a part of the yarn) is present in at least a part of a multilayer fabric excluding the outermost layer of the fabric. The staple has a water content of ≥20% at 20°C and 65%RH and a moisture releasing ratio of ≥15% when the staple is transferred from an environment of 20°C and 90%RH to an environment of 20°C and 45%RH. The highly moisture absorbing and releasing staple preferably has a moisture absorption heat of ≥20J/g in the case of immersing in water of 20°C after equilibrating the moisture content of the staple in an environment of 20°C and 40%RH.