To obtain the subject fabric hardly causing physical and chemical irritation to wearer and having good touch feeling by removing surface fluff by cellulolytic enzyme treatment and attaching a natural compound hardly causing irritation to skin or having affinity for skin.

A cellulosic fiber fabric is subjected to cellulolytic enzyme treatment to decompose and remove surface fluff and decrease physical irritation to skin due to fluff. Then, a natural compound having low irritation to skin or good affinity for skin (preferably a substance useful for skin, e.g. extract of Aloe ferox Miller or Houttuynia cordata, hyaluronic acid or squalane) to decrease chemical irritation to skin.