To provide a portable communication device that prolongs the lifetime of a battery by suppressing the power consumption by minimizing actuation of a reader writer, and an IC card system using the same.

The portable communication device 1 comprises a card storage part, the reader writer 12, a transceiver 14, an information storage part 15, and a power source part 10, and is provided with a switch which controls electric power supply between the reader writer 12 and the power supply part 10 when the IC card 4 is stored in the card storage part so as to control the actuation of the reader writer 12 and further to communicate using card information stored in the information storage part 15, thereby suppressing the number of times of actuation of the reader writer to save electric power.