To provide a sheet conveying device which can specify a failure occurring spot in conveyance of a sheet with simple constitution, and an image reading device including the sheet conveying device.

A transmitting side opening 103C and a transmitting side opening 103B, and a receiving side opening 104C and a receiving side opening 104B are arranged across a second separation roller 34 and a second separation piece 35 in an X-axis direction. The transmitting side opening 103B and a transmitting side opening 103A, and the receiving side opening 104B and a receiving side opening 104A are arranged across a conveying roller 36 and a driven roller for conveyance 37 in the X-axis direction. Whether or not the failure occurs in the conveyance of the sheet is determined based on time when an ultrasonic wave is received by an ultrasonic wave receiving part 106 through the receiving side openings 104A to 104C and an amplitude value of the ultrasonic wave received by the ultrasonic wave receiving part 106. When determining that the failure occurs in the conveyance of the sheet, the failure occurring spot is specified.