PURPOSE: To provide the unspecified speaker speech recognizing device which has high robust performance to variation on the time base and frequency base of a specific word and also has a high recognition rate.

CONSTITUTION: This speech recognizing device is equipped with speech analyzing means (11-14) which analyzes inputted speech signals and generate monitor waveform data, and a data recognizing means 15 having a means which generates one identification system identified with data for identification corresponding to the specific word that one unspecified person voices and plural evaluation systems identified with data for evaluation corresponding to specific words that other speakers voice, and a means which finds the minimum sum of squares of the differences between similarity estimated values obtained by inputting respective evaluation data to corresponding evaluation systems for the specific words and similarity estimated values obtained by inputting the respective evaluation data to the identification system.