To provide a shift lever device compact in size realizing an oscillation or restriction against the oscillation of the shift lever in an arbitrary direction under a small number of component parts.

A pivot ball 38 of a lever main body 31 is oscillatably supported by a first spherical bearing 51 formed at a retaining bracket 22 and a second spherical bearing 52 formed at a lever holder 41. A first pivot pin 53 is protruded at the pivot ball 38 facing toward the first spherical bearing 51, and a second pivot pin 54 is protruded at the second spherical bearing 52. A first long hole 55 is punched at a long hole piece 25 of the retaining bracket 22 and then the first pivot pin 53 is fitted into the first long hole 55. In addition, a second long hole 56 is punched at the second spherical bearing 52 of the lever holder 41 and a second pivot pin 54 is fitted into the second long hole 56.