METHOD AND APPARATUS FOR PREVENTING ACCIDENTS CAUSED BY DROWSINESS IN A VEHICLE DRIVER FIELD AND BACKGROUND OF THE INVENTION The present invention relates to a method and apparatus for preventing accidents caused by drowsiness in a driver of an automotive vehicle while operating the vehicle.

One of the most serious causes of vehicle accidents, particularly those resulting in fatalities, is the danger that the vehicle driver may fall asleep while at the wheel. Many devices have been proposed to detect the onset of drowsiness in a driver while driving the vehicle. For example, see U. S. Patents 6,130, 617,6, 346, 887 and 6,559, 770, disclosing systems for monitoring eye movements of the driver to detect the onset of drowsiness; U. S. Patents 4,594, 583 and 6,087, 943 disclosing systems for monitoring steering movements, particularly the lack of a steering movement in a predetermined time interval, for providing an indication of drowsiness ; and U. S. Patent 4,504, 979 disclosing a system for monitoring the driver's gripping pressure gripping the steering wheel to indicate the possibility of the onset of drowsiness. However, the devices heretofore proposed have been largely ineffective for one reason or another since none has entered into widespread use, and therefore the high rate of such accidents continues unabated.

OBJECTS AND BRIEF SUMMARY OF THE PRESENT INVENTION An object of the present invention is to provide a new method and apparatus for preventing accidents caused by drowsiness in a driver of an automotive vehicle.

According to one aspect of the present invention, there is provided a method of preventing accidents caused by drowsiness in a driver of an automotive vehicle while operating the vehicle, comprising: mounting a mobile telephone handset having a camera and an audible ringer at a location and orientation in the vehicle such that the camera views at least a predetermined portion of the vehicle or of the body of the driver while driving the vehicle; detecting a predetermined condition in the portion of the vehicle or driver's body viewed by the camera indicating the onset of drowsiness in the

driver; and actuating the audible ringer when detecting the predetermined condition indicating the onset of drowsiness in the driver.

According to one embodiment, the mobile telephone handset is mounted such that the camera views at least a portion of the face of the driver while operating the vehicle, and the alarm is actuated when a predetermined movement of the viewed portion of the driver's face is detected indicating the onset of drowsiness.

According to another described preferred embodiment, the mobile telephone handset is mounted such that the camera views at least one hand of the driver on the steering wheel while operating the vehicle, and the alarm is actuated when the lack of movement of the viewed hand is detected for a predetermined period of time indicating the onset of drowsiness.

In a further described embodiment, the mobile telephone handset is mounted such that the camera views at least a portion of the steering wheel of the vehicle, and the alarm is actuated when the lack of movement of the viewed portion of the steering wheel is detected for a predetermined period of time indicating the onset of drowsiness.

According to another aspect of the present invention, there is provided apparatus for preventing accidents caused by drowsiness in a driver of an automotive vehicle while driving the vehicle, comprising: a mobile telephone handset having an audible ringer; a camera; a mounting device for mounting the camera at a location and orientation in the vehicle such that the camera views a predetermined portion of the vehicle or of the body of the driver while driving the vehicle; and a control system configured for detecting a predetermined condition in the portion of the vehicle or of the driver's body viewed by the camera indicating the onset of drowsiness in the driver, and for actuating the ringer when detecting the predetermined condition.

In one preferred embodiment of the invention described below, the mounting device mounts the camera such that the camera is oriented to view at least a portion of the face of the driver while operating the vehicle; and the control system detects a predetermined movement of the viewed portion of the driver's face indicating the onset of drowsiness and actuates the ringer of the telephone handset. For example, the control system could detect a predetermined drooping of the driver's head, drooping of the

driver's chin, closing of the driver's eyelids for a period of time, or any combination of the above conditions indicating the onset of drowsiness.

In another described embodiment, the mounting device mounts the mobile telephone handset such that the camera views at least one hand of the driver on the steering wheel while driving the vehicle, or a marker on the steering wheel; and the control system detects the lack of movement of the viewed hand or marker for a predetermined period of time indicating the onset of drowsiness, and actuates the alarm at that time.

In some described embodiments, the camera is incorporated in the mobile telephone handset; and in other described embodiments, the camera is in a separate unit from the mobile telephone handset and communicates with the handset via a wired, or a wireless, communication channel.

According to another aspect of the present invention, there is provided apparatus for preventing accidents caused by drowsiness in a driver of an automotive vehicle while driving the vehicle, comprising: a mobile telephone handset including an audible ringer; and a drowsiness detector system for detecting a condition indicating the onset of drowsiness in the driver, and for actuating the ringer when such condition is detected.

According to yet another aspect of the present invention, there is provided apparatus for preventing accidents caused by drowsiness of a driver of an automotive vehicle while driving the vehicle, comprising: a mobile telephone handset including a camera; a mounting device for mounting the mobile telephone handset at a location and orientation in the vehicle such that the camera views a predetermined portion of the vehicle or of the body of the driver while driving the vehicle; an audible arm; and a control system for detecting a predetermined condition in the portion of the vehicle or the driver's body viewed by the camera such as to indicate the onset of drowsiness in the driver, and for actuating the audible alarm when the predetermined condition is detected.

In one described preferred embodiment, the control system is the controller of the mobile telephone handset programmed for producing an output alarm signal to the alarm when the detected movement of the portion of the driver's body (e. g. , face)

viewed by the camera indicates the onset of drowsiness in the driver. The mobile telephone handset may further include means for selectively enabling and/or disabling the controller from producing the output alarm signal. The latter means could be, for example, a voice recognition circuit for recognizing a voice command by the driver, or a key on the keyboard of the mobile telephone handset programmed or dedicated to perform this function.

In one described preferred embodiment, the alarm is or includes the ringing circuit of the mobile telephone handset. A further embodiment is described wherein the control system is or includes a controller in a unit added to the mobile telephone handset to receive and process the electrical output of the camera such as to produce an output alarm signal to the alarm when the detected movement of the portion of the driver's body viewed by the camera indicates the onset of drowsiness in the driver. The added unit may include a separate audible alarm, or the alarm could also be the ringing circuit of the mobile telephone handset.

According to yet another aspect of the present invention, there is provided apparatus for preventing accidents caused by drowsiness in a driver of an automotive vehicle while driving the vehicle, comprising: a driver-condition sensor for monitoring a predetermined condition of the driver while driving the vehicle, and for producing an output corresponding to the monitored driver-condition; a vehicle-condition sensor for monitoring a predetermined condition of the vehicle while it is being driven by the driver; and for producing an output corresponding to the monitored vehicle condition ; an alarm; and a processor for processing the outputs of the driver-condition sensor and vehicle-condition sensor, and for actuating the alarm when the outputs indicate the onset of drowsiness in the driver while driving the vehicle.

In a preferred embodiment of the invention described below, the driver- condition sensor includes an optical device which monitors a predetermined portion of the driver's body to detect a predetermined condition indicating the possible onset of drowsiness ; and the vehicle-condition sensor monitors the movement or lack of movement of the vehicle steering wheel for a predetermined time interval indicating the possible onset of drowsiness in the driver of the vehicle. In the described preferred embodiment, at least one of the latter sensors is included in a mobile telephone handset

mounted in the vehicle, and the alarm is the audible ringer of the mobile telephone handset.

Further features and advantages of the invention will be apparent from the description below.

BRIEF DESCRIPTION OF THE DRAWINGS The invention is herein described, by way of example only, with reference to the accompanying drawings. With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of the preferred embodiments of the present invention only, and are presented in the cause of providing what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention.

In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understanding of the invention, the description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice.

In the drawings: Fig. 1 pictorially illustrates one form of apparatus constructed in accordance with the present invention; Fig. 2 is a block diagram illustrating the apparatus of Fig. 2 implemented in an existing mobile telephone handset by appropriately programming its controller to perform the described functions; Fig. 3 is a block diagram illustrating the apparatus of Fig. 1 implemented in a separate unit to be added to a standard mobile telephone handset; Fig. 4 illustrates apparatus similar to that of Fig. 1 but including a modification wherein the camera is separate from the mobile telephone handset, and communicates with it via a wired communication channel; Fig. 5 illustrates apparatus similar to that of Fig. 4 but showing the separate camera communicating with the mobile telephone handset via a wireless communication channel;

Fig. 6 illustrates apparatus similar to that of Fig. 1, but including a first sensor for monitoring a predetermined condition of the driver while driving the vehicle, and a second sensor for monitoring a predetermined condition of the vehicle while it is being driven by the driver, both outputs being processed by a processor, preferably a mobile telephone handset, for actuating an alarm, preferably the audible ringer of the telephone handset, when the outputs indicate the onset of drowsiness in the driver while driving the vehicle; and Fig. 7 illustrates an arrangement similar to that of Fig. 6, except one or more sensors are provided for sensing one or more predetermined conditions of the driver and/or of the vehicle which indicate the possible onset of drowsiness.

DESCRIPTION OF PREFERRED EMBODIMENTS OF THE INVENTION Fig. 1 pictorially illustrates a vehicle driver 2 occupying the driver's seat 3 of a vehicle and gripping the steering wheel 4 in order to steer the vehicle while operating it and while viewing the outside environment via the vehicle windshield 5.

With the increasing use of mobile telephone handsets, such vehicles are commonly equipped with a mounting device 6 for mounting a mobile telephone handset or other mobile communication device, schematically shown at 10 in Fig. 1, for convenient use by the vehicle driver 2. Such mounting devices 6 commonly include a microphone and speaker, schematically shown at 7 and 8, respectively, together with circuitry powered via an electrical conductor 9, to enable the driver, in a"hands free" manner, to speak into the mobile telephone handset 10, and to audibly reproduce the output of the mobile telephone handset to the driver.

Such mobile telephone handsets or other mobile communication devices (hereinafter referred to collectively as mobile telephone handsets) have become highly sophisticated, and many now include cameras, links to the Internet, hand computers, etc.

As will be described more particularly below, the present invention utilizes modular telephone handsets, as shown at 10 in Fig. 1, also to perform the highly important function of detecting drowsiness in a driver of an automotive vehicle such as to substantially reduce the danger of the driver falling asleep while operating the

vehicle. Thus, the present invention utilizes the camera, the audible ringer, and/or the control circuit of the mobile telephone handset in a manner to alert the driver should the onset of drowsiness be detected.

Figs. 1 and 2 schematically illustrate one embodiment of the present invention wherein the mobile telephone handset 10 is programmed to perform the additional function of alerting a vehicle driver in the event drowsiness is detected. The illustrated mobile telephone handset 10 includes a camera 11 displaying an image on a screen 1 la, a microphone 12a, speaker 12b, and a keyboard 13. Fig. 2 also illustrates telephone circuitry 14 controlled by a telephone controller 15, a memory 16 and a telephone ringer 17 which is actuated when a calling party calls the respective mobile telephone handset.

In accordance with the present invention, the mounting device 6 is adjustably mounted and is used for mounting the mobile telephone handset 10 at a location and orientation in the vehicle such that the camera 11 views at least a predetermined portion of the body of the driver 2 while driving the vehicle, and/or a predetermined portion of the vehicle, such as the steering wheel 4. The telephone controller 15 of the mobile telephone handset would be programmed to perform the function of block 18 in Fig. 2, namely of detecting and processing a predetermined condition of the driver's body or of the vehicle, as viewed by the camera 11, such as to indicate the onset of drowsiness in the driver. For example, body movements of the driver may be monitored to detect a drooping of the driver's head or chin in such manner as to indicate the onset of drowsiness, or the closing of the driver's eyelids for a predetermined period of time such as to indicate the onset of drowsiness, etc.

Other driver conditions to be monitored may be the position of the driver's hands, or the lack movement of the driver's hands on the steering wheel for a predetermined period of time indicating the onset of drowsiness. Camera 11 may be used also for directly monitoring movement, or lack of movement, of the steering wheel itself for a predetermined period of time indicating the onset of drowsiness. For example, the steering wheel could be provided with markers, shown at 4a, viewed by the camera to detect lack of movement of the steering wheel for a predetermined period of time.

When such body or vehicle conditions are detected which indicate the onset of drowsiness, an alarm signal is produced and outputted by processor 18 to the telephone ringer 17 to actuate the ringer, and thereby to alert the driver of the dangerous condition.

The diagram of Fig. 2 further includes an enable/disable means 19 for enabling and/or disabling the drowsiness detector function of the controller 15. The enable/disable means 19 could be, for example, a voice recognition circuit which recognizes a voice command by the driver, e. g. ,"Enable Drowsiness Detector", or "Disable Drowsiness Detector". Alternatively, the Enable/Disable means of block 19 could be a key on the mobile telephone handset 10, or on the mounting device 6, dedicated or programmed to perform this function.

Fig. 3 is a block diagram including a mobile telephone handset, generally designated 20, illustrating the invention implemented in a separate add-on unit, generally designated 30, to be attached to, or otherwise in communication with, the mobile telephone handset 20.

Thus, the mobile telephone handset 20 illustrated in Fig. 3 also includes a camera 21, microphone 22a, speaker 22b, keyboard 23 and telephone circuitry 24, all controlled by the telephone controller 25 having a memory 26 and controlling the operation of the telephone including the telephone ringer 27. In order to adapt the mobile telephone handset 20 for detecting drowsiness, the separate unit 30 added to the handset includes a processor 31 for detecting a predetermined driver condition and/or vehicle condition, as described above, indicating the possible onset of drowsiness.

Processor 30 is connected to the telephone controller 25 to receive and process the electrical output of the camera 21. The arrangement is such that when the portion of the driver's body, or of the vehicle, viewed by the camera indicates the onset of drowsiness in the driver, processor 31 produces an output alarm signal to alert the driver.

In Fig. 3 the add-on unit 30 further includes a separate audible alarm 32 actuated by the alarm signal outputted from processor 31 when a drowsiness condition is detected from the body movements of the driver or from the vehicle condition (e. g., steering wheel) viewed by the camera. However, instead of having a separate audible alarm 32, the outputted alarm signal could be fed via the telephone controller 25 to the

telephone ringer 27 of the mobile telephone headset 20 to actuate it as in Fig. 2, and thereby to alert the driver of the alarm condition, namely the onset of drowsiness.

As further shown in Fig. 3, the add-on unit 30 preferably further includes means for selectively enabling and/or disabling the drowsiness detector function. The latter means, schematically indicated by block 33, could also be a voice recognition circuit which recognizes the"Enable"and/or"Disable"commands as described above with respect to Fig. 2, or a key dedicated or programmed to perform the Enable/Disable function.

In all other respects, the apparatus illustrated in Fig. 3 is constructed and used in the same manner as described above with respect to Figs. 1 and 2.

In Figs. 1-3 the mobile telephone handset is preferably mounted such that the camera views a predetermined area of the face of the driver, such as the eye area, and the control system actuates the alarm when a predetermined movement of the viewed portion of the driver's face is detected, such as eye-closure for a predetermined time, indicating the onset of drowsiness. It will be appreciated, however, that the mobile telephone handset could be mounted such that the camera views another portion of the driver's body, such as the chin, or the hands or a hand of the driver while operating the vehicle, whereupon the control system would actuate the alarm when the detecting a condition indicating the onset of drowsiness. For example, when the driver's chin is viewed, a drooping of the chin would indicate the onset of drowsiness; and when only one hand is viewed, or a viewed hand is not moved for a predetermined time, this would also indicate the onset of drowsiness.

As indicated above, the mobile telephone handset 10 may be mounted in the vehicle such that the camera 11 views a predetermined condition of the vehicle itself, such as movement of the steering wheel 4, to provide an indication of the possible onset of drowsiness. For example, the steering wheel 4 may be provided with a plurality of markers, shown at 4a, viewed by the camera 11 to detect the lack of movement of the steering wheel for a predetermined time, which lack of movement may also indicate the possible onset of drowsiness.

Fig. 4 illustrates a further arrangement which is similar to that of Fig. 1, and therefore, to facilitate understanding, the corresponding parts have been identified with

the same reference numerals. The main difference in the arrangement of Fig. 4 is that the camera (11, Fig. 1) used for detecting drowsiness in the driver is not incorporated in the mobile telephone handset 10, but rather is a separate unit, as shown at 111. In this case, the camera unit 111 would be mounted so as to view a predetermined portion of the driver's body and/or of the vehicle in order to monitor a predetermined driver condition and/or vehicle condition, to detect the onset of drowsiness in the manner described above. For example, camera 111 could be oriented so as to view the eye area of the driver to detect eye closure for a predetermined time interval, the chin of the driver to detect drooping of the head, one or both hands of the driver to detect proper placement of the hands on the steering wheel, lack of movement of the viewed hand or hands for a predetermined time interval, or markers 4a on the steering wheel to detect lack of movement of the steering wheel for a predetermined time interval. It will also be appreciated that more than one of the foregoing conditions could be detected and used in the determination of the onset of drowsiness.

Fig. 5 illustrates an arrangement similar to that of Fig. 4, except that the separate camera unit 111 communicates with the mobile telephone handset 10 via a wireless channel, rather than via the wired channel 112 illustrated in Fig. 4. Thus, camera unit 111 would include a transmitter 113 communicating with a receiver 114 carried by the mobile telephone handset 10.

Fig. 6 illustrates an arrangement wherein the mobile telephone handset 10 does not include a camera (11, Fig. 1), but rather includes another sensor, generally designated 114, for monitoring a predetermined condition of the driver while driving the vehicle and/or of the vehicle itself while it is being driven by the driver. For example, sensor 114 could be an optical sensor for sensing the closing of the eyes of the driver, drooping of the chin of the driver, the improper placement of both hands of the driver on the steering wheel, or the lack of movement of the steering wheel for a predetermined time interval, any of which conditions would indicate the possible onset of drowsiness. The output of sensor 114 would be processed, as described above, to produce a determination that the sensed condition indicates the onset of drowsiness on the part of the driver, and would actuate the ringer of the mobile telephone handset, or other alarm, to alert the driver when such a condition is sensed.

Fig. 7 illustrates an arrangement similar to that of Fig. 6, except one or more sensors are provided for sensing one or more predetermined conditions of the driver and/or of the vehicle which indicate the possible onset of drowsiness. For purposes of example, Fig. 7 illustrates a first sensor 120 for sensing predetermined conditions of the driver, particularly the driver's face, and a second sensor 130 for sensing a predetermined condition of the steering wheel 4. For example, sensor 120 could be a camera viewing the eye area to detect eye closure, or chin area to detect head-drooping; whereas sensor 130 could be an optical sensor monitoring the condition of the steering wheel 4 by sensing its markers 4a, in order to detect the lack of movement of the steering wheel for a predetermined time interval indicating the possible onset of drowsiness.

The outputs of the two sensors 120,130 are fed to the mobile telephone handset 10, which would be programmed to process such outputs and to actuate the telephone ringer, or other alarm, when the two outputs indicate the onset of drowsiness in the driver while driving the vehicle.

While the invention has been described with respect to several preferred embodiments, it will be appreciated that these are set forth merely for purposes of example, and that many other variations, modifications and applications of the invention may be made.

Although the invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations that fall within the spirit and broad scope of the appended claims. All publications, patents, patent applications and sequences identified by their accession numbers mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual publication, patent, patent application or sequence identified by their accession number was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present invention.