Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHOD FOR OPERATING AN OUTPUT DEVICE FOR A MOTOR VEHICLE, OUTPUT DEVICE AND MOTOR VEHICLE WITH SUCH AN OUTPUT DEVICE
Document Type and Number:
WIPO Patent Application WO/2017/012685
Kind Code:
A1
Abstract:
A method for operating an output device (10) for a motor vehicle (36), in which method light and/or sound is emitted by at least one output element (18, 19) of the output device (10), with at least the following steps: - detecting at least one parameter by means of a control device (12), the parameter being indicative of at least one state of mind of an occupant (34), - comparing the at least one parameter with a data set (14), comprising data being indicative of at least one predetermined state of mind, - determining a present state of mind (32) of the occupant on the basis of the comparison between the parameter and the data set (14), and - adjusting an emission (11 ) of light and/or an emission (11) of sound of the output element by means of the control device on the basis of the determined present state of mind (32).

Inventors:
KAUSCH CARSTEN (CN)
Application Number:
PCT/EP2016/001033
Publication Date:
January 26, 2017
Filing Date:
June 17, 2016
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
AUDI AG (DE)
International Classes:
B60Q9/00; B60K28/06; B60Q1/50; B60W50/14; G06F1/16; G06F3/01; G08B21/06
Foreign References:
DE102013018784A12015-05-13
US20030227778A12003-12-11
DE202005014791U12005-12-22
DE102012000629A12013-07-18
DE102005036941A12006-08-03
DE102006009636A12007-09-06
DE102012013549A12013-01-24
DE102013001258A12014-08-14
Download PDF:
Claims:
CLAIMS:

1. A method for operating an output device (10) for a motor vehicle (36), in which method light and/or sound is emitted by at least one output ele- ment (18, 19) of the output device (10),

characterized by the steps of,

- detecting at least one parameter by means of a control device (12), the parameter being indicative of at least one state of mind of an occupant (34),

- comparing the at least one parameter with a data set (14), comprising data being indicative of at least one predetermined state of mind,

- determining a present state of mind (32) of the occupant on the basis of the comparison between the parameter and the data set (14), and

- adjusting an emission (11 ) of light and/or an emission (11 ) of sound of the output element by means of the control device on the basis of the determined present state of mind (32). 2. The method according to claim 1 ,

characterized by,

adjusting the emission (11 ) of light and/or the emission (11 ) of sound by means of a mobile device (20). 3. The method according to claim 1 or 2,

characterized by,

adjusting the emission (11 ) of light and/or the emission (11 ) of sound by . means of a gesture input device (22). 4. The method according to any one of the preceding claims,

characterized by,

adjusting the emission (11 ) of light and/or the emission (11 ) of sound by means of a touch screen (24). 5. The method according to any one of the preceding claims,

characterized by,

adjusting the emission (11 ) of light and/or the emission (11 ) of sound by means of a voice input device (26).

6. The method according to any one of the preceding claims,

characterized by,

adjusting the emission (11 ) of light and/or the emission (11) of sound by means of a mental companion device (28).

7. An output device (10) for a motor vehicle (36), the output device (10) comprising at least one output element (18, 19) for emitting light and/or sound,

characterized in that,

the output device (10) comprising a control device (12) for detecting at least one parameter, the parameter being indicative of at least one state of mind of an occupant (34), wherein the control device (12)

- is capable of comparing the at least one parameter with a data set (14), comprising data being indicative of at least one predetermined state of mind,

- is capable of determining a present state of mind (32) of the occupant (34) on the basis of the comparison between the parameter and the data set (14), and

- is capable of adjusting an emission (11 ) of light and/or an emission (11 ) of sound of the output element (18, 19) on the basis of the determined present state of mind (32).

8. The output device (10) according to claim 7,

characterized in that,

the output element (18, 19) is designed as an organic light-emitting-diode or as a loud speaker.

9. The output device (10) according to claim 7 or 8,

characterized in that,

the control device (12) and the output element (18, 9) are spaced apart from each other and the output device (10) comprises means (30) for transmitting and receiving signals between the control device (12) and the output element (18, 19), in dependency on which signals an emission (11 ) of light and/or an emission (11 ) of sound of the output element (18, 19) is adjustable.

10. Motor vehicle (36) with an output device (10) according to anyone of claims 7 to 9.

Description:
Method for operating an output device for a motor vehicle, output device and motor vehicle with such an output device

DESCRIPTION:

The invention relates to a method for operating an output device and to an output device for a motor vehicle of the kind specified in the preambles of the independent claims as well as to a motor vehicle with an output device. The usage of output devices e.g. for the purpose of entertainment is sufficiently well known from the prior art. Furthermore, controlling such output devices without contact is widely used, especially in the automotive sector. For example, such an output device can be designed as hands-free speaking system which may be controlled by a voice input of an occupant of a motor vehicle. Such systems, which may be operated contact free lead to a significant increase of traffic safety, since the drivers of motor vehicles are less distracted, when they do not have to search for small buttons or handles in order to operate a system. US 7224262 B2 discloses an intuitively-operable, highly flexible remote vehicle component operating device, provided for wireless remote control of the operation of vehicle components such as a door lock or an entertainment system. An electronic host device, such as a PDA or a mobile telephone, is coupled to a vehicle-specific transponder, and a user interface program exe- cuted on the host device allows a user to select a desired vehicle component , operating command for execution. The selected operating command is sent to the transponder for transmission to the vehicle, and a vehicle receiver forwards the selected command to the target component for execution. The transponder may contain vehicle-specific information which the vehicle re- ceiver may use to verify in order to operate the vehicle.

YP 2005306336 A provides a lighting device and a illuminance sensor for detecting the illuminance provided inside a cabin. The brightness of the lighting device is controlled by a control device so that the illuminance inside the cabin detected by the illuminance sensor becomes a preset target illuminance. The target illuminance can be changed by illuminance change command data transmitted from a speaking party through a television telephone device and the illuminance inside the cabin is adjustable so as to become easy to watch for the speaking party,

JP 2001053844 A discloses an illuminating device of a vehicle with an illuminating means for illuminating the compartment of a vehicle, a carrier power detecting means for detecting a carrier power outputted from a radio tele- phone device such as a portable telephone, a speech and judging means for judging the end of speech of the radio telephone device based on the detected output of the carrier power detecting means and an illumination controlling means for allowing the illuminating means to illuminate the compartment of the vehicle when the end of speech of the radio telephone device is judged by the speech and judging means.

It is an object of the present invention to provide a method and an output device of the initially mentioned kind, by means of which the traffic safety can be further increased.

This object is solved by a method for operating an output device as well as by an output device for a motor vehicle having the features of the independent claims, as well as by a motor vehicle with an output device. Advantageous embodiments of the invention are specified in the dependent claims.

In the method according to the invention for operating an output device for a motor vehicle, in which method light and/or sound is emitted by at least one output element of the output device, at least one parameter is detected by means of a control device, the parameter being indicative of at least one state of mind of an occupant. The at least one parameter is compared with a data set, comprising data being indicative of at least one predetermined state of mind. A present state of mind of the occupant is determined on the basis of the comparison between the parameter and the data set and an emission of light and/or an emission of sound of the output element is adjusted by means of the control device on the basis of the determined present state of mind.

The output device can be designed as a light emitting output device and additionally or alternatively as a sound emitting output device. In other words, the output device can be used to emit light and additionally or alternatively to emit sound. Accordingly, the output elements can be designed as a light emitting panel, particularly as an OLED-Panel (organic light emitting diode panel) and additionally or alternatively as a sound panel.

The output device comprises at least one sensor in order to detect the aforementioned state of mind of an occupant of the motor vehicle. The state of mind can correspond to different kinds of mood or to different kinds of conditions of one ore more occupants (e.g. the driver) of the motor vehicle. Thus, the state of mind can correspond to a condition of e.g. aggressiveness, excitement or sadness, to name but a few kinds of conditions. In other words the mood of one or more occupants can be detected by means of the control device. This is of special advantage, since if e.g. the driver is in a condition, in which he is less watchful with respect to the traffic, the control device can adjust the output device depending on the detected (determined) present state of mind. For example, if the driver is angry about something, this condition ('angriness') is detected by the control device (by means of an appropriate sensor) and is evaluated as the present state of mind 'angriness'. In order to do so, e.g. the parameter 'loudness' and additionally or alternatively the parameter 'facial expression' which can be representative for the condition of the occupant is detected by the sensor or by a plurality of sensors. This parameter (here: the loudness and/or facial expression) is compared to the dataset, wherein the dataset comprises data which are indicative of the state of mind 'angriness' (amongst other data related to other states of mind). Thus, the data may correspond to data for evaluating the loudness of a voice, by means of which the control device can derive, if the respective person (occupant) is in normal mood or in abnormal mood, such as the aforementioned angriness, or fatigue, sadness or happiness, to name but a few examples for the mood. It is clear, that the parameter can correspond to many other indicative parameters, such as e.g. the frequency of eye-blinking, the heart rate as well as the reaction speed of the driver, to name but a few kinds of parameters.

After determining the present state of mind (e.g. 'angriness') the control device adjusts the output device based on the determined state of mind in such a manner, that e.g. in the case of angriness a calming light and additionally or alternatively a calming sound is emitted. Such a calming light can e.g. be a soft blue light. In order to warn other road users that the driver is currently less watchful due to his state of mind, the output element of the output device can also emit a blinking light, similar to a warning light or a hazard light. Thus, the output device can also comprise several output elements, wherein one of the output elements may be used to emit light/sound for the driver and hence may be directed towards the driver and another output element may be used to emit light for other road users and thus the other output element can be directed towards a window of the motor vehicle. In other words, the driver may be calmed by blue light by one of the output elements, and the other road users may be warned with a warning light or a hazard light emitted by another output element, wherein the blue light and the warning light (or hazard light) can be directed into different directions.

In contrast to solutions known from the prior art, by means of the output de- vice the emission of light and/or sound can be adjusted by detecting the unconsciously expressed state of mind of at least one of the occupants. Furthermore, in dependency on the determined state of mind or mood of the occupant, the output element can be adjusted in such a manner, that it emits light and additionally or alternatively sound in order to generate an opposite state of mind. For example, if the detected state of mind correspond to 'an- griness', the opposite state of mind correspond to a 'balance' of the occupant.

It is clear, that the data of the dataset correspond to default data which allow for evaluating the present state of mind. For example, the default values of the data which are indicative of at least one predetermined state of mind may correspond to a certain volume of a voice of an occupant. The control device can also be designed as a self learning system which means, that different parameters, such as a voice volume or a facial expression, the heart rate or the frequency of eye-blinks, to name but a few, can be recorded, wherein the values of the parameters can be classified as normal values (e.g. indicative for a balanced state of mind) or an abnormal value of the parameters (e.g. for 'angriness' or 'enthusiasm') based on how often the respective values of the parameters are reached.

An advantageous embodiment of the invention provides an adjustment of the emission of light and/or the emission of sound by means of a mobile device. The control device and the mobile device each comprise means for wire- lessly transmitting and receiving signals. In other words, by means of the mobile device, signals are transmitted to the control device and the control device adjusts the emission of light and additionally or alternatively the emis- sion of sound based on this signals. The mobile device can be designed e.g. as a mobile phone, wherein a mobile app is used to steer the output element of the output element. By using a mobile phone, the driver can knowingly and thus actively steer the emission of light and/or sound. Furthermore, the mobile device may correspond to e.g. a pulse frequency measurement device, which detects the heart rate of e.g. the driver. Thus, the pulse frequency measurement device is used to unknowingly (passively) steer the output element. If the heart rate is low, which may be an indicator for a 'sleepy' condition as the state of mind, the control device adjusts the output element in such a manner, that the output element increases the brightness and/or the color of the emitted light. Additionally or alternatively the sound emission can be adjusted and e.g. the volume of music is increased in order to keep the driver awake. On the other hand, if the control device detects, that the occupant (especially the driver) is nervous or upset, the output element can be adjusted in such a manner, that it emits e.g. blue and dim light and additionally or alternatively calming music.

In an advantageous configuration of the invention the emission of light and/or the emission of sound is adjusted by means of a gesture input device. The gesture input device comprises means for transmitting and receiving signals to/from the control device. In other words, by means of the gesture input device, signals can be transmitted to the control device, wherein the control device adjusts the emission of light and additionally or alternatively the emission of sound based on the signals. By means of the gesture input device, an occupant can actively influence the emission of light and additionally or alternatively of sound in an especially ergonomic manner.

In an advantageous embodiment of the invention, the emission of light and/or the emission of sound is adjusted by means of a touchscreen. The touch- screen, which corresponds e.g. to a car display, comprises means for transmitting and receiving signals to/from the control device. In other words, by means of the touchscreen, signals are transmitted to the control device and the control device adjusts the emission of light and/or the emission of sound based on this signals. By means of such a touchscreen, an especially ergo- nomic way of actively operating the emission is given.

In a further advantageous development of the invention the emission of light and/or the emission of sound is adjusted by means of a voice input device. The voice input device also comprises means for transmitting and receiving signals to/from the control device. By means of the voice input device, an especially comfortable way of actively operating the emission of light/sound is given.

In an advantageous configuration of the invention, the emission of light and/or the emission of sound is adjusted by means of a mental companion device. The mental companion device also comprises means for transmitting and receiving signals to/from the control device. The mental companion de- vice allows for monitoring several parameters related to the state of mind of one or more occupants. Examples for these parameters are e.g. the heart frequency, the breathing rate or the eye-blink frequency, to name but a few. Thus, it is of special advantage to use these parameters detected by the mental companion device and to adjust the output device or the output ele- ment, respectively, in dependency on these parameters, because the mental companion device allows for an especially appropriate emission of light and/or sound according to the detected state of mind. The mental companion device can detect the condition of several occupants and thus may be used to adjust the emission of light/sound in such a manner, that a setting of the emission is chosen, which is at least passably appropriate for the detected states of mind of the different occupants. In other words, by means of the mental companion device, an average setting of the emission may be chosen, wherein the average setting is based on an average of the different present states of mind of the occupants.

The different present states of mind can also be weighted differently. This means, that it may be more important to calm down an 'angry' occupant, than putting another occupant's mind at ease, who is merely 'euphoric'. Furthermore, the control device may prioritize the present state of mind of the driver, since his condition is extremely safety relevant and thus more important, than calming down e.g. an 'angry' fellow passanger.

The output device according to the invention for a motor vehicle comprises at least one output element for emitting light and/or sound. The output device comprises a control device for detecting at least one parameter, the parameter being indicative of at least one state of mind of an occupant, wherein the control device

- is capable of comparing the at least one parameter with a dataset, comprising data being indicative of at least one predetermined state of mind,

- is capable of determining a present state of mind of the occupant on the basis of the comparison between the parameter and the dataset and

- is capable of adjusting an emission of light and/or an emission of sound of the output element on the basis of the determined present state of mind.

This output device allows for an especially appropriate reaction based on a certain state of mind of a person. The output device is capable of emitting light and additionally or alternatively sound in such a manner, that the state of mind of the respective person is influenced positively.

In an advantageous configuration of the invention, the output element is de- signed as an organic light-emitting-diode or as a loud speaker. The output device may comprise one or more output elements, which are designed as a loud speaker and another one or more output elements, which are designed as an LED. It is of special advantageous to use organic light emitting diodes (OLED) as output elements, since OLEDs are flexible and can also be at- tached in a 'bent shape'. Thus, this OLED may be attached e.g. to the head- liner of the motor vehicle especially easy. Mounting the OLED in its bent, and thus at least slightly prestressed condition allows for an especially uniform light distribution, which would be not possible with ordinary LEDs or other lamps, in other words, a uniform illumination intensity may be achieved at the surfaces of the interior of the motor vehicle on which the light emitted by the OLEDs impinges. This is of advantage, because the illumination by means of the OLED is particularly close to the illumination achieved by daylight. Preferably, the light and additionally or alternatively sound emitting output elements are arranged behind the driver, so that the driver is not distracted by the emitted light or even distracted by the light source. Thus, in contrast to systems known from the prior art in which lamps are arranged in the instrument board of the motor vehicle, the occupant perceives a light emitted by the output element not directly, but rather by illuminating the area in front of the occupant by the output element, wherein the output element is preferably arranged behind the driver. Since the output device can comprise one ore more (organic) light-emitting-diodes and additionally or alternatively one ore more loud speakers, both optical signals and acoustic signals can be emitted by an especially compact output device. Thus, different kinds of sensory or- gans are activated by the output device, which may be arranged in an especially space saving manner, e.g. inside the motor vehicle.

In a further particularly advantageous embodiment of the invention, the control device and the output element are spaced apart from each other and the output device comprises means for transmitting and receiving signals between the control device and the output elements, in dependency on which signals an emission of light and/or an emission of sound of the output element is adjustable. The control device and the output element can be spaced apart from each other, which is of special advantage, since an available space for mounting the output device can be utilised particularly good. The means for transmitting and receiving signals allow for a wireless communication between the control device and the output elements, whereby e.g. a motor vehicle may be upgraded with the output device easily and without the need for installing cables for connecting the control device with the output elements.

The invention further relates to a motor vehicle comprising an output device according to the present invention. Advantageous embodiments of the method according to the present invention are to be regarded as advanta- geous embodiments of the output device according to the present invention and as advantageous embodiments of the motor vehicle according to the present invention and vice versa.

Further advantages, features and details of the invention derive from the fol- lowing description of preferred embodiments as well as from the drawing. The features and feature combinations previously mentioned in the description as well as features and feature combinations mentioned in the following description of the figures and/or shown in the figures alone can be employed not only in the respective indicated combination but also in any other combi- nation or taken alone without leaving the scope of the invention.

The drawings show in: Fig. 1 a side view on a motor vehicle which is equipped with an output device according to the invention;

Fig. 2 a perspective view on an output element which is designed as an organic light-emitting-diode (OLED) at presents; and in a schematic illustration of several devices which may be used for a communication with a control device of the output device. Fig. 1 shows a side view on a motor vehicle 36, wherein the motor vehicle 36 is equipped with an output device 10 at present. The output device 10 comprises a control device 12, at least one sensor 16 and several output elements 18, 19, wherein the control device 12, the sensor 16 and the output elements 18, 19 are spaced apart from each other. In the present embodi- ments, the output device 10 comprises merely one sensor 16, by means of which a parameter, which is indicative of a present state of mind of an occupant 34 (here: the driver of the motor vehicle 36) can be detected. If e.g. a present state of mind 32 of the occupant 34 corresponds to 'sadness' or 'an- griness' the sensor 16 may detect e.g. 'the volume of the voice' or 'a sad fa- cial expression', to name but a few examples for parameters being indicative of the present state of mind 32 of the occupant 34.

The control device 12 is capable of comparing the at least one parameter with a dataset 14, which is comprising data being indicative of at least one predetermined state of mind. Thus, the data describe different default kinds of moot or different states of mind, such as 'happiness', 'sadness', 'angri- ness', 'excitement', or even 'a state of distraction', to name but a few examples. For example, the sensor 16 may be capable of detecting a parameter being indicative of a deviation between the current view of the occupant 34 and a straight view through the windshield while the motor vehicle 36 is in motion.

The control device 12 is capable of determining a present state of mind 32 of the occupant 34 on the basis of the comparison between the parameter (or several parameters) being indicative of one ore more predetermined states of mind) and the dataset 14. The control device 12 is also capable of adjusting an emission 11 of light and additionally or alternatively an emission 11 of sound of the output element 18, 19 on the basis of the determined present state of mind 32. Preferably, at least one of the output elements 18, 19 is designed as an organic light-emitting-diode (OLED) and at least another of the output elements 18, 19 is designed as a loud speaker. Thus, different kinds of sensory organs of the occupant 34 can be activated by these different output elements 18, 19. It is of further advantage, if at least the light emit- ting output element 18 is arranged in the interior of the motor vehicle 36 and behind the driver. In the embodiment shown in Fig. 1 , both the output element 18 (which is designed as OLED) and the output element 19 (which is designed as a loud speaker) are arranged at the headliner of the motor vehicle 36 above the backseats (and thus behind the driver). The arrangement of at least the light emitting output element 18 behind the occupant 34 (the driver) is of special advantage, because the occupant 34 is not distracted when the output element 18 emits light, because the emitted light is used to illuminate the surroundings of the driver (e.g. the instrument panel) instead of being directed towards the eyes of the occupant 34. Thus, in contrast to sys- terns known from the prior art, in which a light symbol in the instrument panel may distract the driver from the traffic, the light emitted by the output element

18 is perceived by the driver indirectly due to an illumination of the surroundings of the driver. If for example the detected parameter indicates the present state of mind 32 'angriness' a calming blue light is emitted by the output element 18 and e.g. a favourite song of the occupant 34 is emitted by the output element 19 in order to calm down the occupant 34 and thus to change the present state of mind 32 from 'angriness' into 'happiness' or at least into 'equilibrium'.

Fig. 2 shows a perspective view on the output element 18 which is designed as OLED at present. The output element 18 (the OLED) is shown in 'bent condition' which allows for an especially uniform light distribution over a large area within the interior of the motor vehicle 36. As mentioned above, the con- trol device 12 and the output elements 18, 19 are spaced apart from each other. The output device 10 comprises means 30 for transmitting and receiving signals between the control device 12 and the output elements 18, 19, in dependency on which signals the emission 11 of light and additionally or alternatively the emission 11 of sound of the output elements 18, 19 is adjust- able. In other words, both the control device 12 and the output elements 18,

19 comprise such means 30 for transmitting and receiving signals.

Fig. 3 shows a schematic illustration of different devices which may be used for communication with the output device 10 via the control device 12. As it was mentioned above, the occupant 34 can influence the adjustment of the emissions 11 unknowingly since the output device 10 reacts on the present state of mind 32 of the occupant 34. Such an unknowing influence of the emission 11 can be also achieved by means of a mental companion device 28. In addition, by means the mental companion device 28 a plurality of both the aforementioned parameters which may be derived without contact and measured values such as the heart frequency, the breathing rate or the eye blink frequency, to name but a few can be evaluated in order to adjust an especially appropriate emission 11 of light and additionally or alternatively of sound according to the detected present state of mind 32. Thus, the mental companion device 28 can be used to derive measured values (with appropriate sensors) which cannot be measured contact free and the mental companion device 28 can be used to choose an appropriate setting of the emission 11 on the basis of an average of all detected present states of mind 32 of all occupants 34 of the motor vehicle 36.

The devices which are described in the following are examples for means for active adjustment of the emission 11 of the output elements 18, 19. The emission 11 can be adjusted by means of a mobile device 20, or by means of a gesture input device 22 or by means of a touchscreen 24 or by means of a voice input device 26, to name but a few devices, by means of which the emission 11 may be adjusted by active contribution of the occupant 34.

In order to achieve an especially smooth light appearance, the output ele- ment 18 (OLED) can comprise an interior fitting box with a certain opacity (transparence) with an appearance of e.g. opal glas. The means 30 for transmitting and receiving signals may be designed as a W-LAN- or Bluetooth-Receiver by means of which the OLED-panel (the output element 18) can be steered by means of both the control device 12, the mental compan- ion device 28, or the aforementioned other devices (active steering by means of the mobile device 20, the gesture input device 22, the touchscreen 24, or the voice input device 26). It is clear, that both color or color schemes as well as color-animations and the brightness or the brightness schemes or brightness-animations of the light emitting output 18 is adjustable. This schemes or animations can be actively steered by e.g. a mobile app (of the mobile device 20) by means of a head unit front end software (of the touchscreen 24, of the gesture input device 22 or the voice input device 26). The color schemes can also be steered passively by means of a mental companion software of the mental companion device 28 and, as mentioned above, of course by means of the determined present state of mind 32.

The sound and color-scheme functions which may be adjusted for the re- spective output elements 18, 19 correspond to e.g. a conformation (adjustment) of emitted music (in dependency on the determined present state of mind 32), a warning with maximum attraction (warning sound, warning blinking, or e.g. red warning lights), to name but a few. Furthermore, the adjustable color schemes and sound schemes may be related to information such as e.g. an incoming phone call, navigation information, a short message service (SMS), traffic information, refuel information or service information to name but a few. It is clear, that the emission 11 of light can also be used for the purpose of reading books or news.

In summary the output device 10 can be used for the emission 11 of light and additionally or alternatively for the emission of sound, whereby causing a shock due to a dazzling light or a distraction from the traffic can be avoided.