Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
DEVICE AND METHOD FOR DISPLAYING A VISUAL FLOW TO PREVENT MOTION SICKNESS ON AUTONOMOUS VEHICLES
Document Type and Number:
WIPO Patent Application WO/2023/126669
Kind Code:
A1
Abstract:
A device for counteracting motion sickness for a user in a vehicle moving in a direction along a route by displaying a visual image flow, comprising: a display for displaying said visual image flow, and an electronic data processor; wherein the electronic data processor is configured for: receiving indication of vehicle's direction of movement; displaying, in said display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the user's location in the vehicle. Operation method thereof.

Inventors:
CASTRO VILAS BOAS VERA PATRICIA (PT)
MARTINS MARQUES COSTA NÉLSON BRUNO (PT)
FREITAS DE SOUSA EMANUEL AUGUSTO (PT)
MACKAY ANDRADE ANA MARGARIDA (PT)
MARQUES COUTINHO MANUEL SEBASTIÃO (PT)
MACHADO CARVALHO ADRIANO DÍDIMO (PT)
Application Number:
PCT/IB2021/062501
Publication Date:
July 06, 2023
Filing Date:
December 30, 2021
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
BOSCH CAR MULTIMEDIA PORTUGAL SA (PT)
UNIV DO MINHO (PT)
International Classes:
B60Q3/70; B60K35/00
Domestic Patent References:
WO2019212633A12019-11-07
Foreign References:
US20070198183A12007-08-23
DE102019124386A12021-03-11
US20200331386A12020-10-22
JP2008230575A2008-10-02
US20200384240A12020-12-10
US20190061655A12019-02-28
US10259451B22019-04-16
US20190047498A12019-02-14
CN112977460A2021-06-18
Attorney, Agent or Firm:
PATENTREE (PT)
Download PDF:
Claims:
C L A I M S A device for counteracting motion sickness for a user in a vehicle moving in a direction along a route by displaying a visual image flow, comprising: a display (1) for displaying said visual image flow, and an electronic data processor; wherein the electronic data processor is configured for: receiving indication of vehicle's direction of movement; displaying, in said display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the user's location in the vehicle. The device according to any of the previous claims wherein the electronic data processor is further configured for receiving said indication of the vehicle's direction of movement from a self-driving system of the autonomous vehicle. The device according to the previous claim comprising a communication device and the electronic data processor being configured for communicating with a remote system to receive said indication of the vehicle's direction of movement. The device according to any of the previous claims wherein the electronic data processor is further configured for receiving said indication of the vehicle's direction of movement from a navigation system of the vehicle. The device according to any of the previous claims wherein the electronic data processor is further configured for estimating said indication of the vehicle's direction of movement from a route map provided by a navigation system of the vehicle. The device according to any of the previous claims comprising an additional display for displaying said visual image flow for an additional user, and the electronic data processor being further configured for: displaying, in said additional display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the additional user's location in the vehicle. The device according to any of the previous claims wherein the electronic data processor is configured for displaying the visual image flow comprising a moving plurality of dots or texture in advance of the vehicle's movement, particular 0.5-5 seconds in advance, further in particular 1-2 seconds in advance. The device according to any of the previous claims wherein the electronic data processor is further configured for initiating the display of the visual image flow comprising a moving plurality of dots or texture when the vehicle is detected to have initiated movement. The device according to any of the previous claims wherein the electronic data processor is further configured for initiating the display of the visual image flow comprising a moving plurality of dots or texture when a user indication is received by the device. The device according to any of the previous claims wherein the electronic data processor is further configured for initiating the display of the visual image flow comprising a moving plurality of dots or texture when a probability of motion sickness is determined to be above a predetermined threshold. The device according to any of the previous claims wherein the electronic data processor is further configured for detecting a change of user's location in the vehicle and adjusting the displaying of the visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the changed user's location in the vehicle. The device according to any of the previous claims wherein the electronic data processor is further configured for stopping the display of the visual image flow comprising a moving plurality of dots or texture when an indication is received from the user. The device according to any of the previous claims wherein the display is adjustable to be fully opaque to fully transparent, and the electronic data processor is further configured for adjusting the display opacity from an indication received from the user. The device according to any of the previous claims wherein the display is adjustable to be fully opaque to partly transparent, and the electronic data processor is further configured for adjusting the display opacity from an indication received from the user. An operation method of a device for counteracting motion sickness for a user in a vehicle moving in a direction along a route by displaying a visual image flow, the method comprising using said electronic data processor for: receiving indication of vehicle's direction of movement; displaying, in said display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the user's location in the vehicle.
Description:
DEVICE AND METHOD FOR DISPLAYING A VISUAL FLOW TO PREVENT MOTION SICKN ESS ON AUTONOMOUS VEHICLES

TECHNICAL FIELD

[0001] The present disclosure relates to a device and a method to prevent motion sickness in a vehicle. More particularly, relates to a device and method to prevent autonomous vehicle occupants from experiencing motion sickness, by displaying a visual image flow, in particular dots or patterns, in an interior of the vehicle, the visual flow correlating with the vehicle motion.

BACKGROUND

[0002] The document US2019061655A1 discloses a method and apparatus for preventing motion sickness of vehicle occupants designed to display a motion image in a vehicle interior to convey visual information to the occupants regarding the vehicle's current and upcoming movements. The motion image includes a plurality of patterns with the same shape and different sizes arranged concentrically to create a three- dimensional image based on perspective representation, and changes the patterns in advance of upcoming vehicle movements. The occupants can perceive such moving patterns in their peripheral vision and consciously or unconsciously process and anticipate the vehicle movements.

[0003] The document US10259451B2 discloses a system and method for mitigating motion sickness. When motion sickness is predicted, the motion sickness mitigation system alters vehicle performance, cabin conditions, and/or alerts the occupant to upcoming vehicle actions, to avoid or alleviate motion sickness. A controller includes a processor that receives an occupant profile and traffic information for an upcoming trip of the vehicle on a route. Using the occupant profile and the traffic information, the processor calculates whether the occupant will experience motion sickness when the vehicle travels on the route. A vehicle performance signal correlated to the calculation, is delivered by the processor to initiate motion sickness mitigation. The vehicle performance signal varies operation of a steering actuator, an acceleration actuator, and/or a brake actuator to implement the motion sickness mitigation.

[0004] The document US20190047498A1 discloses a systems and techniques for an adaptive display for preventing motion sickness. In an example, an adaptive display system is adapted to determine, such as from sensor information, movement of a vehicle. The sensor information may be obtained from sensors installed in the vehicle. The adaptive display system may display, to a passenger of the vehicle, visual content that changes orientation in correspondence to the movement of the vehicle. The adaptive display system may be further adapted to determine a gaze direction of the passenger and display the visual content in the gaze direction of the passenger. The adaptive display system may be further adapted to obtain physiological data about the passenger and determine the passenger is experiencing motion sickness.

[0005] Document CN112977460A discloses a method and apparatus for preventing motion sickness when viewing image content in traveling vehicle.

[0006] These facts are disclosed in order to illustrate the technical problem addressed by the present disclosure.

GENERAL DESCRIPTION

[0007] The present disclosure relates to a screen with visual information (textures flow or "stream") regarding the current or proceeding movements of the vehicle which presents great potential in the autonomous vehicles' industry, helping to prevent motion sickness while also showing interesting content to the passengers.

[0008] Motion Sickness (MS) is a main concern in the upcoming self-driving paradigm. Although there are many theories regarding the causes of MS, the most widely accepted theory to explain MS is the Sensory Rearrangement Theory, which predicts the symptoms to occur whenever one sensory system generates signals to the brain that are not in agreement with another set of sensory signals (Griffin, 2012; Mansfield, 2017).

[0009] Autonomous cars intend to allow drivers to disengage from the driving task and everyone will become a passenger. Occupants are free to engage in tasks other than driving, and therefore, MS symptoms are more prone to occur due to a decrease in the anticipation of the vehicle motion and the road ahead.

[0010] Although there is a similar concept that proposes displaying a three- dimensional image based on perspective representation which changes the patterns in advance of upcoming vehicle movements, the present disclosure will provide a configurable texture stream, where various templates will be available, over a screen with transparency/opacity regulation.

[0011] There are no disclosures in the state of the art that comprises a system such as the presented now. Although there is a similar concept that proposes displaying a three-dimensional image based on perspective representation which changes the patterns in advance of upcoming vehicle movements, our concept would provide a configurable texture stream (various templates would be available) over a screen with transparency/opacity regulation.

[0012] It is disclosed a device for counteracting motion sickness for a user in a vehicle moving in a direction along a route by displaying a visual image flow, comprising: a display for displaying said visual image flow, and an electronic data processor; wherein the electronic data processor is configured for: receiving indication of vehicle's direction of movement; displaying, in said display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the user's location in the vehicle.

[0013] In an embodiment, the electronic data processor is further configured for receiving said indication of the vehicle's direction of movement from a self-driving system of the autonomous vehicle.

[0014] In an embodiment, the device can comprise a communication device and the electronic data processor being configured for communicating with a remote system to receive said indication of the vehicle's direction of movement. [0015] In an embodiment, the electronic data processor is further configured for receiving said indication of the vehicle's direction of movement from a navigation system of the vehicle.

[0016] In an embodiment, the electronic data processor is further configured for estimating said indication of the vehicle's direction of movement from a route map provided by a navigation system of the vehicle.

[0017] In an embodiment, the device can comprise an additional display for displaying said visual image flow for an additional user, and the electronic data processor being further configured for: displaying, in said additional display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the additional user's location in the vehicle.

[0018] In an embodiment, the electronic data processor is configured for displaying the visual image flow comprising a moving plurality of dots or texture in advance of the vehicle's movement, particular 0.5-5 seconds in advance, further in particular 1-2 seconds in advance.

[0019] In an embodiment, the electronic data processor is further configured for initiating the display of the visual image flow comprising a moving plurality of dots or texture when the vehicle is detected to have initiated movement.

[0020] In an embodiment, the electronic data processor is further configured for initiating the display of the visual image flow comprising a moving plurality of dots or texture when a user indication is received by the device.

[0021] In an embodiment, the electronic data processor is further configured for initiating the display of the visual image flow comprising a moving plurality of dots or texture when a probability of motion sickness is determined to be above a predetermined threshold.

[0022] In an embodiment, the electronic data processor is further configured for detecting a change of user's location in the vehicle and adjusting the displaying of the visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the changed user's location in the vehicle.

[0023] In an embodiment, the electronic data processor is further configured for stopping the display of the visual image flow comprising a moving plurality of dots or texture when an indication is received from the user.

[0024] In an embodiment, the display is adjustable to be fully opaque to fully transparent, and the electronic data processor is further configured for adjusting the display opacity from an indication received from the user.

[0025] In an embodiment, the display is adjustable to be fully opaque to partly transparent, and the electronic data processor is further configured for adjusting the display opacity from an indication received from the user.

[0026] It is also disclosed an operation method of a device for counteracting motion sickness for a user in a vehicle moving in a direction along a route by displaying a visual image flow, the method comprising using said electronic data processor for: receiving indication of vehicle's direction of movement; displaying, in said display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the user's location in the vehicle.

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The following figures provide preferred embodiments for illustrating the disclosure and should not be seen as limiting the scope of invention.

[0028] Figure 1: Schematic representation of an embodiment of the device.

DETAILED DESCRIPTION

[0029] The present disclosure relates to a screen with visual information regarding the current or proceeding movements of the vehicle that can be used on the windows or on a transparent screen to present the passengers with anticipatory cues of the vehicle behaviour so that they are able to anticipate the motion and compensate accordingly. The vehicle is able to predict the movement through a vehicular technology: V2X.

[0030] Transparent screens, that look like a glass, are already available (e.g., Gauzy ™ ) but they are not applied to prevent motion sickness.

[0031] Showing content on screens in synchronization with the vehicle movement and vital signs of the passenger that allows the passenger to "predict" the vehicle behaviour is part of the present disclosure.

[0032] Fulfilled the requirements that allow this concept to work (see "Preconditions" on the table 1), the ride starts and the "stream" is automatically activated to prevent MS symptoms. The stream of dots or textures has a direction that is congruent (in particular, with a few seconds of advance) with the visual flow of the road view, as seen from a point-of-view placed in the vehicle front, as a typical driver. Alternatively, an on/off button can be available and within reach for each passenger.

[0033] The direction of the movement of the stream of dots is adjusted depending on the position of the passenger (e.g. the passenger that is on the left seat turned to the front sees the flow differently from the passenger on the left turned backwards) as detailed on "Standard flow" on the table 1.

[0034] The predictive "stream" is customizable. The dots flow can change its appearance according to users' preferences (see "Alternative flow" on the table below).

[0035] Table 1 - Predictive visual flow to prevent motion sickness on autonomous cars: Preconditions, Triggers, Standard and alternative flows, and special requirements.

• Four seat shared vehicle; Two passengers are turned to the front; the other two are turned backwards.

• There is an individual transparent screen for each passenger or a Preconditions projection on the car window closer to him/her.

• The MS system is able to anticipate the car movements with a few seconds of advance. • Route may be predefined.

• Assuming the vehicle is automated, the car is supposed to be able to predict the movement (V2X).

• Alternative API: The system is able to predict MS symptoms.

• Ride starts and the "stream" is automatically on to prevent MS symptoms.

Triggers • Alternative ATI: SAV predicts MS symptoms and turns it on (if it is turned off).

• Alternative AT2: The passenger turns it on (if its turned off).

• An individual transparent screen or projection on the window, allows the passenger to see a displayed or projected stream of moving dots.

• The stream of dots has a direction that is congruent (with a few seconds of advance) with the visual flow of the road view, as seen

Standard flow from a point-of-view placed in the car front.

• The direction of the movement of the stream of dots is adjusted depending on the position of the passenger (e.g. the passenger that is on the left seat turned to the front sees the flow differently from the passenger on the left turned backwards).

• The passenger does not like to see the projection o AF1.1 The passenger uses a vocal command to turn it off o AF1.2 The passenger uses a manual interface to turn it off

Alternative . The passenger does not like the visual look of the flow flow o AF2.1 The passenger uses a vocal command to switch to a different pattern (e.g.water flow). o AF2.2 The passenger uses a manual interface to switch to a different pattern o AF2.3 The passenger adds animations to the flow (like an animal riding the cloud)

• The passenger wants more or less light in the cabin- transparency/opacity regulation o AF3.1 The passenger uses a vocal command to regulate opacity o AF3.2 The passenger uses a manual interface to regulate opacity

• On/off (manual, voice commands, interface) - required for the alternative flow

Special

• Change stream (manual, interface, gestures, voice?) requirements

• Transparency/opacity (manual, interface)

• Templates (manual, interface)

[0036] As illustrated in Figure 1, a device for counteracting motion sickness for a user in a vehicle moving in a direction along a route by displaying a visual image flow, comprising: a display 1 for displaying said visual image flow, and an electronic data processor; wherein the electronic data processor is configured for: receiving indication of vehicle's direction of movement; displaying, in said display, a visual image flow comprising a moving plurality of dots or texture wherein the direction of movement of said plurality of dots or texture is congruent with the vehicle's direction of movement as seen from a point-of-view of the user's location in the vehicle.

[0037] The term "comprising" whenever used in this document is intended to indicate the presence of stated features, integers, steps, components, but not to preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. [0038] The disclosure should not be seen in any way restricted to the embodiments described and a person with ordinary skill in the art will foresee many possibilities to modifications thereof. The above-described embodiments are combinable.

[0039] The following claims further set out particular embodiments of the disclosure.