ARMREST KEYBOARD WITH HAPTIC AND THERMAL FEEDBACK

TECH NICAL FI ELD

[0001] The present disclosure relates to an interface device comprising a smart surface with haptic feedback to a passenger.

BACKGROUND

[0002] Document EP2483104B1 relates generally to travel information systems and more particularly, but not exclusively, to aircraft in-flight entertainment systems for providing an enhanced travel experience.

[0003] Document US9349552B2 related to a touchpad with capacitive force sensing. The described techniques may determine the point or region of a user-engagement surface contacted by a user. In addition, the described techniques may also determine a force of the user's finger press on the user engagement surface using one or more capacitance force sensors. Furthermore, the described techniques may offer active tactile feedback (i.e., haptics) to the user's finger touching the user-engagement surface.

[0004] Document W02015/159100A1 discloses a switch panel comprises: a layer having a touch-or proximity-responsive surface and being patterned to indicate defined switch areas of the surface to a user; illumination means for illuminating the patterned layer; and output means for providing an output signal in response to a user interaction with one or more of the defined switch areas, wherein the switch panel is arranged to operate in: (i) an active state, in which the illumination means are arranged to illuminate the patterned layer so as to make the switch areas visible to the user; and (ii) a dormant state, in which the switch areas are substantially not visible to the user, and the output means are arranged to provide the output signal only when the switch areas are visible in the active state.

[0005] Document US20200264772 discloses a method for providing haptic feedback to an operator of a touch-sensitive display device. The method includes providing an operator interface to be represented in the display device as image data; the operator interface having at least one button assigned to a function to be controlled, graphically displayed in the operator interface, and graphically delimited from the rest of the operator interface; analysing the image data for a presence and a position of shapes for representing a button; determining an intended display region of a shape, which is to be represented and is identified as a button; representing the image data of the operator interface in the touch-sensitive display device; outputting haptic feedback in response to detection of contact with the touch-sensitive display device in the region of a surface of the touch-sensitive display device which is assigned to a display region of a shape identified as a button.

[0006] These facts are disclosed in order to illustrate the technical problem addressed by the present disclosure.

GENERAL DESCRIPTION

[0007] The present disclosure relates to an interface device comprising a smart surface with haptic feedback to a passenger. Namely, an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard and an operation method thereof.

[0008] The present disclosure relates to a capacitive haptic feedback surface, herein called smart surface comprising, at least, 4 or 5 layers. The first, top-most layer, is an insulative layer, applied to a transparent and conductive electrode sheet layer, which, when charged with an electric current and when in contact with the human skin, produces a frictional stimulus by controlling the electric current. These two layers are, in turn, applied to a capacitive-based touch sensitive layer. Below this layer rests another layer fitted with LED lights, which can produce strong enough lights to be visible through the previous layer, depending on the material of which said layer is made out of (this layer is optional). The fifth and final layer is composed of vibrotactile actuators, which can produce vibrations with enough frequency and amplitude for them to be felt by users while interacting with the top-most layer.

[0009] The inclusion of control elements and interfaces on the armrests of in-vehicle seats has already been the focus of prior patents (e.g., JP2004262363A; US2017147108A1). These inclusions usually arise from a wish to provide passenger, particularly drivers, with easy access to a myriad of vehicle controls, such as window and radio controls.

[0010] Although interacting with these controls is not necessary for the primary task of driving the vehicle, they can still have an adverse effect on driving by deviating the drivers' attention while they fumble with the different control elements.

[0011] Haptic feedback in devices and surfaces has commonly been achieved through vibrotactile stimuli, generated from mechanical actuators (e.g., EP3582074A1). More recently, haptic technologies have emerged that make use of other actuation types, such as electro vibration, to generate other types of tactile feedback beyond just vibrations (e.g., US10768749B2). The technology for creating richer display and surface interactions is available, by delivering different haptic feedback sensations, such as different texture sensations or different vibrations, to users while they interact with the display surface with their fingers. Richer interactions, in the present disclosure, refers to interactions that provide more feedback to users, instead of the usual sensation of just touching a surface. However, there is a lack of applications that exploit the capabilities of these interfaces to the maximum.

[0012] In an embodiment, any control commands, such as increasing or decreasing the strength of an overhead light, would have to be processed by the software of the centre stack display device, although the keyboard area could have some shortcuts associated with some simple actions such as this light control, or media volume control, for example, like it is currently found on most computer keyboards. [0013] In an embodiment, the smart surface can be used to control those and any other parts. It is only a matter of having a controller which, upon sensing input on the smart surface, is able to actuate (directly or indirectly) on those parts.

[0014] With the expected increase of autonomous vehicles that will become available to the general consumer market, passenger of such vehicles will find themselves with more free time during their commutes. Passengers might choose to engage in a variety of activities to make use of this free time, for leisure or work purposes, such as writing documents, browsing the internet, or looking up information online, among other activities that require them to input written and other information.

[0015] In an embodiment, writing from a comfortable position on a virtual keyboard presented on the center stack display is difficult to achieve, since it requires passenger to bend forward on their seat, to stretch their arm(s), or both at the same time, which quickly becomes uncomfortable to maintain. Additionally, interactions with such virtual keyboards do not normally transmit any haptic feedback to passenger, making the writing process less intuitive.

[0016] In an embodiment, in level 5 of autonomous vehicles, i.e., in full automation, concerns regarding driver distraction are no longer present, as the task of driving the vehicle is taken up by the vehicle itself, and the driver becomes just another passenger in the vehicle. Therefore, more control and interface elements can be added to each seat's armrest, so that passengers can access these controls from a comfortable position of their choosing, and without the interaction with said controls compromising their performance while driving the vehicle, as could occur if this was implemented on non- autonomous vehicles due to the increase of interactable elements possibly distracting the driver while trying to interact with them.

[0017] In an embodiment, it is possible to have more functionalities in non-AV (autonomous vehicle), but the more functionalities, buttons, switches, etc., that you add, the more you increase the risk of the driver getting distracted while trying to interact with the one he wants. Those functionalities do not need to be used by the driver, they can be used by passengers in non-AVs.

[0018] Additionally, said elements no longer need to be simple nobs, switches or on/off buttons, but instead can be more complex and useful controls and interfaces. Furthermore, other technologies, such as haptic feedback surfaces, can be used to increase the passenger experience and engagement of passenger with these elements, contributing to a more pleasurable and/or useful commute.

[0019] As display surface technology develops, more focus is being given to display devices and surfaces that can provide new and innovative ways of enriching the interactions passenger have with them, such as generating richer haptic feedback sensations.

[0020] It is thus disclosed a smart surface, with haptic feedback capabilities, which is capable of acting as a keyboard interface between a user and a system, with the aim of it being used either in level 5 autonomous vehicles, or in passenger compartment that have seats with armrest surfaces.

[0021] The present disclosure improves the driving safety, e.g., by providing haptic feedback of proximity to an obstacle while parking.

[0022] In an embodiment, the present disclosure is employable in level 5 autonomous vehicles.

[0023] In an embodiment, this smart surface can be employed as the interactive surface interface of a device to which it is not physically connected, e.g., touch surface interface communicating wirelessly with a display device in close proximity.

[0024] In an embodiment, the capacitive-based touch sensitive layer can be made of a variety of materials, depending on the intended use case and aesthetic appeal.

[0025] In an embodiment, the capacitive-based touch sensitive layer is made of translucent plastic - interactive surface interface for an external device with LED lights underneath it.

[0026] In the present disclosure, the smart surface can generate both frictional and vibrotactile haptic sensations.

[0027] In an embodiment, frictional haptic sensations, also described as electro vibration, are generated thanks to the insulative and conductive layers, which allow for friction between the smart surface and the passenger's skin to be modulated through electrostatic actuation, while the skin is in motion. [0028] In an embodiment, vibrotactile haptic sensations, in turn, are generated thanks to the vibrotactile actuators, which can generate vibrations strong enough (e.g., 65Hz to 500Hz) to be felt through the passenger's skin, either stationary or in motion, when in direct contact with the smart surface.

[0029] In an embodiment, when the smart surface is used as the interactive interface for an external device, haptic feedback sensations, programmed/controlled by the external device's software, can be generated on it, as long as the haptic actuation technology that is present on the smart surface is both capable of interpreting the software's information and of generating such sensations. When the external device's software sends a command to the smart surface, requesting that it generates haptic and/or thermal feedback sensations on the surface layer, the command technology/software found on the smart layer should be capable of differentiating between these types of actuations, delegating the request to the actuation technology that controls the actuators capable of generating said feedback.

[0030] In an embodiment, the capacitive and/or haptic feedback sensations of the smart surface are controlled by an external device which can be the same device that the smart surface is controlling (e.g., center stack) or other.

[0031] In an embodiment, the armrest keyboard comprises a 7" display, 7 mm thick, powered through a socket provided by the vehicle specifically for the device, communication with the vehicle via ethernet, and with user devices via Wi-Fi.

[0032] In an embodiment, the present disclosure is equipped on a portion of the surface of the vehicle seat's armrest, where it acts as an external interactive surface interface for the centre stack display device, in the form of a keyboard.

[0033] In another embodiment, the seat's armrest is part of a train carriage, airplane fuselage or other passenger compartment that have seats with armrests.

[0034] In an embodiment, a full haptic feedback keyboard surface, actuated through electro vibration and/or vibrotactile actuation, which can be activated by the passenger and accessed on the vehicle seat armrest smart surface. LED lights, integrated on their own layer between the capacitive-based touch sensitive layer and the layer of vibrotactile actuators, light up when the keyboard is in use, indicating the location of each specific key on the keyboard. The light from these LED lights should be strong enough to be seen through the capacitive-based touch sensitive layer, which, in turn, should be made of a material, or have a thin enough thickness, that allows for the lights to be clearly visible.

[0035] In an embodiment, the capacitive surface can be made of a material that allows for the LED light to pass through, which can be dependent on how thick said surface is (e.g., certain types of wood can let light pass through when it's thin enough).

[0036] In an embodiment, passenger can use this keyboard to facilitate and speed up their performance on tasks that involve writing, be it for entertainment, educational, or professional purposes, while sitting comfortably inside the vehicle during their commutes, keeping a comfortable posture.

[0037] In an embodiment, the armrest smart surface is embedded on a movable platform which, at the passenger's behest, can be switched into one of two positions, either placed directly on top of the full armrest structure, at the passenger's side, or it can be slid on top of the full armrest structure until it is set horizontally in front of the passenger. When the user presses the dedicated "switch" button present either on the armrest smart surface, or as key on the keyboard, the movable platform's apparatus proceeds to move to the other position. This movable platform is placed between the armrest smart surface and the remaining structure of the armrest. This movable platform is connected to the middle and tail-right end of the armrest smart surface. The location where the movable platform connects to the armrest smart surface's middle portion is horizontally curved in its design. When the "switch" button is pressed, and the armrest smart surface is in "compact" or "short" mode (as seen in Figure 2), the movable platform moves over the length of the armrest structure, until it reaches the front end of it. When it reaches said area, it is locked in placed, and the movable platform component that is connected to the armrest smart surface's tail-right end begins to move inwards towards the middle portion. Throw this movement, the armrest smart surface slides atop the middle portion of the movable platform, curving inwards instead of moving fully forward, until it reaches the "full" or "extended" mode (as seen in Figure 1). If, when the "switch" button is pressed, and the armrest smart surface is in "full" or "extended" mode, the reverse of this process occurs, and instead of the movable platform's component that is connected to the armrest smart surface's tail-right end sliding towards the middle portion of the movable platform, it instead slides away from said portion. The assembly of this structure to a base/normal armrest can be plug and play, can come pre-installed on it, or it can be installed by a knowledgeable person. For the smart surface's components to be powered, it should be connected to any of the vehicle's power supplies or one provided by the user (e.g., batteries), deriving power from it.

[0038] In the passenger's side embodiment, the keyboard is in compact layout, which is aimed at being used with only one hand, ideally for shorter inputs.

[0039] In the in front of the passenger embodiment, the keyboard is in full layout, extended over a wide horizontal portion of the smart surface. This layout is aimed at being used with both hands, ideally for longer inputs.

[0040] In an embodiment, when a key is pressed, passenger feel a vibrotactile "click" sensation, indicating that a key was pressed.

[0041] In an embodiment, when sliding a finger over the keyboard, different texture sensations are used to indicate to the passenger, e.g., when the finger is sliding on top of a virtual button (e.g., a different texture sensation is generated for each button, helping the user differentiate between different buttons); when the passenger enter/leaves the location of a virtual button (e.g., a sensation of a "bump" in generated when the skin reaches the edge of a button, and no texture sensation is generated between the gaps of each button); and the location of the index-finger locator keys, usually the F and J keys in QWERTY keyboards (when keyboard is in full mode), by way of noticeably different texture and bump sensations. In other alphabets, these locator keys can be adjusted accordingly. However, it is expected that the perception of electrovibration and vibrotactile haptic sensations might be affected by conditions related to the user's hands. For example, the use of gloves can completely negate electrovibration actuation, as the skin of the finger is required to complete the circuit with the insulating layer and the conductive layer of the structure, as well as severely attenuate or even completely mask the vibrations generated by the electrovibration actuators. High finger humidity, in turn, can also negatively impair or outright negate the sensations generated by both electrovibration and vibrotactile actuators. [0042] In an embodiment, it is disclosed an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.

[0043] In an embodiment, the armrest and the interactive surface are rotatably and slidably coupled.

[0044] In an embodiment, the interactive surface is arranged to fit in the armrest when the interactive surface and the armrest are oriented parallelly.

[0045] In an embodiment, the armrest keyboard can comprise a wireless connection to communicate wirelessly with an external display device.

[0046] In an embodiment, the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user presses a virtual button of the interactive surface.

[0047] In an embodiment, the electronic data processor is further configured to drive the haptic-feedback layer to provide a haptic-feedback as the user slides a finger over virtual buttons of the interactive surface.

[0048] In an embodiment, the electronic data processor is further configured to drive the haptic-feedback layer to provide an enhanced haptic-feedback as the user slides a finger over virtual buttons 'F' and 'J' of the interactive surface.

[0049] In an embodiment, the armrest keyboard according to any of the previous claims wherein the first keyboard is longer than the second keyboard. [0050] In an embodiment, the second keyboard has less virtual buttons than the first keyboard.

[0051] In an embodiment, the capacitive-based touch sensitive layer is made of translucent plastic comprising LEDs underneath it.

[0052] In an embodiment, the armrest keyboard can comprise a frictional haptic- feedback layer comprising an insulative sheet for user touch and a transparent conductive electrode film for providing frictional haptic sensations.

[0053] In an embodiment, the armrest keyboard can comprise a vibrotactile haptic layer for providing vibrotactile haptic sensations.

[0054] It is also disclosed a method of operating an armrest keyboard according to any of the previous embodiments comprising using an electronic data processor to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.

BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The following figures provide preferred embodiments for illustrating the disclosure and should not be seen as limiting the scope of invention.

[0056] Figure 1A: Schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest.

[0057] Figure IB: Schematic representation, in top view, of an embodiment of the haptic full keyboard layout on armrest.

[0058] Figure 2A: Schematic representation, in front view, of an embodiment of the haptic compact keyboard layout on armrest. [0059] Figure 2B: Schematic representation, in top view, of an embodiment of the haptic compact keyboard layout on armrest.

[0060] Figure 3: Scheme of the layer's superposition.

DETAILED DESCRI PTION

[0061] The present disclosure relates to an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, comprising an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to drive the haptic-feedback layer to provide a haptic-feedback; display a first keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard; and to an operation method thereof.

[0062] Figure 1A shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 103 represents a full keyboard layout, 105 represents an armrest, and 107 represents a seat.

[0063] Figure IB shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 103 represents a full keyboard layout, 105 represents an armrest, and 107 represents a seat. [0064] As illustrated in Figure 1A and Figure IB, an armrest keyboard for providing an interface with capacitive haptic feedback for a user in an automotive setting, can comprise: an interactive rectangular surface comprising a haptic-feedback layer, a capacitive touch sensitive layer and a display; an armrest, wherein the armrest and the interactive surface are rotatably coupled; and an orientation sensor for detecting the orientation of the interactive surface in respect of the armrest; an electronic data processor configured to: drive the haptic-feedback layer to provide a haptic-feedback as the user touches the interactive surface; display a first keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented perpendicularly, and display a second keyboard of virtual buttons in the display of the interactive surface when the orientation sensor indicates that the interactive surface and the armrest are oriented parallelly; wherein the second keyboard is more compact than the first keyboard.

[0065] Figure 2A shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 203 represents a compact keyboard layout, 105 represents an armrest, and 107 represents a seat.

[0066] Figure 2B shows a schematic representation, in front view, of an embodiment of the haptic full keyboard layout on armrest, where: 101 represents a passenger, 203 represents a compact keyboard layout, and 107 represents a seat.

[0067] Figure 3 shows a scheme of the layer's superposition, wherein A represents an insulative layer; B represents a capacitive-based touch sensitive layer; C represents a vibrotactile actuators layer; D represents a transparent electrode sheet layer and E represents a LED lights layer.

[0068] The term "comprising" whenever used in this document is intended to indicate the presence of stated features, integers, steps, components, but not to preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof.

[0069] The disclosure should not be seen in any way restricted to the embodiments described and a person with ordinary skill in the art will foresee many possibilities to modifications thereof. The above-described embodiments are combinable. The following claims further set out particular embodiments of the disclosure.

[0070] References:

1. Junichi, S., & Yukawa, K. (2004). INPUT DEVICE FOR AUTOMOBILE (Patent No.

JP2004262363A).Japan. https://worldwide.espacenet.eom/patent/search/family/0331195 18/publication/J P2004262363A?q=pn%3DJP2004262363A. KHOSHKAVA, V., CRUZ-HERNANDEZ, J. M., & SHAH, K. (2019). HAPTIC ACTUATOR ASSEMBLY WITH A SPRING PRE-LOAD DEVICE (Patent No. EP3582074A1). https://worldwide.espacenet.com/patent/search?q=pn%3DEP35820 74Al. Olley, M. F. D., Peshkin, M. A., & Colgate, J. E. (2020). Electronic controller haptic display with simultaneous sensing and actuation (Patent No. US10768749B2). https://worldwide.espacenet.com/patent/search?q=pn%3DUS10768 749B2. SHOU-SHAN, F., LIANG, L., LI, Q., & YU-QUAN, W. (2017). TOUCH CONTROL VEHICLE SEAT AND VEHICLEMOUNTED ENTERTAINMENT SYSTEM (Patent No. US2017147108A1). https://worldwide.espacenet.com/patent/search/family/0566607 92/publication/ US2017147108Al?q=pn%3DUS2017147108Al.