BACKGROUND

Technical Field

[0001] The exemplary and non-limiting embodiments disclosed herein relate generally to haptic devices and, more particularly, to mobile devices that incorporate haptic feedback for navigation applications.

Brief Description of Prior Developments

[0002] Tactile devices comprising actuators for producing navigation instructions are known. Some tactile devices use vibrating elements that vibrate at different intensities based on angular differences between a destination direction and a direction of orientation of a terminal. Other tactile devices use tilting and/or leaning as methods of supplying direction. In any case, such devices can be handheld or worn by the user.

SUMMARY

[0003] The following summary is merely intended to be exemplary. The summary is not intended to limit the scope of the claims.

[0004] In accordance with one aspect, an apparatus comprises a first magnetic plate; a second magnetic plate oriented parallel to the first magnetic plate, magnetically coupled to the first magnetic plate, and slidable relative to the first magnetic plate; a dielectric material positioned between the first magnetic plate and the second magnetic plate; and a contact in communication with the first magnetic plate and the second magnetic plate through which a voltage is applied, the voltage generating a signal that is responsive to a task performed on a mobile device, the signal providing a haptic effect to the first magnetic plate and the second magnetic plate upon sliding of the first magnetic plate relative to the second magnetic plate.

[0005] In accordance with another aspect, a method comprises inputting destination data into a mobile device; linking a haptic feedback device to the mobile device using a wireless connection; adjusting the haptic feedback device; determining whether a direction to the destination is correct based on haptic feedback provided from the haptic feedback device; moving in the direction to the destination; and reaching the destination. [0006] In accordance with another aspect, a non-transitory computer readable storage medium, comprising one or more sequences of one or more instructions which, when executed by one or more processors of an apparatus, causes the apparatus to at least: link a haptic feedback device to a mobile device using a wireless connection; and provide haptic feedback from the haptic feedback device.

BRIEF DESCRIPTION OF THE DRAWINGS

[0007] The foregoing aspects and other features are explained in the following description, taken in connection with the accompanying drawings, wherein:

[0008] Figure 1A is a top view of one exemplary embodiment of a haptic device comprising two magnetic wheels in a parallel orientation; [0009] Figure IB is a cross-sectional view of the haptic device of Figure 1A.

[0010] Figure 1C is a schematic representation of the haptic device of Figures 1A and IB linked to a mobile device; [0011] Figure 2A is schematic representation of a user using the haptic device of Figures 1A and IB;

[0012] Figure 2B is a schematic representation of a hand of the user of Figure 2A rotating/sliding the wheels of the haptic device; [0013] Figure 3 is a flowchart illustrating one exemplary embodiment of a method of navigating using the haptic device;

[0014] Figure 4A is a perspective view of one exemplary embodiment of a haptic device incorporating various ancillary features; and [0015] Figure 4B is a representation of one exemplary embodiment of a screen of a haptic device.

DETAILED DESCRIPTION OF EMBODIMENT

[0016] Electronic maps and location-based navigation services are becoming more ubiquitous in mobile devices. However, electronic navigation using a mobile device at present requires cognitive effort and frequent recourse to viewing of a screen device (in the absence of voice guidance, which may not always be to a user's taste, especially in a crowded urban environment, for example) . It is desirable for electronic navigation mobile devices to enable communication with the user without forcing the user to be constantly immersed in viewing the screen device to the exclusion of other ongoing tasks, such as walking. Haptics (vibratory electrotactile feedback) offers the possibility of a solution whereby enough information is conveyed to the user such that the information can also be mentally processed without detracting from other tasks at hand. It is also desirable for tactile information to be conveyed using a device that is easily handled in a blind-use scenario.

[0017] The exemplary devices disclosed herein are haptic devices that generally comprise sliding and/or rotating mechanisms that obviate or at least reduce the need for buttons. The emphasis is on low cost implementations of devices that are companion to mobile devices (e.g., in a master/slave relationship) and that utilize ET feedback, allowing for non-visual interaction of the companion device with the mobile device through wireless technologies (e.g., by utilizing a Bluetooth® Low Energy or an ANT+™ wireless connection) to access the extended capabilities of a mobile device, thereby augmenting a user's interaction with the mobile device. The ET technology offers ultra-low power consumption for programmable haptic technology relative to other electromechanical actuator technologies.

[0018] The exemplary devices are ET-keyrings that are linked to the mobile devices (e.g., smart phones or mobile displays or terminals) based on ET-keyring (ET-keyring/ETK) technology. The devices disclosed herein are not limited to being keyrings, however, as any other similar configuration may be considered. One exemplary use of an ET-keyring is for haptic navigation (e.g., pedestrian, bicycle, and the like) that allows for street level guidance as well as line-of-sight guidance. Other exemplary uses include haptic control of data devices (audio and video) , as well as haptic applications with regard to entertainment (e.g., toys), therapeutic devices, and the like.

[0019] Mobile devices have navigational functionality through global positioning satellite (GPS) systems. However, viewing maps on mobile displays while moving is frequently not the most suitable interaction scenario when the user wants to get to a particular place (especially in a crowded environment) . In the exemplary devices as disclosed herein, the user preselects a target location and route on a mobile terminal, following which the actual guidance is performed by tactile perceptions via the companion device, e.g., the ET-keyring. The mobile device streams information about the navigation through a wireless channel and gives instructions to the ET-keyring as to the correct direction to move in. The user sets the target location on the mobile terminal and then follows the guidance by sliding and/or rotating the ET-keyring using their fingers and checking/confirming the right direction to move in and/or how far the target location is. In the exemplary embodiments disclosed herein, the ET-keyring is a simplified tactile-tile-slider system that enables movement of two surfaces in intimate contact with programmability of texture perceptions via tactile feedback to the user. The GPS system of the mobile device is not discussed here; however, the ET-keyring will work with any mobile terminal which is linked via a wireless connection.

[0020] The ET-keyring device has a "low cognitive effort" requirement and presents an "easy-to-operate" approach to complex navigational tasks. Besides indicating the right direction to travel in, the ET-keyring has the added functionality of delivering "distance-to-target" information to the user. For instance, the intensity of the texture signals can be changed in accordance with the distance-to-target (more intense means closer to the target location) . Furthermore, the ET-keyring allows for subtle navigating in crowded areas without having to observe maps or electronic navigation devices, thus making the user appear less like a tourist and allowing him to focus on his surroundings. In addition, the ET-keyring can also be used as a therapeutic device where the user relaxes/exercises his fingers while listening to music on the mobile device and perceiving the music-driven rhythm as a texture on the ET-keyring .

[0021] In any embodiment, deviation from the prescribed path could be indicated by a change in frequency, a change in amplitude, or the introduction of noisy ET signals, or the like.

[0022] Referring to the Figures, one exemplary embodiment of the ET-keyring is shown. Although the features of the ET- keyring for navigation purposes will be described with reference to the example embodiments shown in the drawings, it should be understood that features can be embodied in many alternate forms. In addition, any suitable size, shape, or type of elements or materials could be used. [0023] Referring now to Figures 1A and IB, the ET-keyring is designated generally at 100 and is hereinafter referred to as "ET-keyring 100." ET-keyring 100 comprises two magnetized surfaces (wheels) orientated in parallel and configured to be able to slide and/or rotate over each other. The two sliding/rotating magnetized surfaces comprise a first substrate or first plate 102 magnetically coupled to a second substrate or second plate 104 via one or more central magnets 106 that allow the first plate 102 to be rotatable relative to the second plate 104 about an axis 108. The first plate 102 and the second plate 104 each comprise a polymer or glass sheet, each plate 102, 104 being substantially unaffected by humid conditions or moisture on the interfacing surfaces of the plates 102, 104.

[0024] Each plate 102, 104 is rendered magnetic via a respective magnetic film 122, 124 disposed on opposing faces of each plate 102, 104. The magnetic films 122, 124 each comprise dispersed magnetic dots, optically transparent magnetic film, or the like. The two plates 102, 104 are kept together by a magnetic field which is implemented via the magnetic films 122, 124.

[0025] A thin film of dielectric material 110 is located between the plates 102, 104. The dielectric material 110 may be a lubricant that facilitates the sliding contact of the first plate 102 relative to the second plate 104. The surfaces of the plates 102, 104 facing the dielectric material 110 are each covered with a thin film of conductive material 120 such as indium tin oxide, graphene, graphene oxide, combinations of the foregoing materials, or the like. The conductive material 120 provides conducting layers (in sliding contact through the dielectric material 110) that together define a large-area capacitor. [0026] As shown in Figure 1A, in some exemplary embodiments an alignment marker 135 may be disposed on an edge of the second plate 104 that, when synced up with the mobile device, indicates a "forward" direction to the user.

[0027] Alternating signals on the conducting plates produce palpable haptic effects, which can then become the basis for means for interacting with a mobile device. In one exemplary embodiment, to provide the alternating signals, a contact 115 is coupled to an edge of the first plate 102, the contact 115 being in sliding communication with two resistor traces 125 extending around the edge of the second plate 104.

[0028] The act of sliding the first plate 102 over the second plate 104 while a voltage is applied to the two plates 102, 104 through the contact 115 triggers a signal via electrotactile feedback drive circuitry (ET-circuitry) . The signal is responsive to a task being performed on the mobile device (e.g., navigation) . As the first plate 102 is rotated relative to the second plate 104, the position of the contact 115 is varied along the resistor traces 125, thereby changing the voltage and resistance values and providing for an ET feedback that indicates the user is on (or off) the calculated path.

[0029] Referring now to Figure 1C, the ET-circuitry can be built into a casing of the ET-keyring 100. In one exemplary embodiment, the ET keyring 100 may be linked to the mobile device, which is shown at 130, via a transmitter/receiver device 160 in the casing of the ET keyring 100 that communicates with a transmitter/receiver device 170 in the mobile device 130. The operation of ET-circuitry of the transmitter/receiver devices 160, 170 is triggered by the user (the ET-circuitry may be not activated or in a "sleep" mode at other times) , and the signals are determined by the user's interaction with the mobile device 130 (or other navigation tool) even though the user is not viewing or interacting directly with the mobile device, electronic map, etc. Tactile signals are mostly predicated on guiding the user by providing a tactile response that indicates the direction the user needs to take. [0030] Referring now to Figures 2A and 2B, the mobile device 130 may be kept in a pocket in a fixed orientation relative to the body of the user, shown at 200 (e.g., in a horizontal/vertical position) . According to the orientation and position of the user 200 (and therefore the position of the mobile device 130), the ET-keyring 100 receives information pertaining to the preferred direction. With this information, the ET-keyring 100 creates a tactile pattern which is then perceived by the user 200 when sliding/rotating the ET-keyring plates over each other. For example, when the user 200 is facing the correct direction in which to go, the ET-keyring 100 (when rotated by the fingers of the user 200) delivers a more intense tactile pattern to the user 200 (to distinguish it from the wrong direction, which will have a less intense signal, perhaps also with a different texture pattern, the difference being readily perceived by the user 200) . In this way the user 200 does not need to look at a complicated map on the mobile device 130 to obtain guidance on pedestrian paths to determine the direction in which to proceed (turn left/right or go ahead) . The user 200 can simply hold the ET-keyring 100 in hand (or even in a pocket) and check (occasionally) if he/she has kept on the right path/direction .

[0031] In another exemplary embodiment, the fixed alignment mark 135 allows the ET-keyring 100 to be easily aligned by the user 200 with the same orientation as the mobile device 130. This allows the feedback to be given at a particular angular position of the first plate 102 relative to the alignment mark 135, so that a bump, series of bumps, or a texture is felt, for example at the 90 degree position of the first plate 102 relative to the second plate 104 when a right turn is to be made or at the 270 degree position when a left turn is to be made. This embodiment has the added advantage that the user 200 does not need to turn his body (and mobile device 130) while continually using the ET-keyring 100 to establish whether he is facing in the correct direction. [0032] Referring now to Figure 3, a method of navigating using the ET-keyring 100 is designated generally by the reference number 500 and hereinafter referred to as "method 500." In method 500, data is input into a mobile device in an input step 510. The input step 510 may comprise entering a destination by street address or other information indicative of the destination. After the input step 510, the ET-keyring 100 is linked to the mobile device in a linking step 520 (e.g., by selecting a suitable wireless connectivity parameter on the mobile device that initiates a connection to the ET-circuitry of the ET-keyring 100) . The linking step 520 may be carried out using a controller 600 having a processor 610 and a memory 620. The processor 610 may include software 625.

[0033] The user 200 then begins navigating to the destination. In doing so, the user adjusts the ET-keyring

100 by sliding or rotating the first plate 102 relative to the second plate 104 in an adjustment step 530. A determination is then made in a determining step 540 as to whether the user 200 is facing in the correct direction based on haptic feedback provided by the controller 600 and received (or not received) through the ET-keyring 100. In the exemplary embodiment shown, if the user does not receive haptic feedback through the ET-keyring 100, the user 200 is not facing in the correct direction and so corrects his direction in a correcting step 550 after which he adjusts the

ET-keyring 100 in the adjustment step 530 again. If (or once) the user receives haptic feedback in the determining tep 540, the user 200 moves in the correct direction moving step 560. Upon receiving haptic feedback in the determining step 540, the user 200 may also determine a distance to the destination in a distance determination step

555.

[0034] Periodically, the user assesses whether he is at the destination in a destination determining step 570. In the destination determining step 570, if the user 200 determines that he is not at the destination, then he returns to the adjustment step 530 and adjusts the ET-keyring 100 and proceeds to the determining step 540, possibly proceeding back through the correcting step 550, and proceeding again through the moving step 560 back to the destination determining step 570. Once it is determined in the determining step 540 that the user 200 has reached the destination, the user 200 stops.

[0035] Tactile signals can also be employed in other ways, such as indicating the range of the user from the intended destination (e.g., distance determination step 555). A distance-squared relationship tactile response could be employed in this scenario, where the tactile signals increase in frequency (frequency of pulse train signals) as the user gets closer to the intended target. In practice, besides gaining tactile information about the preferred direction in which to go, the user can be easily informed how far away the target is just by adapting the frequency of pulse-train signals of the tactile perception.

[0036] Referring now to Figure 4A, one exemplary embodiment of the ET-keyring 100 is shown in which the ET-keyring is adapted for other uses, such as for entertainment. In such embodiments, devices by which various signals may be employed with the ET-keyring 100 are incorporated. For example, the ET-keyring 100 may include LEDs 700 (or other visual signaling devices) , speakers 710 (or other audio devices) , a simple touch screen 720, or the like. In adapting the concepts of the ET-keyring 100 to embody a toy or similar device (e.g., a virtual pet), audio or visual signals may be incorporated to alert the user to the need for engaging with the toy in a tactile sense.

[0037] The ET-keyring 100 also includes means for the device to communicate with other, more sophisticated devices, e.g., mobile phones, e-maps, e-readers, and the like. Such means of communication is mainly envisioned to be wireless and carried out through the transmitter/receiver devices 160, 170. [0038] The utility of the ET-keyring 100 may yet be expanded further without compromising the companion aspect of the device, for example, the compatibility of the companion device with the mobile device 130. Embodiments of the ET- keyring 100 including the touch screen 720 (which may incorporate a means for identifying finger location) can employ electrophoretic ink to carry out and enhance the tactile interaction, especially when the touch screen 720 is used in conjunction with entertainment applications or navigation applications in which the user 200 interacts with the mobile device 130 through the touch screen 720. In any case, the materials for the plates 102, 104 should be chosen accordingly. An optically transparent version of the ET- keyring 100 is envisioned, which could enable on-display applications and a direct correlation of tactile perceptions with visual images seen on the touch screen 720. For example, as shown in Figure 4B, in some exemplary embodiments the ET-keyring 100 may incorporate a touch screen 720 that displays a representation of a map 730 as a static haptic image (e.g., about 10 x 20 pixels) in order to replicate a map displayed on the mobile device 130. This would offer, in addition to the navigation concept described, mapping of a user's immediate environment. An ET-keyring 100 incorporating such a touch screen 720 may be made operable by means of finger guidance, in which the desired path could be associated with a particular frequency, or in which the desired path could be associated with no ET signal at all. [0039] Referring back to Figure 4A, the ET-keyring 100 can also be used as a remote, haptic scroll wheel when the first plate 102 is rotated relative to the second plate 104 about the axis 108, allowing for the browsing of a list of files (e.g., videos or songs) on the mobile device 130 and/or the touch screen 720 and subsequent selection of a file, for example, by pressing the touch screen 720. Also, the ET- keyring 100 can be used to control the volume of a music player without the need to remove the mobile device from a pocket . [0040] The virtues of this invention with regard to navigation pertain to the use of haptic technology so as to avoid or minimize visual reference to a navigation device by, for example, maneuvering a rotatable/slidable wheel arrangement to receive tactile cues pertaining to the correct direction to take. For this purpose, a navigation or orientation mark on the casing of the device could be used, for example, to indicate north, which would obviate the need for a gyroscope. It could also easily be employed to provide information to the user about the range to the intended target/destination by causing the frequency of tactile feedback to vary based on distance. [0041] The ET-keyring 100 can also act as a stand-alone device when used in an entertainment or therapeutic mode. In this embodiment, the device is intended to transmit continual random textures while in use. The textures can abruptly change to a distinct regular signal to alert the user of an incoming SMS/email/telephone call, etc. This would involve only very small cognitive effort for the user. The connection may be infrequent, and controlled by the user as they see fit, to reduce the power consumption. [0042] Furthermore, with regard to entertainment, virtual pet devices and other types of toys (which may be considered to be anti-stress) generally offer only audio and visual interaction with their "owners." Adding a tactile component to a virtual pet device offers a chance for a much more authentic virtual pet experience. Also, random or programmed tactile effects can be produced to replicate, for example, the texture of a real animal or certain actions associated with an animal (e.g., purring, oinking, hissing, and the like) . [0043] Tactile feedback may also have applications in video gaming. Modern video gaming entails increasingly newer paradigms of interaction between the user and the gaming console (or accessories to the gaming console) . Introducing tactile patterns to gameplay could offer an enhanced user experience, especially those involving an avatar moving within a virtual gamespace or a driving game, etc.

[0044] Further applications may exist with regard to the tactile examination of digital images on a display (e.g., the display of a mobile phone, computer, tablet, or the like) when touched by one finger and examined by another hand. More particularly, a user can obtain "remote texture delivery" by touching one image seen on a display using a finger of his left hand and receiving textural information pertaining to the touched object by moving a device of an ET system with his right hand. This may be beneficial to Internet-based purchasing and auctioning services where buyers could touch and feel objects on sale prior to clicking a device or pressing a button to make a purchase.

[0045] In one exemplary embodiment, an apparatus comprises a first magnetic plate; a second magnetic plate oriented parallel to the first magnetic plate, magnetically coupled to the first magnetic plate, and slidable relative to the first magnetic plate; a dielectric material positioned between the first magnetic plate and the second magnetic plate; and a contact in communication with the first magnetic plate and the second magnetic plate through which a voltage is applied, the voltage generating a signal that is responsive to a task performed on a mobile device, the signal providing a haptic effect to the first magnetic plate and the second magnetic plate upon sliding of the first magnetic plate relative to the second magnetic plate.

[0046] The first magnetic plate and the second magnetic plate may each comprise magnetic films disposed on polymer or glass sheets, the magnetic films being disposed on opposing faces of each respective plate. Each magnetic film may comprise dispersed magnetic dots or optically transparent magnetic films. The first magnetic plate and the second magnetic plate may each comprise a film of conductive material, the films of conductive material being disposed on surfaces of each respective plate that face the dielectric material. The films of conductive material may each comprise indium tin oxide, graphene, graphene oxide, or combinations of the foregoing materials. Two resistor traces may extend around the edge of the second plate through which the contact maintains communication between the first magnetic plate and the second magnetic plate. The apparatus may further comprise means for the apparatus to communicate wirelessly with the mobile device. The apparatus may be embodied in a keyring .

[ 0047 ] In another exemplary embodiment, a method comprises inputting destination data into a mobile device; linking a haptic feedback device to the mobile device using a wireless connection; adjusting the haptic feedback device; determining whether a direction to the destination is correct based on haptic feedback provided from the haptic feedback device; moving in the direction to the destination; and reaching the destination .

[ 0048 ] Linking a haptic feedback device to the mobile device may comprise selecting a wireless connectivity parameter on the mobile device to initiate a connection to circuitry of the haptic feedback device. The method may further comprise correcting the direction to the destination based on the haptic feedback from the haptic feedback device. The method may further comprise re-adjusting the haptic feedback device and correcting the direction to the destination. The method may still further comprise determining a distance to the destination in a distance determination step. Adjusting the haptic feedback device may comprise sliding a first plate relative to a second plate to produce a voltage. Sliding the first plate relative to the second plate to produce a voltage may produce the haptic feedback . [ 0049] In another exemplary aspect, a non-transitory computer readable storage medium, comprising one or more sequences of one or more instructions which, when executed by one or more processors of an apparatus, causes the apparatus to at least: link a haptic feedback device to a mobile device using a wireless connection; and provide haptic feedback from the haptic feedback device.

[0050] It should be understood that the foregoing description is only illustrative. Various alternatives and modifications can be devised by those skilled in the art. For example, features recited in the various dependent claims could be combined with each other in any suitable combination ( s ) . In addition, features from different embodiments described above could be selectively combined into a new embodiment. Accordingly, the description is intended to embrace all such alternatives, modifications and variances which fall within the scope of the appended claims.