BACKGROUND

[0001] Touch sensitive screens have, in some apparatus, been replaced by hover- sensitive screens that rely on proximity detectors. While touch sensitive screens detected objects that touched the screen, hover-sensitive screens may detect objects that are "hovering" within a certain distance of the screen. A touch sensitive screen may have identified the points on the screen that were being touched by the user, by a user stylus or pen, or other object. Actions could be controlled based on the touch points and the actions that occurred at the touch points. Conventional hover-sensitive screens detect objects in a hover-space associated with the hover-sensitive device.

[0002] Conventionally, a screen may have been either a touch-sensitive screen or a hover-sensitive screen. Thus, hover interactions and touch interactions have been considered separate tasks that a user performs at separate times (e.g., sequentially) but not at the same time. In some conventional systems, a user may have had to choose between touch interactions or hover interactions. This may have needlessly limited the potential richness of input actions.

SUMMARY

[0003] This Summary is provided to introduce, in a simplified form, a selection of concepts that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

[0004] Example methods and apparatus are directed towards accepting inputs involving simultaneous or coordinated touch and hover actions. For example, a user may be able to perform an input action that includes both a hover and a touch action. The touch may begin the action and be supplemented by the hover or the hover may begin the action and be supplemented by the touch. Being able to use hover and touch at the same time introduces a new way to interact with screens that are both touch and hover sensitive.

[0005] Some embodiments may include a capacitive input/output (i/o) interface that is sensitive to both touch and hover actions. The capacitive i/o interface may detect objects (e.g., finger, thumb, stylus) that touch the screen. The capacitive i/o interface may also detects objects (e.g., finger, thumb, stylus) that are not touching the screen but that are located in a three dimensional volume (e.g., hover-space) associated with the screen. The capacitive i/o interface may be able to simultaneously detect a touch action and a hover action. The capacitive i/o interface may be able to detect multiple simultaneous touch actions and multiple simultaneous hover actions. An embodiment may produce characterization data concerning the touch action(s) and the simultaneous hover action(s). An embodiment may selectively control the action performed on the i/o interface as a function of the characterization data.

BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The accompanying drawings illustrate various example apparatus, methods, and other embodiments described herein. It will be appreciated that the illustrated element boundaries (e.g., boxes, groups of boxes, or other shapes) in the figures represent one example of the boundaries. In some examples, one element may be designed as multiple elements or multiple elements may be designed as one element. In some examples, an element shown as an internal component of another element may be implemented as an external component and vice versa. Furthermore, elements may not be drawn to scale.

[0007] Figure 1 illustrates an example touch and hover-sensitive device.

[0008] Figure 2 illustrates an example touch and hover-sensitive device.

[0009] Figure 3 illustrates a portion of an example touch and hover-sensitive device.

[0010] Figure 4 illustrates a portion of an example touch and hover-sensitive device.

[0011] Figure 5 illustrates an example method associated with a simultaneous hover and touch interface.

[0012] Figure 6 illustrates an example method associated with a simultaneous hover and touch interface.

[0013] Figure 7 illustrates an example cloud operating environment in which a simultaneous hover and touch interface may operate.

[0014] Figure 8 is a system diagram depicting an exemplary mobile communication device configured with a simultaneous hover and touch interface.

[0015] Figure 9 illustrates an example apparatus that provides a simultaneous hover and touch interface.

DETAILED DESCRIPTION

[0016] Example apparatus and methods detect touch actions performed by objects that touch an i/o interface. Example apparatus and methods also detect hover actions performed by objects in a hover-space associated with an i/o interface. Example apparatus and methods then determine how, if at all, to combine the touch actions with the hover actions. Once the combination of touch actions and hover actions is determined, i/o performed by the i/o interface will be controlled, at least in part, by the combination.

[0017] Touch technology is used to detect an object that touches a touch-sensitive screen. "Touch technology" and "touch sensitive" refer to sensing an object that touches the i/o interface. The i/o interface may be, for example, a capacitive interface. The capacitance sensed by a capacitive sensor may be affected by the different dielectric properties and effects on capacitance of an object that touches a screen. For example, the dielectric properties of a finger are different than the dielectric properties of air. Similarly, the dielectric properties of a stylus are different than the dielectric properties of air. Thus, when either the finger or stylus touches the capacitive i/o interface, the change in capacitance can be sensed and used to identify an input action. While a capacitive i/o interface is described, more generally a touch sensitive i/o interface may be employed.

[0018] Hover technology is used to detect an object in a hover-space. "Hover technology" and "hover sensitive" refer to sensing an object spaced away from (e.g., not touching) yet in close proximity to a display in an electronic device. "Close proximity" may mean, for example, beyond 1mm but within 1cm, beyond .1mm but within 10cm, or other combinations of ranges. Being in close proximity includes being within a range where a proximity detector (e.g., capacitive sensor) can detect and characterize an object in the hover-space. The device may be, for example, a phone, a tablet computer, a computer, or other device. Hover technology may depend on a proximity detector(s) associated with the device that is hover sensitive. Example apparatus may include the proximity detector(s).

[0019] Figure 1 illustrates an example device 100 that is both touch-sensitive and hover- sensitive. Device 100 includes an input/output (i/o) interface 110. I/O interface 100 is both touch-sensitive and hover-sensitive. I/O interface 100 may display a set of items including, for example, a virtual keyboard 140 and, more generically, a user interface element 120. User interface elements may be used to display information and to receive user interactions. Conventionally, user interactions were performed either by touching the i/o interface 110 or by hovering in the hover- space 150. Example apparatus facilitate identifying and responding to input actions that use both touch actions and hover actions.

[0020] Device 100 or i/o interface 110 may store state 130 about the user interface element 120, the virtual keyboard 140, or other items that are displayed. The state 130 of the user interface element 120 may depend on the order in which touch and hover actions occur, the number of touch and hover actions, whether the touch and hover actions are static or dynamic, whether the combined hover and touch actions describe a gesture, or on other properties of the touch and hover actions. The state 130 may include, for example, the location of a touch action, the location of a hover action, a gesture associated with the touch action, a gesture associated with the hover action, or other information.

[0021] The device 100 may include a touch detector that detects when an object (e.g., digit, pencil stylus with capacitive tip) is touching the i/o interface 110. The touch detector may report on the location (x, y) of an object that touches the i/o interface 110. The touch detector may also report on a direction in which the object is moving, a velocity at which the object is moving, whether the object performed a tap, double tap, triple tap or other tap action, whether the object performed a recognizable gesture, or other information.

[0022] The device 100 may also include a proximity detector that detects when an object (e.g., digit, pencil, stylus with capacitive tip) is close to but not touching the i/o interface 110. The proximity detector may identify the location (x, y, z) of an object 160 in the three-dimensional hover-space 150. The proximity detector may also identify other attributes of the object 160 including, for example, the speed with which the object 160 is moving in the hover-space 150, the orientation (e.g., pitch, roll, yaw) of the object 160 with respect to the hover-space 150, the direction in which the object 160 is moving with respect to the hover-space 150 or device 100, a gesture being made by the object 160, or other attributes of the object 160. While a single object 160 is illustrated, the proximity detector may detect more than one object in the hover-space 150.

[0023] In different examples, the touch detector may use active or passive systems. Similarly, in different examples, the proximity detector may use active or passive systems. In one embodiment, a single apparatus may perform both the touch detector and proximity detector functions. The combined detector may use sensing technologies including, but not limited to, capacitive, electric field, inductive, Hall effect, Reed effect, Eddy current, magneto resistive, optical shadow, optical visual light, optical infrared (IR), optical color recognition, ultrasonic, acoustic emission, radar, heat, sonar, conductive, and resistive technologies. Active systems may include, among other systems, infrared or ultrasonic systems. Passive systems may include, among other systems, capacitive or optical shadow systems. In one embodiment, when the combined detector uses capacitive technology, the detector may include a set of capacitive sensing nodes to detect a capacitance change in the hover-space 150 or on the i/o interface 110. The capacitance change may be caused, for example, by a digit(s) (e.g., finger, thumb) or other object(s) (e.g., pen, capacitive stylus) that touch the capacitive sensing nodes or that come within the detection range of the capacitive sensing nodes.

[0024] In general, a proximity detector includes a set of proximity sensors that generate a set of sensing fields on the i/o interface 110 and in the hover-space 150 associated with the i/o interface 110. The touch detector generates a signal when an object touches the i/o interface 110 and the proximity detector generates a signal when an object is detected in the hover- space 150. In one embodiment, a single detector may be employed for both touch detection and proximity detection, and thus a single signal may report a combined touch and hover event.

[0025] In one embodiment, characterizing a touch includes receiving a signal from a touch detection system (e.g., touch detector) provided by the device. The touch detection system may be an active detection system (e.g., infrared, ultrasonic), a passive detection system (e.g., capacitive), or a combination of systems. Characterizing a hover may also include receiving a signal from a hover detection system (e.g., hover detector) provided by the device. The hover detection system may also be an active detection system (e.g., infrared, ultrasonic), a passive detection system (e.g., capacitive), or a combination of systems. Characterizing a combined touch and hover event may also include receiving a signal from an active detection system or a passive detection system incorporated into the device. The signal may be, for example, a voltage, a current, an interrupt, a computer signal, an electronic signal, or other tangible signal through which a detector can provide information about an event the detector detected. In one embodiment, the touch detection system and the hover detection system may be the same system. In one embodiment, the touch detection system and the hover detection system may be incorporated into the device or provided by the device.

[0026] Figure 2 illustrates a simulated touch-sensitive and hover-sensitive device 200 where one digit is performing a touch action while another digit is performing a hover action. Since the touch action and the hover action are being performed at the same time, device 200 may interpret the two actions as a single combined action. By way of illustration, hovering finger 210 over a certain key on a virtual keyboard may cause that key to become highlighted. Then, making another hover action (e.g., simulated typing action) over the highlighted key may cause an input action that causes a certain keystroke to appear in a text input box. For example, the letter e or E may be placed in a text input box. But there are two choices for the letter, either lower case e or upper case E. The typing experience on a touch or hover sensitive device can be impacted by the ease or difficulty with which upper and lower case letters can be chosen.

[0027] In figure 2, thumb 220 is illustrated touching device 200. Thumb 220 may be touching a user interface element (e.g., virtual shift key) that controls whether a letter entered in response to a hover action by finger 210 is a lower case e or an upper case E. In figure 2, thumb 200 has performed a touch action that causes an upper case E to be produced by the hover action. Conventionally, a user may have had to perform a hover action over a shift key, then had to move their finger to the desired letter, then had to enter the letter. The user may have had to hover over the shift key for each keystroke that was intended to be entered as a capital letter. Device 200 provides more flexibility by combining simultaneous touch and hover actions. In one example, device 200 facilitates performing a touch and hold action on the shift key with thumb 220 and then entering as many upper case letters as desired with finger 210. When the user wants to return to lower case typing the user would simply lift thumb 220 from the screen without having to relocate hovering finger 210.

[0028] Figure 3 illustrates a touch-sensitive and hover sensitive i/o interface 300. Line 320 represents the outer limit of the hover-space associated with hover sensitive i/o interface 300. Line 320 is positioned at a distance 330 from i/o interface 300. Distance 330 and thus line 320 may have different dimensions and positions for different apparatus depending, for example, on the proximity detection technology used by a device that supports i/o interface 300.

[0029] Example apparatus and methods may identify objects located in the hover- space bounded by i/o interface 300 and line 320. Example apparatus and methods may also identify objects that are touching the i/o interface 300. For example, device 300 may detect object 310 when it touches i/o interface 300 at time Tl . Since object 312 is neither touching i/o interface 310 nor in the hover zone for i/o interface 300, object 312 may not be detected at time Tl . But at time T2, object 312 may enter the hover space and be detected. I/O interface 300 may be configured to determine whether to treat the touch action that occurred at time Tl and the hover action that occurred at time T2 as separate actions or as a combined action. The determination may depend on the amount of time that elapsed between time Tl and time T2, the user interface elements associated with the touch action for object 310 and the hover action for object 312, or as a function of other information. [0030] By way of illustration of the time component, if the touch and hover action occur within a pre-determined threshold of time, then the actions may be considered to be a combined touch and hover action. But if the touch and hover actions are separated by more than the threshold amount of time, then they may be considered to be separate actions. The threshold amount of time may be, for example, less than .01 of a second, less than .1 of a second, less than .5 of a second, less than a second, or other time periods. In one embodiment, different time thresholds may be used. In one embodiment, the threshold amount of time may be configurable.

[0031] By way of illustration of the user interface component, if the touch action is associated with a certain user interface element (e.g., shift key), then the amount of time that elapses between touching the shift key and a hover action to enter a keystroke may be irrelevant. While a shift key is described, a touch and hover combination may be used in different applications. Consider a video game where a touch action may be used to select a character or vehicle (e.g., helicopter) to move and a hover action may be used to indicate the direction and velocity to move the character or vehicle. If the user hovers their finger close to the screen then the character may move more quickly than if the user hovers their finger farther from the screen. In another video game, a hover action may be used to select a weapon to fire. For example, a user may hover over a machine gun to select the weapon and then may tap on the screen where the machine gun is supposed to be aimed. In another video game, an ordered pair of touch actions may be used to select a starting point and an end point and a subsequent hover action may be used to indicate speed or intensity. For example a first touch with one finger may indicate the origin of flames from a flamethrower, a second touch with the same finger may indicate the direction in which the flames are supposed to be sent, and a hover action with a separate finger, pen, or stylus may indicate the intensity of the flames. The intensity may be varied by moving the hovering object (e.g., digit, stylus) closer to or further from the screen. While typing and video games are described, other combinations of combined touch and hover actions may be performed.

[0032] Different users may have different desires concerning how simultaneous touch and hover actions should be handled. Thus, in one embodiment, example apparatus and methods may provide an application programming interface (API) through which a user, program, process, or other actor may configure or reconfigure i/o interface 300. Thus, one user may want touch to be primary and hover to be secondary, another user may want hover to be primary and touch to be secondary, and another user may want there to be no primary/secondary ordering. Additionally, a user may want different ordering, gestures, or threshold times for different applications or at different times. The configuration may also identify combinations of different touch and hover actions to be identified and handled. The configuration may also provide information for handling a touch and hover action. For example, the configuration may include a callback address, socket, service, process, or other entity that may participate in handling the action and controlling a user interface element in response to the combined action. In one embodiment, the configuration may be performed using logic in the device supporting i/o interface 300 while in another embodiment the configuration may be performed off the device.

[0033] Figure 4 illustrates a touch and hover sensitive i/o interface 400. Line 420 depicts the limits of a hover-space associated with i/o interface 400. Line 420 is positioned at a distance 430 from the i/o interface 400. The hover-space may be present between the i/o interface 400 and line 420. While a straight line is illustrated, the hover- space may vary in size and shape.

[0034] Figure 4 illustrates object 410 touching the i/o interface 400 and object 412 touching the i o interface 400. Additionally, figure 4 illustrates object 414 hovering in the hover space and object 416 hovering in the hover space. Object 416 may be hovering over a particular user interface element 490 displayed on the i/o interface 400. While some touch and hover actions may involve first touching the i/o interface 400 and then performing a hover action (e.g., typing), some touch and hover actions may involve first hovering over user interface element 490 and then performing additional touch or hover actions. Since i/o interface 400 can detect multiple touch events and multiple hover events, and the order in which the events occur, and the combinations of events, a rich set of user interface interactions are possible. For example, object 416 may hover over user interface element 490 to select a color to be used in a painting application. User interface element 490 may be a palette where both discrete colors and blended colors that form transitions between discrete colors are available. The distance at which object 416 hovers above element 490 may control whether a single color is selected or whether a combination of colors are selected. Objects 410 and 412 may identify a line to be painted with the color selected by object 416. Object 414 may control the thickness of the line. For example, hovering object 414 closer to the i/o interface 400 may produce a thinner line while hovering object 414 farther away from the i o interface 400 may produce a thicker line.

[0035] Some portions of the detailed descriptions that follow are presented in terms of algorithms and symbolic representations of operations on data bits within a memory. These algorithmic descriptions and representations are used by those skilled in the art to convey the substance of their work to others. An algorithm is considered to be a sequence of operations that produce a result. The operations may include creating and manipulating physical quantities that may take the form of electronic values. Creating or manipulating a physical quantity in the form of an electronic value produces a concrete, tangible, useful, real-world result.

[0036] It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, and other terms. It should be borne in mind, however, that these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise, it is appreciated that throughout the description, terms including processing, computing, and determining, refer to actions and processes of a computer system, logic, processor, or similar electronic device that manipulates and transforms data represented as physical quantities (e.g., electronic values).

[0037] Example methods may be better appreciated with reference to flow diagrams. For simplicity, the illustrated methodologies are shown and described as a series of blocks. However, the methodologies may not be limited by the order of the blocks because, in some embodiments, the blocks may occur in different orders than shown and described. Moreover, fewer than all the illustrated blocks may be required to implement an example methodology. Blocks may be combined or separated into multiple components. Furthermore, additional or alternative methodologies can employ additional, not illustrated blocks.

[0038] Figure 5 illustrates an example method 500 associated with a simultaneous touch and hover interface. Method 500 includes, at 530, detecting a touch interaction with the input/output interface. Method 500 may also include, at 540, detecting a hover interaction with the input/output interface. The touch interaction and the hover interaction are related and operate at least partially simultaneously and therefore can be detected simultaneously as discrete events or as a combined event.

[0039] In one embodiment, detecting the touch interaction at 530 involves receiving a first signal from a detector and detecting the hover interaction at 540 involves receiving a second signal from the detector. This is detecting the events as simultaneous discrete events. The detector may include, for example, a set of capacitive nodes. While two separate signals are described, one associated with detecting a touch and one associated with detecting a hover, in one embodiment, detecting the touch interaction and detecting the hover interaction may include receiving a single signal from a detector. This is detecting the events as a combined event. The single signal may provide information about a combined touch and hover event rather than receiving separate signals about separate touch and hover events.

[0040] In one embodiment, both the touch interaction and the hover interaction may be performed by the same object. For example a user may hover a digit over a user interface element to select the element, may touch a portion of the element to select a particular feature provided by the user interface element, and may then hover to control an aspect of the feature provided. In another embodiment, the touch interaction and the hover interaction may be performed by two separate objects. For example a user may use a stylus with a capacitive tip to select an item and may use a digit to control an action performed by the selected item.

[0041] Method 500 may also include, at 550, identifying a combined touch and hover interaction associated with the touch interaction and the hover interaction. The combined touch and hover interaction may depend on one or more touches that occur at least partially in parallel (e.g., partially simultaneously, partially concurrently) with one or more hover interactions. In one embodiment, the touch interaction may include two or more touch interactions that occur serially or at least partially in parallel. For example, a user may touch an i/o interface at a first location to identify a starting location for a video game effect (e.g., flames) and may touch the i/o interface at a second location to identify an ending location for the effect. Additionally, a hover interaction may include two or more hover interactions that occur serially or at least partially in parallel. For example, a user may hover a first digit over a first location and at a first height to indicate an intensity associated with producing a sound from a virtual violin string and may hover a second digit over a second location and at a second height to indicate an effect (e.g., reverb) associated with the sound produced by the virtual violin string.

[0042] Method 500 may also include, at 560, selectively controlling the device as a function of the combined touch and hover interaction. In one embodiment, selectively controlling the device as a function of the combined touch and hover interaction includes providing an input signal from the input/output interface. For example, the combined touch and hover interaction may identify a character to be entered into a text box, a graphic to be added to a drawing, a brush stroke to be used to build a Kanji character, or other input. In one embodiment, selectively controlling the device as a function of the combined touch and hover interaction includes providing an output signal to the input/output interface. For example, the combined touch and hover interaction may identify a brush stroke location, width, color, and intensity to be displayed in a virtual painting program. Similarly, the combined touch and hover interaction may identify a desired note, volume, and reverberation to be played by a virtual musical instrument.

[0043] More generally, a touch interaction may control a first attribute of a user interface element and a hover interaction may control a second different attribute of the user interface element. The combined touch and hover interaction may coordinate controlling the first attribute and the second attribute simultaneously. The first attribute may be a choice of a user interface element to display and the second attribute may be a property of the user interface element.

[0044] Method 500 may be used by different applications in different ways. Thus, selectively controlling the device as a function of the combined touch and hover interaction may include controlling a typing application, controlling a video game, controlling a virtual painting application, controlling a virtual musical instrument, or controlling other applications.

[0045] Figure 6 illustrates an example method 600 that is similar to method 500 (Figure 5). For example, method 600 includes detecting a touch interaction at 630, detecting a hover interaction at 640, identifying a combined touch and hover event at 640, and controlling an i/o interface at 650. However, method 600 also includes additional actions.

[0046] Conventionally, the appearance, operation, and other attributes of user actions may have been configurable through on-screen configuration. The configuration that was possible, if any, may have occurred through user interaction with the i/o interface and not through programmatic control. Additionally, since simultaneous touch actions and hover actions were not allowed, there was no configuration of simultaneous touch and hover actions. Example apparatus and methods provide a more configurable and extensible approach to configuration that supports simultaneous touch and hover actions. To support this configurability, method 600 may include, at 610, receiving an inbound message. The message may be received, for example, through an application programming interface (API) provided by a process running on the device. In different embodiments, the inbound message may also be received using other message passing approaches including, for example, sockets, remote procedure calls, interrupts, or shared memory. The inbound message may include configuration information that controls the type of combinations that will be accepted, how to parse multiple touches, how to parse multiple hovers, how to parse simultaneous actions, how to parse combinations of actions, time intervals for separate but related actions, callback addresses for event handlers, or other information. Method 600 may, as a function of receiving the inbound message at 610, selectively reconfigure which combinations are accepted and how the combinations are handled.

[0047] A user may interact with a touch-sensitive and hover-sensitive screen in different ways at different times. For example, at a first time a user may be using a texting application, at a second time a user may be editing a photograph, and at a third time a user may be handling their email. Different applications may have different types of interfaces with which a user may interact in different ways. A user may interact with their text application with their index finger, may interact with their email application with their thumbs, may interact with a video game with multiple digits, and may interact with a painting application with an electronic paint brush and multiple digits. User interfaces associated with virtual musical instruments may also employ multiple simultaneous touch and hover interactions. For example, a virtual violin may use a touch action to select a string to play and a hover action to simulate passing a bow over the string. The proximity of the hover action may control the volume of the instrument.

[0048] While Figures 5 and 6 illustrate various actions occurring in serial, it is to be appreciated that various actions illustrated in Figures 5 and 6 could occur substantially in parallel. By way of illustration, a first process could identify touch actions, a second process could identify hover actions, and a third process could process combined touch and hover actions. While three processes are described, it is to be appreciated that a greater or lesser number of processes could be employed and that lightweight processes, regular processes, threads, and other approaches could be employed.

[0049] In one example, a method may be implemented as computer executable instructions. Thus, in one example, a computer-readable storage medium may store computer executable instructions that if executed by a machine (e.g., computer) cause the machine to perform methods described or claimed herein including methods 500 or 600. While executable instructions associated with the listed methods are described as being stored on a computer-readable storage medium, it is to be appreciated that executable instructions associated with other example methods described or claimed herein may also be stored on a computer-readable storage medium. In different embodiments, the example methods described herein may be triggered in different ways. In one embodiment, a method may be triggered manually by a user. In another example, a method may be triggered automatically. [0050] Figure 7 illustrates an example cloud operating environment 700. A cloud operating environment 700 supports delivering computing, processing, storage, data management, applications, and other functionality as an abstract service rather than as a standalone product. Services may be provided by virtual servers that may be implemented as one or more processes on one or more computing devices. In some embodiments, processes may migrate between servers without disrupting the cloud service. In the cloud, shared resources (e.g., computing, storage) may be provided to computers including servers, clients, and mobile devices over a network. Different networks (e.g., Ethernet, Wi-Fi, 802.x, cellular) may be used to access cloud services. Users interacting with the cloud may not need to know the particulars (e.g., location, name, server, database) of a device that is actually providing the service (e.g., computing, storage). Users may access cloud services via, for example, a web browser, a thin client, a mobile application, or in other ways.

[0051] Figure 7 illustrates an example simultaneous touch and hover service 760 residing in the cloud. The simultaneous touch and hover service 760 may rely on a server 702 or service 704 to perform processing and may rely on a data store 706 or database 708 to store data. While a single server 702, a single service 704, a single data store 706, and a single database 708 are illustrated, multiple instances of servers, services, data stores, and databases may reside in the cloud and may, therefore, be used by the simultaneous touch and hover service 760.

[0052] Figure 7 illustrates various devices accessing the simultaneous touch and hover service 760 in the cloud. The devices include a computer 710, a tablet 720, a laptop computer 730, a personal digital assistant 740, and a mobile device (e.g., cellular phone, satellite phone) 750. It is possible that different users at different locations using different devices may access the simultaneous touch and hover service 760 through different networks or interfaces. In one example, the simultaneous touch and hover service 760 may be accessed by a mobile device 750. In another example, portions of simultaneous touch and hover service 760 may reside on a mobile device 750. Simultaneous touch and hover service 760 may perform actions including, for example, configuring a touch and hover sensitive i/o interface, handling a callback for a combined touch and hover action, allowing a user to define a combined touch and hover action, or other service. In one embodiment, simultaneous touch and hover service 760 may perform portions of methods described herein (e.g., method 500, method 600). [0053] Figure 8 is a system diagram depicting an exemplary mobile device 800 that includes a variety of optional hardware and software components, shown generally at 802. Components 802 in the mobile device 800 can communicate with other components, although not all connections are shown for ease of illustration. The mobile device 800 may be a variety of computing devices (e.g., cell phone, smartphone, handheld computer, Personal Digital Assistant (PDA), etc.) and may allow wireless two-way communications with one or more mobile communications networks 804, such as a cellular or satellite networks.

[0054] Mobile device 800 can include a controller or processor 810 (e.g., signal processor, microprocessor, application specific integrated circuit (ASIC), or other control and processing logic circuitry) for performing tasks including touch detection, hover detection, signal coding, data processing, input/output processing, power control, or other functions. An operating system 812 can control the allocation and usage of the components 802 and support application programs 814. The application programs 814 can include mobile computing applications (e.g., email applications, calendars, contact managers, web browsers, messaging applications), or other computing applications.

[0055] Mobile device 800 can include memory 820. Memory 820 can include nonremovable memory 822 or removable memory 824. The non-removable memory 822 can include random access memory (RAM), read only memory (ROM), flash memory, a hard disk, or other memory storage technologies. The removable memory 824 can include flash memory or a Subscriber Identity Module (SIM) card, which is known in GSM communication systems, or other memory storage technologies, such as "smart cards." The memory 820 can be used for storing data or code for running the operating system 812 and the applications 814. Example data can include touch action data, hover action data, combination touch and hover action data, user interface element state, web pages, text, images, sound files, video data, or other data sets to be sent to or received from one or more network servers or other devices via one or more wired or wireless networks. The memory 820 can store a subscriber identifier, such as an International Mobile Subscriber Identity (IMSI), and an equipment identifier, such as an International Mobile Equipment Identifier (IMEI). The identifiers can be transmitted to a network server to identify users or equipment.

[0056] The mobile device 800 can support one or more input devices 830 including, but not limited to, a screen 832 that is both touch and hover sensitive, a microphone 834, a camera 836, a physical keyboard 838, or trackball 840. The mobile device 800 may also support output devices 850 including, but not limited to, a speaker 852 and a display 854. Display 854 may be incorporated into a touch-sensitive and hover-sensitive i/o interface. Other possible input devices (not shown) include accelerometers (e.g., one dimensional, two dimensional, three dimensional). Other possible output devices (not shown) can include piezoelectric or other haptic output devices. Some devices can serve more than one input/output function. The input devices 830 can include a Natural User Interface (NU ). An NUI is an interface technology that enables a user to interact with a device in a "natural" manner, free from artificial constraints imposed by input devices such as mice, keyboards, remote controls, and others. Examples of NUI methods include those relying on speech recognition, touch and stylus recognition, gesture recognition (both on screen and adjacent to the screen), air gestures, head and eye tracking, voice and speech, vision, touch, gestures, and machine intelligence. Other examples of a NUI include motion gesture detection using accelerometers/gyroscopes, facial recognition, three dimensional (3D) displays, head, eye, and gaze tracking, immersive augmented reality and virtual reality systems, all of which provide a more natural interface, as well as technologies for sensing brain activity using electric field sensing electrodes (electro-encephalogram (EEG) and related methods). Thus, in one specific example, the operating system 812 or applications 814 can comprise speech-recognition software as part of a voice user interface that allows a user to operate the device 800 via voice commands. Further, the device 800 can include input devices and software that allow for user interaction via a user's spatial gestures, such as detecting and interpreting simultaneous touch and hover gestures to provide input to an application.

[0057] A wireless modem 860 can be coupled to an antenna 891. In some examples, radio frequency (RF) filters are used and the processor 810 need not select an antenna configuration for a selected frequency band. The wireless modem 860 can support two- way communications between the processor 810 and external devices. The modem 860 is shown generically and can include a cellular modem for communicating with the mobile communication network 804 and/or other radio-based modems (e.g., Bluetooth 864 or Wi- Fi 862). The wireless modem 860 may be configured for communication with one or more cellular networks, such as a Global system for mobile communications (GSM) network for data and voice communications within a single cellular network, between cellular networks, or between the mobile device and a public switched telephone network (PSTN). Mobile device 800 may also communicate locally using, for example, near field communication (NFC) element 892. [0058] The mobile device 800 may include at least one input/output port 880, a power supply 882, a satellite navigation system receiver 884, such as a Global Positioning System (GPS) receiver, an accelerometer 886, or a physical connector 890, which can be a Universal Serial Bus (USB) port, IEEE 1394 (Fire Wire) port, RS-232 port, or other port. The illustrated components 802 are not required or all-inclusive, as other components can be deleted or added.

[0059] Mobile device 800 may include a simultaneous touch and hover logic 899 that is configured to provide a functionality for the mobile device 800. For example, simultaneous touch and hover logic 899 may provide a client for interacting with a service (e.g., service 760, figure 7). Portions of the example methods described herein may be performed by simultaneous touch and hover logic 899. Similarly, simultaneous touch and hover logic 899 may implement portions of apparatus described herein.

[0060] Figure 9 illustrates an apparatus 900 that provides a simultaneous touch and hover interface. In one example, the apparatus 900 includes an interface 940 configured to connect a processor 910, a memory 920, a set of logics 930, a proximity detector 960, a touch detector 965, and a touch-sensitive and hover-sensitive i/o interface 950. In one embodiment, the proximity detector 960 and the touch detector 965 may share a set of capacitive sensing nodes that provide both touch-sensitivity and hover-sensitivity for the input/output interface. Elements of the apparatus 900 may be configured to communicate with each other, but not all connections have been shown for clarity of illustration.

[0061] The touch detector 965 may detect when an object 975 touches the i/o interface 950. The proximity detector 960 may detect an object 980 in a hover-space 970 associated with the apparatus 900. The hover-space 970 may be, for example, a three dimensional volume disposed in proximity to the i/o interface 950 and in an area accessible to the proximity detector 960. The hover-space 970 has finite bounds. Therefore the proximity detector 960 may not detect an object 999 that is positioned outside the hover-space 970.

[0062] Apparatus 900 may include a first logic 932 that is configured to produce characterization data concerning a simultaneous touch and hover event detected by the input/output interface. The characterization data may describe, for example, the location of a touch, the location of a hover, the time at which the touch occurred, the time at which the hover occurred, a direction in which the touch is moving, a direction in which the hover is moving, a gesture associated with the touch, a gesture associated with the hover, or other information. In one embodiment, the first logic 932 may produce the characterization data from signals associated with combined simultaneous touch and hover events. In another embodiment, the first logic 932 may produce the characterization data from signals associated with discrete touch and hover events.

[0063] Apparatus 900 may include a second logic 934 that is configured to control selectively receiving an input from the input/output interface or to control selectively providing an output to the input/output interface as a function of the combined touch and hover event. For example, a certain combination of touch and hover events may indicate that a certain input is to occur (e.g., add upper case E to text box) while another combination of touch and hover events may indicate that a certain output is to occur (e.g., play a sound from a virtual violin string, shoot virtual flames in a video game).

[0064] A combined touch and hover event may include a single touch portion and a single hover portion. In one embodiment, a touch portion of the touch and hover event controls a first attribute of a user interface element displayed on the input/output interface 950 and a hover portion of the touch and hover event controls a second attribute of the user interface element displayed on the i/o interface 950. For example, a touch portion may identify a location where an action is to occur and the hover portion may identify the action to occur at that location. In another example, a touch portion may identify an object to be controlled (e.g., virtual violin string) and the hover portion may identify an effect to apply to the string (e.g., bowing, plucking) and an intensity of the effect (e.g., volume control).

[0065] A combined touch and hover event may include multiple touch portions or multiple hover portions. In one action, a first touch portion may identify a location from which an effect (e.g., flames produced by magic spell) is to originate, a second touch portion may identify a direction in which the effect is to be applied, a first hover portion may identify a property of the effect (e.g., intensity) and a second hover portion may identify another property of the effect (e.g., degree to which the flames are to fan out). Different combinations of touch portions and hover portions can be used in different applications.

[0066] For example, the touch portion of the touch and hover event may include two or more touches on the input/output interface 950 or the hover portion of the touch and hover event may include two or more hovers in a hover-space associated with the input/output interface 950. The two or more touches and the two or more hovers may occur at least partially in parallel to produce a diverse, rich interaction with the device 900.

[0067] Apparatus 900 may include a third logic 936 that reconfigures how the second logic 934 processes the combined touch and hover event. The third logic 936 may reconfigure the second logic 934 in response to a message received from a user or an application through a messaging interface.

[0068] Apparatus 900 may include a memory 920. Memory 920 can include nonremovable memory or removable memory. Non-removable memory may include random access memory (RAM), read only memory (ROM), flash memory, a hard disk, or other memory storage technologies. Removable memory may include flash memory, or other memory storage technologies, such as "smart cards." Memory 920 may be configured to store user interface state information, characterization data, object data, or other data.

[0069] Apparatus 900 may include a processor 910. Processor 910 may be, for example, a signal processor, a microprocessor, an application specific integrated circuit (ASIC), or other control and processing logic circuitry for performing tasks including signal coding, data processing, input/output processing, power control, or other functions. Processor 910 may be configured to interact with logics 930 that provide simultaneous touch and hover processing.

[0070] In one embodiment, the apparatus 900 may be a general purpose computer that has been transformed into a special purpose computer through the inclusion of the set of logics 930. The set of logics 930 may be configured to perform input and output. Apparatus 900 may interact with other apparatus, processes, and services through, for example, a computer network.

[0071] The following includes definitions of selected terms employed herein. The definitions include various examples or forms of components that fall within the scope of a term and that may be used for implementation. The examples are not intended to be limiting. Both singular and plural forms of terms may be within the definitions.

[0072] References to "one embodiment", "an embodiment", "one example", and "an example" indicate that the embodiment(s) or example(s) so described may include a particular feature, structure, characteristic, property, element, or limitation, but that not every embodiment or example necessarily includes that particular feature, structure, characteristic, property, element or limitation. Furthermore, repeated use of the phrase "in one embodiment" does not necessarily refer to the same embodiment, though it may.

[0073] "Computer-readable storage medium", as used herein, refers to a medium that stores instructions or data. "Computer-readable storage medium" does not refer to propagated signals. A computer-readable storage medium may take forms, including, but not limited to, non-volatile media, and volatile media. Non-volatile media may include, for example, optical disks, magnetic disks, tapes, and other media. Volatile media may include, for example, semiconductor memories, dynamic memory, and other media. Common forms of a computer-readable storage medium may include, but are not limited to, a floppy disk, a flexible disk, a hard disk, a magnetic tape, other magnetic medium, an application specific integrated circuit (ASIC), a compact disk (CD), a random access memory (RAM), a read only memory (ROM), a memory chip or card, a memory stick, and other media from which a computer, a processor or other electronic device can read.

[0074] "Data store", as used herein, refers to a physical or logical entity that can store data. A data store may be, for example, a database, a table, a file, a list, a queue, a heap, a memory, a register, and other physical repository. In different examples, a data store may reside in one logical or physical entity or may be distributed between two or more logical or physical entities.

[0075] "Logic", as used herein, includes but is not limited to hardware, firmware, software in execution on a machine, or combinations of each to perform a function(s) or an action(s), or to cause a function or action from another logic, method, or system. Logic may include a software controlled microprocessor, a discrete logic (e.g., ASIC), an analog circuit, a digital circuit, a programmed logic device, a memory device containing instructions, and other physical devices. Logic may include one or more gates, combinations of gates, or other circuit components. Where multiple logical logics are described, it may be possible to incorporate the multiple logical logics into one physical logic. Similarly, where a single logical logic is described, it may be possible to distribute that single logical logic between multiple physical logics.

[0076] To the extent that the term "includes" or "including" is employed in the detailed description or the claims, it is intended to be inclusive in a manner similar to the term "comprising" as that term is interpreted when employed as a transitional word in a claim.

[0077] To the extent that the term "or" is employed in the detailed description or claims (e.g., A or B) it is intended to mean "A or B or both". When the Applicant intends to indicate "only A or B but not both" then the term "only A or B but not both" will be employed. Thus, use of the term "or" herein is the inclusive, and not the exclusive use. See, Bryan A. Garner, A Dictionary of Modern Legal Usage 624 (2d. Ed. 1995).

[0078] Although the subject matter has been described in language specific to structural features or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.