Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
FORCE SENSITIVE DEVICE
Document Type and Number:
WIPO Patent Application WO/2017/044206
Kind Code:
A1
Abstract:
A display with a force sensing function has two layers of a reference voltage, for example a ground voltage. One reference voltage layer is inside the display stack. A sensor layer between the two reference voltage layers senses capacitance from the distance between the sensor layer and the reference voltage layer. The capacitance changes according to the force applied to the display, as the display moves slightly when the user presses the display. A thin foam layer allows the distance between the sensor layer and the reference voltage to change. This change is reflected in the measured capacitance. Multiple force sensors also enable detection of the position of the touch.

Inventors:
KEMPPINEN PASI (US)
PELLIKKA MATTI (US)
Application Number:
PCT/US2016/045453
Publication Date:
March 16, 2017
Filing Date:
August 04, 2016
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
MICROSOFT TECHNOLOGY LICENSING LLC (US)
International Classes:
G06F3/041
Domestic Patent References:
WO2015123322A12015-08-20
WO2014092758A12014-06-19
Attorney, Agent or Firm:
MINHAS, Sandip et al. (US)
Download PDF:
Claims:
CLAIMS

1. A device, comprising:

a body,

a display having a cover glass extending over the edges of the display,

an adhesive configured to attach the display to the body from the cover glass portion,

a first conductive layer on the display configured to provide a reference voltage, a second conductive layer on the body configured to provide a reference voltage, a sensor layer configured to detect capacitance between the reference voltage and the sensor layer,

a first dielectric layer configured to provide a distance between the first conductive layer and the sensor layer, and

a second dielectric layer configured to provide a distance between the second conductive layer and the sensor layer; wherein

at least one of the first dielectric layer and the second dielectric layer is made of foam configured to compress due to a force applied to the display.

2. A device according to claim 1, comprising at least one processor and a memory storing instructions that, when executed, cause the device to transform the capacitance detected from the sensor layer to correspond to the force applied to the display.

3. A device according to claim 2, comprising a plurality of sensors at the sensor layer, wherein the at least one processor and the memory storing instructions cause, when executing the instructions, the device to detect the position of the force applied to the display.

4. A device according to claim 1, wherein the first dielectric layer and the second dielectric layer are made of foam.

5. A device according to claim 1, wherein the first dielectric layer is made of foam and the second dielectric layer is made of solid material.

6. A device according to claim 1, wherein the first dielectric layer is made of solid material and the second dielectric layer is made of foam.

7. A display structure, comprising:

a body,

a display having a cover glass extending over the edges of the display, an adhesive configured to attach the display to the body from the cover glass portion extending over the edges of the display,

a first conductive layer on the display configured to provide a reference voltage, a second conductive layer on the body configured to provide a reference voltage, a sensor layer configured to detect capacitance between the reference voltage and the sensor layer,

a first dielectric layer configured to provide a distance between the first conductive layer and the sensor layer, and

a second dielectric layer configured to provide a distance between the second conductive layer and the sensor layer; wherein

at least one of the first dielectric layer and the second dielectric layer is made of a compressible material configured to compress due to a force applied to the display.

8. A display structure according to claim 7, wherein the display is configured to move and the compressible material is configured to compress when the force is applied to the display, wherein the force is equivalent to the force caused by a human finger.

9. A display structure according to claim 7, wherein the compressible material in the first dielectric layer and in the second dielectric layer is made of foam.

10. A display structure according to claim 7, wherein the compressible material in the first dielectric layer is made of foam and the second dielectric layer is made of solid material.

11. A display structure according to claim 7, wherein the first dielectric layer is made of solid material and the second dielectric layer is made of foam.

12. A system, comprising:

a body,

a display having a cover glass extending over the edges of the display,

an adhesive configured to attach the display to the body from the cover glass portion,

a first conductive layer on the display configured to provide a reference voltage, a second conductive layer on the body configured to provide a reference voltage, a sensor layer configured to detect capacitance between the reference voltage and the sensor layer,

a first dielectric layer configured to provide a distance between the first conductive layer and the sensor layer, and a second dielectric layer configured to provide a distance between the second conductive layer and the sensor layer; wherein

at least one of the first dielectric layer and the second dielectric layer is made of foam configured to compress due to the force applied to the display.

13. A system according to claim 12, comprising at least one processor and a memory storing instructions that, when executed, cause the system to transform the capacitance detected from the sensor layer to correspond to the force applied to the display.

14. A system according to claim 13, comprising a plurality of sensors at the sensor layer, wherein the at least one processor and the memory storing instructions cause, when executing the instructions, the system to detect the position of the force applied to the display.

15. A system according to claim 12, wherein the display is configured to move and the foam is configured to compress when the force is applied to the display, wherein the force is equivalent to the force caused by a human finger.

Description:
FORCE SENSITIVE DEVICE

BACKGROUND

[0001] Touch sensitive displays are a well-known solution for user interfaces. The display senses the position of the touch on the screen. Additional features may be utilized in the user interface when the display detects the force of the touch - for example, the user may apply more force against the display to increase a displayed value on the screen. Current trends of the mobile or hand-held devices focus on thinner devices. The sensors sensing the force are aimed to be thin and/or light in order to fit into the device stack that forms the smartphone or any other device. A complex structure would require multiple layers on the display stack, thereby increasing the thickness of the display. The

embodiments described below are not limited to implementations which solve any or all of the disadvantages of known displays with force sensors.

SUMMARY

[0002] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This

Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

[0003] A display with a force sensing function has two layers of a reference voltage, for example a ground voltage. One reference voltage layer is inside the display stack. A sensor layer between the two reference voltage layers senses capacitance from the distance between the sensor layer and the reference voltage layer. The capacitance changes according to the force applied to the display, as the display moves slightly when the user presses the display. A thin foam layer allows the distance between the sensor layer and the reference voltage to change. This change is reflected in the measured capacitance.

Multiple force sensors also enable detection of the position of the touch.

[0004] Many of the attendant features will be more readily appreciated as they become better understood by reference to the following detailed description considered in connection with the accompanying drawings.

DESCRIPTION OF THE DRAWINGS

[0005] The present description will be better understood from the following detailed description read in light of the accompanying drawings, wherein:

FIG. 1 illustrates a device according to an embodiment; FIG. 2 illustrates a cross-sectional view of one device with a display;

FIG. 3 illustrates one embodiment of a display stack; and

FIG. 4 illustrates one embodiment of the sensor layer placement on the device. Like reference numerals are used to designate like parts in the accompanying drawings.

DETAILED DESCRIPTION

[0006] The detailed description provided below in connection with the appended drawings is intended as a description of the present examples and is not intended to represent the only forms in which the present example may be constructed or utilized. However, the same or equivalent functions and sequences may be accomplished by different examples.

[0007] Although the present examples are described and illustrated herein as being implemented in a smartphone, the device described is provided as an example and not a limitation. As those skilled in the art will appreciate, the present examples are suitable for application in a variety of different types of mobile and/or hand-held apparatuses, e.g. in tablets, laptops or gaming consoles. Force sensing may be used in various applications and apparatuses with a display. The display may be a peripheral connected to a system, wherein at least a portion of the user interface is configured to the display. In one embodiment the display is arranged inside a car, wherein the driver or passenger may operate the display with the force sensing feature.

[0008] FIG. 1 illustrates a device according to an embodiment, wherein the device is a smartphone. The device comprises a body 100 comprising a display 110, a speaker 120, a microphone 130, keys 140 and a camera 150. The device comprises at least one processor and at least one memory including computer program code for one or more programs. The at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus to perform at least the functionality described herein. The system described hereinafter may comprise a portion of the portable device, its components and/or peripherals connected to the portable device.

[0009] FIG. 2 illustrates a cross- sectional view of a device with a display, wherein a portion of the structure is shown. In this embodiment the device is a smartphone. A device body may comprise different constructions. In one embodiment the body is a unibody design, wherein the body consists of a single shell that is the principal source of structural strength and is configured to carry the components. In one embodiment the body comprises multiple parts, wherein the structural strength and component placement is carried out by different parts of the body. In the embodiment of FIG. 2 the device body comprises a display frame 200 and a cover structure 204. A display 210 is visible under a cover glass 211. The display 210 may be attached to the display frame 200. The cover glass 211 protects the display from external elements, such as moisture or mechanical damage. In one embodiment the display 210 is attached to the cover glass 211 with a transparent adhesive 213. The cover glass 211 is made of durable transparent material that may comprise a coating made of another material, not limiting the cover glass material to glass. In this context, directions such as "top", "higher" or "up" relate to the visible side of the display 210; and "bottom", "lower" or "down" relate to the side of the display 210 that is attached to the device.

[0010] A portion 212 of the cover glass 211 extends over the edges of the display

210. An adhesive 203 attaches the cover glass 211 to the display frame 200 from the cover glass portion 212. An adhesive 203 attaches the cover glass 211 to the display frame 200. The outer cover structure 204 is configured to provide rigidity to the device and protection on the outer edges of the device. The cover structure 204 may be openable by the user. Various cover structure 204 arrangements are possible without affecting the functionality of the force sensing. As the cover glass 211 is attached to the display 210, the adhesive 203 attaches the display 210 to the display frame 200 from the cover glass portion 212. In one embodiment the display is an OLED display (OLED, Organic Light-Emitting Diode). The display 210 comprises a first conductive layer 201 that provides a reference voltage. The first conductive layer 201 may be a common voltage layer, configured to comprise a single function, such as a VCOM layer for the display or a guard electrode layer for the touch sensing if the display is configured to sense touch. In one embodiment the first conductive layer 201 comprises two functions, a VCOM layer for the display mode and a guard electrode layer for the touch sensing mode, wherein the modes are configured to alternate according to the function.

[0011] A second conductive layer 202 is configured on the display frame 200 to provide a reference voltage. In an embodiment, both the first conductive layer 201 and the second conductive layer 202 provide the same reference voltage. The reference voltage may be a ground voltage, a device chassis voltage, a phone chassis voltage or a floating ground, wherein the grounding may be provided through the user holding the display frame 200 of the device. The reference voltage may also be other predefined voltage level provided to the first conductive layer 201 and/or to the second conductive layer 202 by a measurement circuit. A sensor layer 220 is positioned between the first conductive layer 201 and the second conductive layer 202. A first dielectric layer 221 provides a distance between the first conductive layer 201 and the sensor layer 220, and a second dielectric layer 222 provides a distance between the second conductive layer 202 and the sensor layer 220. The sensor layer 220 is configured to detect capacitance between the reference voltage and the sensor layer 220. For example, a charge is induced on the sensor layer 220 and the capacitance measurement circuitry produces a voltage signal or the reference voltage for the first conductive layer 201 or the second conductive layer 202.

[0012] At least one of the first dielectric layer 221 and the second dielectric layer

222 is made of compressible material configured to compress due to a force applied to the display. The sensor layer 220 may only cover a portion of the display area, wherein the sensor area detects the movement of the display 210. One example of the movement is the display 210 bending towards the sensor layer 220 as a response to the user applying force to the display 210 or pressing the display 210. In one example the display 210 moves sideways as the adhesive 203 and/or the adhesive layer 213 may allow lateral flex to the display 210 in relation to the sensor layer 220. The compressible material may be made of foam or elastic material such as rubber or a gel-like material. In one embodiment the compressible material is foam. In one embodiment the foam is made of polyolefin and polyester. The foam may be used to cushion the display 210 against damage. The positioning of the sensor layer 220 and the foam layers 221, 222 in the area 223 under the display 210 provides more leverage to detecting the force from the display when compared to sensors positioned close to the edge of the cover glass 212. The compressible material 221, 222 has at least two purposes: cushioning the display and providing distance from the sensor layer 220 to the first conductive layer 201 and the second conductive layer 202.

[0013] In one embodiment the foam thickness is between 0.05mm to 0.2mm. In one embodiment the foam thickness is about 0.1mm. The foam may compress for up to 20% of the original thickness. In one embodiment the foam is supersoft foam.

[0014] A capacitive force sensor detects the changes in the capacitance from the sensor layer 220 against the reference voltage present at the first conductive layer 201 and the second conductive layer 202. In one embodiment the first conductive layer 201 is configured to the lower surface of the display 210, under the display 210. In one embodiment the first conductive layer 201 is configured to the areas near the edge of the display 210, wherein the layer may be made of a grounded copper tape, a printed conductive area or an ITO area on the lower surface of the cover glass 211. The change in the capacitance detected at the sensor layer 220 is proportional to the variable distance between the first conductive layer 201 and the sensor layer 220. When the user applies force to the cover glass 211, for example by pressing it with a finger, the cover glass 211 moves slightly. The movement of the cover glass 211 causes the display 210 to move as well, whereby the distance between the first conductive layer 201 and the sensor layer 220 is temporarily reduced. The display 210 may also move sideways due to the flexibility of the adhesive material 213. When the user releases the force applied to the cover glass 211, the structure retains its original form and the original distance between the first conductive layer 201 and the sensor layer 220. Variable background capacitance or parasitic capacitance could create unreliable results for measuring the capacitance; therefore, the sensor layer 220 is sandwiched between two layers both the reference voltage. The reference voltage may be the same for the first conductive layer 201 and the second conductive layer 202 or the layers 201, 202 may have different reference voltages. The reference voltage is kept constant over a long period of time. This configuration reduces the effect of background capacitance or parasitic capacitance and the capacitive measurement from the sensor layer 220 focuses to detecting movement of reference layers 201, 202. In one embodiment the backside of the device moves, causing the second conductive layer 202 to move closer to the sensor layer 220 or in relation to the sensor layer 220. The configuration senses the force applied on the backside of the device. In an embodiment, both sides of the device move, causing measurement of the force applied to the surface of both sides of the device.

[0015] In one embodiment the first dielectric layer 221 is made of compressible material and the second dielectric layer 222 is made of solid material. The solid material in this context refers to a material that is not compressible in the measurement range of the force applied by a human finger to a portable device. In one embodiment the first dielectric layer 221 is made of solid material and the second dielectric layer 222 is made of compressible material. These embodiments may be used to differentiate the detection range of the force applied to the device surface. In one embodiment the sensor layer 220 detects the battery swell, as the swelling battery may alter the distance between the sensor layer 220 and the first conductive layer 201 or the second conductive layer 202.

[0016] The sensor layer 220 is in one embodiment configured as a conductor inside an insulating layer. In one embodiment the sensor layer 220 comprises a flat polyamide-copper-polyamide configuration with a flat structure. In one embodiment the conductor inside the sensor layer 220 extends to a force detecting element 230 through the second conductive layer 202. The second conductive layer 202 may extend to the sides on the device, providing further protection to force sensing elements. In one embodiment the second conductive layer 202 extending to the sides may be used to detect force sensing from the sides of the device.

[0017] In an embodiment the device comprises at least one processor 231 and a memory storing instructions that, when executed, cause the device to transform the capacitance detected from the sensor layer 220 to correspond to the force applied to the display 210. The device comprises a force detecting element 230 that is connected to the conductor extending from the sensor layer 220. The force detecting element 230 detects the voltage received from the sensor layer 220 and transforms the voltage information to force information. The force detecting element 230 may be implemented partially by the operating system of the portable device; it may be implemented by hardware or partially by hardware and partially by embedded software. In an embodiment the software or a part of the software is configured in a cloud computing environment and at least a portion of the software is executed in the cloud computing environment. In one embodiment the force detecting element 230 and the at least one processor 231 are integrated as a single component. In one embodiment the force detecting element is configured to detect the position of a touch on the display.

[0018] In an embodiment the at least one processor and the memory storing instructions cause, when executing the instructions, the device to calibrate a sensor at the sensor layer by moving a predefined measurement range between a minimum capacitance value and a maximum capacitance value. The measurement range may be 40pF that is moved inside the value range detectable by the force detecting element 230. The measurement range and the measurement resolution may vary according to the

embodiment or according to the design of the capacitance measurement circuit.

[0019] FIG. 3 illustrates one embodiment of a display stack. An array glass 310 forms the bottom layer of the display stack. The display panel 311 may be a LCD panel, a LED, an OLED, an AMOLED panel or any means for presenting an image, wherein the first conductive layer is sufficiently stiff to move according to the display. The display may be configured to detect touch with a capacitive sensor. A display driver operates and controls the display panel 311. The display driver may be a separate integrated circuit connected to the display panel 311. On top of the display panel 311 there is a color filter 312 that may be made of glass. Display functions are arranged on the lower portion of the display stack and touch functions are arranged on the upper portion. An adhesive layer 313 connects the color filter 312 and a guard layer 314 used for sensing touch. In this arrangement a touch sensor substrate 315 separates the self-capacitance sensing layers, the lower guard layer 314 and an upper electrode layer 316. The electrode layer 316 may comprise multiple sensors on the same layer according to the desired touch sensing resolution. Electrodes may be arranged in an array and they may be square or any other shape in two dimensions on the electrode layer 316. A touch control 320 is connected to the guard layer 314 and the electrode layer 316. A cover glass 318 forms the top layer. It is connected to the electrode layer 316 and to the touch sensor substrate layer 315 with an adhesive layer 317. The cover glass 318 may be made of glass or any other suitable transparent and durable material.

[0020] FIG. 4 illustrates one embodiment of the sensor layer placement on the device. In one embodiment the device comprises a plurality of sensors 420 at the sensor layer. The sensors 420 may detect the capacitance from the first conductive layer and/or the second conductive layer. The sensors 420 may also comprise dummy sensor lines configured to detect environmental effects that differ from the capacitive movement measurement. These environmental effects may be filtered from the capacitance detected from the sensors arranged on the sensor layer. The sensors 420 may be located near the corners of the device body 400. Conductors 421 conduct the sensor information to a force sensing element 430. The force sensing element 430 may be configured on the same layer as the sensors 420 or it may be configured on another layer on the body 400, wherein the component 430 provides a connector to the force sensing element. When the user applies force to the display, the plurality of sensors 420 in the sensor layer detect different values as the leverage of the moving display affects sensors 420 at each corner in a different manner. The at least one processor and the memory storing instructions cause, when executing the instructions, the device to detect the position of the force applied to the display according to the difference detected from different sensors 420. The display may also comprise a touch detecting function, wherein the information from the touch detecting element may be used with the force sensing element. In one embodiment the force sensing element detects the position of the touch when the display is off. This feature may save battery charge on the device. In one embodiment, compressible material is used for cushioning the display in some areas without having the sensor element 420 in between.

[0021] One aspect discloses a device, comprising: a body, a display having a cover glass extending over the edges of the display, an adhesive configured to attach the display to the body from the cover glass portion, a first conductive layer on the display configured to provide a reference voltage, a second conductive layer on the body configured to provide a reference voltage, a sensor layer configured to detect capacitance between the reference voltage and the sensor layer, a first dielectric layer configured to provide a distance between the first conductive layer and the sensor layer, and a second dielectric layer configured to provide a distance between the second conductive layer and the sensor layer; wherein at least one of the first dielectric layer and the second dielectric layer is made of foam configured to compress due to a force applied to the display. In an embodiment the device comprises at least one processor and a memory storing instructions that, when executed, cause the device to transform the capacitance detected from the sensor layer to correspond to the force applied to the display. In an embodiment the device comprises a plurality of sensors at the sensor layer, wherein the at least one processor and the memory storing instructions cause,, when executing the instructions, the device to detect the position of the force applied to the display. In an embodiment the at least one processor and the memory storing instructions cause, when executing the instructions, the device to calibrate a sensor at the sensor layer by moving a predefined measurement range between a minimum capacitance value and a maximum capacitance value. In an embodiment the display is an Organic Light-Emitting Diode display. In an embodiment the first dielectric layer and the second dielectric layer are made of foam. In an

embodiment the first dielectric layer is made of foam and the second dielectric layer is made of solid material. In an embodiment the first dielectric layer is made of solid material and the second dielectric layer is made of foam.

[0022] One aspect discloses a display structure, comprising: a body, a display having a cover glass extending over the edges of the display, an adhesive configured to attach the display to the body from the cover glass portion extending over the edges of the display, a first conductive layer on the display configured to provide a reference voltage, a second conductive layer on the body configured to provide a reference voltage, a sensor layer configured to detect capacitance between the reference voltage and the sensor layer, a first dielectric layer configured to provide a distance between the first conductive layer and the sensor layer, and a second dielectric layer configured to provide a distance between the second conductive layer and the sensor layer; wherein at least one of the first dielectric layer and the second dielectric layer is made of a compressible material configured to compress due to a force applied to the display. In an embodiment the display is configured to move and the compressible material is configured to compress when the force is applied to the display, wherein the force is equivalent to the force caused by a human finger. In an embodiment the display is an Organic Light-Emitting Diode display. In an embodiment the compressible material in the first dielectric layer and in the second dielectric layer is made of foam. In an embodiment the compressible material in the first dielectric layer is made of foam and the second dielectric layer is made of solid material. In an embodiment the first dielectric layer is made of solid material and the second dielectric layer is made of foam.

[0023] One aspect discloses a system, comprising: a body, a display having a cover glass extending over the edges of the display, an adhesive configured to attach the display to the body from the cover glass portion, a first conductive layer on the display configured to provide a reference voltage, a second conductive layer on the body configured to provide a reference voltage, a sensor layer configured to detect capacitance between the reference voltage and the sensor layer, a first dielectric layer configured to provide a distance between the first conductive layer and the sensor layer, and a second dielectric layer configured to provide a distance between the second conductive layer and the sensor layer; wherein at least one of the first dielectric layer and the second dielectric layer is made of foam configured to compress due to the force applied to the display. In an embodiment the system comprises at least one processor and a memory storing instructions that, when executed, cause the system to transform the capacitance detected from the sensor layer to correspond to the force applied to the display. In an embodiment the system comprises a plurality of sensors at the sensor layer, wherein the at least one processor and the memory storing instructions cause, when executing the instructions, the system to detect the position of the force applied to the display. In an embodiment the at least one processor and the memory storing instructions cause, when executing the instructions, the system to calibrate a sensor at the sensor layer by moving a predefined measurement range between a minimum capacitance value and a maximum capacitance value. In an embodiment the display is configured to move and the foam is configured to compress when the force is applied to the display, wherein the force is equivalent to the force caused by a human finger. In an embodiment the display is an Organic Light- Emitting Diode display.

[0024] Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), Graphics Processing Units (GPUs). For example, some or all of the force detection element functionality may be performed by one or more hardware logic components.

[0025] An example of the apparatus or a system described hereinbefore is a computing-based device comprising one or more processors which may be

microprocessors, controllers or any other suitable type of processors for processing computer executable instructions to control the operation of the device in order to control one or more sensors, receive sensor data and use the sensor data. Platform software comprising an operating system or any other suitable platform software may be provided at the computing-based device to enable application software to be executed on the device.

[0026] The computer executable instructions may be provided using any computer-readable media that are accessible by a computing based device. Computer- readable media may include, for example, computer storage media such as memory and communications media. Computer storage media, such as memory, include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media include, but are not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non- transmission medium that can be used to store information for access by a computing device. In contrast, communication media may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, or other transport mechanism. As defined herein, computer storage media do not include communication media. Therefore, a computer storage medium should not be interpreted to be a propagating signal per se. Propagated signals may be present in computer storage media, but propagated signals per se are not examples of computer storage media. Although the computer storage media are shown within the computing- based device it will be appreciated that the storage may be distributed or located remotely and accessed via a network or other communication link, for example by using

communication interface.

[0027] The computing-based device may comprise an input/output controller arranged to output display information to a display device which may be separate from or integral to the computing-based device. The display information may provide a graphical user interface, for example, to display hand gestures tracked by the device using the sensor input or for other display purposes. The input/output controller is also arranged to receive and process input from one or more devices, such as a user input device (e.g. a mouse, keyboard, camera, microphone or other sensor). In some examples the user input device may detect voice input, user gestures or other user actions and may provide a natural user interface (NUT). This user input may be used to configure the device for a particular user. In an embodiment the display device may also act as the user input device. The

input/output controller may also output data to devices other than the display device, e.g. a locally connected printing device.

[0028] The term 'computer' or 'computing-based device' is used herein to refer to any device with processing capability such that it can execute instructions. Those skilled in the art will realize that such processing capabilities are incorporated into many different devices and therefore the terms 'computer' and 'computing-based device' each include PCs, servers, mobile telephones (including smart phones), tablet computers, set-top boxes, media players, games consoles, personal digital assistants and many other devices.

[0029] The methods described herein may be performed by software in machine readable form on a tangible storage medium e.g. in the form of a computer program comprising computer program code means adapted to perform all the steps of any of the methods described herein when the program is run on a computer and where the computer program may be embodied on a computer readable medium. Examples of tangible storage media include computer storage devices comprising computer-readable media such as disks, thumb drives, memory etc. and do not include propagated signals. Propagated signals may be present in tangible storage media, but propagated signals per se are not examples of tangible storage media. The software can be suitable for execution on a parallel processor or a serial processor such that the method steps may be carried out in any suitable order, or simultaneously.

[0030] This acknowledges that software can be a valuable, separately tradable commodity. It is intended to encompass software, which runs on or controls "dumb" or standard hardware, to carry out the desired functions. It is also intended to encompass software which "describes" or defines the configuration of hardware, such as HDL

(hardware description language) software, as is used for designing silicon chips, or for configuring universal programmable chips, to carry out desired functions.

[0031] Those skilled in the art will realize that storage devices utilized to store program instructions can be distributed across a network. For example, a remote computer may store an example of the process described as software. A local or terminal computer may access the remote computer and download a part or all of the software to run the program. Alternatively, the local computer may download pieces of the software as needed, or execute some software instructions at the local terminal and some at the remote computer (or computer network). Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Application-specific

Integrated Circuits (ASICs), Application-specific Standard Products (ASSPs), System-on- a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0032] Any range or device value given herein may be extended or altered without losing the effect sought.

[0033] Although the subject matter has been described in language specific to structural features and/or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims.

[0034] It will be understood that the benefits and advantages described above may relate to one embodiment or may relate to several embodiments. The embodiments are not limited to those that solve any or all of the stated problems or those that have any or all of the stated benefits and advantages. It will further be understood that reference to 'an' item refers to one or more of those items.

[0035] The term 'comprising' is used herein to mean including the method blocks or elements identified, but that such blocks or elements do not comprise an exclusive list and a method or apparatus may contain additional blocks or elements.

[0036] It will be understood that the above description is given by way of example only and that various modifications may be made by those skilled in the art. The above specification, examples and data provide a complete description of the structure and use of exemplary embodiments. Although various embodiments have been described above with a certain degree of particularity, or with reference to one or more individual embodiments, those skilled in the art could make numerous alterations to the disclosed embodiments without departing from the spirit or scope of this specification.