Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHOD AND APPARATUS FOR PRESENTING AN OPTION
Document Type and Number:
WIPO Patent Application WO/2011/154873
Kind Code:
A1
Abstract:
A method of presenting an option comprises: calculating a movement range of an object; calculating an area of a display device based on the movement range; and presenting at least one option in the area of the display device (Fig. 2).

Inventors:
JIN SHENG (CN)
Application Number:
PCT/IB2011/052413
Publication Date:
December 15, 2011
Filing Date:
June 01, 2011
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
KONINKL PHILIPS ELECTRONICS NV (NL)
JIN SHENG (CN)
International Classes:
G06F3/01
Foreign References:
US20080019589A12008-01-24
US20030076293A12003-04-24
Other References:
None
Attorney, Agent or Firm:
KROEZE, John et al. (High Tech Campus 44, AE Eindhoven, NL)
Download PDF:
Claims:
What is claimed is:

1. An apparatus for presenting an option, comprising: a calculation module adapted to calculate a movement range of an object and calculate an area of a display device, based on the movement range; and a presentation module adapted to present at least one option in the area of the display device.

2. The apparatus of claim 1, wherein the apparatus further comprises a reception module adapted to receive position information of the object, the calculation module is further adapted to calculate the movement range, based on the received position information of the object.

3. The apparatus of claim 1, wherein the apparatus further comprises a processing module adapted to perform image processing on images including position information of the object to obtain the position information of the object, the calculation module is further adapted to calculate the movement range, based on the obtained position information of the object.

4. The apparatus of claim 3, wherein the images are picked up by an image pickup means.

5. The apparatus of claim 2, 3 or 4, wherein the calculation module is further adapted to calculate a movement trajectory of the object, based on the position information of the object, and calculate the movement range, based on the calculated movement trajectory of the object.

6. The apparatus of claim 1, wherein the object includes a marker worn on a hand of a person.

7. The apparatus of claim 4, wherein the image pickup means includes an infrared camera.

8. The apparatus of claim 1, wherein the apparatus further comprises: a judgment module adapted to judge whether or not a pointer indicating the object in the display device remains on one option of the at least one option for a predefined period; and a determination module to determine whether one of the at least one option is selected, when the judgment is affirmative.

9. A method of presenting an option, comprising: calculating a movement range of an object; calculating an area of a display device, based on the movement range; and presenting at least one option in the area of the display device.

10. The method of claim 9, wherein the method further comprises a step of receiving position information of the object, and the step of calculating a movement range of an object further comprises calculating the movement range, based on the received position information of the object.

11. The method of claim 9, wherein the method further comprises a step of performing image processing on images including position information of the object to obtain the position information of the object, and the step of calculating a movement range of an object further comprises calculating the movement range, based on the obtained position information of the object.

12. The method of claim 11, wherein the method further comprises a step of picking up the images including the position information of the object.

13. The method of claim 10, 11 or 12, wherein the method further comprises: calculating a movement trajectory of the object, based on the position information of the object; and calculating the movement range, based on the calculated movement trajectory of the object.

14. The method of claim 9, further comprising: judging whether or not a pointer indicating the object displayed on the display device remains on one option of the at least one option for a predefined period; and determining that one option of the at least one option is selected, when the judgment is affirmative.

15. A machine-readable medium storing machine -readable instructions, causing a machine to perform the method of any one of claims 9 to 14.

Description:
METHOD AND APPARATUS FOR PRESENTING AN OPTION

TECHNICAL FIELD

The invention relates to a method and apparatus for presenting an option.

BACKGROUND OF THE INVENTION

A stroke rehabilitation system is a good tool for a stroke patient to do limb rehabilitation exercises.

The existing stroke rehabilitation system may usually include a host controller, a video camera, a display device and passive markers. The display device may display guidance for a limb rehabilitation exercise prescribed by doctors and/or therapists. The passive markers are worn on hands, elbows and shoulders of the stroke patient. When the stroke patient wearing the passive markers on hands, elbows and shoulders does limb rehabilitation exercises according to the guidance being displayed on the display device, the video camera may pick up images of the patient, and the host controller may perform image processing on the images picked up by the video camera to detect the markers worn by the patient, and present the detected markers as pointers on the display device. The host controller may calculate a trajectory performed by the patient, based on trajectories of the detected markers, and compare the calculated trajectory with a medical exercise template to give an evaluation of the training quality.

With the existing stroke rehabilitation system, user interaction needs to be carefully designed since the patient usually has an upper limb impairment on one side of the body. The use of an infrared remote controller in the existing stroke rehabilitation system is a feasible solution since the patient usually has an unimpaired upper limb on the other side of the body.

However, there are some inconvenience attached to this solution. The patient needs to hold the remote controller when control is needed, and the remote controller has to be placed somewhere when the patient is doing his training exercises. Usually the patient should keep a standing position or sits in a wheelchair in an open area without a desk or table by his side, so that the patient will find there is no place to put down the remote controller.

SUMMARRY OF THE INVENTION An object of the present invention is to provide a method and apparatus for presenting an option that enables user interaction to be performed without the controller.

In accordance with one aspect, an apparatus for presenting an option comprises: a calculation module adapted to calculate a movement range of an object and calculate an area of a display device, based on the movement range; and a presentation module adapted to present at least one option in the area of the display device.

In accordance with another aspect, a method of presenting an option comprises:

calculating a movement range of an object; calculating an area of a display device, based on the movement range; and presenting at least one option in the area of the display device.

These and other characteristics, features and advantages of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention. The description is given for the sake of example only, without limiting the scope of the invention. The reference Figures given below refer to the attached drawings. DESCRIPTION OF THE DRAWINGS

The invention is explained in further detail, and by way of example, with reference to the accompanying drawings wherein:

Fig. 1 is a schematic diagram illustrating a stroke rehabilitation system according to an embodiment of the invention;

Fig. 2 illustrates a flowchart for a process of presenting an option according to an embodiment of the invention; and

Figs. 3 A and 3B are examples of presenting an option in the display device.

Throughout the above drawings, like reference numerals will be understood to refer to like, similar or corresponding features or functions.

DETAILED DESCRIPTION OF EMBODIMENTS

The present invention will be described with respect to particular embodiments and with reference to certain drawings but the invention is not limited thereto but only by the claims.

The drawings described are only schematic and are non-limiting. In the drawings, the size of some of the elements may be exaggerated and not drawn to scale for illustrative purposes. Where an indefinite or definite article is used when referring to a singular noun, e.g. "a", "an", "the", this includes a plural of that noun unless specifically stated otherwise.

Fig. 1 is a schematic diagram illustrating a stroke rehabilitation system according to an embodiment of the invention. The stroke rehabilitation system 10 may include three retro- reflective markers 100a, 100b and 100c, an infrared camera 110, a display device 120 and a host controller 130.

The retro -reflective markers 100a- 100c may be worn on a hand, elbow and shoulder of the patient, respectively. The marker 100a worn on the hand of the patient has a different shape from the marker 100b worn on the elbow of the patient and the marker 100c worn on the shoulder of the patient.

The infrared camera 110 may pick up images including the patient.

The display device 120 may display guidance about a limb rehabilitation exercise prescribed by doctors and/or therapists, and display at least one option in a specific area of the display device 120 as explained below in detail.

The host controller 130, which may include a processor, a RAM and a ROM, may perform image processing on the images picked up by the infrared camera 110 to obtain position information of the marker 100a worn on the hand of the patient, calculate a movement range of the marker 100a, based on the obtained position information, calculate an area of the display device 120, based on the calculated movement range, the area of the display device 120 being an area that displays the calculated movement range if the calculated movement range is displayed in the display device 120, and present at least one option (for example, menu item or button etc.) in the area of the display device 120 when the at least one option needs to be provided to the patient for selection. In another embodiment of the invention, the host controller 130 may further judge whether or not a pointer indicating the marker 100a on the display device 120 remains on one option of the at least one option for a predetermined period (for example 10 seconds), and determine that one option of the at least one option is selected by the patient when the judgment is affirmative.

Fig. 2 illustrates a flowchart for a process of presenting an option according to an embodiment of the invention. A position calibration is performed to calibrate the patient's position such that it fits the training session (Step S100). The position of the marker 100a at the moment of completing calibration is recorded as the starting point.

After said position calibration, and until the system 10 is powered off, the camera 110 may continuously pick up images including the patient, and whenever the camera 110 picks up a new image, image processing on the new image is performed by the host controller 130 to obtain the present position of the marker 100a, and a pointer indicating the marker 100a is presented in a position on the display device 120 corresponding to the present position of the marker 100a.

A guide is presented in the display device 120 by the host controller 130, to ask the patient to move the marker 100a worn on the hand so as to measure the movement range that the marker 100a is able to cover (Step SI 10).

Images picked up by the infrared camera 110 during measurement of the movement range are transferred from the infra-red camera 110 to the host controller 130 (Step S120). Here, the fact that the marker 100a worn on the hand of the patient goes back to the starting point means that measurement of the movement range of the marker 100a is completed.

Image processing of each of the transferred images is performed by the host controller 130 to calculate the position of the marker 100a in each of said images, thus obtaining a plurality of positions of the marker 100a (Step SI 30).

A movement trajectory of the marker 100a is calculated by the host controller 130 by interconnecting the plurality of positions of the marker 100a (Step S140).

A region enclosed by the movement trajectory of the marker 100a is calculated by the host controller 130 as the movement range of the marker 100a (Step S150).

An area of the display device 120 is calculated by the host controller 130, based on the movement range of the marker 100a (Step S160). The area of the display device 120 is the area that displays the movement range of the marker 100a if the movement range of the marker 100a is displayed on the display device 120.

When an interaction is needed, at least one menu item indicating at least one option is presented in the calculated area of the display device 120 by the host controller 130 (Step S170). Here, it is preferred that the at least one menu item is presented at the bottom of the calculated area of the display device 120, so that it is easier for the patient to reach. Figs. 3A- 3B illustrate two examples of a first menu item 211 and a second menu item 215 presented at the bottom of the calculated area 220 of the display device 120. In addition, Figs. 3A-3B also illustrate the pointer 230 indicating the marker 100a in the display device 120.

The host controller 130 judges whether or not the pointer indicating the marker 100a in the display device 120 remains on one menu of the at least one menu for a predefined period (e.g., 3 seconds) (Step S180).

If the judgment at Step SI 80 is affirmative, one menu of the at least one menu is considered as being selected by the patient and an action corresponding to the one menu of the at least one menu is conducted by the host controller 130 (Step S190).

The stroke rehabilitation system and the process for presenting an option according to the invention should not be limited to the embodiments mentioned above. It will be apparent to those skilled in the art that various aspects of the invention claimed may be practiced in other examples that depart from these specific details.

Those skilled in the art will understand that in the above embodiments of the invention, the movement trajectory of the marker 100a is calculated by using the Steps SI 10- S140, but the invention is not limited thereto. In an alternative embodiment of the invention, the movement trajectory of the marker 100a may also be calculated by using the following Steps S110'- S140'. At Step SI 10', a guide for measuring the movement range of the marker 100a is displayed on the display device 120 by the host controller 130, to ask the patient to move the marker 100a that he wears on his hand so that the pointer indicating the marker 100a on the display device 120 tries to reach specified points on the display device 120, for example four points indicating four corners of the display device 120 or eight points indicating four corners of the display device 120 and four midpoints of four sides of the display device 120. At Step SI 20', images picked up by the infrared camera 110 during measurement of the movement range are transferred to the host controller 130 from the camera 110. At Step S130', an image processing step is performed on the transferred images by the host controller 130 to obtain a plurality of positions of the marker 100a. At Step S135', multiple positions of the marker 100a are retrieved by the host controller 130 from the obtained plurality of positions of the marker 100a, wherein compared to other positions of the obtained plurality of positions of the marker 100a, each of the multiple positions of the marker 100a has a smaller distance with respect to one of the specified points. At Step S140', the movement trajectory of the marker 100a is calculated by the host controller 130 by interconnecting the multiple positions of the marker 100a. Further, those skilled in the art will understand that in the above embodiments of the invention, the retro-reflective marker 100a worn on the hand of the patient is used as an object whose movement range is measured, but the invention is not limited thereto. In an alternative embodiment of the invention, the object whose movement range is measured may also be the marker 100b worn at the elbow of the patient, the marker 100c worn at the shoulder of the patient, a retro-reflective marker or non-reflective marker worn at any position of the upper limb of the patient, or in the palm of the hand of the patient.

Further, those skilled in the art will understand that in the above embodiments of the invention, the infrared camera 110 is used as an image pickup means, but the invention is not limited thereto. In an alternative embodiment of the invention, the image pickup means may also be a common optical camera.

Further, those skilled in the art will understand that in an alternative embodiment of the invention, the retro-reflective marker 100a used as the object whose movement range is measured may be replaced with a marker P equipped with a position detector such as a GPS or a combination of a magnetometer, gyroscope and accelerometer; the infrared camera 110 used as the image pickup means may be removed, and the Steps S120-S130 may be replaced with the following Step SI 25' to obtain position information of the marker P during measurement of the movement range of the marker P. At Step SI 25', positions of the marker P during measurement of the movement range of the marker P are received by the host controller 130 from the marker P.

In addition, those skilled in the art will understand that in the above embodiments of the invention, the option is indicated by the menu item on the display device 120, but the invention is not limited thereto. In an alternative embodiment of the invention, the option may also be indicated by a button on the display device 120.

Further, those skilled in the art will understand that in the above embodiments of the invention, the Steps SI 10-S160 are carried out to calculate the area of the display device 120 that displays the movement range of the object every time the system is powered on, but the invention is not limited thereto. In an alternative embodiment of the invention, the Steps SI 10-S160 may be carried out one time only when a predetermined period elapses, or the Steps SI 10-S160 may be carried out when the system 10 receives the instruction from the patient.

Further, those skilled in the art will understand that the process for presenting an option according to the invention may be applied not only to the stroke rehabilitation system but also to other systems.

Further, the operations executed by the host controller 130 in the process for presenting an option may be implemented by means of software, hardware or combination of software and hardware.

It should be noted that the above described embodiments are given for describing rather than limiting the invention, and it is to be understood that modifications and variations may be resorted to without departing from the spirit and scope of the invention, as those skilled in the art will readily understand. Such modifications and variations are considered to be within the scope of the invention and the appended claims. The protective scope of the invention is defined by the accompanying claims.