INTERACTIVE SYSTEMS AND METHODS AND POWERLESS REMOTE CONTROL

FIELD OF THE INVENTION

The present invention relates to an interactive systems and methods in general and in particular to interacting with a television or a computer via a remote control without a power source.

BACKGROUND OF THE INVENTION

In the Internet-Protocol television (IPTV) environment, the audience sitting in front of the television is offered many opportunities to interact with the content displayed on the television set and potentially with other users and information sources. In a personal computer (PC) environment, the interaction between the user and the PC is typically performed using a keyboard and a mouse. In the context of watching television in the living room, it is not convenient to use a keyboard or a mouse since the user is typically sitting on a sofa with all the family, and not alone on a desk as with a PC.

The modern and future living room is envisioned to be filled with smart, highly interactive devices such interactive television, game consoles, media centers, virtual reality environments etc. In order to take advantage of these interactive devices, it would be highly desirable to enable the user to be highly interactive in a way that is adapted for a living room environment.

Some sophisticated and expensive solutions exist in the market. For example, Gyration, Inc. from 12950 Saratoga Avenue, Saratoga, CA 95070, USA developed a remote control (SKU:GYR3101US) that senses the movement of the user with motion sensors that are installed inside a remote control. Logitech of 6505 Kaiser Dr., Fremont, CA 94555 USA, developed a computer mouse (PN 931633-0403) that includes different sensors, such as motion sensors, to calculate the position and location of the mouse. Other specialized tracking systems such as for handicapped people, can track head movements from a short distance (up to one meter). These tracking systems may be used to control the computer cursor.

Speech recognition is another available technology that enables a user to interact with an application. Speech recognition is not suited for a living room environment where the television program and additional people in the living room will generate sound that will interfere with the voice recognition commands. In addition, a user watching a television program will usually not want to speak out loud while he and others are listening to the program.

Remote controls available today at the market require a power source and are usually battery operated. When the batteries run out the remote control is not functional, and if the user does not have new batteries handy he will not be able to operate the remote control.

It would thus be desirable to offer consumers a remote control that is not operated by batteries and is thus more environmentally friendly and its operation being more reliable.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a remote control without a power source.

It is another object of the present invention to provide a remote control that can point to desired sections on a display screen.

It is yet another object of the present invention to provide a remote control that can select an item from a menu of items on a display screen.

It is yet another object of the present invention to provide a remote control that can identify the user of the remote control.

It is yet another object of the present invention to provide a remote control that can operate at a large distance (such as 3 to 10 meters) and with wide field of view (such as -40130 degrees)

It is yet another object of the present invention to provide a remote control that can operate in difficult lighting conditions, including at night when people are watching television and the pushbuttons on a regular remote control are hardly visible.

It is another object of the present invention to provide a remote control that can replace the actual remote control of the media center.

In one aspect, the present invention thus relates to an interactive system accepting user input via a remote control in relation to content watched on a display screen, said interactive system comprising:

(i) a remote control adapted to be manipulated by a user;

(ii) one or more retro-reflective surfaces coupled to said remote control;

(iii) one or more light sources directed in the direction of said remote control;

(iv) one or more light detectors for detecting reflections of light emitted from said one or more light sources and reflected from said one or more retro-reflected surfaces; and

(v) a processor unit for analyzing the image signal received on said one or more light detectors and deciding on the appropriate action of the interactive system.

Preferably, the one or more light sources emit infrared (IR) radiation. Infrared radiation is electromagnetic radiation of a wavelength longer than that of visible light, but shorter than that of radio waves. Infrared radiation has wavelengths between about 700 nanometer (nm) and about 30 μm (micron). Wavelengths used for photography (in the Near IR) usually range from about 700 nm to about 1 100 nm. In another aspect, the present invention relates to an interactive system accepting user input via a remote control related to content watched on a display screen, said interactive system comprising:

(i) a remote control or/and mouse adapted to be manipulated by a user;

(ii) one or more retro-reflective surfaces coupled to said remote control; (iii) one or more light sources directed in the direction of said remote control;

(iv) an overlay unit for displaying and/or overlaying a control image on said display screen;

(v) one or more light detectors for detecting reflections of light emitted by said one or more light sources and reflected from said one or more retro-reflected surfaces; and

(vi) a processing unit for analyzing the image signal received on said one or more light detectors and decide on the appropriate action of the interactive system.

The one or more light sources are closely located to the one or more light detectors (camera) and the display screen. The one or more light sources and the one or more light detectors (such as a camera) are closely located and oriented towards an audience in front of the display screen. The display screen can be a television set, an IPTV, a computer screen, a game console or any similar device. The interactive system is able to track a reflective surface in front of the display screen. The reflections of the target (remote control) are detected by one or more light detectors and displayed as a dot (or any cursor sign) on the display screen. When the remote control moves then the dot moves on the display screen. The remote control does not require a power source such as electricity or batteries since the invention is based on the light reflections from the remote control that are translated back to a virtual cursor on the display screen. The overlay unit's purpose is to display and/or overlay a control image on top of the image (content) displayed on the display screen. The displayed and/or overlaid image can be of any form such as a menu, keyboard, mouse cursor, joystick cursor, computer avatar, graphical representation of volume control, graphical representation of image control or any graphical form or image. Once the user moves the remote control in a way that the control image is positioned in proximity or on a desired item on the display screen, the interactive system also enables the user to signal the selection of that item, similarly to the effect of a mouse click or double click in a personal computer context. The selection can be implemented in different ways, for example, leaving the cursor on the selected item for a predetermined amount of time, drawing with the control image an "X" form on the item, drawing with the control image a circle around the contour of the item, performing any predetermined movement pattern on the item, pressing a button on the remote control activating a mechanical shutter hiding the reflecting surface for a predetermined amount of time etc. Alternatively, a list or menu system

can be drawn on the display screen (attached, for example, to a cursor if one is used) thus allowing the user to choose an available option via the remote control.

In addition, the user can use different, predetermined gestures with the remote control in order to control different functionalities of a television or any other interactive device. For example, moving the remote control up or down may change the channel, moving the remote control to the right or to the left can augment or lower the volume. This functionality control can be achieved without adding any control image to the display, for example, by using specialized software that is connected to the position pointed by the remote control and activates one or more additional IR light sources (which is used as an IR transmitter) in order to emit a corresponding signal that will operate the volume or channel or any other functionality control of the TV as if emitted by a standard remote control.

In yet another aspect, the present invention relates to a remote control that can be operated without a power source, unlike current remote control that require batteries in order to work with a television set.

BRIEF DESCRIPTION OF THE DRAWINGS

Figs. 1A-1B show embodiments of control images displayed or overlayed on a display screen that a user can click on for performing an action such as typing text or emulating computer mouse functionalities. Fig. 2 is a block diagram of an embodiment of an interactive system according to the invention.

Fig. 3 is a block diagram of an embodiment of an interactive system showing the integration of the overlay image with a television display screen.

Fig. 4 is a block diagram of an embodiment of an interactive system further comprising an IR transmitter for emulating a television remote control.

Fig. 5 is an embodiment showing a television set showing an example of an overlaid menu on the display screen.

Figs. 6A-6F illustrate an embodiment of a menu selection process according to the invention.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description of various embodiments, reference is made to the accompanying drawings that form a part thereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.

The present invention relates to an interactive system enabling a user to interact with a display screen using a fitted remote control. The display screen can be a television, a computer, a game console or any similar device using a screen. The remote control, used to interact with the content displayed on the display screen, can be any object fitted with one or more retro-reflective surfaces. The surface can also be a reflective surface and the term retro-reflective surface shoud be interpreted as also including reflective surfaces. One or more light sources are directed in the direction of the remote control. One or more light detectors are positioned to detect the reflections of the light emitted by the light source or sources and reflected from the retro-reflective surface or surfaces of the remote control. A processor unit analyzes the image received on the light detector (or detectors) in order to deduct how the user has moved or used the remote control, and what is the appropriate action to take. The type of appropriate action depends on the interaction possibilities offered by the display screen. If the display screen is a television set, then the remote control of the invention can control typical television functionalities such as changing channels, setting the volume, setting the brightness etc. If the display screen is an Internet Protocol television (IPTV) or a similar interactive television, then the remote control of the invention can control additional functionalities such as selection from a menu, entering text (sending a message, performing a search etc.), selecting a specific region in the screen etc. If the display screen is a computer then the remote control of the invention can be used as a regular computer mouse for moving a cursor on the screen and emulation of regular mouse functionalities such as right click, left click and double click. If the display screen is a slide

projector screen (typically a dedicated wall or a cloth type screen) coupled to a computer then the remote control of the invention can be directed to any area of the cloth screen or dedicated wall that is covered by the light detector, such that the location pointed by the remote control is captured by the light detector, transmitted to the computer, and then any control image can displayed back on the display screen by the slide projector. If the display screen is a game console, then the remote control of the invention can be used to interact with a game offering, for example, the functionality of a joy stick for moving objects on the screen and emulating pressing a button in order to interact with the game. For example, moving the remote control up and down can make a character on the screen shoot his weapon.

Reference is now made to Fig. 2 showing an implementation of the interactive system of the invention accepting user input via a remote control operated without a power source, said remote control being adapted to send instructions to a display screen in order to manipulate the display screen's settings and/or the content displayed on the display screen 60. The light source 10 illuminates a field of illumination 12 in front of the display screen 60. The emitted light 13 is preferably invisible, so it will not disturb the user in front of the display screen 60 with the illumination. The powerless remote control 20 contains a retro- reflective pad 14 (surface) that reflects back the light on it to the light detector 30. The light detector 30 is preferably located near or in the same line of sight as the light source 10, so that the light detector's 30 field of view 16 overlaps as much as possible with light source's 10 field of illumination 12. The reflectance back to the light detector 30 located near (or in the same line-of-sight of the light source 10) is almost not affected by the orientation of the pad 14, thus it is almost insensitive to the way the user holds the remote control 20, as long as the pad 14 in the remote control 20 is visible by the light detector 30. The light detector 30 receives the light 18 reflected back from the remote control 20 and it transmits the location of the remote control 20 to the processing unit 50 through an ATD (Analog to Digital) component 40. The ATD 40 may be a frame grabber if the light detector 30 is a

digital or analog video camera (like CCD or CMOS for example) or a Fire Wire component if the light detector 30 is a Fire Wire camera or a conventional ATD 40 if the light detector 30 is a PSD (position sensitive detector) or a USB device or any other device that "translates" the signal from the light detector 30 to a signal that the processing unit 50 may receive and "understand". The power supply module 55 in addition may include further electronic circuits that can enable the synchronization of the operation of the light source 10 with the light detector 30. It also may include additional electronic circuits for the pulse operation of the light source 10 and the pulse / shutter operation of the light detector 30 in full accordance with the light source 10. The light source 10 may further include optical components in order to design the illumination field-of-view 12. In a similar manner, the light detector 30 may further include optical components to allow the light detector 30 to have a field of view 16 which is in correspondence with the light source 10 field of illumination 12. In order to do achieve such correspondence, the interactive system may further include pulse generator sub-modules and electronic drivers for the light detector 30 and light source 10.

The processing unit 50 responsible for processing of the signal position may implemented via a computer's processing resources or by a Digital Signal Processor (DSP). A dedicated processor (not shown in Fig. 2) may be used before the signal enters the processing unit 50.

The digital signal that is received by the processing unit 50 tracks the changes in the position of the remote control 20 and according to the position changes the processing unit 50 can manipulate the content displayed on the display screen 60 or the display's screen 60 settings. For example, when the remote control 20 operates like a computer mouse, moving the remote control 20 moves the mouse cursor on the display screen 60. The actual form of the mouse cursor can be any image according to the application running, for example, in a gaming environment the mouse cursor can take the shape of a game persona or avatar.

When the mouse cursor stays for a "long" predefined amount of time on a software button on the display screen 60, then it may be interpreted in a similar way

as activating the button (left or right) on a computer mouse. In another embodiment the activation of the button may be done by pressing a mechanical spring in the remote control 20 that hides for a moment the pad 14. This method may be interpreted by the processing unit 50 as a double click of the mouse. Yet another selection mean is to draw with the remote control 20 a predetermined pattern on the software button such as an "X", drawing the button's contour with the remote control 20 cursor etc.

The term "image" as referred to herein should be interpreted in a large sense and also to include a signal received from a single light detector 30 or from an array of light detectors 30.

The first component of the system is one or more light sources 10 directed in the direction of the remote control 20 to be detected. The light source 10 can be in the visible spectrum, infrared (IR) spectrum or even ultraviolet (UV) spectrum.

The reflected light from the retro-reflective pad 14 couple to the remote control 20 is captured by one or more light detectors 30. The light detector 30 can be also a matrix of sensors such as a Charge Coupled Device (CCD) or

Complementary Metal Oxide Semiconductor (CMOS). Instead of a camera as a light detector 30 it also possible to use a Position Sensitive Detector (PSD). The light detection technology can include silicon, Gallium Arsenide or any other known technology. Alternatively, the light detector 30 can be a line sensor or a single pixel sensor of any type known in the art, for example, a photodiode or similar sensor.

The light detector 30 is sensitive to the wavelength of the light source 10.

An optional spectral filter may be installed in front of the light detector 30 in order to enhance the captured signal quality and filter unnecessary background light not related to the reflected light from the retro-reflective pad 14 couple to the remote control 20.

The light detector 30 can use any optical lens (single or compound) known in the art in order to arrange the desired FOV (field of view) which optimize the light detection process by enabling correspondence with the light source 10 field of

illumination 12. The invention exploits the retro-reflective character of the retro- reflective pad 14 (sticker) that reflects the light back to the source.

In another embodiment of the present invention the light source 10 and accordingly the light detector 30 include a polarizer filter, that polarizes the light and the eliminating background light that is not of the same polarization characteristic.

In yet another embodiment of the present invention the light source 10 is operated in a pulse regime, which is in correspondence with the exposure time of the light detector 30, both synchronized to coincide at the same time. This pulse regime method may allow discriminating the signal light from the background light since the background is present with no synchronization to the light source 10 and light detector 30. It also allows to increase the intensity of the light source 10 for short period of time (periodically as the exposure time) to be higher than the background intensity, and then to overcome signal to background in a quite well illuminated room, and thus be a provision to allow simpler algorithms for the detection process and possibility of use simple DSP or similar stand alone processors.

In a further embodiment of the present invention, fluorescent retro-reflective pads 14 (stickers) are used in order to further increase the signal to background ratio. In this case the pad 14 is illuminated with a light source 10 with some special bandwidth range that stimulates the pad 14 to reflect/emit light in a corresponding different bandwidth and the pad 14 reflects/emits light in the corresponding different wavelength bandwidth, so the light detector 30 is provided with a filter that match the emitted wavelength bandwidth of the pad 14 and thus reduced the influence of the background that its reflection from the light source itself cannot be detected since it is in a different range of wavelengths.

By moving and pointing the pad 14 towards the desired next position on the display screen 60 in front of the light detector 30, the control image (cursor) position on the display screen 60 corresponds and moves to its new position on the display screen 60.

Mouse clicks and typing

The term "control image" as used herein comprises two types of images displayed on the display screen 60: a cursor that may be permanently displayed; and a pop-up menu that may be momentarily displayed according to the context of the application.

If the control image (cursor) stays on a certain position on the display screen 60 for a predefined time interval, a user friendly toolbar pops-up on the screen enabling common mouse functions, for example, click, double click, right click and drag. In addition or alternatively, the Microsoft accessibility keyboard application (OSK) can be launched in order to enable typing. When the popup toolbar appears, the user can choose the wanted function by standing on it for a predefined time interval (see Fig. IB discussed in more detail below). If the user chooses not to use any of those functions the toolbar will disappear by itself.

Fig. IB illustrates an embodiment of a pop-up control image menu that can be displayed or overlaid on the display screen 60 so that the user can select them using the remote control 20 of the invention. The example show includes common functionalities such as click (left button), double click, right click, display keyboard, drag region, and Quit. Natuarally, many more and different options can be displayed according to the context of the application. In one embodiment of the present invention, if the user moves the cursor to a certain position and stays still for a predetermined amount of time (for example, 2 or 5 seconds) then a pop-up menu with application-sensitive choices is displayed near the cursor so that the user can select of the options.

In addition, the left click, for being common, is also triggered automatically by a long cursor remaining on a certain position. This long stay click occurs only once per position staying.

In common mouse usage the drag procedure consists of three sequential phases, mouse button press - mouse movement - mouse button release. The invention simulates this procedure by the bi state drag option. First the user has to choose the "Start drag" option when pointing on the initial drag location. Following

the last, the user now has to point on his desired final drag location and choose the "End drag" option. This result in a drag and drop action executed only after the "End drag" was chosen. To cancel the drag and drop function in the middle of it, the user needs to choose another desired function from the toolbar. Algorithms

The interactive system of the invention can analyze each captured image to match special geometric shapes, if designed. For example, if a personalized retro- reflective pads 14 form is assigned to the remote control 20 of every member of the family, then once the interactive system detects a specific geometric shape it can recognize to which person it belongs to.

The interactive system of the invention tracks the position of the retro- reflective pad 14, in order to detect its movement and not in order to "know" its absolute position. For example, if the interactive system stops detecting the retro- reflective pad 14 (for example, when the remote control 20 is moved in a direction that the light detector 30 cannot detect it) then the next time the retro-reflective pad 14 is detected it may be in a different location and it is not important because only its relative movement is what matters. Actually, the loop is closed by the person, when he is looking and following the "mouse cursor" on the display screen 60 then in order to move it the desired location the person moves the "sticker mouse" so the interactive system detects the relative movement.

The interactive system can detect the retro-reflective pad 14 from a distance of about 40 cm up to several meters.

The above-mentioned detection of the signal reflected back from the retro- reflective pad 14 is done with the help of detection algorithms like "image processing" when the light detector 30 is a CCD, for example, or signal processing in other cases. The advantage of this invention is that it allows using simple detection algorithms (like thresholding, for example) since the provisions the invention provides are as intrinsic enhancement of the signal over the background. This enhancement may be done as explained before by each of the explained methods or even a combination of them. It is not the purpose of this invention to

provide sophisticated algorithms but to allow simple ones, as known in the art, to be used conveniently.

In yet another embodiment of the present invention, the interactive system further comprises overlay electronics means for integrating the video image coming from the television broadcaster with the overlaid menu generated by the interactive system of the invention thus allowing the possibility of controlling the TV/IPTV without a standard remote control or an operating system on a media center.

As illustrated by Fig. 3, the present invention also relates to an interactive system as shown in Fig. 2 further comprising a video overlay generator 80 for displaying and/or overlaying a control image over the video image in the display screen 60. The signal received by the light detector 30 is sampled by the ATD 40 and transferred to the detection processor 70 that detects the movements of the remote control 20 and translates them into scaled relative movements on the display screen 60 coordinates. The detection processor 70 then generates an overlay sign, which represents the position of the control image (for example, mouse cursor) on the display screen 60 and with the help of the video overlay generator 80 overlays the signal on the display screen 60. The detection processor 70 may be an independent or dedicated processor. Alternatively, the detection processor 70 may be the computer processor (when the display screen 60 is a computer) and then there is no need for video overlay generator 80 and video integrator 90. The user can then see this position on the display screen 60, together with the video image coming from the TV line (or computer) 50 and both the video signal and the overlay are seen together on the display screen 60, after integrating both images into a single image with the video integrator 90. Fig. 5 shows an example of the overlay display over the video image. The sign menu can be in a corner or may be hidden and appear when the "mouse cursor" stays on the corner. In one embodiment, the selection process is done similar to working with a mouse in a graphical window environment on a PC. Once the "mouse cursor" stays on a menu sign for a predetermined amount of time, then a

submenu appears. The user can then move the "mouse cursor" to the desired command or select another submenu if available.

Fig. IA illustrates a virtual keyboard that can be displayed or overlaid as an image on the display screen. The specific keyboard shown is a Windows™ type keyboard with 1 pointing to the "start" key and 2 pointing to the "u" key. The user can thus point the retro-reflective pad 14 (sticker) towards the display screen 60 and by moving the mouse cursor shown on the screen select letters on the virtual keyboard in order to write an SMS or e-mails or for any other application.

In another embodiment of the present invention, the interactive system further contains an IR transmitter, allowing for a stand-alone TV remote control that is not dependent on an operating system in the IPTV, and is thus able to be connected to any existing TV in the market.

In a display screen 60 adapted for receiving remote control commands via IR, the interactive system of the invention can operate the display screen's 60 functionalities (changing channels, adjusting volume, image etc.) in one of two ways: (a) the interactive system can operate directly the display screen's 60 functions by integrating directly with these functions; or (b) the interactive system can remain exterior to the display screen's 60 functions and simulate the equivalent IR command of the action generated by the remote control 20 of the invention. The IR simulation can be achieved either by an IR transmitter or by an IR simulator.

In Fig. 4, likewise in the previous Figs. 2, 3 another embodiment is presented for a stand-alone powerless remote control 20 for a television. The signal is detected in the same way as described in the Figs. 2, 3. Once the signal is detected by the detection algorithm in the detection processor 70, the detection processor 70 delivers commands to both the video overlay generator 80 and to the IR transmitter unit 75. The video overlay is inserted into a video integrator 90 that integrates the overlay signal coming from the video overlay generator 80 together with the video line 100 and sends the unified image to the TV monitor display screen 60. From the other hand, the IR transmitter 75 receives from the detection processor 70, the commands (selections) entered by the user, for example, change a channel, or

change the volume or any other command that is normally used with a remote control.

When the user points with the powerless remote control 20 to the TV display screen 60, the light detector 30 detects that the remote control 20 is present and then the video overlay generator 80 generates a mouse-like sign or cursor. When the user moves the remote control 20 accordingly to a region in the TV display screen 60 marked as "menu", then the detection processor 70 detects that the "mouse cursor" is standing on a menu area for more than half a second (or any other predefined amount of time) and opens another overlay display with different commands options. When the user moves the "mouse" remote control 20 to the new command he wants to execute, again a new overlay arrow appear so the user can move up or down by placing the "mouse" remote control 20 on the desired arrow or item.

The interactive system of the invention is designed to give the IPTV user a way of interaction with the display screen 60 i.e. the TV/computer (the IPTV is no longer a simple TV but a combination of TV and internet computer), in such a way that there is no need to use the standard computer keyboard or mouse which would not fit in a living room environment where the user may lay on a couch. Instead this invention allows the creation of a virtual keyboard overlaid over the TV screen. The remote control 20 of the invention acts as a wireless mouse with no power source. The remote control's 20 mouse-like functions allow the user to easily interact with the IPTV. For example, the user may activate a virtual keyboard (shown in Fig. IA) displayed (or overlaid) over the current screen and by pointing a letter in the virtual keyboard and selecting it, the user can write any text. The entered text can be used by any available IPTV application, for example, instant messaging application, search applications, email, web browsing, TV guide applications, Internet applications and content etc. The term "IPTV" as used herein should be interpreted to encompass all existing and future interactive television media, including but not limited to Internet Protocol television, Interactive television, WEBTV, Enhanced TV (ETV) and any other interactive television platform.

Another application of the remote control 20 of the invention can be to act as a regular television remote control, be it for an IPTV set or a regular television set.

For example, in order to change channels the interactive system can display (or overlay) a graphical representation of a channel selector to be activated by the remote control 20. Numerous such implementations can be envisioned, for example:

• Displaying a channel knob wherein moving the cursor clockwise fetches the next channel up while turning the cursor counterclockwise fetches the previous channel down.

• Displaying an up arrow and a down arrow such that holding the cursor on the up arrow fetches the next channel up while holding the cursor on the down arrow fetches the previous channel down.

• Using a virtual keyboard and selecting the number keys assigning the channel number.

Similar display methods can be used for any other remote control function such as volume control, image fine-tuning etc.

In another embodiment of the present invention, a retro-reflective pad 14 (sticker) is located on any object such as a bar (or on a finger or piece of wood, metal, plastic or on the standard TV remote control) thus acquiring the object the functionality of a remote control 20 of the invention. Any movement of the object, for example, will be translated to a movement of the control image (cursor or similar displayed image) on the display screen 60, thus the remote control 20 mimics the functionality of a computer mouse.

In yet another embodiment of the present invention, the reflective pad (sticker) 14 is connected to a person's hand, for example, on his watch (or on his personal mobile/cellular phone - as another example) so that the reflective pad 14 is in front of the display screen 60. In this case the processing unit tracks the reflective pad (sticker) 14 as a control image (for example a dot or any other image) on the display screen 60.

Still in another embodiment of the present invention, the light source(s) 10 and light detector(s) 30 are incorporated inside the television set itself. The

integration into the television of the light source(s) 10 and/or light detector(s) 30 can be in the television's screen, in the television's frame or both.

Fig. 6A shows the display screen 60 right after the interactive system detects the remote control 20, then once the retro-reflective pad 14 or sticker is detected the "mouse cursor" (appearing in the Figs. 6A-6F as a hand) appears in the center of the display screen 60. Then the next step in Fig. 6B is for the user to move the "mouse cursor" to the lower left corner of the display screen 60. When the cursor stays on the lower left corner of the display screen 60 then the sign of the word "menu" appears as shown in Fig. 6C. If the "mouse cursor" keeps staying on the menu area, then a new submenu appears next to it as shown in Fig. 6D. The user then moves the "mouse cursor" to the selected choice ("channel") and as long as the mouse cursor stays there for a predefine time then another new menu appears Fig. 6E, and again as long as additional new menus appear. The last menu in this example is selecting a specific channel, channel number 11 in Fig. 6F. In this last menu if the "mouse cursor" stays enough time on the number of the channel then the internal system changes the channel or in another configuration, a signal is generated by a remote control simulator and sends a command to change to channel 1 1. Adding a table of contents attached to the cursor allows the user to choose further options.

In addition, the user can by different gestures operate (set) many functions of the TV. For example, moving the remote control 20 up and down may change the channel by increasing or decreasing the channel number shown; moving the remote control 20 to the right or left can augment or lower the volume without adding any video layers but by special software that is connected to the mouse position. The software activates the IR transmitter 75 in order to emit a corresponding signal that will operate the volume or channel or any other function of the TV as if it was done by using a standard remote control. The IR commands may be any IR signal, signal and/or pulses that activate television functions. Alternatively, the IR command may directly manipulate an internal television or set-top box circuits that control television set functionalities. This mode of operation with gestures doesn't require using video overlay.

The remote control 20 of the invention can be easily adapted to provide input to a gaming console. For example, different functions of a game appliation can be controlled by using the orientation of the remote control 20 in such a way that orientation is interpreted as a special control. For example, if remote control 20 represents a driving wheel in a car race game, then the inclination of the wheel forward may be understood as acceleration and inclination backwards as deceleration. In order to understand when an inclination of the remote control 20 occurs, some retro-reflective pads 14 are placed around the driving wheel. When an inclination occurs, then the distance between two vertical pads is detected as a shorter distance and if the distance between two horizontal pads 14 is not changed then it is understood an inclination has occurred. If on the contrary, also the horizontal distance is shorter, then it is understood the driving wheel as a whole is physically closer to the console but no inclination has occurred. In a similar way, the control may be deducted using the distance between the remote control 20 and the gaming console. For example, each pad 14 may be composed of a dual or multiple pads 14 with a specific known distance between the components such that by measuring the distance between the pads 14 and comparing them to the known values of these distances, the actual distance from the remote control 20 to the gaming console can be calculated. Other possibility of detecting the distance between the remote control 20 and the gaming console is by using two couples of a light source 10 and a light detector 30 separated by a minimal distance, such that according to the difference in the two signals detected by the two light detectors 30 the actual distance between the remote control 20 and the gaming console can be calculated. Although the invention has been described in detail, nevertheless changes and modifications, which do not depart from the teachings of the present invention, will be evident to those skilled in the art. Such changes and modifications are deemed to come within the purview of the present invention and the appended claims.