Title: "Method for remotely controlling a mobile terminal"

DESCRIPTION

The present invention relates to a method for controlling remotely a mobile terminal .

According to the state of the art, methods are known for controlling remotely mobile terminals whereby a remote server sends one or more commands to a mobile terminal. The command is sent from the remote server to the mobile terminal via an OTA channel, for example by means of one or more SMS messages. The mobile terminal or the SIM card of the mobile terminal is provided with an application which is able to intercept the message received and execute the command. This remote control method is used for example in connection with customer assistance where an operator at a call centre sends commands to the mobile terminal of a user who has requested assistance in order to solve a particular problem with his/her mobile terminal.

The control method described above, although it allows the mobile terminal to execute a series of commands sent remotely, does not allow the operator at the call centre to converse with the user of the mobile terminal at the same time as the sending of the command. A telecommunications system of the GSM OR GPRS type, in fact, does not allow the operator to establish with the user simultaneously a data connection and a voice connection. This prevents, for example, the operator at the call centre from being able to guide and

instruct the user when navigating through the various menus on the mobile terminal, thereby providing a kind of long-distance training service. This drawback is also present in telecommunications systems other than the GSM system, for example GPRS and UMTS systems, should 5 the mobile terminal no longer be situated within the coverage of the GPRS or UMTS network and be registered in a network where there is only GSM coverage.

From the above, it comes out that there is a need to be able to control remotely a mobile terminal via remote control means so as to

-0 establish a simultaneous data and voice connection between the remote control means and the mobile terminal.

In view of the state of the art described, the object of the present invention is to provide a method for controlling remotely a mobile terminal via remote control means able to overcome the drawbacks

L5 present in the known art.

In accordance with the present invention, this object is achieved by a method for controlling remotely a mobile terminal via remote control means in accordance with Claim 1. By means of the present invention it is possible to obtain a method

20 for controlling remotely a mobile terminal via remote control means, which allows the operator present remotely at a remote server to send commands to the remote terminal and at the same time give voice instructions to the user of the mobile terminal so as to provide a kind of long-distance training or tutoring service.

25 Further characteristic features and advantages of the method

according to the present invention will emerge from the description below of a preferred example of embodiment, provided by way of a non-limiting example, with reference to the accompanying figures, in which: - Figures 1 and 2 show basic diagrams illustrating the method for controlling remotely a mobile terminal via remote control means in accordance with the present invention.

With reference to the accompanying figures, a method for controlling remotely a mobile terminal 30 by means of remote control means 20 is described.

The mobile terminal 30 is registered in a telecommunications system, denoted overall by 10.

Advantageously, the control method according to the present invention can be used for the remote control of a mobile terminal 30 registered in a telecommunications system 10 where a single communications channel is present between the mobile terminal 30 and the remote control means 20, for example in a GSM telecommunications system. In—accordance with the embodiment shown in the accompanying figures and as described below, the mobile terminal 30 is controlled remotely by means of a remote server 20. Alternatively, the remote control means may comprise several remote servers or electronic processors or computers which are connected together in order to execute one or more of the steps of the method according to the present invention.

The control method according to the present invention comprises the following steps :

- providing a command COM to be sent from the remote server 20 to the mobile terminal 30, - providing a voice signal V to be transmitted from the remote server 20 to the mobile terminal 30, encoding the voice signal V in a voice data packet flow VOICE_FLOW, for example a Voice Over IP flow commonly called VOIP, and encoding the command COM in one or more command data packets COM _k , where k indicates the number of command data packets COM _k with which the command COM is encoded,

- generating a packet data flow DATA_FLOW comprising the voice data packet flow VOICE_FLOW and the command data packets COM _k , and

- sending the packet data flow DATA_FLOW from the remote server 20 to the mobile terminal 30.

Since the packet data flow DATA_FL0W comprises both the command data packets COM _k and the voice data packets of the packet flow VOICE_FLOW, it is possible to convey from the remote server 20 to the mobile terminal 30 both the command data and the voice data. In this way, should it be required to provide assistance to the client using the mobile terminal 30, it is possible to send not only commands to be executed on the mobile terminal 30 but also establish voice communication between the user and an operator communicating from the remote server 20, for example an operator at a customer service centre or call centre.

Essentially, with the control method according to the present invention it is possible to have access simultaneously to a voice channel for sending instructions/voice commands and a data channel for sending commands to the mobile terminal 30 when there is only one communications channel between the mobile terminal 30 and the remote server 20, i.e. in all those cases where two physically separate channels are not present.

It should be pointed out that the term "voice signal V" comprises any type of voice signal, whether it be an analog signal or a signal already converted into a digital signal. For example, the voice signal V may be generated by a user by means of a normal microphone or may be generated and then stored in digital format so that it can be subsequently retrieved when required. The step of generating the packet data flow DATA_FLOW comprises the step of multiplexing the voice data packet flow VOICE_FLOW with the command data packets COM _k .

In accordance with a preferred embodiment, the multiplexing step comprises the step of inserting the command data packets COMk in a position adjacent to the voice data packets which form the voice data packet flow VOICE_FLOW.

Each packet comprises one or more headers H intended to identify the contents of the payload P. The voice data is contained in the payload P, in the example a payload of the RTP type, while the data relating to the content of the payload P, for example the type of source, the size, the VoIP encoding type, are contained in the

header H, in the example the header H of the RTP type. The packet may also comprise headers of the UDP and IP type for transmission with the UDP protocol within a network using an IP protocol .

5 In accordance with a preferred embodiment, the packet starts with a fixed header H comprising:

- a payload type identifier: in the example a specific payload for the commands is identified;

- a command identifier: in the example this consists of sixteen bits .0 and has a progressively increasing value so as to maintain the sequence of commands sent in the case of several commands; in this way it is possible to maintain the correct sequence in the case of several commands sent to the mobile terminal 20. Typically, the mobile terminal 30 comprises a plurality of control

L5 devices KEY(n) , C-\LL_ON, CALL_OFF. Advantageously, the command COM represents activation of one of the control devices. In particular, the mobile terminal 30 typically comprises a user interface 31 with a plurality of control devices KEY(n) , CALL_ON,CALL_OFF and a graphics interface 32. Each control

20 device KEY(n) , CALL_ON, CALL_OFF is associated with a command COM representing activation of the respective control device. The remote server 20 also comprises a graphics interface 21.

The control devices typically comprise the numerical keys KEY _n , with n=0..9, the call send/call reply key CALL_ON and the call 5 reject/call end key CALL_OFF. Some mobile terminals are also

equipped with a joystick device.

In this case, the step of providing a command COM comprises the following steps:

- displaying on the graphics interface 21 of the remote server 20 5 the user interface 31 of the mobile terminal 30,

- activating, on the graphics interface 21 of the remote server, one of the control devices KEY(n) , CαLL_ON, CALL_OFF of the user interface 31 so as to generate the command COM associated with activation of the activated control device KEYIn) ₇ CALL-ON ₇ CALL-OFF.

.0 The command COM associated with each numerical key KEY _n will therefore be the event associated with pressing of the numerical key, and likewise the command COM associated with the call send/call reply key CALL__ON and the call reject/call end key CALLJDFF will be the event associated with pressing of the associated key.

L5 In the case of a mobile terminal equipped with a joystick, it is possible to envisage displaying on the graphics display 21 of the remote server 20 a plurality of movements associated with the joystick, for example up, down, right, left, pressing the joystick and the four diagonal movements.

20 As a result it is possible to generate one or more commands which allow complete navigation of the menu on the mobile terminal 30 so as to perform any operation.

The mobile terminal 30 receives from the remote server the packet data flow DATA_FLOW and retrieves the command COM from the packet 5 data flow DATA FLOW. The retrieved command COM is executed in the

mobile terminal 30.

In particular, the step of retrieving the command COM comprises the step of decoding the packet data flow DATA_FLOW received in order to extract the command COM. In the case in question, in sequence the mobile terminal 30 extracts from the packet data flow DATA_FLOW the part relating to the commands, namely the command data packets COM _k or the corresponding codes and then performs decoding of the voice data packet flow VOICE_FLOW. If there is more than one command, the mobile terminal 30 isolates the various commands COM _k and, owing to the command counter contained in the packet, generates in sequence the events associated with the specific command COM in the same order in which they were generated. Execution of the command COM causes variations of the image F _n displayed on the graphics interface 32 of the mobile terminal 30. In order to allow verification of execution of the command COM on the mobile terminal 30, the method comprises the step of displaying on the graphics interface 21 of the remote server 20 the image F _n displayed on the graphics interface 32 of the mobile terminal 30 following the execution of the command COM in the mobile terminal 30.

Advantageously, prior to the step involving display on the graphics interface 21 of the remove server 20, the method envisages the steps of: - sending, from the mobile terminal 30 to the remote server 20, data

representing the image F _n displayed on the graphics interface 32 of the mobile terminal 30, and

- receiving in the remote server 20 the data representing the image F _n displayed in the graphics interface 32 of the mobile terminal 30.

5 After execution of the command COM, the image F _n may change into an image F _n+1 different from the image F _n . In this case the image F _n+ i will be sent .

Advantageously, it is possible to avoid sending the data representing each image F _n , but it is sufficient to execute a logic .0 operation for the difference between two successive images, for example F _n and F _n+ i, and send only data representing the changed image portion or the difference F _n+I -F _n .

Essentially, the method may envisage, prior to the display step, the following steps: L5 - sending, from the mobile terminal 30 to the remote server 20, data representing variations F _n+I -F _n of the image displayed on the graphics interface 32 of the mobile terminal 30,

- receiving in the remote server 20 this data representing the variations F _n+I -F _n of the image displayed on the graphics interface 32

20 of the mobile terminal 30,

- processing the data representing the variations F _n+ I-F _n of the image displayed on the graphics interface 32 of the mobile terminal 30 with data representing the image F _n displayed on the graphics interface 32 of the mobile terminal 30 prior to execution of the 5 command COM for displaying on the graphics interface 21 of the

remote server 20 the image F _n+ i displayed on the graphics interface 32 of the mobile terminal 30 following execution of the command COM in the mobile terminal 30.

In particular, the data representing the image F _n displayed on the 5 graphics interface 32 of the mobile terminal 30 prior to execution of the command COM is obtained by means of the following steps:

- sending, from the mobile terminal 30, to the remote server 20, data representing the image F _n displayed on the graphics interface 3 of the mobile terminal 30, prior to execution of the command COM,

.0 and

- receiving in the remote server 20 this data representing the image F _n displayed on the graphics interface 32 of the mobile terminal 30, prior to execution of the command COM.

Below an example of application of the method for controlling L5 remotely a mobile terminal according to the invention is described. In particular, the example described below refers to the case where the method is used with the function of providing tutoring or assistance to a user possessing the mobile terminal 30. In the example shown in Figure 1, the user with the mobile terminal 0 30 contacts, by means of a voice call, an operator at the call centre (REP) and asks for an advanced check to be performed by the operator. At this point, the operator sends an Over The Air (OTA) message, in the example an encrypted SMS message, from the remote server 20 to the mobile terminal 30. If the user replies 5 affirmatively to the message sent, the operator at the call centre

performs an operation in order to activate the data and voice channel from the remote server 20 to the mobile terminal 30. Standard checks are then carried out in order to establish whether the software resident on the mobile terminal 30, called Mobile 5 Tutoring or MT, and the software resident in the remote server 20, called PC client, communicate correctly.

At this point, the operator at the call centre is able to communicate by voice with the user of the mobile terminal 30 and at the same time send commands COM to the mobile terminal 30. In

.0 particular, the command COM is ¹ generated by the computer 20a of the operator at the call centre and is encapsulated and sent from the remote server 20 to the mobile terminal 30 as described above, for example using an encrypted protocol, within the packet data flow DATA_FLOW.

L5 The command COM is then extracted from the packet data flow DATA_FLOW and executed on the mobile terminal 30. For this purpose, the mobile terminal 30 has a command interpreter which translates the command COM into the language of the software operating system installed in the mobile terminal so as to allow execution of the

20 retrieved command COM.

Advantageously, moreover, the operator at the call centre may display on the graphics interface 21 of the remote server 20 the variations of the images which occur on the graphics interface 32 of the mobile terminal 30 following the sending of each command COM. 5 In a manner known per se, the mobile terminal 30 may be provided

with an application which allows processing of the images displayed on the graphics interface 32 of the said terminal 30 and compression of these images before sending them to the remote server 20. As can be understood from the description above, with the method according to the present invention it is possible to satisfy the requirements and overcome the drawbacks referred to in the introductory part of the present description with reference to the known art . In particular, with the method according to the invention, an operator present remotely at the remote server is able to send commands to the mobile terminal and at the same time give voice instructions to the user of the mobile terminal so as to provide a kind of long-distance training service. The method according to the present invention can be used in particular in all those cases where there is only one communications channel between the mobile terminal 30 and the remote server 20, for example in GSM telecommunications systems and in UMTS and GPRS systems should there be no GPRS or UMTS coverage. Obviously, a person skilled in the art, in order to satisfy unforeseen and specific requirements, may make numerous modifications and variations to the method according to the invention described above, all of which moreover are contained within the scope of protection of the invention as defined by the following claims.