FIELD OF THE INVENTION [0001] Embodiments of the present invention generally relate to methods and apparatus for operating handheld devices and particularly to virtual keyboards of handheld devices. More particularly, embodiments of the present invention relate to a method and apparatus for displaying and operating a virtual keyboard on an electronic handheld device and a computer program product for displaying and operating a virtual keyboard on an electronic handheld device.

BACKGROUND OF THE INVENTION

[0002] Nowadays, virtual keyboards have been used widely as human-machine interfaces for many electronic devices, including, for example, personal computers (PC) , personal digital assistants (PDA), mobile phones, electronic dictionaries, electronic readers, etc. However, due to the size constraints on display screens of handheld devices, the number of buttons that can be displayed on a virtual keyboard is rather limited. In order to accommodate on a limited area of a virtual keyboard characters/symbols needed for inputting information, the characters/symbols are typically divided into multiple groups, and characters/symbols in each group are mapped onto a plurality of buttons as accommodated on the virtual keyboard. As a result, the virtual keyboard typically has multiple key mapping or inputting modes; each key mapping or inputting mode corresponds to a different group of characters/symbols. Consequently, a same button on the virtual keyboard may be used to input different

! characters/symbols in different inputting modes. Therefore, it is necessary to indicate to the user the current inputting mode of the virtual keyboard.

[0003] Generally, there are three methods for indicating to the user the current inputting mode of the virtual keyboard. A first method is displaying multiple activation buttons on the virtual keyboard; each activation button is used for activating a different one of the multiple inputting modes of the virtual keyboard; among the multiple activation buttons, only an activation button that has been used to activate the current inputting mode is highlighted. However, in the first method, because each inputting mode is assigned an activation button, too much display area is needed for displaying the multiple activation buttons, which leaves less area for displaying character/symbol buttons. In addition, the button size has to be relatively small so that more character/symbol buttons may be displayed on the virtual keyboard, but the small size of the buttons is inconvenient for the user's pressing or tapping.

[0004] A second method is displaying only a common activation button; once the user presses the activation button, a popup listing of multiple activation buttons will be displayed, and the user may continue to press one of the displayed activation buttons to activate a corresponding inputting mode. However, in the second method, the user has to press the common activation button twice for activating an inputting mode, and the user is unaware of how many inputting modes are available prior to pressing the common activation button at least once.

[0005] A third method is using only a single activation button and allowing the user to press the single activation button more times so as to switch to different inputting modes in a loop, which is generally one-way. However, in the third method, the user is unaware of which inputting mode will appear before he or she presses the single activation button, and the user is also unaware of how many inputting modes are available. In addition, if a new inputting mode that is switched to is not the desired inputting mode, the user will have to press the single activation button one or more times prior to reaching the desired inputting mode. At the worst, if the user missed the desired inputting mode by accident, he or she will have to press the single activation button more times and at the same time stare at the virtual keyboard more cautiously so that he or she will not miss the desired inputting mode again.

SUMMARY OF THE INVENTION

[0006] Therefore, there is a need in the art to provide for a way of arranging buttons on a virtual keyboard so that a user of the virtual keyboard may be conveniently notified of how many modes of the virtual keyboard are available, what the current mode of the virtual keyboard is, and where the current mode of the virtual keyboard is located in a sequence of all available modes of the virtual keyboard with respect to other available modes.

[0007] One embodiment of the present invention provides a method. The method comprises displaying, on a display screen, a virtual keyboard comprising a plurality of input buttons, each of the input buttons including at least two faces. The method also comprises displaying, on a mode button, an indication indicative of which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard.

[0008] In one embodiment, the method may further comprises : in response to sensing a flipping action with respect to the virtual keyboard, rotating at least one of the plurality of the input buttons to a different face for displaying; and updating the indication on the mode button to indicate that the different face is being displayed. The flipping action may be performed in a direction substantially parallel to a longer side of the virtual keyboard. Alternatively, the flipping action may be performed in a direction substantially parallel to a shorter side of the virtual keyboard. The method may further comprises producing an audible signal accompanying the rotating of the at least one input button.

[0009] In another embodiment, the method further comprises: in response to sensing a tapping action with respect to the mode button, rotating at least one of the plurality of the input buttons to a different face for displaying; and updating the indication on the mode button to indicate that the different face is being displayed. The method may further comprises producing an audible signal accompanying the rotating the at least one input button.

[0010] In a further embodiment, the at least two faces of at least one input button represent at least two corresponding different symbols or characters, and the method further comprises in response to sensing a touching action with respect to a displayed face of the at least two faces of the at least one input button, outputting to a processor a corresponding symbol or character that is represented by the displayed face.

[0011] In one embodiment, the virtual keyboard comprises four by ten buttons. In another embodiment, each of the input buttons includes at least three faces. In an additional embodiment, each of the input buttons includes at least four faces .

[0012] In one embodiment, the displaying the indication comprises: displaying, on the mode button, at least two dots corresponding to the at least two faces of the plurality of the input buttons; and highlighting one of the dots that corresponds to one of the at least two faces of the plurality of the input buttons being displayed in the virtual keyboard. [0013] In another embodiment, the displaying the indication comprises displaying, on the mode button, a fraction. A denominator of the fraction equals to a total number of the at least two faces of the plurality of the input buttons, and a molecule of the fraction indicates which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard.

[0014] Another embodiment of the present invention provides an apparatus. The apparatus comprises means for displaying, on a display screen, a virtual keyboard comprising a plurality of input buttons, each of the input buttons including at least two faces. The apparatus also comprises means for displaying, on a mode button, an indication indicative of which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard.

[0015] In one embodiment , the apparatus further comprises : means for in response to sensing a flipping action with respect to the virtual keyboard, rotating at least one of the plurality of the input buttons to a different face for displaying; and means for updating the indication on the mode button to indicate that the different face is being displayed. The flipping action may be performed in a direction substantially parallel to a longer side of the virtual keyboard. Alternatively, the flipping action may be performed in a direction substantially parallel to a shorter side of the virtual keyboard. The apparatus may further comprises means for producing an audible signal accompanying the rotating of the at least one input button .

[0016] In another embodiment further comprises: means for in response to sensing a tapping action with respect to the mode button, rotating at least one of the plurality of the input buttons to a different face for displaying; and ^' means for updating the indication on the mode button to indicate that the different face is being displayed. The apparatus may further comprises means for producing an audible signal accompanying the rotating the at least one input button.

[0017] In a further embodiment, the at least two faces of at least one input button represent at least two corresponding different symbols or characters, and the apparatus further comprises means for in response to sensing a touching action with respect to a displayed face of the at least two faces of the at least one input button, outputting to a processor a corresponding symbol or character that is represented by the displayed face.

[0018] In one embodiment, the virtual keyboard comprises four by ten buttons. In another embodiment, each of the input buttons includes at least three faces. In an additional embodiment, each of the input buttons includes at least four faces .

[0019] In one embodiment, the means for displaying the indication comprises : means for displaying, on the mode button, at least two dots corresponding to the at least two faces of the plurality of the input buttons; and means for highlighting one of the dots that corresponds to one of the at least two faces of the plurality of the input buttons being displayed in the virtual keyboard.

[0020] In another embodiment, the means for displaying the indication comprises means for displaying, on the mode button, a fraction. A denominator of the fraction equals to a total number of the at least two faces of the plurality of the input buttons, and a molecule of the fraction indicates which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard.

[0021] An additional embodiment of the present invention provides a handheld device. The handheld device comprises any apparatus as provided by embodiments of the invention and as discussed above.

[0022] A further embodiment of the present invention provides an apparatus. The apparatus comprises at least one processor and at least one memory including computer program code. The memory and the computer program code are configured to cause the at least one processor to display, on a display screen, at least a virtual keyboard comprising a plurality of input buttons, each of the input buttons including at least two faces. The memory and the computer program code are also configured to cause the at least one processor to display, on a mode button, an indication indicative of which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard.

[0023] Another embodiment of the present invention provides a computer program product, comprising at least one computer readable storage medium having a computer readable program code portion stored thereon. The computer readable program code portion comprises program code instructions for displaying, on a display screen, a virtual keyboard comprising a plurality of input buttons, each of the input buttons including at least two faces. The computer readable program code portion comprises program code instructions for displaying, on a mode button, an indication indicative of which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard.

[0024] According to certain embodiments of the present invention, only one mode button is needed and indications of how many modes are available and what the current mode is are displayed on the mode button. Thus, the space of the display screen of a handheld device is greatly reduced. With no need to press the mode button, the user is able to know how many modes, e.g., inputting modes, are available to the virtual keyboard, e.g., by merely glimpsing the mode button. In addition, when switching to another mode of the virtual keyboard, the rotating of input buttons of the virtual keyboard, e.g., accompanied by a sound effect as produced by an audible signal, provides the user with a lively and intuitive feeling. Furthermore, the user may conveniently perceive that where the current mode of the virtual keyboard is located in a sequence of all available modes of the virtual keyboard with respect to other available modes.

[0025] Other features and advantages of the embodiments of the present invention will also be understood from the following description of specific embodiments when read in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of embodiments of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The embodiments of the invention that are presented in the sense of examples and their advantages are explained in greater detail below with reference to the accompanying drawings, in which:

[0027] Fig. 1 is a schematic diagram illustrating a virtual keyboard and its operation in one embodiment of the present invention;

[0028] Figs. 2 _r 3 and 4 are schematic diagrams illustrating virtual keyboards and their operations in other embodiments of the present invention;

[0029] Fig. 5 is a flow chart of a method for using the virtual keyboard in one embodiment of the present invention; and

[0030] Fig. 6 is a schematic diagram of an apparatus in another embodiment of the present application, which is equipped with, or implements, the virtual keyboard or method as illustrated in Figs. 1-5.

DETAILED DESCRIPTION OF EMBODIMENTS

[0031] Embodiments of the present invention will be described in detail as below.

[0032] In one embodiment of the present invention, at least an input button as comprised in a virtual keyboard may be flipped, flicked, turned, rotated, tapped, touched, etc., to expose a different face to a user of virtual keyboard. For example, the user may perform a flipping, flicking, or swiping action with respect to the virtual keyboard to initiate the turning or rotating of the input buttons. Herein, a flipping, flicking, or swiping action refers to a quick swipe, e.g., on a touch sensitive display screen, which includes lifting off the finger at the end of the stroke with a speed proportional to the speed of the action. The user may also perform a tapping action with respect to a mode button as comprised in the virtual keyboard or elsewhere to initiate the turning or rotating of the input buttons. In certain embodiments, indications regarding faces of the input buttons are displayed on the mode button .

[0033] Fig. 1 is a schematic diagram illustrating a virtual keyboard and its operation in one embodiment of the present invention. Fig. 1 illustrates an input window 101, in which a Chinese phrase " has been inputted, and a virtual keyboard 102 , which comprises a plurality of input buttons (e.g. , four by ten buttons} . Each of the input buttons has been assigned a corresponding symbol (e.g., #, $, @, or the like), a corresponding digit (e.g., 1, 2, 4, or the like), or a corresponding character (not shown, e.g., "a," "d, " or the like) , depending upon different inputting modes. When one inputting mode is switched to another inputting mode, the input buttons will be assigned different corresponding symbols, digits, or characters. In one embodiment, such inputting mode switching can be implemented by pressing, touching, or tapping a mode button, which may also be displayed. In the example as illustrated in Fig. 1, the mode button 103 is illustrated at first row, third column (from left to right) of the virtual keyboard, as indicated with a circle. As illustrated in Fig. 1, two dots, a bigger one and a smaller one, are displayed on the mode button 103. Each dot is indicative of an inputting mode. Thus, the virtual keyboard as illustrated in Fig. 1 includes two inputting modes for an inputting state as represented by "12@." The dot indicative of the current inputting mode is highlighted, e.g., enlarged as illustrated in Fig.l. Correspondingly, each input button on the virtual keyboard includes at least two faces. Each face corresponds to one inputting mode. When one inputting mode is selected by the user by tapping, pressing, or touching the mode button 103 or by flipping, flicking, or swiping the virtual keyboard 102, which is at least a portion of the display area of a touch sensitive display, the corresponding dot will be highlighted (e.g., by enlarging, flashing, changing color, etc.) and one of at least two faces of the button will be displayed correspondingly in the virtual keyboard 102. The virtual keyboard 102 then enters into a corresponding inputting mode. When the user taps, touches, or presses one of the input buttons, corresponding information (e.g., a symbol, digit, or character, as displayed on the face of the tapped, touched, or pressed input button, which is being exposed to the user) will be outputted by the virtual keyboard 102 to a processor or application currently interacting with the virtual keyboard 102. In the example of Fig. 1, the corresponding information will be outputted by the virtual keyboard 102 to a word processor and may be displayed on the input window 101.

[0034] The middle portion 104 of Fig.l particularly illustrates two states of the mode button 103 and at least two faces of an input button 105 during the transition of switching inputting modes. One face of the input button 105 displays and thus corresponds to punctuation mark and another face of the input button 105 displays and thus corresponds to symbol "#." In one embodiment, in response to sensing the user's flipping action with respect to the virtual keyboard 102 or tapping action with respect to the mode button 103, at least one of a plurality of input buttons is rotated to a different face for displaying. For example, Fig. 1 illustrated that the input button 105 is being rotated from one face of to another face of before, during, or after the rotating of the input button 105, the dots as displayed on the mode button 103 is updated, e.g., from highlighting (e.g., enlarging as illustrated in Fig. 1) the first dot to highlighting the second dot. Two corresponding views of the mode button 103 are illustrated in Fig. 1, from left to right.

[0035] The lower portion of Fig. 1 illustrates a layout of the virtual keyboard 102 subsequent to the foregoing switching of inputting modes. As illustrated in Fig. 1, subsequent to the rotation of a plurality of input buttons, the virtual keyboard enters into a next inputting mode and each input button is assigned a new symbol, digit, or character (correspondingly, another face of the input buttons are displayed to the user} . The switched input buttons are illustrated, for example, from the fourth column to the ninth column in the virtual keyboard 102.

[0036] It should be noted that the foregoing description are for the purpose of illustration only, and the present invention is not restricted by the illustrated examples. A

I I person skilled in the art can make any suitable modification or adaptation to the virtual keyboard as illustrated in Fig. 1 without departing from the scope of the present invention. For example, the input buttons as illustrated in Fig. 1 include at least two faces . In one embodiment, each of the input buttons may include three faces , forming a triangular prism, four faces, forming a cube, or even more faces, forming other solid figures . In addition, although Fig. 1 uses dots to indicate the inputting modes, any other signs can also be used as long as their sizes are suitable for displaying on the mode button 103. In another embodiment, dots are replaced with a fraction. The denominator of the fraction equals to a total number of the at least two faces of the plurality of the input buttons, and the molecule of the fraction indicates which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard 102. Suppose each input button 104 as illustrated in Fig. 1 has four faces. The views of dots as displayed on the mode button 103 may be replaced with views of "1/4," "2/4," "3/4," and "4/4" respectively. For example, the view of "3/4" indicates that the virtual keyboard has four inputting modes under the inputting state as represented by "12@" and the current inputting mode is inputting mode No. 3 in a sequence of the four inputting modes.

[0037] In further embodiments, accompanying the input buttons being rotated to other faces, an audible signal, which produces a sound effect, is generated to prompt user that the virtual keyboard will enter, is entering, or has entered into a next inputting mode. In different embodiments, the rotation may occur at all or a portion of the input buttons, depending on different designs.

[0038] Figs. 2, 3 and 4 are schematic diagrams illustrating virtual keyboards and their operations in other embodiments of the present invention. As illustrated in Fig. 2, the user' s flipping, flicking, or swiping action with respect to the virtual keyboard 102 is performed in a direction substantially parallel to a longer side of the virtual keyboard 102. Subsequent to the flipping action, the input buttons as comprised in the virtual keyboard 102 are rotated from exposing the current face to exposing another face. Suppose that the layout of the virtual keyboard 102 prior to the flipping, flicking, or swiping action is denoted by layout "A" and the layout of the virtual keyboard 102 subsequent to the flipping , flicking, or swiping action is denoted by layout "B." The middle portion of Fig. 2 illustrates that the virtual keyboard 102 is being rotated from layout "A" to layout "B" the lower portion of Fig. 2 illustrates that the virtual keyboard 102 has been rotated from layout "A" to layout "B." Fig. 2 also illustrates that, during and after the rotating of the input buttons, the first dot as displayed on the mode button 103 is de-highlighted, and the second dot as displayed on the mode button 103 is highlighted.

[0039] Likewise, as illustrated in Fig. 3, the user's flipping, flicking, or swiping action with respect to the virtual keyboard 102 is performed in a direction substantially parallel to a shorter side of the virtual keyboard 102. The lower portion of Fig. 3 illustrates that the virtual keyboard 102 has been rotated from layout "A" to layout "B." Fig. 3 also illustrates that after the rotating of the input buttons the upper dot as displayed on the mode button 103 is de-highlighted, and the lower dot as displayed on the mode button 103 is highlighted.

[0040] A person skilled in the art can appreciate that the flipping, flicking, or swiping action may be performed in any directions, e.g., from left to right, from right to left, from top to bottom, or from bottom to top.

[0041] Fig. 4 illustrates another embodiment, in which only partial input buttons as comprised in the virtual keyboard 102 are rotated subsequent to sensing the user's flipping, flicking,, or swiping action with respect to the virtual keyboard. The lower portion of Fig. 4 illustrates that the input button as included in the right portion of the virtual keyboard have been rotated from layout "A" to layout "B" while input buttons as included in the left portion of the virtual keyboard 102 (i.e., numerical buttons) remain unchanged.

[0042] Fig. 5 is a flow chart of a method for using the virtual keyboard in one embodiment of the present invention. As illustrated in Fig. 5, the method 500 begins at step S501 and launches a virtual keyboard at step S502. The virtual keyboard, for example, can be any virtual keyboard as illustrated in Figs. 1 to . Generally, the launching of a virtual keyboard is performed during the initialization of a certain application which requires input from the virtual keyboard during its interaction from the virtual keyboard or other components. In one embodiment, the launching of the virtual keyboard comprises, for example, displaying on a touch sensitive display screen, a plurality of input buttons and at least a mode button, as discussed above with respect to Figs. 1 to 4. At step S503, the method 500 decides, e.g., by sensing at least one electronic signal, whether a tapping, touching, or pressing action has been performed with respect to the mode button of whether a flipping, flicking, or swiping action has been performed with respect to input buttons of the virtual keyboard.

[0043] If the result in step S503 is "Yes," the method 500 proceeds to step S504. At step S504, the method 500 switches the virtual keyboard to a new inputting mode . In one embodiment, the virtual keyboard is switched from layout "A' to layout "B" as illustrated in Figs. 2 to 4. At step S504, the method 500 may additionally produces an audible signal as discussed above . [0044] At step S505, the indication as displayed on the mode button and on the input buttons are updated to conform to the layout of buttons as predetermined for the new inputting mode of the virtual keyboard. For example, in one embodiment, a different dot as displayed on the mode button will highlighted, or a greater or less fraction will be displayed on the mode button to replace a previously displayed fraction. Afterwards, the method 500 returns to step S503.

[0045] If the result in step S503 is "No," the method 500 proceeds to step S506. At step S506, the method 500 decides, e.g., by sensing another electronic signal, whether an input representing exiting the virtual keyboard has been sensed. If the result in step S506 is "No," the method 500 proceeds to step S507. At step S507, a symbol, digit, or character as displayed on an exposing face of an input button, which has been touched, tapped, or pressed by the user for selection, is outputted by the virtual keyboard to a processor or application as discussed above with respect to Fig. 1. Afterwards, the method 500 returns to step S503.

[0046] If the result in step S506 is "Yes," the method

500 proceeds to step S508 where the method 500 ends.

[0047] It should be noted herein that the steps and execution order as illustrated Fig. 5 are only examples and are restrictive to the present invention. Those skilled in the art, after reading the present specification, can change these steps, for example, by omitting, combining, or adding certain steps, changing the execution order of certain steps so as to adapt to different application demands. For example, the order of steps S504 and S505 can be switched such that the mode button and the input buttons are updated prior to switching to the next inputting mode; the two steps can also be combined into a single step. [0048] Fig. 6 is a schematic diagram of an apparatus in another embodiment of the present application, which is equipped with, or implements, the virtual keyboard or method as illustrated in Figs. 1-5. The apparatus as illustrated in Fig. 6 is only an example of the electronic devices in which the present invention implemented. In certain embodiments, the apparatus as illustrated in Fig. 6 may be a personal digital assistant (PDA), a mobile phone, an electronic dictionary or electronic reader, a receipt printer, etc. As illustrated in Fig. 6, the apparatus 60 comprises at least one processor 600, a virtual keyboard 601 (e.g. , implemented in an area of a touch sensitive display screen) , a codec circuitry 602, a microphone 603, an ear-piece 604, a radio interface circuitry 605, an antenna 606, at least one memory 607 storing computer program code, an infrared port 608, a display 609 (e.g., including the above touch sensitive display screen} , a smart card 610, and a card reader 611. Individual circuits and elements are all of a type well known in the art and some of them are omitted herein so as not to obscuring embodiments of the present invention unnecessarily. As illustrated in Fig. 6, the memory 607 and the computer program code as stored therein are configured to cause the processor 600 to launch the virtual keyboard 601. In one embodiment, the launching of the virtual keyboard 601, for example, includes displaying, on a touch sensitive display screen, the virtual keyboard 601; the virtual keyboard, as discussed above, comprises a plurality of input buttons, each of the input buttons including at least two faces. The launching of the virtual keyboard 601, for example, also includes displaying, on a mode button, an indication indicative of which one of the at least two faces of the plurality of the input buttons is being displayed in the virtual keyboard 601.

[0049] Exemplary embodiments of the present invention have been described above with reference to block diagrams and flowchart illustrations of methods, apparatuses (i.e., systems) . It will be understood that each block of the block diagrams and flowchart illustrations, and combinations of blocks in the block diagrams and flowchart illustrations, respectively, can be implemented by various means including computer program instructions. These computer program instructions may be loaded onto a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions which execute on the computer or other programmable data processing apparatus create means for implementing the functions specified in the flowchart block or blocks.

[0050] The foregoing computer program instructions can be, for example, sub-routines and/or functions. A computer program product in one embodiment of the invention comprises at least one computer readable storage medium, on which the foregoing computer program instructions are stored. The computer readable storage medium can be, for example, an optical compact disk or an electronic memory device like a RAM (random access memory) or a ROM (read only memory) .

[0051] Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these embodiments of the invention pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the embodiments of the invention are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.