Field of the Invention

The present application relates to a handheld controller, in particular a handheld game controller that is transformable between different configurations.

Background of the Invention

Various handheld controllers for enabling a user to control functions of an electronic device through manually operation of input elements of the handheld controller are known, for example remote control devices for enabling the wireless control of home audio visual equipment (such as televisions, optical media players, radios, and media streamers) and game controllers for enabling a user to control play of a game (such as on a PC or gaming console).

Common form factors and general architectures for handheld game controllers have been focused on monolithic type designs, typically featuring a centre block region disposed between gripping regions. A kind of game controller, which can be termed as “generic” or “universal”, offers a fixed arrangement of input elements, such as buttons and sticks, that can be mapped to menu navigation and game play actions for a particular gaming platform. The unchangeable nature of this kind of game controller, with the same the fixed arrangement of input element being used by a player regardless of the type of game being played, can detract from the user experience.

Another kind of game controller, which can be termed as “specific” or “custom”, seeks to offer a player an improved user experience through utilising a more purpose-specific, realistic design and may therefore resemble a steering wheel, pedals, an aircraft yoke, a particular type of weapon, or a particular piece of sports equipment. The lack of versatility associated with this kind of game controller can however lead to a player having different game controllers which are used only selectively and which can be difficult to switch between during game play.

It is desirable for a user of a handheld game controller to be able to transform the configuration thereof to match a particular type of game. It is further desirable for the user to be able to change the configuration of the handheld game controller during game play, to match a particular scene or action being performed within the game. For example, during game progression a character may transition from driving a vehicle to engaging in combat. It is also desirable for the handheld game controller to incorporate one or more features, which may provide an audio and/or visual and/or a haptic effect and which may involve connectivity to at least one other peripheral device, for example a camera or motion sensor, for effecting an improved immersive experience.

Summary of the Invention

According to a first aspect there is provided a handheld controller, comprising: a body supporting an input element arrangement for detecting user inputs, the body comprising: a set of mechanically connected body components transformable between a plurality of different configurations, the body components comprising: a base component, a plurality of primary- linked components, each primary-linked component movably secured to the base component by a connection therebetween for guiding movement of the primary-linked component relative to the base component, each primary-linked component connected directly to the base component, and a plurality of secondary-linked components, each secondary-linked component movably secured to a primary-linked component or another secondary-linked component by a connection therebetween for guiding movement of the secondary-linked component relative to said primary-linked component or said another secondary-linked component, each secondary- linked component connected indirectly to the base component via at least a primary-linked component.

The handheld controller may be transformable between at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations. The set of mechanically connected body components may thus be transformable between a high number of different configurations, this feature serving to improve user experience.

In an example, the plurality of different configurations includes at least a gaming controller configuration, a steering wheel configuration, and at least one weapon configuration.

The at least one weapon configuration may comprise one or more of a knife or bat configuration and a gun configuration.

A “knife” configuration may represent any other similar implement having a blade, for example a machete, a sword or similar. A “bat” configuration may represent any other similar item having an elongate form, for example a wand or similar. A “gun” configuration may resemble any of a variety of types of firearm, for example a shotgun, a submachine gun, a sniper rifle, an assault rifle, a pistol, or similar.

In an example, the set of mechanically connected body components comprises a primary-linked component that is slidable relative to the base component along a single axis.

In an example, the set of mechanically connected body components comprises two or more primary-linked components that are each rotatable relative to the base component about a single axis. The handheld controller may comprise two or more primary-linked components that are rotatable relative to the base component about a common axis.

The use of single axis couplings has several benefits that include, but are not limited to, reducing the degree of freedom of movement between connected body components, which is beneficial for maintaining reliable electrical through-signalling, providing for self-guiding movement of one body component relative to another, which is advantageous for achieving quick, easy and reliable transformation between different configurations, and providing for cost-effective manufacture.

In an example, the set of mechanically connected body components comprises at least one secondary-linked component that is (i) movably secured to a primary-linked component by a connection therebetween for guiding movement of the secondary-linked component relative to the primary-linked component and (ii) movably secured to another secondary-linked component by a connection therebetween for guiding movement between them.

In an example, the base component has a first end and a second end, and the set of mechanically connected body components comprises: a first subset of body components extending from the first end of the base component, and a second subset of body components extending from the second end of the base component. The first subset of body components may comprise a plurality of primary-linked components, and the second subset of body components may comprise a primary-linked component and a plurality of secondary-linked components. The set of mechanically connected body components may form a configuration in which the body has an upper block section and left side and right side handlebars. The body may comprise a powered actuator arrangement that is selectively operable to activate automatic transformation of the set of mechanically connected body components between different configurations. In an example, transformation between configurations may be effected manually or automatically via the powered actuator arrangement.

The input element arrangement of the handheld controller may comprise a plurality of buttons.

The body may support at least one camera, The body may support an omnidirectional camera. The body may support at least one speaker. The body may support a microphone. The body may support at least one motion sensor, The body may support a haptic actuator.

In an example, the body comprises a configuration sensing arrangement for sensing a relative arrangement of body components, whereby to determine a present configuration of the set of mechanically connected body components.

The body may comprise an orientation sensing arrangement for determining a present orientation of the set of mechanically connected body components.

In an example, the body comprises a wireless communication device for enabling wireless communication between the handheld controller and at least a wireless communication-enabled host. A wireless communication-enabled host may be, for example, a gaming console, a smart television, an AR/VR headset, a smartphone, or similar device.

In an example, the body comprises a binaural Tenderer for providing an audio output for reproduction by headphones, the binaural Tenderer functional to render sounds with reference to a calculated relative positioning of the handheld controller and a user’s head.

The handheld controller may be configured for low-latency communication with a communicatively connected wireless headphones.

In an example, the handheld controller comprises a true wireless stereo headphone pair, and the body defines a holding region for releasably housing the true wireless headphone pair. Earbuds may be removably held by a snap-fit arrangement of the holding region. The body may comprise a charging arrangement for recharging the headphones when housed in the holding region.

In an example, the body comprises a mobile device docking station for releasably physically securing and communicatively connecting a mobile device to the handheld controller.

Integrated connectivity and audio/visual features are usable in different ways to improve user experience.

According to a second aspect there is provided a method of assembling a handheld controller, the handheld controller comprising a body supporting an input element arrangement for detecting user inputs, the method comprising: assembling the body by connecting a plurality of body components to form of a set of mechanically connected body components transformable between a plurality of different configurations, such that a first plurality of said body components are each connected directly to a base component of the plurality of body components, each body component of said first plurality movably secured to the base component by a connection therebetween for guiding movement of the body component relative to the base component, and a second plurality of said body components are connected indirectly to said base component, via at least a body component of said first plurality, each body component of said second plurality movably secured to a body component of said first plurality or another body component of said second plurality by a connection therebetween for guiding movement of the body component of said second plurality relative to the said body component of said first plurality or said second plurality.

The plurality of different configurations may comprise at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations, which may include at least a gaming controller configuration, a steering wheel configuration, and at least one weapon configuration, which may comprise at least one of a knife or bat configuration and a gun configuration.

Further particular and preferred aspects of the invention are set out below.

Brief Description of the Drawings

The present invention will now be more particularly described, with reference to the accompanying drawings, in which: Figure 1 shows a front, perspective view of a handheld controller;

Figure 2 shows a rear, perspective view of the handheld controller;

Figure 3 shows an exploded view of the handheld controller;

Figure 4 shows the handheld controller in a gaming controller configuration;

Figures 5 to 13 show the handheld controller in different weapon configurations;

Figure 14 shows the handheld controller in a steering wheel configuration;

Figures 15 to 23 show different transformations of the handheld controller from one configuration to another;

Figure 24 illustrates transformability of the handheld controller during game play, to transform the handheld controller between different configurations to suit different scenes of a game;

Figure 25 shows a first handheld controller in one configuration and a second handheld controller in another configuration;

Figure 26 shows an optional actuation feature of the handheld controller;

Figure 27 illustrates the architecture of the handheld controller;

Figures 28 & 29 illustrate a device connection feature of the handheld controller;

Figures 30 to 32 illustrate an audio output feature of the handheld controller;

Figure 33 shows additional features of the handheld controller;

Figure 34 illustrates a camera feature of the handheld controller; and

Figure 35 illustrates an audio processing feature of the handheld controller;

Figure 36 illustrates an ear phone storage feature of the handheld controller.

Description

Examples are described below, with reference to the accompanying drawings, in sufficient detail to enable those of ordinary skill in the art to implement the apparatus, systems and/or processes described herein. However, it is to be understood that the invention is not limited to the precise examples described and/or shown and that various changes and modifications can be effected by one skilled in the art without departing from the scope of the invention as defined by the appended claims.

In the following description, all orientational terms, such as upper, lower, radially and axially, are used in relation to the drawings and should not be interpreted as limiting the scope of the invention as defined by the appended claims unless the context clearly indicates otherwise. The drawings are not necessarily drawn to scale, and in some instances the drawings may have been exaggerated or simplified for illustrative purposes only.

Unless otherwise defined, all terms (including technical and scientific terms) used herein are to be interpreted as is customary in the art. In addition, features referred to herein in the singular can number one or more, unless the context clearly indicates otherwise. Similarly, the terms “comprises”, “comprising”, “includes”, “including”, “has” and/or “having” when used herein, specify the presence of the stated feature or features and do not preclude the presence or addition of one or more other features, unless the context clearly indicates otherwise.

The following is disclosed herein: a handheld controller comprising a body that supports an input element arrangement for detecting user inputs and that comprises a set of mechanically connected body components which are transformable between a plurality of different configurations, preferably at least 3 different configurations, and preferably between at least a gaming controller configuration, a steering wheel configuration and at least one weapon configuration. The body components comprise a base component, a plurality of primary-linked components and a plurality of secondary-linked components. Each primary-linked component is movably secured to the base component by a connection therebetween for guiding movement of the primary-linked component relative to the base component, each primary-linked component being connected directly to the base component. Each secondary-linked component is movably secured to a primary-linked component or another secondary-linked component by a connection therebetween for guiding movement of the secondary-linked component relative to the primary-linked component or the another secondary-linked component, each secondary- linked component being connected indirectly to the base component via at least a primary- linked component.

The following is also disclosed herein: a method of assembling a handheld controller that comprises a body supporting an input element arrangement for detecting user inputs. The method comprises assembling the body by connecting a plurality of body components to form of a set of mechanically connected body components that are transformable between a plurality of different configurations. The assembly of the body components is such that a first plurality of the body components are each connected directly to a base component of the plurality of body components, each body component of the first plurality movably secured to the base component by a connection therebetween for guiding movement of the body component relative to the base component, and a second plurality of the body components are connected indirectly to the base component, via at least a body component of the first plurality, each body component of the second plurality movably secured to a body component of the first plurality or another body component of the second plurality by a connection therebetween for guiding movement of the body component of the second plurality relative to the said body component of said first plurality or said second plurality.

Further disclosure follows with reference to the accompanying drawings.

A handheld controller 101 according to a specific example is shown in Figures 1 & 2, the handheld controller 101 has a front side 100, a perspective view of which is shown in Figure 1 and a rear side 200, a perspective view of which is shown in Figure 2. The handheld controller also has a first side 110, a second side 120, a top 130 and a bottom 140. As will be described in detail, the handheld controller 101 is designed is transformable between each of a plurality of different configurations. The handheld controller 101 of the specific example is designed for use in gaming but may be used in a non-gaming application.

The handheld controller 101 comprises a body, indicated at 102, that supports an input element arrangement, indicated at 103, for detecting user inputs. The input element arrangement 103 may comprise any suitable type or types of input element, for example a button, a stick, a dial, a trackball, a toggle, a touchpad, a squeeze switch, a microphone. In this illustrated example, the input element arrangement 103 comprises a plurality of buttons, such as button 104.

An exploded view of the body 102 is shown in Figure 3. The body 102 comprises a set of mechanically connected body components transformable between a plurality of different configurations. As will be described in further detail below, the body components comprise a base component, a plurality of primary-linked components and a plurality of secondary-linked components. Each primary-linked component is movably secured to the base component by a connection therebetween for guiding movement of the primary-linked component relative to the base component, each primary-linked component connected being directly to the base component. Each secondary-linked component is movably secured to a primary-linked component or another secondary-linked component by a connection therebetween for guiding movement of the secondary-linked component relative to the primary-linked component or other secondary-linked component, each secondary-linked component being connected indirectly to the base component via at least a primary-linked component.

In this specific example, the body components comprise base component 301, a plurality of primary-linked components, comprising first, second, third and fourth primary-linked components 302-305, and a plurality of secondary-linked components, comprising first, second, third and fourth primary-linked components 306-309.

In an example, a primary-linked component is slidable relative to the base component.

In this specific example, first primary-linked component 302 is slidably connected to base component 301. As indicated by arrow 310, first primary-linked component 302 is slidable relative to the base component 301 along a single axis (in both directions).

In an example, each of at least two primary-linked components are rotatable relative to the base component about a single axis.

In this specific example, second primary-linked component 303 is pivotably connected to base component 301 and rotatable relative to base component 301 about a first rotation axis 311.

In an example, the body components comprise two or more primary-linked components that are rotatable relative to the base component about a common axis.

In this specific example, third primary-linked component 304 and fourth primary-linked component 305 are each pivotably connected to base component 301 and rotatable relative to base component 301 about a second rotation axis 312; the third and fourth primary-linked components 304, 305 are disposed on opposite sides of the base component 301 (with third primary-linked component 304 towards the front side 100 of the body 102 and the fourth primary-linked component 305 towards the rear side 200).

In an example, the body components comprise at least one secondary-linked component that is movably secured to a primary-linked component by a connection therebetween for guiding movement of the secondary-linked component relative to the primary-linked component and that is further movably secured to another secondary-linked component by a connection therebetween for guiding movement between them.

In this specific example, first secondary-linked component 306 is pivotably connected to second primary-linked component 303 for rotation about a third rotation axis 313, third secondary- linked component 307 is pivotably connected to first secondary-linked component 306 for rotation about a third rotation axis 314, third secondary-linked component 308 is pivotably connected to second secondary-linked component 307 for rotation about a fourth rotation axis 315, and fourth secondary-linked component 309 is pivotably connected to third secondary- linked component 308 for rotation about a fourth rotation axis 316.

Thus, and as shown, the first secondary-linked component 306 is mechanically connected to a primary-linked component (second primary-linked component 303) and to a secondary-linked component (second secondary-linked component 307), the second and third secondary-linked components 307, 308 are each mechanically connected to two secondary-linked components (the first and the third secondary-linked components 306, 308 and the second and the fourth secondary-linked components 307, 309 respectively), and the fourth secondary-linked component 309 is mechanically connected to one other secondary-linked component (third secondary-linked component 308).

Of the primary-linked components 303-305 that are rotatable relative to the base component 301, the third primary-linked component 304 presents a free end 316 and the fourth primary- linked component 305 presents a free end 317. Of the second-linked components 306-309, the fourth secondary-linked component 309 presents a free end 318.

XYZ coordinates are indicated in Figure 3. A depth of the body 102 (between the front and rear sides 100, 200) is indicated as being in the Z-direction, a width of the body 102 (between the first and second sides 110, 120) is indicated as being in the X-direction, and a height of the body 102 (between the top and bottom 130, 140) is indicated as being in the Y-direction.

In this Figure, of the axes of rotation 311-316, axes 311, 312, 314 and 316 are shown extending in the Z-direction, axis 313 is shown extending in the X-direction, and axis 315 is shown extending in the Y-direction. In an example, the set of mechanically connected body components comprises a first subset of body components extending from the first end of the base component, and a second subset of body components extending from the second end of the base component,.

In an example, the first subset of body components comprises a plurality of primary-linked components and the second subset of body components comprising a primary-linked component and a plurality of secondary-linked components.

In this specific example, the set of mechanically connected body components 301-309 comprises a first subset of body components, indicated generally at 319, extending from a first end 320 of the base component 301, the first subset 319 of body components comprising the fourth and fifth primary-linked components, 304, 305, and a second subset of body components indicated generally at 320, extending from a second, opposite end 322 of the base component 301, the second subset 321 of body components comprising a second primary-linked component 303 and the first to the fourth secondary-linked components 306-309.

As shown, the set of mechanically connected body components 301-309 may form a configuration in which the body 102 has an upper block section 323 and left side and right side handlebars 324, 325 respectively.

In an example, the body components are transformable between at least 3 different configurations. In other examples, the body components are transformable between at least 4, 5, 6, 7, 8, 9 or 10 different configurations.

In a preferred example, the body components are transformable between a plurality of different configurations that includes at least a gaming controller configuration, a steering wheel configuration, and at least one weapon configuration. The at least one weapon configuration may comprise one or more of a knife or bat configuration, and a gun configuration. As used herein, the term “knife” is intended to cover other items having a blade such as a machete, a sword or similar. As used herein, the term “bat” is intended to also cover other items having an elongate form such as a wand or similar. As used herein, the term “gun” is intended to cover many types of firearm, such as a shotgun, a submachine gun, a sniper rifle, an assault rifle, a pistol, or similar. According to this specific example, the body components of handheld controller 101 are transformable between over 10 different configurations.

The body 102 is shown in Figure 4 in a gaming controller configuration 401 (which may be referred to as a ’’standard gaming controller configuration” arrangement, although it is to be appreciated that the handheld controller 101 is suitable for non-gaming applications), in Figure 5 in a first weapon configuration 501 being a gun configuration (which may be referred to as a “shotgun” arrangement), in Figure 6 in a second weapon configuration 601 being a gun configuration (which may be referred to as a “mini submachine gun” arrangement), in Figure 7 in a third weapon configuration 701 being a gun configuration (which may be referred to as a “submachine gun” arrangement), in Figure 8 in a fourth weapon configuration 801 being a gun configuration (which may be referred to as a “long assault rifle” arrangement), in Figure 9 in a fifth weapon configuration 901 being a gun configuration (which may be referred to as a “long assault rifle” arrangement), in Figure 10 in a sixth weapon configuration 1001 being a gun configuration (which may be referred to as a “short assault rifle” arrangement), in Figure 11 in a seventh weapon configuration 1101 being a gun configuration (which may be referred to as a “pistol” arrangement), in Figure 12 in an eighth weapon configuration 1201 being a bat configuration (which may be referred to as a ’’short bat” arrangement), in Figure 13 in a ninth weapon configuration 1301 being a knife configuration (which may be referred to as a ’’long knife” arrangement), and in Figure 14 in a steering wheel configuration 1401.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the steering wheel configuration 1401 shown in Figure 14 is illustrated in Figure 15.

As illustrated at A and B, with the body 102 in the gaming controller configuration 401, the first, second, third and fourth secondary-connected components 306-309 are pivoted together about the axis of rotation 313 until they reach the unfolded position shown at C. As illustrated at B and C, the third and fourth secondary-connected components 308, 309 are pivoted together about the axis of rotation 315 until they reach the unfolded position shown at E. As illustrated at E, the third primary-linked component 304 is pivoted about the axis of rotation 312 until it reaches the position shown at F, with the free end 318 of the fourth secondary-linked component 309 meeting the free end 317 of the fourth primary-linked component 305, and transformation into the steering wheel configuration 1401 is completed. Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the long knife configuration 1301 shown in Figure 13 is illustrated in Figure 16.

As illustrated at A, with the body 102 in the gaming controller configuration 401, the fourth primary-linked component 305 is pivoted about the axis of rotation 312 and the first, second, third and fourth secondary-connected components 306-309 are pivoted together about the axis of rotation 311 until they reach the arrangement shown at B, from which the third primary- linked component 304 is pivoted about the axis of rotation 312 until it reaches the position shown at C and transformation into the long knife configuration 1301 is completed. It is to be appreciated that the third primary-linked component 304 is pivoted in an opposite direction of rotation around the axis 312 to that in which the fourth primary-linked component 305 is pivoted; the free end 318 of the latter 305 is moved towards the base element 301 and the free end 317 of the former 304 is moved away the base element 301.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the pistol configuration 1101 shown in Figure 11 is illustrated in Figure 17. As illustrated at A, with the body 102 in the gaming controller configuration 401, the third and fourth primary- linked components 304, 305 are pivoted about the axis of rotation 312 in the same direction, to move their free ends 317, 318 towards the base element 301, until they reach the position shown at B, and transformation into the pistol configuration 1101 is completed.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the mini submachine gun configuration 601 shown in Figure 6 is illustrated in Figure 18. As illustrated at A, the body 102 is initially transformed from the gaming controller configuration 401 into the pistol configuration 1101 shown at B. As illustrated at B, with the body 102 in the pistol configuration 1101, the first primary-linked component 302 is moved into the extended position shown at C, and transformation into the mini submachine gun configuration 601 is completed.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the short bat configuration 1201 shown in Figure 12 is illustrated in Figure 19. As illustrated at A, the body 102 is initially transformed from the gaming controller configuration 401 into the pistol configuration 1101 shown at B. As illustrated at B, with the body 102 in the pistol configuration 1101, the first, second, third and fourth secondary-connected components 306-309 are pivoted together about the axis of rotation 313 until they reach the extended position shown at C, and transformation into the short bat configuration 1201 is completed.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the short assault rifle configuration 1001 shown in Figure 10 is illustrated in Figure 20. As illustrated at A, with the body 102 in the gaming controller configuration 401, the third primary-linked component 304 is pivoted about the axis of rotation 312, to move its free end 317 away from the base element 301 until it reaches the position shown at B, and transformation into the short assault rifle configuration 1001 is completed.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the sniper rifle configuration 501 shown in Figure 5 is shown in Figure 21. As illustrated at A, with the body 102 in the gaming controller configuration 401, the third primary-linked component 304 is pivoted about the axis of rotation 312, to move its free end 317 towards the base element 301 and the fourth primary-linked component 305 is pivoted about the axis of rotation 312, to move its free end 318 away from the base element 301, until they reach the arrangement shown at B. As illustrated at B, the first primary-linked component 302 is moved into the extended position shown at C, and transformation into the sniper rifle configuration 501 is completed.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the submachine gun arrangement 701 shown in Figure 7 is shown in Figure 22. As illustrated at A, with the body 102 in the gaming controller configuration 401, the third primary- linked component 304 is pivoted about the axis of rotation 312, to move its free end 317 away from base element 301 and the fourth primary-linked component 305 is pivoted about the axis of rotation 312, to move its free end 318 towards the base element 301, until they reach the arrangement shown at B. As illustrated at B, the first primary-linked component 302 is moved into the extended position shown at C, and transformation into the submachine gun arrangement 701 is completed.

Transformation of the body 102 from the gaming controller configuration 401 shown in Figure 4 into the long assault rifle arrangement 801 of Figure 8 is shown in Figure 23. As illustrated at A, with the body 102 in the gaming controller configuration 401, the fourth primary-linked component 305 is pivoted about the axis of rotation 312, to move its free end 318 away from base element 301, until it reaches the arrangement shown at B. As illustrated at B, the first primary-linked component 302 is moved into the extended position shown at C, and transformation into the long assault rifle arrangement 801 is completed.

The handheld controller 101 is conveniently transformable between different configurations during game play, the design allowing a user to effect such transformations in a quick and robust manner.

For example, and as illustrated in Figure 24, the body 102 of the handheld controller 101 may be used in the steering wheel configuration 1401 during a driving scene, then transformed into a gun configuration 801 during a shooting scene 2402, and then transformed into a different gun configuration 101 during a subsequent shooting scene 2403, transformed then into the standard gaming controller configuration 401, and then transformed again into a bat configuration 1201 during a hitting scene 2405.

As illustrated in Figure 25, two players 2501, 2502 can play a game together, each using a respective handheld controller 101A, 101B but with one player 2501 using their handheld controller 101 A in one configuration and the other player 2502 using their handheld controller 101B in a different configuration. For example, one player 2501 can be controlling a character that is driving a vehicle, and so use their handheld controller 101 A in a steering wheel configuration 1401, and the other player 2501 can be controlling a character that is a passenger in that vehicle but engaging in combat with enemies outside the vehicle, and so use their handheld controller 101A in a gun configuration 1101. Thus, the handheld controller 101 provides a benefit in multi-player mode: a plurality of players can share the same gameplay and switch roles by using different configurations of the handheld controller 101, thus increasing realism and team play experience.

It is to be understood that the set of mechanically connected components are assembled using an optimum (limited/minimised) number of single axis couplings (axial joints and linear (sliding) connections). In the specific illustrated example of body 102 of handheld controller 101, and as can be seen most clearly in Figure 3, only a single linear (sliding) connection is utilised). The use of single axis couplings reduces the degree of freedom of movement between connected body components, which is beneficial for maintaining reliable electrical through- signalling and provides for self-guiding movement of one body component relative to another, which is advantageous for achieving quick, easy and reliable transformation between different configurations, so as not to detract from fast gameplay. It also provides for cost-effective manufacture. Further, the feature facilitates motorization of the set of mechanically connected body components.

In an embodiment, and as indicated in Figure 26, the body 102 comprises a powered actuator arrangement, indicated generally at 2601, that is selectively operable to activate automatic transformation of the set of mechanically connected body components between different configurations. Thus, the transformation of the body 102 from at least one configuration to another configuration can be electrically activated. In a preferred embodiment, each available transformation between configurations can be achieved using powered actuator arrangement. In an embodiment, transformation between configurations may be effected manually or automatically via the powered actuator arrangement.

The powered actuator arrangement may comprise any suitable arrangement of components for switching between different configurations. Rotary motors, such as DC motor 2602, electromagnetic solenoid actuators, piezo actuators, shape memory alloy actuators equipped with or without transmission members, such as a bevel gear 2603, spur gear 2604, worm gear 2605 or internal gear 2606 for a rotational joint and a rack and pinion gear 2607 for a linear (sliding) connection, may applied to drive the moving system elements.

Any suitable activation arrangement, indicated generally at 2608, for activating the powered actuator arrangement to effect a transformation to a different configuration of the body 102 may be utilised. The activation arrangement may comprise at least one control element of any suitable type, for example a button, a dial, or an appropriate sensor.

In an embodiment, the body 102 comprises a configuration sensing arrangement, indicated generally at 2605, for sensing a relative arrangement of body components, for determining a present configuration of the set of mechanically connected body components.

The transformable handheld controller 101 provides a more immersive user experience for action, adventure and racing based third person, first person or multi-person gameplay. Fast gameplay requires fast switching times between the modes, these can be performed manually in couple of seconds. Optionally, the joints between body components can also contain small Hall-sensors with moving magnets that indicate the position of moving members electrically to the processing unit; the handheld controller can then send a feedback signal to the host game console which UI mode is currently in use.

Figure 27 illustrates the architecture of the handheld controller 101.

In this Figure, a multimedia module 2701 of the body 102 is indicated. The multimedia module 2701 may comprise any number of components, such as, but not limited to, a camera, a speaker, a microphone, a sensor, a processor, for use in providing one or more different functions such as, but not limited to, those specifically described below.

It is to be appreciated that different arrangements of body components may be used in different examples. The number of body components may vary, the way that the body components are mechanically connected to form the set of mechanically connected body components may vary, the dimensions of the body components may vary, and the type of body components may vary. For example, a body component may be provided as a unitary component or may alternatively be provided as a multi-part, adjustable component. As a specific example, body component 304 is illustrated as having a unitary form but an alternative body component 304’ is also illustrated that comprises multiple parts, first part 304A and second part 304B, with the two parts 304A, 304B being rotatable together about an axis 212 and with second part 304B being rotatable relative to the first part 304A about a different axis 2702.

A method of assembling a handheld controller as disclosed herein, comprising a body supporting an input element arrangement for detecting user inputs, comprises assembling the body by connecting a plurality of body components to form of a set of mechanically connected body components transformable between a plurality of different configurations, such that a first plurality of said body components are each connected directly to a base component of the plurality of body components, each body component of said first plurality movably secured to the base component by a connection therebetween for guiding movement of the body component relative to the base component, and a second plurality of said body components are connected indirectly to said base component, via at least a body component of said first plurality, each body component of said second plurality movably secured to a body component of said first plurality or another body component of said second plurality by a connection therebetween for guiding movement of the body component of said second plurality relative to the said body component of said first plurality or said second plurality.

In an example, the resultant handheld controller is transformable between at least 3 different configurations, preferably between at least a gaming controller configuration, a steering wheel configuration, and at least one weapon configuration, which may comprise one or more of a knife or bat configuration and a gun configuration.

As will be described below, the handheld controller 101 may be configured for use with a variety of different media devices.

Referring now to Figures 28 & 29, in an embodiment, and as indicated, the body 102 comprises a mobile device docking station 2801 for releasably physically securing and communicatively connecting a mobile device 2802 to the handheld controller 101. The mobile device docking station 2801 may be configured to physically secure and communicatively connect a smartphone to the handheld controller 101. The handheld controller may thus be usable as a phone accessory. In this specific example, the mobile device docking station 2801 is disposed at the top 130 of the handheld controller 101 and is designed to support a mobile device 2702 in such a way that transforming the body 102 of the handheld controller 101 between different configurations is not negatively affected. In Figure 28, mobile device 2802 is shown docked on the handheld controller 101 and with the body 102 in a first configuration (a steering wheel configuration being illustrated) in Figure 29 mobile device 2802 is shown docked on the handheld controller 101 and with the body 102 in a second, different configuration (a weapon (gun) configuration being illustrated).

In this specific example, the mobile device docking station 2801 is provided by, or electrically connected with, the multimedia module 2701.

Moving now to Figures 30 to 32, in an embodiment, the body 102 supports at least one speaker. In Figure 30, the body 102 is shown in a weapon configuration, being the long assault rifle arrangement 801, and comprises at least one speaker, such as speaker 3001. Various audio effects may be output during gameplay, to coincide with an action within the game, for example when firing a gun, there can be two sounds generated, a “bang” sound output from a first speaker 3001 at one position 3002 (towards a firing end of the weapon) and a “cartridge ejecting” sound (similar to a metallic “click”) output from a second speaker 3003, at a different position 3004 (towards the handle end of the weapon), the different speaker positions for outputting the particular sounds being selected with reference to where each sound would be heard to be made by a real weapon. In Figure 31, the body 102 is shown in another weapon configuration, being the pistol arrangement 1101, and supports speakers (not shown) usable to output, for example, a “cartridge ejecting” sound from position 3002 and a “bang” sound from position 3101. The body 102 is shown in yet another weapon configuration, being short bat arrangement 1201, in Figure 32, and supports a speaker arrangement for outputting a “swoosh” sound when the handheld controller 101 is moved, for example in a direction as indicated by arrow 3201. It is to be appreciated that any suitable audio special effects (SFX) may be provided. The feature of a speaker arrangement provides audio immersivity, for enhancing user experience. The or each speaker of the speaker arrangement may be provided by, or electrically connected with, the audio/visual module 2701.

Turning now to Figure 33, in an embodiment the body 102 of the handheld controller 101 supports at least one microphone, such as microphone 3301. A microphone may be of any suitable type and may be used for any suitable purpose or purposes. A microphone may be used, for example, for recording a user’s voice, controlling menu navigation and/or game play actions for a particular gaming platform, for controlling a function of the handheld controller 101 and/ or for enabling a user to communicate with another person at a remote location.

In an embodiment, the body 102 supports at least one camera, such as camera 3302. A camera may be of any suitable type and may be used for any suitable purpose or purposes. A camera may be an omnidirectional camera. A camera may be an RGB or IR camera.

In an embodiment, the body 102 supports at least one motion sensor, such as motion sensor 3303. A motion sensor may be of any suitable type and may be used for any suitable purpose or purposes. A motion sensor may be a gyroscope, an accelerometer, an inertial measurement unit (IMU). A motion sensor can be used in detecting a pointing position of the handheld controller 101, and movements of the handheld controller 101.

A motion sensor may be used, for example, for controlling menu navigation and/or game play actions for a particular gaming platform and/or for controlling a function of the handheld controller 101. In an embodiment, the body 102 supports at least one haptic actuator sensor, such as haptic actuator 3304. A haptic actuator may be of any suitable type and may be used for any suitable purpose or purposes. A haptic actuator may be used, for example, for confirming menu selections and/or for providing feedback corresponding to game play actions, for enhancing user experience.

In an embodiment, the body 102 comprises an orientation sensing arrangement, indicated generally at 3305, functional to determine a present orientation of the set of mechanically connected body components. An orientation sensing arrangement may be of any suitable type and may be used for any suitable purpose or purposes.

In an embodiment, the body 102 comprises a wireless communication device, indicated generally at 3306, that is functional to enable wireless communication between the handheld controller 101 and at least a wireless communication-enabled host, indicated generally at 3307. The wireless communication-enabled host 3307 may be, for example, a gaming console, a smart television, an AR/VR headset, a smartphone, or similar device.

In an embodiment, the body 102 comprises a binaural Tenderer, indicated generally at 3308, that is functional to provide an audio output for reproduction by headphones. In a specific example, the binaural Tenderer is functional to render sounds with reference to a calculated relative positioning of the handheld controller 101 and a user’s head.

According to this specific illustrated example, and referring back to prior Figures, the base component 301 houses the main hardware members, such as a battery, a processor, a tactile feedback actuator, driving circuitry for audio, camera and motion sensors (for example, a gyroscope, an accelerometer) as well as wireless transmitters e.g. Bluetooth or WiFi. The base component 301 has different electromechanical connections existing to left and right side handlebars 324, 325 and to the first primary-linked component 302. The base component 301 supports an input element array 3309 on its front side.

The first primary-linked component 302 surrounds the base component 302 and supports an input element array 310 on its front side and the audio/visual module 2701. Audio elements can include stereo microphones and speakers supporting special audio effects for the handheld controller 101. The camera can be, for example, an ultra-wide angle or full 360-degree RGB or IR camera, which is capable of monitoring/tracking the surrounding environment for identifying factors such as the user behaviour or spatial factors. The left and right side handlebars 324, 325, which are hinged to the base component 301 and rotatable through 180 degrees (along the Y-axis) do not contain any active electronics, but either or both may do so in other examples. The right side handlebar 325 is important in providing the steering wheel configuration 1401. The second primary-linked component 303 has an axial hinge connection to the base component 301 (along the Y-axis ) and also contains an axial hinge joint to first secondary-linked component 306 (along the X-axis), which has dependency over another axial joint to the second secondary-linked component 307 (along the Y-axis). The second secondary- linked component 307 has an axial connection to the third secondary-linked component 308 (along the Z-axis) which is also axially connected to the fourth secondary-linked component 309 (along the Y-axis).

Referring now to Figure 34, a field of view 3401 for a 360-degree camera 3302 supported on the top 130 of the body 102 of the handheld controller 101 is shown. As indicated by line 3402, in this example, the camera 3302 is functional to scan the environment, and to record 3D data, which can be used in the gameplay. The camera 3302 can be used to monitor a user’s movements and surrounding events, especially when a mobile media device (smartphone, VR/AR headset) is used with the handheld controller 101. The camera 3302 may support depth functions and may scan the real-world spatial surroundings with conversion into 3D digital representation (SLAM (Simultaneous Localization and Mapping)).

With reference now to Figures 35 & 36, benefits are provided by integrated audio features. As illustrated in Figure 35, head/earphones-controller integration allow binaural rendering to be implemented within the handheld controller 101.

In an example, the handheld controller 101 receives multichannel (e.g. 7.1) or object audio, as indicated by arrow 3501, from a gaming console or HMD 3502, calculates the head orientation of the user 3503 and the location of the handheld controller 101 (e.g. using an IMU sensor in the handheld controller 101), and renders virtual sound sources in the correct locations (e.g. gunshot sounds from the direction of the handheld controller 101, other sounds from their virtual directions in the game environment) for output to the user’s head/earphones 3504, as indicated by arrow 3505. As illustrated in Figure 36, in this specific example, the handheld controller 101 comprises headphones 3601, preferably a true wireless stereo headphone pair (TWS earbuds), and the body 102 defines a holding region, indicated at 3602 for releasably housing the headphones 3601. Further, the body 102 comprises a charging arrangement, indicated at 3603, for recharging the headphones 3601 when housed in the holding region 3602.

Wirelessly linking the headphones 3601 directly to the handheld controller 101, instead of an external host, allows a binaural functionality as described above to be achieved.

The handheld controller 101 is preferably configured for low-latency communication with communicatively connected wireless headphones. The low-latency connection is preferally proprietary.

Many gamers do not have access to multiple-speaker Hi-Fi audio setups, especially in mobile gaming. Therefore, an excellent compromise is to use headphones in reproducing game sounds directly to the user’s ears. In fact, for good-quality 3D audio, headphones usually are the only viable sound setup. As extended reality (xR) gaming relies heavily on 3D audio to provide the correct sonic experience, incorporating wireless headphones as an integral part of the gaming setup is desirable.

In this specific example, when in use, the headphones 3601 can be ’’popped out” from the handheld controller 101 and placed to the user’s ears. When not in use, the headphones 3601 can be ’’pushed in” the handheld controller 101 for charging and storage.

An advantage with using a TWS headset integrated into the game controller is that a proprietary RF codec may be used for transmitting the audio or other data between the handheld controller 101 and the headphones 3601, allowing for much lower latencies than, for example, the Bluetooth standard allows. This would allow for a smoother gameplay experience and improved immersion. For 3D audio, the headphones could be equipped with inertial measurement unit (IMU) sensors, which could help in defining the head orientation of the user (perhaps by supplementing xR head-mounted-display (HMD) data). A low-latency proprietary connection between, for example, IMU sensors (in the TWS headset 3601 and handheld controller 101), the binaural Tenderer 3308 (in the handheld controller 101), and playback (TWS headphones 3601) is particularly advantageous in relation to games where fast reaction times are essential (such as first-person-shooters).

A handheld controller as described herein can feature: a single unit architecture, all-in-one; inexpensive and manufacturing friendly electro-mechanical architecture; compatibility, easy to carry around (with a size similar to existing monolithic controllers) and usable with different media devices (monitor, VR glasses, smartphone); a high number of transformations (+10 options); fast, reliable transformations between different configuration (achieved using self-guiding architecture, supported by single axis joints (no ball joints used)); optional electrical switching of operational modes with small actuators, this is to be realized also with single axis joint designs; realistic transformation modes, authentic form factors for different UI setups (wheel, rifle, pistol, machine gun, knife); natively supported integrated haptic and audio effects.

Integrated connectivity and audio/visual features are usable in different ways to improve user experience.