Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
AN INTERACTIVE MULTIMEDIA SYSTEM AND DEVICE THEREFOR
Document Type and Number:
WIPO Patent Application WO/2024/059949
Kind Code:
A1
Abstract:
The present disclosure provides for an electronic multimedia device comprising a protective casing housing a variety of electronic components. The electronic components are electro- mechanically actuatable by a user to generate sounds, lights, or a haptic response. The device is configured to wirelessly communicate with a server to create and generate sounds through remote speakers, or lights through remote lighting. A system for providing interactive entertainment is also described, whereby a plurality of devices can communicate with the server and to a central controller to produce an interactive light and sound show. The system is also optionally comprised of a display device to receive instructions and relay those instructions to participants.

Inventors:
LÉTOURNEAU-ROSS GAULTIER (CN)
VILLENEUVE ERICK (CA)
Application Number:
PCT/CA2023/051257
Publication Date:
March 28, 2024
Filing Date:
September 22, 2023
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
OPERA OP INC (CA)
International Classes:
H04W4/20; A63J99/00; H05B47/19
Foreign References:
US10004984B22018-06-26
Other References:
STRINER ET AL.: "Transitioning Between Audience and Performer: Co-Designing Interactive Music Performances with Children", PROCEEDINGS OF THE 2017 CHI CONFERENCE EXTENDED ABSTRACTS ON HUMAN FACTORS IN COMPUTING SYSTEMS, 11 May 2017 (2017-05-11), pages 2115 - 2122, XP058992872, [retrieved on 20231227], DOI: https://doi.org/10.1145/3027063.3053171
Attorney, Agent or Firm:
ANDREWS ROBICHAUD PC (CA)
Download PDF:
Claims:
CLAIMS

1 . An electronic multimedia device for use with an interactive multimedia show, the device comprising : a casing; a plurality of actuatable electro-mechanical inputs ; and, electronic components secured within the casing and in electrical engagement with the plurality of actuatable electro-mechanical inputs , wherein the electronic multimedia device is in two-way wireless communication with a central controller of the interactive multimedia show to provide at least one of : a sound, light and video output on the electronic multimedia device and in the interactive multimedia show .

2 . The electronic multimedia device of Claim 1 further comprising an attachment mechanism connected to the casing, the attachment mechanism configured to be secured to a limb of a user of the interactive multimedia show .

3 . The electronic multimedia device of Claim 1 further comprising : an accelerometer ; a pad to receive a mechanical input ; a plurality of actuatable buttons ; and, an optical sensor, wherein the user can interact with the accelerometer, the pad, the plurality of actuatable buttons and the optical sensor to generate the at least one of : the sound, light and video output on the electronic multimedia device and in the interactive multimedia show . 4 . The electronic multimedia device of Claim 1 further comprising a wand to interact with the plurality of actuatable electro-mechanical inputs .

5 . A multimedia system for providing an interactive multimedia show, the system comprising : at least one server to process data ; an audio system adapted to wirelessly communicate with the at least one server ; a plurality of electronic multimedia devices adapted to wirelessly communicate with the at least one server , the plurality of electronic multimedia devices comprising : a casing; a plurality of actuatable electro-mechanical inputs ; and, electronic components secured within the casing and in electrical engagement with the plurality of actuatable electro-mechanical inputs ; and, a central controller in two-way wireless communication with the plurality of electronic multimedia devices to provide at least one of : a sound, light and video output on the electronic multimedia device and in the interactive multimedia show .

6 . The multimedia system of Claim 5 further comprising a plurality of wireless access points (WAPs ) for wirelessly communicating with the plurality of electronic multimedia devices and the at least one server .

7 . The multimedia system of Claim 5 further comprising a screen to display images during the interactive multimedia show . The multimedia system of Claim 5 wherein the plurality of electronic multimedia devices are adapted to work with one another in unison in the interactive multimedia show . The multimedia system of Claim 5 wherein the plurality of electronic multimedia devices are further comprised of an attachment mechanism connected to the casing, the attachment mechanism configured to be secured to a limb of a user of the interactive multimedia show . . The multimedia system of Claim 5 wherein central controller is configured to send a prompt to each one of the plurality of electronic multimedia devices to elicit a response from users of the interactive multimedia show . . A method of providing an interactive multimedia show, the steps comprising : securing a plurality of wearable electronic multimedia devices on a plurality of users ; connecting the plurality of wearable electronic multimedia devices wirelessly to a central controller ; sending a prompt from the central controller to the plurality of wearable electronic multimedia devices for the plurality of wearable electronic multimedia devices to generate at least one of : an audio output , a light output , and a picture output ; sending a command from the plurality of wearable electronic multimedia devices to the central controller to provide at least one of : a sound, light and video output in the interactive multimedia show .

12 . The method of providing an interactive multimedia show of Claim 11 wherein the plurality of wearable electronic multimedia devices are further comprised of : a casing; a plurality of actuatable electro-mechanical inputs ; and, electronic components secured within the casing and in electrical engagement with the plurality of actuatable electro-mechanical inputs .

13 . The method of providing an interactive multimedia show of Claim 12 further comprising an attachment mechanism connected to the casing, the attachment mechanism configured to be secured to a l imb of the users of the interactive multimedia show .

14 . The method of providing an interactive multimedia show of Claim 13 further comprising : an accelerometer ; a pad to receive a mechanical input ; a plurality of actuatable buttons ; and, an optical sensor, wherein the user can interact with the accelerometer, the pad, the plurality of actuatable buttons and the optical sensor to generate the at least one of : the sound, light and video output on the electronic multimedia device and in the interactive multimedia show .

15 . The method of providing an interactive multimedia show of Claim 11 further comprising a wand to interact with the plurality of actuatable electro-mechanical inputs .

Description:
AN INTERACTIVE MULTIMEDIA SYSTEM AND DEVICE

THEREFOR

FIELD

The disclosure relates to the field of interactive multimedia, and more speci fically to an interactive multimedia system and a multimedia device therefor .

BACKGROUND

Live stage performances have been growing steadi ly for the past few decades . Indeed, performances are now more interactive , with various multimedia, and serve to entertain audiences of all ages . However, newest technologies , like two-way wireless multimedia capabilities , are seldom used .

The present interactive multimedia system is used as part of a live stage performance in which the audience is equipped with portable electronic devices to interact with, and influence , the content being presented on stage . The device and the wireless telecommunication system allows stage performances and other types of of fline public events to include elements of interactive & multimedia gami fication ( in which the audience uses the device and system to become players in the scenario ) , as well as interactive & multimedia educational and knowledge transmission ( in which the audience can receive information, go through a learning process , and transmit the knowledge back to the presenters on stage ) .

Typically, a live performance in accordance with the prior art will utili ze a LED bracelet for light ef fects . These bracelets can receive basic commands ( e . g. flash lights ) but cannot transmit data back to the stage . Another example of devices used are the so-called "clickers" that are used in business conferences to let audiences participate , often by responding to A, B, or C questions . But these devices ' technology and list of functionalities are much more limited than the device described in the present disclosure .

Other devices that exist are the AR or VR headsets that are increasingly being used in performing arts or immersive exhibition settings ; however, the present device di f fers from that in the sense that it is aimed at a "communal" participation, not individually- focused . The present device enables the user to collaborate with others during a live performance , as opposed to a VR headset that is used by the user as part of an individual immersive experience .

As such, there is a need such as the present system, to provide two-way communication to a device and provide an immersive , interactive experience that can be shared by a group communally and collaboratively .

SUMMARY

In an aspect , the present disclosure provides an electronic multimedia device for use with an interactive multimedia show, the device comprising : a casing; a plurality of actuatable electro-mechanical inputs ; and, electronic components secured within the casing and in electrical engagement with the plurality of actuatable electro-mechanical inputs , wherein the electronic multimedia device is in two-way wireless communication with a central controller of the interactive multimedia show to provide at least one of : a sound, light and video output on the electronic multimedia device and in the interactive multimedia show .

In another aspect , the present disclosure provides a multimedia system for providing an interactive multimedia show, the system comprising : at least one server to process data ; an audio system adapted to wirelessly communicate with the at least one server ; a plurality of electronic multimedia devices adapted to wirelessly communicate with the at least one server, the plurality of electronic multimedia devices comprising : a casing; a plurality of actuatable electromechanical inputs ; and, electronic components secured within the casing and in electrical engagement with the plurality of actuatable electro-mechanical inputs ; and, a central controller in two-way wireles s communication with the plurality of electronic multimedia devices to provide at least one of : a sound, light and video output on the electronic multimedia device and in the interactive multimedia show .

In yet another aspect , the present disclosure provides a method of providing an interactive multimedia show, the steps comprising : securing a plurality of wearable electronic multimedia devices on a plurality of users ; connecting the plurality of wearable electronic multimedia devices wirelessly to a central controller ; sending a prompt from the central controller to the plurality of wearable electronic multimedia devices for the plurality of wearable electronic multimedia devices to generate at least one of : an audio output , a light output , and a picture output ; sending a command from the plurality of wearable electronic multimedia devices to the central controller to provide at least one of : a sound, light and video output in the interactive multimedia show .

BRIEF DESCRIPTION OF THE DRAWINGS

The following figures serve to illustrate various embodiments of features of the disclosure . These figures are illustrative and are not intended to be limiting .

Figure 1 is a perspective view of a wearable device for use with an interactive multimedia show, according to an embodiment of the present disclosure ;

Figure 2 is an exploded perspective view of a wearable device for use with an interactive multimedia show, according to an embodiment of the present disclosure ;

Figure 3 is a top view of two layers of a printed circuit board secured within the wearable device of Figure 1 , according to an embodiment of the present disclosure ;

Figure 3A is a perspective view of a drumstick for use with an interacting multimedia show as described herein, according to an embodiment of the present disclosure ;

Figure 4 is a schematic view of a system for providing interactive entertainment with multimedia content using a plurality of the wearable devices of Figure 1 , according to an embodiment of the present disclosure ;

Figure 5 is a perspective view of the wearable device for use with an interactive multimedia show, the device having an exterior layer design, according to an embodiment of the present disclosure ;

Figure 6A is a rear perspective view of a lower part of a casing for the wearable device , according to another embodiment od the present disclosure ; Figure 6B is a front perspective view of an upper part of the casing for the wearable device of Figure 6A, according to another embodiment of the present disclosure ;

Figure 7 is an exploded perspective view of a wearable device for use with an interactive multimedia show, according to another embodiment of the present disclosure ;

Figure 8 is a top view of the wearable device for use with an interactive multimedia show of Figure 7 , according to another embodiment of the present disclosure ;

Figure 9 is a perspective view of the wearable device for use with an interactive multimedia show of Figure 7 , according to another embodiment of the present disclosure ; and,

Figure 10 is a method of providing method of providing an interactive multimedia show using a wearable device .

SUBSTITUTE SHEET (RULE 26) DETAILED DESCRIPTION

The following embodiments are merely illustrative and are not intended to be limiting . It will be appreciated that various modi fications and/or alterations to the embodiments described herein may be made without departing from the disclosure and any modi fications and/or alterations are within the scope of the contemplated disclosure .

With reference to Figures 1 and 2 and according to an embodiment of the present disclosure , an electronic multimedia device 10 is shown . In a preferred embodiment , the electronic multimedia device is a musical synthesi zer and sampler . The device 10 is further comprised of a casing 15 , the casing 15 operatively engaged with and secured to electronic components , which in the present embodiment is a printed circuit board ( PCB ) 20 . The device 10 is also optionally comprised of an electronic ribbon 25 . The ribbon 25 is further comprised of an optical fiber strip ( not shown) connected to LEDs (not shown) to light up the ribbon 25 . A worker skilled in the art would appreciate that in a preferred embodiment , the device 10 is wearable by a user . As such, the device 10 is further comprised of adj ustable straps (not shown) to comfortably surround a user' s forearm or other suitable part of the body . The straps (not shown) can be tightened or loosened depending on user preference . An antenna 30 is shown, secured through the casing 15 and connected to the PCB 20 for the device 10 to wirelessly communicate with a remote server (not shown) . The PCB 20 is configured to receive electro-mechanical inputs from a user and convert those electro-mechanical inputs into images , lights or sound, such as musical notes , sound ef fects , etc . The device 10 can also convert the electro-mechanical inputs into signals , such as instructions or data, and transmit those signals wirelessly to the server (not shown) . In an embodiment , the device 10 is further comprised of one or more screens (not shown) to display images .

With reference to Figures 2 , 3 and 3A and according to an embodiment of the present disclosure , the PCB 20 is further comprised of a microphone 35 to receive audio input . The PCB 20 is also compri sed of a speaker 37 to play audio . The PCB 20 is comprised of pressure sensors 40 , which could be piezoelectric sensors or an accelerometer, to receive a mechanical input from a user . An example of such as a mechanical input could be a tap to mimic a drumbeat or a piano note . The PCB 20 will convert the mechanical input from the pressure sensors 40 into an electric signal to convert the input into a sound and/or a signal to be wirelessly transmitted . The PCB 20 is also comprised of two optical sensors 45 , 47 , configured to convert a light input into sound and/or signal . A worker skilled in the art would appreciate that two optical sensors 45 , 47 are utili zed to provide the device 10 with redundancy in case of failure or gesture data, such that only one optical sensor 45 may be utili zed instead . A proximity sensor 48 is also shown, to ensure that the optical sensors 45 , 47 are only activated when intended by the operator ( e . g. when an optical input element as further described below is close to the device 10 ) . The PCB 20 is comprised of a vibration unit (not shown) to provide haptic feedback to the user when activated . The PCB 20 is also comprised of a plurality of LEDs 50 that can be activated based on a variety of inputs . The PCB 20 is further comprised of an infrared sensor 55 to send and receive data . A purpose of the infrared sensor 55 is to have redundancy in the PCB 20 in case of wireless communication failure . In a preferred embodiment , the device 10 may have an optional input element , such as a drumstick, tubular flute or baton 60 to interact with the device 10 . Indeed, the drumstick 60 is configured to actuate the pressure sensors 40 when the drumstick 60 makes contact with the pressure sensors 40 . The drumstick 60 may also be luminescent or comprised of coloured strips 62 to actuate the optical sensors 45 , 47 , which will in turn generate signals and/or sounds . Indeed, the luminescence or coloured strips 62 on the drumstick 60 would interact with the optical sensors 45 , 47 such that movement of the drumstick 60 would act as an electric violin . A worker skilled in the art would appreciate that the drumstick 60 is merely an exemplary embodiment , and a user could use their hands or another similar instrument . In another embodiment , the drumstick 60 could be comprised of a di f ferent pattern, provided that there is an alternation in colours to interact with the optical sensors 45 , 47 .

With reference to Figure 4 and according to an embodiment of the present disclosure , an interactive multimedia system 70 is shown, the system 70 for providing interactive entertainment with participants , for example participants in an audience . The system 70 is comprised of a server 75 to process data and an audio system comprising a plurality of speakers 80 to wirelessly communicate with the server 75 . The system 70 is further comprised of a plurality of user-operated electronic multimedia devices 10 that are configured to wirelessly communicate with the server 75 . In an embodiment , the system 70 is also comprised of a plurality o f wireless access points (WAP ) 85 to provide a means of communication between the devices 10 and the server 75 . A central controller 90 is also shown, which is a type of master device , that can send instructions to the devices 10 . During an iteration of the interactive entertainment show, the central controller 90 , through a master operator (not shown) , could send instructions , such as lights , sounds or haptic feedback to each one of the devices 10 . A response would be elicited from each one of the operators (not shown) of the devices 10 , who could communicate with their devices 10 through the flute (not shown) or by other means . The controller 90 is configured to synchroni ze signals received from the devices 10 , such that responses from each of the devices 10 are coordinated and appear to be at the same time . In other words , multiple signals would be received from the devices 10 to the central controller 90 , but those signals may be received at di f ferent times , depending on speci fic timing of each user' s input . The controller 90 is configured to synchroni ze the s ignals for them to appear to have been sent and received at the same time , and therefore appear mus ically synchroni zed when generating an audiovisual output . Other responses from operators (not shown) of the devices 10 may include tapping on the device 10 with one ' s hands , activating the optical sensors 45 , 47 with the flute (not shown) , using voice to activate the microphone , or otherwise interacting with the device 10 as described herein . The devices 10 and central controller 90 would communicate with server 75 wirelessly and send instructions to the speakers 80 or to a display device 95 . Indeed, the display device 95 may play an integral part of the interactive entertainment . The display device 95 could receive the instructions from the central controller 90 and proj ect those instructions for actions to be performed by the participants . A worker skilled in the art would appreciate that although a general show is described, in another embodiment it may be a theatrical stage show and that the show may be presented in various venues , including shopping centers , small auditoriums , theme parks , etc .

With further reference to Figure 4 , a multimedia system 70 for providing an interactive multimedia show is shown, the system 70 comprising : at least one server 75 to process data, an audio system 80 adapted to wirelessly communicate with the at least one server 75 , a plurality of electronic multimedia devices 10 adapted to wirelessly communicate with the at least one server 75 , and, a central controller 90 in two-way wireless communication with the plurality of electronic multimedia devices 10 to provide at least one of : a sound, light and video output on the electronic multimedia device 10 and in the interactive multimedia show . The multimedia system 70 is further comprised of a plurality of wireless access points (WAPs ) 85 for wirelessly communicating with the plurality of electronic multimedia devices 10 and the at least one server 75 . The multimedia system 70 is further comprised a screen 95 to display images during the interactive multimedia show . The plurality of electronic multimedia devices 10 are adapted to work with one another in unison in the interactive multimedia show . In other words , signals received by the controller 90 from the devices 10 are synchroni zed so that the audiovisual output is similarly musically and visually synchroni zed . Indeed, as signals sent by each device 10 is not sent at the same time , synchronicity in the system 70 is required to provide a good show .

With reference to Figure 5 and according to an embodiment of the present disclosure , the device 10 is shown having an exterior layer design 98 over the casing 15. The exterior layer design 98 has buttons 100, 102, 104 positioned over the corresponding pressure sensors (not shown) of the PCB (not shown) . In this embodiment, the buttons 100, 102, 104 have different shapes or multi-colour possibilities, which can be used to differentiate between the pressure sensors (not shown) . A worker skilled in the art would also appreciate that there can be any number of buttons. The optical sensors 45, 47 are shown below the casing 15, to be actuated by the drumstick (not shown) . A user can utilize the flute (not shown) and move it up and down so that the coloured strips (not shown) of the flute (not shown) actuate the optical sensors 45, 47. An antenna port 32 may also be provided to receive an antenna (not shown) . A speaker 37 is shown to play sounds, music, etc.

With reference to Figures 6A and 6B, a variation of the casing

115 is shown.

With reference to Figure 7, 8 and 9 and according to another embodiment of the present disclosure, an electronic multimedia device 210 for use with an interactive show is shown. In this preferred embodiment, the electronic multimedia device 210 is a musical synthesizer and sampler. The device 210 is further comprised of upper and lower casings 215, 217, the casings 215, 217 operatively engaged with and secured to electronic components, which in the present embodiment is a printed circuit board (PCB) 220. A worker skilled in the art would appreciate that in a preferred embodiment, the device 210 is wearable by a user. As such, the device 210 is further comprised of adjustable straps 222, 224 and buckle 226 to comfortably surround a user's forearm or other suitable part of the body . The straps 222 , 224 and buckle 226 can be tightened or loosened depending on user preference . The device 210 is configured to wirelessly communicate with a remote server ( not shown) . The PCB 220 is configured to receive electro-mechanical inputs from a user and convert those electro-mechanical inputs into images , lights or sound, such as musical notes , sound ef fects , etc . The device 210 can also convert the electro-mechanical inputs into signals , such as instructions or data, and transmit those signals wirelessly to the server (not shown) . In an embodiment , the device 210 is further comprised of a screen (not shown) to display images . In this embodiment , the device 210 is comprised of buttons 250 , which are actuatable and light up to create an ef fect for the user . The device 210 is comprised of a pressable pad 255 that is actuated by contact with a user' s fingers or other obj ect . The device 210 is also comprised of a speaker 260 to play music and sounds , as well as a plurality of lights such as LEDs 262 that can light up interactively . The device 210 has an optical sensor 265 that can be triggered by light to generate a sound or light . To trigger the optical sensor 265 , a user can simply wave an obj ect , such as a wand or fingers , to generate a sound or light . The device 210 is comprised of a flashlight 270 that can be illuminated on command as well as a microphone 275 for a user to talk into . The device 210 is comprised of an accelerometer (not shown) that can be actuated upon movement of the device 210 . Once actuated, the accelerometer (not shown) engages the PCB to generate a sound, light , vibration, or other desired ef fect .

With further reference to Figures 7 , 8 and 9 , an electronic multimedia device 10 for use with an interactive multimedia show is shown, the device comprising a casing 215 , a plurality of actuatable electro-mechanical inputs 250 , and electronic components 220 secured within the casing 215 and in electrical engagement with the plurality of actuatable electromechanical inputs 250 , wherein the electronic multimedia device 10 is in two-way wireless communication with a central controller (not shown) of the interactive multimedia show to provide at least one of : a sound, light and video output on the electronic multimedia device 10 and in the interactive multimedia show . The electronic multimedia device 10 further comprises an attachment mechanism 222 , 224 , 226 connected to the casing 215 , the attachment mechanism 222 , 224 , 226 configured to be secured to a limb of a user of the interactive multimedia show . The electronic multimedia device 10 further comprises an accelerometer (not shown) , a pad 255 to receive a mechanical input , a plurality of actuatable buttons 250 ; and, an optical sensor 265 , wherein the user can interact with the accelerometer, the pad 255 , the plurality of actuatable buttons 250 and the optical sensor 265 to generate the at least one of : the sound, light and video output on the electronic multimedia device 10 and in the interactive multimedia show . The electronic multimedia device 10 further comprises a flute (not shown) to interact with the plurality of actuatable electro-mechanical inputs .

With reference to Figure 10 and according to an embodiment of the present disclosure , the method 300 of providing an interactive multimedia show using a wearable device 310 is shown . In a first step 301 , the device 310 is turned on, typically by means of movement felt by the accelerometer (not shown) or other movement detector . In another embodiment , a button can be pressed to turn the device 310 on and handed to a user 300 . In a second step 302 , the device 310 is installed by the user 300 using the straps (not shown ) or other fastening means . In a third step 303 once a user 300 is wearing the device 310 , the device 310 can enter into a tutorial functionality . This can be through a signal sent by a server 375 directly, by means of a WAP 385 , or due to another actuation means . In the tutorial , the device 310 may flash or emit other signals to instruct the user 300 how to use the device 310 and help them be familiar with the functionality of the device 310 . I f the device 310 was not wirelessly connected in the second step 302 , it wil l attempt to connect to the server 374 in the fourth step 304 . Once a wireless connection is established, the interactive show will take place in a fi fth step 305 . Once the show has ended, the device 310 may receive a signal to let the user 300 know that the show has ended and that it i s time to remove the device 310 , which occurs in a sixth step 306 . In a seventh step, the device 310 is turned of f , either by receiving a signal or manual disconnect . A worker skilled in the art would appreciate that these steps are not necessarily sequential , and in particular that steps two through four may be in another order .

Many modi fications of the embodiments described herein as well as other embodiments may be evident to a person skilled in the art having the benefit of the teachings presented in the foregoing description and associated drawings . It is understood that these modi fications and additional embodiments are captured within the scope of the contemplated disclosure which is not to be limited to the speci fic embodiment disclosed .