A method of operating a set of devices, a real- world representation system and a detection device

FIELD OF THE INVENTION

This invention relates to a method of operating a set of devices according to the preamble of claim 1. The invention further relates to a real- world representation according to the preamble of claim 6 and to a detection device. The detection device is arranged for determining an ambient characteristic of an ambient environment. The real- world representation system is arranged to provide an ambient atmosphere in the ambient environment. In the method of operating a set of devices comprised in the real- world representation system the operation of said set of devices is adjusted in response to the determined ambient characteristic.

BACKGROUND OF THE INVENTION

Developments in the entertainment world have led to the creation of real- world representation systems, which provide additional effects in addition to a user's primary entertainment experience. An example of this would be a movie, which is being presented by a display device and connected audio devices, and is augmented by effects devices to provide an ambient atmosphere in the ambient environment of the user and wherein the provided ambient atmosphere corresponds to said movie.

International patent application publication WO 2004/082275 describes a real- world representation system comprising a set of devices. At least one of the devices is arranged to receive a real-world description describing an ambient atmosphere to be created in an ambient environment, and the devices are operated according to the description. The set of devices comprises a number of effects devices. These effects devices provide perceptible effects and may be, for example, lighting devices, or temperature devices etc. that are controlled according to the real- world description and in line with the movie's content. With the perceptible effects a predetermined atmosphere corresponding to the real world description is created in the ambient environment of the user. For example if a scene is being shown in the film that is underwater, then additional lights may provide blue light and a fan may operate to lower the temperature of the room thereby creating an ambient

atmosphere in the ambient environment of the user that matches the underwater condition in the real-world.

The author of the real- world description assumes a certain ambient environment with certain ambient characteristics when designing the real-world description. Examples of ambient characteristics in an ambient environment such as a room are the temperature in the room, the intensity of the light in the room, the position of the effects devices in the room, the size of the room, the acoustics of the room, etc. There may be ambient characteristics of the ambient environment of the user that are different than the author has assumed causing a deterioration of the result of the rendering of the real- world description. The ambient environment of the user may have a window through which sunlight is shining, thereby disturbing an intended ambient atmosphere that is being created by the real- world representation system. In an other example the position of the effects devices with respect to the user may be different than assumed resulting in a different perception of the generated effects.

SUMMARY OF THE INVENTION

It is therefore an object of the invention to provide a method of operating a set of devices that enables an ambient atmosphere resulting from the rendering of the real- world description that better matches the author's intention. This object is achieved with the method as defined in claim 1. To adapt the rendering of the real- world description to an ambient characteristic that differs from an assumed ambient characteristic said ambient characteristic is determined. In response to the determined ambient characteristic the operation of said set of devices is adjusted. Thus the rendering of the real- world description is made dependent on the ambient characteristic of the user's ambient environment thereby obtaining an ambient atmosphere resulting from said rendering that better matches the author's intention, and thereby achieving the object of the invention.

The ambient characteristic may be determined during for example a start up routine of the real- world representation system. This allows the ambient characteristic to be determined prior to the step of operating the set of devices, thereby changing the operation of said set of devices that results from the received real- world description when no ambient characteristic had been determined.

Also an ambient characteristic may be monitored regularly or continuously during the operation of said set of devices allowing adjustments in the operation when

ambient characteristics in the ambient environment change. When for example the sun starts shining through the window the lighting characteristic may change resulting in a change of the ambient characteristic.

In an other example the ambient characteristic relates to an acoustical characteristic, which depends on an ambient parameter such as for example a position of the user. As an example the volume of an audio amplifier comprised in an effects device providing sound may be adjusted in response to the determined position of the user. In a further example the volume and the audio content provided by the audio amplifier comprised in said effects device may be further adjusted in response to a further ambient parameter such as the orientation of the effect device with respect to the user. As an example the effects device may be arranged to provide audio content wherein the provided audio content is dependent on whether said effects device is a 'rear' or 'front' speaker. Thus the volume of the audio amplifier comprised in the effects device is dependent on the determined acoustical characteristic, said acoustical characteristic being dependent at least one ambient parameter. In yet a further example a population characteristic of the ambient environment is determined, said characteristic being dependent on the determined position of the user or users in the ambient environment, the operation of a rumbling device being adjusted in response to the determined population characteristic.

In an embodiment each effects device comprised in said set of devices itself may handle the adjustment of the operation in response to the determined ambient characteristic. Once for example the sunlight shines through the window and the change of the ambient characteristic caused by an enhanced lighting level in the ambient environment has been notified to the effects device, the effects device may adjust for example the intensity of the light it provides. A disadvantage is that each effects device has to be notified of a change of the ambient characteristic, and has to interpret the change and determine what action it must take in response to said change.

In a further embodiment of the method the real- world description comprises a number of ambient parameters. These ambient parameters have a default value corresponding to the ambient characteristics of the ambient environment that was assumed by the author of the real- world description. When the set of devices is operated in a different ambient environment than the assumed environment the default value of the number of ambient parameters is adjusted dependent on the determined ambient characteristic of said different ambient environment. As the set of devices is operated according to the real- world description this may result in an adjustment of the operation of some or all of the devices

comprised in the set of devices. This has the advantage that the devices do not need to be aware of the ambient characteristic, or a change in said ambient characteristic.

In a further embodiment of the method the interpretation of the real- world description results in a script that comprises a number of ambient parameters. In said further embodiment of the method the real- world description is in the form of an instruction set of a markup language. Such a real- world description comprises a high level description of an ambient atmosphere to be created in the ambient environment as a result of the operation of said set of devices. As an example the real world description may comprise a term <FOREST>. The interpretation of said term <FOREST> results in a script defining the colour and intensity of a light to be provided by an effects device comprising a light source. As an example the script further has an ambient parameter characterizing the intensity of the light in the ambient environment, and said ambient parameter may for example be set to 'bright' in response to the determining of a lighting characteristic of the ambient environment, the lighting characteristic being an example of an ambient characteristic. The script with the ambient parameter set to 'bright' will result in an adjustment of the provided lighting level by an effects device having the capability to provide light. This example illustrates that the real world description <FOREST> results in an ambient atmosphere in the ambient environment of the user that may better match the author's intent.

An ambient environment has many characteristics, but advantageously preferably just a limited number of these characteristics may need to be determined to adjust the operation of said set of devices and to achieve an ambient atmosphere that better matches the author's intention. Therefore in a further embodiment of the method the preferably a limited number of ambient characteristics of the ambient environment are determined, each ambient characteristic being determined by preferably a limited number of ambient parameters.

The set of devices is comprised in a real- world representation system. The real-world representation system is arranged to provide an ambient atmosphere in an ambient environment of the user. An example of such an environment may be a room in which the user is enjoying music or a movie or is playing a video game. The music, movie or video game may be enriched with a variety of effects created by said set of devices. As an example the movie may show a scene with a forest, and the real- world representation system may provide a green light in the room and a gentle wind. In the real- world representation system the light intensity of the green light is adjusted to the lighting characteristic of the room, which is determined by for example the brightness of the light in the room, thereby creating

the ambient atmosphere that according to the author of the real world description best fits with the forest scene.

The real-world representation system comprises a detection device to enable the system to be aware of at least one ambient characteristic of the ambient environment of the user. Such a detection device may comprise a simple sensor, such as for example a light sensor. The detection device determines an ambient parameter of an ambient characteristic. As an example the detection device determines the ambient parameter 'light' of the lighting characteristic of said ambient environment and provides a value 'bright' to the ambient parameter 'light'. The detection device may also comprise a more complex sensor such as for example a camera. This allows the detection device to determine for a plurality of ambient characteristics a number of ambient parameters such as for example 'light', a position of the user, a position of some or all of the devices, a position of light sources not controlled by the real-world representation system, etc. Said detection device comprises processing means to extract the ambient parameters from the data provided by the camera.

Thus the real- world representation system may have relatively simple as well as relatively complex detection devices. This allows a user to update his real- world representation system by changing a relatively simple and cheap detection device by a relatively complex and more expensive detection device. A user may also update his system by adding a further detection device to the system that already comprises a detection device. Thus with the same real- world description a more realistic ambient atmosphere, that is an ambient atmosphere matching better the author's intention, may be created depending on the capabilities of the detection device.

Further optional features will be apparent from the following description and accompanying claims.

Embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS In the drawings:

Fig. 1 shows an ambient environment comprising a real-world representation system,

Fig. 2 shows a schematic diagram of a real- world representation system comprising a set of devices,

Fig. 3 illustrates a method of operating a set of devices, Fig. 4 illustrates a further method of operating a set of devices.

DETAILED DESCRIPTION OF THE EMBODIMENTS In Fig. 1 an ambient environment 50 comprising a real-world representation system is shown. The set of devices includes display device 10 and effects devices 30-35. These effects devices provide perceptible effects such as audio, light, wind, heat, etc. An effects device may provide more than one effect. In the room 50 the effects devices 30-33 provide audio and light, whereas the effect devices 34, 35 shake the seats of the couch 60. The effect devices 30-33 contribute to the colour tones as well as to the luminance level of the light in the room 50. A preferably wireless network interconnects the devices. There are various examples of ambient environments, each ambient environment having its own ambient characteristics. An ambient characteristic is dependent on at least one ambient parameter such as for example temperature on a certain position in the room, dimension of the room, position of the effects devices and light sources in the room, position of the chairs in the room, etc. The room 50 may be part of a private dwelling, but could in an other example be a hotel room, or part of an entertainment complex, or could form part of a public space. Each of these ambient environments has at least one corresponding ambient characteristic. The real-world representation system creates an ambient atmosphere in said ambient environment 50 in dependence of a received real- world description. As an example the real- world representation system may be used to create a relaxing atmosphere in a busy hotel lobby. Most people experience a forest as a place having an ambient atmosphere of peace and quiet. The real- world representation system may be used to create said ambient atmosphere of the forest in the hotel lobby. The more effects devices will be used, the more realistic the ambient atmosphere of the forest is realized in the ambient environment in which the real-world representation system is located. In this example the effects devices provide the primary entertainment experience and the real-world description <FOREST> is not related to a movie scene or game play event. In Fig. 1 the real-world representation system further comprises detection devices 20-22. The detection devices provide the real- world representation system awareness on an ambient characteristic of the ambient environment 50 in which it is located. The ambient characteristic relates to a plurality of ambient parameters of the ambient environment that influence the user's experience of the created ambient atmosphere. An example of an

ambient characteristic of the room 50 is an acoustical characteristic. The acoustical characteristic is dependent on a plurality of ambient parameters such as for example the position of the couch 60 in the room 50, the distance between each effects device 30-33 and the couch 60, or the position of the user on the couch as detected by pressure sensors that are included in an other detection device 21, 22. A further example of an ambient characteristic of the room 50 is a heat transfer characteristic. The heat transfer characteristic is also dependent on a plurality of ambient parameters such as for example the position of the couch 60 in the room 50 and the position of a fan in said room. The temperature in the room 50 is a further example of an ambient parameter. Each detection device 20-22 determines at least one ambient parameter of at least one ambient characteristic, dependent on its capabilities. A simple detection device comprising only a light sensor will provide only the ambient parameter 'light' and for example a luminance value for said ambient parameter 'light', whereas a further detection device comprising a more complex light sensor will provide the ambient parameters 'light' and for example 'light colour', thereby providing the real- world representation system awareness on more ambient parameters that determine the lighting characteristic of the room 50. In a further example a detection device 21, 22 determines an ambient parameter relating to a position of the user on the couch 60, wherein the acoustical as well as the heat transfer characteristic is dependent on said ambient parameter.

In an embodiment at least one device 30 of the set of devices making up the real-world representation system is arranged to receive a real world description. The real- world description is describing the ambient atmosphere to be created by the system, and the devices are operated according to the description. The description is preferably in the form of an instruction set of a markup language. For example the real- world description reads <SUMMER>. A software engine running on a processor comprised in the at least one of the devices interprets the real-world description <SUMMER> and consequently creates a script. This script is a translation of the real- world term <SUMMER> to a lower abstraction level language that is interpreted by the effects devices 30-35 that are comprised in the system. An example of a part of a script resulting from the translation is:

<object> summer

<state light: bright> high_intensity_yellow </state> <state light: dark> low_intensity_yellow </state> <location> N </location> </object>

<input_asset>

<type> light_sensor </type> <state> light <state_pair>

<input> 100 </input> <value> bright </value> </state_pair> <state_pair> <input> 10 </input>

<value> dark </value> </state_pair> </state> </input_asset>

In response to receiving the above script an effects device 30-33 having the capability to provide light and being located at a position North will provide a yellow light, thereby contributing to the creation of the ambient atmosphere 'summer' in the ambient environment 50 in which the set of devices 10, 20-22, 30-35 is located. The yellow light provided is dependent on a value 'bright' or 'dark' of an ambient parameter 'light', in the script referred to as state, of the light ambient characteristic of the room 50.

To make the set of devices aware of the ambient characteristic of the specific ambient environment in which said set is located a detection device 20 is introduced in the system. In this example the detection device 20 comprises a light sensor. As an example the at least one device 30 receives a message {input#light#100#} from the detection device 20 comprising the light sensor. The at least one device 30 recognizes that the message originates from the detection device 20 having a capability to determine an ambient parameter 'light' of the ambient characteristic relating to lighting. Further the detection device 20 has assigned a numeric value to said ambient parameter 'light' of ' 100'. In the script is further defined how the numeric value of the ambient parameter 'light' is interpreted, that is by assigning a semantic value to said ambient parameter. An input value of the ambient parameter 'light' of ' 100' is interpreted as 'bright', meaning that in the ambient environment 50 the light is bright. The input value ' 100' may refer to ' 100 lumen' with lumen being the corresponding SI unit for light. The input value of '100' may also represent a relative value. For example

the input value of 100' may correspond to 100% on a scale of 0 to 100, and therefore an input value of '100' corresponds to 'bright' and an input value of 10 corresponds to 'dark'. The script defines that the effects devices 30-33 having the capability to provide light will provide high intensity yellow light. The script further defines that an input value of the ambient parameter 'light' of ' 10' is interpreted by said effects devices 30-33 having the capability to provide light as 'dark'.

In a further embodiment a further software engine running on the processor comprised in the at least one of the devices interprets the script to an even lower abstraction level thereby creating effects device specific messages, each effects device only receiving those messages that relate to its capability. Consequently an effects device having the capability to provide sound may not receive a message relating to the example of a real- world description <SUMMER> whereas a further effects device having the capability to provide light may receive a message to provide high intensity yellow.

A detection device 20 may have more than one sensor, giving it capabilities to determine a plurality of ambient parameters. For example the detection device 20 may also comprise a sensor for determining the sound pressure level in the ambient environment 50. As a result the detection device 20 may determine an ambient parameter of the lighting characteristic as well a further ambient parameter of the acoustical characteristic. Consequently the detection device 20 may send in addition to the message {input#light#100#} a further message {input#audio#10#}. The detection device 20 may also send yet a further message comprising yet a further ambient parameter providing information on its location in the ambient environment 50.

It is an advantage that with a script having at least one ambient parameter and with a detection device 20 providing the ambient parameter having a value the creation of an ambient atmosphere is adapted to the ambient environment 50.

There may be several detection devices included in the set of devices that determine a same ambient parameter of the ambient characteristic. As an example a further detection device comprising a camera may be included in said set of devices. The further detection device may also contribute to the determination of the lighting characteristic by determining the ambient parameter 'light' and a value for said ambient parameter. It is an advantage that a value of the ambient parameter in the script may be changed in response to a message received from a relative simple detection device comprising only a light sensor as well as by a relative complex multi sensor detection device comprising a camera.

In the script a priority rating may be introduced, that is a message comprising an ambient parameter received from the further detection device may have a highest priority resulting in a message from the detection device to be ignored.

The further detection device may also provide a value to the ambient parameter 'light' that the detection device can't provide. The further detection device may send the message {input#light#40#} and in the script said value '40' may be interpreted as 'medium bright' :

<input_asset> <type> camera </type>

<state> light

<state_pair>

<input> 40 </input> <value> medium bright </value> </state_pair>

</state> </input_asset>

In the described embodiment the real- world description describes the ambient atmosphere to be created at a high semantic value, having no ambient parameters. In a further embodiment the real- world description comprises at least one ambient parameter of an ambient characteristic and a value of said ambient parameter is adjusted in response to an ambient parameter that is determined by a detection device.

Fig. 2 shows a schematic diagram of a real- world representation system comprising a set of devices. The set of devices comprises a first detection device 20 comprising a camera, a second detection device 21 comprising a pressure sensor located in a chair 61, and a third detection device 22, located in an other chair 62 and also comprising a pressure sensor. The set of devices further comprises several effects devices: so called body shakers 34, 35 located in the chairs 61, 62, and audio and light devices 30, 31, 32, 33. The set of devices further comprises a display device 10 and a personal computer 11. The personal computer is configured to operate the effects devices 30-35 and the display device 10 and is further configured to receive messages from the detection devices 20-22. The personal computer 11 receives data from a record carrier such as for example a DVD 36 comprising a movie or video game. The personal computer 11 further receives a script corresponding to

that movie or video game from a further record carrier 37. Also the movie or video game and its corresponding script may be provided on the same record carrier 36, or each of the movie, the video game or their corresponding script may be downloaded in the personal computer 11 using the Internet. In response to the execution of the script the effects devices 30-35 will create an ambient atmosphere that corresponds to scenes of the movie or game play events shown at the display device 10. The pressure sensors comprised in the second and third detection device 21, 22 determine an ambient parameter of an ambient characteristic and make the system aware whether there are one or two users in the ambient environment. The camera comprised in the first detection device 20 also determines at least one ambient characteristic by interpreting audio visual data and providing at least one ambient parameter such as for example light, sound and position in response to said interpretation. As a result of the determined ambient characteristic the operation of the set of devices resulting from the execution of the script is adjusted.

Fig. 3 illustrates a method of operating a set of devices. Said method comprises the steps of receiving 100 a real- world description describing an ambient atmosphere to be created in an ambient environment 50 in which the set of devices is located, interpreting 110 said real- world description, operating 120 said set of devices according to the description, - determining 130 an ambient characteristic of said ambient environment, adjusting 140 the operation of said set of devices in response to said determined ambient characteristic.

In an embodiment of the method the step of determining 130 the ambient characteristic is performed only once. In this embodiment the step of determining 130 the ambient characteristic may for example be used to calibrate the system. After performing said step the system is aware of the ambient characteristic of the ambient environment in which the system is located. For example the system is aware of the position of the effects devices and the chairs, the lighting level, the temperature in the room, etc. In response to the determined ambient characteristic the interpreting of the real- world description results in an adjustment 140 of the operation of the set of devices.

In an other embodiment of the method the step of determining 130 the ambient characteristic is performed regularly, thereby enabling the execution of the script to anticipate on changes in the ambient characteristic of the ambient environment. For example the lighting characteristic in the ambient environment may change. In Fig. 1 a room 50 with a

window 40 is shown. In the room the set of devices 10, 20-22, 30-35 creates an ambient atmosphere corresponding to a real- world description. During the step of operating 120 the set of devices the lighting characteristic in the room changes as a result of sunlight 70 that is entering the room 50 through a window 40, resulting in a change of the value of the ambient parameter 'light' of the lighting characteristic. In the other embodiment of the method the operation of the set of devices is adjusted 140 in response to the changed lighting characteristic.

Fig. 4 also illustrates the method of operating a set of devices, albeit a further embodiment of said method. In this embodiment the step of determining 130 the ambient characteristic such as for example the acoustical characteristic is performed in response to the operation of the set of devices, thereby anticipating on the realized effects provided by the effects devices. The set of devices may for example comprise a detection device. The detection device may comprise a microphone and be arranged to determine an ambient parameter sound. With said detection device the realized sound pressure level resulting from audio provided by an effects device comprising an audio amplifier and a speaker may be determined. The acoustical characteristic may be further dependent on the volume of the room, a length / width aspect ratio of the room and the position of the effects device providing audio. With the method a volume setting of the audio amplifier comprised in the effects device is adjusted 140 in response to said determined acoustical characteristic. In an other example the set of devices may comprise a detection device that is preferably located close to the user and is arranged to determine an ambient parameter 'temperature in the vicinity of the user'. With said detection device the heat transfer characteristic of the room may be determined by measuring the realized temperature resulting from an effects device comprising a heater. With the method the provided heat of the effects device is adjusted 140 in response to the determined heat transfer characteristic.

A detection device for use in a real-world representation system comprises at least one sensor such as for example a temperature sensor, an infrared sensor, a pressure sensor, a light sensor, a humidity sensor, a microphone, etc. The detection device further comprises processing means that are coupled to the sensor and arranged for processing a signal originating from the sensor. The detection device further comprises communication means arranged to communicate a message comprising an ambient parameter and its value to at least one device comprised in the set of devices, the at least one device being arranged to receive the real-world description. The detection device is configured to determine at least one ambient parameter and its corresponding value of said ambient characteristic.

The detection device may be a separate device, but the detection device may also be included in an other device that is included in the real-world representation system, such as for example an effects device.