Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHOD FOR REPRESENTING AN ENVIRONMENTAL REGION OF A MOTOR VEHICLE WITH AN IMAGE WINDOW IN AN IMAGE, COMPUTER PROGRAM PRODUCT AS WELL AS DISPLAY SYSTEM
Document Type and Number:
WIPO Patent Application WO/2019/149499
Kind Code:
A1
Abstract:
The invention relates to a method for representing an environmental region (13) of a motor vehicle (1) in an image (19), in which real images of the environmental region (13) are captured by a plurality of real cameras (5, 6, 7, 8) of the motor vehicle (1) and the image (19) is generated from these real images, which at least partially represents the environmental region (13), wherein the image (19) is represented from a perspective of a virtual camera (14)virtually arranged, wherein at least one image window (17, 26, 27) is represented in the image (19), wherein only a partial area of the environmental region (13) is represented in the image window (17, 26, 27), and this partial area is represented in a second perspective, which is different from the first perspective of the virtual camera (14). The invention also relates to a computer program product and a display system (2) for a motor vehicle (1).

Inventors:
GUO HUANQING (IE)
O'MALLEY FERGAL (IE)
RUHL FELIX (DE)
BAUER GUENTER (DE)
Application Number:
PCT/EP2019/050589
Publication Date:
August 08, 2019
Filing Date:
January 10, 2019
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
CONNAUGHT ELECTRONICS LTD (IE)
BAYERISCHE MOTOREN WERKE AG (DE)
International Classes:
B60R1/00; H04N7/18
Foreign References:
US20120069187A12012-03-22
DE102015105529A12016-10-13
EP1115250A12001-07-11
EP2234399A12010-09-29
US20160182823A12016-06-23
US20080246843A12008-10-09
US20140055487A12014-02-27
DE102015105529A12016-10-13
DE102013013364A12014-03-06
US20110032357A12011-02-10
Attorney, Agent or Firm:
HOFSTETTER SCHURACK & PARTNER (DE)
Download PDF:
Claims:
Claims

1. Method for representing an environmental region (13) of a motor vehicle (1 ) in an image (19), in which real images of the environmental region (13) are captured by a plurality of real cameras (5, 6, 7, 8) of the motor vehicle (1 ) and the image (19) is generated from these real images, which at least partially represents the

environmental region (13), wherein the image (19) is represented from a perspective of a virtual camera (14) virtually arranged

characterized in that

at least one image window (17, 26, 27) is represented in the image (19), wherein only a partial area of the environmental region (13) is represented in the image window (17, 26, 27), and this partial area is represented in a second perspective, which is different from the first perspective of the virtual camera (14), wherein the image (19) is generated as a bowl shape and the motor vehicle (1 ) is represented on the bottom (30) of the bowl shape, and

the image window (17, 26, 27) is represented in a curved wall area (18) of the bowl shape and the curvature of the image window (17, 26, 27) is adapted to the curvature of the wall area (18).

2. Method according to claim 1 ,

characterized in that

the second perspective is set such that the environmental region located on the side of the motor vehicle (1 ) and/or the environmental region (13) located behind the motor vehicle (1 ) are represented in the image window (17, 26, 27) as the partial area of the environmental region (13).

3. Method according to claim 1 or 2,

characterized in that

the image window (17, 26, 27) is generated as a reflected image of a mirror.

4. Method according to claim 3,

characterized in that

the reflected image of a mirror is generated as a virtual mirror image.

5. Method according to claim 4,

characterized in that

the virtual mirror image is generated from real images of multiple of the real cameras (5, 6, 7, 8) and the second perspective is determined as a perspective of a second virtual camera (16, 29) or the virtual mirror image is determined by a ray tracing method.

6. Method according to claim 3,

characterized in that

a real image of one of the real cameras (5, 6, 7, 8) is represented as the mirror image.

7. Method according to any one of the preceding claims 3 to 6,

characterized in that

the motor vehicle (1 ) is at least partially represented in the mirror image.

8. Method according to any one of the preceding claims,

characterized in that

a size of the image window (17, 26, 27) and/or a shape of the image window (17, 26, 27) and/or a frame of the image window (17, 26, 27) and/or a magnification factor of the partial area of the environmental region (13) represented in the image window (17, 26, 27) are generated or changed depending on the first perspective and/or on a change of the first perspective and/or on an orientation of the motor vehicle (1 ) and/or on a movement of the motor vehicle (1 ) and/or on a direction of movement of the motor vehicle (1 ) and/or on the number of image windows (17, 26, 27) and/or on a position of a further image window (17, 26, 27) in the image (19) and/or on the curvature of a bowl shape of the image (19).

9. Method according to any one of the preceding claims,

characterized in that

a position of the image window (17, 26, 27) in the image (19) is changed depending on a change of the first perspective and/or on a change of an orientation of the motor vehicle (1 ) and/or on a change of a movement of the motor vehicle (1 ) and/or on a change of a direction of movement of the motor vehicle (1 ) and/or on a change of a number of image windows (17, 26, 27) and/or on a change of a position of a further image window (17, 26, 27) in the image (19) and/or on the change of a curvature of the bowl shape of the image (19).

10. Method according to any one of the preceding claims,

characterized in that

the second perspective is determined depending on the first perspective and/or the orientation of the motor vehicle (1 ) and/or a direction of movement of the motor vehicle (1 ).

1 1. Computer program product for executing a method according to any one of the preceding claims when the computer program product is executed on a

programmable computer device.

12. Display system (2) for a motor vehicle (1 ), with an evaluation unit (3), a display unit (4) and a plurality of real cameras (5, 6, 7, 8), which is formed to execute a method according to any one of claims 1 to 10.

Description:
Method for representing an environmental region of a motor vehicle with an image window in an image, computer program product as well as display system

The invention relates to a method for representing an environmental region of a motor vehicle, in which this environmental region is represented in an image. Real images of the environmental region are captured by a plurality of real cameras. The image is generated from these real images, which at least partially represents the environmental region. The image is represented from a perspective of a virtual camera. Furthermore, the invention also relates to a computer program product as well as to a display system for a motor vehicle.

From the prior art, for example DE 10 2015 105 529 A1 , a method is known, in which multiple real images are captured by multiple real cameras arranged at the motor vehicle and a common overall image is generated from these images, which can be displayed on a display unit of the motor vehicle. The overall image is there formed in a bowl shape from these real images. This means that the image is shown in a "distorted" representation and thus is virtually represented in a certain curved shape, which then results in the bowl shape. This is effected such that the environmental region around the vehicle is completely displayed. This means that the representation of the image is such that a representation of the environmental region is effected around the vehicle in closed manner and without interruption. By the representation of the image in this curved view and thus in the bowl shape, a larger area with larger distance to the motor vehicle can be represented, in particular compared to a plane representation.

As is also known from the prior art, a virtual camera can be disposed in various positions in this generated overall image, such that a three-dimensional perspective from different viewing directions can also be represented. However, this can result in situations, in which a perspective also disturbing for the vehicle driver with regard to the driving maneuver of the motor vehicle is shown. For example, this can be the case if the virtual camera is disposed in a position such that it looks to the motor vehicle from the front and the motor vehicle moves in forward direction in reality on the other hand. Optionally, this can result in impairments of the driver, in particular the intuitive perception of the information is thereby impaired for a driver. Furthermore, methods for transforming an image are known, in which an environmental region of a motor vehicle is at least partially represented by the image from the perspec- tive of a virtual camera virtually arranged in the environmental region, are known from the prior art.

Thus, in DE 10 2013 013 364 A1 , a method for low-distortion imaging environmental im- age data is provided, which is generated by a plurality of cameras, which are arranged at a motor vehicle.

Furthermore, an image processing device is described in US 201 1/0032357 A1 , by which an image of an environmental region of a motor vehicle is captured. The captured image is converted to an image, which is viewed from the perspective of a virtual line of sight.

The virtual line of sight extends from a predetermined position in the environmental region into a predetermined direction.

Furthermore, it is known that an image is provided by a virtual camera. Then, the virtual camera can usually be arbitrarily arranged around a motor vehicle in fictive manner. The image is provided by transforming real images. The real images are usually provided by a plurality of real cameras of the motor vehicle. By the plurality of the real cameras, an envi- ronmental region of the motor vehicle is usually completely captured. The real images can be selected and transformed by the virtual camera such that the image is provided from the perspective of the virtual camera. Thus, the virtual camera in the environmental region of the motor vehicle is not really existing, but describes the transformation and selection of the real images such that the desired perspective of the virtual camera is shown by the image. Usually, the provision of the image is determined by a transformation, which in- cludes a translation and multiple rotations. Thus, each of the real images is for example transformed from a camera coordinate system of the respective real camera into a motor vehicle coordinate system, and the position of the virtual camera can finally be set in the motor vehicle coordinate system.

It is the object of the present invention to provide a method, in which the representation of information of an environmental region of the motor vehicle is represented more extensively and more simply comprehensibly for a user. Similarly, it is the object to provide a computer program product as well as a display system for a motor vehicle. An aspect of the invention relates to a method for representing an environmental region of a motor vehicle, wherein the representation is effected in an image. In the method, capturing multiple real images of the environmental region is performed by a plurality of real cameras of the motor vehicle. The image, which can then also be referred to as an overall image, is then generated from these real images. Therefore, this then common image is generated from a plurality of real images. The environmental region is at least partially represented in this image. The image is represented from a perspective of a virtual camera. At least one image window or an image section is represented in this image. A partial area of the environmental region is represented in this image window, wherein this partial area is represented in a second perspective, which is different from the first perspective of the virtual camera. Thus, the possibility is provided in the image that at least two different perspectives are shown and thus information is shown to a user in an image from two different perspectives at the same time. Since the image window is displayed with the representation of the image and thus is displayed at the same time, a driver obtains information from the environmental region from various perspectives and thus with different viewing directions at the same time. Since the image window is smaller in size than this overall image, the image window is represented in a partial area of the surface area of the image. In particular, the image window is represented completely within the surface of the image. The information content represented with the first perspective is maintained unrestricted and can also be further perceived by a vehicle user in unrestricted manner.

The virtual camera could be virtually positioned in the environmental region. The virtual camera is then virtually arranged outside the motor vehicle. The virtual camera could be positioned virtually in the inner and therefore in the passenger area of the motor vehicle, too.

The information representation over the environmental region of the motor vehicle is considerably improved by this method and the intuitive perceptibility for a user is also improved. In particular, representations can be effected by the at least one image window, which are not visible or cannot be extensively represented by the first perspective depending on the orientation of the motor vehicle and/or depending on a driving maneuver of the motor vehicle. In particular, representations can then be effected in the image window by such a configuration, which are additionally helpful for the vehicle user and are helpful for the comprehension of the environmental region. Situations, in which the vehicle driver perceives the environmental region only from one perspective and which thus would optionally be mistakable or would be restrictive for the intuitive perceptibility and the secure comprehension with regard to his current driving maneuver and/or the orientation of the motor vehicle, can thereby at least considerably reduced.

Preferably, the image with the image window is displayed on a display unit of the motor vehicle. This display unit can be fixedly installed in the motor vehicle, but can for example also be a mobile display unit, which can be non-destructively detachably removed from the motor vehicle and again be inserted. For example, it can be a portable display or a portable screen. This screen can for example also be a component of a portable functional unit, which also comprises at least one further function in addition to the representation of images. For example, such a functional unit can be a portable communication terminal like a tablet computer or a mobile radio terminal.

In an advantageous implementation, the second perspective is set such that the environmental region located on the side the motor vehicle and/or the environmental region located behind the motor vehicle is represented in the image window as a partial area of the environmental region. In particular, this is provided if the first perspective is oriented in forward direction of the motor vehicle. Since especially in situations, in which the visibility of the driver is laterally and rearwards restricted, for example due to the orientation of the motor vehicle and/or due to the driving maneuver of the motor vehicle performed or planned in the future, this configuration is preferred. Thus, this can for example be advantageous if the motor vehicle performs a parking operation, in which reversing is at least temporarily performed. Because, if for example the first perspective is then not rearwards directed, but oriented such that the lateral and/or rear area of the motor vehicle is not or not sufficiently represented, thus, this lateral and/or rear area of the motor vehicle can then be represented in the image window with the second perspective especially by this advantageous implementation. Especially in such reversing, in which the own sight of the vehicle driver and thus the anyway independent perception to the side and to the rear can be restricted, this implementation is particularly advantageous.

In a particularly advantageous implementation, it is provided that the image window is generated as a reflected image of a mirror. Thus, the second perspective is represented such that it shows a viewing direction, which represents a partial area of this environmental region, which cannot be seen by the driver and/or is oriented opposite to the current and/or future direction of travel of the motor vehicle. Especially such a mirror image has the above mentioned advantages to particular extent. Especially in reversing, a particularly intuitive image representation then also very comprehensible for the driver is therefore allowed in the image window for a vehicle driver. In particular, in this context, also in the manner of a rearward looking mirror, which can for example be given by a real mirror or a real wing mirror of the motor vehicle, a corresponding image representation is virtually shown in the image window. In an advantageous implementation, thus, a representation can be effected in the image window, which is particularly easily comprehensible for the vehicle driver. This is in particular with regard to the then specific orientation of the motor vehicle and/or with regard to the specific direction of travel of the motor vehicle. The vehicle driver then has the impression in such a configuration that he practically looks in forward direction of travel of the vehicle due to the first perspective and also correspondingly sees such a viewing direction and thus perspective on the image and recognizes a corresponding representation, on the other hand perceives a lateral and/or rearward directed representation in the image window. Therefore, he also has the possibility that he sees a pictorial representation of a partial area of the environmental region on the side of the vehicle and/or on the rear side of the vehicle despite of the viewing direction to the front.

In an advantageous implementation, the image of a mirror is generated as a virtual mirror image. In such a configuration, this virtual image window is then advantageously created in the overall image preferably from real images of the virtual camera. In such a configuration, the second perspective is then preferably determined as a perspective of a second virtual camera. It can also be provided that the virtual mirror image is determined by a ray tracing method. Depending on individual situations, thus, the representation in an image window can be very individually generated. In this context, individual and diverse positionings of the further virtual camera in the environmental region can then also be performed. The representation of information in the image window is therefore very diverse and variable. This also very advantageously contributes to the flexible information representation in the image window.

In an alternative implementation, it can be provided that a real image of only one of the real cameras is represented as the mirror image. In such a configuration, the computing effort is then reduced since a virtual image does not have to be generated for representation in the image window, which is generated from multiple individual real images.

Preferably, it is provided that the motor vehicle is at least partially represented in the mirror image. Thereby, the consistency of the information is even more comprehensible for a driver in particular with respect to the own motor vehicle.

In particular, it can be provided that the representation of the motor vehicle in this mirror image is represented in a non-mirrored, but actual orientation.

In a further, particularly advantageous implementation, it is provided that the image and thus the overall image is generated as a bowl shape and thus with a curved image plane and the motor vehicle is represented on a bottom of the bowl shape. The representation of the overall image by such a bowl shape was already initially explained. In particular, the image is represented such that the environmental region is represented completely extending around the motor vehicle and without interruption.

Preferably, the image window is represented in a curved wall area of the bowl shape. In particular, the image window is also curved represented. This means that the image window is also represented in the form of a curved wall area of the bowl shape.

Preferably, the image window is represented with a curvature, which corresponds to the curvature of the wall area of the bowl shape, in which the image window is represented.

By such a configuration, the image window is displayed virtually embedded in this image. Therein, advantages with respect to the perceptibility and the comprehension of the information represented on the remaining surface area of the image to the information represented in the image window arise in specific representation situations.

The curvature of the image window can be adapted to the scenario, by which the representation is effected or in which direction and in which position it is located to the motor vehicle. Thus, it can for example be provided that if the image window is effected in a positioning in the image on the left side of the motor vehicle, the second perspective is a mirror image of the left-side lateral and/or left-side rear-side partial area of the

environmental region. In particular, the curvature of the image window can be as if the view would be effected in such a lateral and/or rear wall area of the bowl shape of the overall image such that the curvature of the image representation in the image window is different from the curvature of that wall area of the overall image, in which the image window is actually represented. However, a relevant identical curvature can also be present as it was already above mentioned.

In an alternative implementation, it can be provided that the image window is displayed as a non-curved and thus non-distorted representation and thus is displayed virtually as a non-curved plane in the image. Then, this is in particular a non-curved mirror image. In such a configuration, it can be provided that the image window is virtually represented as a plane placed in the bowl shape of the overall image such that the image window can also be recognized as an in particular three-dimensional object in the image in such a configuration in this respect. Depending on the second perspective and/or the information content to be individually represented, the curved representation of the image window, in particular embedded in the wall area of the bowl shape of the overall image, can be advantageous in specific situations or this plane image window can be advantageous. Thus, scenarios can also occur, in which non-distorted or non-curved representations of image information in the image window are advantageous, in particular with respect to the perception for the observer of the display unit.

In an advantageous implementation, a size of the image window and/or a shape of the image window and/or a frame of the image window and/or a magnification factor of the partial area represented in the image window are generated or changed depending on the first perspective and/or depending on a change of the first perspective and/or depending on an, in particular current and/or future, orientation of the motor vehicle and/or depending on an in particular current and/or future movement of the motor vehicle and/or depending on an in particular current and/or future direction of movement of the motor vehicle and/or depending on the number of image windows and/or depending on a position of a further image window in the image and/or on the in particular current or future curvature of a bowl shape of the image. By such a configuration, a particularly variable and flexible generation and/or change of the image window in the image is allowed such that it can be very adequately responded to representation scenarios and a corresponding adaptation can always be effected, in particular also in dynamic manner. Thereby, the display scenario is again improved for an observer and the perceptibility of very diverse information is very adequately allowed such that this information is also comprehensible in improved manner for a user and can be easily comprehended. In an advantageous implementation, it is provided that a position of the image window in the image is changed depending on a change of the first perspective and/or depending on an in particular current and/or future change of an orientation of the motor vehicle and/or depending on an in particular current and/or future change of a movement of the motor vehicle and/or depending on an in particular current and/or future change of a direction of movement of the motor vehicle and/or depending on a change of a number of image windows and/or depending on a change of a position of a further image window in the image and/or depending on the in particular current and/or future change of a curvature of a bowl shape of the image. Thus, diverse and variable configurations with respect to the position of the image window can be effected here too. Thereby too, an advantage can be achieved in very adequate manner and in particular with regard to the simple, fast and intuitive perceptibility of the information presentation by a user. The above mentioned configurations with regard to the change of a position of the image can be effected in discrete time intervals or in continuous manner. Thus, it can also be fast responded to changing environmental scenarios and/or changing positions and/or changing movements of the motor vehicle in the environmental region. Thus, a then best possible and adapted representation of the environmental region from at least two different perspectives can be effected in the image respectively in adequate manner and immediately adapted to the new conditions.

Besides the above mentioned parameters, parameters characterizing the motor vehicle and/or parameters characterizing the state of movement of the motor vehicle can also be taken into account in addition or instead. For example, a steering angle or a forward drive or a rearward drive or the speed or a parameter characterizing a specific driving maneuver such as for example recognition of a parking operation can be taken into account.

Preferably, the second perspective is determined depending on the first perspective. By such an implementation, in which the perspectives are linked or coupled to each other, the particularly advantageous information presentation can also be effected by a user in individual representation scenarios. In addition or instead, the second perspective can also be determined depending on the current and/or future orientation of the motor vehicle and/or depending on a current and/or future direction of movement of the motor vehicle. With regard to the above mentioned influencing factors, which relate to future scenarios, this can for example be recognized based on the operating states of the motor vehicle or these future aspects can be inferred. For example, if a parking operation is performed and for example in particular a vehicle driver has started himself the search for a parking space and/or the beginning of parking into or leaving a parking space, but the actual movement of the motor vehicle has not yet occurred, thus, it can here be inferred due to this information that the motor vehicle travels the specific trajectory, which can then in particular also already be known, soon or in the future. From this information, it can then again be inferred that the vehicle will for example reverse over a certain distance.

Therefrom or instead of it, it can again be inferred that the motor vehicle will set a specific steering angle and/or a specific change of the steering angle will occur in the future. The same can be effected based on further parameters such as for example the speed or an actuation of a brake etc. With respect to the indications for future parameters or influencing factors, the above mentioned explanations are therefore only to be exemplarily understood.

It is in particular essential that the image or the overall image is not only formed by a real image of a real camera and thus also on a display unit the real image of only one camera and optionally overlaid or without overlap the again individual real image of a further real camera is displayed besides. But that the image or the overall image is generated from a plurality of real images of a plurality of real cameras as a virtually single common overall image and an individual image window recognizable as such is then additionally represented in this image, in particular is represented overlaid. The image window is therefore not displayed besides the overall image and in particular without overlap with the overall image, but represented within the surface of the overall image, in particular represented completely within this overall image.

Besides the above mentioned advantageous implementations that the size and/or the position of the image window in the image can for example change, a magnification factor and thus a zoom factor can also be changed in the image window. This can also be effected based on the above mentioned exemplary and non-conclusive parameters and/or influencing factors. Moreover, the brightness and/or the contrast of these image windows could also individually change depending on the mentioned parameters and/or influencing factors. Furthermore, it can be advantageous that if critical situations are represented in the image window, for example a distance to an object to the environmental region of the motor vehicle is changed, is in particular reduced such that for example a collision could occur, a corresponding warning symbol is displayed in the image window. In addition or instead, it can be provided that the image window experiences a color change in this respect or flashing of the image window in the image occurs. Similarly, it could be provided in addition or instead that a bounding border of the image window correspondingly presents itself. This means that a corresponding frame could overlay, which has an individual coloration, for example red or yellow. In this respect, such a frame could then also dynamically flash. The frequency of flashing and/or the color change and/or the brightness of this warning indication could become greater with increasing probability of a critical state.

It can be provided that the representation of the image window in the image or in the overall image can be activated and deactivated. This can be effected manually by a user. However, it can also be provided that this activation or deactivation of this image window is effected depending on environmental situations and/or driving situations of the motor vehicle. It can also be provided that at least two image windows are represented as separate image windows displayed without overlap in the image in an advantageous implementation. In this context, a partial area of the environmental region can be represented in a second perspective and a further partial area, in particular different thereto, can be represented in a third perspective different from the first and the second perspective in the second image window. Similarly, it is also possible that at least three separate image windows, which are represented without overlap in the image, are displayed. Thus, in this context, it is then also possible that in particular three separate mirror images, which thus are reflected images, are displayed. Thus, in an image window, which is displayed in the image in front of and on the right side of the motor vehicle, the lateral partial area located to the right of a motor vehicle and/or a rear area of the motor vehicle could be displayed as a mirror image. In a further image window displayed in the image on the left side of the motor vehicle and in front of the motor vehicle, the left-side partial area of the environmental region and/or a partial area of the environmental region located behind the motor vehicle could be displayed. In an third image window located centrally in the image in front of the motor vehicle, a mirror image of the partial area of the environmental region located in front of the motor vehicle or the partial area of the environmental region located behind the motor vehicle could be displayed. Preferably, the position and/or orientation of the image window in the image are selected depending on the second perspective to be displayed with the image window and a corresponding display of the image window is performed in the image. The intuitive comprehension of the information displayed on the image window is thereby again improved.

A further aspect relates to a computer program product for executing a method according to the above mentioned aspect or an advantageous implementation thereof when the computer program product is executed on a programmable computer device.

Moreover, a further aspect of the invention relates to a display system for a motor vehicle. The display system comprises at least one evaluation unit and a display unit and moreover comprises a plurality of real cameras. The display system is formed to execute a method according to the above mentioned aspect or an advantageous configuration thereof.

Furthermore, an aspect of the invention relates to a motor vehicle with such a display system.

The preferred embodiments presented with respect to the method and the advantages thereof correspondingly apply to the computer program product, the display system as well as to the motor vehicle.

With the indications of "top", "bottom", "front", "rear", "horizontal", "vertical", "depth direc- tion", "width direction", "height direction" etc., the positions and orientations given with in- tended use and intended arrangement of the virtual camera or the real camera or the mo- tor vehicle are specified.

Further features of the invention are apparent from the claims, the figures and the description of figures. The features and feature combinations mentioned above in the description as well as the features and feature combinations mentioned below in the description of figures and/or shown in the figures alone are usable not only in the respectively specified combination, but also in other combinations without departing from the scope of the invention. Thus, implementations are also to be considered as encompassed and disclosed by the invention, which are not explicitly shown in the figures and explained, but arise from and can be generated by separated feature combinations from the explained implementations. Implementations and feature combinations are also to be considered as disclosed, which thus do not comprise all of the features of an originally formulated independent claim. Moreover, implementations and feature combinations are to be considered as disclosed, in particular by the implementations set out above, which extend beyond or deviate from the feature combinations set out in the relations of the claims.

Below, embodiments of the invention are explained in more detail based on schematic drawings.

There show:

Fig. 1 a schematic top view to an embodiment of a motor vehicle with an

embodiment of a display system;

Fig. 2 a schematic representation of a virtual arrangement of a virtual camera in an environmental region of the motor vehicle with a symbolical

representation of an image window;

Fig. 3 a schematic representation of a virtual arrangement of a virtual camera in an environmental region of the motor vehicle with a further symbolical representation of an image window;

Fig. 4 a schematic representation of an image with two image windows as it can be represented on a display unit;

Fig. 5 a further schematic representation of an image with three image windows as it can be represented on a display unit,

Fig. 6 a further schematic representation of an image with two image windows as it can be represented on a display unit during a parking procedure of a motor vehicle; and Fig. 7 a further schematic representation of an image with two image windows as it can be represented on a display unit during a further parking procedure of a motor vehicle.

In the figures, identical or functionally identical elements are provided with the same reference characters.

In Fig. 1 , a top view to a motor vehicle 1 with a display system 2 according to an embodi- ment of the invention is schematically illustrated. In the embodiment, the display system 2 comprises an evaluation unit 3 and a display unit 4. Furthermore, the display system 2 comprises a first real camera 5, a second real camera 6, a third real camera 7 and a fourth real camera 8 in the embodiment. According to the embodiment, the first real cam- era 5 is disposed at a front 9 of the motor vehicle 1 , the second real camera 6 is disposed on a right side 10 of the motor vehicle 1 , the third real camera 7 is disposed at a rear 11 of the motor vehicle 1 and the fourth real camera 8 is disposed on a left side 12 of the motor vehicle 1. However, the arrangement of the real cameras 5, 6, 7, 8 is diversely possible, however, preferably such that the motor vehicle 1 and/or an environmental region 13 of the motor vehicle 1 can be at least partially captured.

In particular, the real cameras 5, 6, 7, 8 have a wide capturing range, which can for ex- ample be greater than 180°. The wide capturing range can each for example be provided by a fish eye lens of an objective of the real camera 5, 6, 7, 8. Thus, the display system 2 can for example be formed as an environmental vision system (CMS - camera monitoring system) or electronic rearview mirror or be formed as a further driver assistance system of the motor vehicle, in which the environmental region 13 is at least partially captured.

The real cameras 5, 6, 7, 8 can be CMOS (complementary metal-oxide semi-conductor) cameras or CCD (charge coupled device) cameras or also other image capturing devices, which can provide a frame of the environmental region 13 and/or the motor vehicle 1. The real cameras 5, 6, 7, 8 are in particular video cameras, which continuously provide an im- age sequence of frames. Then, the evaluation unit 3 processes the image sequence of the frames for example in real time. The evaluation unit 3 can for example be disposed within the respective real camera 5, 6, 7, 8 or within the display unit 4. However, the eval- uation unit 3 can also be disposed outside of the respective camera 5, 6, 7, 8 or the dis play unit 4 in any other position within the motor vehicle 1 and thus be formed as a unit separate from the real camera 5, 6, 7, 8 and from the display unit 4. For example, the display unit 4 can be formed as a liquid crystal display (LCD). The dis play unit 4 can be diversely disposed in the motor vehicle 1 , however, preferably such that a user of the motor vehicle 1 can direct an unobstructed look to the display unit 4.

A plurality of real images is captured by the real cameras 5, 6, 7, 8. The real images show the environmental region 13 at least partially from the perspective of the respective real camera 5, 6, 7, 8. Preferably, the real images are captured at least partially overlapping.

Fig. 2 shows a virtual arrangement of a virtual camera 14 in the environmental region 13 of the motor vehicle 1. The virtual camera 14 can be diversely disposed in the environ- mental region 13. Preferably, the virtual camera 14 is disposed in preset virtual camera positions 15, in particular of the bowl shape of the image, wherein the motor vehicle 1 is displayed on a bottom 30 of the bowl shape. Depending on the respective virtual camera position 15 of the virtual camera 14 and the orientation thereof, the perspective of the vir tual camera 14 to the environmental region 13 and/or the motor vehicle 1 is determined. The perspective of the virtual camera 14 can for example be adapted in real time and within a predetermined computing time, respectively.

In Fig. 2, it is also apparent that the virtual camera 14 here has the camera position 15 in the embodiment, which looks from obliquely behind to the front such that a first perspec- tive is here present, which has this viewing direction or this orientation. Here, it is again to be mentioned that this representation is only exemplary and very diverse other camera positions 15 of the virtual camera 14 are possible.

In the implementation shown in Fig. 2, a partial area of the environmental region 13, which is located on the left side of the motor vehicle 1 , is only partially visible or not visible at all by the virtual camera 14. In particular, in order to also be able to represent this partial area on the left side of the motor vehicle 1 in the exemplary representation in Fig. 2, it is pro- vided in the shown implementation that a further virtual camera 16 is for example virtually arranged in a camera position 15, which is different from the camera position 15 of the first virtual camera 14. The further virtual camera 16 is oriented such that the environmen- tal region 13 is shown in a second perspective, which is different from the first perspective of the first virtual camera 14. In the shown example, this is the second perspective of the second virtual camera 16 in the left-side area of the motor vehicle 1 and with viewing di- rection to the rear and thus here substantially directed in opposite direction to the orienta- tion of the motor vehicle 1. Here too, the second virtual camera 16 can also be arranged in a camera position differ- ent from Fig. 2, but wherein the second perspective is always different from the first per- spective.

In such a configuration, an image is represented on the display unit 4, which is generated from multiple real images of multiple real cameras 5, 6, 7 and 8, namely as a uniformly en- tire image or as an overall image. In this overall image, a smaller image window is repre- sented within the surface area of this image. In this image, which is shown from the per- spective of the first virtual camera 14, thus, a smaller image window 17 is represented, which represents the second perspective and thus the perspective of the here preferably shown second virtual camera 16. Thus, the image information is displayed at the same time on the display unit 14, in which a smaller image window 17 with the second perspec- tive is displayed at the same time in the image with the first perspective.

In Fig. 2, the image window 17 is only symbolically represented for better comprehension, since only the bowl shape of the image with the position of the motor vehicle 1 in this im- age is basically shown in Fig. 2 and moreover exemplary camera positions 15 for the vir tual cameras 14 and 16 are represented.

However, in Fig. 2, an example of this image window 17 is already indicated, which is rep- resented in a wall area 18 of the bowl shape. The relevant curvature or distortion of the image window 17 is also symbolically shown in Fig. 2, which is given by the curvature or distortion of the wall area 18. A curvature of the image window 17 different from the curva- ture of the wall area 18 can also be provided.

In particular, the image window 17 is formed as a mirror such that the representation of the partial area of the environmental region 13 represented in the image window 17 is rep- resented as a reflected image of a mirror. In the implementation shown here, thus, a mir- ror image is generated, which would be formed by a mirror, which would be arranged in the camera position 15, here the further virtual camera 16.

In the representation in Fig. 2, this image window 17 is represented as an area embedded in the bowl shape of the image.

In Fig. 3, a further embodiment is shown, in which the image window 17 is not represent- ed as a curved image area, but as a plane image area. Here too, a mirror image is prefer- ably formed, wherein this mirror image is virtually realized as a flat mirror in this represen- tation in Fig. 3.

In particular, it is provided that the representation of the image can be two-dimensional or three-dimensional.

In Fig. 4, an image 19 is shown in an exemplary representation, as it can be displayed on the display unit 4. The image 19 is generated from a plurality of real images of the real cameras 5, 6, 7 and 8. In the representation in Fig. 4, the virtual camera 14, which repre- sents the first perspective, is in particular arranged in the camera position 15a, as it is ex- emplarily shown in Fig. 2 and Fig. 3. In Fig. 4, a parking area 20 formed as a parking zone is shown in the environmental region 13. Adjacent to this parking area 20, further parking areas 21 and 22 are shown, in which motor vehicles 23 and 24 are placed. The motor ve- hicle 1 is to be parked into the parking zone or the parking area 20 in a parking operation. As is apparent in Fig. 4, the motor vehicle 1 with its vehicle longitudinal axis A is oriented obliquely to the orientation of the longitudinal parking space, which the parking area 20 represents. In the representation in Fig. 4, the parking operation is already started and the motor vehicle 1 parks into the parking area 20 by reversing. A perspective is generated by the camera position 15a, in which the left-side area of the motor vehicle 1 can be com- pletely and best possible seen. The partial area of the environmental region 13 formed to the right of the motor vehicle 1 (with a view in the direction of the vehicle longitudinal axis A) cannot or can only be partially seen. In the embodiment shown here, it is preferably provided that an image window 17 is generated as a mirror image in the image 19, which represents a mirror image, in which the partial area of the environmental region 13 located to the right of the motor vehicle 1 is displayed. Preferably, a partial area behind the motor vehicle 1 is also displayed by this mirror image in the image window 17. By the position of the image window 17 in the image 19 on the right side of the motor vehicle 1 , the partial area of the environmental region 13 on the side of the motor vehicle 1 is preferably shown in the mirror image in the image window 17, which is located over the entire length of this right side of the motor vehicle 1. In such an image window 17, therefore, a more extensive mirror image representation is shown than if the driver would look into a wing mirror 25 disposed on the right outer side. However, it can also be provided that the image window 17 shows a mirror image, which corresponds or substantially corresponds to a virtual wing mirror 25.

However, by the image window 17, in particular the position and the size, a substantially greater section can preferably be represented as the partial area of the environmental re- gion 13, in particular on the right side of the motor vehicle 1 , compared thereto. Prefera- bly, the image window 17 is generated as a partial image from a plurality of real images of the real cameras 5 and/or 6 and/or 7 and/or 8. Here, a virtual image is in particular shown as the image window 17, which is generated by a further camera position 15b, as it is ex- emplarily drawn in Fig. 2 and Fig. 3. Preferably, a virtual camera is arranged in this cam- era position 15b, by which a corresponding second perspective is formed, by which this mirror image is represented.

In an advantageous implementation, it can be provided that a further image window 26 separate from the first image window 17 is additionally displayed at the same time in the image 19. This second image window 26 is arranged without overlap with the first image window 17. The image window 27, which is also a small image section, which is displayed completely within the surface of the image 19, can display an additional more accurate representation of the left-side partial area of the environmental region 13 to the motor ve- hicle 1. For example, this would be given by the second virtual camera 16, as it is repre- sented in Fig. 2 and Fig. 3.

As already set forth above, the position of an image area 17, 26 can be advantageously depending on very different parameters and/or influencing factors, which were exemplarily mentioned above and are not to be again repeated here.

In Fig. 5, an image 19 is shown in a further embodiment, which is generated from a plu- rality of real images of the real cameras 5, 6, 7, 8. Here, a first perspective is also exem- plarily shown, which is generated by a virtual camera 14, which is positioned in the cam- era position 15a according to the representations in Fig. 2 and Fig. 3. In this implementa- tion, in contrast to Fig. 4, three separate image windows 17, 26 and 27 are shown in the image 19, which are preferably all represented as mirror images. The mirror images in these image windows 17, 26 and 27 here show partial areas of the environmental region 13, which represent a partial area of the environmental region 13 viewed on the right side from the motor vehicle 1 , on the left side from the motor vehicle 1 and from the front op- posite to the vehicle longitudinal axis A. Exemplarily and for better comprehension, the further motor vehicle 28 adjacent to the motor vehicle 1 is shown in the mirror image in the image window 17, which is oriented in the same direction of travel as the motor vehicle 1 in reality, but is represented and seen from the front for a viewer in the mirror image.

It can be provided that the own motor vehicle 1 is represented mirror-imaged or also not mirror-imaged in such a mirror image. In Fig. 5, a representation is exemplarily shown, in which the own motor vehicle 1 is not represented as a mirror image and is shown oblique- ly from the top. In Fig. 2 and Fig. 3, exemplary implementations are shown by the camera positions 15c, in which further, in particular virtual, cameras can be present to allow the image window 27 with the corresponding mirror-image representation, wherein this per- spective of the further virtual camera 29 is then here allowed.

Only for the fact of clarity in the image windows 26 and 27 in Fig. 5 no scenes of the envi- ronment 13 are shown. The same is true for the image windows 17 and 26 in Fig. 4

Preferably, it is provided that a ray tracing method is performed for generating a mirror image, by which the reflected light rays are imaged such that a corresponding mirror im- age arises and is displayed. However, it can also be provided that only a partial area of the environmental region 13 behind the motor vehicle 1 is shown for example in the image window 27, which is displayed centrally in the middle in front of the motor vehicle 1 in the image 19. This can be a virtual mirror image, but can for example also be a real image of the real camera 7.

In addition or instead, a virtual image of the lateral partial area of the environmental region 13 to the motor vehicle 1 , as already above explained, can be correspondingly represent- ed in the image window 17 and/or 26. However, a real image only of the camera 6 can al- so be displayed in the image window 17. Similarly, it can be provided that a virtual image is represented as a mirror image or a real image only of the camera 8 in the image win- dow 26. Similarly, it is possible that with multiple image windows a virtual mirror image is generated in one of these image windows and a real image of a single real camera is rep- resented in another one of these image windows. In this context, it is also always essen- tial that the perspective of the virtual camera, which generates the image 19, and the scenery represented in the at least one image window are different. It is also essential that the image 19 is respectively generated from multiple real images of multiple real cameras 5, 6, 7 and 8 and the camera position of a virtual camera 14 is then taken as a basis for this image 9 in this context. In addition, it is possible that alternatively to the three- dimensional perspective representations, as they were schematically represented and ex- plained in Fig. 4 and Fig. 5, an image 19 can also be represented as a two-dimensional view, for example as a complete bird's eye perspective or completely on the side of the motor vehicle 1.

In Fig. 6 a representation is shown, in which an image 19 is displayed on a display unit 4. The motor vehicle 1 makes a parking procedure. In the image 19 a perspective of the vir- tual camera 14 is shown, which is orientated form the inner of the motor vehicle 1 to the front into the environmental region 13. In the image 19, as an example, two image win- dows 17 and 26 are displayed, which each have a different perspective thereto. In the im- age window 26 a representation of the environmental region 13 on the left side of the mo- tor vehicle and orientated to the back is shown. A further motor vehicle 24 can be seen in the image window 26. Said further motor vehicle 24 cannot be seen in the image 19. In the image window 17 a representation of the environmental region 13 on the right side of the motor vehicle 1 and orientated to the back is shown. Especially both image windows 17 and 26 are mirror images.

In Fig. 7 a representation is shown, in which an image 19 is displayed on a display unit 4. The motor vehicle 1 makes a parking procedure. In the image 19 a perspective of the vir tual camera 14 from outside of the motor vehicle 1 is shown. Especially the virtual camera 4 is positioned behind the motor vehicle 1 and above of said motor vehicle 1. In the image 19, as an example, two image windows 17 and 26 are displayed, which each have a dif- ferent perspective thereto. In the image window 26 a representation of the environmental region 13 on the left side of the motor vehicle and orientated to the back is shown.

A further motor vehicle 24 can be seen in the image window 26. Said further motor vehicle 24 can be seen in the image 19, too. In the image window 17 a representation of the envi- ronmental region 13 on the right side of the motor vehicle 1 and orientated to the back is shown. Especially both image windows 17 and 26 are mirror images.