IR ILLUMINATOR WITH ASYMETRIC RADIATION PATTERN

BACKGROUND OF THE INVENTION

FIELD OF THE INVENTION

[0001] The present disclosure relates generally to lighting for a vehicle camera, and in particular, IR illuminator design optimized to avoid camera field-of view.

DESCRIPTION OF THE RELATED ART

[0002] Camera systems play an important role in autonomous vehicles and driver assist system applications. Among the various types of sensors used in autonomous vehicles, cameras are the only sensor technology that can capture color and contrast information at a level of detail that enables object classification. Cameras enable driver assist system applications such as adaptive cruise control, automatic emergency braking, forward collision warning, automatic high beam control, traffic sign recognition, lane keep systems, parking assist, cross-traffic alert, and rear-view mirror. Cameras may also be included inside the vehicle cabin for such features as gaze tracking, presence detection and gesture recognition. However, camera systems are susceptible to weather conditions, variations in lighting, and their exposed lenses may be accidentally damaged.

[0003] A general sensor arrangement for an autonomous vehicle is shown in FIG. 1. The arrangement of FIG. 1 includes long-range radar as a sensor for adaptive cruise control, several vision cameras, such as forward stereo cameras, surround cameras, rear and side cameras. Vision cameras 105, 107, 109 may facilitate features including traffic sign recognition, lane departure warning, digital side mirror, park assist, and rear view. Vision cameras, or alternatively an optional LiDAR 103, may be used as a sensor for viewing the entire surroundings around the vehicle and for obtaining video information for emergency braking, pedestrian detection, collision avoidance, and short/medium range radar for use in cross traffic alerting, rear collision warning, and blind spot detection.

SUMMARY OF THE INVENTION

[0004] According to an embodiment of the present disclosure, there is provided

[0005] (1) an infrared (IR) illuminator for providing IR radiation for a vision camera having a wide-angle lens with a respecti ve wide field of view, that includes an illuminator structure arranged adjacent to the vision camera, at least one IR LED mounted to the illuminator structure, and a cover lens positioned to cover the at least one IR LED. The cover lens changes IR radiated by the IR LED from a symmetric pattern into an asymmetric pattern in a manner that prevents emitted infrared radiation from entering into the camera lens.

[0006] (2) The IR illuminator of feature (1), in which the vision camera has an optic axis in a direction of focus. A center axis that the at least one IR LED is facing is tilted from the optic axis by an angle greater than zero degrees. The cover lens shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is biased toward a direction away from the camera.

[0007] (3) The IR illumi nator of any of features (1) or (2), in which a top surface of the cover lens is positioned below the field of view of the camera.

[0008] (4) The IR illuminator of any of features (1) to (3), in which a field of view of the emission pattern of radiated IR radiation is at least plus or minus 75 degrees from a central direction in which the IR LED is facing.

[0009] (5) The IR illuminator of any of features (1) to (4), in which a pair of illuminator structures are arranged adjacent to and at opposite sides of the vision camera and at least one IR LED is m ounted to each of the illuminator structures. Each of the pair of illuminator structures and IR LED mounted thereon are identical and arranged flipped 180 degrees to emit complementary asymmetrical patterns.

[0010] (6) The IR illuminator of any of features (1) to (5), in which the cover lens positioned to cover the at least one IR LED is a Fresnel lens that shifts the IR radiation pattern of the at least one IR LED to illuminate radiation in an asymmetrical distribution.

[0011] (7) The IR illuminator of feature (6), in which the Fresnel lens shifts IR radiation intensity away from the camera at a side closest to the camera and forms a radiation pattern that has uniform maximum radiant intensity that is substantially squared at a side away from the camera.

[0012] (8) The IR illuminator of feature (7), in which the Fresnel lens shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is greater than 45 degrees from the center axis of the IR LED.

[0013] (9) The IR illuminator of any of features (1) to (8), in which the cover lens positioned to cover the at least one IR LED includes a diffractive film that shifts the IR radiation pattern of the at least one IR LED to illuminate radiation in an asymmetrical distribution.

[0014] (10) The IR illuminator of feature (9), in which the diffractive film shifts IR radiation intensity away from the camera at a side closest to the camera and forms a radiation pattern that has uniform maximum radiant intensity that is substantially squared at a side away from the camera. [0015] (11) The IR illuminator of feature (10), in which the diffractive film shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is greater than 45 degrees from the center axis of the IR LED.

[0016] (12) The IR illuminator of any of features (1) to (11), in which the at least one IR LED is two pairs of IR LEDs mounted to a respective illuminator structure which are at opposite sides of the camera.

[0017] (13) The IR illuminator of any of features (1) to (12), in which the cover lens positioned to cover the at least one IR LED includes a collimator lens with exit optics that shifts the IR radiation pattern of the at least one IR LED to illuminate radiation in an asymmetrical distribution.

[0018] (14) The IR illuminator of feature (13), in which the collimator lens with exit optics shifts IR radiation intensity away from the camera at a side closest to the camera and forms a radiation pattern that has uniform maximum radiant intensity that is substantially squared at a side away from the camera.

[0019] (15) The IR illuminator of feature (14), in which the collimator lens with exit optics shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is greater than 45 degrees from the center axis of the IR LED.

[0020] According to another embodiment of the present disclosure, there is provided

[0021] (16) a method of operating an IR illuminator for a vision camera having a wide-angle lens with a respective wide field of view, the method includes capturing images by the vision camera in the camera field of view, transmitting IR radiation by an IR LED as symmetric radiation pattern, and changing, by a cover optic, the IR radiated by the IR LED from the symmetric pattern into an asymmetric pattern in a manner that prevents emitted infrared radiation from entering into the camera lens.

[0022] (17) The method of feature (16), in which the vision camera has an optic axis in a direction of focus. A center axis in a direction that the at least one IR LED is facing is tilted from the optic axis by an angle in a range of five degrees to fifteen degrees. The changing, by the cover optic, shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is biased toward a direction away from the camera.

[0023] (18) The method of feature (17), in which the changing shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is biased toward the edge of the IR field of view in a direction away from the camera. [0024] (19) The method of feature (18), in which the changing shifts the symmetric pattern to an asymmetric pattern in which a center of maximum intensity of the emitted IR radiation is greater than 45 degrees from the center axis of the IR LED.

[0025] (20) The method of feature (19), in which the changing shifts IR radiation intensity away from the camera at a side closest to the camera and forms a radiation pattern that has uniform maximum radiant intensity that is substantially squared at a side away from the camera.

BRIEF DESCRIPTION OF THE DRAWINGS

[0026] A more complete appreciation of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:

[0027] FIG. 1 illustrates a typical sensor arrangement for an autonomous vehicle;

[0028] FIG. 2 is a schematic diagram for an IR LED illuminator having a clear cover lens;

[0029] FIG. 3 is a schematic diagram for an IR LED illuminator having a transparent black lens;

[0030] FIGs 4 A, 4B, 4C are views of a two LED IR illuminator;

[0031] FIGs. 5A and 5B are plots for comparison of radiant intensity between an IR illuminator having a dome-shaped lens and an IR illuminator having a flat neutral lens;

[0032] FIG. 6 is a schematic diagram for a camera with side-mounted IR illuminators;

[0033] FIG. 7 is a plot of radiant intensity for the IR illuminator of FIG. 6;

[0034] FIG. 8 is a graph of the radiant intensity of FIG. 7;

[0035] FIG. 9 is a schematic diagram for a camera with side-mounted IR illuminators in accordance with an exemplary aspect of the disclosure;

[0036] FIG. 10 is a graph of the radiant intensity for the IR illuminator of FIG. 9;

[0037] FIGs. 11 A and 1 IB are plots for comparison of radiant intensity between an IR illuminator having a symmetric dome-shaped lens and an IR illuminator having an asymmetric dome-shaped lens;

[0038] FIG. 12 is a schematic diagram for an IR LED illuminator having a Fresnel lens or micro optics;

[0039] FIG. 13 is a schematic diagram for an IR LED illuminator having a cover lens and a diffractive film or micro-optics; [0040] FIG. 14 is a schematic diagram for an IR LED illuminator having a cover lens and a collimator;

[0041] FIG. 15 is a graph of radiation distribution for the IR LED illuminator having asymmetrical distribution; and

[0042] FIG. 16 is a schematic diagram of a camera having complementary side-mounted IR illuminators.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0043] As used herein any reference to“one embodiment” or“some embodiments” or“an embodiment” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase“in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment. Conditional language used herein, such as, among others,

“can,”“ could,”“might,”“ may,”“ e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. In addition, the articles“a” and“an” as used in this application and the appended claims are to be construed to mean“one or more” or“at least one” unless specified otherwise.

[0044] Furthermore, the terms“approximately,”“proximate,”“minor,” and similar terms generally refer to ranges that include the identified value within a margin of 20%, 10% or preferably 5% in certain embodiments, and any values therebetween.

[0045] Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views.

[0046] In order to obtain video information for detecting objects in the field of view of the vision camera for a vehicle, the vision camera needs to capture video information under all types of lighting conditions. Vision cameras are able to operate at normal lighting conditions where there is sufficient daylight. However, vehicles must also operate in conditions where lighting is low, due to shading, and of course during early morning or early evening hours. Vehicles must operate during nighttime. During nighttime hours, lighting may be provided by street lights or other sources, but those sources may not sufficiently provide lighting for specific objects that the camera may be focused on. There is a need to provide light that covers the field of view of the vision camera under all lighting conditions, especially during conditions of low light and darkness. Although conditions of low light and darkness relate to conditions where visible light is low to non-existent, other wavelengths of electromagnetic radiation may be used. Lighting conditions may be enhanced using a source of visible light, such as a camera flash or other camera lighting source. However, camera flash or other camera lighting needs to be bright and is not practical for use on vehicles, as vehicles generally have specific lighting constraints, for among other reasons, safety. Camera flash and camera lighting will blind pedestrians and other drivers. One approach to providing lighting for low light and dark conditions has been to use infrared radiation. Infrared radiation generally is a range of the electromagnetic spectrum that is not visible to humans but is in a range than can be captured by cameras. Infrared radiation includes wavelengths that are near the visible range, referred to as near-infrared. Near-infrared is defined as electromagnetic radiation over the range of 0.75 to 1.4 micro meters.

[0047] Infrared radiation, similar to visible light, may be reflected off of objects, even including some black objects. Vision cameras may be provided with infrared radiation in order to enhance image capture during low light and nighttime conditions. Subsequently, infrared radiation may be used to augment the available ambient light.

[0048] There are various devices that may be used as a source for infrared radiation . Light emitting diodes (LEDs) are increasingly being used to transmit infrared radiation as they are energy efficient and can be implemented in a small space. When infrared (IR) LEDs are used for transmitting infrared (IR) radiation, they are typically enclosed by a cover that protects the LED from the environment and from being damaged. The IR LED and cover are referred to herein as an IR illuminator. The cover for the IR LED may be made IR Black using black pigments that have low infrared reflectivity. The dark lens allows IR radiation to pass, and is commonly referred to as transparent black. The transparent black cover prevents transmission of visible light.

[0049] In order to provide directed radiation toward an object, the cover for an IR illuminator is provided without a secondary optic, such as a neutral cover. In this disclosure, a neutral cover is a cover that allows visible light and infrared radiation to pass without applying optics. Subsequently, the radiation field of view (FOV) of the IR illuminator is the FOV of the IR LED (approximately half of +/- 70 degrees). The cover for the IR LED may be a neutral cover in which a half-angle emission of the LED is in a range of 45 to 70 degrees. A typical neutral cover provides no optical power and may be made of polycarbonate (PC) or polymethyl methacrylate (PMMA). Typically PC is used in the case of an external application that may be subjected to environmental conditions. As shown in FIG. 2 the cover may be clear, but as shown in FIG. 3 typically will include black pigments to make a transparent black lens.

[0050] Typical vehicle mounted vision cameras have a field of view (FOV) up to +/- 100 degrees. As mentioned above, the half-angle emission of an LED in typical IR illuminators is in the range of approximately 45 to 70 degrees. It is desirable to increase the IR illuminator FOV in order to enhance lighting in the camera FOV.

[0051] Vehicle mounted vision cameras and IR illuminators are preferably provided as an assembly, or at least the IR illuminators associated with a vision camera are positioned in close proximity to the camera in order to provide IR radiation that is within the field of view of the camera. Vehicle mounted vision cameras are becoming smaller in size, but are generally incorporated with a wide-angle lens and are limited by focal length. Generally, a diameter of a vision camera lens may be about 35 mm or smaller. In other words, although the vision camera device may have a small diameter lens, the lens is at a specified height above the camera sensor circuit. As a consequence, some of the IR radiation emitted by an IR illuminator mounted adjacent to the vision camera may enter into the camera lens or may be clipped by the camera bezel depending on how the IR illuminator is arranged relative to the vision camera. Thus, increasing the FOV of an IR radiation pattern can lead to elevation of these problems.

[0052] Disclosed are embodiments having a secondary optic that increases the IR illuminator emission FOV while avoiding clipping/interfering with the camera FOV, and maintain high optical efficiency and radiation uniformity over the FOV. Embodiments achieve these objectives by a combination of an IR optical design, i.e. design of the illuminator exit surface, placement and orientation of the IR illuminator relative to the camera, and asymmetric distribution of IR radiation.

[0053] One type of secondary optic for an IR illuminator is an elliptical lens, and may have an inner surface with a shape that is different from the shape of the outer surface. FIGs. 4 A, 4B, 4C are views of an IR illuminator module with an elliptical cover lens. The elliptical cover lens also provides optical characteristics such as radiation diffraction. In FIGs. 4 A, 4B, 4C, the IR illuminator module has LEDs 401 covered by a single elliptical cover lens 403. FIG. 4A is an end view of the IR illuminator module. FIG. 4B is a side view of the IR illuminator module. FIG. 4C is a top view of the IR illuminator module. The IR illuminator module of FIGs. 4 A, 4B, 4C has a mounting substrate 405 having a flat mounting surface on which the LEDs 401 are mounted. It should be understood that mounting substrates for LEDs are not limited to this configuration and can take many forms and may include mounting surfaces that are curved or rounded. In one embodiment, the elliptical cover lens is approximately the same length as the diameter of the camera lens. The elliptical cover lens is not limited to this dimension, but rather its size is determined based on design requirements for a particular installation as well as dimensions of a vision camera.

[0054] In some embodiments, the lens material may be of a transparent thermoplastic such as polycarbonate PC 2245. The polycarbonate PC 2245 typically has a refractive index of 1.569 (at a wavelength of 850 nm) and a linear absorption coefficient of 0.002. It should be understood that the material for the cover lens is not limited to polycarbonate. Other plastic lens materials may be used. Also, the lens material may be glass or a glass laminate and may be made IR Black using black pigments that have low infrared reflectivity.

[0055] FIGs 5A and 5B illustrate a comparison between the radiant intensity of two IR illuminator modules with the elliptical cover lens and IR illuminator modules having a flat neutral lens, respectively. FIG. 5A illustrates the performance of an IR illuminator using two IR illuminator modules of FIGs. 4 A, 4B, 4C each having a single cover lens with elliptical surfaces and a pair of LEDs. The plot extends over a maximum range of +/- 90 degrees by 90 degrees. The plot in FIG. 5 A illustrates that the IR illuminator modules with the elliptical cover lens has a larger radiation pattern and better uniformity than the LED with the flat neutral lens of FIG. 5B. In particular, the plot in FIG. 5 A illustrates that the elliptical cover lens provides an increase in radiation FOV and uniformity that extends to beyond +/- 80 degrees.

[0056] FIG. 6 is a schematic illustrating a relationship between the beam pattern FOV of the IR illuminator and the FOV of the camera. It is an objective to have an illuminator having a maximum beam pattern in the camera FOV while maintaining a compact camera-illuminator assembly. In some embodiments, the IR illuminator 623a, 623b is positioned relative to the camera 621 to meet these illumination conditions. First, the top of the illuminator 623a, 623b where radiation is emitted must be below the FOV of the camera 621 (see line 603 indicating the camera FOV). This condition must be met to prevent parasitic radiation (such as sun reflections, scatter from dust on the illuminator lens) from entering the camera 621. Second, the radiation pattern of the IR illuminator 623a, 623b (see radiation edge 605) must not intercept/clip the camera lens. This condition must be met to prevent IR illuminator radiation from directly entering the camera lens, and thus reducing image quality. The inventor has determined that it is difficult to achieve an IR illuminator FOV of +/- 100 degrees while avoiding illumination radiation clipping the camera. In one embodiment, to reduce illuminator clipping by the camera 621, the illuminator axis 611 is tilted approximately 10 degrees from the optical axis 609 of the camera 621. The choice of size of the tilt angle of the illuminator depends on the FOV requirements of the camera system. The tilt angle may be adjusted to maximize the extent that the beam pattern of the IR illuminator 623 covers the FOV of the camera 621.

[0057] FIG. 7 is a plot of radiant intensity for the IR illuminator of FIG. 6. As shown in the plot, when two illuminators are tilted at 10 degrees, some clipping by the camera bezel occurs. The camera bezel causes the extent of the region of radiation that has good uniformity to be reduced. The inventor has determined that substantial clipping by the camera bezel may occur depending on the illuminator tilt angle. Large tilt angles have been determined to result in reduction in radiation uniformity. It is noted that the range of tilt angle that may lead to clipping is dependent on the distance between the IR illuminator and the camera.

[0058] FIG. 8 is a graph of the radiant intensity of FIG. 7. In FIG. 8, it can be seen that the resultant horizontal intensity profile I _R due to clipping of the camera bezel is less than +/- 90 degrees.

[0059] FIG. 9 is a schematic diagram of an assembly for a camera with side-mounted IR illuminators in accordance with an exemplary aspect of the disclosure. In order to increase the extent of good uniformity by reducing the effect of clipping by the camera bezel, the radiation distribution of each IR illuminator may be made asymmetrical about the optical axis (i.e., the angle of the radiation source distribution pattern is made smaller at one side). In particular, the camera 621 may have IR illuminators 623a and 623b arranged adjacent to the camera 621 on opposite sides. The camera 621 and IR illuminators may be mounted on a common mounting substrate, or may be mounted in a bracket arrangement in which the IR illuminators on respective mounting substrates and attached to the camera 621 by way of a bracket structure.

[0060] A pair of IR illuminators 623a and 623b together increase the FOV of the IR distribution pattern in which the IR radiation is substantially maximum uniform intensity.

The IR illuminator 623a biases intensity to the left, away from the camera 621. The IR illuminator 623b biases intensity to the right. As a result, one IR illuminator 623a and another IR illuminator 623b together increase the extent of the maximum uniform infrared pattern FOV, by providing improved radiation uniformity, while avoiding clipping by the camera 621.

[0061] FIG. 10 is a graph of the resultant radiant intensity for the IR illuminator of FIG. 9. The figure illustrates that the IR illuminator 623a biases maximum intensity to the left outward, and the IR illuminator 623b biases intensity to the right outward, such that the resultant horizontal intensity profile for the pair of IR illuminators can be increased to approximately +/- 80 degrees.

[0062] FIGs. 11 A and 1 IB are plots for a comparison of radiant intensity between an IR illuminator having a symmetric dome-shaped lens and an IR illuminator having an asymmetric dome-shaped lens. FIG. 1 IB illustrates the skewed shape of the bias of radiant intensity that can be achieved by using an asymmetric pattern relative to the symmetric pattern of FIG. 11 A. FIG. 1 IB illustrates that the skewed shape of the uniform radiant intensity may be formed to be substantially squared, i.e., area of maximum intensity extends towards corners of a FOV as opposed to being edges of maximum intensity that is oval or rounded, at a side away from the camera at approximately in a range of 75 to 85 degrees from the center axis of the IR illuminator.

[0063] There are various types of optical arrangements that may be used to achieve asymmetrical IR radiation distribution. FIGs. 12, 13, and 14 provide some example arrangements.

[0064] FIG. 12 is a schematic diagram for an IR LED illuminator having a Fresnel lens or micro optics as a cover lens for the IR LED. A Fresnel lens 1203 or other micro optics may be used to shift the IR radiation pattern of one or more IR LEDs 1201 to illuminate radiation in an asymmetrical distribution.

[0065] FIG. 13 is a schematic diagram for an IR LED illuminator having a cover lens and a diffractive film or diffractive optics. A diffractive film 1303 or diffractive optics may be formed on a surface of the cover lens 1305 to shift the IR radiation pattern from one or more IR LEDs 1301 to illuminate radiation in an asymmetrical distribution.

[0066] FIG. 14 is a schematic diagram for an IR LED illuminator having a cover lens and a collimator. A collimator 1403 having exit optics 1405 may be used to shift the IR radiation pattern from one or more IR LEDs 1401 to illuminate radiation in an asymmetrical distribution out of the cover lens 1305.

[0067] FIG. 15 is a graph of radiation distribution for the IR LED illuminator having asymmetrical distribution. In each approach, the IR radiation distributed from an IR illuminator having optics such as that shown in figures 12, 13, or 14 shifts the radiation distribution toward an asymmetric radiation distribution.

[0068] The asymmetric radiation distribution may be accomplished without having to use different IR illuminators for a camera assembly. FIG. 16 is a schematic diagram of a camera having complementary side-mounted IR illuminators. In one embodiment, an identical IR illuminator 1601 may be used for each of the right illuminator and the left illuminator mounted adjacent to opposing sides of the camera 1607 by rotating the lens element by 180 degrees to enable complementary asymmetrical patterns.

[0069] Numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.