TECHNICAL FIELD

[0001] The present disclosure generally relates to a display system for a vehicle and, more particularly, to a display system providing a rearward view from the vehicle.

BACKGROUND OF THE INVENTION

Display systems for vehicles may provide various benefits. Current display technology may not provide for some features that may be beneficial for display in an automotive vehicle. The display system introduced herein provides various improvements.

SUMMARY OF THE INVENTION

[0002] According to one aspect of the present disclosure, a display system for a vehicle is disclosed. The display system comprises a display device disposed in a passenger compartment of the vehicle. The display device comprises a screen. The display system further comprises a first imager configured to capture a first image data corresponding to a rearward directed field of view from the vehicle and a second imager configured to capture a second image data corresponding to a field of view of a passenger compartment of the vehicle. A controller of the display system is configured to display the first image data on a first portion of the screen and selectively display the second image data on a second portion of the screen in response to a detection of a display prompt or stimulus.

[0003] According to another aspect of the present disclosure, a display system for a vehicle is disclosed. The system comprises a display device comprising a screen disposed in a passenger compartment of the vehicle. The system further comprises a first imager and a second imager. The first imager is configured to capture a first image data corresponding to a rearward directed field of view from the vehicle. The second imager is configured to capture a second image data corresponding to a field of view of a passenger compartment of the vehicle. The system further comprises at least one microphone configured to detect a sound from the passenger compartment and a controller. The controller is configured to display the first image data on a first portion of the screen and selectively display the second image data on a second portion of the screen in response to a detection of the sound. The sound comprises a speech of an occupant.

[0004] According to yet another aspect of the present disclosure, a display system for a vehicle is disclosed. The system comprises a display device comprising a screen disposed in a passenger compartment of the vehicle. The system further comprises a first imager and a second imager. The first imager is configured to capture a first image data corresponding to a rearward directed field of view from the vehicle. The second imager is configured to capture a second image data corresponding to a field of view of a passenger compartment of the vehicle. The system further comprises at least one microphone configured to detect a sound from the passenger compartment and a controller. The controller is configured to display the first image data on a first portion of the screen and selectively display the second image data on a second portion of the screen in response to detecting a motion of an object exceeding a predetermined motion threshold identified in the second image data.

[0005] These and other features, advantages, and objects of the present disclosure will be further understood and appreciated by those skilled in the art by reference to the following specification, claims, and appended drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The present disclosure will become more fully understood from the detailed description and the accompanying drawings, wherein:

[0007] FIG. 1 is a perspective view of a passenger compartment of a vehicle comprising a display system;

[0008] FIG. 2 is an elevational view of a vehicle comprising a display device configured to display image data including a feature of a passenger of the vehicle;

[0009] FIG. 3 is a detailed view a display device configured to display image data including a feature of a passenger of the vehicle;

[0010] FIG. 4 is an elevational view of the display system of FIG. 3 further demonstrating a sound detecting embodiment of the display device; and

[0011] FIG. 5 is a block diagram of a display system in accordance with the disclosure. DETAILED DESCRIPTION OF EMBODIMENTS

[0012] The present illustrated embodiments reside primarily in combinations of method steps and apparatus components related to an image sensor system and method thereof. Accordingly, the apparatus components and method steps have been represented, where appropriate, by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein. Further, like numerals in the description and drawings represent like elements.

[0013] In this document, relational terms, such as first and second, top and bottom, and the like, are used solely to distinguish one entity or action from another entity or action, without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0014] Referring to FIGS. 1, 2, and 3, a vehicle 10 is shown equipped with a display system 12. In various embodiments, the display system 12 may comprise at least one imager 14. The imager 14 may correspond to a plurality of imagers 14. The plurality of imagers 14 may include a first imager 14a configured to capture a first image data 16a corresponding to an interior field of view 17 of a passenger compartment 18 of the vehicle 10. The plurality of imagers 14 may further comprise a second imager 14b configured to capture a second image data 16b corresponding to a scene directed to an exterior region 20 proximate the vehicle 10. In an exemplary embodiment, exterior region 20 may correspond to a rearward directed field of view 21 relative to a forward direction 22 of the vehicle 10.

[0015] The image data 16a and 16b captured by the imager 14 may be displayed by the display system 12 on a display device 24. In some embodiments, the display device 24 may correspond to a rearview display device 26 configured to demonstrate the second image data 16b of the rearward directed view 21. In this configuration, the display system 12 may be operable to display a series of images captured corresponding to scenes behind the vehicle 10. The scenes may include one or more objects, landscapes, road features, and any other visual information that may be captured by the second imager 14b. The imagers 14 as discussed herein may be in communication with a controller and may comprise pixel arrays configured to capture the image data 16 in the form of pixel information. In the various implementations discussed herein, the display system 12 may be configured to process the image data 16 captured by one or more of the imagers 14 and display a feature 28 or portion of one or more objects 30 identified in the image data 16.

[0016] In an exemplary embodiment, the display system 12 may be configured to display the image data 16a on a first portion 32a of display screen 32 of the display device 24. Additionally, the display system 12 may be configured to display the second image data 16b on a second portion 32b of a display screen 32. The first image data 16a may be superimposed over or divided in a separate display window over the second image data 16b similar to a picture-in-picture display. As discussed previously, the first image data 16a may correspond to a scene inside the passenger compartment 18, and the second image data 16b may correspond to a scene of the exterior region 20. During operation, the second image data 16b may be displayed on the second portion 32b to provide rearview operational information configured to assist an operator or passenger 34 of the vehicle 10 in viewing the rearward directed field of view 21.

[0017] The first image data 16a and/or the second image data 16b may be displayed selectively on the display screen 32 throughout operation of the vehicle 10. Additionally, in some embodiments, the first image data 16a and/or the second image data 16b may be selectively displayed on the display screen 32 in response to one or more of a detection of a feature or identification of an event in the image data 16. The image data 16a and/or 16b may be selectively displayed in response to one or more input signals or operating conditions of the vehicle 10. The display system 12 may comprise a controller 40 configured to identify the feature or the event in the image data 16. Additionally, the controller 40 may be configured to selectively display the image data 16a and/or 16b in response to the one or more input signals or operating conditions of the vehicle 10. In this configuration, the display system 12 may provide for a flexible solution that may be utilized to display image data 16 for a variety of diverse applications. The controller 40 is further discussed in reference to FIG. 5. [0018] In some embodiments, the controller 40 may comprise one or more processors and/or control circuits configured to process the image data 16 received from the first imager 14a and/or the second imager 14b. For example, in some embodiments, the controller 40 may process the first image data 16a from the first imager 14a to identify a display-prompt (e.g., a gesture, motion, speech, or other form of input or stimulus) of a passenger 34 of the vehicle 10. In response to detecting the display-prompt of the passenger 34, the controller 40 may control the display system 12 to display a portion of interest of the passenger 34 in a display window 42 on the display screen 32. The portion of interest may correspond to a facial region 44 of the passenger 34 that may be cropped and/or otherwise processed for display in the display window 42. In this configuration, the display system 12 may be configured to selectively display the portion of interest of the image data 16a in response to the controller 40 identifying the display-prompt. Though described as a gesture, motion, or speech, the display-prompt may correspond to various inputs or stimuli received by the controller 40. Accordingly, the display system 12 may be configured to provide a variety of display functions based on various inputs identified or received by the controller 40.

[0019] In some embodiments, the controller 40 may be operable to crop the image data

16a focusing on the region of interest. The region of interest may be identified by the controller 40 based on a facial recognition process applied to the image data 16a thereby identifying a facial region 44 of the passenger 34 or occupant. The identified facial region 44 may then be cropped by the controller 40 to generate cropped image data 16a focusing on the facial region 44 of the occupant. In this way, the controller 40 is operable to demonstrate the relevant information in the display window 42 and limit the display of additional information that may not relate to a communication from the passenger 34.

[0020] As discussed herein, a passenger 34 may correspond to a person (e.g., adults, children), an animal (e.g., a pet), and/or any object of interest in the passenger compartment 18. The imagers 14 discussed herein are demonstrated in fixed locations in connection with the vehicle 10. However, in some embodiments, the imagers 14 may be flexibly utilized in various portions of the vehicle 10. In such embodiments, one or more of the imagers 14 may be configured to communicate wirelessly (e.g., via Bluetooth™,

WiFi™, ZigBee ^® , etc.) with the controller 40. In this configuration, one or more of the imagers 14 may be selectively positioned in connection with the vehicle 10 such that the controller 40 may detect a display-prompt corresponding to motion of objects positioned in a field of view.

[0021] In some embodiments, the at least one imager 14 may comprise a third imager

14c. Though designated with the term, third, the third imager 14c may correspond to the at least one imager 14 or may be utilized in any combination with the first imager 14a and/or the second imager 14b. In an exemplary embodiment, the third imager 14c may be configured to communicate wirelessly with the controller 40 and be selectively positioned to capture image data of a selectable field of view 45. The selectable field of view 45 may be selected to include one or more objects of interest 47. The controller 40 may be configured to detect motion of the one or more objects 30 of interest in image data received from the third imager 14c. The motion of the one or more objects 30 of interest in the image data may be detected by the controller 40 to identify the display- prompt. In response to the display-prompt, the controller 40 may selectively display one or more of the objects 30 of interest in the display window 42.

[0022] An object of interest as described herein may refer to any object, scene, or region captured in a field of view of the imager 14. For example, an object of interest may correspond to a trailer hitch 46a, a luggage compartment 46b, a fuel door 46c, an engine 46d, a wheel 46e, an underbody component 46f, a blind spot 46g, or any portion of the vehicle 10. In some embodiments, the object of interest may correspond to a region of interest 47 that may be monitored for motion of an object that may enter the region 47. For example, in some embodiments, the third imager 14c may be configured to capture image data corresponding to a blind spot 46g of the vehicle 10. In this configuration, the controller 40 may selectively display an object (e.g., a nearby vehicle) entering the region of interest 47 in response to a detection of motion of the object in the region of interest 47.

[0023] Though discussed as having a modular or portable wireless design configured to be selectively located or positioned on the vehicle 10, the third imager 14c may be located in a fixed position in connection with the vehicle 10. Additionally, the first imager 14a and/or the second imager 14b may be configured to communicate the image data 16 to the controller 40 wirelessly. Accordingly, the imager 14 may be utilized in a variety of applications to display information corresponding to various portions of the vehicle 10. Further details regarding the imagers 14 and controller 40 are discussed in reference to FIG. 5.

[0024] Still referring to FIGS. 2 and 3, the controller 40 may be configured to identify the display-prompt as a motion of a facial feature 46 (e.g., a mouth, jaw, eye, etc.) that may correspond to speech of the passenger 34. In response to the detection of the display- prompt in the image data 16a, the controller 40 may display the facial region 44 of the passenger 34 on the display device 24. The controller 40 may continue to detect movement of the one or more facial features 46 and display the facial region 44 in the display window 42 until the motion of facial features 46 is not detected for a predetermined period of time. For example, the controller 40 may terminate the display of the image data 16a of the facial region 44 of the passenger 34 on the display device 24 after a predetermined period of time elapses following the completion of the speech of the occupant. In this way, the controller 40 may selectively display the facial region 44 and the display window 42 during temporal periods during which the passenger 34 may be moving or speaking.

[0025] The motion detected by the controller 40 corresponding to the display-prompt may correspond to a detected motion of one or more of the facial features 46 exceeding a motion threshold. The controller 40 may identify that the detected motion has exceeded the motion threshold by identifying motion of pixel data corresponding to the one or more facial features 46 moving in excess of a predetermined distance over a plurality of consecutive frames captured by the first imager 14a. Such an identification of the one or more facial features 46 may result in the controller 40 triggering the display- prompt and display the facial region 44 of the passenger 34 in the display window 42 for a predetermined period of time.

[0026] Once the facial region 44 is displayed on the display device 24, the controller 40 may continue to process the first image data 16a to determine if the one or more facial features 46 continue to move in excess of the motion threshold. The controller 40 may continue to display the facial region 44 of the first image data 16a in the display window

42 for a predetermined period of time (e.g., 2 seconds, 5 seconds, etc.). If the controller

40 detects the motion of the one or more facial features 46 exceeding the motion threshold, the controller 40 may reset the predetermined period of time and continue to display the facial region 44 in the display window 42. The controller 40 may continue to display the facial region 44 until the predetermined period of time expires without the motion threshold being exceeded. In this way, the controller 40 may display the facial region 44 in the display window 42 while the passenger 34 is speaking.

[0027] Referring now to FIG. 4, in some embodiments, the controller 40 may comprise one or more microphones 52 that may be configured to detect speech or noise corresponding to the passengers 34 of the vehicle 10. The detection of such speech may also or alternatively be utilized by the controller 40 as a display-prompt. The one or more microphones 52 may correspond to a microphone array operable to detect a region in the passenger compartment 18 from which the noise or speech originated. For example, the controller 40 may be configured to receive an audio signal from the one or more microphones 52. Based on the audio signal, the controller 40 may identify whether a noise in the audio signal originated in one of a plurality of regions 54 of the passenger compartment 18. For example, the controller 40 may be operable to distinguish if the noise originated in a first region 54a, a second region 54b, or a third region 54c of the passenger compartment 18. The controller 40 may then utilize this information to activate the display of the facial region 44 in the display window 42. In some embodiments, the audio signal may also be utilized in combination with the first image data 16a to identify the display-prompt.

[0028] The one or more microphones 52 may utilize various detection methods to distinguish the region 54 of the passenger compartment 18 from which the noise originated. To enable such detection, the one or more processors 64 of the controller 40 may comprise a digital signal processor (DSP) in communication with the one or more microphones 52. The DSP may process the audio signals from the microphone 52 or microphone array via beam forming, and/or polar steering to determine a particular region of the plurality of regions 54 from which a noise originated. Further details regarding the detection of a region from which one or more noises may be detected are discussed in United States Patent No. 7,447,320 entitled, "Vehicle Accessory

Microphone," which is incorporated by reference in its entirety. Accordingly, the controller 40 may utilize the indication of the region 54 from which a noise in the passenger compartment 18 originated to search the first image data 16a for a facial region 44 to display on the display device 24. The controller 40 may continue to display the facial region 44 throughout a detection of the motion or speech originating from the region 54. The controller 40 may continue to display the facial region 44 on the display device 24 for a predetermined time as previously discussed.

[0029] The one or more microphones 52 may be disposed in a rearview assembly 56, which may correspond to the display device 24. The rearview assembly 56 may be configured to operate in a mirror mode as well as a display mode. In the display mode, the display device 24 may be configured to display the image data 16 on the display screen 32. Additionally, in some embodiments, the rearview assembly 56 may correspond to an electro-optic or electrochromic mirror assembly. Accordingly, the disclosure may incorporate a display screen 32 for use in an automotive vehicle that may correspond to a mirror-display as disclosed in U.S. Pat. Nos. 8,582,052; 6,870,655; 6,737,630; 6,572,233; 6,552,326; 6,420,800; 6,407,468; 6,346,698; 6,170,956; 5,883,605; and 5,825,527; and U.S. Pat. Application Publication No. 2009/0096937 Al entitled "Vehicle Rearview Assembly Including a Display for Displaying Video Captured by a Camera and User Instructions," all commonly assigned to Gentex Corporation and all of which are incorporated herein by reference in their entireties.

[0030] In some embodiments, the controller 40 may be operable to detect and control one or more functions of the display device in response to a voice recognition received via the one or more microphones 52. In this configuration, display device 24 may be configured to enable hands-free operation. The DSP of the controller 40 may process one of more speech signals received by the one or more microphones in various speech situations. The DSP may process the speech from a desired or identified spatial location (i.e., the location in which the driver or other passengers are located). Arrival time differences of the speech signal to a plurality of microphones may be used to narrow and filter conflicting noises. Additionally, the DSP's may comprise stored information of human speech including fundamental frequencies that may be used to filter voice signals. As a result, the controller 40 may be configured to process signals and frequencies that are likely to contain speech and identify one or more commands configured to control the operation of the display device 24 or one or more systems in communication with the controller 40.

[0031] Though discussed in detail in reference to the rearview assembly 56, the one or more microphones 52 may be disposed in various portions of the vehicle 10. For example, the one or more microphones 52 may be disposed in a headliner, a pillar, a seat, door panel, or various portions of the vehicle 10. Accordingly, the microphone 52 may be flexibly positioned in the vehicle 10 to suit a particular application.

[0032] The disclosure provides for the controller 40 to utilize one or more of the detection of motion of the facial features 46 and/or an indication of a region 54 from which a noise in the passenger compartment 18 originated to identify a passenger 34 is speaking in the passenger compartment 18. Based on the detection, the controller 40 may identify a display-prompt and display the first image data 16a of the passenger compartment 18 in the display window 42. Additionally, the controller 40 may display the second image data 16b on the display screen 32 throughout operation of the vehicle 10 and/or in response to various vehicle operating conditions. Accordingly, the display system 12 may selectively display the first image data 16a and/or the second image data 16b to assist in operation of the vehicle 10.

[0033] Referring now to FIG. 5, a block diagram of the display system 12 is shown. The imager 14 (e.g., the first imager 14a and/or the second imager 14b) is shown in communication with the controller 40. A pixel array of the imagers 14 may correspond to a complementary metal-oxide semiconductor (CMOS) image sensor, for example, a CMOS active-pixel sensor (APS) or a charge coupled device (CCD). Each of the pixels of the pixel array may correspond to a photo-sensor, an array of photo-sensors, or any grouping of sensors configured to capture light. The controller 40 may comprise a processor 64 operable to process the image data as supplied in analog or digital form from the imager(s) 14. In various embodiments, the processor 64 may be implemented as a plurality of processors, a multicore processor, or any combination of processors, circuits, and peripheral processing devices.

[0034] In some embodiments, one or more of the imagers 14 may correspond to infrared imaging devices. Such devices may comprise lighting modules configured to project infrared radiation. For example, the second imager 14b may correspond to an infrared imaging device. In such an embodiment, the controller 40 may be configured to receive infrared image data corresponding to one or more of the passengers 34 of the vehicle 10. In this configuration, the controller 40 may utilize the infrared image data to identify the passenger 34 based on a retinal identification or various identification algorithms.

[0035] The controller 40 may further comprise a memory 66. The memory 66 may comprise various forms of memory, for example, random access memory (RAM), dynamic RAM (DRAM), synchronous (SDRAM), and other forms of memory configured to store digital information. The memory 66 may be configured to store the image data 16 (e.g., the first image data 16a and/or the second image data 16b) for processing. Processing the image data 16 may comprise scaling and cropping the image data 16 to adjust a position and apparent size of the image data 16 as it is output to the display screen 32 of the display device 24. In some embodiments, the memory 66 may further be configured to store additional programming information including method and processes for operation of the display system 12.

[0036] The one or more imagers 14 may be configured to communicate with the controller 40 via a wired or wireless connection to suit a desired application. Some examples of wireless communication protocols may include Bluetooth™, WiFi™, ZigBee ^® , and similar wireless communication protocols including those yet to be developed. Accordingly, the controller 40 may comprise a communication module 68 configured to communicate wirelessly with one or more of the imagers 14. In a wireless configuration, the imagers 14 may correspond to a modular configuration comprising a battery 70 as exemplified by the third imager 14c. The modular configuration may further comprise a communication circuit 72 configured to communicate wirelessly with the communication module 68 of the controller 40.

[0037] The controller 40 may further be in communication with a plurality of inputs - for example, a speed input 74, and a vehicle bus 76. The speed input 74 may provide a signal communicating a speed of the vehicle 10 via a speedometer or any device operable to measure and communicate data corresponding to the speed of a vehicle 10. The vehicle bus 76 may be implemented using any suitable standard communication bus, such as a Controller Area Network (CAN) bus, a Local Interconnect Network (LIN) bus, etc. The vehicle bus 76 may be configured to provide a variety of additional information to the controller 40. Such information may correspond to one or more vehicle states, for example, a gear selection, passenger occupancy, a headlight activation, etc., which may be utilized by the controller 40 to control the display of the image data. For example, the controller 40 may selectively display the first image data 16a, the second image data 16b, and or a third image data 16c in response to one or more vehicle states.

[0038] It will be appreciated that embodiments of the disclosure described herein may be comprised of one or more conventional processors and unique stored program instructions that control one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of an image sensor system and method thereof, as described herein. The non-processor circuits may include, but are not limited to, signal drivers, clock circuits, power source circuits, and/or user input devices. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs), in which each function or some combinations of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used. Thus, the methods and means for these functions have been described herein. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein will be readily capable of generating such software instructions and programs and ICs with minimal experimentation.

It should be appreciated by those skilled in the art that the above described components may be combined in additional or alternative ways not explicitly described herein. Modifications of the various implementations of the disclosure will occur to those skilled in the art and to those who apply the teachings of the disclosure. Therefore, it is understood that the embodiments shown in the drawings and described above are merely for illustrative purposes and not intended to limit the scope of the disclosure, which is defined by the following claims as interpreted according to the principles of patent law, including the doctrine of equivalents.