CHARACTERIZATION MEASUREMENTS

BACKGROUND

Technical Field The present disclosure generally relates to imaging, and more particularly, to systems and methods of providing polarimeters that generate high fidelity surface characterization measurements.

Description of the Related Art

The measurement of light may be useful in various fields, such as science, industry, security, and other fields. In addition to intensity and wavelength, polarization of light may be measured to characterize various objects or scenes. In general, polarimetry is the measurement and interpretation of the polarization of transverse waves, most notably electromagnetic waves, such as radio or light waves. Typically polarimetry is done on electromagnetic waves that have traveled through or have been reflected, refracted or diffracted by some material in order to characterize that object. Polarimeter cameras (or “polarimeters”) may be used in remote sensing, characterization of aerosol particles, planetary detection, quality control, biological activity measurements or detection, and numerous other applications.

To measure the characteristics of an object or scene based on polarization of scattered or reflected light, a polarimeter may need to be operative to measure linear polarization and/or circular polarization of light emanating from the object. Existing designs utilize complex arrangements of beam splitters, polarization elements, or moving parts to separate polarization states in space, and may require separate imaging components ( e.g ., lenses, retarders, sensor arrays) to capture the required polarization information. As an example, some polarimeters utilize a Wollaston prism to separate light in space based on its polarization, so that the separate polarization components may be analyzed individually. However, these types of polarimeters may be relatively large in size, and may also require multiple optical paths and associated components, which may cause spatial registration errors and further increases complexity, cost, reliability, and spatial requirements.

BRIEF SUMMARY

A polarimetry camera may be summarized as including a multi-twist retarder component operative to be selectively switched between at least two polarization filtering states, wherein, in each polarization filtering state, the multi-twist retarder component passes light having a different one of at least two corresponding polarization states; a sensor array operative to capture two dimensional images from light that passes through the multi-twist retarder component; a controller operatively coupled to the multi-twist retarder component and the sensor array, the controller configured to cause the multi-twist retarder component to sequentially cycle through the at least two polarization filtering states at a polarization state change rate; when the multi-twist retarder component is in each polarization filter state during the cycling, cause the sensor array to capture at least one image; and store the captured images in at least one nontransitory processor-readable storage medium.

The at least two polarization filtering states may include four polarization filtering states. The polarization state change rate may be greater than or equal to 30 polarization filtering state changes per second. When the multi-twist retarder component is in each polarization filter state during the cycling, the controller may cause the sensor array to capture exactly one image. The at least two polarization states may include three unique linear polarization states and one circular polarization state. The at least two polarization states may include a horizontal linear polarization state, a vertical linear polarization state, and 45 degree linear polarization state. The sensor array may include one of a charge-coupled device (CCD) or a complementary metal- oxide-semiconductor (CMOS) active pixel sensor.

The polarimetry camera may further include an optic positioned between the multi-twist retarder component and the sensor array, the optic operative to focus light onto the sensor array.

The polarimetry camera may further include an optic positioned between the multi-twist retarder component and the sensor array, the optic operative to filter light from the multi-twist retarder component with respect to at least one characteristic. The controller may be operative to process the captured images to generate one or more Stokes parameters. The controller may be operative to process the captured images to generate one or more Stokes parameters for each of at least a subset of pixels of the sensor array. The controller may be operative to process the captured images to generate one or more Stokes parameters in real-time during capture of the images. The controller may be operative to cause at least one polarization-specific video to be displayed on a display, the at least one video including a sequence of images captured for one of the polarization filtering states of the multi-twist retarder component.

A method of operating a polarimetry camera, the polarimetry camera including a multi-twist retarder component operative to be selectively switched between at least two polarization filtering states, wherein, in each polarization filtering state, the multi twist retarder component passes light having a different one of at least two corresponding polarization states, the polarimetry camera further including a sensor array operative to capture two dimensional images from light that passes through the multi-twist retarder component, the method may be summarized as including causing the multi-twist retarder component to sequentially cycle through the at least two polarization filtering states at a polarization state change rate; when the multi-twist retarder component is in each polarization filter state during the cycling, causing the sensor array to capture at least one image; and storing the captured images in at least one nontransitory processor-readable storage medium.

The at least two polarization filtering states may include four polarization filtering states. The polarization state change rate may be greater than or equal to 30 polarization filtering state changes per second. Causing the sensor array to capture at least one image may include causing the sensor array to capture exactly one image when the multi-twist retarder component is in each polarization filter state during the cycling.

The method may further include processing the captured images to generate one or more Stokes parameters. Processing the captured images to generate Stokes parameters may include processing the captured images to generate one or more Stokes parameters for each of at least a subset of pixels of the sensor array. The method may further include processing the captured images to generate one or more Stokes parameters in real-time during capture of the images.

The method may further include causing at least one video to be displayed on a display, the at least one video including a sequence of images captured for one of the polarization filtering states of the multi-twist retarder component.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

In the drawings, identical reference numbers identify similar elements or acts. The sizes and relative positions of elements in the drawings are not necessarily drawn to scale. For example, the shapes of various elements and angles are not necessarily drawn to scale, and some of these elements may be arbitrarily enlarged and positioned to improve drawing legibility. Further, the particular shapes of the elements as drawn, are not necessarily intended to convey any information regarding the actual shape of the particular elements, and may have been solely selected for ease of recognition in the drawings.

Figure l is a schematic block diagram of an example polarimetry camera, according to one non-limiting illustrated implementation.

Figure 2 is a perspective view of components of the polarimetry camera of Figure 1 showing an example operation thereof, according to one non-limiting illustrated implementation.

Figure 3 is a diagram that shows an example sequence for capturing images sequentially while a multi-twist retarder cycles through polarization filtering states to obtain time-multiplexed polarization specific image data that may be used to determine Stokes parameters, according to one non-limiting illustrated implementation.

DETAILED DESCRIPTION

In the following description, certain specific details are set forth in order to provide a thorough understanding of various disclosed implementations. However, one skilled in the relevant art will recognize that implementations may be practiced without one or more of these specific details, or with other methods, components, materials, etc. In other instances, well-known structures associated with computer systems, server computers, and/or communications networks have not been shown or described in detail to avoid unnecessarily obscuring descriptions of the implementations.

Unless the context requires otherwise, throughout the specification and claims that follow, the word “comprising” is synonymous with “including,” and is inclusive or open-ended (i.e., does not exclude additional, unrecited elements or method acts).

Reference throughout this specification to “one implementation” or “an implementation” means that a particular feature, structure or characteristic described in connection with the implementation is included in at least one implementation. Thus, the appearances of the phrases “in one implementation” or “in an implementation” in various places throughout this specification are not necessarily all referring to the same implementation. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more implementations.

As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. It should also be noted that the term “or” is generally employed in its sense including “and/or” unless the context clearly dictates otherwise.

The headings and Abstract of the Disclosure provided herein are for convenience only and do not interpret the scope or meaning of the implementations.

One or more implementations of the present disclosure are directed to systems and methods for providing a polarimetry camera operative to obtain high fidelity surface characterization measurements. A polarimetry camera may include a multi twist retarder component that is operative to selectively switch between two or more polarization filtering states, wherein when in each polarization filtering state, the multi twist retarder component only passes light having a particular polarization state or orientation ( e.g ., horizontal linear polarization, vertical linear polarization, 45 degree linear polarization, circular polarization) and reflects or absorbs light having other polarization states. The polarimetry camera may capture images using a sensor array as the multi-twist retarder is switched between the at least two polarization filtering states, thereby capturing sequences of polarization-specific images or video that may be displayed or used to determine Stokes parameters for a scene in real-time. Advantageously, the polarimetry camera may not require spatial separation of received light and may not have any moving parts, which reduces the required dimensions for the camera, the complexity, and the cost, and also improves reliability. Improved reliability and performance may be particularly beneficial in various applications where the polarimetry camera is subject to harsh conditions (e.g, temperature, vibration), and/or applications where maintenance and replacement of components are particularly burdensome.

Figures 1-3 illustrate an example embodiment of a polarimetry camera 100 of the present disclosure that may be used to determine polarization profiles of points in a scene 102 from image or video frames using Stokes parameters or other measurements. Advantageously, the systems and methods described herein may generate Stokes parameters more rapidly, reliably, and accurately than conventional methods, while also requiring a smaller form factor in at least some embodiments by providing a single optical path and utilizing thin film optical components. The polarimetry camera 100 may generally include a multi -twist retarder component 104, optics 105, a sensor array 106, and a controller 108 operatively coupled to the multi -twist retarder component and the sensor array. The multi -twist retarder component 104, which may include one or more multi-twist retarders, may be operative to be selectively switched between at least two polarization filtering states. In each polarization filtering state, the multi-twist retarder component 104 passes light having a different one of at least two corresponding polarization states and absorbs or reflects light of other polarization states or orientations.

The sensor array 106 may be operative to capture two dimensional images from light that passes through the multi -twist retarder component 104 and is focused by the optics 105. Generally, the controller 108 may be configured to cause the multi -twist retarder component 104 to sequentially cycle through the at least two polarization filtering states at a polarization state change rate (e.g, greater than 10 per second, greater than 30 per second, greater than 50 per second). When the multi -twist retarder component is in each polarization filter state during the cycling, the controller 108 may cause the sensor array 106 to capture at least one image (e.g, one image, two images, numerous images). The controller 108 may store the captured images in at least one nontransitory processor-readable storage medium, such a data storage 110, as image data 112. As discussed further below, the polarimetry camera 100 may include a Stokes determiner module 114 that is operative to process the image data 112 to determine some or all of the Stokes parameters for the scene 102.

The multi -twist retarder component 104 may be formed of birefringent materials. Birefringence is the property of a material that has a refractive index that depends on the polarization and propagation direction of light. The multi -twist retarder alters the polarization state or phase of light traveling through it. The multi-twist retarder may have a slow axis (or extraordinary axis) and a fast axis (ordinary axis). As polarized light travels through the multi-twist retarder, the light along the fast axis travels more quickly than along the slow axis. Generally, the multi-twist retarder component 104 is a waveplate-like retardation film that may be configured to provide precise and customized levels of broadband, narrowband or multiple band retardation in a single thin film. More specifically, the multi -twist retarder component 104 includes two or more twisted liquid crystal (LC) layers on a single substrate and with a single alignment layer. Subsequent LC layers are aligned directly by prior layers, allowing simple fabrication, achieving automatic layer registration, and resulting in a monolithic film with a continuously varying optic axis. As discussed elsewhere herein, the multi twist retarder 104 is switchable into a plurality of polarization filtering states and, in at least some implementations, may also include static or switchable diffraction patterns that focus light onto the sensor array. The multi-twist retarder component 104 may include a single multi-twist retarder, or may include a plurality of multi-twist retarders arranged proximate each other ( e.g ., in a stacked arrangement). Dependent on the particular application, the multi -twist retarder component 104 may be configured to work on one or more particular ranges of wavelengths (e.g., visible, specific color, infrared).

In at least some implementations, the polarimetry camera 100 may include the data storage 110 that stores image data 112, a Stokes determiner module 114, and/or other programs and data 116. The polarimetry camera 100 may also include various I/O components 118, which may include one or more user interfaces (e.g, buttons, touch pads, speakers), displays, one or more wired or wireless communications interfaces, etc. As an example, the I/O components 118 may include a communications interface that allows the polarimetry camera 100 to communicate with an external device 120 over a wired or wireless communications link 122. As non-limiting examples, the external device 120 may include a host computer, a server, a mobile device ( e.g ., smartphone, wearable computer), etc. The various components of the polarimetry camera 100 may be housed in a single housing, may be housed in one or more separate housings (e.g., host computer), or any combinations thereof.

As noted above, the polarimetry camera 100 may be used for the determination of polarization profiles of points in the scene 102 from video or image frames 124 (Figure 2) using Stoke parameters (e.g, parameters So, Si, S2, and S3). The polarimetry camera 100 may be operative to generate a sufficient number of unique scene images 124 to determine the respective Stokes parameters in real-time (or near real-time). Such parameters may be used to characterize one or more objects in the scene 102.

In at least some implementations, the multi -twist retarder component 104 may be controlled to selectively switch between or cycle through a plurality (e.g, two, three, four) of polarization filtering states. The time required to obtain unique images needed to determine the Stokes parameters may be determined at least in part by the switching rate of the multi -twist retarder component 104 and the frame rate of the sensor array 106. As an example, in an implementation wherein the multi -twist retarder component 104 switches between four polarization filtering states (e.g, three linear polarization states or orientations and one circular polarization state), the time required to capture four unique images may be the time required for the multi -twist retarder component 104 to switch between the four states while the sensor array 106 captures at least one image while the multi-twist retarder is in each polarization filtering state.

In the example 200 illustrated in Figure 2, the scene 102 may have a horizontal axis X, a vertical axis Y that is perpendicular to the X axis, and a Z axis that is perpendicular to the X and Y axes. The operator of the polarimetry camera 100 desires to obtain polarization information for the scene 102, which may be one or more objects, a landscape, or any other scene.

As discussed above, the multi -twist retarder component 104 may be switchable into a plurality of polarization filtering states. As an example, the multi-twist retarder may be configurable into four polarization states that respectively pass horizontal linearly polarized light, vertical linearly polarized light, 45 degree (or other angle) linearly polarized light, and circularly polarized light.

As shown by the example frame sequence 300 in Figure 3, in operation, the controller 108 may cause the multi -twist retarder component 104 to iteratively cycle through different polarization filtering states PI, P2, P3, and P4 while also controlling the sensor array 106 to capture images or frames. In the illustrated frame sequence 300, a set of four frames ( e.g ., a set 302 including frames 1-4, a set 304 including frames 5- 8) corresponds to four images that were each captured when the multi-twist retarder component 104 was in a different one of the four polarization filtering states PI, P2, P3, P4. Thus, the polarimetry camera 100 may generate four independent polarization- specific image sequences or videos, with each video capturing the scene 102 using a different polarization filter provided by the multi -twist retarder component 104.

The optics 105 may include one or more lenses that focuses light received from the multi -twist retarder component 104 onto the sensor array 106. The optics 105 may further include one or more other optics that filter or modify at least one characteristic of light, such a color filter or other type of optic. The optics 105 may include a plurality of optical elements, and may be located at different positions in the optical path than shown in the example illustrations. In at least some implementations, the multi-twist retarder component 104 may be configured to provide one or more static or dynamic diffraction patterns that may be operative to focus light on the sensor array 106. In such implementations, the optics 105 may be modified or even omitted.

As non-limiting examples, the sensor array 106 may include a two dimensional sensory array, such as a charge coupled device (CCD) or a complementary metal- oxide-semiconductor (CMOS) sensor array. More generally, the sensor array 106 may be implemented using any appropriate light receptors that provide suitable functionality for a particular application.

The scene 102 presents (e.g., reflects) light rays 126 that may be received by the multi -twist retarder component 104. Although not shown for clarity, the polarimetry camera 100 may include one or more optical elements positioned between the scene 102 and the multi-twist retarder component 104. The light rays 126 are generally emitted in the direction of the Z axis shown in Figure 2. The multi-twist retarder component 104 may present a ray 128 to the optics 105 that is polarized in a polarization state or orientation ( e.g ., PI, P2, P3, or P4) dependent on the current polarization filtering state of the multi -twist retarder component 104. The optic 105 may present a respective polarized ray 130 to the sensor array 106 as the scene image 124.

The polarization filtering states of the multi -twist retarder component 104 may have any orientation with respect to the sensor array 106. As a non-limiting example, in at least some implementations the multi-twist retarder component may be configured to implement a first polarization filtering state that provides a linear polarizer in which the transmission axis is horizontally oriented, a second polarization filtering state that provides a linear polarizer in which the transmission axis is vertically oriented, a third polarization filtering state that provides a linear polarizer in which the transmission axis is oriented at an angle of 45 degrees with respect to horizontal, and a fourth polarization filtering state that provides a circular polarizer in which the fast axis is vertically oriented.

The image or video frames 124 may be stored as image data 112 (Figure 1) in the data storage 110, and may be processed using the Stokes determiner module 114 or other program, as discussed herein. For instance, the Stokes determiner module may utilize the pixel values for one or more sets of four polarization-specific images to obtain the Stokes parameters for each point in the scene 102 using known equations. The Stokes parameters may be provided to a user via a display or communicated to the user in any other manner. In at least some implementations, the polarimetry camera 100 may display the polarization-specific video or images of the scene 102 to the user via a display.

It will be appreciated that the illustrated computing system and devices are merely illustrative and are not intended to limit the scope of the present disclosure. For example, the polarimetry camera 100 and/or the external device 120 may be connected to other devices that are not illustrated, including through one or more networks such as the Internet or via the Web. More generally, such a computing system or device may comprise any combination of hardware that can interact and perform the described types of functionality, such as when programmed or otherwise configured with appropriate software, including without limitation desktop computers, laptop computers, slate computers, tablet computers, head-mounted display (HMD) systems, or other computers, smart phone computing devices and other cell phones, Internet appliances, PDAs and other electronic organizers, database servers, network storage devices and other network devices, wireless phones, pagers, television-based systems ( e.g ., using set-top boxes and/or personal/digital video recorders and/or game consoles and/or media servers), and various other consumer products that include appropriate inter-communication capabilities. For example, the illustrated polarimetry camera 100 may include executable software instructions and/or data structures in at least some embodiments, which when loaded on and/or executed by particular computing systems or devices, may be used to program or otherwise configure those systems or devices, such as to configure processors of those systems or devices. Alternatively, in other embodiments, some or all of the software systems may execute in memory on another device and communicate with the illustrated computing system/device via inter computer communication. In addition, while various items are illustrated as being stored in memory or on storage at various times (e.g., while being used), these items or portions of them can be transferred between memory and storage and/or between storage devices (e.g, at different locations) for purposes of memory management and/or data integrity.

Thus, in at least some embodiments, the illustrated systems are software-based systems including software instructions that, when executed by the processor(s) and/or other processor means, program the processor(s) to automatically perform the described operations for that system. Furthermore, in some embodiments, some or all of the systems may be implemented or provided in other manners, such as at least partially in firmware and/or hardware means, including, but not limited to, one or more application- specific integrated circuits (ASICs), standard integrated circuits, controllers (e.g, by executing appropriate instructions, and including microcontrollers and/or embedded controllers), field-programmable gate arrays (FPGAs), complex programmable logic devices (CPLDs), etc. Some or all of the systems or data structures may also be stored (e.g, as software instructions contents or structured data contents) on a non-transitory computer-readable storage medium, such as a hard disk or flash drive or other non- volatile storage device, volatile or non-volatile memory ( e.g ., RAM), a network storage device, or a portable media article (e.g., a DVD disk, a CD disk, an optical disk, a flash memory device, etc.) to be read by an appropriate drive or via an appropriate connection. The systems, modules and data structures may also in some embodiments be transmitted as generated data signals (e.g, as part of a carrier wave or other analog or digital propagated signal) on a variety of computer-readable transmission mediums, including wireless-based and wired/cable-based mediums, and can take a variety of forms (e.g, as part of a single or multiplexed analog signal, or as multiple discrete digital packets or frames). Such computer program products may also take other forms in other embodiments. Accordingly, the present disclosure may be practiced with other computer system configurations.

Those of skill in the art will recognize that many of the methods or algorithms set out herein may employ additional acts, may omit some acts, and/or may execute acts in a different order than specified.

The various implementations described above can be combined to provide further implementations. These and other changes can be made to the implementations in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific implementations disclosed in the specification and the claims, but should be construed to include all possible implementations along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.