Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
MONOCENTRIC MULTISCALE (MMS) CAMERA HAVING ENHANCED FIELD OF VIEW
Document Type and Number:
WIPO Patent Application WO/2019/161184
Kind Code:
A1
Abstract:
Disclosed are various arrangements of monocentric multiscale imaging systems and cameras that advantageously exhibit an enhanced field of view (FoV). Illustrative examples of such systems include a 360° ring FoV MMS lens that advantageously captures approximately 500-mega-pixel image from a circular ring area. Additionally, by varying microcamera imaging channel configurations, we disclose a multi-focal design that advantageously can range from 15mm to 40mm providing coverage of a scene with widely different imaging magnifications. Finally, additional illustrative configurations combine multiple MMS systems such that an arbitrary solid angle in 4π space is covered.

Inventors:
PANG WUBIN (US)
BRADY DAVID JONES (US)
Application Number:
PCT/US2019/018199
Publication Date:
August 22, 2019
Filing Date:
February 15, 2019
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
AQUETI INCORPORATED (US)
UNIV DUKE (US)
International Classes:
G02B13/06; G01C11/02; G03B37/04; G06T7/00
Foreign References:
US9256056B22016-02-09
US8928988B12015-01-06
US9182228B22015-11-10
Other References:
MARKS, D ET AL.: "Engineering a gigapixel monocentric multiscale camera", OPTICAL ENGINEERING, vol. 51, no. 8, 7 August 2012 (2012-08-07), pages 1, XP060025457, ISSN: 0091-3286, DOI: 10.1117/1.OE.51.8.083202
PANG, W ET AL.: "Field of view in monocentric multiscale cameras", APPLIED OPTICS, vol. 57, no. 24, 17 August 2018 (2018-08-17), pages 6999 - 7005, XP055631870, ISSN: 1559-128X, DOI: 10.1364/AO.57.006999
See also references of EP 3765816A4
Attorney, Agent or Firm:
BROSEMER, Jeffery J. (US)
Download PDF:
Claims:
Claims:

1. A monocentric multiscale optical system (MMS) CHARACTERIZED BY:

a Galilean MMS lens configuration generated by a distorted icosahedron geodesic method, said configuration including a plurality of individual cameras positioned in a top-hemispherical arrangement producing a ring-shaped field of view (FoV).

2. A monocentric multiscale optical system (MMS) CHARACTERIZED BY:

a Galilean MMS lens configuration including a plurality of imaging channels, each one of the plurality of imaging channels exhibiting an overlap of a portion of adjacent imaging channels, each one of the individual channels exhibiting a different focal length from one another.

3. A monocentric multiscale optical system (MMS) CHARACTERIZED BY:

at least three MMS lens configurations positioned along a common plane in a back- to-back arrangement such that a 360 degree horizontal field of view along that plane is produced.

4. The monocentric multiscale optical system of claim 3 FURTHER CHARACTERIZED

BY:

each of the individual MMS lens’ exhibit a horizontal field of view (FoV) that is larger than 120 degrees.

5. A monocentric multiscale optical system (MMS) CHARACTERIZED BY:

at least three MMS lens configurations vertically arranged along a common central axis, each individual one of the MMS lens configurations configured to provide a portion of a 360 horizontal field of view.

Description:
MONOCENTRIC MULTISCALE (MMS) CAMERA HAVING ENHANCED

FIELD OF VIEW

CROSS REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of United States Provisional Application

Serial No. 62/631,170 filed 15-FEB-18 the entire contents of which is incorporated by reference as if set forth at length herein.

TECHNICAL FIELD

[0002] This disclosure relates generally to optics and digital imaging and, more particularly, to large-pixel-count imaging systems including monocentric multiscale cameras having an enhanced field of view.

BACKGROUND

[0003] As will be readily appreciated by those skilled in the art, digital imaging systems, methods, and structures are employed in an ever-increasing number of applications and have become integral in every industry imaginable - making, creating, storing, analyzing, and disseminating images.

[0004] Given this importance, improved systems, methods, and structures for digital imaging - and in particular - systems, methods and structures which facilitate the development of large-pixel-count imaging (i.e., gigapixel) - would represent a welcome addition to the art.

SUMMARY

[0005] An advance is made in the art according to aspects of the present disclosure directed to systems, methods, and structures for monocentric multiscale imaging systems and cameras having an enhanced field of view as compared with the prior art. [0006] In sharp contrast to the prior art arrangements of monocentric multiscale imaging systems and cameras according to the present disclosure provide - illustratively - a 360° ring FoV MMS lens that advantageously captures approximately 500-mega-pixel image from a circular ring area. Additionally, by varying microcamera imaging channel configurations, we disclose a multi -focal design that advantageously can range from l5mm to 40mm providing coverage of a scene with widely different imaging magnifications. Finally, additional illustrative configurations combine multiple MMS systems such that an arbitrary solid angle in 4p space is covered

[0007] This SUMMARY is provided to briefly identify some aspect(s) of the present disclosure that are further described below in the DESCRIPTION. This SUMMARY is not intended to identify key or essential features of the present disclosure nor is it intended to limit the scope of any claims.

[0008] The term“aspect” is to be read as“at least one aspect”. The aspects described above and other aspects of the present disclosure are illustrated by way of example(s) and not limited in the accompanying drawing.

BRIEF DESCRIPTION OF THE DRAWING

[0009] A more complete understanding of the present disclosure may be realized by reference to the accompanying drawing in which:

[0010] FIG. 1 shows a schematic diagram illustrating hexagonal close-packing for a localized FoV output according to an aspect of the present disclosure;

[0011] FIG. 2 shows an illustrative close-packing of 492 circles on a spherical surface using a distorted icosahedral deodesic method according to aspects of the present disclosure; [0012] FIG. 3 shows an illustrative diagram of an obscuration occurring when two microcameras are positioned in each other’s light path according to aspects of the present disclosure;

[0013] FIGs. 4(A) and 4(B) show the calculation of maximum packing angle cFov in which: FIG. 4(A) illustrates a light path of one channel in an MMS lens; while FIG. 4(B) illustrates a maximum packing angle given specified design parameters according to aspects of the present disclosure;

[0014] FIGs. 5(A), 5(B), and 5(C) show schematic diagrams of illustrative MMS optical imaging systems with ring FoV in which: FIG. 5(A) shows an MMS camera on a pole with a FoV of a ring area while FIG. 5(B) shows an 165 circles packed on a belt on a top hemisphere with polar angle ranging from 43° to 76 while FIG. 5(C) shows an illustrative layout of an MMS lens design - according to the present disclosure;

[0015] FIGs. 6(A) and 6(B) show illustrative imaging performance of a 360 ring

MMS lens in which: FIG. 6(A) shows an illustrative layout of one channel of 360 ring Fov MMS lens design while FIG. 6(B) shows an illustrative MTF curves according to an aspect of the present disclosure;

[0016] FIGs. 7(A), 7(B), and 7(C) show schematic diagrams of an illustrative multifocal system in which: FIG. 7(A) illustrates monitoring traffic along a street from one end, while FIG. 7(B) shows illustrative multiple imaging channels of optics employed, and FIG. 7(B) shows an optical layout of a multifocal system according to an aspect of the present disclosure;

[0017] FIGs. 8(A), 8(B), and 8(C) show plots of MTF curves of each channel in multifocal MMS lens design for: FIG. 8(A) MTFs of on-axis FoV; FIG. 8(B) shows MTFs of 0.707 FoV and FIG 8(C) shows MTFs of marginal FoV - according to an aspect of the present disclosure; [0018] FIGs. 9(A) and 9(B) show illustrative approaches to 360 s horizontal FoV optics including: FIG. 9(A) shows an illustrative layout including three back-to-back MMS lenses and FIG. 9(B) showing an illustrative interleaving strategy with MMS lenses stacked - according to an aspect of the present disclosure;

[0019] FIG. 10 shows illustrative microcameras and light window(s) of 36 (f horizontal FOV imager according to aspects of the present disclosure;

[0020] FIGs. 11(A) and 11(B) show illustrative tetrahedral geometry of full spherical MMS lens in which: FIG. 11(A) shows illustrative space segmentation with four MMS lenses with each one covering a quarter of the full sphere; and FIG. 11(B) showing illustratively close-packed microcameras on one of the four segments - according to an aspect of the present disclosure;

[0021] FIG. 12 shows illustrative layout view of a full spherical MMS lens according to aspects of the present disclosure;

DETAILED DESCRIPTION

[0022] The following merely illustrates the principles of the disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements which, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its spirit and scope. More particularly, while numerous specific details are set forth, it is understood that embodiments of the disclosure may be practiced without these specific details and in other instances, well-known circuits, structures and techniques have not been shown in order not to obscure the understanding of this disclosure.

[0023] Furthermore, all examples and conditional language recited herein are principally intended expressly to be only for pedagogical purposes to aid the reader in understanding the principles of the disclosure and the concepts contributed by the inventor(s) to furthering the art and are to be construed as being without limitation to such specifically recited examples and conditions.

[0024] Moreover, all statements herein reciting principles, aspects, and embodiments of the disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently-known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.

[0025] Thus, for example, it will be appreciated by those skilled in the art that the diagrams herein represent conceptual views of illustrative structures embodying the principles of the disclosure.

[0026] In addition, it will be appreciated by those skilled in art that certain methods according to the present disclosure may represent various processes which may be substantially represented in computer readable medium and so controlled and/or executed by a computer or processor, whether or not such computer or processor is explicitly shown.

[0027] In the claims hereof any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements which performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. Applicant thus regards any means which can provide those functionalities as equivalent as those shown herein. Finally, and unless otherwise explicitly specified herein, the drawings are not drawn to scale.

[0028] By way of some additional background, we begin by noting that the demand for gigapixel-scale cameras and imaging systems has been steadily increasing given their recognized utility in a variety of applications including broadcast media, imaging, virtual reality, flight control, transportation management, security, and environmental monitoring, - among others. Notwithstanding this considerable demand, utilization of such gigapixel systems has been tempered due - in part - to the cost and system complexity of such gigapixel systems coupled with recognized computational and communications challenge(s) of gigapixel image management.

[0029] Given these infirmities, the art has directed considerable enthusiasm towards Monocentric Multiscale (MMS) imaging systems and cameras that may advantageously reduce the cost and complexity of gigapixel imaging systems due to several design and technology breakthroughs. Notably, and as will be readily appreciated by those skilled in the art, MMS imaging systems and cameras advantageously achieve both high angular resolution and a wide field of view (FOV) in gigapixel scale systems. In contrast with gigapixel astronomical telescopes and lithographic lenses, MMS imaging systems and cameras according to the present disclosure may advantageously be manufactured and assembled using commercially available, off-the-shelf components and methods, while the former may only can be realized in precisely controlled lab environment with purposely developed tools and materials.

[0030] We note that the architecture of an illustrative MMS system generally resembles that of a telescope. More particularly, one layered monocentric spherical objective lens is shared by several microcameras, wherein each microcamera covers a portion of an overall FOV - denoted as microcamera FOV (MFOV). We note further that refractive telescopes may be classified into Keplerian systems having an internal image surface and Galilean systems having secondary optics positioned before an objective focal surface. Yet while MMS systems may be designed according to either of these two classifications, and that Galilean systems achieve a smaller physical size, prior art MMS imaging systems and cameras all adopt Keplerian design(s) because such architectures more readily accommodate overlap between adjacent microcamera FOV and because they are easier to construct. [0031] As will be understood and appreciated by those skilled in the art, field of view (FoV) and instantaneous field of view (iFoV) are two basic measures of camera performance. Conventionally, FoV describes the angular extent of a cone around the optical axis observed by a camera. As is known, fisheye lenses have long been used to achieve wide field of view imaging. For example, the Ricoh Theta and the Samsung Gear 360 capture 360 ° x 180 ° images. Despite such impressive FoV, distortion and aberration in fisheye systems severely limits iFoV. For at least this reason, systems that capture a wide field of view by computationally stitching images obtained using temporal scanning or camera arrays have become increasingly popular. Note that higher resolution full solid angle imaging has been implemented in camera arrays like as the Facebook Surround 360.

[0032] Several platforms have recently been developed that generalize 360 camera design to include more diverse parallel camera architectures. While a camera array can be designed to cover any FoV and iFoV, the cost of such systems increases nonlinearly as iFoV decreases. One fundamental issue is that as iFoV decreases entrance aperture must increase. Those skilled in the art will readily understand that lens cost increases nonlinearly with entrance aperture size and such cost is raised still further if FoV per microlens decreases as required by conventional scaling - since the number of microlenses required to fill a given field of view must then also increase as iFoV decreases.

[0033] In sharp contrast, multiscale designs in which a parallel array of microcameras share a common objective lens, have been shown to allow wide FoV over a wide range of aperture scales. Monocentric multiscale (MMS) designs using a spherical objective lens and microcameras mounted on a spherical shell have been particularly effective in this regard.

[0034] While previous works by the instant applicants has primarily focused on multiscale design for lens systems with a conventional, cone-shaped FoV, this disclosure describes novel MMS designs suitable for wide angle applications commonly associated with fish-eye lenses and ring-shaped camera arrays. [0035] At this point we note that focus control presents a considerable challenge for conventional wide field imaging systems. More particularly, even if a fish-eye lens can reasonably focus on a scene in one configuration, the design of such lenses for focal accommodation is extremely challenging. And while we do not explicitly discuss focal accommodation in this disclosure, we note that the ability to independently and locally control focus state in each microcamera of an MMS system is a particular advantage of such MMS systems. Notwithstanding, we recognize the significance of work relating to focus control strategies and note that these strategies can be implemented in the systems disclosed herein. We now show how spherical geometry of MMS systems allows a variety of novel field of view alignments according to aspects of the present disclosure.

[0036] By way of illustrative example, we note that security cameras are oftentimes installed on a ceiling or pole overlooking a target field of view. Complementing such installations, contemporary systems oftentimes incorporate mechanical pan-tilt-zoom components that allow a camera to scan wide angle fields with high resolution.

[0037] Alternatively, such security camera systems may combine a wide-angle spotting camera with a long focal length narrow field slew camera. In operation, when an event of interest is registered by the wide-angle camera, the long focal length narrow field slew camera will be directed into that event and capture high resolution details.

[0038] As those skilled in the art will readily appreciate however, there are at least three disadvantages to such camera system configurations. First, only one region of the full field is captured in high resolution. Second, the response time and mechanical motion speed may be limited and unable to keep up with rapidly changing events - especially when several events take place simultaneously. Third, mechanical components may render the entire system unreliable and afflicted with high maintenance cost.

[0039] In sharp contrast, MMS achieve a wide field and a high resolution in real time. With such an architecture, parallel small aperture optics outperforms the traditional single aperture lens thereby providing a significantly improved information efficiency. In addition, the MMS’ shared objective lens results in a more compact layout as compared with that of multi-camera clusters. Since MMS imaging sensors are tessellated over a spherical surface - as long as there is no notable inter-occlusion occurring - a target from any spatial angle can be imaged by a microcamera appropriately configured.

[0040] Those skilled in the art will know and appreciate that there are numerous ways of arranging a microcamera array hence the configurations of the FoV. This flexibility offers great opportunities for different FoV configurations and other camera set ups for various application scenarios. In addition to arrangement flexibility of one MMS lens, more configurations can be realized by using multiple MMS lenses as a combination.

[0041] As an illustrative example, we have previously described a design for compact wide field imaging using three MMS systems. In this disclosure, we now disclose and describe enhancements to our designs to include compact 360 ring cameras, multifocal length/extended depth of field systems and full sphere imaging systems. We note however, that the illustrative designs presented herein are intended as simple illustrations of the potential of systems constructed according to the present disclosure while - in practice - systems can be constructed which cover an arbitrary field of view and depth of field.

[0042] As will be readily understood by those skilled in the art, conventional cameras capture images in a rectangular format due to the format of film, electronic sensor and display devices. In most cases, the captured FoV is slated to be fully streamed for rendering, e.g. the FoV shape/format of any captured image data is determined by the rendering convention employed.

[0043] As technologies in optics, electronics and computation advance however, this close coupling between image capturing and rendering needs to be decoupled to further exploit image information and further creation of novel functionalities. We note that an arbitrary image format realizable by synthesizing image frames derived from multiple focal planes. Additionally, as new image and video rendering technologies are explored and subsequently developed, alternative image navigation methods will become readily available for development of new ways of rendering.

[0044] As will be further understood and appreciated by those skilled in the art, an

MMS lens expands its FOV by adding up small size secondaries. The resulting, ultra-high information capacity advantageously allows for a myriad of FoV configuration options and image resolution formats, which provides widespread applicability to new and different application scenarios.

[0045] As will be known and appreciated by those skilled in the art - with systems including an MMS architecture, the microcameras are packed or otherwise positioned on a spherical surface. Accordingly, the extent and format of the FoV captured are determined by the manner of packing the microcameras. And while such positioning/packing is a relatively trivial task in case of a 2D plane, close-packing on a spherical surface can be much more challenging.

[0046] We note that depending on the extent of a targeted packing region, either a local packing or a global packing strategy is preferable. A local packing strategy is preferred if the packing region comprises only a small fraction of the whole sphere onto which the microcameras are to be positioned.

[0047] Turning our attention now to FIG. 1, there is shown a schematic diagram illustrating hexagonal close-packing for a localized FoV output according to an aspect of the present disclosure. As illustratively shown in this figure, the packing region covers approximately 90 ° c 50 ° FoV, and with the hexagonal close-packing employed, the microcameras are aligned along lines of latitude. This packing method produces a near rectangular FoV coverage resembling a conventional image format that produces a cord ratio defined by the following:

[0048] As a matter of experience, a chord ratio value less than 0.17 creates small perturbation and uniform packing density which leads to a high image quality and reduced lens complexity. Observing this rule of thumb, a hexagonal packing strategy can only achieve a maximum latitudinal angle span of 60 ° .

[0049] We note that additional previous work has implemented a packing strategy based on a distorted icosahedral geodesic. By iteratively subdividing a regular icosahedron that is projected onto a sphere, this strategy produces an approximately uniformly distributed grid of circles on the whole globe.

[0050] FIG. 2 shows an illustrative close-packing of 492 circles on a spherical surface using a distorted icosahedral deodesic method (strategy) according to aspects of the present disclosure Even with such an extensive global packing method, the full extent of the packing area is nevertheless limited as light paths from different channels may interfere with each other.

[0051] FIG. 3 shows an illustrative diagram of an obscuration occurring when two microcameras are positioned in each other’s light path according to aspects of the present disclosure. As may be observed from that FIG.3, when close-packed regions expand to approximately 180°, the light paths are interfered by sensors located on opposite side(s) of the globe i.e., spherical lens. Of course, the maximum packing angle is also dependent upon specifications of the optical system employed.

[0052] At this point we may now estimate a maximum angle cFoV within which a light path stays obscuration free. We note that a MMS lens of Galilean style exhibits the following parameters: the focal length of the spherical objective lens is f 0 , the radius of the objective is R , the distance between the stop and the center of the objective is d 0s , the distance between entrance pupil and the center of the objective is h, the half FoV angle of each sub-imager is a.

[0053] FIGs. 4(A) and 4(B) show the calculation of maximum packing angle cFov in which: FIG. 4(A) illustrates a light path of one channel in an MMS lens; while FIG. 4(B) illustrates a maximum packing angle given specified design parameters according to aspects of the present disclosure.

[0054] As depicted in FIG.4(A), an imaging channel is located on the margin of a multi-channel MMS system. The line which connects the entrance point of the marginal ray with the center of the objective lens serves as another margin of this multi-channel system. If all the channels are confined by the cone included by these two margins, this system is obscuration free.

[0055] The clear semi-diameter of the objective can be approximated as:

where f is the overall effective focal length.

[0056] The free angle cFoV can be determined from the following relationship:

[0057] Assuming an illustrative design wherein chief parameters are: /= 20mm,

FI# = 2.5,/o = 47.06, R = 21.11 mm, d 0s = 21 A9mm, a = 5.7 and substituting these parameters into EQN.(2) and EQN.(3), we have a clear angle of FoV, namely cFoV= 77.35 ° .

[0058] FIG.4(B) shows this free packing cap as the top portion of the sphere illustrated therein. As we shall now describe, this set of design specifications will be used to show an illustrative configuration with a ring-shaped FoV.

[0059] We note - and as will be readily appreciated by those skilled in the art - numerous contemporary applications benefit from cameras with a ring-shaped field of view - such as used for security purposes in parks, squares, traffic circles and entry/exit ways, where the top and bottom views with content are not of concern. 360 ° ring FoV cameras are developed to increase situational awareness in surveillance, navigation applications and in Virtual Reality (VR) and Augmented Reality (AR) for stereo effect [19], 360 ° photography is also called panoramic imaging. A common way of doing panoramic imaging is by tiling multiple cameras in a circle. As mentioned previously, this method usually ends up with bulky and costly hardware. The rest of the section shows how MMS architecture deal with this subject with superior dexterity.

[0060] FIGs. 5(A), 5(B), and 5(C) show schematic diagrams of illustrative MMS optical imaging systems with ring FoV in which: FIG. 5(A) shows an MMS camera on a pole with a FoV of a ring area while FIG. 5(B) shows an 165 circles packed on a belt on a top hemisphere with polar angle ranging from 43° to 76° while FIG. 5(C) shows an illustrative layout of an MMS lens design - according to the present disclosure.

[0061] As illustrated in FIG.5(A), consider an arrangement wherein a camera is installed on the top end of a pole which is 4m above the ground. The view angle (the angle formed by the upright pole and the dotted lines) of the camera is 45 ° when aiming at the inner boarder and 75° when at the outer boarder. By simple calculation, the radius of the inner border is 4m while the radius of the outer border is about 14,93/??, The distance between the inner circle and the camera is about 5.67 m and that of the outer circle is about 15.45/??.

[0062] A square image sensor chip would be ideal for MMS lens design for its advantage in producing a mosaic. The effective focal length /is chosen to be 20 mm, which is adequate for the required angular resolution. The aperture size is FI# = 2.5 and the FoV of each sub-imager (microcamera) is 11.4 ° .

[0063] Since the monitored area covers an extensive area of the hemisphere, a local packing method would lead to an inferior quality in terms of packing uniformity. Here we configure our MMS lens by choosing a group of circle slots that resulted from the distorted icosahedron geodesic method shown previously in FIG. 2. The corresponding slots with microcameras are highlighted by patches in FIG .5(B) and in FIG. 5(C) shows the layout of the corresponding optical design.

[0064] FIGs. 6(A) and 6(B) show illustrative imaging performance of a 360 ring

MMS lens in which: FIG. 6(A) shows an illustrative layout of one channel of 360 ring Fov MMS lens design while FIG. 6(B) shows an illustrative MTF curves according to an aspect of the present disclosure.

[0065] With reference to these figures, we note that another optical design now disclosed includes 165 microcameras covering a polar angle from 43 ° to 76 ° . The covered FoV is not exactly equal to the required due to discretely added FoV with step of 11.4 ° of each channel.

[0066] FIG.6(A) shows the dimension of one channel of the optics. The spherical ball lens has a radius of 21.11 mm and the total track of optics is 60 mm. The image area of each focal plane is 2.8 mm c 2.8 mm, the resolvable pixel pitch which can be estimated by MTF curves shown in FIG .6(B) is about 1.67m/??, therefore, the resolution elements of each focal plane is about 2.8 mega-pixel. The total resolution elements is approximately 500 Mpixel. [0067] As will be understood by those skilled in the art, for a single focal length camera, magnification varies for objects at different ranges. The further the object from the camera, the smaller the magnification. As will be appreciated, this property may cause difficulty in recognition of objects dispersed over a deep depth of field.

[0068] One solution to this problem is to employ a zoom lens. Such a zoom lens adjusts (zooms) to a long focal length for distant objects and to a short focal length for close objects. Another alternative solution employs a camera cluster that includes multiple cameras exhibiting different focal lengths wherein cameras exhibiting a long focal length employed for distant objects and cameras exhibiting a short(er) focal length for close(r) objects.

[0069] As compared with these two techniques, an MMS lens architecture provides a more compact, more modular and less expensive way of conducting multi-focal imaging. In a MMS lens architecture, the overall effective focal length of any individual channel can be varied by changing its design of secondary optics. By applying different secondary optics, we can advantageously integrate multiple focal lengths within a single optical system.

[0070] FIG.7(A), FIGs. 7(A), 7(B), and 7(C) show schematic diagrams of an illustrative multifocal system in which: FIG. 7(A) illustrates monitoring traffic along a street from one end, while FIG. 7(B) shows illustrative multiple imaging channels of optics employed, and FIG. 7(B) shows an optical layout of a multifocal system according to an aspect of the present disclosure.

[0071] FIG. 7(A) shows illustratively an arrangement for supervising a stretched street from one end of the street, wherein the object plane is a narrow, tilted strip that results in large, object-range- variance as measured from the camera’s perspective. In such illustrative arrangement, the viewing angle ranges from 25 ° to 85 ° . To capture detailed information over this entire strip, a multifocal system is advantageously employed. [0072] FIG.7(B) shows an illustrative MMS lens covering different street segments with channels of varying focal lengths. As the segment moves away from the camera, the respective channel increases in its focal length for a more uniform ground sampling.

[0073] Those skilled in the art will understand and appreciate that it is impossible to achieve a uniform sampling with a finite segmentation of the field of view. However, we can attempt to obtain a nominally uniform sampling with a multifocal imager having equal magnification in the axial field point of each channel. In this illustrative example, we may install the camera lOm above the ground with each channel covering a 10 ° area and 1.5 ° overlap between adjacent channels. With 7 channels, the total range of the surveillance is about l lOm. The focal lengths of each channel and the respective object distances of central field of view are tabulated in Table.l.

Table 1. Axial object range of each imaging channel for a quasi-uniform

sampling rate

[0074] With continued reference to this figure - and as shown in Table 1 - a uniform sampling rate over the entire street requires a focal range from l5mm to 59.39mm which requires a 4x zoom capacity. Unfortunately, however, our illustrative MMS design only achieves a focal range from l5mm to 40mm. As a result, the 7th channel cannot satisfy a quasi-uniform condition. Notwithstanding, a varying sensor pitch can be employed to compensate for this.

[0075] FIG.7(C) shows an illustrative layout of such a lens design and size(s) of some critical dimensions. The MTF curves for each channel are shown in Fig8. For a given primary objective lens, there is a mostly matched system focal length at which optimal imaging performance is achieved. However, the performance degrades mildly as the focal length deviates from the optimally matched.

[0076] FIGs. 8(A), 8(B), and 8(C) show plots of MTF curves of each channel in multifocal MMS lens design for: FIG. 8(A) MTFs of on-axis FoV; FIG. 8(B) shows MTFs exhibiting a 0.707 FoV and FIG 8(C) shows MTFs having a marginal FoV - according to an aspect of the present disclosure. As may be observed from these figures, channel 4 exhibits highest MTF for both on-axis and off-axis FoVs while a satisfactory performance can be obtained as the focal length scales on either side with a zoom ratio about 2.7x. Detailed design prescription data is available in Table S2.

[0077] As discussed previously, light path obscuration prevents arbitrary FoV configuration for one MMS camera. Nonetheless, this limitation can be surmounted by a combinational use of multiple MMS cameras. One such example that has been demonstrated is where multiple MMS lenses are co-boresighted to interleave a continuous coverage of a wide FoV. Here we disclose yet another example.

[0078] With respect to the 360 ° ring FoV lens described previously, we note that the viewing angle ranges from 43 ° to 76 ° . However, light occlusion occurs when the covering area approaches the equator as shown illustratively in FIG. 3.

[0079] FIGs. 9(A) and 9(B) show illustrative approaches to 360 s horizontal FoV optics including: FIG. 9(A) shows an illustrative layout including three back-to-back MMS lenses and FIG. 9(B) showing an illustrative interleaving strategy with MMS lenses stacked - according to an aspect of the present disclosure.

[0080] As illustrated in FIG. 9(A), one solution according to aspects of the present disclosure is characterized by configuring three MMS lens positioned back to back with each one covering a FoV larger than 120 ° . Collectively, a 360 ° panoramic image in horizontal direction is captured without occlusion.

[0081] Another configuration according to aspects of the present disclosure provides a spherical camera where free spaces are reserved between adjacent optic and sensors for light to pass through. To achieve this field of view using a multiscale array, some microcamera positions are saved for light passages. For a continuous FoV coverage, we combine image patches captured by multiple MMS cameras together.

[0082] Turning our attention now to FIG. 9(B), shown illustratively therein are four MMS lenses stacked vertically and interleaved for complete coverage of 360 ° horizontal FoV. In a most simple configuration, all four of the MMS cameras are identical, only being twisted relatively for staggered angular positions. The cone angle of each small circle here is 10 ° , the number of circles along one orbit of the sphere is 36. While we have indicated that all four cameras are identical, those skilled in the art will know and appreciate that such identicality is not a necessity.

[0083] FIG. 10 shows illustrative microcameras and light window(s) of a 360° horizontal FOV imager according to aspects of the present disclosure. As illustrated in that figure, each microcamera is directed toward a respective clear tunnel each providing a reserved, circular view arranged horizontally, which advantageously provides a near obscuration free light passage. Detailed lens design data is shown in Table S3.

[0084] Finally, we now present a final illustrative example that is a omnidirectional camera which sees in all directions with uniform angular resolution. Previously in this disclosure, we estimated that the largest obscuration free angle for a MMS lens is less than 80 ° which implies a minimum of 4 MMS lenses are required for a full 4p spherical FoV coverage. Each camera of the four is positioned at one of the vertices of a regular tetrahedron and covers a solid angle slightly more than p steradian. The extra coverage is for overlapping. [0085] FIGs. 11(A) and 11(B) show illustrative tetrahedral geometry of full spherical MMS lens in which: FIG. 11(A) shows illustrative space segmentation with four MMS lenses with each one covering a quarter of the full sphere; and FIG. 11(B) showing illustratively close-packed microcameras on one of the four segments - according to an aspect of the present disclosure.

[0086] As illustratively shown in FIG. 11(A), the area projected by one of the triangular surfaces of a tetrahedron on its circumscribed sphere dictates the minimum covering area of each MMS lens. The largest field angle for this triangular spherical patch, as depicted in FIG. 11(A), is 125.26 ° . As shown in FIG. 10(B), we crop out a packing patch from a close-packed globe with the distorted icosahedron geodesic method.

[0087] FIG. 12 shows illustrative layout view of a full spherical MMS lens according to aspects of the present disclosure. The geometry shown in that figure is a 4p full space camera bounded by a sphere having a radius of 14mm. Advantageously, this illustrative imager has a potential of achieving a uniform angular resolution of ifov=83p rad over complete space coverage employing the MMS lens design prescription used in our first example above and detailed in Table SI.

[0088] To provide a quantitative perception about all the design instances disclosed herein we provide Table 2 that describes field of view configurations, angular resolution, information capacity and physical size of each instance. This table helps verify the effectiveness of the MMS lens architecture in building high pixel count, versatile field of view configuration cameras with compactly small form factor.

[0089] At this point, those skilled in the art will readily appreciate that while the methods, techniques, and structures according to the present disclosure have been described with respect to particular implementations and/or embodiments, those skilled in the art will recognize that the disclosure is not so limited. Accordingly, the scope of the disclosure should only be limited by the claims appended hereto.