MOLTI-LBNS ARRAY SYSTEM AND METHOD

David Boyd. Pollock Patrick John Reatdon

Tteso4<$'C5 Ba$ Rogers Christopher Nόsitisn Underwood

Geoffrey Bgπal

Bennett $MJipSό» Wilbtms

Stefben Kenneth ϊ'italo

PRϊQRπΎ

Tfets application clmms priority to U-S. Provisional Patent Application Serial No. 60/772,670, entitled "Multi-Lens Array System aad Method," filed February 13,:2OO6. ₅ \li® disclosure of wlϊfch is mcorpόrated.by reier^ncs iiereis>

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR

DEVELOPMENT

[0002]| Tliis Irtve^doπ was m&k. with Government χ5«p:poτt røder. BARPA C^Mf adt

No. ^B€ilCO5OO90 awarded by Jh» U.S. Deρaϊtmeftt _; of the Interior - Natio«iil Business Center cm behalf of a Department of Defense Agency - Defense Advanced Research Projects Agency. The Government has certain .rights in the invMtiαvL

BACKGROUND

[0003] Image capture systems have existed m a variety of forms since the asceptkm of photography. One type of image capture system includes a» array of cameras Used tø capture $$yes&i. Images that are .at$i?hed. toget^er to fotm. a _: 4i%ie. unitary image or a composite Image. While a variety of methods < -mά

apparatuses for capturing images have been macks aad used, it Is believed that no one prior to the iaveators has made or used the invention, described in the a$ρ.©Med claims

BRIEF DESCRIPTION OF THE DRAWINGS

|0004| While the specification concludes with claims which particularly point ous a»d distinctly claim the kvestioa, it is boiksveά the present iaysaiios will be better aMe∑sledd from the -following description, of oerfetm samples taken in conjunction with the accompanying drawings, m which, like reference numerals identify the same elements and m which:

[0005] FlG. I dφiets m;t£%mpl$sy- .usage esplrøϊ aiϊd to«sm.issio« syst^tij

[0006] MG. 2 depicts a perspective yfew of an exemplary mount for aα army of

[0007] FIG, 3 depicts a cross-ssoiionai view of the mcnmt of Fϊ<X 2, token* along Tme

|0008] FϊO, 4 dfepipts a perspective view of the .mouM of FlG. 2 ^' with & plurality of cameras moimted thereto;

[0009] F|G, 5 depicts a cfcδss~s.ec&rørt -view- of the .aount. of FIO.4, taken siotig: Ike.

5-5;

[ 0010 ] FIG, 6 depicts a perspective view of an exemplary collar suitable for securing a camera to the mount of FIG, 2;

[011] FIG, 7 depicts a ^: erόss-$ecdøiial view ofihe collar :o.f FIO.6;

[ _. 0012] Hϊ& % depict _? a eross-seόtioimϊ view of the ^' tάomt. of FIG, 2 secured to a fuselage;

(0013] FIG.9 depfcts an exploded view of an exemplary lens assembly;

[0014] FIG. 10 depicts a cross-sectional view of the lens assembly of FIG. 9;

[0015] HG. 1.1 depicts .light passmg ihroagb tens elements of ilie lens ss$embly of

FIG, 9;

[0016] FIO, 12i. dφjøts light passing., tho/ugh. .©røϊ$aty alternative Is»s elements suitable for use in the lens assembly of WlQ. 9;

[0017 HG. 13 depicts a partial cross-sectiαnal view of the k»s assembly of FIG. 9 mounted to the mount of FlG. 2; mά

|0018] Flβv 1.4 depicts a flow ύmi -.showing acfe ia. aa sxssaplpy image prpc^sskg

-.DETAILED DIS€RIPXϊOH

0019 The folbwing cissmptjdtt of certain ^«ϊftp»Jes of the mveMion sliouM άot ^' ϊϊe

«Seά to limit the- $eope of the present invention. Other examples, ibaiures _? . aspects, embodiments, and advantages of the Invention "will become apparent to those skilled in the art ito.m the foUøwmg description, which is by way of iϊϊustialion _j .oae of tlie best modes contemplated for carrying ø«l the invention. As will be realize the kyeπtioα is -capable -of other dϊfjtønt a»d ol^vJptis aspects, all without departing irom the invention. Accordingly, the dniwEngs atid descriptions should be regarded as illustrative m n&ims: &nύ not restrictive.

|0020]| λs sbown lit FIG. l _* :Sϊκt.astvMl. be: described -Its greater detail bdow, the .ϊmag^ ckptύit: system of lite present eκ;anip.fe employs the. use . of an aircra ^' H (10) .fbr ^' ih& capture of overload, wϊde-aiigle video Images of \nόpB {12),, factiities, cities, or other places or things within the field of view of the image capture system, Ai least a portion of. the captured imsge-s ate transmitted in approximately real time- to a ground station (1.4). While not depicted & plurality of ground stations (14) may be provided, with at least one ground station (14) acting as a relay between other ground stations (14) and aircraft

[;0021] While aircraft (10) depicted in FSG. ϊ is an immatmed drone, it will be appreciated thai any other type of aircraft (.10) may fee tts&ύ, including bui not limited to a maimed airplane* a helicopter, an airship, a balloon, or another type of aerostat. It will also be appreciated that an image capture system may be used m any other type of vehicle, meiudiag bat not incited to..1atκ! vehicles _* watercrali, etc, Alternatively, m image capture system may be secured to a structure k a feed location such as a tower* bailding, «*e. An image capture system may also include θ eo.røbiπartem of images captoring _. portions- In. sars aϋrcrafi or other vehicle aod image capturihg pftious secured to a fixed locaiioB- While several, examples herein contemplate an image capture system bsiάg odeatod yett^ώy, such that its vi«w is directed generally dowmvb'4 it v?ilϊ be appreciated thaϊ image capture systems described t&rdn may also be oriented Iiomontaϊϊy or provMed In any other suitable orientation. Otlier ways in wflich .a» imag? <&ptes system may fee prodded mά «se«i will be apparent to ifeβse of ordmary sMl! ^" in ttee art. :

[022] As shown in FIGS, 2-5, the image capture system of the present example comprises a camera raøuϊrt (20) or optical bench. Camera moimt (20) may comprise acrylic, polycarbonate, or any other plastic, βiuminum or any. -other meta^. or any other materials), indudiag combinations thereof. As shown, αarøem.møύni _. (2 ^! 0).feas a dome-like cony£x porfibn (22\ aπd&.Iip (24), !whkh. defmes a circimiference of camera, rooiuit (20) and extends rssdlally oHlward Alternatively, lip (24) may have any suitable aiigle or other coMiguratioa. By way of example øniy _> . Hp (24) ήiay bave jfe tener diameter between approximately 46% iπdwjsive _λ and approximately 48"; incisive; mύ m mtix diameter between approxϊmatøiy 48", kclusive* mά approximately 50% ihdysivβ, Aitematitel^ anyothe^ inner or outer diamster.may.be tised. i ^:

|0023] Convex; portion (22) has _. an outer surface (26) and an inner surltce (2S) ₅ and a plurality of opersings (30) formed tlsersthtougk Itx t&e pre$e«t ex-ample, convex; portion (22) hø$ 271 openings (30), each being configured to receive a camera (40). It will be appreciated, however, that any sαiiabb πuniier of

openings (30) may be used, including but not limited to Jess tfcan 100, more than 100, more that* 200 _} more than 300, or any other suitable number. Bach opeftiag (30) of the present example has a diameter of approximately 38 mm _> though any other diameter may be used. By way of example only, convex portion {22) _: may have ^' an inside -radius of exirvstes between approximately 24% inclusive and approximately 26% imήuύva; and. an outside mά\xι$ of curvature between approximately 24.125% inclusive, and approximately 2fr ϊ25% iftclι$si¥& Convex portion {22} of the jrøsgefct example Ms an. I»si% radius of curvature of approximately 24% mά an outside radius of cutvafiire of approximately 24,125**. Alternatively, any other inside or outside .radius of curvature may be used.. It another mbόdimeπ^. couvsx psaiiαxi (2ϋ|);hss a hyperbolic or parabolic άirvalure. Other ssuϊtablo coMigtirstibos wilt t><≥ aρpas^»t to those of ordk&ry sMl.1 in the art

|0024] IB αnofh^c aι»bo.dmignt _j cainm mόmt (2Q) is geimally fiat 1«. this embodiment, eacli caisera (40) may be aimed ui a common, phantom point or may be otherwise orieatei !n other words, wherέ camera momit (2θ) ts generally flat, ih& lines of sight of cameras (40) may nevertheless intersect m a maatier similar to lfeat described herein witb respect to tbδ carved camera mcαmt (20), and such Urns of sight may have relative angalar relationships _. similar tø ^' _. lhpsβ descrilved heteiii with respect to the .curved camera mount, ϊn still aaiother embodkient cameras (40) are provided m a variety of sixes. For instance, a relatively large camera (40) may be provided in the crater of an army ø£ relaϋyely smaHer cat^r^ (40}> Sipulajtiy^ severaϊ camem (40| may be provided with dϊffereBt optical properties or other diltemig properties. It will therefore be appreciated that all cameras (40) mourned to camera mount (20) need not be umfom# the same. ;;

[0025] Each camera (40) of the present exaiϊipϊe comprises a seasor portion (42) said a lens portion (44% which wilt be described in greater detail below. C&nsras (40) are positioned on convex portion (22) of camera xnotmt (20) such that Q&ck tens portion (44) k σmntisά mύMly inward Ir will &εrefoπ? be

appreciated that, where a plurality of cameras (40) are secured to camera mount (20} _? lens portions {44} of cameras (40) will have intersecting lines of sight Each km. portion (44) of the. present example is secured to convex portion (22) by a respective collar (50), an example of which is shown, in. FIGS- 6 SB<J ?i As shown, each collar (50) has a sMewall (S2\ a« . inner recessed portion (54), and att outer .recessed portion (5$). Bach sidewall (52) has a plurality of threaded openings (64) formed feeretbrough. Jitne ^y recessed portion (54) has an inner -shoulder (58) .exten#ιg _: ta.dtai.ly toward; whitøpμlsr. recessed portion (56) has an outer shoulder (60) extending radially oiύtvarti As js also shown, collar (50) comprises an angled portion (62) that defines a iτ»st«omo&l. a|>ert«re, .AiegMI pottion (62).is adjacent to iimer slioiαideξ (SS)j mά defines an angle of apprøxwπafely 60 ^ώ relative to inner δhoulde? (5^). Of course, any other suitable osrientatioti or co«fig«ratioii may be used.

|0026]] IB aαofher embodkieM, a _. pδB~tiit-2θom (PTZ) camera {net show») Is used u% comhxmlwn with cameras (4Q), Such a FTZ camera may be iβouated to tbe satiie platfbnn ®$ cameras (40). In Mάition, or in tlis alternative, a FTZ c-amera may l>e located elsewhere, As yet another variation, a camera system sucii ?B one described in US, Pub, No. 20067002S550 _. , entitled *S«rvei3Iance System and Mδtliod," the disclosure of which is incorporated by reference herøn<i is ysed m combination with cameras. As with te I^TZ -camem. described above, such a camera system may be generally co-located with cameras (40) and/or may be located elsewhere. Other cameras or camera systems that may be.smmbie for combiπkg with φmetas. (40) wJli be appsreM to tiiαso of ordinary skill m the art. ^;

|0027] in tbs present example, collars (50) are secured to camera mount (20) by inserting oiύ&c recessed portion (56) of each collar (50) into a respective opeakig. ^' PG), such that outer shoulder (60) is .adjacent to outer surface. (M) of convex portion (22). It w.Ul be appreciated that this may he repeated imXϊl every opesiag (30) has a eomjspondmg collar (50) inserted therein, tμ one embodimeM^ collars (50) are secured to convex poriios (22) usiiig an adjbslve

or epoxy, in another embodiment _s outer recessed portions (56) arid opemags (30) are -threaded, such that collars (50) may be screwed into openings (30), Still otttor ways m which collars (50) røay be secured to camera mcmtif (20) will be apparent to those of ordinary skill i» tlte art, itιch.κimg but not litmtød to welding, mterføreftce βtiitig, or a«y other tecteiques,. Alternatively, camera mount (20) may be constructed mch. that collars (50), or structures similar thereto, are integrally formed with camera mown (20). Of course, any : other tec|».iiques w gtrμetiires fer«eς»rmg cameras {40) to camera mount (20| may be used. ώ. other word% collars (50) sαcϊx as those described herein are merely optional

[0028] Befoi^ Pϊ st\er eølifrs (50) ar^ secured: to .eamera mount (20% tens ρ®$i(>n$

(44)» ϋts røserte.4 hήo dollars. (§0) a»d secsml thereto. 1« psrUwføϊv et Isus portion ^' (44) is ksetred mto each collar (SO) s^ch that fe distal <κ objective end ofletjs portion (44) is adjacent jmier shoulder (5S). Bach teas portion (44) is tbsa secnrδξd to its eotresponditig coMar {50} by Inserting -and tigbtentøg a set screw (not shown) mto threaded openings (64) formed tføough sMewail (5 J) of collar (50). It will be appreciated fhat len$ portion (44) may be any commercial off-the-shelf (COTS) Ions assembly, and that each earners (40) may be a COTS camera. The use of set screws or other devices may pxsrmit collar (5Q) to ∑'iCCOϊHmo.date amϊ secure i?sa*k>:as t)- ^» ρes of fens pαrtioM (44) having various outer diameters.

|0029] Alternatively, the mside of sidewall (52) may be threaded, such that; Ims portkm (44) may be screwed into collar (50). Still other suitable structures and techniques for seeurmg fens, ptortloti (44) to collar (50) will be appateiit to &όse of ordinary Mil m th$ art. ilitemaiwsjy, lens portion (44) may be coπϋgured such that a structure sii»i1.ar to collar (50) is integrally formed tlisrewiih. It will tlierόfore bø appredsted irom I6ns porlfori.(4% is merely o|>tiorjal _?

[0030] FIG. 8 shows camera mount (20) secured to the fuselage (80) of aireπrft (10) by a fixture (70), In one embodiment, fixture (70) comprises & "Fictor^isioa XR" structure by Pictorvislon Inc. (formerly Wescam), of Van Nays, California. Of course, any other type of fixture (70) may be used. It wi|ϊ also be appreciated thai fixture {70} may have my of a. variety of ^' propertied For instance, fixture (70) may be substantially rigid, such ifeat fixture {70} prohibits movement of camera mount (20) relative to fesekge i($0). Alternatively,, ikture £70) may sβmprisg gimbaii features or similar features, permitting some degree of movement of camera mount (20) relative to fuselage (80), It will also be appreciated that fixture (70) may compiisejpads, cusMbns; _. resilient members, etc;, coitSgύred to provide dampening* or other features erøOgareel to prevent transfer of vibrMkms irom fuselage (W) Xo camera mount (20). Still øtfosr suitable features and coϊxδgurations for iixtwre (70) will be &ppama to these.of ordkary skill m the art. i

|0031] ϊij the presertt exam|>!e, wm4o%v ($2) i$ provϊ&ød m fuselage (80), pemiMόg

^■ cajQieras (40). to **see" through imekge.(80). Ih oifeer wor<is, each eameri. (40) is printed. suc& that ali c^meπis (40) ppmt throiigh a common geatra! apόrture provided, by wmdow (82), More particularly, cameras (40) of the present example have intersecting lines of sight As shøw» i« FlG. S _> tlie Esterssctmg lines of sight of the øutcmiosi cameras (40) form ^: a. ϊ&aximum. cotiverieήce artgϊe (S4), The vertex of this angle (84) may be regarded a$ a ^' ^haintom point." While the lines of sight of the outermost cameras (40) are shown as ^C5ftγergi%:geaάaily a,t window (SS), it _. WiU. be appreciated th^t.tliese .Jipes of sight may converge elsewhere (e>g., above window (S2), below window (S^X etc). Beyond t!he point at which the lines of sight converge, die lines ofjsight diverge thKWjgh wϊtat may be regarded M at .region, of dH'βrgmαe. ϊa. tbe present example, subjeois (g,g, _λ ρerso»s _> places, objects, events, etc.), of which images are captured by cameras {40}* are located vάthm ihk reglφi of (Mverg&i&e.; In o&er ivmάs, tte ^hanidrø ^' point" is positioned betivve^a. tamerss |40) ®ιύ fee ^' sutsject of «?hich images are beiag captect A)trø>ative3y, tbe lines of si^bt may converge approximately at the suMlii

As yet another alternative,, the subject may be positioned sucb, that the subject is located, between cameras (40) and She "phantom point"

|0032]| ϊti the present €xajtφ!& window (82) is substantially. Hat όή both Mde% φjugh; it will be appreciated that either or both sides of window (82) may be curved, such that window (S2) nmy be provided as a lens element. Similarly, while window (&2) α.f. &e ψmβfrt- zmmpte. has a . ^: <S*amet«r ^approximately. £Q2$ mat, it will be appreciated that aay other suitable diameter or dttae«slon(s) may be used,

[0033] In one embodiment , maximum convergence angle (84) is approximately 92°.

In another embo diment, the maximum convergence angle (84) is approximately 81°. Of course, any othe suitable maximu convergence angle (84) may be used. Alternatively _, camera mount (20) may be configured or used such that the line of sigh of th e ύtendiosf ^: oam^s (4Q) dø -liot ooEVφi-ge. It: will also be sφprsokt^ tlmt mOTϊπum cø&vergmce aBgfe -(M) m&y vary as a Iunctiois of the radius of curvature of convex portion (22) of camera mount (20} _s aiid/or a variety of other factors. Those of ordinary skill in the art will also recognize that the fsdd of view obtaiasd by cameras (40) _* collectively, .may be projKHtfOϊial to the maxiffium convergence aøgie (§4) or have some other relationship with the maximum convergence a»gb (84). Alternatively, the fklύ. of view coϋeetively obtained by cameras (40) .may be di$j>tφpoi$oMl tofhe maximum com ^? e?ge«ee m§p (S4). '

|0034]| It wϊlϊbe appreftjafed th&fc, to the extent thatrcamera momU. (20) is ssαireit to &

.raovi«g piatfattn (e.g., aircraft (10)), images captured by θarh:eras (40) May have a tendency to jitter or may otherwise be affected by motion of the .platform. -Sufch allots, may; Mdr»sse4 by stabilizing, camera; mxm$ (20) relative to -the --platform and/or by i?tsbiliaiag cameras (40) rølθtlve to cimera mount (20). For imtaace, a dampening structure or feator-e- may be incorporated Into or between cameras (4ø) _? camera mount (20), ϋbs:tαro _? {7{ ^} )., and/or elsewhere. As noted abovt% swch a dampening stmcture or feslnrd may coϊϊφ«se soy j&mbsr of t^ βjϊiowlBg;^ ^prifegs, mbbrn; or fosm kM^

pneumatϊcsj, gimbals, etc. M additϋøβ, different coaφcmeats of a« image capture system may be dampened m different ways _* if at all Otter daτ$e£*mg techniques, as well as alternatives to dampening, will be apparent to those of ordinary skill in the art :;

(0035.) .Alternately* effects of pJatform tnovsmsat, vjtøtiøjv etc> _* on images ^' captured by camels (40) may be a&trsssed -through processmg of -th« images. Such, "corrective* processing may bs perfomied in addition to or m lieα of the Iϊax4war€~based techniques described above for addressing similar effects. For iαstai&e, -sts will fee described, i« gteatet iføiaiϊ bψfow _* images cagtuitd by cameras (40) may be combined to form a collective,, wide angle mmgej such, that an. image captαre4- by a single camera (40) may be regarded as a "tife" of the ^' larger wώ$β- As will also _: be described m greater detail ^' bebW _j . mosaicking feolintques may i?e used ^" to eiitnmate motion between such tilos («.g,, motion or iramtatiøs of one tile relative to asotber tile); while global ■mott<M:est£maii<5& may fee ased tQ-&dφ©ss mόtjofe of Hie collect^ wlde _. fmgk ii»agi\ Jn otlier wottis-, mosaicking may be used to address xriotiori of osjjierss (40) relative to each other, while global motion estimation may be usαi to address collective motion of cameras (40) relative to the ground, ■

[0036] As exemplary lens assembly (90) is illustrated in FlβS. 9-1.1, M; oad embodiment, lens portion (44) _^ described above,, comprises hm assembly (90). As ^' shόyrø, and as will be fecϊil>ed in greater detail below _* ; kss assembly (}M) comprises a housing (92) or barrel, a plurality of lens olemetϊts (H ^» 9$) _> oapδ (100, 102), spacers (104, 106), «md retainers (J 08, 1.10). A ckcu^ferential flaage (t.20| extends -radially outward, nesr ^' the objective φd of tens assembly (90), ;

[0037] Ia this βxamiple, kπs assembly (90) is ecmilgursd sucli that fcoot lerøs elφimt

(94) Is positioned distaUy (e.g _<? at the objective end of leas assembly (90)} _» rear kϊis element (9S) is positioned proximally, and middle lens element ($<>) is posiliαned between front leas element (94) and rear lm$ element (Mi> It will bo apj)t^ciatώd thaϊ lmi poxtiϋή (44) may coτ.vφπs<5 one -or more fe^

ptovidiag the option of taking lms portion (44) apart for any χmtpøsel For instance, bousing (92) of leas assembly (90) may be cαaβgumd in separate parts having complimentary threaded features, such that tioasbg (92) .day be laken a$>ari by αiϊserøwmg tibese parts from each other. Other ways hi which housing (92) .may be varied will be apparent to those of ordinary skill m the art; i

[0038] As illustrated in FJGS. 10 and Vl, lens assembly (90) is eonSgured such ih&t light (iJ.2) passes through front lens element (94) first, thm tkxmgh twiddle fens tjlemeni ( ^§ 6), then fer&ugh rear less felemen* _. (98),. This $>Joαγ*φ ^& - ^: ∞ image projection (114} to an image plane (ϊ 16), In tliβ present example, .Whexi leas assembly (90) is coupled with, sensor portion (42), sensor portion (42) Is located, within image ptem (ll&% s»di:.that image ptφsiiαs (114) Is ^oei^ed by sensor portkm (42), While several exemplary features of lms dement (94, 96 _f 9S) will be described below, it wøl be appreciated that lens e1em©Ei^ {94, 96» _. θ8) m^y Mve -any other sraiaisle. eαβfigurϋtlofts, a»4 that/.aήy namls^f. or types of leas .eiemexds may &e used. ^■

[0039] Frrøt lens element (94) comprises a convex Srsl surface (ϊ20) and » substMtMly itat second surface (122% Cø&vex irst sιarfacd.{120} hss arkdjiss of curvatiire of approximately 48.785 mm, though any other suitable radius of curvature may be used. Similarly, second surface (122) uee4 not necessarily be sub|taiitia!ly flat, and ..May hm§ Wϊ suitable radks of curvature. : For instance, second surface (1.22) may be sliglitϊy concave In the present example, fkmt .lens elemet)t (,94) comprises a SCHOTT SKIl 6 glass. •AlfcerøatiYoly, any other suitable ghss may be used. i

|0040] Middle Mis element (96) h W<ono&\% Mά comprises a cφήόiive βpf sdrlacq

(124) and a concave second, surtace (126). Concave first surface (124) km s radius of curvature of approximately 135,35 mm; while concave second surface (126) lias a radius of curvature of appiOximately 41.107 mm! Of course, any o&er siύiable radius of curvature may fee used for either or both of coftc&Ϋsλfitst surf ^g cs (1 ^; 24) ϋt confem'e second surfkee (IM). hi tie priβfe

example, -middle lens element (96) comprises a SCHGTT F4 ;;g&ss. Alternatively, any other suitable glass may be used.

[0041]| Rear lens, element (9B). cdiήpHses a Sόi%x first stfrf a$& (I2S) anil, a φrivax secøskl surface (1.30). Convex .first surface (12S) has a radms of curvature of approximately 315,24 mm; while convex second surface (12S) has a radius of curvature ^approximately 03,241 -mm, Qf course,, any .other smtsbleiacBisis of curvature may be used for either or both of eo»vex first surface (12S) or convex second surface (130), In the present example* rear lens element (9S) comprises a SCHOTT $K1€> .glass, Alteimaέivdj'; ajiiy other suitable gϊήύ m&y be used.

[0042] FlG, 12 depicts a series of alternative has olβmβats (140, 142, 144, 14% 148»

150), In this example, first lens element (140) comprises a eo»vex first surface (152) md a concave secόM surface: (15% _. βθsϊond less elemeat:(i42) comprises a ccmvsx Hrsl surface (IS6) aacta s^bstemidly Hat sscesiα surface- (15S). Third lens element (144) comprises a convex first surface {.160) aτκI & substantially fiat second surface (162), Fourth lens element (.146) comprises a substantially Hat first surface (164) and a concave second surface (Mφ. M tMs escaiϊφle, third and fourth kns elements (144, 146) are positioned! ^' suck; that substantially flat first surface (164) of fbnrt.li .lens element (1.46) is adjacent substaβtialiy .flat second surface (162) of third lens element (144), Filth tern .φmsaϊt (I4S) compises asufe^taMsOy fiat&st spxϊace (16S)?aiκl a convex second surface (170). Sktlϊ lens element (15Oj comprises a. convex first surface (172) mid a concave second surface (I.74)> Ia this. &K&mp}& _f BMt Mid sixth lem det»eMs( 14$, 150) are positioned such timt όonvex Srst Stlrface. (1^)S) of skill lcjis element (150) is adjaceiit convex second surface (J?0) of ilMi ϊens element (148). Of coarse, these coafigaratiøos &>r teas elements (140 _? ϊ42, 144, 1.4δ; _> 1 _. 48, ISO) are merely exeMplary, Md any number o;f km elements or lens element -cøa&gαrattosas Btaybe βsed,

|0043] FIG _* 13 shows aji example of liow lens assembly (90) may bs secuφd to camera «iou»t (20). As shows, a portion of the objective e«d of leas asssksfellL

(90) is inserted through camera mount (20), such t&al the eirc-umfφϊntial flange (.120) of lens assembly (90) is adjacent outer surface (26) of camera mount (20), A securing ήng (1 IS) is engaged with, the objective end of lens assembly (9G), and is adjacent inner surface (28) of camera mount (20)> Securing ήng {1 IS) and. clrcϊumfereisSal f&nge (120) thus "$andv?lefe" αamera mount (20), thereby securing lens assembly (90) to csmαa mou»l (20) in a clamping fashion. Other suitable methods lor securing a lens assembly (90) or camera -(4O) to.eamera moxmt (20) will be _: a|»parent to tbos§ of ordinary skill m the art

[0044] Each camera (40) of (he preset example lias the following parameters, each bd»g merely approximate in value: an F~ιwmh$r of 6; an effective! focal

Imφi αfϊBO aim; an image distance of 124 mm; m image size of 2048k204S pixels (or 24x24 mm};- a spec-trai range oif 450-700 ma; a feπgtli of 200 mm; a .field of view of TO-B ⁰ ; an entraice pupil diameter of 30 mm; a depth of HeM rafegmg froai 1.S km to mfmit^ sad a p&el pitch of 12 micrdM. Of <sorøe, each of these listed parameter values is merely e&t*.«φ.lary, ami My? other siύtabϊe parameter values xnzy be used.. For .kstaaee, cameras (40) may feavc a specti^ϊ mage .falling aiywfeere between approxiniat©!y 3001 «α<l approximately 30,000 am, inclusive. In one embodiment,, an image fomied by iSombinmg images captm*ed substantially simultaneously with cameras (48) comprises approxaπateϊy one billion pixels, s«ch that oamsras; (40) collectively form a single "gigapixel camera.** ;

[0045 In tfe pris^it eacample,- each seϊ&or pQήi<m>(42) comprises ^■ % sensor siϋmeαt

(not sbowii} thai is operable to captxite visible HgIiI(^g.. having s wa^efe ^; »gtl.\ betvveen approximately 450 nanoniefers &\ά ψpϊϋxhn&lύy 700 .naϋofefefers). Bach sensor portion (42) may comprise a CCD sensor (e>g^ frame transfer^ interfile transfer, etc.), a GMOS sensor (e. ^; g,, ^:ith. mx. ph&mmo: .rpilmg sfetter), or any other iyp& of -sensor. By way of example oniyj sensor portion (42) may comprise a tWA 4000 sensor by Cypress Semϊcoϊφiotor Corporation of SSΏ lose, California, though any other sensor may be usφl In

one embodiment, cameras (40) are configured to obtain monochrome images. in another embodiment,, cameras (40) &re con.6gu.red to obtain polychrome images, In yet another variation, sensor portions (42) comprise nxCrared imagmg components, such that cameras (40) comprise infrared cameras. Infrared cameras (40) may comprise passive night vision components, ;acti ^γ e night vision components, or combinations thereof. M still another variation, a earner as (40) is operable to capture both infrared mά non-infrared: images,

|0046] ^' Sensor poϊttoas (42) of the present .example &t& cøftligirøs- to provide a global shattier. M oifeer words _{* :} oatrøsπis (4Q) are e-oaøgured to all eapt&m images substantially simd&neonsly and synchroaously. It will be appreciated ϋthat a global sliutter may be provided mecktmcaily and/or electronically. ! For msfemce, -a mechanics or ei^cttwie global shatter may cause the s^osure iims for catii earner a {40} to begin aniiend δt substantially f he same %is as the other cameras (40). Suitable techniques for implemeattng a global shutter ^• wilj _. be af$3Mitt<5 thosø of orditsary sMILmtlie srt. It wilt also hs apprebiatel that a global sfeutisr is ^: not necessary, and ih^i any suiiabfe aitemaiiv.e may M used. By way of example only, an algorithm may be «sed to register pixels to a common time. Suitable methods of implementing such an algorithm will be apparent to ifeose of ordinary skill in the art, as will other alternatives Io a global shutter; \

[0047 Sensor portions (42) amy be secure to corresponding len portions (1 _. 4) in any suitable way. For .instance, SSESOT portions (42) axid lms pottions (44) may comprise complimentary threaded features, such, that a sensor portion (42)/ma# be screwed on to & cortespos^ing lsαs..ρoιtbu.- (44). Altemativefe sensor portion {42} may be configured to clasp or latch onto a coϊtepφding lens portion (44). As yet anoiher alternative, instead of being removably coupled with a corre ^' spottdtøg Utβ portion (44), a sensor portion (42) niay be peniiajiently coupled -with & correspondmg lens portion (44), sueli ks by ^• weMϊπg, usmg adhesive, integmt ^>rmation _s or «si»g otJier techniques. sOtber

suitable structural relationships between htm portion (44) and sensor portion (42) will, be apparent to those of ordinary skill in the art

[0048]! frm&y be desirable .to _. .. cloefc ail sensor portions (4S) ₅ .sucli as by .atigmng all sensor portions (42), For instance, sensor portions (42) may be docked, by rotating each sensor portion (42) tmϊϊi ths bottom of eaoft sessor portion (42) is tlie same dktsace from, oufer surface (2C) of qpfers mmύ (2t>) |s the bottom of other sensor portions (42). Sensor portions (42) may also be clocked by aligning the respective bottom edges of ail sensor portions (42) such that thsy are all ipøMfeti-- Suck cϊockmg methods may: %$* doEfe in ilw embodiment where housing 02} of lam assembly (90) comprises ^' two portions screwably secured together _* such that each sensor portion (42) may be rotated, or in iaiiy other siiiiiabb ^sfeodiment^ M p* another embodimenf, sensor portions (42} are activated, aad γid«o captured by- seπsot portions (#2) is viewed. In tins embodimeot, c-ioddsg .may be perfornsed h-y rotating sensor portions (42) until objects or features within captured, images are δøssιφ$a#y aligned among views lrom adjacent sensor portions (42), If will be appreciated tliat clocking may initialize the search space for a mosaicking algorithm _* Oilier methods for cloekkg or aligning sensor por&ORS (42) v?ilϊ be apparøut to those of ordinary skill ki ih.& art

[0049] In the present example, when cameras (40) are located approximately 7.6 km _? όr ^: 25,QOO' f i _: aboy© fϋø grόviϋd (&gy carøetas (40) mόuif ed m an aircraft (10)% emsimis (40) may cølleciively view and capture- an image of aii area (a "footprint' ^* ) that is approximately U km by approximately U km. Cameras (40) may be coMigured .sαcfe that such, an image has a resolution of approximately 0>5 meters. By way of sxmhpy oaϊy, catte∞ (40) Bisy provMe approximately 50% contract of features larger than 0.5 meters in ήz& ψihm m ύpp-mxlmdϊύγ IMU teat grotmd footprint from a» altitude of iφprøXBTjately ?.6 hm. It will be apprsciMeά that ^e s&e of. ihe |rotmd ibølprMt associated with. cameras (40) .may vary as a function, of caiτιera4 ^J (40) altitude, as may resolution. For insfcmce, in one embodiment, where cameras

(40) provide a resolutio nf 0,5 m from &α altitude of 7 S km* cameras (40) may provide a resolution o.f 1.2 m. frαrø ail altitude of 18 km. Other s&table degrees of resolution attitudes, aad footprint sizes may be vised, \

[0050] Cameras (40) of m exemplary image capture system incorporate sensors thai- are all of the same effective focal ieogth and entrance pupil ήzo thus sampling a scene at a constant ashlar mh. A sensor with a: leas well corrected lor. geometrical distortion, each pixel linearly maps a plane onto the respective sensor array. With uniform angakr resolution from sensor to sensor the eorøpo ^' site sceι\e όbsen ^r «(| by axi image e^ptwe system may .be. mii|?rmly scaled ibr platies at a constant distance- from the -respective sensor, Whjeπ. the scene being sampled is at multiple distances ftom the image capture system,

^' lit pπήciple, it may be as tlϊόυglvthe origin of ike coordinate -system fψ each seosor entrance pupil is co-located at a common point, and the .respective pupil pHnt k imply rotated ώvut tfiat pfomf- ^' tp sample &e entire image φpttite- systmt βeϊd-øf-viisw, THs quantity may provide a means for adjacent s^nsom to sample more or less of a common volume of fee image capture system field _' Of-view. Each sensor may sample the image capture system .i!ekl-of~ vϊevv ajtid each pixel of the respective sa»sor array .may saiπpk tfee respective serøor sample, Xt ifcay. also fee possible to liave each sensor d^signsd to scale the volume of the image capture system fiddof-view such that &i plane perpendicular to the image capture sysiem borcsiglit direction is sampled by ώe mvφtse oftfe::ang!α \

To tb:e extent that cameras (40) are capture- -video images, such video. may have aay suitabfe rrai-»e raie. Forinstance, a isdiable ^' jO&tϊϋe tats ^' may- be greater ihmx or equal to approximately 5 rrames per second. Alternatively, any other sujtable frame .rate .niay.bd useel _* mctedmg less than 5 thimes per φ<?ond, Eaαh camera (40) -mtxy- also -capture images with an. exposure tifeie of approximately 1 ms _* with an apermre of approximately fZS _> usisg mi HD4

neutral density filter. Other suitable exposure limes, aperture settings, and fitter selections will, be apparent to those of ordinary skill in the art. ]

|0052] Ii may foe f esiiabie to provide some degree .of -calibration of catsrøs (40) mounted to camera mount (20), Such calibration may be used to detect atκi/ør correct mounting inaccuracies or inconsistencies of sensor jjø.fϊioas (42) or tens portions (44), For instance, calibration may be pjwidέd to Facilitate adjustment of cameras (40) such that their respective lines of sight ail mlmect at a single common poist to the greatest extent possible. Calibration may also fee ^provided, to provide, a consist^ϊi distance from each ser&όr portkm β2) t$ its respective first kns (94), Td the extent that cameras (40) may not be ideally adjusted for whatever reason, calibration x»ay be used to obtain; some Gøiϊsetitvs: factor or factors to be accounted for during «&%« proc.έssmg> M iSihti wxϊids, struc-tuml dr other imper&ctioES dtscovered durmg caKbMidn may be accounted for during image processing, to address adverse effects ilml

|0053] ϊn o«e exemplary calibration method _^ lens portions (44) are used to project light onto a planar checkerboard pattern (not showu) positioned beκeatϊi camera mount (-20), Osteokerboard pattern comprises .a plurality of sqiϊsires^ each square bung associated with a respective lens portion (44). Each, lens portion (44) is adjusted relative to camera mount (20) until lighέ shose tlirough lens portion (44) k centered m its. corresρoridi«g sqttwyiπ the dieckerboard pattern.. i ^:

[0054] Ia another exempiaty calibration method, a ooliimalor (not shown) is positioned ϊmdsr the center of camera mount (20). The collimator is GOfiβgtffisd to rotate about: two axes, UgM is provided to ^icϊ % thθ ooliimator, and eoϊiiinator Is rotated about the two axes, to seiectivdlyξdirect. the light into each camera (40). If needed, each lens portion (44) h ad|αsted relative to camera moimt (20) to ensure tliat HgM provided by the colfm&tor .reaches sensor portion (42) shewed to such leas portion (44) when collimator ϊδ directed tttwani e«τf estioaidkm camssra^O^ Those of ordmatv skffi :«ϊ tbe

art will appreciate that the foregomg calibration, structures and methods are merely exemplary, aM that any øtfeer suitable calibration techniques may be used, I

Calibration may also be used, to account ibr hardware errors or aberrations (e.g., defects m a lens ekment (94 _> 96, 98% defects in a sensor, etc), pertain etmtoameaial factors, $r {Jtfier. factors tbat- jt. may be desirsble! tp tsφ into account dnrbg image processing. By way of example only, my of the Allowing may be determined during calibration: geometrical distorϋos imd/or jion-uπϊfomi iltøώiaties ovet ¹ the UiM of view, uoivimiform response of each pixel in an arrays dead pixels in an army _* non-uniform gain and/or offset &>f each pxx&ϊ hi an array, etc. Such errorø or factors may be cliaraetδπzed άmmg

.ft: wifl bs appreciated thii imagiss cai>tured ^: by cameras £40) (e.g^ images, eaptoreά substantially smraitaήeouslv) may be coilibhisd to lbrm a wide ^" angle image, such as a wide a^gls vkfeo image. Of course, images, captiitφd t?y cameras (40) could alternatively be combined to form an image having any suitable iϊeM of view, such as a irørøw field of view, ft will iwδbr be appreciated tliat images- captured by- ^' cameras (4ϋ) may be processed aM pi?esented to a user m an interactive fashion. For instance, referring back to FIG, 1 _> images captured .from within aircraft (10) may be transmitted to a user at tvSφipd station (14) or-else^tee; Wtsere _: at least ^-poff^bn- of & wide. an;gl«g Image captured coϋectitvely by caϊϊϊe.ras (40) is presented to a user, the user

which may affect ^' panat»g, tiMήg, and/or zooming wlfhk a ydatjvdy large, wide angle image for presentation of a selected portion of (or selected _; view witea) that wide mgW ijntge to the Bser via « viser. interface _* Because m. array of telatively higli resofotioB catϊiems (40) are «sed to cøEactJVsIy capture- a wide aϊϊglo image, zooaied-te portions of such a wide zm%k imag^ may provide a greater resolution than, may otherwise be obtained if a single ekrπera

weres used to capture the same wide angle image instead of an army o.f cameras (40). i

[0057 FlO, 24 iilsMr&teii several, acts that .may brpeφmmi as _. past of a method ft processing images captured by cameras (40). As shown its block (lϋøøχ a plurality of images are captured by cameras (40) substantially sϊmalj&neøusly. For purposes of CMs example only, each of s&efc images will be referred tb as a "tile image." ^' As shown in block (1010), each tile im&gv is then registered Such registration may comprise associating each, image with &$ particular camera (40) the isnage was captured with, the time.φs ϊm$g% was _: capttuted, a geogmpMc k>catio« within the I?ek1 of view provided by tlie image, sad/or a«.y otiter mfomtation. Next as shown, in block (1020), eadi tile irøage is sliaφetϊe4> Bueli shatpemng may eoπpise eti&t&eaieot; feted pattern noise mnovaii, pmma cosxeotion, dead pixel detection and mterpolaiioπ, wliiie clip, de-waipmg, vignetting correclk^

(0058] As shown i» block (1030), the shatpmed tile images may be subject to ϋomøε detoctioit. While ^e term "corner tieteetiosT is «sed to designate this ac% it is »ot. i«t«ti4αi t& necessariiy limit the :aet to the cblsαiiøii of o^Biers ^e>^» _t cornets of a tile image or comers within a tile image) o«ly. ϊtKfeedv aixy suitable feature within a tile image may be detected as part' of thh act.. For instance, detected tile .ϊmagø IMtifes _; m$y β.ømppsδ iftmge locations .haying gradients in ali directions at a ^' predetemdned scal« ^' > It wiH ^" be apprm^teά iiiat the comer detection may provide a plurality of Mfet^isce pomts wihiα an images,, and tliat siioh refsraice jjokts: -xaa^ be usi€tii ϊatec in prøcesskg. ■ i

[0059 Next.t, as sbbwή fm block (3LQ4φ), motiόii .^e,g^ tsaasϊasitøϊi, affiBc, projeζ:iive _s etc.) between eacii tile image is detected using tlis comers/features detected in Mock (1030), As noted above, mαsakkiag techniques may be used to eKmύmte motion between such lik images (e.g., motion or traask&oa ofo»e tile image -relative to anotte tile image), ϊm the present example, ύύp act- c ^' øftφπses (Jompaήήg tte mktive locations oC detected comers/featars* «.niMn...

adjacent tile images thai have beeix captured at the same time. h\ addition, as shown in block (1050). global, motion, estimation and adjustment day be perforated In contrast to the møsaiekmg associated with block (1040), .Which is .focused on adjacent tile Image .pairs, global .motion estimation te focused mors on the collection of tile images* In parύeulaϊ; global ftiotkm. esthnatkp may include a comprehensive coBSpsmsόn of a p.hαal% of motirø or translation lmdings and/or correclioas that were mads in. hlQck (1040). \ Saoh global motion- estimation may :tlius be ^• us€ξd.-έo detect mύ correct a&y ^: errors iiat occtøed during the motion detection and corroctioa that oceurred in lblock CϊO40), i

The processing pereformed in ac&ortat&e -with blocks (!04§, 1050) may reveal that the f il images captured in. block. (11000) were appreciably misaligned relative to each othe ^r whe nhey werfe uiitiatly captured. It. wilt therefore be apparent to thassa of ordinary skill in the art that some degree of spatial overlap am«mg tfie ϊi« associated with: %&$&&&% iilø images jaay- feiiitat^ tlie process p^&rrøed in accoiidaacewkh block 0 ^' 04O) _* by -ρensatti»g ^: -common cort\ers/fsat«r«s to be detected m røosfe tlis« OΏS tile image iiαrisg peτfαraiance of the act eorrespøϊKSmg to block (1030). Siseli overlap may also r«dτjce th$ likelihood of gaps i« image data occurring. Accordingly, m the pi^seat exampfe, rø%es, obtøiπeϋ-. by cameras. (40) lϊave some <rtegr<?s of overlap F<?j ^s irsstaitc^ a» biage obtained by a gϊveα camera (40) may bave a|?p.roximaϊe?y 42% or 43% overlap with Images obtained by cameras (40) adjacent to that pattϊδular _. caxaera (40). Aliernatwely, my ofEør suitable ά$$β-zz of overlap

{1 ⁾ 06.11 Havintg deteπnmed the proper relative positioning of tile images thrøug'h the pmcesιsi»g described above with reference to Mocks (.1030. 1040, 1050), fc process of the present, example ptρo«ed$ to block (1.060),., wh^re tife imag^s. θr§ imήeated, aligned, mid stitched togδ&et to form a cdllectlve Image.; Of course, a collective image created in acoordaace wifh Mock (1060) w>φ not tjecessatily include all ύte images stitched together. For instance, sad. as wOI

^" be better understood alter discission of block (1070), a collect! v« xnt&gp may comprise portions of several tile images, a single tile image, or even, a pbttiøa of a single tile image. It will 1?e appreciated that stitching m accordance wife block (1060) may be- performed m substantially real time (e.g., stitching as images are being captured by cameras (40)}, Alternatively _* siitcMβg -xψy b® performed M ' & M«r time _> . such as after tile, images have been stored for so.pe ^' time. It' wϊll al?o be. appreciated feat tih images may In αrirøectifis&Ce.g,* sack that tkø csmer^f ca«ifrasi;40} appears to W β|..iESϊiity) prior -to, dbdng, or afte? stitching. To the es&eai that otthomct&atioti or a simile technique is used stitching may be performed by correlating features within each ύl& image with feature o» a iMp or model. Sii^k.cøπ^ktRmmay h« αss^ϊ i» Jiβu bf (or iϋ addition to) comer detection discussed above with reference to block (1030), Other suitable stitchmg tεckiiques will be. apparent to those of ordinary skiO inthe -sari

[0062] As previously noted, & tiser tnay be provided with a ^* S ^f .irtual pan-tϊU-koom

(FTZ) .«arøem," which may effect patmmg, tilting, and/or Kooming withfn the image created k block (1.060). The uset .m?ty th«s be penmtted. to selectively view selected pottkms of (or selected views within) the wuie a«g!.e imag« ^: via a user interface. Accordingly _* mύ as shown in block (107O), a Bser*s; FTZ .selections may tse received. Sucii FTZ selections m&f be mdlcative .of 'the image region, vbw perspective, mάlot 2αom ieveϊ desired by ths user, In response to such PTZ selections, the region of the collective image cotrøsposfidiflig ^' _. tø the sete-ied FXZ. view m&γ bϋ extracted,' ss -.shøwii In |>lockr (1080).

[0063 To the extent that cameras (40) are located in a moving platform (e,g., liyiag aifctmt (10)) when file images are captured In accordance with block (1000), ϊt will be .appreciated itiat a FI?Z view extracted in accordMcδ witfe block <t OSO) may tetid.to .^move'* with ilie. platform. To tile extøt .thiat saeli movement is uiides!jrable _v ®ϊά iϊ m desired tliatthe «xtø?ted.PTE yjew -appear-ss if iljwors being captured by cameras (40) secured, ϊύ a platform having a fixed bcition,

additional proce ssain gay be used to provide the appearance of a static or fixed perspective. Accordingly, as shown in block (1090), a global motion estimation and adjustment may be performed Such a process may account for movement of the platform by essentially cancelling such movement from the extracted PTZ view \

[0064] The global motion estimation may be performed in a variety of ways. For instance, in one embodiment, a global motion estimation method comprises a random sample consensus algorithm (RANSAC). For instance RANSAC may be used to provide homography mapping between consecutive frames or images captured by cameras (40). In the present example, this is performed at a global level (e\g. _? using images captured simultaneously by a plurality of cameras ( 40 though it may also be performed at the file level (e.g. using images captured by a -single camera (40)). Global motion estimation may also be based, at least m part., on physical parameters, such as the speed and altitude of aircraft (10), by way of example only. Other suitable method for performing global motion estimation will be apparent to those of ordinary skill in the art. Similarly suitable methods for effecting global motion adjustment will be apparent to those of ordinary skill in the art For instance the camera (40) source(s) for extracted PTZ images may be changed as the platform moves, thereby providing an appearance of a fixed perspective in the extracted PTZ image. [

[0065] Having processed the file images in accordance with the foregoing exemplary processes, and as shown in block (1100), an adjusted PTZ view may be provided to the user in accordance with their selections.

As another optional image processi ngt, images captured by cameras: (40) iaay be registered wltti geographical ground coordinates corresponding to a geographica area within the field., of view of cameras (40}> Such "geo- registration may provide correlation between a view o.f a particular camera <40) _? or a portion of such a view, and a corresponding location on a map. Geo-registratio informatio n may be obtained using any suitable techniques

For instance, infonaation reialmg to the geographical position of aircraft (10) may be obtained using GPS technology or other technology, &M may be correlated ψϊth images captured by cameras. (40), as a fiaietioij of tims, m orcler to obtain. at least a rough kϊea of £he geographical locatkm. bemg viewed by cameras (4ϋ) at sucli time. Resolution or accuracy of geo-regii^r&tkm mthtmatiαn may be teftaea by accoiaitmg. for additional fa&tots,, such ss the line^of-sϊght orientation øf the cameras) (40) associated with, selected images poriioii% together ⁵ WUh altitude Mersifttipn,, by way of example only. Axicstte technique for øbiainmg geo-registrMon Mormation may comprise reoøgm&iiig mύ correlaimg objects delected wiMn the lieM of view of cameras (40) (e,g., usmg object tecogftitioή. løgie) wl|h objects tekg ^ known geogi-apbic locations, such as prominent laidmia'ks, etc. 'Other methods of obtaimng geo-registration iafomiatioB will be aρpsre»t to thdse of ordinary Mil m ihs. ®ή. \

{0067] Geo-re^.stmtion m&miatϊon may be transmitted with images ca|it«rfd by caineras (40% or imy otHenvise be obtainable based on data i^latisg to irnages captiwd by cameras?. (40). F^r -mstssie^. geρ-regϊs!xatioϋs may b« p®t%tmέά. within aircraft (10), at ground station (I4) _s and/or eϊsewiiere. To fk& kxtent that geo-registratioϊi iιifoπaatio« may be transmitted with images, siicli geo~ regisMtio.n informatio nay fee pmvlded as..a»tκ>tatjo,ns to images o.t rsmy.be otherwise provided ;

|0068]| As yet another optional processing act, persons or objects of interest may hz tracked (e.g.,, aatomatkaϋj). For instance, soch tπtckirtg .may comprise automatically adjusting the view, presented .(11CK)) to the user sucii .feft .the persόivObjedt of interest remains sobstantiaily ceiitered wtthni tlie ρr<js(3«ted view as ths persoa/object moves. Where cameras (40) are mounted to a movable platform (e,g>, an Mrcmll .(.1O)), automated: tracking . ^■ may f«rtbe.r;oarry over 5nto movement ^' αf the pktfortii :(e.g>, by aatomatlc control, by providing •trδό|d% _. »δvigag.θft infora^itlon :lo s . pih% stά), fό the extet.it tfiφ. the persoϊi/objeci of interest. wo»14 otherwise leave- the collective field of vifw of

cameras (4G) mounted to the platform _* Tracking may occur at a file image level and/or at & globally fused imago level Other methods .for effecting tracking will be apparent to those of ordinary sMIl fe the art

|0069| It will also be appreciated that there are several ways m which tracking ώά' y be imlήited For instance, the image processing may include object recognition, facial feature recondition _* etc,, such, thai tracking m imtfaivά upon recø|mtkm ^■ of a partkλfe object, person, event, etc. Alternatively, as a variation of tracking, αbjeet'&exa&eveai recognition may be used to detect a particular Qhj^QtfpusQtii.&mi wϊMti the sofeetϊve field ®t view, of s-amerssi (4ϋ% kaά may automaticslly provϊde ^: a zoomεd-m view of the sxseøgiώed object/'persor ^y evsBt. Traciάng may also be irύϋMQd m accordance- with & user selectiόB pkMdsά ikm&φ % xmm. itα%ϊac». For instme^ a isser xmy ^oliek otnT mi object : of kferest, ύf pvmnύs soaie όtlier fomt of input to <!esig8kte sii object of interest, and the desigoaled object may be tracked accordingly- Initiation of tracktog may also b& a coEibiπstioή of automatic- mά mmu&L For mstaϊϊces a fecogniiiόft algorithm mm rscogtike a person or object of interest, and present & user, via a user mterface, vτi.& tJie option to deekie wliether the person or object should be tracked. In this embodiment, the user may κobm in on tlie person or object tor furtiier inspection M order to detertnine whether tracking is warranted. If tmoϋing i$ desirsd^ fe user may indicate the .-same feough a αser interface, aa4 the person or object may be tracked accordingly, ft will be appred&led that still other metbods for initiating tracking may be used., ib tlie extent that kaepβg 1$ available, ^" ;

[0070| It- will be appreciated tfcat _. ihe fotegoing processes aj-e mmάy SKsxtxpIa^ mi that any of the- acts may b£ mόdiβedj s«bstitιifø4 supplemented, of ^" omitϊecl The acts may also be re-ordered, and similarly, the output of one act may be IM. back as- an mput Bf a second, iteration of -a p;rior act fbr i»stoei\ ύ colleδliv.e imag« creates in block (.1060) ϋiay consist solely of corrects^ and ^■ stilάbe^. tile iφϊiges coirre^oBdfeg .fe a user's Pt ¹ Z selections ce^iv# ^er block (1070), It ^H therefore be appreciated that iπsage pmcessaig mky be

streamlined based on a user's PTZ selections, such ϊh&i oiύy portions of Image data corresponding to the user's indicated area of interest;: are processed, .^t^mative!^ SMs tiM miages ααisicfe tli« user's indicated area of i»teresj;.ma.y still be processed, such m forstor&ge or other purposes, ij

[0071] I t will also he appreciated that processing may be executed on ha-dw^re at variθ&s locations; For isstsace, the processing tβ&y oøcor oi* hardware that is substantially co-located an &e platform with cameras (40) (e.g., located. MiUn aircraft (10)),, such, thai the adjusted FfZ view is transmitted to the \ise*j turn ite pϊatfomi, Altermiiyely* r«gιsterøl -tile images maybe ttsαisiBitted tτdm tlm camera (40) platform to a remote locatkm, where hardware performs tϋψ acts corresp<mdmg to blocks (1020, 1030 _» 1040, 1050, 1060, 1070, lOSO, (1090, liόø), SiSl Other ways m whmh ittmsβ processing, acts niay Be sϊ!<|cateB aiijorig hardware at various locations will bø <tppareat to those of ordiπistf skill ϊπ the art. ^

[0072] M the present δxai«ple _» & user interface pemiϊts users to viøw.&t feast ap^rtkm of one or more imagss cspturet! by om or iβote .cameras (40), ajid further permits users to provide FTZ selections, sucft as those described aboye, as input A; tiset kteε&ce may hteo mmψm≠e a ieMtϊte s^clt as a?ι kter|.ctiyt m&p> To the extent that cameras (40) ate seotited to a moving p!atform ^' j(e.g., Hymg drcmt (10)), an interactive .map may provide a substantially real time visual mdication of the geogmphbai area, within: the collective field, of ylf*w of cameras (40), An interactive map may also permit tlie to beϊect geographies! areas of interest, and a FFZ view of such areas .may be ptaijvkbd m igspoms to such sekctioas. Ati interactive map may therefore provide &t\ msixomenl ibr maibg fTi selectiojαs as described above. To the msnϊ ih$i an area of interest indicated using m interaotive map is not currently vi'ithin. fee field of view of canijsras (40V a aser*s interaction wMt sycli a ni&ψ to iudicate suck ansa of isitesresi may effect tr&asport oCatemft ;{W} to a pcφMon where the indicated area of interest is within field of view of cameras (40). A& ϊMeractϊ^e m&p itsay thus provide ^ xa&ote control of airemft (10) (orbtfeer

vehicle), in additions to providing an instrument for making PTZ selections. An interactive map may have any other suitable features.

[0073] As another merely illustrative example, a user interface may comprise o : share similarities with any of the user interfaces described in U.S. Application Publication No. 20G6/QO338ϊ3, entitlod "immersive Surveillance System Interface/* the disclosure of which is incorporated by reference hereii „ For instance, a collective image described herein may be presented in a nanner similar to the equireetanguϊar image described m that publication; -wiϊs PTZ selections and views described herein being made and presented in a manner similar to the PTZ selections and views described in that pubB nation, respectively. Alternatively, the user interface described in that publ cation may be modified to suit the present examples, and variations thereof, in any other suitable ways. Still other ways in which a user interface iray be provided will be apparent to those of ordinary skill in the art. It will 1 lso be appreciated that image capture systems described herein may be cox joined with image capture systems such as those described in ILS. Application Publication Ko. 2006/0033813, and that views provided by such combined image capture systems may be correlated in a variety of ways, including but not limited to using correlation methods described in that publication.

|0074] Those of ordinary skill in the art will appreciate that an image capture J system employing camera mount (20), cameras (40), and image processing sach as that described above may be used m a variety of ways. While everal exemplary uses will be described below, such examples are not Intended to be exhaustive in any way. Indeed, & variety of other uses, including tut not limited to variations of those described below, will be apparent to tbjose of ordinary skill in the art

[0075] One exemplary me comprises a terrorist bombing retrace. For m tssicfe camera mount (20) with cameras (40) may be positioned within an aero: itat (or other airborne platform), with cameras (40) persistently captu.ri.ng images of an urban area while the aerostat is floating over the urban area, iaages

captured by cameras (40) may be stored m. a storage device located wifjbia the aerostat and/or may be transmitted to a remote location (e.g., ground. station

(14)), for storage and/or review. If a car bomb or other device explodes, images captured by cameras (40) may be reviewed for details of the exp losion.

For instance, a user interface may permit a user to zoom in on the regioϊ of the image where the explosion occurred, then backtrack through the video to determine the source of the bomb. In the case of a car bomb, the user in terface may permit the user to "rewind" video captured by cameras (40) to determine the type of car used, the route driven by the car prior to its explosion, Xl e car's origin, the identity of the driver _* etc. The cameras (40) and user in terra :e may also be used to evaluate activity following the explosion. For instance, video captured by cameras (40) may be monitored to look for and track te xorists fleeing the scene of the explosion. To the extent that an. image capture system

.further includes other cameras (e.g., PTZ cameras, etc.) fixedly ocated throughout the urban area, views obtained using cameras (40) π:ay be correlated with views obtained by such rbted cameras to provide adc itional perspectives of people, places, events (e.g., explosions), or things of interest Other ways in which cameras (40) may be used to provide information r bating to a bombing incident or similar Incident will be apparent to those of oidinary skill in the art.

[0076] Another exemplary use of cameras (40) on camera mount (20) compxi ses the provision of a tactical "eye in the sky" view for military reconnaissance or similar purposes. For instance, camera mount (20) with cameras (40) i aay be positioned within an aircraft (10), with cameras (40) capturing linages while aircraft (10) is flying over enemy territory or unknown territory. mages captured by cameras (40) may be transmitted to military command peisomiel located at ground station (14) in substantially real time. It will be appreciated that several users (e.g., at different locations) may simultaneously viisw fee same or different portions of a collective image captured by camera 5 (40), Aircraft (10) and cameras (40) may permit commanders to interactively view activity or objects over a hill, for instance, or at other remote

interest, without the need to use human scouts, and In substantially mil time. A user interface may initially provide a wide angle image to the us< r, then permit the user to select areas of interest for a closer, high resolution view. Information related to the geographical location of the area of interest may also be transmitted to the user via the user interface. The user mterfa :c may further permit such users to remotely control aircraft (10), in addition to permitting such users to effect a ^** virtual pan-til-zoom camera" within a wide angle video image. Alternatively, aircraft (10) may automatically track moving people (12) or objects of interest to provide a persistert high resolution view of such people (12) or objects and/or to provide targeting information relating to the same. Other suitable reconnaissance uses or similar uses will be apparent to those of ordinary sϊdll in the art.

Yet another exemplary use comprises border patrol. M this example, a ;amera mount (20) with cameras (40) may be positioned within an aircraft (10), which may persistently fly or hover over borders. Images captured by earaeφs (40) i may be processed to automatically delect border erossers (e.g. _} using notion detection and/or object recognition logic). Where border crosssrs are automatically or otherwise detected, a portion of the wide angle image occupied by the border erossers may be zoomed in, and the border c rossers may be automatically tracked. Such automated tracking may furfhe" carry over into control of aircraft (10) flight, to the extent that the border erossers would otherwise leave the collective field of view of cameras (40) within aircraft (10). Images of border erossers may be transmitted to ground station (14), along with information related to the geographic location of the border erossers, with an alert of the border crossers ^* presence. As witi other exemplary uses, where an image capture system further includes other cameras (e.g., PTZ cameras, etc.) fixedly located, throughout the urba i area, views obtained using cameras (40) may be correlated, with views obtai fied. by such fixed cameras to provide additional perspectives of people, ρla:es _» or things of interest. Alternatively, a combination of camera mount (20) and cameras (40) may be used in a border patrol setting ia any other suitabls^y^

Similar implementations may include visual security (e.g., surveillance ^' of a premises),

(078] Having shown and described various embodiments of the presen tyeiitioa, f^rte ¹ ada|>ta.tiøβs of t&s .methods mά ^' . systems 4<sssesibδ& hzxmi miy be acooffjplished by appropriate modifications by crnt- of ordinary sMil hrite Mt without departmg from the scope of the present invention,. Several of such potential πiodifipatioas havo-.bee«.-mfeήtio«iθd _> : %tiά xithots will be ^' apparpnt to: those skillsd in the art. For instaaes. the. examples, embodiments, geosdMilcSj materials, dimensions, ratios, steps, ami the like diseased abovø are illustrative and are not mqiήwά _* Accotάmgly^ ihe scope of the pjsssst invention should be considered in. terms of th» following claims 4^ & xit?4erstood not to be ItMtQU to the details of stricture and operstioa shown and described m the specification rniά drawings _*