Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
IMAGING SYSTEM WITH AN OPTICAL MIRROR ARRANGEMENT AND SELF-RIGHTING HOUSING
Document Type and Number:
WIPO Patent Application WO/2008/117023
Kind Code:
A3
Abstract:
A multi-wavelength band imaging system including a beam splitter (33) is provided, allowing image capturing means adapted to specific wavelength bands to be used such as from visible to near infrared, intermediate infrared and far infrared. The system may have a field of view of substantially (360) degrees about an optical axis of the system and may fit into a golf ball sized housing. The imaging system includes a first convex mirror and a second concave mirror. Some embodiments for imaging single or close wavelength bands and not requiring a beam splitter are equally provided. Also provided is a self-righting housing for an imaging system, for example as described above, which self-rights under the action of gravity, thereby disposing the imaging system in an appropriate orientation.

Inventors:
SAMUELSON DAVID W (GB)
NEIL IAIN A (CH)
Application Number:
PCT/GB2008/000963
Publication Date:
November 13, 2008
Filing Date:
March 18, 2008
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
DSAM LONDON LLP (GB)
SAMUELSON DAVID W (GB)
NEIL IAIN A (CH)
International Classes:
G02B13/06; G02B17/08
Domestic Patent References:
WO2005078502A12005-08-25
Foreign References:
EP0863421A11998-09-09
US20020121574A12002-09-05
GB1521087A1978-08-09
GB2158261A1985-11-06
JP2001094839A2001-04-06
Attorney, Agent or Firm:
KORENBERG, Alexander Tal (20 Red Lion Street, London WC1R 4PJ, GB)
Download PDF:
Claims:

Claims

1. A multi-wavelength band imaging system including an objective system which is arranged to collect radiation emanating from an object space, a beam splitter which is arranged to collect radiation from the objective system and to direct collected radiation to first and second image planes, and first and second image sensors respectively arranged in the first and second image planes; wherein, the objective system includes a convex reflective surface and a concave reflective surface mutually spaced along an optical axis through the beam splitter, the convex reflective surface being disposed to collect radiation from object space and to deliver the collected radiation to the concave reflective surface, and the concave reflective surface being disposed to transfer radiation collected from the convex reflective surface to the beam splitter past the convex reflective surface; and wherein the first image sensor is adapted for imaging radiation in a first wavelength band, the second image sensor is adapted for imaging radiation in a second wavelength band, the first and second wavelength bands being either side of a wavelength of about 2.7 microns.

2. A system as claimed in claim 1 in which the beam splitter is a cube beam splitter.

3. A system as claimed in claim 1 or claim 2 including, a positively powered refractive optical component having a useful spectral bandpass in the first and second wavelength bands and being optically between the concave reflective surface and the beam splitter.

4. A system as claimed in claim 1, claim 2 or claim 3 in which the first wavelength band is from visible to near infrared and the second wavelength band is intermediate infrared, far infrared or both.

5. A system as claimed in any preceding claim which has a field of view measured to one side from an optical axis of about 55 degrees.

6. A system as claimed in any preceding claim in which the beam splitter comprises ZnS, ZnSe, MgO, sapphire or diamond.

7. A system as claimed in claims 3 to 6 in which the positively powered refractive optical component comprises ZnS, ZnSe, MgO, sapphire or diamond.

8. A system as claimed in any preceding claim, further including a window optically between the object space and the convex reflective surface.

9. A system as claimed in claim 8 in which the window has a useful spectral bandpass in the first and second wavelength bands.

10. A system as claimed in claim 9 in which the window comprises ZnS, ZnSe MgO, sapphire or diamond.

11. A system as claimed in any of claims 8 to 10 in which the window is frustoconical, arcuate or part-spherical.

12. A system as claimed in any preceding claim in which the concave reflective surface is disposed to transfer radiation collected from the convex

reflective surface to the beam splitter through an aperture in the convex reflective surface.

13. A system as claimed in claim 12 which has a field of view of about 140 degrees with a 30 degrees axial blindspot viewed along the optical axis.

14. A system as claimed in claim 12 or claim 13 which has a field of view of substantially 360 degrees about the optical axis.

15. A system as claimed in any one of claims 12 to 14 in which the convex and concave reflective surfaces and the aperture are shaped and disposed relatively to each other as defined by surfaces 3, 4 and 5, respectively, of table 1 and the appended notes above.

16. A system as claimed in claim 15 when dependent on claim 3 in which the positively powered refractive optical component is shaped and disposed relative to the aperture as defined by surfaces 6 and 7 of table 1 and the appended notes above.

17. A system as claimed in claim 16 in which the beam splitter is shaped and disposed relative to the positively powered refractive optical component as defined by surfaces 8,9,10 and 16 in table 1 and the appended notes above.

18. A system as claimed in claim 17 in which the first wavelength band is below about 2.7 micron, the first image plane is disposed within the objective system as defined by surface 15 in table 1 and the appended notes above and the objective system includes refractive optical components as

defined by surfaces 11 to 14 in table 1 and the appended notes above between the beam splitter and the first image plane.

19. A system as claimed in claim 17 or claim 18 in which the second wavelength band is above about 2.7 micron, the second image plane is disposed within the objective system as defined by surface 19 in table 1 and the appended notes above and the objective system includes refractive optical components as defined by surfaces 17 and 18 in table 1 and the appended notes above between the beam splitter and the second image plane.

20. A system as claimed in any one of the preceding claims in accordance with an optical prescription as defined in table 1 and the appended notes above.

21. A system as claimed in any one of claims 1 to 20 in which the beam splitter is a dichroic beam splitter for directing radiation in the respective wavelength bands to the respective image sensors.

22. A system as claimed in any one of claims 1 to 11 which has a field of view of substantially 180 degrees about the optical axis.

23. A multi wavelength band imaging system including two multi wavelength band imaging systems as claimed in any one of the preceding claims placed back to back to each other in which radiation in a waveband associated with a longer optical path is reflected by the beam splitter and radiation in a waveband associated with a shorter optical path is transmitted by the beam splitter.

24. A system as claimed in claim 23 in which radiation in the waveband below about 2.7 microns is reflected by the beam splitter and radiation in the waveband above about 2.7 microns is transmitted by the beam splitter.

25. A self-righting housing for a substantially 360 degree field of view imaging system in which the housing is weighted at a bottom end thereof which defines an outer surface such that the housing rights itself into an upright orientation under the action of gravity and in which the housing includes a window to provide a substantial 360 degree field of view about an axis along the upright orientation.

26. A housing as claimed in claim 25 which includes an energy storage device for powering the imaging system.

27. A self-righting housing as claimed in claim 27 which further includes a wireless transmitter for transmitting images captured by the imaging system.

28. A housing as claimed in claim 26 or claim 27 in which the energy storage device provides at least some of the self-righting weight at the bottom end.

29. A housing as claimed in claim 27 or claim 28 which includes an image processor arranged to store a first captured image and to compare it to a second image captured after a predetermined time span to detect changes between the second and the first image and operatively coupled to the wireless transmitter to only transmit a captured image when a change is detected.

30. A housing as claimed in any one of claims 25 to 29 which houses a multi-wavelength band imaging system having a substantially 360 degree field of view about an optical axis.

31. A multi- wavelength band imaging system as claimed in any one of claims 1 to 21 which is housed in a housing as claimed in any one of claims 25 to 30 and in which the concave reflective surface is secured adjacent a top end opposite the bottom end and the remaining imaging system is secured adjacent the bottom end.

32. A system as claimed in claim 1 in which the beam splitter is a plate beam splitter.

33. A system as claimed in claims 1 or 32 in which the beam splitter is a pellicle beam splitter.

34. A system as claimed in claims 1, 32 or 33 in which the beam splitter comprises Ge.

35. A multi- wavelength band imaging system as claimed in any one of claims 1 to 22 or 32 to 34 in which the image sensors are offset about the optical axis with respect to each other to allow the sensed images to be used for range finding or stereo visualisation.

36. A system as claimed in any one of claims 1 to 22 or 32 to 35 which includes a further beam splitter after the beam splitter.

37. An imaging system for imaging a field of view of substantially 360 degrees about an optical axis including a housing as claimed in any one of

claims 25 to 29 having a convex reflective surface adjacent the bottom end for receiving radiation emanating from an object space and a concave reflective surface adjacent an opposed top end for receiving radiation from the convex mirror and directing it through an aperture in the convex reflective surface to an image sensor.

38. A system as claimed in any one of claims 1 to 22 or 32 to 37 in which the distance from the concave reflective surface to an image sensor is less than 4cm.

39. A system as claimed in any one of claims 1 to 22 or 32 to 38 which can be housed in a housing about the size of a golf ball.

40. An objective system for imaging a field of view of substantially 360 degrees about an optical axis including a convex reflective surface for receiving radiation from an object space and a concave reflective surface for receiving radiation from the convex reflective surface and directing it through an aperture in the convex reflective surface to an image plane distanced less than 40mm from the concave reflective surface.

41. An imaging system including: a first subsystem which includes a first objective system for directing radiation received from a first object space to a first image sensor; a second subsystem which includes a second objective system for directing radiation from a second object space to a second image sensor; the first and second optical systems each including a respective first mirror for receiving radiation from the respective object space and directing the radiation to a respective second mirror for directing the radiation to the respective image sensor;

the first and second subsystems being disposed on opposite sides of a plane such that the corresponding first and second object spaces lie on the corresponding side of the plane and each subsystem defining a part spherical field of view extending in directions substantially parallel to the plane.

42. An imaging system as claimed in claim 41 in which the part spherical fields of view combine to form a contiguous field of view without obscurations in the plane at a distance from the optical system of sufficiently low linear resolution.

43. An imaging system as claimed in claim 41 or claim 42 in which the respective fields of view are separated from the plane by a respective gap.

44. An imaging system as claimed in claim 43 in which the fields of view combine to form a contiguous field of view across the plane at a distance where a resolvable dimension is equal to or larger than twice the gap-

45. An imaging system as claimed in any one of claims 41 to 44 in which the first and second part spherical fields of view extend over substantially 90° away from the plane, the respective second mirrors being located outside of the fields of view.

46. An imaging system as claimed in any one of claims 41 to 45 in which the first and second part spherical fields of view extend over substantially 180° in the plane.

47. An imaging system including two imaging systems as claimed in any one of claims 41 to 46 mounted back to back to each other to provide a combined angular field of view covering 360° in all directions.

48. An imaging system as claimed in any one of claims 41 to 47 in which the first mirror is a convex mirror and the second mirror is a concave mirror.

49. An imaging system as claimed in any one of claims 41 to 48 in which each objective system includes a positively powered refractive optical element optically between the second mirror and the image sensor.

50. An imaging system as claimed in claim 49 in which the refractive optical element has a useful spectral band pass in the visible to near infrared and intermediate, far, or intermediate and far infrared.

51. An imaging system as claimed in any one of claims 41 to 50 in which each of the first and second subsystem include a multi- wavelength band imaging system as claimed in any one of claims 1 to 22.

52. An imaging system as claimed in any one of claims 41 to 51 which is housed in a housing as claimed in any one of claims 25 to 30, the axis lying substantially in the plane.

53. An imaging system, objective system or self-righting housing substantially as described herein above with reference to the accompanying drawings.

Description:

Optical Arrangement

This invention relates to an imaging system, in particular although not exclusively a multi- wavelength band imaging system for imaging both in the visible, near infrared and intermediate infrared wavelength bands and, more particularly such an imaging system having a substantially 360 degree field of view. The invention further relates to a self-righting housing for an imaging system.

Many known imaging systems work over a limited band of wavelengths, for example either visible or near infrared. Imaging systems adapted for visible wavelengths tend to have optical elements which may not be optimally transparent for intermediate infrared radiation and, conversely, systems adapted for imaging of intermediate infrared radiation may have an image sensor such as a charge coupled device (CCD), a complimentary metal-oxide semiconductor (CMOS) device or other electronic detector or film which is not optimally adapted for visible wavelengths. Hence the wavelengths which can be used for imaging are limited.

Many modern panoramic imaging applications, such as for home and commercial property monitoring, require optical objective systems with extremely large fields of view. Known panoramic imaging systems can meet some of these application requirements but tend to be large in size, heavy in weight, of high cost and cover limited wavelengths of the radiation being sensed. In "Fisheye Lens Design and their Relative Performance ", James Kumler and Martin Bauer, Proceedings of SPIE - Volume 4093 Current Developments in Lens Design and Optical Systems Engineering, Robert E. Fischer, R. Barry Johnson, Warren J. Smith, William H. Swantner, Editors, October 2000, pp. 360-369, many refractive systems are

described which show the overall system complexity. In particular, multiple waveband refractive imaging systems are dependent on a small variety of available refractive materials which, in addition to being expensive and thermally sensitive, normally require multiple elements to correct the chromatic aberrations for good performance but necessarily increase size and weight of the system.

The present invention is defined in independent claims 1, 25, 37, 40 and 41. Further, optional features as set out in the dependent claims.

In one embodiment of the invention, an objective system for a multi- wavelength band imaging system which includes a beam splitter and is arranged to collect radiation from an object space to deliver it to image planes corresponding to respective first and second wavelengths bands. In an imaging system including such an objective system, an image sensor associated with each image plane is adapted for imaging in the respective corresponding wavelengths band. Advantageously, this allows each image sensor to be specifically adapted for the corresponding wavelengths to increase the quality of the captured image.

The objective system may include a convex reflective surface such as a mirror arranged to receive radiation from the object space, a concave reflective surface arranged to receive radiation from the convex reflective surface and reflect it through an aperture in the convex reflective surface to provide a substantially 360 degree field of view about an optical axis in the first and second image planes. The objective system may further include a lens between the aperture and the beam splitter which, advantageously, allows the beam splitter to be smaller than would otherwise be possible.

The system may further include a window surrounding the objective system, for example a frustoconical, arcuate or part spherical window which may be provided in one piece or segmented.

A multi-waveband imaging system may include two systems as described above mounted back to back to each other and in which radiation split by the beam splitters along respective longer optical paths is reflected by the beam splitter, for example visible to near infrared waveband radiation, and radiation split by the beam splitter along respective shorter optical paths is transmitted by the beam splitter, for example intermediate infrared radiation.

In further embodiments of the invention, a self righting housing for an imaging system which has a substantially 360 degrees field of view is provided in which the housing is weighted at a bottom end which defines an outer surface such that the housing self rights into an upright orientation under the action of gravity. The housing further includes a window to provide a substantially 360 degree field of view about an axis along the upright orientation of the housing.

The housing may include a wireless transmitter for transmitting images captured by an image sensor and an energy storage device for powering the wireless transmitter and image sensor. Advantageously, the energy storage device may provide at least some of the self-righting weight of the bottom end. By transmitting images only when differences in the captured images are detected, energy efficiency may be increased.

The housing may house a multi-waveband imaging system as described above and, in particular, the concave reflective surface may be secured

adjacent the top end of the housing opposite the bottom end, the remaining imaging system being secured adjacent the bottom end.

In yet a further embodiment, an imaging system comprising an assembly of imaging systems as described above (or similarly imaging systems not specifically adapted for multi-wavelength band imaging) is provided. Because the imaging systems described above have an arrangement of two mirrors, a first mirror which receives radiation from an object and a second mirror which directs radiation from the first mirror to an imaging plane, the second mirror obscures part of the field of view, creating a blind spot. By arranging these blind spots appropriately, a contiguous field of view with no angular blind spot may be created from the fields of view of the constituent imaging systems. Although a (linear) gap separates the fields of view of the constituent imaging system, since the fields of view are angularly contiguous, the gap is below the linear resolution of the imaging systems at a sufficiently large distance (say larger than ten metres in some embodiments) so that the field of view is contiguous for most practical applications.

For the avoidance of doubt, throughout this description, reference to visible wavelengths refers to the band from 500 to 650 nanometres, near infrared refers to 650 to 2500 nanometres, intermediate infrared wavelengths refers to the band between 3000 and 5000 nanometres and far infrared refers to 7500 to 14500 nanometres. These numerical values are approximate only, as a skilled person will be well aware in relation to these wavelength bands. A clear band gap due to atmospheric water absorption has a lower bound of about 2.6 to 2.7 microns which can be used to define a separating wavelength between the near and intermediate infrared bands.

Embodiments of the invention are now described in detail by way of example only and with reference to the accompanying drawings in which:

Figure IA is a schematic representation of an objective system for a multi-wavelength band imaging system; Figure IB is an enlarged view of a part of the system of Figure IA;

Figure 2 depicts an alternative embodiment of the system in Figure IA and B;

Figure 3 depicts a further alternative embodiment;

Figure 4 is a plot characterising the optical performance of the system of Figure 1 at visible and near infrared wavelengths;

Figure 5 is a plot characterising the performance of the system of Figure 1 for intermediate infrared wavelengths;

Figure 6 is a schematic representation of an enlarged area on an image sensor; and Figure 7 depicts a self-righting housing for an imaging system;

Figure 8 depicts a schematic representation of a composite objective system comprising two objective systems as represented in figures 1, 2, 3;

Figure 9 illustrates a field of view of an objective system similar to the one shown in figure 9; and Figures 10 and 11 show yet further composite objective systems.

With reference to Figure IA and B, an object space 31 is imaged by a multi- wavelength band imaging system 40 into a first image plane 15 and a second image plane 19 in an image space 34. Radiation from the object space 31 passes through a window 32 having a first surface 1 and a second surface 2 and impinges on a reflective surface 3, for example of a curved mirror, to be reflected to a second reflective surface 4, for example of another curved mirror. The reflective surfaces may be metallic, for example gold or silver, thin films on a glass substitute. Reflective surfaces

3 and 4 are centred on an optical axis 20 and reflective surface 3 defines an aperture or stop 5, again centred on the optical axis 20. Figures IA and B are cross-sections of the imaging system and, in one embodiment, the three dimensional object can be obtained as a body of rotation through 180 degrees of the cross-section shown in the figures.

The reflective surface 4 reflects incoming radiation back towards the reflective surfaces 3 from where the radiation is reflected through the aperture 5 and then passes through a lens having a surface 6 adjacent the aperture and an opposed surface 7 to a cube beam splitter of appropriately transmissive material, for example ZnS, having a first surface 8 adjacent to surface 7 and a beam splitting surface 9 which splits the incoming beam to exit the beam splitter via a first surface 10 and a second surface 16.

The beam splitter is arranged so that the radiation reflected by the beam splitter surface 9 leaves the beam splitter through the surface 10 with its optical axis at right angles to the incoming beam optical axis to be imaged by a lens grouping having surfaces 11, 12, 13 and 14 in the first image plane 15. Radiation which is transmitted by the beam splitting surface 9 leaves the beam splitter through surface 16 to be imaged by a lens having surfaces 17 and 18 onto a second image plane 19.

The first lens element (surfaces 6 and 7) adjacent the aperture 5 is optional. However, advantageously, if this lens is positively powered it will reduce the size of the beams of radiation such that the size of the surfaces 8 and 16 of the beam splitter can be reduced. Without this lens, these surfaces would need to grow by about a factor of 2. The resulting increased volume of the beam splitter (by about a factor of 8) would result in increased cost due to the additional beam splitter material needed, as well as space constraint and

practical limitations for remaining optics if the size of the system is to be kept the same.

The beam splitting surface 9 is arranged to reflect visible and near infrared radiation to the image plane 15 and to transmit intermediate infrared wavelength radiation to image plane 19. Thus, the incoming radiation is imaged in two different image planes in dependence upon its wavelengths, allowing image capturing means provided in the respective image planes to be adapted to the respective wavelength bands. In the specific embodiment of splitting the radiation into visible to near infrared and intermediate infrared radiation, image capturing means provided in image plane 15 can be adapted to the visible to near infrared wavelength bands, for example by selecting appropriate film material or using a CCD or CMOS device adapted for this wavelength band. Similarly, the image capturing means provided in image plane 19 can be specifically adapted to intermediate infrared wavelengths, using an appropriate film or CCD or CMOS device. For example, a CCD for use in the intermediate infrared band may have larger pixels than a CCD adapted for the visible to near infrared band.

Where the beam splitter transmits most of the radiation in one band and reflects most of the radiation in the other, efficiency is high compared to a wavelength indiscriminate arrangement where most of 50% of both bands is reflected and transmitted. The beam splitting surface is coated with a commercially available (from ELCAN Optical Technologies, http://www.elcan.com/) thin film coating for ZnS substrates to give the desired wavelength splitting.

It is equally envisaged to adapt the imaging system to other splits of wavelength bands. For example, the beam splitter could be arranged to

transmit far infrared radiation or both far and intermediate infrared radiation, with appropriate adaptation of the image capturing means. Similarly, the beam splitter could be arranged to split the incoming radiation to a visible wavelength band and a near infrared wavelength band such that the respective image capturing means can be adapted accordingly. Any other split by wavelengths is equally envisaged or, alternatively, the beam splitter may be arranged to split the incoming radiation irrespective of wavelengths such that each image plane receives half of the intensity of the overall radiation spectrum. While potentially less efficient, this would still allow the respective image capturing means to be adapted specifically for the wavelengths of interest, possibly using filters to filter out the remaining spectrum. Furthermore, while a cube beam splitter as described above may result in better image quality in the transmitted path, a plate beam splitter may be used instead, for example a plate beam splitter including a dichroic coating on a Ge substrate. A pellicle beam splitter, for example a Ge pellicle, may also be used (generally, a pellicle beam splitter will have an aspect ratio of diameter to thickness of 20:1). Since all of these plate beam splitters reflect one of the wavelength bands at an outer surface, with only one band traversing the beam splitter, it is sufficient if the beam splitter is able to transmit in the transmitted wavelength band.

In the specific embodiment described above with reference figures IA and B, the beam splitter is arranged to reflect visible and near infrared wavelength radiation and to transmit intermediate infrared wavelength radiation. Because, the optical path for the visible to near infrared wavelength radiation to image plane 15 is somewhat shorter than the path for the intermediate wavelength radiation, this is advantageous in certain embodiments where two imaging systems as described above are placed back to back to each other in order to achieve a close to spherical (rather

than close to hemispherical) field of view because the longer optical path being folded sideways allows the two systems to be placed closer to each other back to back, thereby minimising the lost field of view along the circumference of the resulting near spherical field of view.

For efficient multi-wavelength band operation, the optical elements, including the window 32, should be transparent over all of the wavelengths to be imaged. This means that all optical elements lying in the optical path from the object space to the second image plane 19, including the elements in the path common to both image planes prior to the beam splitter, should be transparent to at least the intermediate infrared band. For example these elements may be manufactured from chemical vapour deposited (CVD) ZnS, ZnSe or diamond, all transparent from visible wavelengths up to the far infrared. Other suitable materials include sapphire or pure crystalline MgO. In addition, the lenses may be supplied with appropriate coating to ensure that they transmit over the entire range of wavelengths required or at least those portions which are required.

In another variant, the image sensors are displaced from the optical axis with respect to each other such that the images formed are offset with respect to each other. The difference between the two images can be used for range finding or stereo imaging using suitable image analysis.

A particular optical prescription for the specific embodiment described above with reference to Figures IA and B is set out below in Table 1 in conjunction with the accompanying notes. Surface references numbers in the table correspond to the respective reference numerals used in the accompanying figures and the text above.

TABLE l

Optical Prescription

Radius of Aperture

Radiation Separation 1 curvature 2 " 3 Material 4 ' 5 Surface height

Item path Surface (mm) (mm) Type Name action (mm)

Object Both 0 459.0000 500.0000 Air - - -

Window Both 1 1.3662 Infinity CVD ZnS Refraction -

Both 2 41.0000 Infinity Air - Refraction -

Mirror 1 Both 3 -24.9000 5.7413 Air - Reflection 5.56

Mirror 2 Both 4 24.9500 41.3947 Air - Reflection 6.60

Stop Both 5 0.3000 Infinity Air - - 0.60

Lens 1 Both 6 4.4000 33.0649 CVD ZnS Refraction 0.68

Both 7 0.1000 -8.0968 Air - Refraction 1.07

BeamPl 8 1.3900 Infinity CVD ZnS Refraction 1.07 splitter Pl 9 1.3900 Infinity CVD ZnS Reflection - prism Pl 10 0.1978 Infinity Air - Refraction 1.11

Lens 2 Pl 11 0.1750 -9.8110 Glass S-TIH14 Refraction 1.12

Lens 3 Pl 12 1.3336 1.6129 Glass S-LAH65 Refraction 1.17

Lens 4 Pl 13 3.7000 -2.1146 Glass S-TIH6 Refraction 1.18

Pl 14 0.4101 3.7094 Air - Refraction 1.31

Image I 6 Pl 15 0.0000 Infinity Air - - -

BeamP2 8 1.3900 Infinity CVD ZnS Refraction 1.08 splitter P2 9 1.3900 Infinity CVD ZnS Refraction - prism P2 16 1.8177 Infinity Air - Refraction 1.13

Lens 5 P2 17 1.7409 23.4806 CVD ZnS Refraction 1.20

P2 18 0.6150 3.8891 Air - Refraction 1.18

Image 2 7 P2 19 0.0000 Infinity Air _

Notes :-

1. The negative separation of surface 3 signifies a reversal in the optical axis direction after surface 3. Surface separation is measured along the optical axis.

2. The surface tilt angles of window surfaces 1 and 2 are both 65 degrees about the optical axis with a closest approach to the optical axis near mirror 2 and when both surfaces are rotated around the optical axis by 360 degrees they form a conically shaped window component.

3. Surface profiles of aspheric surfaces 3 and 4 are governed by the following conventional equation:

CURV(R) 2 Z = + (A)R 4

1 + (1 - (1 + K) (CURV) 2 R 2 ) 1/2 where:

CURV = 1 / (Radius of Curvature) K, A = Coefficients

Z = Position of surface profile for a given Y value or measured along the optical axis from the pole (i.e. axial vertex) of the surface R = Radial aperture height of surface measured from the X and Y axis, where:

R = (X 2 + Y 2 ) %

The coefficients for the mirror surface S3 are: K = -0.5905 and A= -7.337IxIO- 4 The coefficients for the mirror surface S4 are: K = -1.1287 and A= -1.6315xlO "5

4. Zinc Sulphide (ZnS) is a chemically vapour deposited (CVD) material.

5. The glasses listed are available from Ohara Corporation.

6. Image 1 (path Pl) is formed by radiation in the waveband 500-1,000 nm.

7. Image 2 (path P2) is formed by radiation in the waveband 3,000-5,000 nm.

Adding up the surface separations from the surface 4 of mirror 1 to image plane 2 gives less than 37mm as the longest dimension of the optical arrangement such that, allowing space for defectors, associated electronics and mountings for the optical components, the system could be fit into a housing of a size of the order of a golf ball.

Although the window 32 in the specific embodiment of Figures IA and B is flat, other geometries are also envisaged and a curved window 35 may be used in an alternative embodiment 50 depicted in Figure 2. In yet a further alternative embodiment 60 depicted in Figure 3, the dome window extends only over the sides of the embodiment covering substantially only the field of view of the imaging system and does not extend into those portions obscured by the reflective surface 4. This alternative arrangement may provide a reduced cost solution compared to the embodiment 50 as less material is required for the window to provide an equivalent field of view.

Where environmental protection of the optical components of the imaging system is not required, the window may be omitted completely, resulting in further cost savings.

In figures 1 to 3 and the corresponding description above, the housing of the multi- wavelength band imaging system has been omitted so far. However, it will be understood by the skilled person that any appropriate housing ensuring secure relative positioning of the optical components and image capture means may be used and a large number of possible arrangements will be apparent to the skilled person. A specific embodiment of a housing is described below in further detail.

Figures 4 and 5 depict polychromatic diffraction MTF performance plots characterising image modulation as a function of spatial frequency for visible and near infrared and intermediate infrared wavelength bands, respectively. For each wavelength band, several plots across the field of view, as well as the diffraction limit are plotted. Assuming an acceptable level of modulation (contrast) of 30%, a resolution of 80 cycles per millimetre can be achieved for the visible and near infrared band and a resolution of approximately 30 cycles per millimetre can be achieved for the intermediate infrared wavelength band (the latter being substantially diffraction limited for the specific embodiment described above.)

The image area in image plane 15 and 19 for a specific optical prescription as set out in Table 1 is illustrated schematically, together with an approximate outline for a one/six inch 4:3 format detector in Figure 6. The field of view extends for 360 degrees about the optical axis and from 15 to 70 degrees away from the optical axis looking forward (or, in other words, 140 degrees on axis with a 30 degrees central blind spot looking forward along the optical axis). The corresponding image in the image planes is a

doughnut shape with an outer diameter of approximately 3.0 millimetre and an inner diameter of approximately 0.5 millimetre, meaning that a 1/5 or a 1/6 inch detector may cover the image areas.

Taking the minimum dimension of any detector (usually the vertical dimension), the maximum number of pixels available for a given detector size and format can be determined. For example, for a 1/6 inch 4:3 format detector which has 500 pixels vertically, about 208 pixels are available for the 15 to 70 degree field of view (about 83% ((3.0 - 0.5)/3.0) can be used and half that is available for the 15 to 70 degree field of view). This applies to a typical detector used in the visible to near infrared band. In the intermediate and far infrared bands, detector pixel sizes tend to be larger by a factor of 2 to 3 times because of the need for increased sensitivity and, accordingly, for a 1/6 inch detector, 70 to 104 pixels may be available. Based on the resolution derived from the polychromatic diffraction MTF performance plots shown in Figures 4 and 5, it can be seen that the optical system is well matched to commercially available 1/6 inch, 4:3 detectors, with each cycle being sampled by approximately two pixels.

The specific embodiment described above gives resolution at 100 metre from the imaging system of about 275mm or about 6 to 7 pixels for the height (1.8 metre) of an adult human being and a middle infrared channel provides a resolution of about 650mm which gives about 3 pixels for the same height. These resolutions may not be sufficiently high to allow recognition of objects at a 100 metre distance but may allow the detection of the presence and/or movement of objects about the size of an adult human in the field of view.

If a higher resolution than is available with the specific embodiment using a 1/6 inch detector is required, the entire optical system could be scaled by a factor of 2 and a 1/3 inch detector with a correspondingly increased number of pixels can be used, for example. Evidently, the system can be scaled up or down appropriately depending on the required resolution for a given application and space constraints on the imaging system. Also, the resolution of the system may be improved by re-optimising the system prescription which may include increasing the total number of lens elements in one or both paths.

The general aspherical mirrors used in the specific embodiment described above result in a orthographic projection of the field of view which can be transformed into perspective images of the surrounding field of view, for example as described in "Catadioptric Omnidirectional Camera ", Shree K. Nayar, 1063/6919/97, IEEE, 1997 or in "Generation of Perspective and

Panoramic Video from Omnidirectional Video ", Venkata N. Peri and Shree K. Nayar, Proc. OfDARPA Image Understanding Workshop, New Orleans, May 1997, herewith incorporated by reference herein.

Where only detection of object position is required, pixel locations can be mapped directly to corresponding azimuth and altitude angles with respect to the imaging system, for example using a look up table. Where detection of movement or changes in the field of view is required, a snapshot may be stored and compared with a further snapshot taken after a predetermined delay in the fashion of a two step tapped delay line. By detecting differences between the two stored images, changes in the scenery can be detected. This can be implemented either in hardware or software. By sampling the field of view relatively infrequently, energy consumption of

the imaging system may be minimised, albeit at the cost of a reduced temporal resolution.

It will be understood that it is also envisaged to further split one or both of the beams after the beam splitter using one or more further appropriate beam splitters, for example to split the visible and near infrared band do direct each component to separate respective visible and near infrared imaging planes.

It is further envisaged to adapt the system described above for use with only a single image path and plane, eliminating the beam splitter and split image paths (surfaces 8 to 16) and re-optimising.

As described above, the multi wavelength band imaging system may be housed in any appropriate housing but one particular embodiment of a housing is now described with reference to Figure 7. This housing can be used with other imaging systems, as well, and, advantageously, provides a self-righting mechanism such that it has an equilibrium position which corresponds to the correct orientation of the imaging system. For example, this allows the system in its housing to be placed on the ground at appropriate locations, for example the ground surrounding a household to be protected. Because of the self-righting functionality, appropriate positioning of the imaging system can be assured even if it is temporarily disturbed by, for example, contact with a passing human or animal. Because it is not necessary to secure the system in place to ensure appropriate positioning, the system can be deployed rapidly, increasing its ease of use.

In particular, the housing may be used with an imaging system having a mirror arrangement as described above but without being adapted for multi- wavelength band imaging. Such a system is to a large extent similar to the one described above but with the beam splitter, and split image paths (surfaces 8 to 16) removed and the remaining components re-optimised.

As depicted in Figure 7, the housing includes a housing wall 42, which at a lower end 46 has a outer surface which is shaped such that, in conjunction with a weight 48 weighing the lower end 46, the housing has an equilibrium position such that it self-rights to an upright position under the action of gravity. For example, the outer surface of the lower end 46 may have accurate side portions so ensure a smooth rolling action and a flat central portion to ensure a stable equilibrium position. Reflective surfaces 3 and 4 and window 32, as well as the remaining optical components and the image sensors schematically depicted in the figure by box 44 are secured in an appropriate relative configuration, as described above, to the housing wall 42.

The housing may also contain a processor unit for reading and, possibly, processing the output of the image sensors, a wireless transmitter coupled to the processing unit to transmit processed images to a receiving station and a power source device, such as a battery, to provide electrical power to these components. In one embodiment, the power source may at least partially replace the weight 48 to provide the weighting of the lower end 46 of the housing. By providing the imaging system together with means for transmitting the sensed images wirelessly in a single housing which can easily and conveniently be placed in most environments, a surveillance system covering a large area can easily and quickly be set up by distributing an appropriate number of imaging systems in the environment.

It will be understood that other housings for the imaging system are equally envisaged. For example, the system may be looking downwards when mounted on a lamppost or traffic light or may only have a half, 180° field of view such that if can be mounted against a wall, car bumper or other surface.

The embodiments of the optical system described above all have in common a blind spot in the centre of the field of view due to the obscuration caused by the reflective surface 4. An alternative embodiment of an optical system for a multi-wavelength band imaging system (or, equally, an imaging system not specifically adapted for multi-wavelengths band imaging) is now described with reference to figures 8 to 11. In summary, these embodiments eliminate the blind spot in the centre of the field of view by arranging two imaging systems as described above relative to each other such that the blind spot occurs in the periphery of the field of view or within a central linear gap.

With reference to figure 8, two objective systems 60' corresponding closely to those described above with reference to figure 3 are mounted in a housing (not shown) on either side of a central plane 70. The objective systems 60 and 60' are identical apart from the objective system 60' comprising a window 36 and surfaces 4 and 3 only to one side of the optical axis 20 resulting in a 180° field of view about the optical axis 20 (in effect, this corresponds to the objective system 60 cut in half). The two objective systems 60' are disposed relative to each other such that each field of view extends from directions substantially parallel to the plane 70 away from the plane towards the optical axis 20 and the corresponding blind spot. To this end, the two objective systems 60' are disposed relative to each other with reflective symmetry about the plane 70 and the optical axis rotated 20°

away from the normal to the plane 70 (upwards in figure 8) to define a contiguous field of view from the blind spot on each side of the arrangement looking upwards in figure 8.

It will be understood that the arrangement described with reference to figure 8 defines a gap 76 between the fields of view of the two optical systems 60' such that there is a blind spot at small linear resolution (in the near field of view), corresponding to this gap 76. However, since each field of view includes directions substantially parallel to the plane 70, this gap is of substantially fixed linear dimension such that it is significantly below the linear resolution of the arrangement at sufficiently large distances in the field of view, for example ten metres and above. At these resolutions, the field of view is contiguous across the plane 74 for most practical purposes. Away from the plane, the field of view extends 55° away from the plane on each side of it in the region of the blind spot and 70° away from the plane elsewhere where there is no obscuration from the blind spot.

In addition to the gap 76 between the fields of view, the two objective systems 60' further define a gap therebetween which, at its narrowest width 78 between the image planes of the objective systems may be in the region of lcm to allow for a preamplifier board supporting the image sensors in the image planes to be placed between the two objective systems 60'. A corresponding gap 76 between the fields of view of the imaging systems 60' would be of the order of 2 to 3 cm.

With reference to figure 9, the resulting, combined field of view is now described for an arrangement with two modified objective systems similar to the objective system 60' of figure 9 in which the optical reflective surfaces have been modified to provide a field of view of 90° outside the

blind spot away from the optical axis 20. As illustrated in figure 9, the combined field of view 72 of such an arrangement includes 2 quarter spheres extending contiguously on each side of the plane 70 but having a blind spot 74 in a direction perpendicular to the plane 70 corresponding to the reflective surface 4 obscuring the view in that direction.

The corresponding image on the image sensor in each of the image planes 19 and 15 of the optical arrangement 60' consist of half the doughnut shape described above with reference to figure 6. The hemispherical field of view illustrated in figure 9 can then be recovered by projecting each of the half doughnut shaped images into perspective images as described above and stitching the two resulting images along the edge corresponding to the curved outer edge in the untransformed images. As described above, no such transformation is necessary if only detection of object position is required, in which case pixel detection can be mapped directly to azimuth and altitude angles using a lookup table or if only detection of changes in the environment is required.

With reference to figure 10, the blind spot 74 illustrated in figure 9 can further be eliminated by using two objective systems 80 with further modified reflective surfaces 3 and 4 to extend the field of view to 90° from the edge of the obscuration resulting from the reflective surface 4, providing a substantially completely angularly contiguous field of view extending from directions parallel to the plane 70 to directions parallel to a plane perpendicular to the plane 70, as illustrated in figure 10. Further illustrated in figure 10 is a housing 82 in which the systems 80 are mounted. The housing has a lower wall portion 84 and an upper wall portion 86 between which the windows 87 of the objective systems 80 are mounted. For example, the wall portions 84 and 86 may comprise fixtures for

mounting the arrangement to a supporting surface or the wall portion 82 may be weighted as described above for a self righting housing.

As above, the optical components optically after the second reflective surface 4, indicated schematically at 88 in figure 10, may be arranged such that the longer radiation pass points downwards to minimise the lateral dimensions of the arrangements.

As illustrated in figure 11, four imaging systems 80 may be disposed relative to each other in a housing to provide a full 360° field of view in all directions (naturally, at sufficiently low resolutions to account for the linear gaps between the field of views of each objective system). The housing comprises upper and lower wall portions 90 and side wall portions 90' between the respective windows of the imaging systems 80. Of course, it will be appreciated that the arrangement of figure 11 may be mounted in any desired sense so that the wall portions 90 may be side wall portions and the wall portions 90' may be upper and lower wall portions. One or more of the wall portions 90, 90' may comprise a fixture for fixing the arrangement to a surface or maybe appropriately weighted to define an equilibrium orientation when the arrangement is placed on the ground. Alternatively, the weight distribution of the arrangement may be balanced such that the arrangement can conveniently be rolled into place from a distance.

It will be understood that the arrangements described above with reference to figures 8 to 11 are not limited to use as multi- wavelengths band imaging systems but may be modified by removing one of the two radiation path to obtain a simplified arrangement not necessarily for multi- wavelengths band imaging. However, even with only one radiation path, the sensor may be capable of detecting radiation of multi- wavelength bands. Either straight or

folded radiation paths may be eliminated. In the latter case, the need for a beam splitter is obviated, which can result in a significant cost saving. In the former case, the beam splitter can be replaced with a further mirror, also resulting in cost savings and allowing the lateral dimensions of the arrangement to be reduced due to the folded nature of the radiation part.

Any of the housings described above may further include locating means for detecting the location, orientation or both of the housing. The detected location/orientation can then be transmitted to the receiving station to allow it to locate the scene of the transmitted images. The transmission may be encrypted to prevent unauthorised access to the position of the housing. The locating means may include a GPS receiver.

The above description of specific embodiments is by way of example only and many alterations, modifications or juxtapositions of the features set out above will be apparent to a person skilled in the art and are intended to be covered by the scope of the appendent claims.