Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
INTRUSION DETECTION SYSTEM
Document Type and Number:
WIPO Patent Application WO/2005/065376
Kind Code:
A2
Abstract:
An intrusion detection system contains a pair of optical lenses (100) arranged a predetermined distance apart and having overlapping fields of view within an area to be monitored to form a common field of view; at least one light-sensitive device (104) responsive to light from each of the optical lenses; a range detector responsive to signals from the light-sensitive device and operable to determine a range to an object within the common field of view; and a range discriminator for setting at least one range gate to sense objects within the common field of view at predetermined ranges and for ignoring objects outside of the predetermined ranges.

Inventors:
HARDIN LARRY C (US)
Application Number:
PCT/US2004/043941
Publication Date:
July 21, 2005
Filing Date:
December 28, 2004
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
HARDIN LARRY C (US)
International Classes:
G01P3/38; G01P3/68; G01S11/12; G08B13/00; G08B13/194; H01J40/14; H04N13/239
Foreign References:
US3811010A1974-05-14
US5500525A1996-03-19
US5045702A1991-09-03
US5586063A1996-12-17
US5602944A1997-02-11
Other References:
See references of EP 1709664A4
Attorney, Agent or Firm:
Geny, William O. (Vilhauer McClung & Stenzel, LLP, 1600 ODS Tower, 601 SW Second Avenu, Portland OR, US)
Download PDF:
Claims:
CLAIM (S) I/we claim:
1. An intrusion detection system comprising: (a) a pair of optical lenses arranged a predetermined distance apart and having overlapping fields of view within an area to be monitored to form a common field of view; (b) at least one lightsensitive device responsive to light from each of the optical lenses; (c) a range detector responsive to signals from said lightsensitive device operable to determine a range to an object within the common field of view; and [00771 (d) a range discriminator for setting at least one range gate so as to sense objects within said common field of view at predetermined ranges and for ignoring objects that appear outside of said predetermined ranges.
2. [00781.
3. The intrusion detection system of claim 1 further including a lightsensitive device for each lens.
4. [00791.
5. The intrusion detection system of claim 1 wherein the lightsensitive devices include lightsensitive elements arranged in lines of pixels operably selected by the range discriminator to define the ranges included within the range gate.
6. [00801.
7. The intrusion detection system of claim 3 wherein multiple sets of lines of pixels are operably selected by the range discriminator to provide multiple range gates for the selective detection of objects within said common field of view.
8. 5. The intrusion detection system of claim 4 further including a velocity detector responsive to signals from a lightsensitive device and operable to determine velocity of an object sensed by said range detector within the ranges spanned by said range gates. [00821 6. An intrusion detection system for monitoring a secure area comprising: [00831 (a) a pair of electrooptical devices arranged a predetermined distance apart having a common field of view in the secure area to be monitored, each electrooptical device comprising a lens and a lightsensitive element, each lightsensitive element having a pixel array of multiple lines of pixels; and (b) a data processing device responsive to the lightsensitive element of each electrooptical device, the data processing device having a range detector to detect the presence of objects in the area to be monitored, said data processing device including a range gate selector for discriminating among said objects sensed by the range detector by extracting image data from selected ones of said multiple lines of pixels in each said respective pixel array. [00851 7. The intrusion detection system of claim 6 wherein said range gate selector is operable to create multiple zones of ranges within said secure area to be monitored. roo861 8. The intrusion detection system of claim 6 wherein said data processing device further includes a velocity detector for determining velocity of objects detected by said range detector. [00871 9. The intrusion detection system of claim 1 wherein the area to be monitored is defined at least in part by a horizontal ground surface and the pair of optical lenses are situated a predetermined distance above the horizontal ground surface and have lines of sight that intersect the horizontal ground surface at predetermined distances from the lenses. too88 10. The intrusion detection system of claim 9 further including a lightsensitive device for each lens. [00891 11. The intrusion detection system of claim 9 wherein the lightsensitive devices include lightsensitive elements arranged in lines of pixels operably selected by the range discriminator to define the ranges included within the range gate. [00901 12. The intrusion detection system of claim 11 wherein multiple sets of lines of pixels are operably selected by the range discriminator to provide multiple range gates for the selective detection of objects within said common field of view. 13. The intrusion detection system of claim 12 further including a velocity detector responsive to signals from a lightsensitive device and operable to determine velocity of an object sensed by said range detector within the ranges spanned by said range gates.
9. 009214. An @@@@usion detection system for monitoring a secured area comprising: [00931 (a) a pair of passive electrooptical sensors, each sensor including a lens and a lightsensitive device having rows of electronically scanned pixel elements, each row of pixel elements being responsive to light from objects appearing within said area at respective ranges, said pair of sensors being mounted a predetermined distance apart and aimed downward into said secured area at an angle obtuse to a horizontal reference line; and (b) a data processing module coupled to the lightsensitive devices and having a range gate selector for selecting predetermined lines of pixels for processing scanned image data from objects appearing at predetermined ranges. [009s] 15. The intrusion detection system of claim 14 wherein said range gate selector is operable to create multiple zones of ranges within said secure area to be monitored. [0096l 16. The intrusion detection system of claim 14 wherein said data processing device further includes a velocity detector for determining velocity of objects detected by said range detector.
Description:
INTRUSION DETECTION SYSTEM CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation-in-part of application serial number 09/348,903 filed July 6, 1999.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT Not Applicable.

REFERENCE TO SEQUENCE LISTING, A TABLE, OR A COMPUTER PROGRAM LISTING COMPACT DISK APPENDIX Not Applicable.

BACKGROUND OF THE INVENTION [0004] Security systems frequently employ combinations of video monitoring and/or motion detectors which sense intrusion into an area. The former requires real-time surveillance by an operator while the latter is subject to frequent false alarm conditions.

U. S. Patent No. 5, 586, 063 to Hardin et al., which is assigned to the assignee of this application and is incorporated herein by reference, is directed to a passive optical speed and distance measuring system (the'063 system). Specifically the'063 system includes a pair of camera lenses positioned along a common baseline a predetermined distance apart and controlled by an operator to capture images of a target at different times. The camera lenses are focused on light sensitive pixel arrays that capture target images at offset positions in the line scans of the pixel arrays. A video signal processor with a computer determines the location of the offset positions and calculates the range to the target by solving the trigonometry of the triangle formed by the two camera lenses and the target.

With such a system, objects moving into the field of view of the video cameras may be monitored. Further if not only range but direction and velocity were lalown, objects of interest could be tracked and others ignored. To some degree, this would alleviate the problem of false alarms.

BRIEF SUMMARY OF THE INVENTION An intrusion detection system comprises a pair of optical lenses arranged a predetermined distance apart and having overlapping fields of view within an area to be monitored to form a common field of view; at least one light-sensitive device responsive to light from each of the optical lenses; a range detector responsive to signals from the light-sensitive device and operable to determine a range to an object within the common field of view; and a range discriminator for setting at least one range gate to sense objects within the common field of view at predetermined ranges and for ignoring objects outside of the predetermined ranges. totos) The foregoing and other objectives, features and advantages of the invention will be more readily understood upon consideration of the following detailed description, taken in conjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE SEVERAL DRAWINGS FIG. 1 is a simplified block schematic diagram of the system of the invention.

FIG. 2 is a simplified flow chart diagram of a preferred embodiment of the present invention.

FIG. 3 is a schematic illustration of the electro-optical relationships of the system used for generating a range measurement.

FIG. 4 is a schematic illustration of the electro-optical relationships of the system used for generating a velocity measurement.

FIG. 5 is a schematic illustration of a simplified hypothetical example of the correlation process.

FIG. 6 is a null curve diagram illustrating an exemplary relationship between the shift in pixels (x-axis) and the sum of the absolute differences (y-axis).

FIG. 7 is a simplified schematic illustration depicting the angular relationships between camera A and the target T at times tl and t2.

[0016] FIG. FIG. 8 is a simplified schematic illustration depicting the angular relationships between camera B and the target T at times tl and t2.

FIG. 9 is a schematic illustration depicting the angular relationships used for generating velocity vector components and approximations.

100181 FIG. 10 is a simplified schematic illustration depicting the angular relationships used for generating velocity vector components and approximations.

FIG. 11 is a simplified block schematic diagram of the system of the invention.

FIG. 12 is a simplified schematic illustration of a two-camera system of the present invention.

FIG. 13 is a simplified schematic illustration of a four-camera system of the present invention.

[00221 FIG. 14 is a simplified schematic illustration of a three-camera system of the present invention.

[00231 FIG. 15 is a depiction of the video scan lines orientation of the four-camera system of FIG. 13.

[0024] FIG. 16 is a schematic diagram illustrating the geometry of one of the optical detectors used in an intrusion detection system.

[0025] FIG. 17 is a schematic diagram illustrating the geometry of the intrusion detection system of FIG. 16.

FIG. 18 is a schematic diagram illustrating the range gate feature of the intrusion detection system.

[00271 FIG. 19 is a schematic diagram of one of the light-sensitive devices used for each of the lens in the intrusion detection system illustrating how objects are seen by the scanning of

selected lines of pixels.

[00281 FIGS. 20A, 20B, 20C and 20D are flow-chart diagrams illustrating the range gate setting feature of the intrusion detection system.

FIGS. 21 is a schematic diagram of a lens and a light-sensitive element illustrating the geometry referred to in FIGS. 20A-20D.

FIG. 22 is a schematic diagram of a lens illustrating the vertical angular field of view of a line of pixels in a light-sensitive device.

[oo3) FIG. 23 is a geometrical drawing illustrating the range span of a particular line of pixels in a light-sensitive device.

[00321 FIG. 24 is a geometrical line drawing illustrating minimum range of a selected line of pixels in a light-sensitive device as a function of object height.

10033) FIGS. 25A, 25B are flow chart diagram illustrating how approaching/receding velocity discrimination is accomplished within a selected range gate.

DETAILED DESCRIPTION OF THE INVENTION Referring to FIG. 1, the present invention includes a video camera subsystem and video display 10 connected to a control and computational subsystem 12. The camera subsystem 10 provides camera video from cameras A and B 14,16 to the control and computational subsystem 12. The control subsystem supplies alphanumeric video to the video display subsystem 10.

Cameras A and B 14,16 may be any type of electro-optical imaging sensors with a focal length f. Each imaging sensor can be, for example, a charge-coupled device (CCD), a charge- injection device (CID), a metal-oxide-semiconductor (MOS) phototransistor array or various types of infra-red imaging sensors, one example of which is a Platinum Silicide (PtSi) detector array. Control and computational subsystem 12 may be any type of computer. For example, the computational subsystem 12 may be that shown in FIG. 11, a general purpose computer with special software, or an alternate computer specifically designed to accomplish the functions described herein.

More specifically, as shown in FIG. 2, each of the cameras 14,16 in the camera subsystem 10, when instructed by the control subsystem 12, take a video image or linear scan of moving target T at a first instance t, and at a second instance t2 (for a total of four recorded images) lOOa-lOOd. The target is at location T1 at the first instance tl and at location T2 at the second instance. The camera subsystem 10 then passes the camera video to the computational subsystem 12 that makes the calculations necessary to determine the range of the target T at time instance tl 102a and the range R2 of the target T at time instance t2 102b. As will be discussed below in detail, the ranges R1 and R2 to target T at both time instances t, and t2 are obtained by correlating the images obtained from both cameras at that time. The image from camera A at time t1 is then correlated with the image from camera A at time t2 104. From the correlation result, the angles OIA-02A and OIB-02B can be calculated 106. Using R,, R2, and the angle 6, A- 02A, the target displacement between times t, and t2 as seen by camera A 108 can be calculated.

Using Rl, R2 and the angle 61$-628, the target displacement between times t1 and t2 as seen by camera B can be calculated 110. The two displacements are then averaged to obtain the target displacement between times t1 and t2 112. Then, the total target velocity V is calculated using the target displacement and the measured time interval (t2-tl) 114. Using the target displacement and the difference R,-R2, the components of the total target velocity parallel Vx and perpendicular Vy to the line-of-sight can be computed 116. Finally, from the knowledge of the velocity components parallel and perpendicular to the line-of-sight, the angle between the total target velocity vector and the line-of-sight can be computed 118.

[00361 It should be noted that knowledge of the total target displacement 8R and the time instance interval (t2-tl) enables computation of the velocity of the target as well as the components XR and YR of the displacement vector 8R. It should also be noted that the order of computations shown in FIG. 2 is meant to be exemplary and may be varied without changing the scope of the invention.

[0037] Turning first to the exemplary computation of range R, FIG. 3 shows an optical schematic diagram illustrating the placement of cameras A and B 14,16 used in the method for measuring of the range R or distance from the center of a baseline 17 to the target T. The method for measuring range R, the first step in the method of the present invention, is substantially the same method as that used in the'063 system. Calculating R would be done twice in the method of the present invention: once for calculating R1 (the distance from the

baseline midpoint 22 to the target at location T) and once for calculating R2 (the distance from the baseline midpoint 22 to the target at location T2). R, and R2 will be used as approximations for RlA, RlB, R2A, and R2B as set forth below.

Both the'063 system and the present invention, as shown in FIG. 3, include a camera A 14 positioned at a first position 18 and a camera B 16 positioned at a second position 20 on a baseline 17. In these positions, the cameras are separated by a distance of bl and have lines-of-sight LOS that are parallel and in the same plane. Range R, as measured by this method, is defined as the distance from the midpoint 22 of the baseline 17 to the exemplary target T. LOS is the line-of-sight of the two-sensor system. LOSA and LOSB are the lines-of-sight for cameras A and B 14,16, respectively. LOS intersects baseline 17 at its midpoint 22, is in the same plane as the cameras'lines-of-sight, and is perpendicular to baseline 17. The angle shown as 61A is the angle between LOSA and the target T and the angle shown as 01B is the angle between LOSB and the target T. Using the image information supplied by the video camera sub-system 10, the control and computational sub-system 12 first determines the angle of interest (OlB-01A) by electronically correlating the images from the focal planes of cameras A and B 14,16 to measure the linear displacement dlB-dlA. The magnitude of dlB- dlA can be measured by correlating the A and B camera images obtained at time tl. dlB-dlA is measured at the focal plane which is behind the baseline by a distance f, the focal length.

1003ou Image correlation is possible in the present invention because the system geometry (as shown in FIGS. 3 and 4) is such that a portion of the image from camera A 14 will contain information very similar to that contained in a portion of the image from camera B 16 when both images are acquired at the same time. This common information occurs in a different location in the camera A image when compared to its location in the camera B image due to the separation of the two cameras by the baseline distance bl.

10040l The correlation process is discussed in U. S. Patent No. 5,586, 063 to Hardin et al., which is assigned to the assignee of this application and is incorporated herein by reference. However, FIGs. 3 and 4 may be used to illustrate this process. FIG. 5 illustrates the correlation of two linear images, one from Camera A, the other from Camera B. For simplicity, a hypothetical video line of 12 pixels is shown. (In practice, cameras with video line-lengths of hundreds of pixels are used. ) In addition, for simplicity of illustration, a single 3 pixel-wide image of unit (t)

intensity is shown, with a uniform background of zero intensity. In practice, any pixel can have any value within the dynamic range of the camera. The pixel values for each of the two video lines are mapped in computer memory. In this case, the Camera A line is used as the reference.

The map for the Camera B line is then matched with the A line map at different offsets from zero pixels to some maximum value dictated by other system parameters. (Zero pixels offset corresponds to a range of infinity.) This unidirectional process is sufficient since the relative position of any target in the FOV of one camera with respect to the other is known. At each offset position the absolute difference is computed for each adjacent pixel-pair that exists (the pixels in the overlap region). The differences are then summed. It should be noted that there are a number of other mathematical procedures that could be used to correlate the lines that would achieve similar results. One advantage of the procedure described is that no multiplication (or division) operations are required. (Addition and subtraction are computationally less intensive.) FIG. 6 is a plot of the sum of absolute differences (y-axis) versus the offset for this example.

Note that the function has a minimum at the point of best correlation. This is referred to as the "global null, ""global"differentiating it from other shallower nulls that can result in practice.

The offset value corresponding to the global null is shown in FIG. 6 as dlB-dlA. This quantity is also shown in FIG. 3.

In order to measure the total displacement of the target (in order to compute the total velocity) at least one more correlation is required. The additional correlation is performed in a similar manner to that described above, but is a temporal correlation. It uses images from the same camera (Camera A), obtained at two different times (tl and t2). One difference is that the relative positions of the target image at the two different times is not known to the System. This requires that the correlation be bi-directional. Bi-directional correlation is achieved by first using the tl image map as the reference and shifting the t2 image map, then swapping the image maps and repeating the process.

Once image correlation has been completed, the angle (91B-01A) can be found from the equation: 01B-01A = arctan [(dlB-dlA)/f]. Using this information, range R is calculated by the equation: R = bl/ [2 tan 1/2 (01B-01A)]. Alternatively, the computational sub-system 12 can find range R by solving the proportionality equation: (dlB-dlA)/f = (bl/2) /R. The method for finding R is set forth in more complete terms in U. S. Patent No. 5, 586, 063, however, alternative methods for computing range may be used.

100431 FIG. 4 is an optical schematic diagram of the placement of cameras A and B 14,16 as well as the angles and distances used in the method for measuring of the velocity v, the second step in the method of the present invention. To make the necessary calculations to find the velocity v, first the target displacement (8R) between the target location (T1) at a first instance (tl) and the target location (T2) at a second instance (t2) must be determined. Once 8R is determined, the velocity (v) is computed as: v = 8R/ (t2-tl). It should be noted that the'063 system can compute only the ranges Rl and R2 which, when differenced (to form R2-Rl), constitute only one component of the total displacement 8R.

100441 To find an accurate bR, both triangle A (defined by camera A lens 14 at position 18 on the baseline 17, the target location Tl at the first instance tl, and the target location T2 at the second instance t2) and triangle B (defined by camera B lens 16 at position 20 on the baseline 17, the target location T1 at the first instance tl, and the target location T2 at the second instance t2) should be solved. By solving triangle A to find 8RA, an approximate of bR is found.

Solving for 6RB and averaging it with 8RA (8R = (8RA + 5RB)/2) greatly reduces error in using a single calculation. It should be noted that images of the target acquired by cameras A and B at times tl and t2 may have already been acquired and stored for use in range computations of the '063 system.

[00451 Fig. 7 shows an enhanced view of triangle A (defined by camera A lens 14 at position 18 on the baseline 17, the target location T1 at the first instance tl, and the target location T2 at the second instance t2). Specifically, the angle 61A-62A is the angular difference between target locations T1 and T2, as measured by camera A. The images are acquired by camera A at times tl and t2, as set forth above, and are then correlated to obtain the angle 61A-62A. The next step is to use Rl and R2 as approximations for R1A and R2A respectively. RI and R2 can be calculated using the equations set forth generally above and in detail in U. S. Patent No.

5,586, 063, incorporated herein by reference. Using these calculations, triangle A can be solved for the displacement 8RA, using the law of cosines: 5RA = [R12 + R22-2R1R2 cos (01A- 62A)] Y2.

8RA is slightly different than the desired 8R (of FIG. 4) because RI and R2 are distances from the midpoint 22 of the baseline to target locations T1 and T2, whereas R1A and R2A are distances from camera A to target locations Tl and T2. Using the built in symmetry of the

"system, this error can be greatly reduced by solving triangle B (defined by camera B lens 16 at position 20 on the baseline, the target location T1 at the first instance tl, and the target location T2 at the second instance t2) of FIG. 8 for 8RB and averaging the two results. bRB may be found using calculations similar to those set forth above for triangle A. Specifically, triangle B can be solved for the displacement bRB, using the law of cosines: 8RB = [R12 + R22- 2RlR2cos (91B-92B)] Y2.

100471 It should be noted that the solution of triangle B does not require a correlation operation (as did the solution of triangle A) to determine the angle 01B-02B. The reason for this can be seen by referring to FIG. 4 where it can be seen that the triangles A, C, Tl and B, C, T2 both contain the same angle (p (from the law that opposite angles are equal). C is the point of intersection between R1B, the range from camera B to the target at the first instance, and R2A, the range from camera A to the target at the second instance. ) Thus, since three of the four difference angles shown are known, the fourth can be computed using the law that the sum of the interior angles of a triangle is always equal to 180 degrees. Correlation using the images from camera B 16 may be performed for the optional purpose of verifying optical alignment.

As set forth above, once 8R is determined, the velocity v of target T is computed as: v = 8R/ (t2-tl). The time base 12a and sync generator 12b (FIG. 11) would provide the elements necessary to compute tl and t2.

The next step of the present invention is to compute the parallel component XR of the displacement vector 8R and the perpendicular component YR of the displacement vector BR.

Component XR of the displacement vector is parallel to the LOS in the plane defined by the LOS and the baseline 17. Component YR of the displacement vector is perpendicular to the LOS in the plane defined by the LOS and the baseline 17. The velocity vector components are determined by dividing the displacement vector component values by the time interval over which the displacement occurred.

As shown in FIGS. 9 and 10, the x component parallel to the LOS, XR, is defined as the difference of the two range measurements Rl (the distance between the baseline midpoint 22 and the target T, at first instance tl) and R2 (the distance between the baseline midpoint 22 and the target T2 at second instance t2). The difference between the two range measurements can be approximately defined by the equation: XR = R2-R,. This is an approximation, since the actual

difference of the two range measurements is defined by the equation : R2cosOT2-RlcosOTI.

R, cosOTl is the distance on the LOS from the baseline midpoint 22 to point 40, the perpendicular distance from Tl to the LOS. R2cosOT2 is the distance on the LOS from the baseline midpoint 22 to point 42, the perpendicular distance from T2 to the LOS. However, OT2 (the angle between LOS and R2) and OT, (the angle between LOS and R1) cannot be determined. The XR = R2-R approximation will produce accurate results when OT, and 0T2 are both small. Vx, the x component of the velocity vector, is then determined as Vx = XR/(tl-t2).

Ioostl The y component of the velocity vector, YR, also known as a"cross-track"velocity component, is then solved using the relationship set forth in FIG. 10. Using OR (as computed above) as the hypotenuse and XR (as computed above) as one leg of the relationship triangle of FIG. 10, the triangle shown in FIG. 10 can be solved for the perpendicular displacement component YR using Pythagorean theorem: YR= [ 2-XR2] I/2. The y component of the velocity, VY, is then VY=YR/t2-tl. The angle between the velocity vector and the LOS can then be calculated by the following equation: OLOS = arctan YR/XR. Knowledge of the angle OLOS is of value in applications where it is desirable to move the system line-of-sight to track the target or simply to keep the target in the field of view.

[0052] FIG. 11 shows an exemplary functional block diagram of one possible implementation of the velocity measuring system of the present invention. Camera or sensor A 14 and camera or sensor B 16 are electronic imaging cameras substantially controlled by the system controller 12.

The time base 12a and sync generator 12b are used to synchronize the cameras. Further, the time base 12a provides the time interval measurement capability that allows calculation of tl and t2. The time between image acquisitions may be determined by keeping count of the number of camera images that have been scanned between image acquisitions.

The digitizers 50a, 50b convert the analog camera outputs to a digital format, enabling the camera images (or portions thereof) to be stored in conventional computer-type memory 52.

100541 The image correlator 54 correlates the images supplied by camera A 14 and camera B 16.

The correlation process is used to determine the angular difference between cameras when sighting an object or target T at the same time ("correlation") or at two different times ("cross-correlation").

né range computer 56 then determines the range R to the target T by triangulation using the measured angular difference acquired by the cameras at the same time.

100sol The angles computer 58 uses both the range and angle measurements to compute the components of displacement of the target T parallel and perpendicular to the system LOS.

[00571 The velocity computer 60 uses the measured displacement components and knowledge of the time between measurements (t2-tl) to compute velocity V and its components, Vx and Vy. loossl The system controller 12 sequences and manages measurement and computation. The image conelator 54, range computer 56, angles computer 58, velocity computer 60, and system controller 12 can be implemented as hard-wired electronic circuits, or these functions can be performed by a general-purposed digital computer with special software.

Although the invention has been described with reference to detection systems for detecting the range and total velocity of a general moving target it should be understood that the invention described herein has much broader application, and in fact may be used to detect the range to a stationary object, the total velocity of any moving object and/or relative motion between moving or stationary objects. For example, the invention may be incorporated into a range and velocity detection system for moving vehicles. Another example is that the invention may be incorporated in a robotics manufacturing or monitoring system for monitoring or operating upon objects moving along an assembly line. Still another important application is a ranging device used in conjunction with a weapons system for acquiring and tracking a target.

Yet another application is a spotting system used to detect camouflaged objects that may be in motion against a static background. Other possible uses and applications will be apparent to those skilled in the art.

The foregoing invention can also be adapted to measure velocity in three-dimensional space. To do this a two-dimensional camera configuration, such as that shown in FIG. 12, is adapted to either the configuration shown in FIG. 13 or FIG. 14. The embodiment shown in FIG. 13 uses four cameras, A, B, C, and D centered around a central LOS (extending outward form the page). The baseline bl 1 defined between cameras A and B is perpendicular to baseline bl2 defined between cameras C and D, although bl 1 and bl2 need not be the same length. FIG.

15 shows the video scan lines orientation for this system in which cameras A and B operate as

one subsystem and cameras C and D operate as a second subsystem that is a duplicate of the camera A and B subsystem, except for its orientation. The velocity vectors produced by the two subsystems are summed (vector summation) to yield the total target velocity in three dimensions.

FIG. 14 shows an alternate configuration that can measure velocity in three-dimensions, but uses only three cameras A, B, and C. It should be noted that the FOV is smaller than that of the four camera system of FIG. 13 and the calculations to determine the velocity are more complex.

The velocity measuring system of the preferred embodiment can be adapted as an intrusion detection system. Although many intrusion detection systems use video surveillance cameras as monitors, attempts to make such systems automatic are problematic. Passive optical systems"see"everything and are therefore triggered by numerous false alarms. Falling objects, birds, animals and other objects which are not of interest are detected by such systems in the same way that intruders are. In the simplest system of this type, a video camera scans an area and continuously compares a scan of the pixels of a light-sensitive device with a previous scan.

When the pixel maps are compared, any difference between a present scan and previous scan means that an object has moved into the field of view and thus, an alarm is triggered.

In order to prevent false alarms, a passive optical system must be capable of discrimination between objects of interest such as human intruders and other objects. These objects can be detected by discriminating between various objects in the field-of-view of the system on several bases. First, the system may be configured to respond only to objects located at a given range within the area to be monitored. As will be explained below, a range gate may be set so that only objects captured within the range gate are recorded on the system; all other objects are ignored. Discrimination may also occur on the basis of the object's height and its velocity. Because velocity is a vector quantity as explained above, discrimination may also occur on the basis of the algebraic sign of the velocity vector. The system employs the same setup as illustrated in FIG. 1. However for intrusion detection, it is best to mount the system at a height hs above the ground as shown generally in FIG. 18. Having the system pointed downward at an obtuse angle to ground reference will provide the range gate capability required for object discrimination. A schematic close-up of this configuration is shown in FIG. 16 in which a lens 100 is mounted at a height hs above a horizontal surface 102 which may be the ground or a floor but is some horizontal reference plane : The lens has a focal length f and a light-sensitive device, such as a charge coupled device or equivalent 104, is placed at the focal

length. The light-sensitive device 104 includes a plurality of lines of pixels 106. A pair of lenses such as lens 100, which may be associated with video cameras 14 and 16, are placed at a downward looking angle a predetermined distance apart. Usually, the baseline distance between the two lenses will be parallel to the horizontal surface 102. This is not absolutely necessary as the geometry can be corrected if the baseline between the lenses is not perfectly horizontal.

Each lens includes a light-sensitive device 104. This may be a charge coupled device or any similar device having photosensitive elements as described above.

[oo63] Referring to FIG. 19, the light-sensitive device 104 includes lines 106 comprised of individual pixel elements 108. While FIG. 16 shows the use of a light-sensitive device 104 for each of the lenses represented by lens 100 in FIG. 16, it should be understood that a single light- sensitive device may be used if desired. Light from each of the lenses can be routed to a single light-sensitive device using mirrors and the like. However, simplicity of construction makes it more practical to use a single light-sensitive device for each lens in the dual lens array.

The light-sensitive device, typically a charge-coupled device or a CMOS imager chip, is in the focal plane of the lens; f is the focal length of the lens 100. The light-sensitive device 104 is shown for clarity of illustration as having only a few lines of pixels 106. However, an actual chip of this type would have hundreds of lines. From FIG. 16, it can be seen that for the particular orientation chosen, that is, the angle at which the lens is pointed into the space to be monitored, each line 106 on the chip"sees"out to a different maximum range. For example, line L is sensitive to objects at range RL but no further. The topmost line of the chip, line 110, would define the minimum range whereas ordinarily the bottom line 112 would define the maximum range. The maximum and minimum ranges are determined by the focal length f of the lens, the height hs of the system above the ground 102, and the elevation angle a.

Referring to FIG. 17, the system is set up by selecting the desired maximum range Rmax and the minimum range Rmin and the sensor height hg. Once this is done, the angles Omax and Omin can be calculated and the field-of-view angle (angle 0) may then be determined. The elevation angle a to which the system must be set can then be computed as a function of 0 and d) min. Once this is done, the only remaining task is to compute the focal length necessary for the lens. This focal length is a function of A and the focal plane imager chip height hc. The five necessary equations for solving for the focal length f are as follows:

Eq. 1 : Cmax = arctan (Rmax/hg) ; Eq. 2: d) min = arctan (Rmin/hss) ;.

Eq. 3: 0 (Dmax- (D min ; Eq. 4: a = 90 deg. - (0/2)-mm ; Eq. 5: f= hC/ [2 tan (0/2)] One mode of the intrusion sensing operation is shown in FIG. 18. FIG. 18 shows how the use of a range gate enables a system to discriminate between objects of interest and false alarms. A range span within which objects will be detected by correlation of a specific video line pair can be established by the control and computational subsystem of FIG. 11. The maximum range in the span cannot be greater than the maximum range that the specific line can "see. "However, it can be less. The minimum range of the range span can be any range less than the maximum. Once this span or"range gate"is set, the video line pair correlation is restricted to this span of distance within the area to be monitored. In FIG. 18, two range gates are shown, one for video line pair L and one for line pair L+m.

[0067] Line L can see both object 1 and object 3 but only object 3 is within the line L range gate.

Line L+M can also see object 1. In addition, line L+M can see object 2 but only object 2 is in the line L+M range gate. Thus, if object 1 were an object blown by the wind or a bird, it would be seen by many of the video lines in the light-sensitive device but it would not cause a false alarm because the range, when calculated, falls outside the parameters for the range gate of either line L or line L+M. The way in which the objects 1,2 and 3 might be seen by the light- sensitive device 104 is illustrated in FIG. 19. It should be noted that in order to perform object detection within a predetermined range gate, line pair correlation is performed for only a limited plurality of pixel lines 106 of the light-sensitive device 104. In effect, the light-sensitive device may be separated into pixel line"zones"which represent various range gates. Thus within an area to be monitored, range gates may be set at both distant and near ranges as determined by the needs of the user.

[00681 FIGs. 20A-20D illustrate the method by which the range gate is selected by the system controller of FIG. 11. FIGs. 20A-20D are a flowchart diagram that illustrates how the range gate is set. Once the system is installed within an area, a number of parameters must be set. These parameters may be measured and entered into the system through a computer keyboard. At block 100, object height, sensor height, focal length, sensor depression angle, the video camera

chip vertical active dimension and the number of the video lines in the chip are all entered into the system. Next, a nominal maximum range is selected at block 102. This range will depend upon the dimensions of the area to be monitored. At block 104, the angle L iS computed, which is the angle between video line-of-sight and a local vertical reference (which is 90 ° to local horizontal). At block 106, the angle is computed between the sensor line-of-sight and the line- of-sight that will be seen by a pixel line at the maximum range. Note that the identity of this pixel line is not yet known; it will be computed. Next, the linear distance or displacement from the center of the chip to the line which sees out to the maximum range is computed in block 108.

From this computation, the line number can then be computed in block 110. Once the line number is known, the vertical dimension of the pixel can be computed as shown in block 112.

From this information, the angular field of view of any particular line can be determined in block 114. Referring to FIG. 20C, now the ranges at the horizontal reference intercepts of any particular line may be computed. These parameters are shown graphically in FIG. 23. In block 118, the system next selects a line number for intrusion detection and in block 120, with the information previously known for each line number, the maximum dimension of the range gate is set.

Referring to FIG. 24, some assumptions must be made about the size of objects that will be seen by the system when they are found within the distance limits defined by the range gates.

In FIG. 24, an object has a height Ho. This dimension is then inserted in block 122 into the system so that the minimum range gate distance Ro min may be calculated. Referring to block 124, the range gate minimum can now be set so that the intrusion detection system is configured to see objects that appear between the distances within the area to be monitored between Ro min and RL max. As an example, given nominal system parameters of Hs as 10 feet (that is the two lenses and light-sensitive elements, preferably in the form of a pair of video cameras are placed 10 feet above the horizontal reference ground at a nominal angle of between one and two degrees pointing downward) with a focal length of a 159 millimeters and a chip height of. 25 inches with 525 lines of pixels, if the maximum range is set to 500 feet and the object height of interest is set to six feet, the system would use video line number 383 for detection. Line number 383 would see out to a maximum range of about 500 feet and to a minimum distance of about 200 feet. This would then avoid false alarms from objects that are higher than six feet but which occur at a range of less than 200 feet. This is merely an example, however, and the parameters of the system can be set by the user to define a single range gate, or multiple range

gates, according to its particular needs.

Referring to FIGs. 25A and 25B, a block diagram is shown which illustrates how the system of FIG. 11 operates to detect intruders within a secured area. Referring to FIG. 25A, after power-up and start at block 200, the system makes a range measurement (block 202). If the range detected is greater than the range gate maximum setting (block 204), the range measurement is discarded (block 206). The program loops back and another range measurement is made. If the range is not greater than the maximum setting in block 204, the measurement is compared with the range gate minimum setting (block 208). If the measurement is less than the minimum setting, the measurement is discarded (block 206). If the measurement is not greater than the minimum setting, the measurement is saved and the time is noted (block 210). This process continues until a sufficient number of measurements are collected (block 212). Once a sufficient number of data points have been collected, a linear regression of range versus time is computed (block 214). This computation yields the velocity of an object of interest that is found within the range gate. The system then determines whether the velocity is positive or negative (block 216). If negative, the object is marked as one that is receding (block 218). If positive, the object is approaching as determined in block 220. The system controller of FIG. 11 may contain preset alarm criteria. This provides still further discrimination among objects of potential interest. For example, objects that are moving either too fast (i. e. , birds or falling objects) or objects that move too slowly may be eliminated. In block 222, a comparison is made between the objects velocity and preset alarm criteria. If the velocity criteria is met (block 224), an alarm is activated (block 226). On the other hand, if the object velocity does not meet the preset alarm criteria, it may be discarded (block 228).

Thus, the intrusion detection system of the preferred embodiment is able to discriminate among objects not only on the basis of their range but also based upon velocity within a range of interest. Other criteria may be imposed as well. For example, objects approaching (positive velocity vector) at a high velocity might be discarded while objects receding at a similar velocity might be deemed to be of interest, or vice-versa. The user may select parameters based upon the particular environment to be monitored.

[0072] The terms and expressions which have been employed in the foregoing specification are used therein as terms of description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention is defined and limited only by the claims which follow.