DOCKET NO. H0014474-0104 PATENT

SELF-CONTAINED WIRELESS SECURITY SENSOR COLLECTIVE

SYSTEM AND METHOD

CROSS REFERENCE TO RELATED APPLICATIONS [0001] This patent application is related to U.S. Patent

Application No. / , entitled "MESH COMMUNICATION

WIRELESS CAMERA SYSTEM AND METHOD" [Docket No. H0014253- 0104] filed on , which is incorporated by reference.

TECHNICAL FIELD

[0002] This disclosure relates generally to security sensors and more specifically to a self-contained wireless security sensor collective system and method.

BACKGROUND

[0003] One of the top priorities at an industrial facility is security. Perimeter security, access controls, and communication systems may be elements of a security system at an industrial facility.

[0004] Sensors in a security system may include cameras, access readers and motion sensors. However, the costs of installing cables and wires to such sensors for power and data communications are generally high. Such costs may serve as a disincentive to an industrial facility owner to operate an effective security monitoring and alarm system.

[0005] Some industrial facilities and other commercial facilities have miles of perimeter to monitor, and security cameras may be required every 100 to 200 feet along the perimeter. Thus, 25 to 50 security cameras,

DOCKET NO. H0014474-0104 PATENT

2 along with associated power and data cables and trenches in which to install the cables, may be required for every mile of facility perimeter.

[0006] Motion sensors may also be installed in quantities proportional to the size of a facility perimeter being monitored. Access readers may be required on portals in the perimeter of a facility as well as on doors and gates at locations within the facility.

[0007] Furthermore, monitoring such a multitude of sensors may require a complex monitoring system. Data from each sensor may be routed to a single control center for monitoring and alarm generation. Both human and equipment costs for such monitoring may be high. As a result, current security monitoring systems may have high installation costs and monitoring costs when used in an industrial facility.

DOCKET NO. H0014474-0104 PATENT

3 SUMMARY

[0008] This disclosure provides a self-contained wireless security sensor collective system and method.

[0009] In a first embodiment, a system includes a plurality of sensors and a monitoring system. The sensors and the console are capable of wireless communication. A first of the sensors is operable to sense information relating to a specified condition and to send a first wireless message relating to the sensed information to a second of the sensors. The first sensor is also operable to send a second wireless message relating to the sensed information to the monitoring system.

[0010] In particular embodiments, the second sensor is also operable to sense information relating to the specified condition, and the message sent to the monitoring system includes information derived from the information sensed by both the first and second sensors.

[0011] In other particular embodiments, the second sensor may modify its functionality in response to the first wireless message.

[0012] In a second embodiment, a sensor includes a sensor device, a wireless communication device and a controller. The controller is operable to receive information relating to a specified condition via the sensing device. The controller is further operable to send a first wireless message to a second sensor via the wireless interface, where the first wireless message relates to the sensed information. The controller is also operable to send a second wireless message to a monitoring system via the wireless interface, where the second wireless message also relates to the sensed information.

DOCKET NO. H0014474-0104 PATENT

4

[0013] In a third embodiment, a method includes sensing information relating to a specified condition with a first sensor of a plurality of sensors that are capable of wireless communication. The method also includes sending a first wireless message relating to the sensed information from the first sensor to a second of the sensors. The method further includes sending a second wireless message relating to the sensed information to a monitoring system that is capable of wireless communication.

[0014] Other technical features may be readily apparent to one skilled in the art from the following figures, descriptions, and claims.

DOCKET NO. H0014474-0104 PATENT

5 BRIEF DESCRIPTION OF THE DRAWINGS

[0015] For a more complete understanding of this disclosure, reference is now made to the following description, taken in conjunction with the accompanying drawings, in which:

[0016] FIGURE 1 illustrates an example wireless security sensor system according to one embodiment of this disclosure;

[0017] FIGURE 2 illustrates an example sensor according to one embodiment of this disclosure;

[0018] FIGURES 3 illustrates example actions performed by an example wireless security sensor system according to one embodiment of this disclosure; and

[0019] FIGURE 4 illustrates example actions performed by a group of system components according to one embodiment of this disclosure.

DOCKET NO. H0014474-0104 PATENT

6 DETAILED DESCRIPTION

[0020] FIGURE 1 illustrates an example wireless security sensor system 100 according to one embodiment of this disclosure. The embodiment of the wireless security sensor system 100 shown in FIGURE 1 is for illustration only. Other embodiments of the wireless security sensor system 100 could be used without departing from the scope of this disclosure .

[0021] In this example embodiment, the wireless security sensor system 100 could be used in any suitable type of security monitoring application. For example, the wireless security sensor system 100 could be used in a building, an industrial facility or an urban environment. Although the wireless security sensor system 100 may be described below as being used in an industrial facility, the wireless security sensor system 100 could be used in any of these or other environments. Also, although the wireless security sensor system 100 may be described below as being used to detect physical invasion, the wireless security sensor system 100 may be used to detect fire, machine failure, process failures and other alarm conditions.

[0022] In addition, the wireless security sensor system 100 could use any suitable wireless signals to communicate. Although the wireless security sensor system 100 may be described below as using radio frequency (RF) signals to communicate, the wireless security sensor system 100 could use any other or additional type of wireless signal.

[0023] As shown in FIGURE 1, the wireless security sensor system 100 includes a response system 102. In some embodiments, the response system 102 may include an operator console that may be monitored by an operator. The operator may respond to security alarms reported at the

DOCKET NO. H0014474-0104 PATENT

7 operator console. Such responses may include dispatching security personnel to the area of the security breach and shutting down industrial processes in the area of the process failure. In other embodiments, the response system may be a security system that dispatches security personnel automatically in response to a security alarm. In yet other embodiments, the response system 102 may be an industrial process control system that responds to a security alarm by, for example, emptying a tank that may be under attack or shutting down a pump feeding a section of pipeline that is under attack.

[0024] The response system 102 may be in wired or wireless communication with a monitoring system 104 that performs alarm analysis on, and routes signals received from, sensors in the environment being monitored. The monitoring system 104 may analyze reports received from sensors to sense an alarm condition and report on that condition to the response system 102. Where the sensors include cameras, the monitoring system 104 may route all or selected video signals received from sensors to the response system 102.

[0025] The wireless security sensor system 100 may be configured as a wireless mesh communication system. Sensors 114-132 may communicate with each other and with relay devices 106-112, as well as directly with the monitoring system 104. Such wireless links between nodes of the wireless security sensor system 100 may be formed at system configuration. Also, a routing map may be created indicating pathways to be used for sending a wireless message from one sensor to another or from a sensor to the monitoring system 104.

[0026] The initial ability of one node to establish a wireless link to another node may be affected by distance

DOCKET NO. H0014474-0104 PATENT

8 between nodes, intervening structures or geographical features that interfere with wireless signals, or other factors. Such factors affecting wireless communication may change, permanently or temporarily, during operation of the wireless security sensor system 100, causing previously operable wireless links to degrade or fail. In the event of such failures, the wireless security sensor system 100 may route a wireless message by an alternate path to avoid degraded or failed links.

[0027] As shown in FIGURE 1, in the example wireless security sensor system 100 the sensors 114 and 116 are able to communicate wirelessly with each other and with the relay device 106, which is able to communicate wirelessly with the monitoring system 104. The sensor 118 is able to communicate wirelessly with the relay devices 106 and 108 and with the sensor 120, which is able to communicate wirelessly with the relay device 108. The sensor 122 is able to communicate wirelessly with the relay device 108, and both the sensor 122 and the relay device 108 are able to communicate wirelessly with the monitoring system 104.

[0028] The sensor 124 is able to communicate wirelessly with the relay device 112 and the sensor 126, which is also able to communicate wirelessly with the relay device 112. The sensor 128 is able to communicate only with the sensors 126 and 130. The sensor 130 is further able to communicate with the relay device 110 and the sensor 132, which is also able to communicate wirelessly with the relay device 110. The relay devices 110 and 112 can also communicate wirelessly with the monitoring system 104.

[0029] As such, subsets of the sensors 114-132 and the relay devices 106-112 of the wireless security sensor system 100 may collect information and perform analysis on a particular security threat or alarm condition by

DOCKET NO. H0014474-0104 PATENT

9 communicating only with each other. In this way, communication bandwidth may be utilized in only the portion of the network that enables the subset of sensors and relay devices to communicate with each other. Communication bandwidth in other portions of the wireless security sensor system 100 may be left free for other purposes. Furthermore, where some of the sensors 114-132 are video cameras, real-time video from only selected cameras may be routed back to an operator to reduce demands on the bandwidth of central links of the communication system, although real-time video from all cameras may be routed to the operator.

[0030] FIGURE 2 illustrates an example sensor 200 according to one embodiment of this disclosure. The embodiment of the sensor 200 shown in FIGURE 2 is for illustration only. Other embodiments of the sensor 200 could be used without departing from the scope of this disclosure .

[0031] In this example, the sensor 200 includes a sensor device 204, a controller 202 and a wireless interface 206. A battery 210 may power the components of the sensor 200.

[0032] In some embodiments, the sensor device 204 may be a video camera. In other embodiments, the sensor device 204 may be a motion detector. In yet other embodiments, the sensor device 204 may be an access device, such as a proximity detector, a biometric scanner, a magnetic stripe or barcode reader, or a keypad. The sensor device 204 could also represent a combination of these or other devices .

[0033] The controller 202 is coupled to the sensor device 204 and receives signals corresponding to information sensed by the sensor device 204, which relates to the environment in which the sensor device 204 is

DOCKET NO. H0014474-0104 PATENT

10 operating. The controller 202 may analyze the signals in order to detect certain specified conditions. For example, in some embodiments, the sensor device 204 may be an access device and the controller 202 may analyze the sensed information to detect the opening of a door or gate without the proper authorization device being presented. In other embodiments, the sensor device 204 may be a video camera and the controller 202 may analyze the video signal to detect the presence of an intruder or to detect a failure of the camera or interference with the proper operation of the camera. Failure conditions of a camera may include information relating to the charge status of the battery 210 or self-testing diagnostic programs executed by the controller 202.

[0034] The controller 202 is also coupled to the wireless interface 206. Having detected a threat to the facility being monitored or to the proper operation of the security system, the controller 202 may send a message relating to the sensed information via the wireless interface 206. The wireless interface 206 may transmit an RF or other signal via an antenna 208 to another sensor, a relay device or a monitoring system.

[0035] FIGURE 3 illustrates example actions 300 performed by the example wireless security sensor system 100 according to one embodiment of this disclosure. More specifically, FIGURE 3 depicts a situation where the sensors 114-132 and the relay devices 106-112 have organized themselves, in a manner to be explained below, into three subsets. While FIGURE 3 shows three subsets, it will be understood that the sensors 114-132 and relay devices 106-112 may organize themselves into more or fewer subsets, as required to track threats detected by the wireless security sensor system 100. The subsets are

DOCKET NO. H0014474-0104 PATENT

11 referred to in FIGURE 3 as collective sub-units 302, 304 and 306. The collective sub-units (or collectives) 302-306 may comprise components of the wireless security sensor system 100 that are located in geographically separate areas of an industrial facility being monitored. The components in the collective 302 may or may not be different components than those in the collective 304, which may or may not both be different than the components in the collective 306.

[0036] With reference to the elements of FIGURES 1 and 2, in step 302a, the sensor 116 may identify a threat in the information that its sensor device 204 senses. Also in step 302a, the sensor 116 may communicate with the sensors 114 and 118 and the rely device 106 to organize the collective sub-unit 302. In step 302b, the components of the collective 302 may further communicate with each other to verify the threat detected by the sensor 116 and to condition the functionality of the sensors 114-118 and the relay device 106 for further analysis of the threat. Such changes to the functionality of a sensor or relay device may include, among others, adjusting a sensitivity of a sensor to improve its ability to sense the threat, loading an analysis program into a sensor or relay device, and reorienting a camera capable of pan/tilt/zoom adjustment to improve its image of the threat.

[0037] Having verified and further analyzed the threat, in step 302c the collective 302 may send an alarm message to the monitoring system 104 or update a previously sent alarm. Also in step 302c, the collective 302 may continue to track and analyze the threat. In step 302d, the collective sub-unit may predict a future development in the status of the threat and configure itself to continue tracking the threat, for example by adding another sensor

DOCKET NO. H0014474-0104 PATENT

12 to the collective 302. The collective 302 may then return to step 302a, step 302b or step 302c.

[0038] The sensors and relay devices within a collective sub-unit and in different collective sub-units may exchange messages 308 in a first communication protocol referred to as an Artificial Collaborative Protocol (ACP) . Such a protocol may include messages for use in mustering sensors and relay devices into a collective, communicating the identity of a threat, verifying a threat, and communicating desired functionality for a sensor or relay device.

[0039] The components of a collective sub-unit may send messages 310 to the monitoring system using a second communication protocol to communicate the components' status and the status of a threat. Such a protocol may be referred to as a Collective to User Protocol (CUP) . Such a protocol may include messages for reporting a threat, transmitting real-time or compressed video, transmitting still images, and conditioning the response of a collective to a threat .

[0040] FIGURE 4 illustrates example actions 400 performed by a collective sub-unit according to one embodiment of this disclosure. This description uses the sensor 116 for illustrative purposes, although it will be understood that some or all of the actions 400 may be performed by any of the sensors 114-132 in the wireless security sensor system 100. Also, any of the relay devices 106-112 may contribute to the analysis process of a collective sub-unit by performing any of the actions 400 that do not involve sensing the environment.

[0041] The sensor 116 may obtain and analyze sensor data at step 402 for specified conditions indicating a threat. If the analysis does not indicate a possible threat in step 406, the sensor 116 may return to step 402 to obtain and

DOCKET NO. H0014474-0104 PATENT

13 analyze further sensor data. If a possible threat is indicated in step 406, the sensor 116 may consult a geographical map of the environment it is sensing to determine a geographical direction of the possible threat and identify a second sensor (for example, the sensor 114) that is nearest to the sensor 116 in that direction. Having identified the sensor 114, the sensor 116 may then send a wireless message to the sensor 114 using the ACP protocol, requesting that the sensor 114 verify the possible threat at step 408. The sensor 114 may analyze its own sensor information or may perform additional analysis processing to provide the requested verification to the sensor 116.

[0042] In step 410, if the sensor 116 receives a reply message in the ACP protocol indicating that the sensor 114 has not verified the possible threat, the sensor 116 may return to step 402 to obtain and analyze further sensor data. If the sensor receives a message in step 410 that indicates that the sensor 114 has verified the possible threat, then in step 412 the sensor 116 may further consult the map and identify some elements of a collective sub-unit to be mustered for use in tracking the threat . The sensor 116 may select candidates for membership in the collective based upon the geographical location of sensors, the processing capabilities of sensors or relay devices, or other criteria.

[0043] Further, in step 412, the sensor 116 may send one or more wireless messages using the ACP protocol to the candidate sensors and relay devices to form the collective sub-unit. In step 414, the sensor 116 may send further messages using the ACP protocol to the components of the collective to determine whether they are prepared for tracking the threat. If the sensor 116 determines in step

DOCKET NO. H0014474-0104 PATENT

14

414 that one or more components are not prepared, then in step 416 the sensor 116 may send further messages using the ACP protocol to cause the unprepared components to prepare themselves for tracking the threat .

[0044] Whether the components of the collective sub-unit are already prepared in step 414 or have been prepared in step 416, in step 422 the sensor 116 may send further messages in the ACP protocol to initiate tracking of the threat by the collective. In step 424, a component of the collective may send one or more messages to the monitoring system 104 using the CUP protocol to report the threat to a user of the wireless security sensor system 100. The messages may report information such as detection of the threat, a location of the threat, a threat level of the threat, still images of the threat, a video clip of the threat and real-time video of the threat. The messages may multiplex video signals from selected sensors of the collective for the operator console by switching periodically between the video signals from the selected sensors. The sensor 116 may then return to step 408 to continue the process of participating in the collective's tracking of the threat .

[0045] In some embodiments, in step 414, the collective sub-unit may determine its components' preparedness to track a moving threat. The sensor 116 may analyze its sensor information to determine whether the threat is moving. If not, the collective may move on to tracking the threat in step 422. If the threat is determined to be moving in step 414, a component of the collective may consult a geographical map including information regarding the orientation of the sensor 116 and its area of coverage to determine a direction in which the threat is moving. The component may further consult the map to identify a

DOCKET NO. H0014474-0104 PATENT

15 sensor whose area of coverage is in the direction that the threat is moving, such as the sensor 118.

[0046] The sensor 118 may then determine whether it is ready to track the threat moving in the determined direction from its present position. If the sensor 118 determines that it is prepared to track the moving threat, then the collective may move on to tracking the threat in step 422. However, if the sensor 118 determines that it is not ready to track the threat in step 414, the sensor 118 may prepare itself in step 416 by actions such as reorienting its field of view by panning, tilting or zooming. It may thus obtain a position in which it will be able to sense the threat when the threat moves into the field of view of the sensor 118.

[0047] In other embodiments, in step 414 the collective sub-unit may determine whether a component (for example the relay device 106) has an analytical program that it will need in tracking the threat. If so, then the collective may move on to tracking the threat in step 422. If not, the relay device 106 may load the program from another component of the collective or from a program repository coupled to the monitoring system 104. Once the program is loaded into the relay device 106, the collective may move on to step 422 and track the threat.

[0048] Concurrently with obtaining and analyzing sensor data, the sensor 116 may also await communications from other sensors or relay devices in step 404. A relay device or other component of a collective sub-unit may also perform this step, in order to participate in the analysis process of the collective. A received message may be checked in step 428 to determine whether it uses the ACP protocol or the CUP protocol. If the message uses the ACP protocol, it may be checked in step 430 to determine

DOCKET NO. H0014474-0104 PATENT

16 whether it relates to a new threat. If the message relates to a new threat, the sensor 116 may begin processing the threat by verifying the threat in step 406. If the threat is not a new threat, the sensor 116 may continue tracking the threat by updating its threat data in step 426. Updating the threat data in step 426 may include adding or deleting components to the collective. The collective may again determine, in step 414, whether the components of the collective sub-unit are prepared, in light of the updated threat data.

[0049] If a collective sub-unit component determines in step 428 that the received message uses the CUP protocol, the component will determine who the intended recipient of the message is. If the message is intended for the components of the collective, then at step 432 the component will comply with the message, as well as forwarding the message to other components of the collective. If the message is intended for the monitoring system 104 or another collective, the component will forward the message to the next node in a wireless communication path leading to the intended recipient.

[0050] In step 434, any node in the wireless security sensor system 100 may analyze its own self-health, whether or not currently a part of a collective sub-unit. This analysis may include assessing a charge level of the battery 210 or performing a diagnostic self-test of one or more components of the node. The node may send the results of the self-health analysis via a wireless message to the response system 102. A system operator may review such messages in the course of performing maintenance or preventive maintenance on the wireless security sensor system 100. Where the message indicates a low charge level on the battery 210, the maintenance may include replacing

DOCKET NO. H0014474-0104 PATENT

17 or recharging a conventional battery or replenishing the fuel in a fuel cell.

[0051] In some embodiments, various functions described above are implemented or supported by a computer program that is formed from computer readable program code and that is embodied in a computer readable medium. The phrase "computer readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer readable medium" includes any type of medium capable of being accessed by a computer, such as read only memory (ROM) , random access memory (RAM) , a hard disk drive, a compact disc (CD) , a digital video disc (DVD) , or any other type of memory.

[0052] It may be advantageous to set forth definitions of certain words and phrases used throughout this patent document. The term "couple" and its derivatives refer to any direct or indirect communication between two or more elements, whether or not those elements are in physical contact with one another. The terms "application" and "program" refer to one or more computer programs, software components, sets of instructions, procedures, functions, objects, classes, instances, related data, or a portion thereof adapted for implementation in a suitable computer code (including source code, object code, or executable code) . The terms "transmit," "receive," and "communicate," as well as derivatives thereof, encompass both direct and indirect communication. The terms "include" and "comprise," as well as derivatives thereof, mean inclusion without limitation. The term "or" is inclusive, meaning and/or. The phrases "associated with" and "associated therewith," as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be

DOCKET NO. H0014474-0104 PATENT

18 communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like. The term "controller" means any device, system, or part thereof that controls at least one operation. A controller may be implemented in hardware, firmware, software, or some combination of at least two of the same. The functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.

[0053] While this disclosure has described certain embodiments and generally associated methods, alterations and permutations of these embodiments and methods will be apparent to those skilled in the art. Accordingly, the above description of example embodiments does not define or constrain this disclosure. Other changes, substitutions, and alterations are also possible without departing from the spirit and scope of the invention, as defined by the following claims.