Related Application:

This application claims priority to IR.Application Serial No.139550140003006496.

Field of Invention:

The present invention relates to a surveillance system to identify violent vehicles by processing and reviewing their data through telecommunication systems.

Background of Invention:

One of the challenges faced by governments and organizations involved in traffic misdemeanors is the identification of drivers who have not official documents or do not comply with traffic rules. These documents include smog test certificate, insurance documents or technical examination confirmations. The vehicle inspection requires the use of police force and spending a lot of time and money.Additionally,traffic cameras are usually used to detect the passing of cars from red lights, detecting vehicles that violate road traffic regulations, detecting

unauthorized (high) speeds, and for security purposes.

Discussion of Related Art:

Previous patents usually anticipate systems that detect defects or technical malfunctions if they occur, remotely detected and if possible try to fix them. Most of these systems typically have a modulus that is mounted on a vehicle and sends malfunctions of the mentioned vehicle to an appropriate center (e.g. CN202648693U). In some cases, the car is connected to a terminal and this information is transmitted through the terminal to an appropriate center(e.g

CN202720513U).

In some other patents, such as US20120256769, some systems are anticipated to detect problems for the occupants of a vehicle, such as the presence of a gunman in the vehicle.

US 20130033386 Al shows a method and apparatus for the detection and tracking of cars, such as vehicles without insurance, documents or technical inspection sheets, or those who violate traffic laws, in which a module is installed on the vehicle and sends the information to the appropriate data center, and then a traffic officer can detect and intercept the vehicle,

Summery: In this invention, a system is proposed by which a vehicle without a technical inspection certificate (and/or other official documents) is identified using a central system (including a database and a server) and Licence Plate Cameras (or cameras which can recognize the model, type and color of vehicles as well as License plate number). For this purpose, it is suggested that the data from inspection devices are transmitted to a central remote server by appropriate hardware and software, e.g. by a network protocol, a network board, and a computer, to minimize human intervention in the process of certification approval. With this system, it is possible to identify vehicles which lack one or more of the official documents required for the car and carry out the appropriate punitive actions.

Brief DESCRIPTION of DRAWINGS

Fig 1A shows an overall block diagram of the system when the invention is used to check the smog test certificate of the vehicle.

Figure IB shows the case when the data from the camera is sent to a data center, and the data of the vehicle smog test are sent to another data center

Fig. 1C shows the case when the system is used to recognize the vehicles without insurance certificate.

Fig. ID shows an embodiment of the system where both insurance and smog test certificates of the vehicle are sent to the data center.

Fig. IE shows a case when the data mentioned above, are sent to different data centers, and then these two data centers communicate with the third one.

Fig IF shows the block diagram of the system on a lower system level.

Fig 1G shows one embodiment of the system, when the system is being used for automatic recognition of the vehicles

Fig 1H is analogous to Fig. 1G, wherein the system is being used to automatic recognition of insurance status of the vehicles.

Fig. IK shows a block diagram illustrating method steps for practicing an alternate embodiment of the invention.

Figure 2 shows the process of operation for one sensor.

Figure 3 shows the scenarios of to process the data transmitted to the Technical Examination Center or Insurance Center.

Detailed description: The present invention provides a method and a system for recognizing and fining the cars without official documents, such as smog test/inspection certificate/registration/insurance documents etc., by using a license plate camera. The camera is mounted on a pillar (or alike) on roads, parking lots, streets, etc. The target vehicle may be moving or stationary.

Specifically, the invention provides a vehicle surveillance and fining system by utilizing a closed-circuit television camera (CCTV camera) such as License Plate Camera (LPR) or a video camera mounted on a pillar or a gate or alike on roads, parking lots, etc., for capturing an image of the license plate of the vehicle.

After capturing the image by the camera, an image -processing software analyzes the images and extracts the plate information. This data are then matched, by a processor, with license plate numbers which reside in a license plate number database. Every license plate number in the database is related to a record containing information about the vehicle/the owner of the vehicle/ and the official records of the vehicle such as registration/insurance/smog test/inspection status/theft status etc.

A processor then processes the whole data (data coming from the camera and data inside the database) and if the results of the processing shows that the vehicle lacks one or more of the official documents (such as smog certificate/inspection certificate/registration/insurance etc.), then the appropriate punitive or preventing action can be taken place, such as issuing a ticket, fining, reporting to DMV or other authorities, etc. One example for the preventing action can be not issuing the bill of lading, etc. The results of the data processing can also further be displayed on a screen in the data center.

In one embodiment of the system, the punitive action can be repeated periodically until the owner of the vehicle takes appropriate measure to resolve the issue. For example, if a vehicle's image captured and the results of the data processing shows that it lacks smog test/inspection certificate, then a ticket would be issued; then, issuing ticket can be repeated, e.g. every other week, until the owner of the vehicle's takes it to a smog test/inspection center and obtains the related certificate for it.

Communication between the LPR camera and the data center, where the database is located, can be accomplished via a communication link by appropriate network and interface, such as wireless/cable/landline communication link/internet/cellular network/ telecom network, etc. The communication interface is used to transmit the vehicle information such as license plate information to the server, and could be used to transfer data from the server to the camera, such as control command, etc. if needed.

A communication interface associated with the server receives the license plate information from the camera. The server also may have a communication interface to send/receive data to/from other servers of other databases which have alternative information from the car and the owner. The invention also provides a method for identifying and fining a vehicle without one or more necessary official documents, using an LPR camera installed (on a road/parking lot/ etc.) A video image is captured by the camera, and an image-processing software analyzes the information. The license plate number found in the image is compared with the data within the database. If the matched data in the database show that the vehicle lacks one or more of the official documents, or there are some other issues, the appropriate action can be taken place.

The action could be sending ticket to the driver/owner of the vehicle, alerting him/her about the issue, etc. If a punitive action is taken place, then it can be repeated until the appropriate measure is taken by the owner/driver. For example, if s/he had registered for Non-Operational car, but the camera image shows that the car was moving or being utilized (was seen in a commercial parking lot), then ticket can be issued, and the fining can be repeated, e.g. every day or every week, etc., until the owner registers the vehicle, and/or take it to the Smog Check/Inspection cetnre or get insurance for the vehicle/etc.

The method additionally comprises the steps of (i) sending the information of the smog test results of the vehicle through communication interface from the smog/inspection equipment (residing in a smog test/inpection center) to the data center, and/or information of the vehicle insurance status from the insurance department or other related offices, and/or vehicle registration from related offices, to the data center, and (ii) sending the image information of the camera to a server (or to a data center) that is associated with the database via a communication link, and (iii) comparing and processing these information to recognize the vehicles which are being utilized while lacking one or more of the official documents, and (iv) taking appropriate action such as ticketing/fining/etc. if needed.

Also, the owner (/driver) of the vehicle might be alerted about reaching to the deadline for one or more of his official documents by SMS or other related methods.

The data of the smog test/inspection equipment are sent through the communication interface, over a communication link, to the data center. In this way, the human interference with obtaining and sending the data is omitted. If the equipment is connected to a personal or industrial computer, then an appropriate hardware/middle ware/ software may be needed to send the data from the equipment to the data center over a communication link.

Camera are placed in locations such as roads, shopping center parking lots, etc., where a vehicle existence in those locations shows that the vehicle is being used.

The technical inspection equipment consists of several parts, including exhaust gas test sensors, wheel test sensors and so on. The outputs of these sensors are usually sent by a cable to a computer or a printer. When the sensors' data goes to a printer, they are printed on a paper sheet. Otherwise, the sensors data is processed in a computer and the result of the confirmation or disapproval of the technical tests is determined after processing ; then the result of the sensor data can be printed or displayed. In the present invention, it is suggested that the data from the sensors, instead of being processed in the local computer, is transferred through a communication network (such as the Internet) to a central (remote) server , where the sensors' data is processed and the result of the confirmation or disapproval of the vehicle technical test is determined by the central server. The result of the processing of the sensors' data (and / or the end result of auto-approval /

disapproval) can then be transferred from the central server to the computer at the inspection center and then be displayed on the inspection center display and /or sent to a printer.

In a different embodiment of the system, sensors' data processing can be partly done by a local computer, and partly by the central remote server. The result of the processing of information that is obtained in either of these two facilities (central server and local computer) can be transmitted through the network for different purposes.For example, a smog sensor data can first be accessed to the local computer, then it goes to the central server through the network, processed in the central data server, and then the type of smogs in the exhaust gas and their amount are passed to the local computer (available at the inspection center). In the inspection center, passing of these numbers (the amount of exhaust gases emitted) from the permitted threshold levels are determined, and ultimately, the approval or non-approval of the vehicle's health regarding smog test is decided.

Generally, the purpose of sending data to a remote central server and processing on the remote server is that the manual intervention ( by the staff of the inspection center) be eliminated or minimized and consequently the possibility of deception on the issuance of the inspection certificate be eliminated or minimized. For this reason, the sensors' data, which is transmitted to the local computer, should be transmitted to the central server without human's intervention. In general, the less human intervention in the transfer of information between the central server and the local computer, the risk of fraud in the certification process of the technical

examination/inpection is less. Because of this, the sesnors data transmitted to the local computer, can be sent to the remote server through appropriate hardware (such as a Network Board) and the corresponding software, which includes appropriate protocols, and using appropriate transmitting equipment (such as a modem or rotor) and preferably over a secure telecommunication channel. Also, the existing communication protocols in the market for communication between the local computer and the remote server can be used , and/or the specific protocols for this connection can be designed .

Figure 2 shows an example of the operation process. This figure shows the process of operation for one sensor. Therefore, for different sensors of technical examination equipment, this process should be repeated.

It should be noted that in order to send the sensors data of different inpection equipment, two methods can be used. The first method is to transfer the sensor's data to the central server online in real time and then start the next test with the corresponding (next) sensor. The second step is to perform all the vehicle -related tests with the sensors initially and store the data of all sensors in the local computer, and then send all of this information to the central server through the hardwares and relevant protocols. In another method, it is possible to store sensor data for several cars on a local computer, and then send all of the mentioned data to the central server.

Description of units in the data center

The server in the data center would have a back end unit 6, a storage unit 1 and a reporting unit 1.

The back-end unit 6: This unit would do different tasks, such as receiving, sending, saving and processing of data. This unit can be a processing unit, a computer, a server; or it can be a monitoring center which does different tasks. Data from the technical or smog test center, insurance office, (or other locations such as the department which is responsible for issuing registration) is transferred to this unit by communication interfaces. In one embodiment, this unit can transfer the data from the chnical or smog test center (or insurance office, etc.) to the storage unit 1. In another embodiment, this unit can generate a report of the vehicles which need to get one or more of their official documents, and send this data to the appropriate individuals and/or authorities. This unit can also generate a report of those vehicles which lacks one or more official documents which can be shown through reporting unit 2. Unit 6 can be a main monitoring center which do all the tasks mentioned above, or can be comprised of different parts while each part resides in the same or different locations (in this case, communication interfaces and other appropriate equipment may be needed for communication between different parts and/or units.)

The storage unit 1: This unit would save different data, such as the vehicle's information, the model, the model year, the vehicle's history, the result of the inspection (or smog test), the vehicle's insurance info, the owner's info, the registration status, etc. Besides, the storage unit can save the intermediate data from data processing when needed. This unit can be comprised of a single part, or different parts, while each part may reside in a single location, or different locations (in this case, communication interfaces and other appropriate equipment may be needed for communication between different parts and/or units.)

The reporting unit 2: It would show the results of the data processing of unit 1. For example, if a vehicle which lacks one (or more) official documents, and was being utilized, it shows the vehicle's info.

As another example, it would show the information of those vehicles which needed to go for smog test (or get insurance for the vehicle, or pay for registration, etc.) within a time period, but it didn't (and/or if this vehicle was being utilized); or it can show the information of those vehicles which need to get one or more of the above mentioned official documents within a time period.

The reporting unit can be a display, a printer, the equipment to send SMS data (to individual or authorities (the vehicle's owners, police force, etc.)), the equipment to send signal to other external systems, etc. For example, it can be the equipment to send an electronic signal (when a vehicle without one or more official document has been found by the system) to another system which would make a decision based on this signal.

This unit can be comprised of different reporting units, which all resides in a single data center, or in different data centers and in different locations. Besides, the reporting unit may itself need (or have) communication interfaces to communicate with different parts/units of the system.

As shown in the figure 1, the smog test results of the vehicle, is sent to a data center to be saved in a database. The database can be located in DMV office, City, Police data center, etc. The database can be partly in one location, and partly in another location as depicted in Fig. IB.

There are different scenarios to process the data transmitted to the Technical Examination Center or Insurance Center. Following is the brief description of each scenario:

Scenario A: In this case, checking the status of the vehicle's visit to the inspection center (or the Insurance Center to get the insurance certificate) is done after expiration of the deadline. In this case, issuance of the inspection certificate is also made after the deadline

Scenario B: In this case, checking the status of the vehicle's visit to the inspection center can be done every often like once a day, every hour or once in every moment. Accordingly, if the car visited the inspection center and passes all the relevant tests, the confirmation certificate will be issued (or other appropriate measures can be taken).

Take into account that confirmation certificate can be issued either by the inspection Center or by the Main Center (Police Force or Ministry of the Interior, DMV, etc) that have access to the central system data (unit 10).

Scenario C: This scenario is for the cars registered as "Nonoperational" for whatever reason. They are registered as Nonoperational in the central system memory. Nonoperational refers to those cars whose owners have parked them somewhere without moving them (for example, when the owner is on a trip and doesn't move the car). It can also refer to those cars for which technical troubleshooting takes time and whose owner has asked for a break to solve the car's problem . Another case for using the expression of nonoperational is for cars that are not allowed to have the inspection confirmation certificate.

Keep in mind that if the owners of nonoperational cars move them or use them in any way, this can be detected by the LPR cameras or be monitored by checking the cars' odometers so that it leads to the car deterrence.

Scenario D: This scenario is provided for the cars that have not been visited to the inspection Center in due time or their technical defects have not been solved before the deadline expires . In this scenario, after taking the punitive action, the owners will be provided with another break to troubleshoot the car defects. This can be repeated to a desired number of times till the owner look into the technical problems.

Scenario E: This scenario is to do a final decision on the delinquent car owners who have been fined a predetermined number of times (e.g. after 10 times) of not having inspection

confirmation certificate (for example, to detain the car ).

Please note that based on the relevant law other scenarios can be taken into consideration. For example, being noticed of the technical inspection deadline can be up to the owners themselves or they can be notified by an SMS or other methods.

As mentioned, scenario D is for those cars that have not been taken to the inspection/smog Center or their inspection result was not positive. Hence, based on the law they can be fined every often time (e.g. every two weeks a ticket will be sent to their owners).

As it was mentioned, with the same proposed system, those cars that do not have the insurance certificate can be detected and detained by the law. For this purpose, all the information of insurance/registration agencies is saved in a central system(unit 10) so that the information can be compared to the database of the whole cars in the country to detect the cars with no insurance certificate. At this stage, inspection equipment (that can send the owner's or the car's data to the transmission unit and can send the data from transmission unit to the central server) can be scaled down into a computer which is at a firm or insurance agency. This stage is illustrated in figure l.g.

All the above mentioned scenarios can be implemented for the insurance certificate/ registration, too. In case the issuance of the insurance/registration certificate is subject to an inspection and obtaining the inspection certificate, the same scenario can be implemented for all of them.

Moreover, the car owner can be notified of the inspection/insurance/registration deadline by frequent messages (for the technical inspection certificate or insurance certificate).

A final decision can be determined for the whole process. For example, if the number of the tickets and deterrence has passed a certain limit, a kind of penalty (like detaining the car or non issuance of the certificate) can be considered. (Scenario E)

It is obvious that the aforementioned process can be repeated annually (or biennially for the new cars, based on the law) so that the owners take the responsibility to take their cars for such inspections and certificates every year.

Another point is that based on the system preferences and legal requirements, two or more scenarios can be integrated. As shown in the Fig. IB. These two data centers are then connected through an appropriate communication interface via a communication link. The processing of the data can take place in either of the data centers. The results of the data processing then would be used to apply punitive action against violating vehicles (those who lacks one or more official docs (here smog test certificate), while the camera image shows that they are being used.

As shown in the Fig. 1C the insurance center sends its data to the data center (the data would contain the effective date of the policy, the expiration date, the date when the insurance coverage was obtained, the coverage, the plan, and the vehicle's info such as the plate number, the owner, his/her address etc.).

As shown in the Fig. ID . If a moving or utilized vehicle (recognized by the captured image of the camera) lacks one or two of these documents, then punitive action would be taken by authorities.

As shown in the Fig. IE when the data mentioned above, are sent to different data centers, and then these two data centers communicate with the third one where the data of the camera image are sent to. Other embodiments to the system in term of number of data centers and their communication lines can be proposed. As said before, other information, such as registration status of the vehicle, can also be sent from the related department to the data center to be used in the processing and finning in case of violation.

As shown in the Fig. IF data from the inspection system 3 (containing the smog test data and other inspection results such as break, light, etc.) are sent to the data center 10 by a

communication interface 4A over a communication link 5A. The data from the camera 7 is also sent to the data center 10 by appropriate communication interface 4D over a communication link 5B.

As shown in the Fig 1G as other embodiment of the system, when the system is being used for automatic recognition of the vehicles which lack smog test certificate while being utilized (vehicle utilization is recognized by the captured image of the vehicle).

Fig 1H is analogous to Fig. 1G, wherein the system is being used for automatic recognition of the insurance status of the vehicles. As shown, an agent in the insurance office enters the data of the insurance status of the vehicle to a computer. The data are then sent to the data center 10 via a communication link 5A through communication interface 4A.

Fig. IK shows a block diagram illustrating method steps for practicing an alternate embodiment of the invention.