Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
A SYSTEM FOR DISTINGUISHING THE STAFF BY MEANS OF A NON- VISIBLE BEAM RESPONDER
Document Type and Number:
WIPO Patent Application WO/2022/265612
Kind Code:
A1
Abstract:
The present invention relates to a system (1) for enabling devices, which count the visitors in stores, to distinguish the store staff (personnel) by using a responder operating via beams at non-visible wavelength.

Inventors:
BUYUKOZCU MUSTAFA DEMIRHAN (TR)
AKYUREK ALPER SINAN (TR)
YILDIZ DONE (TR)
Application Number:
PCT/TR2022/050605
Publication Date:
December 22, 2022
Filing Date:
June 16, 2022
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
V COUNT TEKNOLOJI ANONIM SIRKETI (TR)
International Classes:
G06K9/62; G06V40/10; G06V40/16; H04W4/30; G06K9/00; G06V10/00
Domestic Patent References:
WO2019191146A12019-10-03
WO2010115315A12010-10-14
Foreign References:
US20150235237A12015-08-20
US20190392605A12019-12-26
US4246568A1981-01-20
Attorney, Agent or Firm:
TRITECH PATENT TRADEMARK CONSULTANCY INC. (TR)
Download PDF:
Claims:
CLAIMS

1. A system (1) for enabling devices, which count the visitors in stores, to distinguish the store staff by using a responder operating via beams at non- visible wavelength; comprising

- at least one image sensor (2) which is configured to perceive the wavelength band of visible beam and at least one of infrared or ultraviolet wavelength bands; to display the visitors and staff who enter the store and to process them by means of image processing technologies;

- at least one memory member (3) which is configured to save the height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2), temporarily for a predetermined period of time;

- at least one processor (4) which is configured to establish data communication with the image sensor (2) and the memory member (3), and to manage the memory member (3); and characterized by

- at least one server (5) which is configured to establish communication with the processor (4); to save and run a decision making software; to store the height information, the vector facial information of each staff; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signal perceived from at least one image sensor (2); to ensure that the persons are distinguished as visitors and staff by feeding the data, that is sent by the processor (4), to the decision-making software; and to ensure that shifts and breaks of the staff are followed up in an independent and integrated way;

- at least one signal transmitter (6) which is configured to send a determinant signal using at least one of visible, infrared or ultraviolet wavelengths in order to identify the staff to the area that is covered by at least one image sensor (2);

- at least one signal responder (7) which is configured to be placed to the body areas of the staff that can be displayed by means of the image sensor (2); and to respond the said determinant signal with a personnel identification signal at at least one of infrared or ultraviolet wavelengths when it receives the determinant signal that is sent by the signal transmitter (6) from at least one of the visible, infrared or ultraviolet wavelengths.

2. A system (1) according to Claim 1; characterized by the image sensors (2) which are configured to construct the depth map of the displayed area, by taking image via stereo camera configuration. 3. A system (1) according to Claim 1 or 2; characterized by the image sensors (2) which are configured to discriminate the height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two- dimensional codes in the form of QR code; and the staff identification signals perceived, from the images taken.

4. A system (1) according to any of the preceding claims; characterized by the memory member (3) which is configured to delete the historical data by transmitting the saved data to the processor (4) regularly.

5. A system (1) according to any of the preceding claims; characterized by the processor (4) which is configured to save the data, that are parsed in the image sensor (2), to the memory member (3).

6. A system (1) according to any of the preceding claims; characterized by the processor (4) which is configured to receive the data in the memory member (3) regularly or optionally manually and then send them to the server (5).

7. A system (1) according to any of the preceding claims; characterized by the server (5) which is configured to calculate a confidence degree for each data by comparing the height information, the vector facial information of each person being displayed; visual beacons such as one dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2) with the registered height information, the vector facial information of each person being displayed; visual beacons such as one dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2) of the staff. 8. A system (1) according to Claim 7; characterized by the server (5) which is configured to calculate the total confidence degree determining the possibility of each person being identified as a staff, by using the confidence degree of the staff identification signals primarily.

9. A system (1) according to Claim 7 to 8; characterized by the server (5) which is configured to mark the persons having the highest confidence degree as a staff and to track them except for the number of customers.

10. A system (1) according to any of the preceding claims; characterized by the server (5) which is configured to follow up the daily total shift, the single break and the daily total break times, the break frequencies of each staff marked, the numbers and the frequencies of the staff who take a break at the same time, on a staff basis and/or collectively for the entire staff team.

11. A system (1) according to any of the preceding claims; characterized by the signal transmitter (6) which is configured to emit a determinant signal having a predetermined waveform in at least one of visible, infrared or ultraviolet wavelengths.

12. A system (1) according to any of the preceding claims; characterized by the signal transmitter (6) which is configured to emit a determinant signal in a light intensity, frequency, waveform and wavelength that will make it impossible to track customers and staff by means of sense organs and that are regulated in accordance with health and safety requirements.

13. A system (1) according to any of the preceding claims; characterized by the signal responder (7) which is configured to discriminate the determinant signal from the lights received from other light sources in the environment, by detecting the waveform of the determinant signal.

14. A system (1) according to any of the preceding claims; characterized by the signal responder (7) which is configured to emit a personnel identification signal in a light intensity, frequency, waveform and wavelength that will make it impossible to track customers and staff by means of sense organs and that are regulated in accordance with health and safety requirements, when it detects a determinant signal waveform.

Description:
A SYSTEM FOR DISTINGUISHING THE STAFF BY MEANS OF A NON-

VISIBLE BEAM RESPONDER

Technical Field

The present invention relates to a system for enabling devices, which count the visitors in stores, to distinguish the store staff (personnel) by using a responder operating via beams at non-visible wavelength.

Background of the Invention

Today, physical stores utilize customer detection systems which enable to count the customers who enter the store, in order to carry out measurements of business efficiency and interaction and to obtain statistical results. Essentially, the said systems which are placed inside stores to display a specific area aim to distinguish the people from other objects by scanning all objects in this area and to count them. Therefore, many customer detection systems count the customers who pass by an displayed area, without distinguishing them from the store staff.

For the purpose of tracking the store staff by distinguishing them from customers; methods which enable to visually distinguish the store staff from customers are applied. The said methods can be summarized as making the identity cards of store staff distinctive by means of one-dimensional codes in the form of barcode and/or two-dimensional codes in the form of QR code; distinguishing the clothes off store staff by means of image processing techniques by adding pre-determined colours, patterns, logos and shapes to them; adding RFID elements to identity cards, accessories and/or clothes of store staff and then tracking their movements inside the store. Accuracy of detection may vary based on the light conditions of the codes and/or the images added to the identity cards of the store staff and/or the staff; risk of copy exists in bad faith or due to the interest of customer group; and the fact that amendments being incompatible with the uniform, that is identified with the store, are required constitutes an obstacle in terms of protection of the brand value. Tracking RFID movements inside a store prevents ensuring the discrimination of staff at high resolution based on the store size, the staff mobility and the fact that the passive elements enabling to perform radio frequency communication have a limited range.

Considering the deficiencies of the visitor counting systems included in the current technique; it is understood that there is need for a system for enabling devices, which count the visitors in stores, to distinguish the store staff by using a responder operating via beams at non-visible wavelength in the state of the art.

The United States patent document no. US20200226363, an application in the state of the art, discloses a system for detecting and identifying objects and humans. Objects and humans in compiled images are detected by means of image sensors, humans are distinguished from other objects and counted by using wireless tags in the system included in the said invention. In the said invention, the area where it is requested to detect humans is illuminated by means of a non- visible beam emitting source such as infrared, terahertz, or millimeter wave wavelength while it is displayed by means of an image sensor such as camera or stereo camera. At least one retroreflector, which is integrated into the uniform of each staff in order that the said beams being emitted from a beam source can distinguish the staff from other persons in the displayed area and which selectively reflects the non-visible beam being emitted, is used in the said invention. The retroreflector reflects the non-visible beam being emitted, without changing it.

Summary of the Invention An objective of the present invention is to realize a system for enabling devices, which count the visitors in stores, to distinguish the store staff by using a responder operating via beams at non-visible wavelength.

Detailed Description of the Invention

“A system for distinguishing the staff by means of a non-visible beam responder” realized to fulfil the objective of the present invention is shown in the figure attached, in which:

Figure l is a schematic block diagram of the inventive device.

The components illustrated in the figure are individually numbered, where the numbers refer to the following:

1. System

2. Image sensor

3. Memory member

4. Processor

5. Server

6. Signal transmitter

7. Signal responder

The inventive system (1) for enabling devices, which count the visitors in stores, to distinguish the store staff by using a responder operating via beams at non- visible wavelength comprises:

- at least one image sensor (2) which is configured to perceive the wavelength band of visible beam and at least one of infrared or ultraviolet wavelength bands; to display the visitors and staff who enter the store and to process them by means of image processing technologies; at least one memory member (3) which is configured to save the height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two- dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2), temporarily for a predetermined period of time; at least one processor (4) which is configured to establish data communication with the image sensor (2) and the memory member (3), and to manage the memory member (3); at least one server (5) which is configured to establish communication with the processor (4); to save and run a decision-making software; to store the height information, the vector facial information of each staff; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two- dimensional codes in the form of QR code; and the staff identification signal perceived from at least one image sensor (2); to ensure that the persons are distinguished as visitors and staff by feeding the data, that is sent by the processor (4), to the decision-making software; and to ensure that shifts and breaks of the staff are followed up in an independent and integrated way; at least one signal transmitter (6) which is configured to send a determinant signal using at least one of visible, infrared or ultraviolet wavelengths in order to identify the staff to the area that is covered by at least one image sensor (2); at least one signal responder (7) which is configured to be placed to the body areas of the staff that can be displayed by means of the image sensor (2); and to respond the said determinant signal with a personnel identification signal at at least one of infrared or ultraviolet wavelengths when it receives the determinant signal that is sent by the signal transmitter (6) from at least one of the visible, infrared or ultraviolet wavelengths.

The image sensors (2) included in the inventive system (1) are configured to perceive the wavelength band of visible beam and at least one of infrared or ultraviolet wavelength bands; to display the visitors and staff who enter the store and to process them by means of image processing technologies. In a preferred embodiment of the invention, the image sensors (2) are configured to construct the depth map of the displayed area, by taking image via stereo camera configuration. In a preferred embodiment of the invention, the image sensors (2) are configured to discriminate the height information, the vector facial information of each person being displayed; visual beacons such as one dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived, from the images taken. The memory member (3) included in the inventive system (1) is configured to save the height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store- specific clothing colours, specific images, patterns, barcode and/or two- dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2), temporarily for a predetermined period of time. In a preferred embodiment of the invention, the memory member (3) is configured to delete the historical data by transmitting the saved data to the processor (4) regularly. The processor (4) included in the inventive system (1) is configured to establish data communication with the image sensor (2) and the memory member (3), and to manage the memory member (3). In a preferred embodiment of the invention, the processor (4) is configured to save the data, that are parsed in the image sensor (2), to the memory member (3). In a preferred embodiment of the invention, the processor (4) is configured to receive the data in the memory member (3) regularly or optionally manually and then send them to the server (5).

The server (5) included in the inventive system (1) is configured to establish communication with the processor (4); to save and run a decision-making software; to store the height information, the vector facial information of each staff; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signal perceived from at least one image sensor (2); to ensure that the persons are distinguished as visitors and staff by feeding the data, that is sent by the processor (4), to the decision-making software; and to ensure that shifts and breaks of the staff are followed up in an independent and integrated way. In a preferred embodiment of the invention, the server (5) is configured to calculate a confidence degree for each data by comparing the height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two- dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2) with the registered height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2) of the staff; to calculate the total confidence degree determining the possibility of each person being identified as a staff, by using the confidence degree of the staff identification signals primarily; to mark the persons having the highest confidence degree as a staff and to track them except for the number of customers. In a preferred embodiment of the invention, the server (5) is configured to follow up the daily total shift, the single break and the daily total break times, the break frequencies of each staff marked, the numbers and the frequencies of the staff who take a break at the same time, on a staff basis and/or collectively for the entire staff team.

The signal transmitter (6) included in the inventive system (1) is configured to send a determinant signal using at least one of visible, infrared or ultraviolet wavelengths in order to identify the staff to the area that is covered by at least one image sensor (2). In a preferred embodiment of the invention, the signal transmitter (6) is configured to emit a determinant signal having a predetermined waveform in at least one of visible, infrared or ultraviolet wavelengths. In a preferred embodiment of the invention, the signal transmitter (6) is configured to emit a determinant signal in a light intensity, frequency, waveform and wavelength that will make it impossible to track customers and staff by means of sense organs and that are regulated in accordance with health and safety requirements.

The signal responder (7) included in the inventive system (1) is configured to be placed to the body areas of the staff that can be displayed by means of the image sensor (2); and to respond the said determinant signal with a personnel identification signal at at least one of infrared or ultraviolet wavelengths when it receives the determinant signal that is sent by the signal transmitter (6) from at least one of the visible, infrared or ultraviolet wavelengths. In a preferred embodiment of the invention, the signal responder (7) is configured to discriminate the determinant signal from the lights received from other light sources in the environment, by detecting the waveform of the determinant signal. In a preferred embodiment of the invention, the signal responder (7) is configured to emit a personnel identification signal in a light intensity, frequency, waveform and wavelength that will make it impossible to track customers and staff by means of sense organs and that are regulated in accordance with health and safety requirements, when it detects a determinant signal waveform.

Industrial Application of the Invention

In the inventive system (1), at least one image sensor (2) and a signal transmitter (6) emitting a determinant signal to the area covered by the said image sensor (2) are placed inside a store; the signal responder (7) -which is placed into the body areas of the staff that can be viewed by the image sensor (2) - emits a personnel identification signal in a light intensity, frequency, waveform and wavelength that will make it impossible to track customers and staff by means of sense organs and that are regulated in accordance with health and safety requirements, when it detects a determinant signal waveform. The image sensor (2) saves and parses height information, the vector facial information of each person being displayed in the area it covers; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two- dimensional codes in the form of QR code and then transmits them to the processor (4) so as to be saved to the memory member (3). The processor (4) receives the data saved in the memory member (3) and the data in the memory member (3) regularly or optionally manually and then sends them to the server (5). The server (5) calculates a confidence degree for each data by comparing the height information, the vector facial information of each person being displayed; visual beacons such as one-dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2) with the registered height information, the vector facial information of each person being displayed; visual beacons such as one dimensional codes in the form of store-specific clothing colours, specific images, patterns, barcode and/or two-dimensional codes in the form of QR code; and the staff identification signals perceived from at least one image sensor (2) of the staff; calculates the total confidence degree determining the possibility of each person being identified as a staff, by using the confidence degree of the staff identification signals primarily; and marks the persons having the highest confidence degree as a staff and to track them except for the number of customers. The server (5) can follow up the daily total shift, the single break and the daily total break times, the break frequencies of each staff marked, the numbers and the frequencies of the staff who take a break at the same time, on a staff basis and/or collectively for the entire staff team.

The inventive system (1) enables to utilize non-visible light wavelengths which are visually tracked for discriminating the staff inside a store, generated actively and not limited by range; and to perform staff tracking with high precision.

Within these basic concepts; it is possible to develop various embodiments of the inventive “system for distinguishing the staff by means of a non-visible beam responder (1)”; the invention cannot be limited to examples disclosed herein and it is essentially according to claims.