Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
CAMERAL REMOTE INVENTORY AND ADVERTISEMENT SYSTEM FOR REFRIGERATED SHOWCASE UNITS
Document Type and Number:
WIPO Patent Application WO/2017/127035
Kind Code:
A1
Abstract:
This invention relates to a camera-equipped remote monitoring and advertising system for the display units that may be used in places such as shopping malls, subways stations, markets, supermarkets, etc. comprising an interior camera with wide angle lens positioned at the inner part of the door (11), a distance measurement sensor that measures the distance by which the door (11) is opened and transmits a signal to the interior camera, a sensor module that houses thereon the distance measurement sensor and the interior camera, a primary module that is associated via the connection cable with the sensor module and that supervises the data and a battery and GPS unit for supplying the power required to transmit the information about theft and location in case the refrigerator is unplugged and in case of power outage.

Inventors:
MORLEVI SELIM (TR)
Application Number:
PCT/TR2017/050027
Publication Date:
July 27, 2017
Filing Date:
January 18, 2017
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
C4 İNTERAKTİF BİLİŞİM VE REKLAM TEKNOLOJİLERİ (TR)
International Classes:
G09F27/00; A47F3/04; F25D29/00; G06Q10/08; G06Q30/02; G07F9/02; G09F23/06
Domestic Patent References:
WO2005015510A12005-02-17
WO2012101606A12012-08-02
WO2008007314A22008-01-17
Foreign References:
US20140144083A12014-05-29
JP2001307195A2001-11-02
US20120105424A12012-05-03
TR201208564U2012-10-22
TR200800697U2008-03-21
US20090314021A12009-12-24
EP2043485A22009-04-08
Download PDF:
Claims:
CLAIMS

1. The invention relates to a camera-equipped remote monitoring and advertising system for the display units characterized in that it comprises

- the interior camera (3) with wide angle lens positioned at the inner part of the door (11),

- the distance measurement or contact sensor (2) that measures the distance by which the door (11) is opened and transmits a signal to the interior camera (3),

- the shock sensor (4) that enables an audible warning to be issued in case the refrigerator (9) is shaken or shocked,

- the light sensor (5) that enables the interior of the refrigerator (9) to be illuminated to enable the products to be seen and to enable the photos of the same to be taken in a clear manner, - the primary module (1) that supervises the data and that is associated, via the connection cable (13), with the sensor module (12), said sensor module (12) housing the temperature, moisture, vibration and light sensors and having a modular structure able to be easily fitted inside the refrigerator,

- the vibrating speaker (16) that broadcasts the audio data transmitted from the primary module (1) and the screen (17) that broadcasts the image data and is able to display the video,

- the communication module (8) that enables the data transfer via GSM, Wi-Fi or LoRa long range radio frequency,

- the exterior camera (14) that enables the number of individuals passing in front of the refrigerator to be counted and that collects the data about the gender and the age, - a battery (20) and GPS unit (19) for supplying the power required to transmit the information about theft and location in case the refrigerator (9) is unplugged and in case of power outage,

- the led light (21) positioned at the inner part of the screen integrated into the door and the interior camera (23) positioned at the inner part of the screen integrated into the door in case requested by the customer. 2. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it comprises the interior camera (3) for taking, upon the receipt of a signal, the photo of the products inside the refrigerator (9) and transmitting the same to the center, for enabling the fill factor of the refrigerator (9), whether or not any product of a foreign brand is present inside the refrigerator and whether or not the array of products is correct to be monitored and reported based on the photo images taken, and for enabling the generation of the alarms.

3. Interior camera (3) according to Claim 2 characterized in that it comprises the communication module and processor (8) for transmitting the obtained photo to the product control center via GSM, Wi-Fi or LoRa.

4. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it comprises the exterior camera (14), which is positioned in the upper portion of the refrigerator (9) and which enables the number of individuals looking at the refrigerator to be counted and which enables the analyses of age and gender to be performed and reported for the individuals looking at the refrigerator.

5. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it comprises the communication module (8), which enables the communication via GSM, LoRa long range radio frequency and Wi-Fi wireless network.

6. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it comprises the screen (17), which is to be positioned on the eye level in the upper portion of the door (11) and/or on the canopy, said screen becoming activated when an individual passes in front of the same, having the touch feature and enabling the interactive contents to be shared.

7. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it features the ability to position an alternative interior camera at the inner part of the screen integrated into the door, in case the customer requests the camera to be arranged in a more hidden manner.

8. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it comprises the vibrating speaker (16), which is positioned into the canopy (10), which generates sound by vibrating the entire surface of the refrigerator or arrangement and display unit and which enables the advertising to be performed for the individuals passing in front of the refrigerator and opening the door of the refrigerator.

9. Camera-equipped remote monitoring and advertising system for the display units according to

Claim 1 characterized in that it comprises the motion sensor (18), which is positioned in the lower portion of the door (11), said motion sensor detecting the opening of the door and enabling the number of times the door is opened and the duration for which the door remains open to be measured and reported.

10. Camera-equipped remote monitoring and advertising system for the display units according to Claim 1 characterized in that it comprises the formation of a free of charge Wi-Fi wireless network point of connection via the primary module (1).

11. Presentation of an opening page to the users with the free of charge Wi-Fi wireless network connection via the primary module (1) according to Claim 9 wherein said opened page contains the collection of the consumer information and the display of the advertisement contents to the consumers.

Description:
DESCRIPTION

CAMERAL REMOTE INVENTORY AND ADVERTISEMENT SYSTEM FOR REFRIGERATED SHOWCASE UNITS

Technical Field: This invention relates to a camera-equipped remote monitoring and advertising system for the display units that may be used in places such as shopping malls, subways stations, markets, supermarkets, etc.

State of the Art:

At the present time, the commercial refrigerators or shelf systems are used for the display and sale of the products in places such as shopping malls, subways stations, markets, supermarkets, etc.

The companies seek to enhance their arrangement and display units in a way to increase their sales. The systems incorporating audio and visual components added to such units assist in increasing the sales. The ability of such arrangement and display units to perform their functions in a whole and complete manner affects the product quality and the presentation quality as well as having a positive effect on the sales. For example, a commercial refrigerator not operating with a correct temperature setting would affect the satisfaction with the product and would also cause the products to turn bad, thereby resulting in material and intangible damages. The practice of turning off the lights of the arrangement and display units for the reasons related to economy reduces the visibility of the products and thus negatively affects the sales. Besides these, the positioning of the expensive arrangement and display units such as commercial refrigerators at the inefficient points of sale results in the losses for the companies. For example, the ability to monitor and detect from a center those refrigerators in front of which very few people pass or the doors of which are only rarely opened would enable such units to be relocated to more efficient points.

For the reasons mentioned above, the products in the commercial refrigerators or the arrangement and display units are checked at certain intervals and the products that have become less in quantity are replenished. This is a costly procedure. On the other hand, when the frequencies of replenishment and check are reduced, the losses of sale are encountered due to lack of stock at the point of sale and the irregularity of arrangement and display. After all, the practice that such procedures are monitored by manpower results in a serious cost and inefficiency for the companies.

In the existing systems, there are present the systems for monitoring the temperature, relocation and frequency of door opening for the refrigerators. However, these systems comprise simpler features in terms of hardware. The primary purpose of such systems is to preserve the service quality and prevent the theft of the company fixtures. They do not serve the purpose of increasing the sales, determining the potential of the sales point and showing the quality of arrangement and display.

The utility model application no. TR201208564 describes "a commercial refrigerator with LED illumination and glass door". The invention in this document relates to a commercial refrigerator with glass door, which is used in order to ensure that the packed and bottled beverages are consumed at the ideal temperature and which comprises at least one double-glazing, a body, the wire shelves for carrying the products and the gaskets for providing the seal between the door and the body, said commercial refrigerator being characterized in that it comprises the LED modules positioned into the double-glazing for illuminating the interior of said refrigerator. The utility model application no. TR200800697 discloses "a refrigerator". The invention mentions a display refrigerator, which is used generally in places such as markets, fueling stations, kiosks, etc. to prevent the dairy products such as yogurt, buttermilk drink, milk, etc. from turning bad and to enable the drinks such as water, beverage, fruit juice, etc. to be displayed and presented for sale in a cold environment, wherein said refrigerator comprises an automatic sliding door with glass that automatically closes or that stands in a vertical position open in the front side, a body, a cooler and a fan.

The patent application with the publication no. US20090314021 describes "a supermarket refrigerator". This system does not have any function intended for advertising or promotion. The patent application with the publication no. WO2008007314 describes "a supermarket refrigerator". This system does not comprise a remote monitoring system.

The patent application with the publication no. EP2043485 describes "a supermarket refrigerator". This system also lacks a remote monitoring system and it therefore lacks an equipment providing information about the condition that the products have run out or about the number of products available.

The above-mentioned utility model/patent applications disclose the systems with commercial refrigerators able to be used in places like supermarkets, etc. Said systems are either intended only for advertising or promotion or they are provided only with a limited function of remote measurement and monitoring. Said systems also have high manufacturing costs and their assembly is a time-consuming task. In said systems, the refrigerators do not transmit the images of their interiors to a center. Moreover, they lack a system capable of providing information about the remaining quantity of each product or about those products that have run out.

At the present time, the transparent screens are employed for advertising purposes in the commercial refrigerators. The aim here is to be able to present the video content and provide interactive applications without hindering the display of the products. However, such technology has very high cost. Consequently, there is a need for more cost-effective products, which do not hinder the display of the products, but are at the same time able to perform advertising.

In the existing systems, there are present the studies about the remote measurement of the refrigerator temperatures, notification of the theft of the refrigerators and the transmission of the location information for the refrigerators. However, these are not the practices directly aimed at increasing the sales. These applications do not collect sufficient data concerning the sales point. Furthermore, they do not transmit the images of the interiors of the arrangement and display unit (e.g. commercial refrigerator), although it is one of the most important subjects. The most significant item of operating costs for the remote management systems is the charges for the cellular network connection (GSM). The companies do not want to bear these fixed expenses for the remote measurement activities that are not income-generating. For this reason, there is a need for integrated systems that are capable of both increasing the sales and carrying out the performance measurement. In this way, the companies would become more willing to invest in this area as they would regard the same to be a sales and marketing activity. The issue of cost, which is the most significant obstacle before the application of these products to the industry, would thus be precluded. As a result, a novel technology is needed, which would directly influence the sales owing to the stock availability and the proper maintenance of the arrangement and display unit or the refrigerator, would enable increase in the sales owing to the interior lights of the devices being kept on and would feature the promotion systems at the point of sale to visually and aurally attract the attention of the consumers. Description of the Invention:

This invention is a camera-equipped remote monitoring and advertising system for display units, capable of overcoming the above-mentioned drawbacks, said system being characterized in that it is a system capable of obtaining with its interior camera the image of the shelves and transmitting the same to a center, issuing an alarm in case of the presence of foreign products, issuing audible warnings and notifying the center in case of shocks, detecting the state where the interior light of the refrigerator is not on, counting the number of individuals passing in front of the refrigerator, calculating with its exterior camera the number of individuals passing in front of the refrigerator and approximate gender and age information for the passing individuals, measuring the number of times the door of the refrigerator is opened and the duration for which it remains open, detecting the location of the refrigerator, detecting the information about the remaining quantities of the products inside the refrigerator and transmitting all such information to a central server computer via cable and wireless communication technologies such as mobile communication networks (GSM) or LoRa (Long Range) long range radio wave transmitters or Wi-Fi (Wireless Network) and the like. This system is an invention, which, in addition to the monitoring and reporting capabilities, is able to perform the instant advertising for the consumers owing to the small screen in front of the same or owing to only the audio system of the same.

With the product according to the invention, it is made possible to easily provide the information about the number of products remaining inside the refrigerator and the identities of the products that have run out. This process is triggered with the aid of a distance measurement sensor that activates the camera available in the system or with the aid of a sensor that detects the opening of the door wherein the photo that is taken is transmitted to the product control center via the cellular data networks (GSM) or LoRa radio waves or Wi-Fi. The obtained images are examined via the image processing method either in the computer on the refrigerator or in the server at the control center, depending on the preference. The information like the fill factor of the refrigerator, whether the foreign brands are present inside the refrigerator and the number of products available on the front face is automatically identified and reported. In this way, it is made possible to replenish in a short time the products that have run out. The product according to the invention enables an audible introduction is to be performed for the products inside the refrigerator, owing to the audio output on the system. In this way, the system contributes in increasing the sales by way of enabling the eye -pleasing products to become also aurally appealing. With the help of the shock sensor present on the product according to the invention, it is possible to instantly notify the center in such cases like the movement, relocation or the theft of the refrigerator. It is also possible for the product to issue an alarm or warning with the speaker system on the same.

Owing to the light sensor present on the product according to the invention, it is possible to report to the center whether or not the light of the refrigerator is on. A positive relationship has been found between the on state of the refrigerator light and the increase in the sales. In this way, it is possible to report to the center those refrigerators the lights of which are not on. At the same time, according to the invention, that the interior light of the refrigerator is in the on state provides the ability to take clearer photo images of the products. Owing to the front camera present on the product according to the invention, it is possible to count the number of individuals passing in front of the refrigerator. In addition, it is possible to collect information about the age and gender of these individuals, by means of image processing. Owing to the contact sensor according to the invention, it is possible to calculate and report to the center the number of times the door is opened and the durations for which the door remains open.

Owing to the ordinary speaker present on the product according to the invention or owing to "the vibrating speaker" that generates sound by vibrating the entire surface of the refrigerator or the arrangement and display unit, it becomes possible to issue an advertisement for the individuals that are passing in front of the product according to the invention and the individuals that open the door of said product. The contents of the advertisement may be remotely changed by the processor that is also disposed on the refrigerator. This method is a far less costly and far more effective solution as compared to the other advertising practices (transparent screen, LCD screen, bill). Moreover, the ability to remotely alter the contents minimizes the operating costs.

The screen, which is easily mounted in the front side of the product according to the invention or in the compartment referred to as canopy on the door of the refrigerator, is able to display the advertising videos for the individuals passing in front of the product. The advertising videos may become activated in a manner sensitive to the motion. Besides the advertising videos, it is also possible to perform the interactive applications owing to the touch sensor to be added. This system has a much more convenient price as compared to the transparent screen technology disposed in the refrigerators. As the screens are of small size or as they are positioned on the canopy, they do not block the visibility of the products. In this manner, the consumer is not prevented from seeing the products.

Owing to the invention, it becomes possible to instantaneously monitor the performance of the point of sale and the arrangement and display unit on the one hand and conduct the marketing and promotion activities intended for increasing the sales on the other hand. Thus, the data costs associated with GSM, i.e. cellular network connection, may be converted to use in a more efficient manner. In this way, it is possible to overcome this fixed cost obstacle before the companies. Two other solutions are also offered to overcome this obstacle. LoRa (Long Range) radio wave technology is a communication solution commercialized in 2014. The advantage of this communication technology lies in its ability to perform free of charge broadcasting over the 433-866 MHZ band. Owing to its range reaching as long as 5 KM, it enables the information pertaining to thousands of refrigerators over very wide areas to be transmitted without having to tackle with the cost of GSM. Instead of installing a GSM line on each refrigerator, owing to this technology, it becomes possible for thousands of devices to connect to Internet via fixed or mobile GSM, using several base stations, to transfer the data to the central server. It is possible for the companies to position said LoRa receivers on mobile vehicles in order to reduce the number of base stations. The vehicle may collect the information from the current zone it is traversing, at any desired frequency. It is also possible to employ the unmanned aerial vehicles with 4 or more propellers, referred to as "drone", in order to collect the data. Another method for avoiding the costs of GSM is to share the information by way of connection with the wireless network at the point where the refrigerator is located, using the new generation Wi-Fi (Wireless Fidelity) modules called ESP or various communication modules capable of connecting to the Wi-Fi networks. The ESP modules are particularly designed to have ultra low cost and they are likely to provide the companies with substantial advantage in terms of cost.

Owing to the fact that the components parts of the invention are easy to be fixed together, the installation becomes easy and the time required for the assembly becomes shorter, which in turn result in reduced costs. Another feature of the invention is that the companies are enabled to easily perform the assembly also for their existing refrigerators, owing to the convenience in installation. In addition, the invention has a robust structure.

The structural and characteristic features and all the advantages of the invention will become more clearly understood from the figures, the descriptions for which are provided below, and from the detailed description written with reference to said figures. Description of the Figures:

The invention will now be described with reference to the enclosed figures. In this manner, the features of the invention will become more clearly understood and appreciated. However, it is not intended herein to limit the invention to said specific embodiments. On the contrary, the invention is intended to encompass all the alternatives, variations and equivalents that may be included in the scope of the invention as defined in the appended claims. It should be understood that the illustrated details are presented only for the purpose of describing the preferred embodiments of the present invention and that they are provided with a view to provide the most convenient and most readily understandable definition both for the formation of the methods and for the principles and conceptual features of the invention. In said drawings:

Figure 1 is a side perspective view of the refrigerator.

Figure 2 A is another view of the refrigerator. Figure 3 is a front perspective view of the refrigerator.

Figure 4 B is another view of the refrigerator.

Figure 5 is a perspective view of the system.

Figure 6 is a perspective view of the module.

Figure 7 is a perspective view of the camera. Figure 8 is a view of the screen, which is integrated into the door, on the refrigerator.

Figure 9 is a perspective view of the interior part of the screen, which is integrated into the door.

Figure 10 is a front perspective view of the screen, which is integrated into the door. Figure 11 is the flow diagram of the system. The parts on the figures that are presented to aid in an understanding of this invention are assigned with reference numerals as indicated on said figures, wherein said reference numerals have the designations given below:

Description of the Reference Numerals:

1. Primary module

2. Distance measurement sensor

3. Interior camera

4. Shock sensor

5. Light sensor

6. Audio output

7. Memory card

8. Communication module

9. Refrigerator

10. Canopy

11. Door

12. Sensor module

13. Connection cable

14. Exterior camera

15. Temperature sensor

16. Vibrating speaker

17. Screen 18. Motion sensor

19. GPS controller

20. Battery

21. Led light 22. Connection point

23. Interior camera (positioned as an alternative at the interior part of the screen, which is integrated into the door, in case the camera is requested by the customer to be disposed in a more hidden arrangement)

Description of the Invention: The invention comprises the interior camera (3) positioned at the inner part of the door (11), the distance measurement sensor or contact sensor (2) for measuring the distance by which the door (11) is opened and for sending a signal to the interior camera (3), the sensor module (12) that carries the distance measurement sensor or contact sensor (2) and the interior camera (3), and the primary module (1) that is associated with the sensor module (12) via the connection cable (13) and that supervises the data (Figure-1, Figure-2, Figure-5, Figure-6).

The invention comprises a sensor module (12), which houses thereon the shock sensor (4), light sensor (5), temperature and moisture sensor (15) and the motion sensor (18). The invention comprises an interior camera (3), which takes the photos of the products inside the refrigerator (9) upon receiving a signal transmitted from the distance measurement sensor (2). There is present a communication module (8), which enables the photo taken by the interior camera (3) to be transmitted to the product control center via the cellular network data package (GSM) or LoRa Radio Frequency or Wi-Fi. The product according to the invention comprises a primary module (1) inside the canopy (10) and a sensor module (12) inside the refrigerator (9) (Figure-3, Figure-5). There is present an audio output (6), which enables the advertisement or promotion to be performed in an audible manner by way of fitting a speaker to the product according to the invention. The product according to the invention comprises a memory card (7) for recording the audio data transmitted from the control center to the communication module (8) (Figure-6). The invention comprises a shock sensor (4), which enables an audible warning to be issued in case the refrigerator (9) is shaken or shocked (Figure-6). The invention comprises a light sensor (5) intended for illuminating the interior of the refrigerator (9) in order to enable the products to be seen and enable the photo images of said products to be taken in a clear manner (Figure-6). The product according to the invention comprises the GPS unit in the rear part thereof. An antenna is present on the GPS unit. The invention comprises a vibrating speaker (16) positioned into the canopy (10) (Figure-3). The invention comprises a screen (17), which is positioned in the upper portion of the door (11) in a way to be disposed on the eye level (Figure-3). In case the customer requests the camera to be arranged in a more hidden manner, there are provided an interior camera (23) and led light (21), which are to be positioned as an alternative arrangement at the interior part of the screen integrated into the door. The product according to the invention comprises a motion sensor (18) positioned in the lower portion of the door (11) (Figure-3). The invention comprises an exterior camera (14) positioned in the upper portion of the refrigerator (9) (Figure-3).

Detailed Description of the Invention: The main component parts of the invention are the primary module (1) comprised by a microcontroller and/or microprocessor, the distance measurement sensor (2), the interior camera (3), the shock sensor (4), the light sensor (5), the audio output (6), the memory card (7), the communication module (8) providing the GSM, LoRa or Wi-Fi communication, the refrigerator (9), the canopy (10), the door (11), the sensor module (12), the connection cable (13), the exterior camera (14), the temperature and moisture sensor (15), the vibrating speaker (16), the screen (17) and the motion sensor (18) (Figure- 1, Figure-2, Figure-5, Figure-6).

The canopy (10) is positioned in the upper portion of the refrigerator (9) (Figure-3). The primary module (1) and the communication module (8) are disposed inside the canopy (10) (Figure-3, Figure-5). The component providing the connection that is necessary for the primary module (1) and the communication module (8) to perform data transfer between each other is a connection cable (13) (Figure-5). The module (1) also records the number of times the door (11) of the refrigerator (9) is opened or the durations for which the door (11) remains open. The sensor module (12) houses thereon the shock sensor (4), the light sensor (5) and the temperature and moisture sensor (15) (Figure-6). The distance measurement sensor (2) and the interior camera (3) are positioned on the refrigerator (9) (Figure-5). The distance measurement sensor or the contact sensor (2) on the product according to the invention is fixed at any location on the body of the refrigerator (9) or in a manner suitable for viewing the opening distance of the door (11) (Figure-1, Figure-2, Figure-4). The interior camera (3) on the product according to the invention is fixed on the door (11) at such an angle enabling it to take the photo images of the entirety of the products inside the refrigerator (9) (Figure-1, Figure-2).

The operation of the invention is as follows: Upon the door (11) being opened, the distance measurement sensor or the contact sensor (2) on the body of the refrigerator (9) transmits a signal to the interior camera (3) via the controller (19) when the required opening distance condition is satisfied (Figure-1, Figure-5). Upon the receipt of the transmitted signal, the interior camera (3) takes a photo of the products inside the refrigerator (9) (Figure-2). The photo that has been taken is sent via the connection cable (13) to the primary module (1) (Figure-5). The primary module (1) in turn sends, via the communication module (8) on the same, the respective information to a center that checks the remaining quantities of the products or whether the products have run out, in the form of GSM or Wi-Fi or Radio Wave data (Figure-6). This center is referred to as the product control center. There is provided a light sensor (5), which enables to understand whether or not the illumination, necessary to allow the products inside the refrigerator (9) to be seen also in case the door (11) of the refrigerator (9) is closed, is in the on state (Figure-3, Figure-6).

By means of the audio output (6) available in the product according to the invention, it is possible to perform the advertisements or promotions in an audible manner (Figure-6). The sounds available in recorded form in the memory card (7) on the primary module (1) enable the promotion of any desired product to be performed in an audible manner with the help of a speaker associated with the audio output (6) (Figure-6). In addition, the voice messages transmitted from the control center to the primary module (1) via the communication module (8) are recorded in the memory card (7) (Figure-6). There is present a shock sensor (4) for notifying the center of the theft or relocation of the refrigerator (Figure-6). The shock sensor (4), which is activated in case the refrigerator (9) is subjected to any shock or shake, issues an audible warning (Figure-6).