INVENTORY

PRIORITY

[0001] This application claims the benefit of and priority to U.S. Patent Application No. 16/598,130, filed October 10, 2019, which claims priority to U.S. Provisional Patent Application No. 62/743,715, filed October 10, 2018, both titled“Systems, Method and Apparatus for Optical Means for Tracking Inventory,” which is hereby incorporated by reference into this application in its entirety.

BACKGROUND

[0002] Retail environments are ever challenging. Consumers typically are confronted with pricing and information about a continuously increasing number of competitors and brands, including information about pricing, labeling, promotions, and the like. Traditionally, this information has been provided using print systems, such as slide-in paper systems, plastic label systems, and adhesive label systems. However, consumers are increasingly confounded by the sheer volume of printed information displayed in retail environments, and thus a growing number of consumers are turning to online shopping for day-to-day purchases. Furthermore, a retailer’s overall performance and profits are significantly impacted by the challenge of getting the right products to the right places at the right time.

[0003] In addition, retailers are constantly concerned with the stocking of their shelves. A retailer may lose money due to a failure to restock inventory. For example, a customer may approach a shelf seeking to purchase a particular item; however, the shelf indicated as the location of the particular item may be empty. In some situations, a retailer may have that particular item stored in the back of the store but due to a lack of knowledge that the shelf was empty, the shelf may not be restocked with the item causing the retailer to lose the money the customer would have spent on purchasing the particular item. Such a situation occurs at a high rate and may cost a retailer thousands or even millions of dollars in lost revenue each year.

[0004] Furthermore, manufacturers or other producers routinely deliver goods to each retailer or retail location at which its goods are sold. For example, an employee or contractor (“employee”) of, for example, a soda company, must deliver the soda product to each retailer or retail location at a routine frequency (e.g., daily, weekly, etc.) in order to ensure the retailer or retail location has an adequate store of the soda products. This delivery process is inefficient and requires the employee to transport the products to each retailer or retail location, walk in the retailer or retail location, manually count stocked inventory, retrieve the necessary amount of product (e.g., from a truck outside), bring the product into the retailer or retail location, and restock the inventory. Thus, a great deal of resources (e.g., time, energy and money) are wasted during the current restocking process.

SUMMARY

[0005] In one embodiment, an inventory camera system, comprises an inventory camera having a lens and a housing, and a mount configured to (i) hold the camera in a predetermined position facing inventory stocked on a shelving unit, and (ii) removably coupled with the shelving unit. In one embodiment, the inventory camera is configured to capture an image of the inventory at predetermined time intervals. Additionally, the image may be transmitted to a cloud computing service for analysis of the inventory.

[0006] In some embodiments, the camera is held in the predetermined position facing a rear of the inventory stocked on the shelving unit. In another embodiment, the camera is held in the predetermined position facing a front of the inventory stocked on the shelving unit.

[0007] In some embodiments, the mount is L-shaped and includes a first set of grips configured to secure a first portion of the camera, and a second set of grips configured to secure a second portion of the camera. In some embodiments, the mount is configured to couple with an underside of a first shelf of the shelving unit, wherein the inventory is stocked on a second shelf of the shelving unit, the second shelf being below the first shelf. In additional embodiment, the inventory camera system further comprises a central processing unit (CPU) encased within the housing, and a non-transitory computer-readable medium encased within the housing and communicatively coupled to the CPU and having logic thereon. The logic, when executed by the CPU, may be configured to perform operations including: receiving an instruction to capture an image of at least a portion of shelving unit, including at least a portion of the inventory stocked thereon. In some embodiments, the CPU and the non-transitory computer-readable medium are included in an integrated circuit. In other embodiments, the lens has a viewing angle of 180° (degrees). [0008] In other embodiment, an inventory camera apparatus is disclosed. The inventory camera apparatus comprises a housing, a lens at least partially encased by the housing, a central processing unit (CPU) encased within the housing, and a non-transitory computer-readable medium encased within the housing and communicatively coupled to the CPU and having logic thereon, the logic, when executed by the CPU, being configured to perform operations including: receiving an instruction to capture an image of at least a portion of shelving unit, including at least a portion of the inventory stocked thereon. In some embodiments, the lens has a viewing angle of 180° (degrees). In other embodiments, the instruction indicates that images are to be captured at predetermined time intervals.

[0009] In one embodiment, the image is transmitted to a cloud computing service for analysis of the inventory. In another embodiment, the housing is configured to couple to a mount, the mount configured to (i) hold the housing in a predetermined position facing inventory stocked on a shelving unit, and (ii) be removably coupled with the shelving unit. In yet other embodiments, the mount is L-shaped and includes a first set of grips configured to secure a first portion of the camera, and a second set of grips configured to secure a second portion of the camera. Additionally, the mount may be configured to couple with an underside of a first shelf of the shelving unit, wherein the inventory is stocked on a second shelf of the shelving unit, the second shelf being below the first shelf. In another embodiment, the CPU and the non-transitory computer-readable medium are included in an integrated circuit.

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The invention may best be understood by referring to the following description and accompanying drawings that are used to illustrate embodiments of the invention. In the drawings:

[0011] FIG. 1 provides an illustration of an automated inventory intelligence system in accordance with some embodiments;

[0012] FIG. 2A provides a second illustration of a plurality of shelves with an automated inventory intelligence system in accordance with some embodiments;

[0013] FIG. 2B provides an illustration of a mount of the inventory camera of FIG. 2A in accordance with some embodiments; [0014] FIG. 2C provides an illustration of the inventory camera positioned within the mount of the automated inventory intelligence system of FIGS. 2 A - 2B;

[0015] FIG. 3 provides a second illustration of a plurality of shelves with an automated inventory intelligence system in accordance with some embodiments;

[0016] FIG. 4 provides an illustration of a portion of an automated inventory intelligence system in accordance with some embodiments;

[0017] FIG. 5 provides an illustration of an image captured by a camera of an automated inventory intelligence system in accordance with some embodiments;

[0018] FIG. 6A provides a schematic illustrating a sensor coupled to a retail shelving unit in accordance with some embodiments in shown;

[0019] FIG. 6B provides a schematic illustrating a sensor such as an inventory camera coupled to an automated inventory intelligence system in accordance with some embodiments; and

[0020] FIG. 6C provides a schematic illustrating a sensor such as an inventory camera coupled to the automated inventory intelligence system in accordance with some embodiments.

[0021] FIG. 7A provides an exemplary embodiment of a first logical representation of the automated inventory intelligence system of FIG. 1.

[0022] FIG. 7B provides an exemplary embodiment of a second logical representation of the automated inventory intelligence system of FIG. 1.

DETAILED DESCRIPTION

[0023] In response to the problems outlined above, a continuing need exists for solutions that help retailers increase operational efficiencies, create intimate customer experiences, streamline processes, and provide real-time understanding of customer behavior in the store. Provided herein are automated inventory intelligence systems and methods that address the foregoing. [0024] Before some particular embodiments are provided in greater detail, it should be understood that the particular embodiments provided herein do not limit the scope of the concepts provided herein. It should also be understood that a particular embodiment provided herein can have features that may be readily separated from the particular embodiment and optionally combined with or substituted for features of any of a number of other embodiments provided herein.

[0025] Regarding terms used herein, it should also be understood the terms are for the purpose of describing some particular embodiments, and the terms do not limit the scope of the concepts provided herein. Ordinal numbers (e.g., first, second, third, etc.) are generally used to distinguish or identify different features or steps in a group of features or steps, and do not supply a serial or numerical limitation. For example,“first,”“second,” and“third” features or steps need not necessarily appear in that order, and the particular embodiments including such features or steps need not necessarily be limited to the three features or steps. Labels such as “left,”“right,”“front,”“back,”“top,”“b ottom,”“forward,”“reverse,”“clockwise,”“coun ter clockwise,”“up,”“down,” or other similar terms such as“upper,”“lower,”“aft,”“fore,” “vertical,”“horizontal,”“proximal,”“distal,” and the like are used for convenience and are not intended to imply, for example, any particular fixed location, orientation, or direction. Instead, such labels are used to reflect, for example, relative location, orientation, or directions. Singular forms of“a,”“an,” and“the” include plural references unless the context clearly dictates otherwise. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the art.

[0026] In general, the present disclosure describes an apparatus and a method for an automated inventory intelligence system that provides intelligence in tracking inventory on, for example retail shelves, as well intelligence in determining the proximity of retail customers as they approach, stall and pass a particular retail shelf or display and the demographics of the retail customers. In one embodiment, the automated inventory intelligence system is comprised of a cabinet top display, fascia, a proximity sensor, one or more inventory sensors, and one or more demographic tracking sensors. The cabinet top display can be configured to display animated and/or graphical content and is mounted on top of in-store shelves. In many embodiments, the fascia may include one or more panels of light-emitting diodes (LEDs) configured to display animated and/or graphical content and to mount to an in-store retail shelf. It would be understood by those skilled in the art that other light-emitting technologies may be utilized that can provide sufficient brightness, resolution, contrast, and/or color response. The automated inventory intelligence system can also include a data processing system comprising a media player that is configured to simultaneously execute (i.e.,“play”) a multiplicity of media files that are displayed on the cabinet top and/or the fascia. The cabinet top and the fascia are typically configured to display content so as to entice potential customers to approach the shelves, and then the fascia may switch to displaying pricing and other information pertaining to the merchandise on the shelves once a potential customer approaches the shelves. The proximity sensor is configured to detect the presence of potential customers. Further, one or more inventory sensors may be configured to track the inventory stocked on one or more in store retail shelves. The automated inventory intelligence system may create one or more alerts once the stocked inventory remaining on the shelves is reduced to a predetermined minimum threshold quantity.

I. SYSTEM ARCHITECTURE

[0027] Referring now to FIG. 1, an illustration of an automated inventory intelligence system 100 in accordance with some embodiments is shown. The automated inventory intelligence system 100 comprises a proximity camera 107, fascia 108i - l08 ₄ , a plurality of inventory cameras l lOi - l lOi (wherein i > 1, herein, i = 8) and a facial recognition camera 109. It is noted that the disclosure is not limited to the automated inventory intelligence system 100 including a single cabinet display top 106 but may include a plurality of cabinet top displays 106. Additionally, the automated inventory intelligence system 100 is not limited to the number of fascia, shelving units, proximity cameras, facial recognition cameras and/or inventory cameras shown in FIG. 1. In typical embodiments, the automated inventory intelligence system 100 couples to a shelving unit 102, which often includes shelves 104, a back component 105 (e.g., pegboard, gridwall, slatwall, etc.) and a cabinet top display 106.

[0028] In many embodiments, the cabinet display top 106 is coupled to an upper portion of the shelving unit 102, extending vertically from the back component 105. Further, a proximity camera 107 may be positioned on top of, or otherwise affixed to, the cabinet top display 106. Although the proximity camera 107 is shown in FIG. 1 as being centrally positioned atop the cabinet top display 106, the proximity camera 107 may be positioned in different locations, such as near either end of the top of the cabinet top 106, on a side of the cabinet top 106 and/or at other locations coupled to the shelving unit 102 and/or the fascia 108. [0027] The cabinet display top 106 and fascia 108 may be attached to the shelves 104 by way of any fastening means deemed suitable, wherein examples include, but are not limited or restricted to, magnets, adhesives, brackets, hardware fasteners, and the like. In a variety of embodiments, the fascia 108 and the cabinet display top 106 may each be comprised of one or more arrays of light emitting diodes (LEDs) that are configured to display visual content (e.g., still or animated content), with optional speakers, not shown, coupled thereto to provide audio content. Any of the fascia 108 and/or the cabinet display top 106 may be comprised of relatively smaller LED arrays that may be coupled together so as to tessellate the cabinet display top 106 and the fascia 108, such that the fascia and cabinet top desirably extend along the length of the shelves 104. The smaller LED arrays may be comprised of any number of LED pixels, which may be organized into any arrangement to conveniently extend the cabinet display top 106 and the fascia 108 along the length of a plurality of shelves 104. In some embodiments, for example, a first dimension of the smaller LED arrays may be comprised of about 132 or more pixels. In some embodiments, a second dimension of the smaller LED arrays may be comprised of about 62 or more pixels.

[0028] The cabinet display top 106 and the fascia 108 may be configured to display visual content to attract the attention of potential customers. As shown in the embodiment of FIG. 1, the cabinet display top 106 may display desired visual content that extends along the length of the shelves 104. The desired content may be comprised of a single animated or graphical image that fills the entirety of the cabinet display top 106, or the desired content may be a group of smaller, multiple animated or graphical images that cover the area of the cabinet display top 106. In some embodiments, the fascia 108 may cooperate with the cabinet display top 106 to display either a single image or multiple images that appear to be spread across the height and/or length of the shelves 104.

[0029] In some embodiments, the cabinet display top 106 may display visual content selected to attract the attention of potential customers to one or more products comprising inventory 112, e.g., merchandise, located on the shelves 104. Thus, the visual content shown on the cabinet display top 106 may be specifically configured to draw the potential customers to approach the shelves 104, and is often related to the specific inventory 112 located on the corresponding shelves 104. A similar configuration with respect to visual content displayed on the fascia 108 may apply as well, as will be discussed below. The content shown on the cabinet display top 106, as well as the fascia 108, may be dynamically changed to engage and inform customers of ongoing sales, promotions, and advertising. As will be appreciated, these features offer brands and retailers a way to increase sales locally by offering customers a personalized campaign that may be easily changed quickly.

[0030] Moreover, as referenced above, portions of the fascia 108 may display visual content such as images of brand names and/or symbols representing products stocked on the shelves 104 nearest to each portion of the fascia. For example, in an embodiment, a single fascia 108 may be comprised of a first portion 114 and a second portion 116. The first portion 114 may display an image of a brand name of inventory 112 that is stocked on the shelf above the first portion 114 (e.g., in one embodiment, stocked directly above the first portion 114), while the second portion 116 may display pricing information for the inventory 112. Additional portions may include an image of a second brand name and/or varied pricing information when such portions correspond to inventory different than inventory 112. It is contemplated, therefore, that the fascia 108 extending along each of the shelves 104 may be sectionalized to display images corresponding to each of the products stocked on the shelves 104. It is further contemplated that the displayed images will advantageously simplify customers quickly locating desired products.

[0031] In an embodiment, the animated and/or graphical images displayed on the cabinet display top 106 and the fascia 108 are comprised of media files that are executed by way of a suitable media player. The media player preferably is often configured to simultaneously play any desired number of media files that may be displayed on the smaller LED arrays. In some embodiments, each of the smaller LED arrays may display one media file being executed by the multiplayer, such that a group of adjacent smaller LED arrays combine to display the desired images to the customer. Still, in some embodiments, base video may be stretched to fit any of various sizes of the smaller LED arrays, and/or the cabinet display top 106 and fascia 108. It should be appreciated, therefore, that the multiplayer disclosed herein enables implementing a single media player per aisle in-store instead relying on multiple media players dedicated to each aisle.

[0032] Furthermore, FIG. 1 illustrates a plurality of inventory cameras 110 (i.e., the inventory cameras 110i - 1 1 Ox) In some embodiments, the inventory cameras 110 are coupled to the shelving unit 102, e.g., via the pegboard 105, and positioned above merchandise 112, also referred to herein as“inventory.” Each of the inventory cameras 110 can be configured to monitor a portion of the inventory stocked on each shelf 104, and in some instances, may be positioned below a shelf 104, e.g., as is seen with the inventory cameras 110 _{3 -} 110 ₈ . However, in some instances, an inventory camera 110 may not be positioned below a shelf 104, e.g., as is seen with the inventory cameras l lOi - H0 ₂ . Taking the inventory camera H0 ₄ , as an example, the inventory camera 110 ₄ is positioned above the inventory portion 116 and therefore capable of (and configured to), monitor the inventory portion 116. Although, it should be noted that the inventory camera 110 ₄ may have a viewing angle of 180° (degrees) and is capable of monitoring a larger portion of the inventory 112 on the shelf l04 ₂ than merely inventory portion 116. For example, FIG. 5 illustrates one exemplary image captured by an inventory camera having a viewing of 180°.

[0033] As is illustrated in FIGS. 2 A - 4 and 6 A - 6C and discussed with respect thereto, the positioning of the inventory cameras 110 may differ from the illustration of FIG. 1. In addition to being positioned differently with respect to spacing above inventory 112 on a particular shelf 104, the inventory cameras 110 may be affixed to the shelving unit 102 in a variety of manners, including attachment to various types of shelves 104 and monitoring of any available inventory 112 stored thereon.

[0034] In addition to the proximity camera 107 and the inventory cameras l lOi - 1 1 Ox, various embodiments of the automated inventory intelligence system 100 can also include a facial recognition camera 109. In one embodiment, the facial recognition camera 109 may be coupled to the exterior of the shelving unit 102. In some embodiments, the facial recognition camera 109 may be positioned between five to six feet from the ground in order to obtain a clear image of the faces of a majority of customers. The facial recognition camera 109 may be positioned at heights other than five to six feet from the ground. The facial recognition camera 109 need not be coupled to the exterior of the shelving unit 102 as illustrated in FIG. 1; instead, the illustration of FIG. 1 is merely one embodiment. The facial recognition camera 109 may be coupled to in the interior of a side of the shelving unit 109 as well as to any portion of any of the shelves 104i - l04 ₄ , the cabinet display top 106, the fascia 108 and/or the back component 105 of the shelving unit 102. Further, a plurality of facial recognition cameras 109 may be coupled to the shelving unit 102. In certain embodiments, the facial recognition camera 109 may be eliminated and its associated functions accomplished by any available proximity cameras 107. In these embodiments, software can be utilized to account for any discrepancy between the image and angles captured between the proximity cameras 107 as compared to the facial recognition cameras 109. In further embodiments, especially where privacy concerns are heightened, facial recognition cameras may be eliminated leaving the automated inventory intelligent system 100 to gather customer data by other means including, but not limited to, mobile phone signals/application data and/or radio-frequency identification (RFID) signals.

[0036] In some embodiments, the automated inventory intelligence system 100 may include one or more processors, a non-transitory computer-readable memory, one or more communication interfaces, and logic stored on the non-transitory computer-readable memory. The images or other data captured by the proximity sensor 107, the facial recognition camera 109 and/or the inventory cameras 110i - 1 1 Ox may be analyzed by the logic of the automated inventory intelligence system 100. The non-transitory computer-readable medium may be local storage, e.g., located at the store in which the proximity sensor 107, the facial recognition camera 109 and/or the inventory cameras l lOi - 1 1 Ox reside, or may be cloud-computing storage. Similarly, the one or more processors may be local to the proximity sensor 107, the facial recognition camera 109 and/or the inventory cameras 110i - 110 ₈ or may be provided by cloud computing services.

[0037] Examples of the environment in which the automated inventory intelligence system 100 may be located include, but are not limited or restricted to, a retailer, a warehouse, an airport, a high school, college or university, any cafeteria, a hospital lobby, a hotel lobby, a train station, or any other area in which a shelving unit for storing inventory may be located.

II. INVENTORY SENSORS

[0038] Referring to FIG. 2A, a second illustration of a plurality of shelves with an automated inventory intelligence system in accordance with some embodiments is shown. Specifically, FIG. 2A illustrates the automated inventory intelligence system coupled to a shelving unit 200. More particularly, the shelving unit 200 includes a back component 202 (e.g., pegboard) and shelves 204 (wherein shelves 204i - 204 ₃ are illustrated; however, the shelving unit 200 may include additional shelves). In the illustrated embodiment, the automated inventory intelligence system includes fascia 208 and the inventory sensor 210 (herein the inventory sensor 210 is depicted as inventory camera). Although only a single inventory camera 210 is shown in FIG. 2A, the automated inventory intelligence system may include additional inventory cameras not shown. FIG. 2A provides a clear perspective as to the positioning of the inventory camera 210 may be in one embodiment. Specifically, the inventory camera 210 is shown to be coupled to a corner formed by an underside of the shelf 204i and the back component 202. The positioning of the inventory camera 210 can enable the inventory camera 210 to monitor the inventory 212. Additional detail of the coupling of the inventory camera 210 to the shelving unit 200 is seen in FIG. 2B. In addition, the fascia, e.g., fascia 208 ₂ may display pricing information (as also shown in FIG. 1) as well as display an alert 209, e.g., a visual indicator via LEDs of a portion of the fascia, indicating that inventory stocked on the corresponding shelf, e.g., the shelf 208 ₂ , is to be restocked.

[0039] Referring now to FIG. 2B, an illustration of a mount of the inventory camera 210 of FIG. 2A is shown in accordance with some embodiments. The mount 222, which may be “L-shaped” in nature (i.e., two sides extending at a 90° (degree) angle from each other, is shown without the inventory camera 210 placed therein. In some embodiments, the inventory camera 210 may snap into the mount 222, which may enable inventory cameras to be easily replaced, moved, removed for charging or repair, etc. The mount 222 is shown as being coupled to a corner formed by an underside of the shelf 204i and the back component 202. In particular, the shelving unit 200 depicted in FIG. 2B comprises a first metal runner 214 attached to the back component 202 and a second metal runner 220 is shown as being attached to the underside of the shelf 2041. The first metal runner 214 includes a first groove 216 and a second groove 218 to which flanges of the mount 222, such as the flange 228, may slide or otherwise couple. Although not shown, a groove is also formed by the second metal runner 220, which may also assist in the coupling of the mount 222.

[0040] In the embodiment illustrated, the mount 222 includes a top component 224, a side component 226, an optional flange 228, bottom grips 230, top grips 232, a top cavity 234 and side cavity 236. In addition, although not shown, a flange extending from the top component 224 to couple with the metal runner 220 may be included. The inventory camera 210 may couple to the mount 222 and be securely held in place by the bottom grips 230 and the top grips 232. Further, the body of the inventory camera 210 may include projections that couple, e.g., mate, with the cavity 234 and/or the cavity 236 to prevent shifting of the inventory camera 210 upon coupling with the mount 222.

[0041] Referring to FIG. 2C, an illustration of the inventory camera 210 positioned within the mount 222 of the automated inventory intelligence system of FIGS. 2A - 2B is shown. The inventory camera 210 is positioned within the mount 222 and includes a lens 238 and a housing 240. The inventory camera 210 is shown as having four straight sides but may take alternative forms as still be within the scope of the invention. For example, in other embodiments, the inventory camera 210 may only have two straight sides and may include two curved sides. Additionally, the inventory camera 210 may take a circular shape or include one or more circular arcs. Further, the inventory camera 210 may take the form of any polygon or other known geometric shape. In addition, the housing 240 may have an angled face such that the face of the housing 240 slopes away from the lens 238, which may be advantageous in capturing an image having a viewing angle of 180°. The inventory camera 210 may snap into the mount 222 and held in place by friction of the bottom grips 230 and top grips 232, and the force applied by the top component 224 and the side component 226. It would be understood to those skilled in the art that the mount 222 can comprise a variety of shapes depending on the camera and shelving unit 200 being utilized, as can be shown in the camera mount depicted in FIG. 3 below.

[0042] Referring now to FIG. 3, a second illustration of a plurality of shelves with an automated inventory intelligence system is shown in accordance with some embodiments. In particular, FIG. 3 illustrates an inventory camera 3 l0i of the automated inventory intelligence system 300 coupled to the underside of a shelf 304i, which is part of the shelving unit 302. In the embodiment depicted in FIG. 3, the automated inventory intelligence system 300 includes the fascia 306i - 306 ₂ , the camera 310i and a mount 314. In one embodiment, the mount 314 is coupled to underside of shelf 304i, which is possible due to the configuration of the shelf 304i, particularly, the shelf 3041 is comprised of a series of grates. Due to the grated nature of the shelf 304i, the mount 314 may be configured to clip directly to one or more of the grates.

[0043] It should also be noted that the shelving unit 302 is refrigerated, e.g., configured for housing milk, and includes a door, not shown. As a result of being refrigerated, the shelving unit 302 experiences temperature swings as the door is opened and closed, which often results in the temporary accumulation of condensation on the lens of the inventory camera 3 lOi. Thus, the logic of the automated inventory intelligence system may perform various forms of processing for handling the temporary accumulation of condensation on the lens of the inventory camera 3 l0i, which may include, for example, (i) sensing when the door of the shelving unit 302 is opened, e.g., via sensing activation of a light, and waiting a predetermined amount of time before taking an image capture with the inventory camera 3 l0i (e.g., to wait until the condensation has dissipated), and/or (ii) capturing an image with the inventory camera 3 l0i, performing image processing such as object recognition techniques, and discarding the image when the object recognition techniques do not provide a confidence level of the recognized objects above a predetermined threshold (e.g., condensation blurred or otherwise obscured the image, indicating the presence of condensation).

[0044] Although not shown, in one embodiment, the inventory camera 3 l0i may be coupled to the front of the shelf 3041 and face the inventory 312. Such an embodiment may be advantageous with refrigerated shelving units such as the shelving unit 302 when a light source, not shown, is housed within the shelving unit and turns on when a door of the shelving unit is opened. More specifically, when the light source is positioned at the rear of the shelving unit, the image captured by the inventory camera 3 l0i may appear clearer and less blurred in such an embodiment.

[0045] Referring to FIG. 4, an illustration of a portion of an automated inventory intelligence system is shown in accordance with some embodiments. In particular, a sensor 408 is shown positioned near merchandise 406 stocked on a shelving unit 402 of an automated inventory intelligence system 400. The sensor 408 is shown integrated in a housing 404, wherein the housing 404 may, in one embodiment, take the form of a rod that extends along at least a portion of the back component of the shelving unit and may be configured to couple to the shelving unit. As in other embodiments disclosed herein, the sensor 408 may include a digital camera; however, in other embodiments, the sensor 408 may be any sensing device whereby merchandise stocked on a shelving unit may be monitored. In the embodiment shown, the sensor 408 is configured to be coupled directly to the shelving unit 402 by way of any fastening means deemed suitable, such as, by way of non-limiting example, magnets, adhesives, brackets, hardware fasteners, and the like. In other embodiments, such as those illustrated in FIGS. 5 - 6 below, the sensor 408 may be coupled to the shelving unit 402 through a mounting bracket. Further, the location of a sensor such as the sensor 408 is not to be limited to the location shown in FIG. 4. It should be understood that the sensor 408 may be disposed in any location with respect to a retail display or warehouse storage unit whereby the stocked merchandise may be monitored. Embodiments of some alternative positioning of sensors are illustrated in FIGS. 6A - 6C. Furthermore, preferred locations suited to receive the sensor 408 will generally depend upon one or more factors, such as, for example, the type of merchandise, an ability to capture a desired quantity of merchandise within the field of view of the sensor 408, as well as the methods whereby customers typically remove merchandise from the retail display units. [0046] Any of the retail displays or warehouse storage units outfitted with the automated inventory intelligence system 400 can monitor the quantity of stocked merchandise by way of one or more sensors such as the sensor 408 and then create a notification or an alert once the remaining merchandise is reduced to a predetermined minimum threshold quantity. For example, low-inventory alerts may be created when the remaining merchandise is reduced to 50% and 20% thresholds; however, the disclosure is not intended to be so limited and thresholds may be predetermined and/or dynamically configurable (e.g., in response to weather conditions, and/or past sales history data). The low-inventory alerts may be sent to in-store staff to signal that a retail display needs to be restocked with merchandise. In some embodiments, the low-inventory alerts can include real-time images and/or stock levels of the retail displays so that staff can see the quantity of merchandise remaining on the retail displays by way of a computer or a mobile device. In some embodiments, the low-inventory alerts may be sent in the form of text messages in real time to mobile devices carried by in-store staff. As will be appreciated, the low-inventory alerts can signal in-store staff to restock the retail displays with additional merchandise to maintain a frictionless shopping experience for consumers. In addition, the automated inventory intelligence system 400 can facilitate deeper analyses of sales performance by coupling actual sales with display shelf activity.

III. INVENTORY MONITORING

[0047] Referring to FIG. 5, an illustration of an image captured by a camera of an automated inventory intelligence system is shown in accordance with some embodiments. The image 500 shown in FIG. 5 illustrates the ability of an inventory camera configured for use with the automated inventory intelligence system of FIGS. 2 A - 2C to capture the image 500 having an approximately 180° viewing angle. In certain embodiments, an inventory camera, such as the inventory camera 310i of FIG. 3, may be positioned within a shelving unit, such as the shelving unit 302 of FIG. 3, such that the inventory camera is located at the inner rear of the shelving unit and above a portion of inventory. In such an embodiment, the inventory camera 3 l0i may capture an image such as the image 500, which includes a capture of an inventory portion 508 and an inventory portion 510 stocked on shelving 506. In addition, the image 500 may include a capture of a portion of the store environment 502 and additional inventory 512. [0048] Specifically, the positioning of the inventory camera as shown in FIG. 5 enables the inventory camera to capture images such as the image 500, which may be analyzed by logic of the automated inventory intelligence system to automatically and intelligently determine the amount of inventory stocked on the shelf. For example, as seen in the image 500, the first inventory portion 508 and the second inventory portion 510 may be identified by the automated inventory intelligence system using object recognition techniques. For example, upon recognition of the first inventory portion 508 (e.g., recognition of Pepsi bottles), logic of the automated inventory intelligence system may analyze the quantity remaining on the shelf 506. In additional embodiments, the automated inventory intelligence system may determine whether a threshold number of bottles have been removed from the shelf 506. Upon determining at least the threshold number of bottles have been removed, the automated inventory intelligence system may generate a report and/or an alert notifying employees and/or manufacturers that the first inventory portion 508 requires restocking. In additional embodiments, the automated inventory intelligence system may determine that less than a threshold number of bottles remain on the shelf 506 and therefore the first inventory portion 508 requires restocking. Utilization of other methodologies of determining whether at least a predetermined number of items remain on a shelf for a given inventory set are within the scope of the invention. Herein, the term“inventory set” generally refers to a grouping of a particular item, e.g., a grouping of a particular type of merchandise, which may include brand, product size (12 oz. bottle v. 2L bottle), etc.

[0049] In some embodiments, the image 500 may also be analyzed to determine the remaining items of other inventory portions such as the second inventory portion 510 and/or the alternative portion 512. As seen in FIGS. 6A - 6C, the inventory camera may be placed at various varying positions within, or coupled to, a shelving unit. The utilization of such alternative configurations may be dependent upon the type of shelving unit, the type of inventory being captured in images taken by the inventory camera and/or the positioning of inventory within the store environment (e.g., across an aisle).

[0050] FIGS. 6A - 6C provide schematics illustrating sensors coupled to retail displays in accordance with some embodiments. The one or more sensors are configured to be disposed in a retail environment such as by coupling the sensors to retail displays or warehouse storage units. Such retail displays include, but are not limited to, shelves, panels (e.g., pegboard, gridwall, slatwall, etc.), tables, cabinets, cases, bins, boxes, stands, and racks, and such warehouse storage includes, but is not limited to, shelves, cabinets, bins, boxes, and racks. The sensors may be coupled to the retail displays or the warehouse storage units such that one sensor is provided for every set of inventory items (e.g., one-to-one relationship), one sensor for a number of sets of inventory items (e.g., one-to-many relationship), or a combination thereof. The sensors may also be coupled to the retail displays or the warehouse storage units with more than one sensor for every set of inventory items (e.g., many-to-one relationship), more than one sensor for a number of sets of inventory items (e.g., many-to-many relationship), or a combination thereof. In an example of a many-to-one relationship, at least two sensors monitor the same set of inventory items thereby providing contemporaneous sensor data for the set of inventory items. Providing two (or more) sensors for a single set of inventory is useful for sensor data redundancy or simply having a backup. Each of FIGS. 6A - 6C shows a one-to-one relationship of a sensor to a set of inventory items, but each sensor can alternatively be in one of the foregoing alternative relationships with one or more sets of inventory items.

[0051] The sensors include, but are not limited to, light- or sound-based sensors such as digital cameras and microphones, respectively. In some embodiments, the sensors are digital cameras, also referred to as“inventory cameras,” with a wide viewing angle up to a 180° viewing angle.

[0052] Referring now to FIG. 6A, a schematic illustrating a sensor such as a sensor 606 coupled to a retail shelving unit 604 is shown in accordance with some embodiments. As shown, the sensor 606, e.g., an inventory camera, may be coupled to or mounted on the retail shelving unit 604 under an upper shelf of the shelving unit 604, wherein the shelving unit 604 is a component of the housing 602 of the automated inventory intelligence system 600. In the illustrated embodiment, the inventory camera 606 is configured in an orientation to view a set of inventory items 608 on an inventory item-containing shelf beneath the upper shelf. While the inventory camera 606 is shown mounted inside the retail shelving unit 604 such as on a back (e.g., pegboard) of the housing 602 and looking out from the automated inventory intelligence system 600, the inventory camera 606 may alternatively be coupled to the upper shelf and looking in to the automated inventory intelligence system 600. Due to a wide viewing angle of up to 180°, whether looking out from or in to the automated inventory intelligence system 600, the inventory camera 606 may collect visual information on sets of inventory items adjacent to the set of inventory items 608. [0053] Referring to FIG. 6B, a schematic illustrating a sensor such as an inventory camera 612 coupled to an automated inventory intelligence system 600 is shown in accordance with some embodiments. As shown, the inventory camera 612 may be coupled to or mounted on the automated inventory intelligence system 600 on an inventory-item containing shelf of the automated inventory intelligence system 600 in an orientation to view a set of inventory items 614 on the inventory item-containing shelf. While the inventory camera 612 is shown mounted inside the automated inventory intelligence system 600 on the inventory item-containing shelf and looking in to the automated inventory intelligence system 600, which may be advantageous when a light 610 is present in a back of automated inventory intelligence system 600, the inventory camera 612 may alternatively be coupled to the inventory item-containing shelf and looking out from the automated inventory intelligence system 600. Due to a wide viewing angle of up to 180°, whether looking in to or out from the automated inventory intelligence system 600, the inventory camera 612 may collect visual information on sets of inventory items adjacent to the set of inventory items 614.

[0054] Referring to FIG. 6C, a schematic illustrating a sensor such as an inventory camera 622 coupled to the automated inventory intelligence system 600 is shown in accordance with some embodiments. In addition, FIG. 6C further provides a second housing 618 with a second sensor such as an inventory camera 624 coupled to a second upper shelf 620 and in communication with a second automated inventory intelligence system 616 in accordance with some embodiments. In certain embodiments the automated inventory intelligence system 600 and second automated inventory intelligence system 616 may be separate and independent systems or may be communicatively coupled and/or processing data cooperatively.

[0055] As shown, the inventory camera 622 may be physically coupled to or mounted on the automated inventory intelligence system 600 in an orientation to view a set of inventory items 628 on an inventory-item containing shelf of an opposing shelving unit across an aisle such as the automated inventory intelligence system 616. Likewise, the inventory camera 624 may be coupled to or mounted on the automated inventory intelligence system 616 in an orientation to view a set of inventory items 626 on an inventory-item containing shelf of an opposing shelving unit across an aisle such as the automated inventory intelligence system 600. Due to wide viewing angles of up to 180°, the inventory camera 622 can collect visual information on sets of inventory items on the automated inventory intelligence system 616 adjacent to the set of inventory items 628 (not shown), and the inventory camera 622 can collect visual information on sets of inventory items on the automated inventory intelligence system 616 adjacent to the set of inventory items 626 (not shown).

[0056] In some embodiments, inventory cameras such as inventory cameras 606, 612, 622, and 624 are coupled to or mounted on endcaps or other vantage points of the automated inventory intelligence systems to collect visual information while looking in to the retail shelving units.

[0057] Referring to FIG. 7A, an exemplary embodiment of a first logical representation of the automated inventory intelligence system of FIG. 1 is shown in accordance with some embodiments. In many embodiments, the automated inventory intelligence system 700 may include one or more processors 702 that are coupled to a communication interface 704. The communication interface 704, in combination with a communication interface logic 708, enables communications with external network devices and/or other network appliances transmit and receive data. According to one embodiment of the disclosure, the communication interface 704 may be implemented as a physical interface including one or more ports for wired connectors. Additionally, or in the alternative, the communication interface 704 may be implemented with one or more radio units for supporting wireless communications with other electronic devices. The communication interface logic 708 may include logic for performing operations of receiving and transmitting data via the communication interface 704 to enable communication between the automated inventory intelligence system 700 and network devices via a network (e.g., the internet) and/ or cloud computing services, not shown.

[0058] The processor(s) 702 is further coupled to a persistent storage 706. According to at least one embodiment of the disclosure, the persistent storage 706 may store logic as software modules includes an automated inventory intelligence system logic 710 and the communication interface logic 708. The operations of these software modules, upon execution by the processor(s) 702, are described above. Of course, it is contemplated that some or all of this logic may be implemented as hardware, and if so, such logic could be implemented separately from each other.

[0059] Additionally, the automated inventory intelligence system 700 may include hardware components such as fascia 71 h - 71 l _m (wherein m > 1), inventory cameras 712i - 7l2i (wherein i > 1), proximity sensors 7l4i-7l4 _j (wherein j > 1), and facial recognition cameras 7l6i - 7l6 _k (wherein k > 1). Each of the inventory cameras 7l2i— 712i, the proximity sensors 714i - 7l4 _j , and the facial recognition cameras 7l6i - 7l6 _k may be configured to capture images, e.g., at predetermined time intervals or upon a triggering event, and transmit the images to the persistent storage 706. The automated inventory intelligence system logic 710 may, upon execution by the processor(s) 702, perform operations to analyze the images. In such embodiments, the automated inventory intelligence system logic 710 may determine whether a threshold amount of inventory remains stocked and provide results of the determination configured to alert of a need to restock the inventory, when applicable.

[0060] Referring to FIG. 7B, an exemplary embodiment of a second logical representation of the automated inventory intelligence system of FIG. 1 is shown in accordance with some embodiments. The illustration of FIG. 7B provides a second embodiment of the automated inventory intelligence system 700 in which the automated inventory intelligence system logic 710 resides in cloud computing services 740. In such an embodiment, each of the inventory cameras 7l2i - 7l2i, the proximity sensors 7l4i - 7l4 _j , and the facial recognition cameras 7l6i - 716 _k may be configured to capture images which are then transmitted, via the communication interface 704, to the automated inventory intelligence system 710 in the cloud computing services 740. The automated inventory intelligence system 710, upon execution via the cloud computing services 740, perform operations to analyze the images.

[0061] Processor(s) 702 can represent a single processor or multiple processors with a single processor core or multiple processor cores included therein. Processor(s) 702 can represent one or more general-purpose processors such as a microprocessor, a central processing unit (“CPU”), or the like. More particularly, processor(s) 702 may be a complex instruction set computing (“CISC”) microprocessor, reduced instruction set computing (“RISC”) microprocessor, very long instruction word (“VLIW”) microprocessor, or processor implementing other instruction sets, or processors implementing a combination of instruction sets. Processor(s) 702 can also be one or more special-purpose processors such as an application specific integrated circuit (“ASIC”), a field programmable gate array (“FPGA”), a digital signal processor (“DSP”), a network processor, a graphics processor, a network processor, a communications processor, a cryptographic processor, a co-processor, an embedded processor, or any other type of logic capable of processing instructions. Processor(s) 702 can be configured to execute instructions for performing the operations and steps discussed herein. [0062] Persistent storage 706 can include one or more volatile storage (or memory) devices, such as random access memory (“RAM”), dynamic RAM (“DRAM”), synchronous DRAM (“SDRAM”), static RAM (“SRAM”), or other types of storage devices. Persistent storage 706 can store information including sequences of instructions that are executed by the processor(s) 702, or any other device. For example, executable code and/or data of a variety of operating systems, device drivers, firmware (e.g., input output basic system or BIOS), and/or applications may be loaded in persistent storage 706 and executed by the processor(s) 702. An operating system may be any kind of operating systems, such as, for example, Windows® operating system from Microsoft®, Mac OS®/iOS® from Apple, Android® from Google®, Linux®, Unix®, or other real-time or embedded operating systems such as VxWorks.

[0063] In many embodiments, the automated inventory intelligence system logic 710 includes an image receiving logic 718, an object recognition logic 720, an inventory threshold logic 722, an alert generation logic 724, a facial recognition logic 726 and a proximity logic 728. In further embodiments, the image receiving logic 718 can be configured to, upon execution by the processor(s) 702, perform operations to receive a plurality of images from a sensor, such as the inventory cameras 7l2i - 7l2i. In some embodiments, the image receiving logic 718 may receive a trigger, such as a request for a determination as to whether an inventory set needs to be restocked, and request an image be captured by one or more of the inventory cameras 7l2i-7l2i.

[0064] The object recognition logic 720 is configured to, upon execution by the processor(s) 702, perform operations to analyze an image received by an inventory camera 7l2i-7l2i, including object recognition techniques. In some embodiments, the object recognition techniques may include the use of machine learning, predetermined rule sets and/or deep convolutional neural networks. The object recognition logic 720 may be configured to identify one or more inventory sets within an image and determine an amount of each product within the inventory set. In addition, the object recognition logic 720 may identify a percentage, numerical determination, or other equivalent figure that indicates how much of the inventory set remains on the shelf (i.e., stocked) relative to an initial amount (e.g., based on analysis and comparison with an earlier image and/or retrieval of an initial amount predetermined and stored in a data store, such as the inventory threshold data store 730). [0065] The inventory threshold logic 722 is configured to, upon execution by the processor(s) 702, perform operations to retrieve one or more predetermined thresholds and determine whether the inventory set needs to be restocked. A plurality of predetermined holds, which may be stored in the inventory threshold data store 730, may be utilized in a single embodiment. For example, a first threshold may be used to determine whether the inventory set needs to be stocked and an alert transmitted to, for example, a retail employee (e.g., at least a first amount of the initial inventory set has been removed). In addition, a second threshold may be used to determine whether a product delivery person needs to deliver more of the corresponding product to the retailer (e.g., indicating at least a second amount of the initial inventory set has been removed, the second amount greater than the first amount). In such an embodiment, when the second threshold is met, alerts may be transmitted to both a retail employee and a product delivery person.

[0066] The alert generation logic 724 can be configured to, upon execution by the processor(s) 702, perform operations to generate alerts according to determinations made by, for example, the object recognition logic 720 and the inventory threshold 722. In certain embodiments, the alerts may take any form such as a digital communication transmitted to one or more electronic devices, and/or an audio/visual cue in proximity to the shelf on which the inventory set is stocked, etc.

[0067] The facial recognition logic 726 may be configured to, upon execution by the processor(s) 702, perform operations to analyze images received by the image receiving logic 718 from the facial recognition cameras 7l6i - 7l6 _k . In some embodiments, the facial recognition logic 726 may look to determine trends in customers based on ethnicity, age, gender, time of visit, geographic location of the store, etc., and, based on additional analysis, the automated inventory intelligence system logic 710 may determine trends in accordance with graphics displayed by the automated inventory intelligence system 700, sales, time of day, time of the year, day of the week, etc. Facial recognition logic 726 may also be able to generate data relating to the overall traffic associated with the facial recognition cameras 7l6i - 7l6 _k . This can be generated directly based on the number of faces (unique and non-unique) that are processed within a given time period. This data can be stored within the persistent storage 706 within a traffic density log 734. [0068] The proximity logic 728 can be configured to, upon execution by the processor(s) 702, perform operations to analyze images received by, for example, the image receiving logic 718 from the proximity sensors 7l4i - 7l4 _j . In some embodiments, the proximity logic 728 may determine when a customer is within a particular distance threshold from the shelving unit on which the inventory set is stocked and transmit a communication (e.g., instruction or command) to the change the graphics displayed on the fascia, e.g., such as the fascia 71 - 71 lm. Data related to the proximity, and therefore the potential effectiveness of an advertisement, may be stored within a proximity log 732. In this way, data may be provided that can be tracked with particular displays, products, and/or advertising campaigns.

[0069] Some portions of the description provided herein have been presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the ways used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of operations leading to a desired result. The operations are those requiring physical manipulations of physical quantities.

[0070] It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the above discussion, it should be appreciated that throughout the description, discussions utilizing terms such as those set forth in the claims below, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system’s registers and memories into other data similarly represented as physical quantities within the computer system’ s memories or registers or other such information storage, transmission or display devices.

[0071] The techniques shown in the figures may be implemented using code and data stored and executed on one or more electronic devices. Such electronic devices store and communicate (internally and/or with other electronic devices over a network) code and data using computer-readable media, such as non-transitory computer-readable storage media (e.g., magnetic disks; optical disks; random access memory; read only memory; flash memory devices; phase-change memory) and transitory computer-readable transmission media (e.g., electrical, optical, acoustical or other form of propagated signals - such as carrier waves, infrared signals, digital signals).

[0072] The processes or methods depicted in the figures may be performed by processing logic that includes hardware (e.g. circuitry, dedicated logic, etc.), firmware, software (e.g., embodied on a non-transitory computer readable medium), or a combination of both. Although the processes or methods are described above in terms of some sequential operations, it should be appreciated that some of the operations described may be performed in a different order. Moreover, some operations may be performed in parallel rather than sequentially.

[0073] While some particular embodiments have been provided herein, and while the particular embodiments have been provided in some detail, it is not the intention for the particular embodiments to limit the scope of the concepts presented herein. Additional adaptations and/or modifications can appear to those of ordinary skill in the art, and, in broader aspects, these adaptations and/or modifications are encompassed as well. Accordingly, departures may be made from the particular embodiments provided herein without departing from the scope of the concepts provided herein.