Cross-Reference to Related Application

[0001] This application claims the benefit of the following: Indian Provisional

Application No. 201841043606 filed November 20, 2018 and U.S. Provisional Application No. 62/810,129, filed February 25, 2019, both of which are incorporated herein by reference in their entireties.

Technical Field

[0002] This invention relates generally to product assessment and, more particularly, product assessment by a retailer.

Background

[0003] Many products require inspection by a retailer before the products are offered for sale to consumers. For example, the retailer may inspect the products for defects, damage, quantity, etc. so as to ensure that only suitable products are offered for sale to consumers. This inspection processed is typically done manually. For example, an employee will physically inspect all, or a sample, of the products to determine if the products are suitable for sale. While manual inspection of products can be used to determine the quality of products, it is time- consuming, and thus costly, for retailers. Additionally, manual inspection can be error prone due to the subjective nature of the inspection as well as potential employee fatigue and/or oversight. Consequently, a need exists for systems, methods, and apparatuses that can quickly, accurately, and consistently inspect products.

Brief Description of the Drawings

[0004] Disclosed herein are embodiments of systems, apparatuses, and methods pertaining to assessing products. This description includes drawings, wherein:

[0005] FIG. 1 A is an isometric view of an enclosure 100 for assessing products, according to some embodiments;

[0006] FIG. IB is a frontal view of an enclosure 120 for assessing products, according to some embodiments; [0007] FI G. 2 is a block diagram of a system 200 for assessing products, according to some embodiments; and

[0008] FIG. 3 is a flow chart depicting example operations for assessing a product, according to some embodiments.

[0009] Elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions and/or relative positioning of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of various embodiments of the present invention. Also, common but well- understood elements that are useful or necessary in a commercially feasible embodiment are often not depicted in order to facilitate a less obstructed view of these various embodiments of the present invention. Certain actions and/or steps may be described or depicted m a particular order of occurrence while those skilled in the art will understand that such specificity with respect to sequence is not actually required. The terms and expressions used herein have the ordinary technical meaning as is accorded to such terms and expressions by persons skilled in the technical field as set forth above except where different specific meanings have otherwise been set forth herein.

Detailed Description

[0010] Generally speaking, pursuant to various embodiments, systems, apparatuses, and methods are provided herein useful to an enclosure for use in assessing products. In some embodiments, an enclosure for use in assessing products comprises a housing, wherein the housing includes a door configured to allow placement of a product within the housing, a product holding surface, wherein the product holding surface is located within the housing, wherein the product holding surface allows pictures to be taken through the product holding surface, wherein the product holding surface divides the housing into a first portion and a second portion, and wherein the product holding surface is configured to support the product, a first image capture device, wherein the first image capture device is located within the first portion of the housing, and wherein the first image capture device is configured to capture an image of the product from a first perspective, a second image capture device, wherein the second image capture device is located within the second portion of the housing, wherein the second image capture device is configured to capture an image of the product from a second perspective, and wherein the image of the product from the second perspective is captured through the product holding surface, and a lighting element, wherein the lighting element is located within the housing, and wherein the lighting element is configured to provide lighting within the housing.

[0011] As previously discussed, many retailers inspect products received from suppliers, manufacturers, etc. before they offer the products for sale to consumers. This inspection is performed to ensure that only suitable products are offered for sale. Not only does this aid the retailer in promoting his or her reputation as a seller of quality goods, but some product inspections are required by governmental agencies (e.g., the Food and Drug Administration (FDA)). In addition to ensuring that only suitable products are offered for sale, the retailer may benefit from this inspection m that he or she may reject products that are not suitable for sale and thus avoid paying for products that are not suitable for sale.

[0012] Currently, many retailers perform these inspections manually. This manual inspection is time-consuming and error prone. As one example, a retailer may inspect produce before offering the produce for sale. In the case of strawberries, the retailer may inspect one percent (1%) of ail strawberries received in a shipment. If the retailer receives 3,000 packages (e.g., clamshells) of strawberries, the retailer must inspect 30 of the packages. To inspect a package of strawberries, the employee must remove the strawberries from the package, count the strawberries, visually inspect the strawberries, determine if there is any damage (e.g., bruising, mold, etc.), quantify the damage, record the damage, and then return the strawberries to the packaging. For an experienced employee, this process can take about two minutes to complete for each package. Consequently, if 30 packages of strawberries are to be inspected, this process will take about an hour. When adding this time amongst all other products that are to be inspected, it is easy to see how the inspection of products can require a significant portion of a retailer’s recourses.

[0013] Described herein are systems, methods, and apparatuses that can be used to help automate this inspection process. Specifically, described herein are enclosures, and methods for using such enclosures, to automate the inspection process. Such enclosures and methods can be used in conjunction with automated evaluation techniques (e.g., an automated inspection system), such as those described in U.S. Provisional Appl. No. 62/509,945, which is incorporated herein by reference in its entirety . Generally, the enclosure is capable of accepting a product and includes an image capture device. The image capture device captures an image of the product under controlled conditions. In some embodiments, the image of the product is transmitted to an external system, such as that described in U.S. Provisional Application No. 62/509,945 for an automated analysis f e.g., scoring) of the product. The discussion of FIGS. 1 A and IB provide an overview of such an enclosure.

[0014] FIG. 1 A is an isometric view of an enclosure 100 for assessing products, according to some embodiments. The enclosure includes a housing 102. Generally, the housing 102 is a box capable of having a product placed within the enclosure 100. While the housing 102 depicted in FIG. 1 A is a rectangular prism-shape, such is not required. That is, any shape suitable for receiving (i.e., allowing placement of) a product can be used and the shape of the housing 102 can be based upon the product being inspected.

[0015] The housing 102 includes a door (not shown). The door can be of any suitable type. For example, the door can be hinged at one, or multiple, ends of the housing 102, be slidable across the housing 102, rotate within or around the housing 102, foldable within or about the housing, etc. The door can be rigid and/or pliable (e.g , fabric), as desired based on the type of the enclosure 100 and/or the products being assessed. The door can take any suitable form based on a desired condition within the housing 102. For example, in some embodiments, it may be desired that the door create a seal with the housing 102 that prevents, or diminishes the amount of, external light entering the housing 102 when closed. It should be noted, that in some embodiments, the door may not be a“door” in the traditional sense, but rather a“doorway” into the enclosure. That is, the door may simply be an opening in the housing 102 that allows placement of a product in the housing 102.

[0016] The housing 102 includes a product holding surface 104. The product holding surface 104 is configured to support the product. The product holding surface 104 divides the housing 102 into two portions: a first portion 114 and a second portion 1 16. Although the product holding surface 104 roughly divides the housing 102 into two equal portions (i.e., the first portion 1 14 is roughly the same size as the second portion 116) in FIG. 1A, such is not required. Additionally, in some embodiments, the height of the product holding surface 104 can be adjusted within the housing 102 to accommodate products of different sizes and/or fine-tune how images of the product are captured (i.e., the product holding surface 104 is moveable). Preferably, the product holding surface 104 comprises a transparent or translucent material through which images of the product can be taken {i.e., the product holding surface 104 is substantially transparent). For example, the product holding surface 104 can he made of glass, plastic, and/or any other suitable material. Additionally, in some embodiments, only a portion of the product holding surface 104 may allow images to be captured through the product holding surface. For example, only a portion, such as a window, may be transparent or translucent and the remainder of the product holding surface 104 opaque.

[0017] In some embodiments, the product holding surface 104 includes a product barrier.

The product barrier is configured to retain products placed on the product holding surface 104 m a specified area ( e.g , in the field of view of an image capture device, optimally placed for the capturing of images, on the product holding surface 104, etc.). The product barrier can comprise any suitable structure, mechanism, or device for positioning of the product holding surface 104. For example, the product barrier can include an incline (e.g., the product holding surface 104, a portion of the product holding surface 104, or a structure associated with the product holding surface 104 can be inclined), a ledge, a ridge, a wall, etc.

[0018] The enclosure 100 includes two image capture devices: a first image capture device 106 and a second image capture device 108. The image capture devices can be of any suitable type and are capable of capture still and/or moving images (e.g., video). The image capture devices can be selected based on the size of the housing 102, type of products to be assessed, placement of the product holding surface 104, the shape of the housing 102, the type(s) of images desired, etc. For example, the image capture devices can include wide angle lenses to capture a large area of the housing 102.

[0019] The first image capture device 106 is located in the first portion 1 14 of the housing 102 and is configured to capture images of products from a first perspective. As depicted in FIG. 1 A, the first image capture device 106 is positioned to capture an overhead image of the product. That is, the first image capture device 106 is located on the“ceiling” of the housing 102, as indicated by the dashed lines. Although FIG. 1 A depicts the first image capture device 106 as being located on the“ceiling” of the housing 102, such is not required.

That is, the first image capture device 106 can be located anywhere in the first portion 114 of the housing 102. For example, the first image capture device 106 can be located on wall of the housing 102 (e.g., the side or back of the housing 102) to capture images of products from the side. The first image capture device 106 can be located anywhere within the first portion 1 14 of the housing 102, as required to capture desired images of products.

[0020] The second image capture device 108 is located in the second portion 116 of the housing 102 and is configured to capture images of products from a second perspective. As depicted in FIG. 1 A, the second image capture device 108 is located on the“floor” of the housing 102. In such embodiments, the second image capture device 108 captures images of products through the product holding surface 104. That is, the second image capture device 108 captures images of the product from a second perspective that is through the product holding surface 104. Although the second image capture device 108 is depicted in FIG. 1 A as being on the“floor” of the housing 102, such is not required. For example, the second image capture device 108 can be located on a wall or the back of the housing 102. The second image capture device 108 can be located anywhere within the second portion 116 of the housing 102, as required to capture desired images of products.

[0021] Additionally, though FIG. 1 A depicts only two image capture devices, in some embodiments, the enclosure 100 can include additional image capture devices. For example, the enclosure 100 can include a third image capture device to capture images of products from a third perspective, a fourth image capture device to capture images of products from a fourth perspective, etc. The additional image capture devices can be located anywhere about the enclosure 100 (e.g., in the housing 102, on the housing 102, outside of the housing 102, on a door, etc.).

[0022] In some embodiments, the enclosure 100 includes a lighting element 1 10. The lighting element is configured to provide lighting for the enclosure 100. In one embodiment, the lighting element 110 is located within the housing 102. In such embodiments, the lighting element 110 provides lighting within the housing 102. For example, as depicted in FIG. 1 A, the lighting element 110 can be located on the“ceiling” of the housing 102, as indicated by the dashed lines. The lighting element can be of any suitable type (e.g., incandescent, fluorescent, LED, etc.) and can produce light that is visible and/or invisible to the human eye. [0023] While FIG. 1 A depicts an isometric view of an enclosure, FIG. I B depicts a frontal view of an enclosure.

[0024] FIG. IB is a frontal view of an enclosure 120 for assessing products, according to some embodiments. Like the enclosure depicted m FIG. 1 A, the enclosure 120 depicted in FIG.

I B includes a housing 122, a door (not shown), a product holding surface 104, a first image capture device 126, a second image capture device 128, and a lighting element.

[0025] The lighting element depicted in FIG. IB includes four lighting elements: a first lighting element 130A, a second lighting element 130B, a third lighting element 130C, and a fourth lighting element 130D. The first lighting element 130A and the second lighting element 130B are located in a first portion 134 of the housing 122. The third lighting element 130C and the fourth lighting element 130D are located in the second portion 136 of the housing 124.

Although depicted as being located on the walls of the housing 122, the lighting element can be located in any suitable location to achieve the lighting effects desired. Additionally, the lighting element can include greater, or fewer (as depicted in FIG. 1 A), than four lighting elements.

[0026] FIG. IB includes a product 132 placed on the product holding surface 124.

Although the product 132 is depicted as only a single item, this is done only for simplicity. The product 132 may include multiple items and can be any type of items.

[0027] While the discussion of FIGS. 1A and IB provide an overview of an enclosure for use in assessing products, the discussion of FIG. 2 provides detail regarding a system for assessing products.

[0028] FIG. 2 is a block diagram of a system 200 for assessing products, according to some embodiments. The system includes a remote processing system 216, an enclosure 208, and a controller device 206. In some embodiments, at least some of the remote processing system 216, the controller device 206, and the enclosure 208 are in communication with one another.

For example, as depicted in FIG. 2, the controller device 206 and the remote processing system 216 are communicatively coupled via a network 214 (e.g, an intranet or internet, such as the Internet). Additionally, the controller device 206 is communicatively coupled to the enclosure 208. Although not being depicted as being communicatively coupled to one another via the network 214, in some embodiments, the controller device 206 and the enclosure are communicatively coupled in a wireless means, such as via the network 214, Bluetooth, etc.

[0029] The enclosure 208 is configured to allow placement of a product within the enclosure 208 for assessment. The enclosure includes an image capture device(s) 210 and lighting element(s) 212. The image capture devicefs) 210 is configured to capture images of the product in the enclosure 208 and the lighting element(s) 212 is configured to provide light for capturing the images.

[0030] The controller device 206 generally controls the capture of images in the enclosure 208. The controller device 206 can be of any suitable type, such as a device dedicated to the control of the enclosure 208 (e.g., a controller designed specifically for use with the enclosure 208, whether integral or separate from the enclosure 208) or an existing device modified to control the enclosure (e.g., a mobile device or other computing device running an application to control the enclosure 208).

[0031] The controller device 206 controls the enclosure 208 by controlling the image capture capture(s) device 210 and the lighting element(s) 212. For example, the controller device 206 instructs the lighting element(s) 212 to illuminate the enclosure 208 and the image capture device(s) 210 to capture an image of the product.

[0032] The controller device 206 includes a user input device 204 and a control circuit

202. The user input device 204 allows users to input commands to the controller device 206.

For example, the user input device 204 can allow- the user to input commands for the image capture device(s) 210 (e.g., capture an image, move or rotate the image capture device, turn a flash on or off, etc.) and for the lighting element(s) 212 (e.g., illuminate the enclosure 208, change the color of the light, adjust the angle of the light, adjust the timing of the light, etc.).

[0033] The control circuit 202 can comprise a fixed-purpose hard-wired hardware platform (including but not limited to an application-specific integrated circuit (ASIC) (which is an integrated circuit that is customized by design for a particular use, rather than intended for general-purpose use), a field-programmable gate array (FPGA), and the like) or can comprise a partially or wholly-programmable hardware platform (including but not limited to

microcontrollers, microprocessors, and the like). These architectural options for such structures are well known and understood in the art and require no further description here. The control circuit 202 is configured (for example, by using corresponding programming as will be well understood by those skilled in the art) to carry out one or more of the steps, actions, and/or functions described herein.

[0034] By one optional approach the control circuit 202 operably couples to a memory .

The memory may be integral to the control circuit 202 or can be physically discrete (in whole or in part) from the control circuit 202 as desired. This memory can also be local with respect to the control circuit 202 (where, for example, both share a common circuit board, chassis, power supply, and/or housing) or can be partially or wholly remote with respect to the control circuit 202 (where, for example, the memory ⁷ is physically located in another facility, metropolitan area, or even country as compared to the control circuit 202).

[0035] This memory can serve, for example, to non-transitoriiy store the computer instructions that, when executed by the control circuit 202, cause the control circuit 202 to behave as described herein. As used herein, this reference to“non-transitoriiy” will be understood to refer to a non-ephemerai state for the stored contents (and hence excludes when the stored contents merely constitute signals or waves) rather than volatility ⁷ of the storage media itself and hence includes both non-volatile memory (such as read-only memory (ROM) as well as volatile memory (such as an erasable programmable read-only memory (EPROM).

[0036] The control circuit 202 is configured to transmit and/or receive commands from the user input device 204, the image capture device(s) 210, the lighting element(s) 212, and the remote processing system 216. For example, the control circuit 202 can receive an execution command from the user input device. The execution command includes instructions for the control circuit 202 to control the enclosure 208. For example, the execution command can include instructions regarding when and how the image capture device(s) 210 and the lighting element(s) 212 should operate. After an image is, or images are, captured by the image capture device(s) 210, the control circuit transmits the image, or images, to the remote processing system 216.

[0037] The remote processing system 216 receives the image(s) from the controller device 206 and performs an analysis on the product. For example, the analysis on the product can be an assessment of the image(s) of the product to determine a score for the product. In some embodiments, the remote processing system 216 operates as described m U.S. Provisional Application No. 62/509,945 for an automated inspection system.

[0038] While the discussion of FIG. 2 provides a discussion of a system for assessing products, the discussion of FIG. 3 describes example operations for assessing products.

[0039] FIG. 3 is a flow chart depicting example operations for assessing a product, according to some embodiments. The flow begins at block 302.

[0040] At block 302, a product is received. For example, the product can be received at a housing of an enclosure via a door. The enclosure includes a product holding surface, a lighting element, and an image capture device. The image capture device is configured to capture an image of the product. In the embodiment depicted in FIG. 3, the enclosure includes two image capture devices. Each of the image capture devices is configured to capture an image of the product from a different perspective (e.g., above, below, next to, etc. the product). In some embodiments, the image of the product is captured so that the product can be assessed. For example, the product can be assessed to determine its suitability for sale, as a sample to determine the suitability of a number of products, etc. The flow continues at block 304.

[0041] At block 304, an execution command is received. For example, the execution command can be received at a controller device that is separate from, or integrated with, the enclosure. The execution command instructs the enclosure to capture the image of the product. The execution command can be received from a user (e.g., user input device) or triggered automatically by the controller device (e.g., by placement of a product within the enclosure). In the latter, the controller device can“receive” the execution from itself in an automated fashion. The flow continues at block 306.

[0042] At block 306, a first image capture device is caused to capture a first image of a product. For example, the controller device can transmit a command to the first image capture device to capture the first image of the product. The first image of the product is captured from a first perspective. For example, the first image capture device may be above, next to, in front of, etc. the product. The flow continues at block 308. [0043] At block 308, a second image capture device is caused to capture a second image of the product. For example, the controller device can transmit a command to the second image capture device to capture the second image of the product. The second image of the product is captured from a second perspective. For example, the second image capture device may be above, next to, in front of, etc. the product. In one embodiment, the enclosure includes a transparent or translucent product holding surface and the second image capture device is located belo w the product holding surface. In such embodiments, the image of the product from the second perspective is captured through the product holding surface. The flow continues at block 310.

[0044] At block 310, images are transmitted. For example, the controller device can transmit the images to a remote processing system. The remote processing system can use the images of the product to assess the product, as described in U.S. Provisional Application No. 62/509,945 for an automated inspection system.

[0045] In some embodiments, an enclosure for use in assessing products comprises a housing, wherein the housing includes a door configured to allow placement of a product within the housing, a product holding surface, wherein the product holding surface is located within the housing, wherein the product holding surface allows pictures to be taken through the product holding surface, wherein the product holding surface divides the housing into a first portion and a second portion, and wherein the product holding surface is configured to support the product, a first image capture device, wherein the first image capture device is located within the first portion of the housing, and wherein the first image capture device is configured to capture an image of the product from a first perspective, a second image capture device, wherein the second image capture device is located within the second portion of the housing, wherein the second image capture device is configured to capture an image of the product from a second perspective, and wherein the image of the product from the second perspective is captured through the product holding surface, and a lighting element, wherein the lighting element is located within the housing, and wherein the lighting element is configured to provide lighting within the housing.

[0046] In some embodiments, a system for assessing products comprises an enclosure, wherein the enclosure includes a housing, wherein the housing includes a door configured to allow placement of a product within the housing, a product holding surface, wherein the product holding surface is located within the housing, and wherein the product holding surface is configured to support the product, a first image capture device, wherein the first image capture device is located within the housing, and wherein the first image capture device is configured to capture an image of the product from a first perspective, and a lighting element, wherein the lighting element is located within the housing, and wherein the lighting element is configured to provide lighting with the housing, a controller device, wherein the controller device is communicatively coupled to the first image capture device and the lighting element, and wherein the controller device includes a user input device, wherein the user input device is configured to receive an execution command, and a control circuit, wherein the control circuit is configured to receive, from the user input device, the execution command, m response to receipt of the execution command, control the first image capture device and the lighting element, and transmit, to a remote processing system, an image of the product captured by the first image capture device, the remote processing system, wherein the remote processing system is communicatively coupled to the controller device, and wherein the remote processing system is configured to receive, from the controll er device, the image of the product captured by the first image capture device, and perform, based on the image of the product captured by the first image capture device, an analysis on the product

[0047] In some embodiments, an apparatus, and a corresponding method performed by the apparatus, comprises receiving, in an enclosure, a product, wherein the enclosure includes a product holding surface that creates a first portion of the enclosure and a second portion of the enclosure, a first image capture device located in the first portion of the enclosure and second image capture device located in a second portion of the enclosure, wherein the first image capture device is configured to capture an image of the product from a first perspective, wherein the second image capture device is configured to capture an image of the product from a second perspective, and wherein the image of the product from the second perspective is captured through the product holding surface, receiving, via a controller device, an execution command, causing, by the controller device, the first image capture device to capture the image of the product from the first perspective, causing, by the controller device, the second image capture device to capture the image of the product from the second perspective, and transmitting, by the controller device to a remote processing system for analysis, the image of the product from the first perspective and the image of the product from the second perspective.

j 0048J Those skilled in the art will recognize that a wide variety of other modifications, alterations, and combinations can also be made with respect to the above described embodiments without departing from the scope of the invention, and that such modifications, alterations, and combinations are to be viewed as being within the ambit of the inventive concept.