Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
PRODUCT IMAGE CLASSIFICATION
Document Type and Number:
WIPO Patent Application WO/2022/170011
Kind Code:
A1
Abstract:
A method includes retrieving, by a processor in an image classification system, a plurality of product images from a memory. A first image classifier is applied to a first of the plurality of product images. The first of the plurality of product images is associated with a first category. A second image classifier is applied to a second of the plurality of product images. The second of the plurality of product images is associated with a second category. A first result of the first image classifier for the first of the plurality of product images is stored in the memory. A second result of the second image classifier for the second of the plurality of product images is stored in the memory.

Inventors:
AFSHAR ESTELLE (US)
XU TIANLONG (US)
YU LE (US)
WANG YUANBO (US)
WHITE JAMES MORGAN (US)
Application Number:
PCT/US2022/015173
Publication Date:
August 11, 2022
Filing Date:
February 04, 2022
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
HOME DEPOT INT INC (US)
International Classes:
G06T7/11; G06T7/194
Foreign References:
US20200279008A12020-09-03
US20120016892A12012-01-19
US20190130214A12019-05-02
US20170076225A12017-03-16
Attorney, Agent or Firm:
SHARP, Ryan D. et al. (US)
Download PDF:
Claims:
CLAIMS

What is claimed is:

1. A method, comprising: retrieving, by a processor in an image classification system, a plurality of product images from a memory; applying a first image classifier to a first of the plurality of product images, wherein the first of the plurality of product images is associated with a first category; applying a second image classifier to a second of the plurality of product images, wherein the second of the plurality of product images is associated with a second category; storing a first result of the first image classifier for the first of the plurality of product images; and storing a second result of the second image classifier for the second of the plurality of product images.

2. The method of claim 1, wherein the first category and the second category are different.

3. The method of claim 1, comprising applying the second image classifier to a third of the plurality of product images, wherein the third of the plurality of product images is associated with a third category; and storing a third result of the second image classifier for the third of the plurality of product images.

4. The method of claim 1, wherein the first image classifier is a category-specific image classifier associated with the first category.

5. The method of claim 1, wherein the second image classifier is a generic image classifier.

6. The method of claim 1, wherein applying the first image classifier to a first of the plurality of product images includes applying the first image classifier to the first of the plurality of product images and applying a fourth image classifier to the first of the plurality of product images; wherein the first result is based on the first image classifier and the fourth image classifier.

7. The method of claim 1, comprising determining a category of each of the plurality of product images.

8. A system, comprising: a processor and a memory, wherein the processor is configured to: retrieve a plurality of product images from the memory; apply a first image classifier to a first of the plurality of product images, wherein the first of the plurality of product images is associated with a first category; apply a second image classifier to a second of the plurality of product images, wherein the second of the plurality of product images is associated with a second category; stores a first result of the first image classifier for the first of the plurality of product images in the memory; and store a second result of the second image classifier for the second of the plurality of product images in the memory.

9. The system of claim 8, wherein the first category and the second category are different.

10. The system of claim 8, wherein the processor is configured to apply the second image classifier to a third of the plurality of product images, wherein the third of the plurality of product images is associated with a third category; and store a third result of the second image classifier for the third of the plurality of product images.

11. The system of claim 8, wherein the first image classifier is a category-specific image classifier associated with the first category.

12. The system of claim 8, wherein the second image classifier is a generic image classifier.

13. The system of claim 8, wherein the processor configured to apply the first image classifier to a first of the plurality of product images includes the processor configured to apply the first image classifier to the first of the plurality of product images and configured to apply a fourth image classifier to the first of the plurality of product images; wherein the first result is based on the first image classifier and the fourth image classifier.

14. The system of claim 8, wherein the processor is configured to determine a category of each of the plurality of product images.

15. A system, comprising: a server; and an image classification system, the image classification system comprising: a processor and a memory, wherein the processor is configured to: retrieve a plurality of product images from the memory; apply a first image classifier to a first of the plurality of product images, wherein the first of the plurality of product images is associated with a first category; apply a second image classifier to a second of the plurality of product images, wherein the second of the plurality of product images is associated with a second category; stores a first result of the first image classifier for the first of the plurality of product images in the memory; and store a second result of the second image classifier for the second of the plurality of product images in the memory.

16. The system of claim 15, wherein the server is configured to receive a captured image from a user computing device over a network.

18 The system of claim 16, wherein the server is configured to compute a visual similarity score between the captured image and the plurality of product images based on the first result and the second result. The system of claim 17, wherein the server is configured to select one of the plurality of product images having a highest visual similarity score with the captured image and output the selected one of the plurality of product images for display on a user computing device. The system of claim 15, wherein the processor is configured to determine a category of each of the plurality of product images. The system of claim 15, wherein the first image classifier is a category-specific image classifier and the second image classifier is a generic classifier.

19

Description:
PRODUCT IMAGE CLASSIFICATION

Field

[0001] This disclosure is directed generally to image classification. More specifically, this disclosure is directed to image type classification of product images for display via a user interface.

Background

[0002] Retail websites can include a plurality of product images and text related to a product available for purchase via the retail website. Retail websites can make a large number of products available for purchase. Each of the products can include multiple product images depicting different views of the products available for purchase. As a result, the retailer may have thousands or millions of images to manage in order to provide a user with the most effective product views.

Summary

[0003] In some embodiments, a method includes retrieving, by a processor in an image classification system, a plurality of product images from a memory. A first image classifier is applied to a first of the plurality of product images. The first of the plurality of product images is associated with a first category. A second image classifier is applied to a second of the plurality of product images. The second of the plurality of product images is associated with a second category. A first result of the first image classifier for the first of the plurality of product images is stored in the memory. A second result of the second image classifier for the second of the plurality of product images is stored in the memory.

[0004] In some embodiments, the first result may be a content label or a view label. In some embodiments, the first result can include a content label and a view label.

[0005] In some embodiments, the first image classifier can include a plurality of image classifiers. In some embodiments, a first of the plurality of image classifiers can predict a content label for the first of the plurality of product images. In some embodiments, a second of the plurality of image classifiers can predict a view label for the first of the plurality of product images. In some embodiments, one or more additional image classifiers can be included to predict other features of the first of the plurality of product images such as, but not limited to, color tone or the like. In some embodiments, a first of the plurality of image classifiers can calculate features that will be provided to a second of the plurality of image classifiers as input to predict the labels (content and view, or the like) for the first of the plurality of product images. In some embodiments, the first of the plurality of image classifiers can be a Siamese neural network. In some embodiments, the second of the plurality of image classifiers can implement machine learning such as, but not limited to, XGBoost.

[0006] In some embodiments, the second result may be a content label or a view label. In some embodiments, the second result can include a content label and a view label.

[0007] In some embodiments, the second image classifier can include a plurality of image classifiers. In some embodiments, a first of the plurality of image classifiers can predict a content label for the second of the plurality of product images. In some embodiments, a second of the plurality of image classifiers can predict a view label for the second of the plurality of product images. In some embodiments, one or more additional image classifiers can be included to predict other features of the second of the plurality of product images such as, but not limited to, color tone or the like. In some embodiments, a first of the plurality of image classifiers can calculate features that will be provided to a second of the plurality of image classifiers as input to predict the labels (content and view, or the like) for the second of the plurality of product images. In some embodiments, the first of the plurality of image classifiers can be a Siamese neural network. In some embodiments, the second of the plurality of image classifiers can implement machine learning such as, but not limited to, XGBoost.

[0008] In some embodiments, an image classification system includes a processor and a memory. In some embodiments, the processor is configured to retrieve a plurality of product images from the memory. The processor applies a first image classifier to a first of the plurality of product images. The first of the plurality of product images is associated with a first category. The processor applies a second image classifier is applied to a second of the plurality of product images. The second of the plurality of product images is associated with a second category. The processor stores a first result of the first image classifier for the first of the plurality of product images in the memory. The processor stores a second result of the second image classifier for the second of the plurality of product images in the memory.

[0009] In some embodiments, a system includes a server; and an image classification system. The image classification system includes a processor and a memory. In some embodiments, the processor is configured to retrieve a plurality of product images from the memory. The processor applies a first image classifier to a first of the plurality of product images. The first of the plurality of product images is associated with a first category. The processor applies a second image classifier is applied to a second of the plurality of product images. The second of the plurality of product images is associated with a second category. The processor stores a first result of the first image classifier for the first of the plurality of product images in the memory. The processor stores a second result of the second image classifier for the second of the plurality of product images in the memory.

Brief Description Of The Drawings

[0010] References are made to the accompanying drawings that form a part of this disclosure and that illustrate embodiments in which the systems and methods described in this Specification can be practiced.

[0011] FIG. 1 is a diagrammatic view of an example system for operating an improved image classification system, according to some embodiments.

[0012] FIG. 2 is a flowchart illustrating an example method for predicting labels for a plurality of product images, according to some embodiments.

[0013] FIG. 3 is a diagrammatic view of an example user computing environment, according to some embodiments.

[0014] Like reference numbers represent the same or similar parts throughout.

Detailed Description

[0015] In online retail (e.g., retail websites), products can be presented to a user in a combination including visual media (e.g., one or more product images, videos, or any combination thereof) and text descriptions of the products. The visual media (i.e., the one or more product images, videos, or any combination thereof) is increasingly important in presenting the products to potential customers. A retailer can have hundreds, thousands, or millions of products available for purchase. Each product available for purchase can include one or more product images and one or more videos. As a result, the retailer may store millions of product images, videos, or any combination thereof. Retailers may display several product images and/or videos of a product to provide a customer a more comprehensive understanding of the product through a website or an application on, for example, a mobile device. It is important for the retailer to be able to identify and select the most appropriate product images for the customer to increase accuracy of visual search results and to increase overall customer engagement through the website or application.

[0016] Manual selection of the most relevant product image to enable a specific customer experience (e.g. inspiration, advertisement, comparison, etc.) is typically not possible given the number of products and product images. Even when a product is known, product images can be described using different aspects of the image, such as, but not limited to, the image content (room scene, white background, line art, etc.), the product view (front-facing, angled views, etc.), the annotations, etc. These descriptors of the product images are useful in selecting the best product image for an application.

[0017] Embodiments of this disclosure include an image type ontology to define visual concepts and organize their relationships. Based on the image type ontology, a series of image classifiers can be trained to predict the labels (e.g., content, view, etc.) that define an image type within the image type ontology. The image classifiers can include a combination of computer vision approaches (e.g., feature engineering) and deep learning approaches (e.g., fine-tuned convolutional neural networks with Siamese network triplet loss). In some embodiments, the prediction accuracies can be improved by applying an active learning approach to select highly informative training data.

[0018] In some embodiments, verification test results indicate that accuracies of the systems and methods described herein can range from 84% to 98%.

[0019] In some embodiments, the classification process can be automated and executed on a periodic basis (e.g., weekly or the like). In some embodiments, the classification process can label millions of images, in parallel, in a matter of hours.

[0020] Examples within this description may generally be focused on product images (e.g., for products such as home improvement products or the like). It is to be appreciated that the systems and methods described herein can be applied in other applications in which a number of images are being utilized, with a selection of a subset of those images being displayed to a user. Examples include, but are not limited to, products other than home improvement products, travel websites displaying various views of rooms or properties for rent, or the like.

[0021] FIG. 1 is a diagrammatic view of an example system 10 for operating an improved image classification system, according to some embodiments. In some embodiments, the system 10 can be used to identify a best image for a selected application. In some embodiments, the selected application can include, but is not limited to, creation of line art imagery, recommendations of visually similar products, execution of a visual search query, any combination thereof, or the like.

[0022] The system 10 can include a user computing device 12, a server 14, and an image classification system 16. The user computing device 12, the server 14, and the image classification system 16 can be electronically communicable via a network 18. It is to be appreciated that the illustration is an example and that the system 10 can vary in architecture. Generally, the system 10 will include more than one of the user computing device 12 in communication with the server 14 via the network 18.

[0023] The user computing device 12 can include a camera 20. In some embodiments, the user computing device 12 can include an application 22 and a web browser 24. In some embodiments, the application 22 or the web browser 24 can be used to submit a captured image from the camera 20 to the server 14 for utilization in, for example, conducting a visual search to identify images within a product image library that are visually similar (e.g., a visual search). In some embodiments, the application 22 or the web browser 24 can include an interface for displaying one or more product images to a user, such as product images returned from the server 14 to the user computing device 12 in response to a search query.

[0024] In some embodiments, the camera 20 may be capable of capturing photographs, video, or combinations thereof. In some embodiments, the captured image can be a photograph or a video of a product a user would like to use as an input to a search query (e.g., a visual search). In some embodiments, the camera 20 can capture an image without the user performing an action (e.g., without pressing a button) to cause the image to be captured. As used herein, a “captured image” is an image that has been captured by the user computing device 12. In some embodiments, when the user captures a video, a frame of the video may be used as a single image to represent the “captured image.”

[0025] In some embodiments, the camera 20 can be physically separate from the user computing device 12, but electronically communicable with the user computing device 12.

[0026] Examples of the user computing device 12 include, but are not limited to, a personal computer (PC), a laptop computer, a mobile device (e.g., a smartphone, a personal digital assistant (PDA), a tablet-style device, etc.), a wearable mobile device (e.g., a smart watch, a head wearable device, etc.), or the like. The user computing device 12 generally includes a display and an input. Examples of the display for the user computing device 12 include, but are not limited to, a monitor connected to a PC, a laptop screen, a mobile device screen, a tablet screen, a wearable mobile device screen, or the like. Examples of the inputs for the user computing device 12 include, but are not limited to, a keyboard, a mouse, a trackball, a button, a voice command, a proximity sensor, a touch sensor, an ocular sensing device for determining an input based on eye movements (e.g., scrolling based on an eye movement), suitable combinations thereof, or the like. The user computing device 12 can include aspects that are the same as, or similar to, FIG. 3 below.

[0027] The server 14 may be in electronic communication with the user computing device 12 via the network 18. In some embodiments, the server 14 can be a web server that is capable of providing a website for access by the user computing device 12. For example, in some embodiments, the server 14 may serve an e-commerce website. In some embodiments, the website served by the server 14 may include a search interface for receiving search queries, such as visual search queries (e.g., based on an image captured by a user). In some embodiments, the server 14 may be communicable with the image classification system 16 to identify one or more product images similar to the captured image from the user.

[0028] The server 14 can be electronically communicable with the image classification system 16.

[0029] The image classification system 16 can be configured to predict labels that define product images that can be used (e.g., by the server 14 in rendering a website for a user) to provide a best product image to a user, depending upon how the product image is being used for the user.

[0030] The image classification system 16 can include a processor 26 and a non-transitory, computer-readable memory 28. The memory 28 can store instructions that, when executed by the processor 26, cause the image classification system 16 to perform one or more of the steps, processes, or methods of this disclosure.

[0031] The image classification system 16 can include visual media 30. In some embodiments, the visual media 30 can include a plurality of product images, a plurality of videos, or any combination thereof. In some embodiments, the visual media 30 includes product images, product videos, or any combination thereof. In some embodiments, the image classification system 16 can include product information 32. The product information 32 can include product types for respective product images.

[0032] The image classification system 16 can be configured to predict one or more labels of the product images in the visual media 30. The image classification system 16 can use a plurality of image classifiers 34 to predict the labels of the product images in the visual media 30. In some embodiments, the plurality of image classifiers 34 can iteratively predict a content label or a view label for the product images in the visual media 30. In some embodiments, the plurality of image classifiers 34 can predict a content label and a view label for the product images in the visual media 30.

[0033] In some embodiments, each of the product images and the videos in the visual media 30 can be labeled based on a content type, a view type, or any combination thereof. The predicted labels of the visual media 30 can be stored for each of the product images and the product videos to describe the content within the product image and the type of view within the product image. The predicted labels of the visual media 30 can generally define concepts that are used to characterize a product image and organize relationships between product images. The predicted labels are important to selecting a best image for a particular customer experience or for inputting an appropriate product image into a search or other image processing algorithm.

[0034] In some embodiments, the content type can include, but is not limited to, closeup, swatch/sample, set, prop, packaged, silo, lifestyle, annotation, or any combination thereof. In some embodiments, a content type can include sub-types as well. For example, in some embodiments, the closeup type can include sub-types closeup-white background and closeup- non-white background. In some embodiments, the swatch/sample type can include sub-types of can, smear, brand, and blob. In some embodiments, the set content type can include setparts, set-full (non-identical parts), and set-full (identical parts). In some embodiments, the silo content type can include sub-types white background and non-white background. In some embodiments, the lifestyle content type can include sub-types lifestyle-product, lifestyle-limited scene, and lifestyle-full scene. In some embodiments, the annotation content type can include sub-types infographic and dimension. In some embodiments, a content type may not have any sub-types.

[0035] In some embodiments, the view type can include, but is not limited to, distance, curl, vertically angled, horizontally angled, orientation, or any combination thereof. In some embodiments, a view type can include sub-types as well. For example, in some embodiments, the distance type can include sub-types near and far. In some embodiments, the curl type can include sub-types rolled, stacked, and folded. In some embodiments, the vertically aligned type can include sub-types 90° (top), 270° (bottom), 45°/135°, and other. In some embodiments, the horizontally aligned content type can include sub-types 0° (front), angled- right, angled-left, 90° (left), 270° (right), and 180° (back). In some embodiments, the orientation content type can include sub-types erect and flat.

[0036] The image classification system 16 can be configured to receive a plurality of product images as an input and to utilize the plurality of image classifiers 34 to predict labels for the plurality of product images within a content type, a view type, or any combination thereof. The image classification system 16 can be configured to utilize a product type that is associated with the product image to apply selected classifiers from the plurality of image classifiers 34 that is specifically trained for usage with that particular product type. For example, a product of type “appliance” can be configured to utilize one or more of the plurality of image classifiers 34 that is configured to identify features specific to product images of appliances. As such, the plurality of image classifiers 34 can be utilized in a manner that a category-specific image classifier is applied to certain product types. In some embodiments, a generic (e.g., not product type specific) image classifier from the plurality of image classifiers 34 can be used for product types that do not include a specifically trained image classifier of the plurality of image classifiers 34.

[0037] In some embodiments, the image classification system 16 can be configured to categorize all product images within the visual media 30 on a periodic basis such as, but not limited to, daily, weekly, monthly, or the like. In some embodiments, running weekly may be preferable as the visual media 30 may not change much on a daily basis. In some embodiments, the image classification system 16 can be configured to predict labels for all product images during an initial execution, and then categorize the delta on a periodic basis. That is, after an initial execution, the image classification system 16 can predict labels for the product images which are newly identified in a subsequent execution. If changes are made to the plurality of image classifiers 34, then the image classification system 16 can again execute on all product images within the visual media 30.

[0038] In some embodiments, the plurality of image classifiers 34 can include categoryspecific image classifiers 36 (e.g., specific to a product type) or generic image classifiers 38 (e.g., not specific to a product type).

[0039] In some embodiments, category-specific image classifiers 36 can be trained using relatively smaller, human-labeled datasets sampled from categories of products that share similar shapes and can be designed to obtain higher accuracies for more specific views. Suitable product categories for the category-specific image classifiers 36 include, but are not limited to, chairs (e.g., dining chairs, office chairs, patio chairs, or the like). Category-specific image classifiers 36 can be trained using a data set that includes, for example, 150 to 250 instances per category.

[0040] In some embodiments, the generic image classifiers 38 can be trained on a relatively larger human-labeled dataset (e.g., 40,000 to 60,000 images) that are sample images across all product categories (to be robust for variation of product type).

[0041] In some embodiments, the plurality of image classifiers 34 are convolutional neural networks (CNNs). In some embodiments, the plurality of image classifiers 34 can be pretrained models. In some embodiments, active learning can be used to start with a small amount of cleaned data and iteratively train the CNN, at each iteration, selecting one or more samples, labeling the samples by human annotators, and adding the annotated samples back into the original training data at the next iteration.

[0042] In some embodiments, the plurality of image classifiers 34 can include a first image classifier to predict a content label for the product images. In some embodiments, a second image classifier can predict a view label for the product images. In some embodiments, one or more additional image classifiers can be included to predict other features of the product images such as, but not limited to, color tone or the like. In some embodiments, the first image classifier can calculate features that will be provided to the second image classifier as input to predict the labels (content and view, or the like) for the product images. In some embodiments, the first image classifier can be a Siamese neural network. In some embodiments, the second image classifier can implement machine learning such as, but not limited to, XGBoost. It is to be appreciated that the usage of the plurality of image classifiers 34 can be iterative and thus can include more than two image classifiers, each specifically configured to predict a different feature of the product images.

[0043] It is to be appreciated that various roles of the server 14 and the image classification system 16 can be distributed among the devices in the system 10. In some embodiments, the image classification system can be on board the server 14.

[0044] In some embodiments, the network 18 can be representative of the Internet. In some embodiments, the network 18 can include a local area network (LAN), a wide area network (WAN), a wireless network, a cellular data network, combinations thereof, or the like. [0045] FIG. 2 is a flowchart illustrating an example method 50 for predicting labels for a plurality of product images, according to some embodiments. The method 50 can utilize the image classification system 16 (FIG. 1). In some embodiments, the method 50 can be performed on a periodic basis such as, but not limited to, weekly.

[0046] At block 52, the image classification system 16 can retrieve image data from the visual media 30. In some embodiments, the image data can include a product type associated with a respective product image. In some embodiments, the image data can include all product images within the visual media 30. In some embodiments, the image data can include all product images newly added since the last time the method 50 was performed. In some embodiments, if no product images were added since the last time the method 50 was performed, the method 50 may be stopped and then run again at the next period (e.g., the following week).

[0047] At block 54, the image classification system 16 applies a respective image classifier (e.g., of the plurality of image classifiers 34 (FIG. 1) to the image data. For example, the image classification system 16 may apply a different one of the plurality of image classifiers 34 to different product images depending upon a product type associated with the product image. For example, a first image classifier may be applied to a first image in a first category and a second image classifier to a second image in a second category. In some embodiments, the image classification system 16 can apply a plurality of image classifiers to a product image. For example, the first image classifier can include a plurality of image classifiers. Accordingly, the plurality of image classifiers can be applied to the first image in the first category. In some embodiments, the second image classifier can similarly include a plurality of image classifiers. In some embodiments, the second image classifier can be applied to a third image in a third category that is different from the second category. In such embodiments, the first image classifier may be a category-specific classifier whereas the second image classifier is a generic image classifier.

[0048] At block 56, the image classification system 16 stores the results from the image classification at block 54. In some embodiments, the results can include a plurality of labels defining a content type and a view type of the plurality of product images.

[0049] In some embodiments, the image classification system 16 can return an output to a user via the server 14 and the user device 12. Examples of returning an output are described below. [0050] In some embodiments, the stored results from block 56 can be used to create line art imagery, according to some embodiments. Line art imagery includes a product image having dimensions overlaid on the product image. In such embodiments, a product image can be retrieved from the visual media 30 for a particular product. For example, the product can be an area rug. The retrieval may be limited to product images for the particular area rug having a given content type and view type (e.g., labels). As a result, using the stored results of the image classification by the image classification system 16, one or more product images for the area rug that are silo-front images can be selected. These image content types and view types may be relatively simpler for overlaying dimensions than other content types and view types. In some embodiments, the overlaid image can be returned as an output to the user for display by the user device 12.

[0051] In some embodiments, the stored results can be used to make a recommendation to a user of visually similar products to the product currently being viewed by a user. In such embodiments, a pairwise visual similarity score (e.g., a cosine similarity score) can be computed for the product image as received relative to other product images. To improve the likelihood of identifying visually similar products, the images selected for computing the pairwise visual similarity score can be based on a content type and view type of the product image being viewed by the user and the content type and view type of the images of other products so that similar content types and views are being used in computing the pairwise visual similarity score. Product images having a highest visual similarity score can be presented for display to the user. In some embodiments, product images having the top 5 to 10 visual similarity scores can be used for display to the user. In some embodiments, product images of the visually similar products can be returned as an output to the user for display by the user device 12.

[0052] In some embodiments, the stored results can be used to perform a query based on an image from a user. In such embodiments, the server 14 can receive an image from a user device (e.g., an image of a product captured using a camera on a mobile device). An object detection model can be applied to locate and predict labels for a product of interest within the captured image. The captured image can be cropped to focus on the product of interest within the captured image. Candidate images can be identified based on the predicted labels. Visual similarity scores (e.g., a cosine similarity score) can be computed for the captured image relative to candidate images to select a highest visual similarity score for returning to the user computing device 12 for display. In some embodiments, product images of the search results can be returned as an output to the user for display on the user device 12.

[0053] Similar to the visual search, in some embodiments, the stored results can be used to identify complementary products.

[0054] FIG. 3 is a diagrammatic view of an illustrative computing system that includes a general-purpose computing system environment 240, such as a desktop computer, laptop, smartphone, tablet, or any other such device having the ability to execute instructions, such as those stored within a non-transient, computer-readable medium. Furthermore, while described and illustrated in the context of a single computing system 240, those skilled in the art will also appreciate that the various tasks described hereinafter may be practiced in a distributed environment having multiple computing systems 240 linked via a local or wide- area network in which the executable instructions may be associated with and/or executed by one or more of multiple computing systems 240.

[0055] In its most basic configuration, computing system environment 240 typically includes at least one processing unit 242 and at least one memory 244, which may be linked via a bus 246. Depending on the exact configuration and type of computing system environment, memory 244 may be volatile (such as RAM 250), non-volatile (such as ROM 248, flash memory, etc.) or some combination of the two. Computing system environment 240 may have additional features and/or functionality. For example, computing system environment 240 may also include additional storage (removable and/or non-removable) including, but not limited to, magnetic or optical disks, tape drives and/or flash drives. Such additional memory devices may be made accessible to the computing system environment 240 by means of, for example, a hard disk drive interface 252, a magnetic disk drive interface 254, and/or an optical disk drive interface 256. As will be understood, these devices, which would be linked to the system bus 246, respectively, allow for reading from and writing to a hard drive 258, reading from or writing to a removable magnetic disk 260, and/or for reading from or writing to a removable optical disk 262, such as a CD/DVD ROM or other optical media. The drive interfaces and their associated computer-readable media allow for the nonvolatile storage of computer readable instructions, data structures, program modules and other data for the computing system environment 240. Those skilled in the art will further appreciate that other types of computer readable media that can store data may be used for this same purpose. Examples of such media devices include, but are not limited to, magnetic cassettes, flash memory cards, digital videodisks, Bernoulli cartridges, random access memories, nanodrives, memory sticks, other read/write and/or read-only memories and/or any other method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Any such computer storage media may be part of computing system environment 240.

[0056] Several program modules may be stored in one or more of the memory/media devices. For example, a basic input/output system (BIOS) 264, containing the basic routines that help to transfer information between elements within the computing system environment 240, such as during start-up, may be stored in ROM 248. Similarly, RAM 250, hard drive 258, and/or peripheral memory devices may be used to store computer executable instructions comprising an operating system 266, one or more applications programs 268 (such as the search engine or search result ranking system disclosed herein), other program modules 270, and/or program data 272. Still further, computer-executable instructions may be downloaded to the computing environment 240 as needed, for example, via a network connection.

[0057] An end-user may enter commands and information into the computing system environment 240 through input devices such as a keyboard 274 and/or a pointing device 276. While not illustrated, other input devices may include a microphone, a joystick, a game pad, a scanner, etc. These and other input devices would typically be connected to the processing unit 242 by means of a peripheral interface 278 which, in turn, would be coupled to bus 246. Input devices may be directly or indirectly connected to processor 242 via interfaces such as, for example, a parallel port, game port, firewire, or a universal serial bus (USB). To view information from the computing system environment 240, a monitor 280 or other type of display device may also be connected to bus 246 via an interface, such as via video adapter 282. In addition to the monitor 280, the computing system environment 240 may also include other peripheral output devices, not shown, such as speakers and printers.

[005S] The computing system environment 240 may also utilize logical connections to one or more computing system environments. Communications between the computing system environment 240 and the remote computing system environment may be exchanged via a further processing device, such a network router 292, that is responsible for network routing. Communications with the network router 292 may be performed via a network interface component 284. Thus, within such a networked environment, e.g., the Internet, World Wide Web, LAN, or other like type of wired or wireless network, it will be appreciated that program modules depicted relative to the computing system environment 240, or portions thereof, may be stored in the memory storage device(s) of the computing system environment 240.

[0059] The computing system environment 240 may also include localization hardware 286 for determining a location of the computing system environment 240. In embodiments, the localization hardware 286 may include, for example only, a GPS antenna, an RFID chip or reader, a Wi-Fi antenna, or other computing hardware that may be used to capture or transmit signals that may be used to determine the location of the computing system environment 240.

[0060] The computing environment 240, or portions thereof, may include one or more of the user computing device 12 and the image classification system 16 of FIG. 1, in embodiments.

[0061] The systems and methods described herein can advantageously ensure that B2B interactions include flexible and easy to manage security policies that are customizable by the businesses and the users accessing the computer systems of another business (e.g., a retail seller).

[0062] Examples of computer-readable storage media include, but are not limited to, any tangible medium capable of storing a computer program for use by a programmable processing device to perform functions described herein by operating on input data and generating an output. A computer program is a set of instructions that can be used, directly or indirectly, in a computer system to perform a certain function or determine a certain result. Examples of computer-readable storage media include, but are not limited to, a floppy disk; a hard disk; a random access memory (RAM); a read-only memory (ROM); a semiconductor memory device such as, but not limited to, an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), Flash memory, or the like; a portable compact disk read-only memory (CD-ROM); an optical storage device; a magnetic storage device; other similar device; or suitable combinations of the foregoing.

[0063] In some embodiments, hardwired circuitry may be used in combination with software instructions. Thus, the description is not limited to any specific combination of hardware circuitry and software instructions, nor to any source for the instructions executed by the data processing system.

[0064] The terminology used herein is intended to describe embodiments and is not intended to be limiting. The terms “a,” “an,” and “the” include the plural forms as well, unless clearly indicated otherwise. The terms “comprises” and/or “comprising,” when used in this Specification, specify the presence of the stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, and/or components.

[0065] It is to be understood that changes may be made in detail, especially in matters of the construction materials employed and the shape, size, and arrangement of parts without departing from the scope of the present disclosure. This Specification and the embodiments described are examples, with the true scope and spirit of the disclosure being indicated by the claims that follow.