ESTIMATE FOR AN ASSET BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates to devices, computer-implemented methods, and systems for estimating the refinishing of an asset.

2. Background and Relevant Art

Modern coatings provide several important functions in industry and society. Coatings can protect a coated material from corrosion, such as rust. Coatings can also provide an aesthetic function by providing a particular color and/or texture to an object. For example, most assets such as automobiles are coated using paints and various other coatings in order to protect the metal body of the automobile from the elements and also to provide aesthetic visual effects.

In view of the wide-ranging uses for different coatings, it is often necessary to identify a target coating composition. For instance, it might be necessary to identify a target coating composition on an asset that has sustained damage (e.g., has been in an accident). However, due to the nature of complex mixtures within coatings, it is sometimes difficult to formulate, identify, and/or search for acceptable matching formulations and/or pigmentations. Even in the case where a suitable match can be identified, frequently the coating on the asset will have aged or denatured in such a way that recoating the damaged portion with the original coating still creates a mismatch in color upon later inspection.

In general, paint manufacturers develop a large range of coatings with different colors, color variations, color effects, and the like, whether for the original automotive companies, or independently, such as to refinish assets painted with coatings from another manufacturer. The sheer volume and range of colors and coatings developed by paint manufacturers frequently provides a suitable overall color match with most damaged assets where basic color comparison on a display screen is the only consideration. Close inspection after application, however, frequently reveals small deviations in the colors that may not be apparent to the repair operator (e.g., auto-body operator), relevant front office manager, or the asset owner when looking at a color chip or computer display screen during the estimation process.

For example, there may be differences owing to the color or physical characteristics of the underbody coating, or other effect pigments. Along these lines, flake, metallic, or other gonioapparent pigments added to the formulation can provide a mixed paint with a completely different overall color effect in certain lighting conditions than the same mixture of tint and base paint without the effect pigment. Moreover, while some coatings historically require multiple layers or added ingredients to achieve a particular effect, a new version of the coating may be made using a different technology that allows for the same visible effect but with fewer ingredients. These differences in cost and makeup of coatings of certain colors that at first glance appear to be identical can create significant cost estimation challenges for operators and/or front office workers of an asset repair facility, such as an auto-body shop. In particular, asset repair facilities can incur significant financial harm and waste inefficiency when an estimator underestimates the true cost of obtaining a particular color for refinishing an asset, and discovers after application that a carefully matched color has a very different look in daylight. A similar harm can occur when the asset repair facility inadvertently uses a more expensive alternative of a color when the asset owner, or a third-party payor (e.g., insurance) has not agreed to cover the more expensive variety, or the cost of replacing an incorrect color match with the correct one.

Thus, there are many opportunities for new methods and systems that improve the efficiency and speed of identifying and estimating coating applications, not to mention environmental costs of waste mitigation.

BRIEF SUMMARY

The present invention provides systems, methods, and computer program products described for efficiently and accurately estimating coating formulations (also referred to as paints herein) in refinish of an asset, in part by enabling more realistic and accurate color matches. For example, the present invention comprises computerized systems employing methods for providing an accurate, just-in-time estimate for an asset to be repainted. The present invention also comprises computerized methods and systems employing machine learning algorithms in connection with 3D rendering techniques to enable accurate coating match and selection for assets in need of refinishing.

For example, a computer-implemented method for providing an accurate, just-in-time estimate of an asset to be repainted can include providing a graphical user interface comprising one or more selectable elements for entering information about a paint job, the paint job corresponding to repair of an asset that has been damaged. The method can also include receiving user input via the one or more initial input fields, wherein the received user input includes: (i) a digital scan of the asset by a hand-held instrument; (ii) a digital image taken of a portion of the asset to be repainted; and (iii) a user time estimate that corresponds to an amount of time needed to repaint the asset. In addition, the method can include retrieving from a database a plurality of closest match colors corresponding to the spectrophotometer data. Furthermore, the method can include displaying on the graphical user interface a plurality of selectable color tiles corresponding to the spectrophotometer data, wherein at least one of the selectable color tiles includes a cost indicator. Upon selection of any of the selectable color tiles, the method still further includes displaying on the graphical user interface a 3D image of a color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from a light source. Yet still further, the method can include, upon receiving a final color selection of the selectable color tiles, displaying on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a cost of repainting the asset based on a volume and cost of paint determined from the received final color selection and received user input via the one or more initial input fields.

An additional or alternative computer-implemented method for providing an accurate, just-in-time estimate of an asset to be repainted can include receiving user input via one or more initial input fields displayed on a graphical user interface, wherein the received user input includes: (i) a digital scan of a color by a hand-held instrument; (ii) a digital image taken of a portion of the asset to be repainted; and (iii) a user time estimate that corresponds to an amount of time needed to repaint the asset. The method can also include using one or more machine learning algorithms to automatically determine an area of the asset to be repainted, and displaying the digital image with one or more lines drawn around the determined area of the asset. In addition, the method can include receiving one or more user inputs that adjusts the lines drawn on the determined area, thereby providing an adjusted area of the asset to be repainted. Furthermore, the method can include retrieving from a database a plurality of closest match colors corresponding to results of the digital scan.

Still further, the method can include displaying on the graphical user interface a plurality of selectable color tiles corresponding to results of the digital scan, wherein at least one of the selectable color tiles comprises a premium color tile displaying a premium color and a corresponding text indicator of cost status. Yet still further, the method can include, upon selection of the premium color tile, displaying on the graphical user interface a 3D image of the asset showing a repaired form of the adjusted area that has been painted with the premium color. In this case, the 3D image shows different color effects at different angles of the displayed premium color from a single light source. In addition, the method can include, upon receiving a final color selection of the premium color, displaying on the graphical user interface a final estimate to refinish the asset. In this case, the final estimate includes a list of parts needed to repair the asset, and a cost of repainting the asset based on a volume of paint determined from the digital image and the user time entry.

Yet another additional or alternative computer-implemented method for providing an accurate, just-in-time estimate of an asset that has been damaged to be repainted using a computer system, can include obtaining color data associated with the asset by a hand-held scanning instrument; taking a digital image of a portion of the asset to be repainted by an image capture element; transferring the obtained color data and digital image to the computer system; receiving user input via a graphical user interface of the computer system comprising one or more selectable elements for entering information about a paint job corresponding to a repair of the asset, wherein the received user input includes a user time estimate that corresponds to an amount of time needed to repaint the asset; optionally automatically determining, by analysis of the digital image through the computer system, an area of the asset to be repainted, and displaying, by the computer system, the digital image with one or more lines drawn around the determined area of the asset, wherein the drawn lines are adjustable by a user to provide an adjusted area of the asset to be repaired; the method further comprising: retrieving, by the computer system, from a database a plurality of closest match colors corresponding to the obtained color data associated with the asset; displaying, by the computer system, on the graphical user interface a plurality of selectable color tiles corresponding to the retrieved closest match colors, wherein at least one of the selectable color tiles includes a cost indicator; upon selection of any of the selectable color tiles, displaying, by the computer system, on the graphical user interface (a) a 3D image of a color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from one or more light sources or (b) a 3D image of the asset showing a repaired form of the determined and optionally adjusted area of the asset to be repainted that has been painted with the color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from a single light source; and upon receiving respective user input, displaying, by the computer system, on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a cost of repainting the asset based on a volume and cost of paint determined from a particular color of the selectable color tiles finally selected by the user and the received user input about the paint job.

Additional features and advantages will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice. The features and advantages may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims and aspects. These and other features will become more fully apparent from the following description and appended claims, or may be learned by the practice of the examples as set forth hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above recited and other advantages and features can be obtained, a more particular description will be rendered by reference to specific examples thereof, which are illustrated in the appended drawings. Understanding that these drawings are merely illustrative and are not therefore to be considered to be limiting of its scope, the present invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which: Figure 1 A illustrates an overview schematic of a system in which a plurality of systems coordinate color data and selection with a remote color database over a network;

Figure IB illustrates a schematic of one of the local systems of Figure 1A, further illustrating components and modules implemented between a corresponding client and server;

Figure 1C illustrates a schematic in which an end user interacts with the components shown in Figures 1A-1B to process an asset;

Figure 2A illustrates a schematic in which a user provides various estimates and color selections pursuant to refinishing the asset;

Figure 2B illustrates a schematic in which the user interacts with a display of the asset in repaired form;

Figure 3 illustrates a user interface that shows the calculations made upon completion of user modifications, and selection of an appropriate color;

Figure 4 illustrates a flowchart of a method according to the present invention comprising a series of acts for providing an accurate just in time estimate of an asset to be repainted; and Figure 5 illustrates a flowchart of an additional or alternative method according ot the present invention for providing an accurate just in time estimate of an asset to be repainted.

DETAILED DESCRIPTION

The present invention provides systems, methods, and computer program products described for efficiently and accurately estimating coating formulations (also referred to as paints herein) in refinish of an asset, in part by enabling more realistic and accurate color matches. For example, the present invention comprises computerized systems employing methods for providing an accurate, just-in-time estimate for an asset to be repainted. The present invention also comprises computerized methods and systems employing machine learning algorithms in connection with 3D rendering techniques to enable accurate coating match and selection for assets in need of refinishing.

For example, the present invention can provide a number of benefits to end users, such as operators of an asset repair facility (e.g., auto-body shop), front office workers managing a bidding system, or even asset owners looking to select an appropriate color at minimal cost. Such benefits can include improved and more efficient color matching used to refinish an asset, such as by enabling better, more realistic matching and interactive display of colors. The benefits can further include improved and more efficient pricing and estimation of asset refinish projects with accurately selected colors, thereby avoiding costly mistakes that necessitate further repair and repainting. One will appreciate that such efficiencies can have large, positive impacts on the environment through waste mitigation, such as by, at least in part, minimizing the amount of materials needed for any particular project. For example, Figure 1A illustrates an overview schematic of a system that can be used to practice the computer-implemented methods as described herein in which a plurality of computer systems coordinate color data with a remote color manager over a network. In particular, Figure 1A illustrates an environment in which a plurality of computer systems (or “systems”) 100(a-c) comprising local color servers 120(a-c) communicate and store data remotely over a network 135 with, for example, a cloud color database 145. As understood more fully herein, the various color servers 120a-c gather data corresponding to user selection, color matching, and asset repair at various asset repair shops, such as local auto-body shops. The color servers 120a-c can comprise one or more stand-alone computer systems, as well as an application or partition of a single device used by the local operator, such as an auto-body refinish operator, or front office worker. Moreover, the one or more devices on which the color server 120(a-c) resides may be installed locally at the asset repair shop, or remote thereto (e.g., a virtual machine), and thus accessible over network 135. The color servers 120a-c can comprise any number of digital computing devices, including but not limited to one or more laptops, tower computer systems, tablet computers, or personal device assistants, including mobile phones.

Figure 1A further shows that the one or more color servers 120(a-c) interact over network 135 with one or more cloud color manager systems 145 (or simply “cloud color manager(s)”). In general, the cloud color manager(s) 145 similarly can include one or more remote computing devices that gather, process, and relay user selections, or recent updates to color profiles. Along these lines, Figure 1A shows that the cloud color database 145 includes a component 155a for storing color selections by region. For example, cloud color database 145 can store data about coating components (e.g., formula/ingredients/parameters) and sub-components selected by users in the eastern United States to coat a car of one particular year, make, and model, as well as similar selections by other users in different parts of the United States (or in another region of the world) to coat the same car. That is, the cloud color database 145 can keep an ongoing, continually updated database for what colors or versions thereof users are selecting in Europe, Australia, Eastern Asia, South America, and so forth. This data can help account for regional and personal selection differences selected by region to obtain the same overall look and color feel, and/or to account for regional preferences in desired end color or overall color appearance/effect.

Figure 1A also shows that the cloud color database 145 can include a cost component, such as the illustrated cost of color formulas component 155b. The cost of color formulas component 155b can include cost information about the overall volumetric pricing for a given coating, as well as pricing for each individual sub-component, such as continually updated costs of base of particular physical types, costs of effect pigment (e.g., XIRALLIC, gonioapparent pigment, metallic flake, mica, pearlescent pigments, and the like), and costs of various color tints. Coatings with greater or lower relative pricing due either to the cost of the coating itself, or the extra labor or special application process(es) needed to apply it, such as those with multiple coating layers (e.g., tricoat, XIRALLIC) can be marked as such in the stored record.

In addition, Figure 1A shows that the cloud color manager(s) 145 can include a component for correlating color with OEM color codes, namely the illustrated component 155c. In one instance, an operator, or automated update interface, can continually update cloud color database 145 with both historical and recent updates to an asset manufacturer’ s coating codes and formulations used to coat a particular asset. Thus, the cloud color database 145 can store information such as the coating color and formulation used to coat a piece of heavy industrial equipment in the year 1970, as well as that used for a particular automobile of a certain make, and model as created in the year 2021, and so on.

The cloud color database 145 can also store various secondary indicia associated with each color and color formulation. For example, the cloud color database 145 can store barcode, QR code, and/or VIN (vehicle identification number) data associated with each color record, which may enable an end user to scan the corresponding code on the asset itself, and then enable the user to pull the record for the original color as stored by the cloud color database 145. Pulling the full record for the original color can indicate all components/ingredients/layers, and other parameters known about the original coating application. The color database 145 can also serve as a central repository for the most recent updates of a coating manufacturer’s colors, color names, and related physical data, such as formula, spectral, colorimetric, RGB, CIELAB (i.e., L*a*b*), and/or XYZ tristimulus data and related conversion data, as well as image data, for each color and corresponding color sub-component used to make a particular coating.

The cloud color database(s) 145 may also, for example, coordinate with one or more databases of one or more asset (e.g., auto) manufacturers (which may or may not be the coating manufacturer). This coordination can ensure the cloud color manager is able to regularly obtain similar formula, spectral, colorimetric, RGB, CIELAB (i.e., L*a*b*), and/or XYZ tristimulus values (and related conversions) for each color used to coat the assets by the asset manufacturer as they are applied each year. The secondary and physical data corresponding to each color can be used to retrieve color matches as described more fully herein. For purposes of this specification and claims, “primary color data” refers to the color name or color code used to identify a particular coating, namely human readable labels that an end user might use to identify a color or color profile, such as Midnight Blue. Meanwhile, “secondary color data” refers to inherent physical characteristic data and machine-readable data other than express color name or color code, such as barcode, QR code, or physical characteristic data associated with a particular coating. Physical characteristic data can include spectral reflectance data, colorimeter data, CIELAB values, RGB values, and so forth.

Figure IB illustrates a schematic of one of the local computer systems of Figure 1A, in this case system 100a, further illustrating components and modules implemented between a corresponding client and server. In general, each local computer system 100 (i.e., lOOa-c, etc.) can comprise at least one client computer system 105 that communicates with a color server (i.e., 120a-c, etc.) For example, Figure IB shows that system 100a can comprise at least client computer systems 105 in communication with color server 120a. The client computer system 105 can comprise any number or type of portable or stationary computer device, including but not limited to a desktop computer system with an attached display/monitor, or a mobile computing device, such as a laptop, tablet computer, mobile phone, or other personal device assistant.

As previously indicated, Figure IB further shows that client computer system 105 is in communication with color server 120a. The color server 120a may comprise an application or virtual machine installed on the client computer system 105 itself, or may be an application installed on a separate, stand-alone computing system, such as a local or remote computer system connected to client computer system 105 over a local or global network. In particular, network 135 may be a global, wide, or local area network, including the Internet. Figure IB further shows that the color server 120a comprises a number of modules (e.g., 125a-125d), components (e.g., 130), and databases (e.g., 140) that assist in management and relay of relevant color data viewed by the client system 105.

In general, modules 125(a-d) and components 130 will be understood as abstractions of generalized processing components that can be used in at least one implementation of the present invention, and there may be more or fewer than those illustrated and described, and as may be suited for a particular server and cloud operating environment. As used herein, a “module” means computer executable code that, when executed by one or more processors at a given computer system (e.g., computer system 105, or server 120), causing the given computer system to perform a particular function. By contrast, a “component” means a passive set of instructions or data structures or records that store, manage, and/or otherwise provide information handled through a given module. One of skill in the art, however, will appreciate that the distinction between a different modules or components is at least in part arbitrary, and that modules or components may be otherwise combined and divided and still remain within the scope of the present disclosure. As such, the description of a component as being a “module” or a “component” is provided only for the sake of clarity and explanation and should not be interpreted to indicate that any particular structure of computer executable code and/or computer hardware is required, unless expressly stated otherwise. In this description, the terms “component,” “agent,” “manager,” “service,” “engine,” “virtual machine” or the like may also similarly be used. In any event, Figure IB shows that color server 120a can further comprise one or more color databases 140, which may itself include one more additional data stores, such as the jobs data store component 160, a data store for a set of color records 150(a-c), and a data store for storing and accessing one or more machine learning algorithms 170. In general, color server 120 can employ machine learning algorithms 170 with any number of the modules 125(a-d) as applicable to identify asset defects (e.g., a crashed or damaged portion of an asset), to learn from the prior human input (described above) identifying the area needing refinish or repair, and improve analysis expertise over time. Such machine learning algorithms 170 can comprise but are not limited to algorithms for use in object or image segmentation, such as supervised learning algorithms, unsupervised learning algorithms, semi-supervised learning algorithms, reinforcement learning algorithms, reinforcement learning algorithms, self-learning algorithms, feature learning algorithms, anomaly detection algorithms, robot learning algorithms, and/or composite versions thereof.

Figure 1C illustrates a schematic in which an end user interacts with the components shown in Figures 1A-1B to process an asset for eventual refinish. As shown, user 190 interacts with a user interface 110a displayed on computer system 105. Figure 1C further shows that computer system 105 comprises one or more image capture elements 113. Image capture element 113, such as a digital camera, may be integrated with computer system 105, as shown, or alternately connected to the computer system 105, such as via a wired (e.g., USB, ethernet) or wireless (e.g., WIFI, Bluetooth, etc.) connection. Figure 1C also shows that computer system 105 can be connected to a scanning instrument (also referred to herein as a scanner) 107, and one will appreciate that this can also be connected similarly via a corresponding wired or wireless connection. In one example, one or both of scanner 107 and image capture element 113 is/are connected to a cloud server over a network (e.g., Internet) connection, such as to color server 120 over network 135, and computer system 105 accesses the corresponding images or scan data from the color server 120 indirectly over network 135.

In any case, Figure 1C shows that user interface 110a displays a plurality of selectable elements 115a, 115b, etc. for creating a job corresponding to repair of asset 180. In one example, user 190 captures data corresponding to the asset 180 to be repaired, in this case the illustrated portion 185 a showing physical damage. One will appreciate that “damage” is not limited to ordinary physical damage owing to impact/deformation of the asset 180 necessarily, but may also include areas of discoloration, such as fade, rust, or other forms of coating degradation or coating imperfection, which might trigger a given user 190 to recoat or refinish all or part of the asset 180. In addition, one will appreciate that examples of the present invention are not limited to refinish or recoating of damaged assets, as such, and that an end user 190 may be performing another type of project, such as building and painting an asset from scratch or from scrap parts, building a kit car, or simply painting an existing asset entirely just to change its color. Nevertheless, the present invention is described herein primarily with respect to refinish of an asset 180 needing repair for purposes of convenience.

In at least one method of operation, user 190 opens user interface 110, and selects selectable element 115a for creating a job. User 190 then uses the image capture element 113 to snap an image of the asset 180 to be repaired, including the damaged portion 185a. User 190 can also select the selectable asset 115b to scan the asset, and then scans the asset 180, and/or damaged portion thereof 185a to identify color and other secondary color data/indicia. For example, upon selecting element 115b, and uses deploys scanner 107 (or image capture element 113) to scan a barcode scanner to scan a barcode, QR code, or VIN element presented on the asset 180. Along these lines, some asset manufacturers now include computer-readable or scannable information embedded within barcodes or QR codes affixed to an inside of a doorjamb along with or beside a VIN for the given asset. In other cases, scanner 107 comprises a colorimeter or spectrophotometer, such as provided by any number of other instrument manufacturers. In at least one example, the scanner 107 comprises a portable, hand-held spectrophotometer connected to computer system 105 via suitable cable such as USB, or is connected wirelessly via Bluetooth, WIFI, or other suitable communication protocol.

In either case, Figure 1C shows that computer system 105 provides the capture image data (typically in RGB format) from the device camera to color server 120 via one or more messages 117. In addition, Figure 1C shows that the user 190 scans all or part of the asset 180 needing repair. In one example, the user 190 scans with the scanner 107 only the non-damages portions of the automobile, whereas in other examples the user 190 scans the damaged area of the asset 180 to be repaired. The user sends the scanned data, including any or all the various scans including barcode, VIN, or QR code data, spectral data, and any other colorimetric data via one or more corresponding messages 109 to color server 120.

Color server 120 can then process the received data from one or both of messages 117 and 109. For example, color server 120 can store the data associated with either or both of scan 109 and image 117 through the color database 140, such as by initiating a job (e.g., “Job A”) record in the corresponding Jobs 160 data structure. The color server 120 can also process the data in any of the processing modules 125a, 125b, 125c, and/or 125d. For example, in one example, estimation module 125b coordinates receipt of image 117 is to create “Job A,” and prepares a data structure for later use by the estimation interface 110b (e.g., Figure 2A).

In addition, the image processing module 125c can perform object and/or image segmentation analysis via one or more machine learning algorithms 170 to identify and draw lines around areas that the machine learning algorithms automatically identified for the presence of damage or defect, (i.e., area/portion 185a). In addition, color processing module 125a can perform a number of analyses of the image, spectral, and/or colorimetric data received to identify relevant, closest color matches among colors 150a, 150b, and 150c stored in color database 140. For example, color processing module 125a can identify that barcode information received in scan data 109 identifies a particular color from a particular make, model, and year of an automobile, and further identify from the color database which particular undercoat(s) and pigment effects were used in the formula for that particular color record.

Similarly, color processing module 125a can determine that the original coating identified in the scan data 109 is not one created by a known paint manufacturer stored in the color database 140, but that several other colors that have similar secondary color data by comparison of physical characteristics, such as similar spectral, CIELab, and/or XYZ tristimulus value matches. Color processing module 125a can then gather those color records that match or otherwise fit within an acceptable range of deviation from the actual measurement (e.g., by computing a z-score of the measured color relative to a group of colors with similar physical measurements), and provide that as a response for further user input. Figure 1C shows that color server 120 then sends one or more responses back to computer system 105 in the form of one or more color match messages 123. As discussed more fully herein, computer system 105 can then handle the response information through user interface 110a.

For example, Figure 2A illustrates a schematic in which computer system 105 renders an update to the user interface 110, namely through display of estimation interface 110b. User interface 110b can be provided to the original user 190, or to another operator who will be working on refinish of asset 180. It is not required that estimation interface 110b and the original user interface 110a be sequentially handled by the same person or entering entity. For example, in one example, one auto-body operator performs the initial intake with the scanner 107 and image capture element 113, while another auto-body operator separately enters estimate data in estimation interface 110b. In still another example, a front office worker that is in the same location or remote of the auto body operator can perform one of these scanning or estimation steps separately before the asset 180 is received at the asset repair shop.

In either case, Figure 2 A shows that estimation interface 110b comprises an interactive display of 200a of asset 180. For example, through one or more selectable elements (not shown) in a prior user interface, a user continues with a workflow related to “Job A,” in this case the job of repairing asset 180. Accordingly, estimation interface 110b pulls the image data taken originally from image capture element 113 (or other device) for asset 180, and loads an interactive display 200a. In one example, the interactive display 200a includes an image of just a portion of asset 180, or a representative image of just a portion of panel (e.g., a tile) showing the color and effect as retrieved from the image file. In another example, interactive display 200a shows an interactive image of the entire asset 180 as photographed, along with the damaged portion 185 a.

Figure 2A further shows interactive display 200a, which comprises rendering data 203 received from color server 120a. In one example, rendering data 203 includes original image information received via messages 117, and/or scan information from messages 109. In general, rendering data 203 comprises the relevant data points of messages 109 and 117 that have been rendered by rendering component 130 for display.

In this case, Figure 2 A shows that the interactive display 200a displays a rendering of asset 180 and further includes a designation of the damaged portion, namely portion 185a. As previously indicated, the designated portion 185a can be automatically determined by the image processing module 125c and relevant machine learning algorithms 170. Alternatively, or in connection with machine learning algorithms, the user can draw a line around the damaged portion shown in the interactive display 200a. The computer system 105 can then make determinations based on the exhibited damage and number of underlying parts known for this portion of asset 180 to automatically determine the number of panels and parts that will need to be replaced. For example, cloud color database 145 may store a list of parts needed to replace panels at varying levels of damage for various makes, models, and years, of various assets.

In addition, Figure 2A shows that the computer system 105 provides a user estimate interface 205. For example, Figure 2A shows that the user estimate interface 205 comprises an entry field 210a for time to complete the repair, a field 210b for entering an estimated volume of paint, a field 210c for a number of panels to be painted, and a field 210d for a date of completion. One will appreciate that these field entry components 210a-210d are merely exemplary, and that a user estimate interface may include other fields of interest, such as fields to enter year, make, and model of the asset, where that information could not be automatically determined through prior steps. Furthermore, some of these fields may be pre-populated by computer system 105 based on data determined from messages 109 and 117 and in connection with image processing module 125c and/or machine learning algorithms 170. For example, the user estimate interface 205 may preliminarily indicate in field 210a “5 hrs” of time to complete the job, preliminarily indicate “2 gallons” of paint, and leave empty the fields 210c and 210d. The user can then interact with the user estimate interface 205 to adjust the preliminarily determined data in each field where applicable, and supply other information where missing. Computer system 105 continually sends user input 213 back to the color server 120a for storage and management in connection with the Job A stored in the Jobs 160 data structure.

Figure 2A further shows that the user can initiate a color match interface 110a, which provides another interactive display 200, namely interactive display 200b, again with asset 180. In this case, the color match interface 110c also displays an indication of the scanned color tile 210. In one example, the scanned color 210 comprises a representation of an OEM (original equipment manufacturer) color determined from barcode or other data known about asset 180 and its characteristics of make, model, year, etc. In another example, the scanned color tile 210 represents an image of the asset 180 (or small tile portion thereof) taken through image capture element 113, and displayed for comparison purposes.

In this case, Figure 2A displays the scanned color 210, and illustrates a suggested color match (i.e., “Color 2”) which corresponds to one of the matched colors shown by tiles 220a, 220b, and 220c in the matched color interface 207. Figure 2A also shows that the matched color interface 207 displays a color tile for each of the matched colors 220a, 220b, 220c deemed to be closest to the color of asset 180, and/or portion 185 a. Furthermore, Figure 2 A shows that each color tile comprises one or more cost indicators. For example, Figure 2A shows that the matched color tile 220b for “Color 2” shows a multiple dollar symbol (“$$$”) as well as a parenthetical indicating that the color corresponds to a “tricoat” color, which requires multiple different coats and/or sub components to achieve the displayed color effect. By contrast, the matched color interface 207 displays color tiles 220a and 220c, corresponding to “Color 1” and “Color 3,” respectively, each with a single dollar symbol (“$”), meaning that “Color 1” and “Color 3” cost less per volume than “Color 2.”

Figure 2A further shows that the matched color interface 207 can indicate one or more user popularity indicators. For example, color tile 220a displays a “75%” popularity, while color tile 220b displays an “80%” popularity rating, and color tile 220c displays a “45 %” popularity rating. These popularity ratings can be further distinguished based on region, and further divided based on selections by users (e.g., asset owners) or third-party payors (e.g., insurance). For example, upon selection of color tile 220b, the matched color interface 207 might further display an indication that Color 2 carries a popularity of 90% among asset owners in the southern United States, but only a 20% popularity among third-party payors in the same region, or perhaps a 55% popularity by end users in a similar climate but different country in the world. These sorts of metrics can help end users, asset repair shops, and front office personnel make informed decisions that can directly impact not just the cost of repair, but the extent to which a repair is likely to be paid in full by insurance, or likelihood a repair is likely to be visually accepted by an end user after application.

Along these lines, an asset repair shop may alternately present the matched colors interface 207 to an asset owner, along with the various color, cost, and popularity metrics. The asset owner, rather than the asset repair operator, may decide to select a slightly less popular color match (i.e., “Color 1”) due to its lower cost but nevertheless acceptable overall appearance. Similarly, the asset owner may alternately select the more expensive, more popular option, knowing that a third-party payor may only reimburse a small portion of the cost of repair and thus that the asset owner may be required to provide an up front payment for the remainder. At least in part since the user can toggle the interactive interface 200b to show asset 180 displayed in interactive 3D with each of the matched colors on selection, and since the color selection is likely to be far more accurate by relating to colorimetric, spectrophotometric, and/or OEM color matching of the car in its present state, the estimation process saves significant cost and effort for both the estimator and the end- user, as well as any other third-party payors. That is, accurate interactive display, among other things, can ensure that initial cost estimates are more likely to reflect the final end price since the colors and costs presented to the user and asset repair personnel are more likely to reflect the actual color upon application, and thus accepted.

Figure 2B illustrates further details for enabling high quality user interactive display in 3D manipulation interface 110c. For example, in Figure 2B the 3D manipulation interface 110c includes additional interactive display interfaces 200c and 200d, in which the end user is able interact with a repaired form of the asset 180. That is, Figure 2B shows that asset 180 has a repaired portion 185b. As before, the 3D manipulation interface 110c can comprise an interactive display constructed from the actual image taken via element 113, or can comprise a 3D generic model of asset 180 obtained from the asset manufacturer, or reconstructed via other means. The display interface 200c may show the asset 180 as photographed for each portion except for the repaired portion, which may be simulated to show an original or repaired form 185b, and pieced together by color server 120a.

Figure 2B shows that the user can then modify or select various other options to view as best as possible how the asset 180 may look upon final application. To enable this, the 3D manipulation interface 110c comprises the previously described matched colors interface 207, as well as a rotation element 240, which enables the user to rotate the view and angle of the asset 180, as shown in comparison between the updates to the interactive display 200c-200d. In addition, Figure 2B shows that the 3D manipulation interface 110c can comprise one or more selectable elements in the form a light source modifier 230. The light source modifier can include a slider 235, for changing the position of the selected form of light (e.g., the sunlight icon shown in interactive display 200d). One will appreciate that the light source modifier 230 can further include options from changing the type of light source (e.g., indoor versus outdoor lighting), brightness, time of day, as well as the numbers of light sources used at a time.

Each selection and/or modification made by the user is sent to the color server 120a via one or more user input messages 245, and the color server 120a responds with one or more corresponding rendering data update messages 250. The end user, asset repair personnel, third-party payor, or the like, can thus observe the asset 180 in a wide variety of true to life environments, and see, for example, the color of a tricoat application in one source of light versus another source of light, as well as a different color with different sub-component characteristics (e.g., different effect pigments) in various sources of light. This ability to manipulate the asset 180 with a wide variety of factors and receive instant, true-to-life interactive display adds significant speed, efficiency, and waste minimization to the estimation process.

Figure 3 illustrates that user interface 110a can further show the calculations made upon completion of interactive display, and selection of an appropriate color. For example, after user selection of the final color, with full consideration of cost considerations, and other visual effects, user interface 110a allows the end user to view an entire quote with full breakdown. For example, user interface 110a pulls data retrieved from the asset repair personnel from user estimate interface 205, and displays an element-by-element breakdown of the anticipated costs, including quotes for third-party payors. Figure 3 further shows that the user interface 110a can display a print estimate element 305, enabling the end user or asset owner to maintain a formal copy of the finalized estimate.

Accordingly, Figures 1A through 3 provide multiple components, modules and schematics as part of a system for efficiently providing accurate refinish estimates that are reflective of true to life appearance and costs, thus significantly eliminating costly environmental waste and lost time needed to correct and refinish otherwise inaccurate selections and estimates. The present invention can also be described in terms of one or more methods for accomplishing a particular result. Along these lines, Figures 4 and Figure 5 illustrate various methods for providing an accurate, just-in- time estimate of an asset to be repainted. The acts and steps of Figures 4 and 5 are discussed below with reference to the systems components and modules of Figures 1A-3, which can be used to perform these acts and steps.

For example, Figure 4 shows that a method 400 of providing an accurate just in time estimate of an asset to be repainted can comprise an act 410 of providing a graphical user interface for entering a paint job. Act 410 includes providing a graphical user interface comprising one or more selectable elements for entering information about a paint job, the paint job corresponding to repair of an asset that has been damaged. For example, an end user such as an asset repair operator opens user interface 110 on computer system 105 to begin creating a job for repair of asset 180. The paint job includes at least the coating requirements in connection with the asset repair.

Figure 4 also shows that method 400 can comprise an act 420 of receiving user scans of the asset, and other user input for completing the job. Act 420 includes receiving user input via the one or more initial input fields, wherein the received user input includes: (i) a digital scan of the asset by a hand-held instrument; (ii) a digital image taken of a portion of the asset to be repainted; and (iii) a user time estimate that corresponds to an amount of time needed to repaint the asset. For example, Figure 1C shows that user 190 uses computer system 105 to capture an image of asset 180, and further to scan asset 180 using scanner 107, thereby gathering additional non-image related data. Figure 2 A shows that the user 190 can also provide separate input through various fields in user estimates interface 205. Thus, the inputs provided are in some parts mechanically or machine-determined (e.g., via elements 113, and scanner 107), and in part human determined (via interface 205).

In addition, Figure 4 shows that the method 400 can comprise an act 430 of using the user scan to display a plurality of matching color tiles with a cost indicator. Act 430 includes retrieving from a database a plurality of closest match colors corresponding to the color data obtained by the scanning operation (e.g., spectrophotometer data), and displaying on the graphical user interface a plurality of selectable color tiles corresponding to the spectrophotometer data, wherein at least one of the selectable color tiles includes a cost indicator. For example, Figure 2A shows that color match interface 110c displays an interface 207 listing colors 150a, 150b, and 150c as corresponding color tiles 220a, 220b, and 220c, along with various secondary indicators related to cost in the form of dollar signs (“$,” “$$$,” “Tricoat,” etc.)

Furthermore, Figure 4 shows that method 400 can comprise an act 440 of, upon selection of a color tile, displaying a 3D object with the color. Act 440 includes, upon selection of any of the selectable color tiles, displaying on the graphical user interface a 3D image a color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from one or more light sources. For example, Figure 2B shows 3D manipulation interface 110c with a variety of controls to both display the asset 180 along with selections to repaint the asset with a matched color via selectable color tiles 220a, 220b, 220c, to adjust the light source(s) via one or more elements 230, and slider 235, and to toggle the position of the asset 180 to show various color effects against different lighting via the interactive display 200(c-d).

Still further, Figure 4 shows that the method 400 can comprise an act 450 of, upon selection of appropriate color, display a completed cost estimate. Act 450 includes, upon receiving a final color selection of the selectable color tiles, displaying on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a cost of repainting the asset based on a volume and cost of paint determined from the received final color selection and received user input via the one or more initial input fields. For example, Figure 3 shows that, upon selection of a final color, user interface 110a can display an estimate interface 300, with one or more selectable print (or finalize) options 305.

In addition to the foregoing, Figure 5 illustrates that an additional or alternative method 500 for providing an accurate just in time estimate of an asset to be repainted can comprise an act 510 of receiving user input regarding data to complete a job. Act 510 includes receiving user input via one or more initial input fields displayed on a graphical user interface, wherein the received user input includes: (i) a digital scan of a color by a hand-held instrument; (ii) a digital image taken of a portion of the asset to be repainted; and (iii) a user time estimate that corresponds to an amount of time needed to repaint the asset. For example, as previously described with respect to Figures 1A-1C, a user 190 can use one or devices to digitally capture image information and other scanned information (e.g., spectrophotometric information, colorimetric information, barcode or QR code information, VIN information, etc.) Similarly, Figure 2A shows that an estimation interface provides several user estimate fields 210(a-d) for providing human input or human adjustments relevant to refinishing a particular asset.

Figure 5 also shows that method 500 can comprise an act 520 of automatically determining boundary lines of an area of the asset to be pained. Act 520 includes using one or more machine learning algorithms to automatically determine an area of the asset to be repainted, and displaying the digital image with one or more lines drawn around the determined area of the asset. For example, Figure 1C shows that color server 120 can receive image and scan information via messages 117 and 109, and process this information via image processing module 125c and/or 3D processing 125d, in further connection with one or more machine learning algorithms 170 deploying for example object and/or sematic segmentation. Figure 2 A shows that the detected asset 180 can be displayed in an interactive display interface 200a, and which further displays or highlights a detected portion 185 a to be repaired. The auto detection of the asset 180 and areas to be repaired 185a can be performed via machine learning algorithms 170.

In addition, Figure 5 shows that method 500 can comprise an act 530 of receiving user inputs that revise the boundary lines of the asset to be pained. Act 530 includes receiving one or more user inputs that adjusts the lines drawn on the determined area, thereby providing an adjusted area of the asset to be repainted. For example, an end user can adjust the boundary lines 185a in the interactive display 200a. The user’s input can be fed back to the machine learning algorithms 170 for additional training.

Furthermore, Figure 5 shows that method 500 can comprise an act 540 of retrieving and displaying a plurality of matching color tiles with a cost indicator. Act 540 includes retrieving from a database a plurality of closest match colors corresponding to results of the digital scan, and displaying on the graphical user interface a plurality of selectable color tiles corresponding to results of the digital scan, wherein at least one of the selectable color tiles comprises a premium color tile displaying a premium color and a corresponding text indicator of cost status. For example, Figure 2A shows a color match interface 110c and a matched colors interface 207, which display matched colors 150a, 150b, and 150c in the form of selectable color tiles 220a-220c. Color tiles 220a-220c, in turn, further display additional indicators such as cost indicators (indicating a premium color), and popularity indicators.

Still further, Figure 5 shows that method 500 can comprise an act 550 of displaying a 3D image showing the asset in repaired form with the selected color. Act 550 includes upon selection of the premium color tile, displaying on the graphical user interface a 3D image of the asset showing a repaired form of the adjusted area that has been painted with the premium color, wherein the 3D image shows different color effects at different angles of the displayed premium color from a single light source. For example, Figure 2B shows that, with 3D manipulation interface 110c, asset 180 can be displayed with options for repainting with different colors in a matched color area, and that the asset 180 and various selectable light sources can be repositioned about each other to interactively experience/observe a maximum number of light conditions and color effects at different angles.

Finally, Figure 5 shows that method 500 can comprise an act 560 of displaying a completed cost estimate and list of parts needed in the repair thereof. Act 560 includes, upon receiving a final color selection of the premium color, displaying on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a list of parts needed to repair the asset, and a cost of repainting the asset based on a volume of paint determined from the digital image and the user time entry. For example, as previously described, after selection of an appropriate color, the user can open an estimate interface 300, and print/finalize the estimate via one or more selectable elements 305.

One will appreciate, therefore, in view of the present specification and claims that the present invention can be practiced in a wide range of settings to provide accurate, just-in-time, contextually related information for properly, quickly, and accurately estimating repair of an asset with minimal waste. One will further appreciate that the present invention can be implemented in a wide range of settings. For example, in addition to the automotive-style asset repair analyses described herein, the present invention can be applied to defect analysis and repair employed in a wide range of assets, including heavy industrial and light industrial equipment.

The present invention can also be practiced with respect to more traditional facilities in the form of roofed buildings, such as to identify degradation/corrosion in or on buildings, and/or with coil steel, metal roofs, and other structural components. The present invention (in particular principles of artificial intelligence) can further be used to identify a particular color, or even quality of a color match, such as may be used in automotive and residential coating matches. Still further, the present invention can be used in connection with style transfer, namely transferring a photo-realistic image of a style of one picture into another one. One will appreciate therefore that principles of the present invention can be applied not just to maintenance, but also to general principles of quality assessment and assurance in a wide range of both industrial and personal use settings.

The present invention may comprise or utilize a special-purpose or general-purpose computer system that includes computer hardware, such as, for example, one or more processors and system memory, as discussed in greater detail below. The scope of the present invention also includes physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures. Such computer-readable media can be any available media that can be accessed by a general-purpose or special-purpose computer system. Computer-readable media that store computer-executable instructions and/or data structures are computer storage media. Computer-readable media that carry computer-executable instructions and/or data structures are transmission media. Thus, by way of example, and not limitation, the invention can comprise at least two distinctly different kinds of computer-readable media: computer storage media and transmission media.

Computer storage media are physical storage media that store computer-executable instructions and/or data structures. Physical storage media include computer hardware, such as RAM, ROM, EEPROM, solid state drives (“SSDs”), flash memory, phase-change memory (“PCM”), optical disk storage, magnetic disk storage or other magnetic storage devices, or any other hardware storage device(s) which can be used to store program code in the form of computer-executable instructions or data structures, which can be accessed and executed by a general-purpose or special-purpose computer system to implement the disclosed functionality of the invention. Transmission media can include a network and/or data links which can be used to carry program code in the form of computer-executable instructions or data structures, and which can be accessed by a general-purpose or special-purpose computer system. A “network” is defined as one or more data links that enable the transport of electronic data between computer systems and/or modules and/or other electronic devices. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computer system, the computer system may view the connection as transmission media. Combinations of the above should also be included within the scope of computer-readable media.

Further, upon reaching various computer system components, program code in the form of computer-executable instructions or data structures can be transferred automatically from transmission media to computer storage media (or vice versa). For example, computer-executable instructions or data structures received over a network or data link can be buffered in RAM within a network interface module (e.g., a “NIC”), and then eventually transferred to computer system RAM and/or to less volatile computer storage media at a computer system. Thus, it should be understood that computer storage media can be included in computer system components that also (or even primarily) utilize transmission media.

Computer-executable instructions comprise, for example, instructions and data which, when executed at one or more processors, cause a general-purpose computer system, special-purpose computer system, or special-purpose processing device to perform a certain function or group of functions. Computer-executable instructions may be, for example, binaries, intermediate format instructions such as assembly language, or even source code.

Those skilled in the art will appreciate that the invention may be practiced in network computing environments with many types of computer system configurations, including, personal computers, desktop computers, laptop computers, message processors, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile telephones, PDAs, tablets, pagers, routers, switches, and the like. The invention may also be practiced in distributed system environments where local and remote computer systems, which are linked (either by hardwired data links, wireless data links, or by a combination of hardwired and wireless data links) through a network, both perform tasks. As such, in a distributed system environment, a computer system may include a plurality of constituent computer systems. In a distributed system environment, program modules may be located in both local and remote memory storage devices.

Those skilled in the art will also appreciate that the invention may be practiced in a cloud computing environment. Cloud computing environments may be distributed, although this is not required. When distributed, cloud computing environments may be distributed internationally within an organization and/or have components possessed across multiple organizations. In this description and the following claims, “cloud computing” is defined as a model for enabling on- demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services). The definition of “cloud computing” is not limited to any of the other numerous advantages that can be obtained from such a model when properly deployed.

A cloud-computing model can be composed of various characteristics, such as on-demand self- service, broad network access, resource pooling, rapid elasticity, measured service, and so forth. A cloud-computing model may also come in the form of various service models such as, for example, Software as a Service (“SaaS”), Platform as a Service (“PaaS”), and Infrastructure as a Service (“IaaS”). The cloud-computing model may also be deployed using different deployment models such as private cloud, community cloud, public cloud, hybrid cloud, and so forth.

A cloud-computing environment, or cloud-computing platform, may comprise a system that includes one or more hosts that are each capable of running one or more virtual machines. During operation, virtual machines emulate an operational computing system, supporting an operating system and perhaps one or more other applications as well. Each host may include a hypervisor that emulates virtual resources for the virtual machines using physical resources that are abstracted from view of the virtual machines. The hypervisor also provides proper isolation between the virtual machines. Thus, from the perspective of any given virtual machine, the hypervisor provides the illusion that the virtual machine is interfacing with a physical resource, even though the virtual machine only interfaces with the appearance (e.g., a virtual resource) of a physical resource. Examples of physical resources including processing capacity, memory, disk space, network bandwidth, media drives, and so forth.

In view of the foregoing, the present invention may be embodied in multiple different configurations, as outlined above, and as exemplified by the descriptions of various exemplary aspects.

For example, in a first aspect, in one configuration, a computer-implemented method for providing an accurate, just-in-time estimate of an asset to be repainted, can include providing a graphical user interface comprising one or more selectable elements for entering information about a paint job, the paint job corresponding to repair of an asset that has been damaged; receiving user input via the one or more initial input fields, wherein the received user input includes: (i) a digital scan of the asset by a hand-held instrument; (ii) a digital image taken of a portion of the asset to be repainted; and (iii) a user time estimate that corresponds to an amount of time needed to repaint the asset; retrieving from a database a plurality of closest match colors corresponding to the spectrophotometer data; displaying on the graphical user interface a plurality of selectable color tiles corresponding to the spectrophotometer data, wherein at least one of the selectable color tiles includes a cost indicator; upon selection of any of the selectable color tiles, displaying on the graphical user interface a 3D image a color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from one or more light sources; and upon receiving a final color selection of the selectable color tiles, displaying on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a cost of repainting the asset based on a volume and cost of paint determined from the received final color selection and received user input via the one or more initial input fields.

In a second aspect, the displayed cost indicator in the computer-implemented method according to the first aspect identifies the corresponding color tile as a tricoat color. In a third aspect, the final estimate in the computer-implemented method according to any one of the preceding first or second aspects further includes a list of parts needed to repair the asset, the list of parts being retrieved from the database. In a fourth aspect, the digital scan in the computer-implemented method according to any one of the preceding first to third aspects can include a scan of the asset using a spectrophotometer, the received user input including spectrophotometer data. In a fifth aspect, the computer-implemented method according to any one of the preceding first to fourth aspects can include using a machine learning algorithm to identify one or more damaged areas of the asset to be repainted. According to a sixth aspect, the computer-implemented according to any one of the preceding first to fifth aspects can additional include displaying, by the computer system, one or more drop-down menu items corresponding to the asset; wherein the one or more drop-down menu items provide input regarding damage of the asset.

In a seventh aspect, the computer-implemented method as described above for the first to sixth aspects can also include receiving a new user selection of an alternate basecoat option for the corresponding color displayed of the 3D image; and displaying an adjusted 3D image of the corresponding color that reflects the selected alternate basecoat option. In an eighth aspect, the computer-implemented method as described above for any of the first to seventh aspects can include creating a job card entry in the database of the computer system upon receipt of the user time estimate that the user assigns to completion of the paint job. In a ninth aspect, at least two of the selectable color tiles in the computer-implemented method as described above for the first through eighth aspects include a matching color retrieved from the database, wherein one of the at least two selectable color tiles is identified as a tricoat color that requires multiple layers of coatings, and the other of selectable color tile is a standard color that only requires a single layer of coating, the method further including displaying the 3D image with either the tricoat color or the standard color upon user selection thereof. In a tenth aspect, the damage to the asset in the computer-implemented method according to any one of the preceding first to ninth aspects can include fading or discoloration of an original coating of the asset.

Furthermore, in an eleventh aspect, in another configuration, a computer-implemented method for providing an accurate, just-in-time estimate of an asset to be repainted can include receiving user input via one or more initial input fields displayed on a graphical user interface, wherein the received user input includes: (i) a digital scan of a color by a hand-held instrument; (ii) a digital image taken of a portion of the asset to be repainted; and (iii) a user time estimate that corresponds to an amount of time needed to repaint the asset; using one or more machine learning algorithms to automatically determine an area of the asset to be repainted, and displaying the digital image with one or more lines drawn around the determined area of the asset; receiving one or more user inputs that adjusts the lines drawn on the determined area, thereby providing an adjusted area of the asset to be repainted; retrieving from a database a plurality of closest match colors corresponding to results of the digital scan; displaying on the graphical user interface a plurality of selectable color tiles corresponding to results of the digital scan; upon selection of the premium color tile, displaying on the graphical user interface a 3D image of the asset showing a repaired form of the adjusted area that has been painted with the premium color, wherein the 3D image shows different color effects at different angles of the displayed premium color from a single light source; and upon receiving a final color selection of the premium color, displaying on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a list of parts needed to repair the asset, and a cost of repainting the asset based on a volume of paint determined from the digital image and the user time entry for completion of the paint job.

In a twelfth aspect, in the computer-implemented method according to the preceding eleventh aspect, the hand-held instrument can include a spectrophotometer; and the digital scan of the color can include a scan by the spectrophotometer of the asset. In a thirteenth aspect, in the computer- implemented method according to any one of the preceding eleventh or twelfth aspects, the hand held instrument can include a portable digital device; and the digital scan of the color can include a scan by the portable digital device of a barcode or QR code. In a fourteenth aspect, the displayed cost indicator in the computer-implemented method according to any one of the preceding eleventh to thirteenth aspects identifies the corresponding color tile as a tricoat color. In a fifteenth aspect, the final estimate in the computer-implemented method according to any one of the preceding eleventh to fourteenth aspects further includes a list of parts needed to repair the asset.

In a sixteenth aspect, the computer-implemented method according to any one of the preceding eleventh to fifteenth aspects can further include displaying one or more drop-down menu items corresponding to the asset; wherein the one or more drop-down menu items provide input regarding damage of the asset. In a seventeenth aspect, the computer-implemented method according to any one of the preceding eleventh to sixteenth aspects can further include receiving a new user selection of an alternate basecoat option for the corresponding color displayed of the 3D image; and displaying an updated 3D image of the corresponding color that reflects the selected alternate basecoat option. In an eighteenth aspect, the computer-implemented method according to any one of the preceeding eleventh through seventeenth aspects can include creating a job card entry in the database upon receipt of the user time estimate. In a nineteenth aspect, in the computer- implemented method according to any one of the preceding eleventh to eighteenth aspects, at least two of the selectable color tiles can include the same color, wherein one of the at least two selectable color tiles is identified as a tricoat color, and the other of selectable color tile is a standard color; and the method can further include displaying the 3D image with either the tricoat color or the standard color upon user selection thereof. Furthermore, in a twentieth aspect, in the computer-implemented method according to any one of the preceding eleventh to nineteenth aspects, at least one of the selectable color tiles can include a premium color tile that displays a premium color and a corresponding text indicator of cost status.

Furthermore, in an exemplary twenty-first aspect, in still another configuration, a computer- implemented method for providing an accurate, just-in-time estimate of an asset that has been damaged to be repainted using a computer system, can include obtaining color data associated with the asset by a hand-held scanning instrument; taking a digital image of a portion of the asset to be repainted by an image capture element; transferring the obtained color data and digital image to the computer system; receiving user input via a graphical user interface of the computer system comprising one or more selectable elements for entering information about a paint job corresponding to a repair of the asset, wherein the received user input includes a user time estimate that corresponds to an amount of time needed to repaint the asset; optionally automatically determining, by analysis of the digital image through the computer system, an area of the asset to be repainted, and displaying, by the computer system, the digital image with one or more lines drawn around the determined area of the asset, wherein the drawn lines are adjustable by a user to provide an adjusted area of the asset to be repaired; the method further comprising: retrieving, by the computer system, from a database a plurality of closest match colors corresponding to the obtained color data associated with the asset; displaying, by the computer system, on the graphical user interface a plurality of selectable color tiles corresponding to the retrieved closest match colors, wherein at least one of the selectable color tiles includes a cost indicator; upon selection of any of the selectable color tiles, displaying, by the computer system, on the graphical user interface (a) a 3D image of a color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from one or more light sources or (b) a 3D image of the asset showing a repaired form of the determined and optionally adjusted area of the asset to be repainted that has been painted with the color corresponding to the selected tile, wherein the 3D image shows different color effects at different angles of the displayed color from a single light source; and upon receiving respective user input, displaying, by the computer system, on the graphical user interface a final estimate to refinish the asset, wherein the final estimate includes a cost of repainting the asset based on a volume and cost of paint determined from a particular color of the selectable color tiles finally selected by the user and the received user input about the paint job.

In a twenty-second aspect, the displayed cost indicator in the computer-implemented method according to the preceding twenty-first aspect identifies the corresponding color tile as a tricoat color. In a twenty-third aspect, the final estimate in the computer-implemented method according to any one of the preceding twenty-first or twenty-second aspects further includes a list of parts needed to repair the asset. In a twenty-fourth aspect, the asset in the computer-implemented method according to any one of the preceding twenty-first to twenty-third aspects is a vehicle. Ina twenty-fifth aspect, a machine learning algorithm is used by the computer system to identify one or more damaged areas of the asset to be repainted in the computer-implemented method according to any one of the preceding twenty-first to twenty-fourth aspects. In a twenty-sixth aspect, the computer-implemented method according to any one of the preceding twenty-first to twenty-fifth aspects further can include displaying, by the computer system, one or more drop-down menu items corresponding to the asset, wherein the one or more drop-down menu items provide input regarding damage of the asset. In a twenty-seventh aspect, the method according to any one of the preceding twenty-first to twenty-sixth aspects can further include receiving a new user selection of an alternate basecoat option for the corresponding color displayed of the 3D image, and displaying an adjusted 3D image of the corresponding color that reflects the selected alternate basecoat option.

Furthermore, in a twenty-eighth aspect, the method according to any one of the preceding twenty- first to twenty-seventh aspects can further include creating a job card entry in the database of the computer system upon receipt of the user time estimate. In a twenty-ninth aspect, in the computer- implemented method according to any one of the preceding twenty-first to twenty-eighth aspects the plurality of closest matching colors retrieved from the database can include a multicoat, such as tricoat color, and a monocoat color, and displaying the 3D image with either the multicoat color or the monocoat color upon user selection thereof. In a thirtieth aspect, the damage to the asset in the computer-implemented method according to any one of the preceding twenty-first to twenty- ninth aspects can include fading or discoloration of an original coating of the asset. In a thirty-first aspect, the hand-held scanning instrument can include a spectrophotometer and the step of obtaining color data associated with the asset can include scanning of the asset using the spectrophotometer in the computer-implemented method according to any one of the preceding twenty-first to thirtieth aspects. In a further aspect, the hand-held scanning instrument can include a portable digital scanning device, and the step of obtaining color data associated with the asset can include a scan by the portable digital scanning device of a barcode or QR code in the computer- implemented method according to any one of the preceding twenty-first to thirty-first aspects. Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the described features or acts described above, or the order of the acts described above. Rather, the described features and acts are disclosed as example forms of implementing the claims.