CLAIM OF PRIORITY

[0001] This application claims priority to U.S. Patent Application No. 17/328,564 filed on May 24, 2021, the entire contents of which are hereby incorporated by reference.

TECHNICAL FIELD

[0002] This disclosure generally relates to rock characterization and classification during a drilling process. BACKGROUND

[0003] Rock, in geology, refers to naturally occurring and coherent aggregate of one or more minerals. Such aggregates constitute the basic unit of which the solid Earth is composed. The aggregates typically form recognizable and mappable volumes. Characterization and classification of rocks can reveal insights about the layered formation, including fluid saturation, of the solid Earth during a drilling operation in the context of gas and oil exploration.

SUMMARY

[0004] In one aspect, some implementations provide a laser drilling tool assembly comprising: a body that includes: a first segment configured to receive an input beam from a laser source and couple the input beam to provide an irradiation beam to irradiate a downhole target, and a second segment housing one or more purging pipes; a tool head that includes: a retractable nozzle; and one or more optical sensing elements mounted on the retractable nozzle, wherein when the downhole target is being irradiated by the irradiation beam, the retractable nozzle is extended towards the downhole target such that the one or more optical sensing elements are positioned closer to the downhole target.

[0005] Implementations may include one or more of the following features.

[0006] The one or more optical sensing elements may include an optical luminosity sensor, or a spectral sensor. The optical luminosity sensor may include at least one of: a charge-coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor, an avalanche photodiode (APD), or a photo diode (PD). The spectral sensor may include at least one of: a scanning sensor, or a Fourier-transform infrared spectroscopy (FTIR) sensor.

[0007] The one or more optical sensing element may include: coupling optical components configured to capture light signals emitted from the downhole target. The tool head may further comprises a sensing cable. The light signals may be transmitted, via the sensing cable, to an optical sensor that includes at least one of an optical luminosity sensor, or a spectral sensor. The optical sensor may be located outside the tool head.

[0008] The tool head may further include wheels in the retractable nozzle. The wheels may be configured to retract or extend the retractable nozzle. The wheels may be further configured to attach the sensing cable to the retractable nozzle.

[0009] The tool head may further include a sensor located at a tip of the tool head. The sensor may be configured to measure an ambient temperature and a range between the tip of the tool head and the downhole target when the downhole target is being irradiated by the irradiation beam. [0010] The tool head may further include: a lens assembly to couple the irradiation beam to reach the downhole target. The tool head may further include: one or more internal purging nozzles mounted inside the lens assembly and configured to spray a flow of medium to merge with the irradiation beam. The tool head may further include: one or more external purging nozzles mounted outside the lens assembly and configured to purge debris from the downhole target being irradiated by the irradiation beam.

[0011] In another aspect, some implementations of the present disclosure provide a method that includes: lowering an laser drilling tool assembly into a wellbore shaft in which a downhole target is located; activating an irradiation beam that exits from a tool head of the laser drilling tool assembly; and extending one or more retractable nozzles on the tool head of the laser drilling tool assembly such that an optical sensing element mounted on the tool head is brought closer to the downhole target when the downhole target is being irradiated by the irradiation beam.

[0012] Implementations may include one or more of the following features. [0013] The method may further include: collecting light signals emitting from the downhole target being irradiated by the irradiating beam. The method may further include: analyzing the light signals to characterize a rock type at the downhole target. The method may further include: retracting the one or more retractable nozzles when the light signals have been collected.

[0014] The method may further include: measuring an ambient temperature and a range between a tip of the tool head and the downhole target when the downhole target is being irradiated by the irradiation beam. The method may further include: in response to the ambient temperature exceeding a first threshold, or the range falling below a second threshold, halting an extension of the one or more retractable nozzles. The method may further include: deactivating the irradiating beam.

[0015] The method may further include: activating one or more internal purging nozzles mounted inside a lens assembly of the tool head to spray a flow of medium to merge with the irradiation beam. The method may further include: activating one or more external purging nozzles mounted outside a lens assembly of the tool head to purge debris from the downhole target being irradiated by the irradiation beam.

[0016] Implementations according to the present disclosure may be realized in computer implemented methods, hardware computing systems, and tangible computer readable media. For example, a system of one or more computers can be configured to perform particular actions by virtue of having software, firmware, hardware, or a combination of them installed on the system that in operation causes or cause the system to perform the actions. One or more computer programs can be configured to perform particular actions by virtue of including instructions that, when executed by data processing apparatus, cause the apparatus to perform the actions.

[0017] The details of one or more implementations of the subject matter of this specification are set forth in the description, the claims, and the accompanying drawings. Other features, aspects, and advantages of the subject matter will become apparent from the description, the claims, and the accompanying drawings. DESCRIPTION OF DRAWINGS

[0018] Fig. 1 illustrates a laser drilling tool configuration.

[0019] Fig. 2 is a diagram illustrating an operation of a laser drilling tool configuration.

[0020] Fig. 3 shows an example of the laser drilling tool aiming at a target. [0021] Fig. 4 is a diagram illustrating a configuration of a laser drilling tool with a retractable nozzle according to an implementation of the present disclosure. [0022] Figs. 5A to 5C illustrate the retractable nozzle according to an implementation of the present disclosure.

[0023] Fig. 6 is a diagram illustrating the laser drilling tool with the retractable nozzle in an extended position to collect reflected light according to an implementation

5 of the present disclosure.

[0024] Fig. 7 shows examples of real-time and in-situ reflectance data collected by the laser drilling tool during the expanded operation according to an implementation of the present disclosure.

[0025] Fig. 8 is a block diagram illustrating an example of a computer system

10 used to provide computational functionalities associated with described algorithms, methods, functions, processes, flows, and procedures, according to an implementation of the present disclosure.

[0026] Like reference numbers and designations in the various drawings indicate like elements.

15 DETAILED DESCRIPTION

[0027] The disclosed technology is directed to a real-time and in-situ acquisition of reflectance and spectroscopic data during a laser drilling operation using high power laser (HPL). Such data may characterize the interaction of high power lasers with subsurface matter, the analysis of which may lead to classification of rock types. The

20 interaction of high power lasers w-ith subsurface matter is complex, intense, and fast- paced. Various characteristics of the subsurface can affect the process. Real-time seising tools can be configured to assess the performance of laser drilling, and to characterize the target and the environment. The operation principle of the sensing tools is based on wideband spectroscopy and intensity characterization of back-scattered laser

25 and black body radiation. Spectroscopy can identify fluids and rocks, akin to a fingerprint, and also gauge the temperature of the laser drilling process. The intensity (luminosity) analysis can reveal information about the laser drilling process and the coupling between die laser and the substrate.

[0028] The tool assembly of the implementations of the present disclosure

30 incorporates various subsystems to analyze the light (sensor modules and edge computing). In some implementations, the tool assembly also hosts several acquisition systems to collect the light from multiple points (e.g. at different points close to and far from the interaction). In the multipoint collection configuration, light collected close to

4 tiie interaction can provide information about the formation and temperature; whereas light collected at different points away from the sample would provide information about the environment due to absorption by the wellbore fluids.

[0029] The terminology used in the present disclosure includes the following

5 terms.

[0030] The term “HPL” refers to high power laser. HPL can include pulsed or continuous wave (CW) laser or a plurality of lases with high energy. The term high power refers to lasers with peak power at or above 100 Watts. Typical HPLs for subsurface operations have peak power at or above 10 kW . HPL can be in the visible

10 and infrared range with a wavelength, for example, from 600nm to lOOOOnm.

[0031] The term “process status” refers to a status of a laser drilling process. Examples can include glass forming, process failure/success/completion, etc.

[0032] The term “machine learning analytics” refers to the use of machine learning and applied statistics to predict unknown conditions based on the available data.

15 Two general areas that fall under machine learning analytics are classification and regression. While classification refers to the prediction of categorical values, regression connotes the prediction of continuous numerical values. One machine learning implementation is also known as “supervised learning” where the “correct” target or y values are available. For illustration, the goal of some implementations is to learn from

20 the available data to predict the unknown values with some defined error metrics. In supervised learning, for example, there are a set of known predictors (features) x_l,x_2,...,x_m which are known to the system as well as the target values y_l,y_2,... ,y_n, which are to be inferred. The system’s objective is to train a machine learning model to predict new target values y_l,y_2,... ,y_n by observing new features.

25 [0033] The implementations can employ a variety of machine learning algorithms. For classification, examples of prediction algorithms can include, logistic regression, decision trees, nearest neighbor, support vector machines, K-means clustering, boosting, and neural networks. For regression, examples of predication algorithms can include least squares regression, Lasso, and others. The performance of

30 an algorithm can depend on a number factors, such as the selected set of features, training/validation method and hyper-parameters tuning. As such, machine learning analytics can manifest as an iterative approach of knowledge finding that includes trial

5 and error. An iterative approach can iteratively modify data preprocessing and model parameters until the result achieves the desired properties.

[0034] Referring to Fig. 1, an example of tool assembly 100 is shown for realtime assessment of laser drilling process and downhole target characterization using

5 high power laser (HPL). An HPL laser source may have its power and spectral signature. As illustrated, the tool assembly 101 includes a first segment that includes coupling fiber optics components for receiving an input laser beam. The input laser beam can originate from a high power laser source located on the ground level. The input laser beam can propagate inside a conduit cavity that is inside the main tool body 102. In some cases,

10 the input laser beam may also propagate along a fiber medium inside the main tool body to reach the downhole target as an irradiation beam.

[0035] In some implementations, the tool assembly 100 also includes a second segment 103 for spectroscopy and luminosity, as illustrated in Fig. 1. For example, sensors for spectroscopy and luminosity may be housed inside the second segment 103.

15 Examples of spectral sensors include scanning and Fourier transform infrared spectroscopy (FTIR).

[0036] The tool assembly 100 may additionally sensing cable 104 extending from segment 103 into tool head 106. The sensing cable may feed light signals collected from tool head 106 to sensors housed in segment 103. In some cases, the sensing cable

20 is connected to sensing element 107 in the head. Sensing element can collect light signals during the laser drilling process for spectroscopy and luminosity. Moreover, sensors for temperature and range measurement can also be housed in tool head to measure the distance from the tool head to the downhole target. The tool assembly 100 may additionally include purging feed pipe 105, which can eject a flow of medium to

25 clear the path for the input laser beam to reach the downhole target as the irradiation beam. Purging feed pipe can also cool the tool head during a laser drilling process. Notably, the transmission of the HPL beam for irradiation is accomplished using special fiber optics cable capable of transmitting high energy effectively with minimum loss. In the meantime, the reflection is captured by different optic fiber, such as seising cable

30 104. Because the reflection energy is relatively low, the reflection energy may not need to be handled by specialized optical cables.

[0037] While this configuration is equipped with sensors for capturing light signals for rock characterizing during a laser drilling process, the challenge is that when

6 subsurface materials are exposed to HPL energy, the interaction will generates debris, gases and vapors. Depending on the laser power, the debris will absorb the reflected light energy and contaminate the reflected light, making it difficult, if not infeasible, for the sensor and the seising cable to capture the light reflected, when, for example, the

5 sensor is mounted on the tool assembly itself, that is, at a distance from the target.

[0038] For additional context, Fig. 2 illustrates an example 200 of operating the tool assembly 101 for irradiating a downhole target. When the tool assembly 101 is placed inside the wellbore 202 and brought to the downhole target, the laser beam 208 may be guided down the body of the tool assembly 100 to exit tool head 106. This high

10 power laser can then interact with the subsurface materials. The laser drilling can heat up the subsurface material at extreme temperature, allowing the materials to be removed for penetrations. The reflected light 209 may propagate in all directions with debris, gases, fluid and other by-products, which can render it difficult, if not infeasible, to capture the reflected light for assessing the quality of the light interaction and

15 characterize subsurface material based on the reflected light. For example, impurity can cause misleading or wrong interpretation of the data Conventional and routine operations may place the laser tool so that the tool head is at distance from the downhole target.

[0039] Fig. 3 shows an example 300 in which a laser drilling tool assembly is

20 used to aim a laser beam at a target. As illustrated, a laser beam exits the tool head 106. The laser beam is aimed at a spot on target 301. As illustrated, the tool head 106 is separated from the target 301 by a distance. If optical sensing elements are placed on the tool head 106, the distance can allow the debris and other by-products of laser drilling to contaminate the path of the laser beam due to, for example, absorption. This

25 contamination can affect spectroscopy or luminosity reading.

[0040] Fig. 4 is a diagram 400 showing an example of a laser drilling tool assembly according to some implementations of the present disclosure. Diagram 400 illustrated a proposed solution to this problem that has plagued conventional systems. Specifically, the solution employs a design that includes one or more retractable nozzles.

30 Here, the tool head includes fiber optic cable 401, internal purging nozzles 402, external purging nozzles 403, and retractable nozzles 405. Fiber optics cable 401 can provide laser beam 404 as the irradiation beam for the laser drilling operation. Internal purging nozzles 402 are configured to generate a flow' of medium including water to merge with

7 tiie laser beam 404 to the downhole target 406. External nozzles 403 are located on the outside of the lens assembly 408. External nozzles 403 can purge the hole/target area and clear a path for the laser beam 404. The purging can also result in cooling of the lens assembly 408. The retractable nozzle 405 is located at the tip of the tool. The

5 retractable nozzle 405 can include sensing cable which is connected to sensor 407 mounted on the tip of the retractable nozzles. Sensor 407 can capture the reflected beam from the downhole target 406. Sensor 407 can additionally capture black body radiation from the downhole target 406. Sensor 407 can measure optical luminosity. For example, sensor 407 can include a charge-coupled device (CCD) sensor, a

10 complementary metal oxide semiconductor (CMOS) sensor, an avalanche photodiode (APD), or a photo diode (PD). Sensor 407 can also include a spectral sensor, for example, a scanning sensor or a Fourier-transform infrared spectroscopy (FTIR) sensor. Additionally or alternatively, sensor 407 can include a coupling optical component, which is passive and which can capture light from the drilling process and then transmit

15 tiie light to an optical sensor via the sensing cable 104. The tool head can additionally include additional sensors for measuring the ambient temperature and distance of the retractable nozzle from the downhole target. In these implementations, the retractable nozzle are extendable so that the distance between the target and fiber sensor that collect the light signals can be substantially minimized.

20 [0041] Figs. 5A to 5C illustrate the retractable nozzle according to an implementation of the present disclosure. In some implementations, the retractable nozzle is made of high thermal resistance materials. Examples of materials with high thermal resistance include: Silicon Carbide, Aluminum, copper, and plastics made by 3D printers such as ABS (acrylonitrile butadiene styrene) and PET-G (polyethylene

25 terephthalate glycol-modified).

[0042] Fig. 5 A illustrates the retractable nozzle 405 in a collapsing position 501.

This is tiie position for the retractable nozzle when the laser beam is not activated or when the tool assembly is not in acquisition mode for collecting light signals.

[0043] Fig. 5B shows an example of an internal configuration 502 of a

30 retractable nozzle which includes sensing cable 104, wheels 501, and sensor 407. Sensing cable 104 may transmit the collected light signals to reach the segment in the main tool where such light signals may be analyzed for spectroscopy and luminosity. Wheels 501 can allow for retraction and extension of the retractable nozzle. Wheels 501

8 may also allow the sensing cable 104 to be attached to the nozzle and to move smoothly along with the retracting/extending nozzle. In some cases, these wheels 501 can spin when the tool expanded and collapse.

[0044] Fig. 5C shows an example of the retracting nozzle in extended mode 503

5 in which sensor 407 is brought closer to the downhole target. When the laser drilling tool assembly is in operation, die retractable nozzle is extended. In some cases, an additional sensor is mounted on the tip of the tool head 106 to measure temperature and distance range. These measurements can be judiciously used to prevent the nozzle from getting too close to the target and get damaged by, for example, excessive heat.

10 [0045] As illustrated in diagram 600 of Fig. 6, when the laser drilling tool assembly is in operational mode inside the shaft of a wellbore 202, the retractable nozzle is extended towards the downhole target. In this extended position, the distance between the tip of the retractable nozzle and the downhole target is shortened. This reduced distance can allow data acquisition to bypass the contamination caused by debris so that

15 quality measurements of the reflected light can be obtained. The articulation of the retractable nozzles can be achieved by mechanical, electrical, and hydraulic or any other configurations. For example, Fig. 5B illustrates the use of wheels 501 to control the position of the retractable nozzles. The controlling of the retractable nozzle can be asserted from the surface or can be programmed by the tool assembly so that the tool

20 assembly senses and determines the adequate amount of light being collected. As illustrated, the distance is close enough to capture the reflected light. At the same time, the tool is kept at a safe distance that prevents damage to the retractable nozzle. Some implementations may incorporate machine learning algorithms to iteratively adjust the extent of extending the retractable nozzle in view of measured temperature so that a

25 judicious trade-off is achieved where contamination due to debris generation is substantially reduced while the tool head is not at the risk of damaging the sensor or optical sensing element by virtue of affinity to the impact zone. The measurement data collected can be transmitted to the surface wirelessly or stored on memory devices located on the laser drilling tool assembly. As explained, the measurement data includes

30 data from a multipoint configuration. For example, the measurement data can include can include spectral data and luminosity data based on reflected light or black body radiation from downhole target. The measurement data can also include measurements

9 of ambient temperature and distance between the tip of the retractable nozzle and the downhole target.

[0046] Fig. 7 shows an example of real-time and in-si tu reflectance data as collected by a laser drilling tool assembly with a retractable nozzle. The acquired data is processed by an in-line spectrometer to provide a readout of the optical signals as a function of time (vertical axis) and wavelength (horizontal axis).

[0047] Fig. 8 is a block diagram illustrating an example of a computer system

800 used to provide computational functionalities associated with described algorithms, methods, functions, processes, flows, and procedures, according to an implementation of the present disclosure. The illustrated computer 802 is intended to encompass any computing device such as a server, desktop computer, laptop/notebook computer, wireless data port, smart phone, personal data assistant (PDA), tablet computing device, one or more processors within these devices, another computing device, or a combination of computing devices, including physical or virtual instances of the computing device, or a combination of physical or virtual instances of the computing device. Additionally, the computer 802 can comprise a computer that includes an input device, such as a keypad, keyboard, touch screen, another input device, or a combination of input devices that can accept user information, and an output device that conveys information associated with the operation of the computer 802, including digital data, visual, audio, another type of information, or a combination of types of information, on a graphical-type user interface (UI) (or GUI) or other UI.

[0048] The computer 802 can serve in a role in a computer system as a client, network component, a server, a database or another persistency, another role, or a combination of roles for performing the subject matter described in the present disclosure. The illustrated computer 802 is communicably coupled with a network 803. In some implementations, one or more components of the computer 802 can be configured to operate within an environment, including cloud-computing-based, local, global, another environment, or a combination of environments.

[0049] The computer 802 is an electronic computing device operable to receive, transmit, process, store, or manage data and information associated with the described subject matter. According to some implementations, the computer 802 can also include or be communicably coupled with a server, including an application server, e-mail server, web server, caching server, streaming data server, another server, or a combination of servers.

[0050] The computer 802 can receive requests over network 803 (for example, from a client software application executing on another computer 802) and respond to the received requests by processing the received requests using a software application or a combination of software applications. In addition, requests can also be sent to the computer 802 from internal users, external or third-parties, or other entities, individuals, systems, or computers.

[0051] Each of the components of the computer 802 can communicate using a system bus 803. In some implementations, any or all of the components of the computer 802, including hardware, software, or a combination of hardware and software, can interface over the system bus 803 using an application programming interface (API) 812, a service layer 813, or a combination of the API 812 and service layer 813. The API 812 can include specifications for routines, data structures, and object classes. The API 812 can be either computer-language independent or dependent and refer to a complete interface, a single function, or even a set of APIs. The service layer 813 provides software services to the computer 802 or other components (whether illustrated or not) that are communicably coupled to the computer 802. The functionality of the computer 802 can be accessible for all service consumers using this service layer. Software services, such as those provided by the service layer 813, provide reusable, defined functionalities through a defined interface. For example, the interface can be software written in JAVA, C++, another computing language, or a combination of computing languages providing data in extensible markup language (XML) format, another format, or a combination of formats. While illustrated as an integrated component of the computer 802, alternative implementations can illustrate the API 812 or the service layer 813 as stand-alone components in relation to other components of the computer 802 or other components (whether illustrated or not) that are communicably coupled to the computer 802. Moreover, any or all parts of the API 812 or the service layer 813 can be implemented as a child or a sub-module of another software module, enterprise application, or hardware module without departing from the scope of the present disclosure.

[0052] The computer 802 includes an interface 804. Although illustrated as a single interface 804 in Fig. 8, two or more interfaces 804 can be used according to particular needs, desires, or particular implementations of the computer 802. The interface 804 is used by the computer 802 for communicating with another computing system (whether illustrated or not) that is communicatively linked to the network 803 in a distributed environment. Generally, the interface 804 is operable to communicate with the network 803 and comprises logic encoded in software, hardware, or a combination of software and hardware. More specifically, the interface 804 can comprise software supporting one or more communication protocols associated with communications such that the network 803 or interface’s hardware is operable to communicate physical signals within and outside of the illustrated computer 802.

[0053] The computer 802 includes a processor 805. Although illustrated as a single processor 805 in Fig. 8, two or more processors can be used according to particular needs, desires, or particular implementations of the computer 802. Generally, the processor 805 executes instructions and manipulates data to perform the operations of the computer 802 and any algorithms, methods, functions, processes, flows, and procedures as described in the present disclosure. [0054] The computer 802 also includes a database 806 that can hold data for the computer 802, another component communicatively linked to the network 803 (whether illustrated or not), or a combination of the computer 802 and another component. For example, database 806 can be an in-memory, conventional, or another type of database storing data consistent with the present disclosure. In some implementations, database 806 can be a combination of two or more different database types (for example, a hybrid in-memory and conventional database) according to particular needs, desires, or particular implementations of the computer 802 and the described functionality. Although illustrated as a single database 806 in Fig. 8, two or more databases of similar or differing types can be used according to particular needs, desires, or particular implementations of the computer 802 and the described functionality. While database 806 is illustrated as an integral component of the computer 802, in alternative implementations, database 806 can be external to the computer 802. As illustrated, the database 806 holds the previously described data 816 including, for example, multiple streams of data from various sources, such as the measurement data from the multi -point configuration as discussed in association with Fig. 6. Measurements from the multi point configuration can include luminosity measurements, spectrum measurements, measurements of ambient temperature, and measurements of distance between the tip of the retractable nozzle and the downhole target. [0055] The computer 802 also includes a memory 807 that can hold data for the computer 802, another component or components communicatively linked to the network 803 (whether illustrated or not), or a combination of the computer 802 and another component. Memory 807 can store any data consistent with the present disclosure. In some implementations, memory 807 can be a combination of two or more different types of memory (for example, a combination of semiconductor and magnetic storage) according to particular needs, desires, or particular implementations of the computer 802 and the described functionality. Although illustrated as a single memory 807 in Fig. 8, two or more memories 807 or similar or differing types can be used according to particular needs, desires, or particular implementations of the computer 802 and the described functionality. While memory 807 is illustrated as an integral component of the computer 802, in alternative implementations, memory 807 can be external to the computer 802.

[0056] The application 808 is an algorithmic software engine providing functionality according to particular needs, desires, or particular implementations of the computer 802, particularly with respect to functionality described in the present disclosure. For example, application 808 can serve as one or more components, modules, or applications. Further, although illustrated as a single application 808, the application 808 can be implemented as multiple applications 808 on the computer 802. In addition, although illustrated as integral to the computer 802, in alternative implementations, the application 808 can be external to the computer 802.

[0057] The computer 802 can also include a power supply 814. The power supply 814 can include a rechargeable or non-rechargeable battery that can be configured to be either user- or non-user-replaceable. In some implementations, the power supply 814 can include power-conversion or management circuits (including recharging, standby, or another power management functionality). In some implementations, the power-supply 814 can include a power plug to allow the computer 802 to be plugged into a wall socket or another power source to, for example, power the computer 802 or recharge a rechargeable battery. [0058] There can be any number of computers 802 associated with, or external to, a computer system containing computer 802, each computer 802 communicating over network 803. Further, the term “client,” “user,” or other appropriate terminology can be used interchangeably, as appropriate, without departing from the scope of the present disclosure. Moreover, the present disclosure contemplates that many users can use one computer 802, or that one user can use multiple computers 802.

[0059] Implementations of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, in tangibly embodied computer software or firmware, in computer hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Software implementations of the described subject matter can be implemented as one or more computer programs, that is, one or more modules of computer program instructions encoded on a tangible, non-transitory, computer-readable computer-storage medium for execution by, or to control the operation of, data processing apparatus. Alternatively, or additionally, the program instructions can be encoded in/on an artificially generated propagated signal, for example, a machine-generated electrical, optical, or electromagnetic signal that is generated to encode information for transmission to a receiver apparatus for execution by a data processing apparatus. The computer-storage medium can be a machine- readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of computer-storage mediums. Configuring one or more computers means that the one or more computers have installed hardware, firmware, or software (or combinations of hardware, firmware, and software) so that when the software is executed by the one or more computers, particular computing operations are performed.

[0060] The term “real-time,” “real time,” “real-time,” “real (fast) time (RFT),”

“near(ly) real-time (NRT),” “quasi real-time,” or similar terms (as understood by one of ordinary skill in the art), means that an action and a response are temporally proximate such that an individual perceives the action and the response occurring substantially simultaneously. For example, the time difference for a response to display (or for an initiation of a display) of data following the individual’s action to access the data can be less than 1 millisecond (ms), less than 1 second (s), or less than 5 s. While the requested data need not be displayed (or initiated for display) instantaneously, it is displayed (or initiated for display) without any intentional delay, taking into account processing limitations of a described computing system and time required to, for example, gather, accurately measure, analyze, process, store, or transmit the data.

[0061] The terms “data processing apparatus,” “computer,” or “electronic computer device” (or equivalent as understood by one of ordinary skill in the art) refer to data processing hardware and encompass all kinds of apparatus, devices, and machines for processing data, including by way of example, a programmable processor, a computer, or multiple processors or computers. The apparatus can also be, or further include special purpose logic circuitry, for example, a central processing unit (CPU), an FPGA (field programmable gate array), or an ASIC (application-specific integrated circuit). In some implementations, the data processing apparatus or special purpose logic circuitry (or a combination of the data processing apparatus or special purpose logic circuitry) can be hardware- or software-based (or a combination of both hardware- and software-based). The apparatus can optionally include code that creates an execution environment for computer programs, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of execution environments. The present disclosure contemplates the use of data processing apparatuses with an operating system of some type, for example LINUX, UNIX, WINDOWS, MAC OS, ANDROID, IOS, another operating system, or a combination of operating systems.

[0062] A computer program, which can also be referred to or described as a program, software, a software application, a unit, a module, a software module, a script, code, or other component can be written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and it can be deployed in any form, including, for example, as a stand-alone program, module, component, or subroutine, for use in a computing environment. A computer program can, but need not, correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data, for example, one or more scripts stored in a markup language document, in a single file dedicated to the program in question, or in multiple coordinated files, for example, files that store one or more modules, sub-programs, or portions of code. A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network. [0063] While portions of the programs illustrated in the various figures can be illustrated as individual components, such as units or modules, that implement described features and functionality using various objects, methods, or other processes, the programs can instead include a number of sub-units, sub-modules, third-party services, components, libraries, and other components, as appropriate. Conversely, the features and functionality of various components can be combined into single components, as appropriate. Thresholds used to make computational determinations can be statically, dynamically, or both statically and dynamically determined. [0064] Described methods, processes, or logic flows represent one or more examples of functionality consistent with the present disclosure and are not intended to limit the disclosure to the described or illustrated implementations, but to be accorded the widest scope consistent with described principles and features. The described methods, processes, or logic flows can be performed by one or more programmable computers executing one or more computer programs to perform functions by operating on input data and generating output data. The methods, processes, or logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, for example, a CPU, an FPGA, or an ASIC.

[0065] Computers for the execution of a computer program can be based on general or special purpose microprocessors, both, or another type of CPU. Generally, a CPU will receive instructions and data from and write to a memory. The essential elements of a computer are a CPU, for performing or executing instructions, and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to, receive data from or transfer data to, or both, one or more mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices. Moreover, a computer can be embedded in another device, for example, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable memory storage device. [0066] Non-transitory computer-readable media for storing computer program instructions and data can include all forms of media and memory devices, magnetic devices, magneto optical disks, and optical memory device. Memory devices include semiconductor memory devices, for example, random access memory (RAM), read-only memory (ROM), phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices. Magnetic devices include, for example, tape, cartridges, cassettes, intemal/removable disks. Optical memory devices include, for example, digital video disc (DVD), CD-ROM, DVD+/-R, DVD-RAM, DVD-ROM, HD-DVD, and BLURAY, and other optical memory technologies. The memory can store various objects or data, including caches, classes, frameworks, applications, modules, backup data, jobs, web pages, web page templates, data structures, database tables, repositories storing dynamic information, or other appropriate information including any parameters, variables, algorithms, instructions, rules, constraints, or references. Additionally, the memory can include other appropriate data, such as logs, policies, security or access data, or reporting files. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry. [0067] To provide for interaction with a user, implementations of the subject matter described in this specification can be implemented on a computer having a display device, for example, a CRT (cathode ray tube), LCD (liquid crystal display), LED (Light Emitting Diode), or plasma monitor, for displaying information to the user and a keyboard and a pointing device, for example, a mouse, trackball, or trackpad by which the user can provide input to the computer. Input can also be provided to the computer using a touchscreen, such as a tablet computer surface with pressure sensitivity, a multi-touch screen using capacitive or electric sensing, or another type of touchscreen. Other types of devices can be used to interact with the user. For example, feedback provided to the user can be any form of sensory feedback. Input from the user can be received in any form, including acoustic, speech, or tactile input. In addition, a computer can interact with the user by sending documents to and receiving documents from a client computing device that is used by the user.

[0068] The term “graphical user interface,” or “GUI,” can be used in the singular or the plural to describe one or more graphical user interfaces and each of the displays of a particular graphical user interface. Therefore, a GUI can represent any graphical user interface, including but not limited to, a web browser, a touch screen, or a command line interface (CLI) that processes information and efficiently presents the information results to the user. In general, a GUI can include a plurality of user interface (UI) elements, some or all associated with a web browser, such as interactive fields, pull- down lists, and buttons. These and other UI elements can be related to or represent the functions of the web browser.

[0069] Implementations of the subject matter described in this specification can be implemented in a computing system that includes a back-end component, for example, as a data server, or that includes a middleware component, for example, an application server, or that includes a front-end component, for example, a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of wireline or wireless digital data communication (or a combination of data communication), for example, a communication network. Examples of communication networks include a local area network (LAN), a radio access network (RAN), a metropolitan area network (MAN), a wide area network (WAN), Worldwide Interoperability for Microwave Access (WIMAX), a wireless local area network (WLAN) using, for example, 802.11 a/b/g/n or 802.20 (or a combination of 802.1 lx and 802.20 or other protocols consistent with the present disclosure), all or a portion of the Internet, another communication network, or a combination of communication networks. The communication network can communicate with, for example, Internet Protocol (IP) packets, Frame Relay frames, Asynchronous Transfer Mode (ATM) cells, voice, video, data, or other information between networks addresses.

[0070] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

[0071] While this specification contains many specific implementation details, these should not be construed as limitations on the scope of what can be claimed, but rather as descriptions of features that can be specific to particular implementations. Certain features that are described in this specification in the context of separate implementations can also be implemented, in combination, in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations, separately, or in any sub- combination. Moreover, although previously described features can be described as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can, in some cases, be excised from the combination, and the claimed combination can be directed to a sub-combination or variation of a sub- combination.

[0072] Particular implementations of the subject matter have been described.

Other implementations, alterations, and permutations of the described implementations are within the scope of the following claims as will be apparent to those skilled in the art. While operations are depicted in the drawings or claims in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed (some operations can be considered optional), to achieve desirable results. In certain circumstances, multitasking or parallel processing (or a combination of multitasking and parallel processing) can be advantageous and performed as deemed appropriate.

[0073] Moreover, the separation or integration of various system modules and components in the previously described implementations should not be understood as requiring such separation or integration in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.

[0074] Furthermore, any claimed implementation is considered to be applicable to at least a computer-implemented method; a non-transitory, computer-readable medium storing computer-readable instructions to perform the computer-implemented method; and a computer system comprising a computer memory interoperably coupled with a hardware processor configured to perform the computer-implemented method or the instructions stored on the non-transitory, computer-readable medium.