Technical Field

[0001] The present invention relates to computer modeling, and more specifically, to modeling the state of a complex physical system.

BACKGROUND

[0002] Data assimilation is a technique that combines observational data with output from a numerical model to estimate a state of a system. Data assimilation networks can include sensors that observe aspects of a physical system, such as ocean currents. The sensors can be incorporated into a model state of a numerical model of the physical system. The sensors can perform measurement, basic data processing, and communication. The model state is a representation of the variables that attempts to fully describe the actual physical state of the system. The model is used because the number of observations available can be orders of magnitude smaller than the number of values required to specify the state of the physical system. State-of-the-art physical sensors have capabilities that typically include: measurement, basic data processing, and communication. However, a large amount of effort is required in integrating noisy and redundant sensor observations with predictive systems used in monitoring and managing complex physical systems (e.g., fluid systems such as lakes).

[0003] Therefore, there is a need in the art to address the aforementioned problem.

SUMMARY

[0004] Viewed from a further aspect, the present invention provides a method of assessing a state of a physical system, the method comprising: generating a model prediction using a calibrated model of a physical system; and monitoring measured data of the physical system using a plurality of sensors connected to a routing node, wherein a first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification, and to combine the uncertainty quantification with the model prediction to output a state of the physical system.

[0005] Viewed from a further aspect, the present invention provides a system comprising: a calibrated model of a physical system configured to generate a model prediction; and a plurality of sensors monitoring measured data of the physical system and connected to a routing node, wherein a first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification, and to combine the uncertainty quantification with the model prediction to output a state of the physical system. [0006] Viewed from a further aspect, the present invention provides a computer program product for assessing a state of a physical system, the computer program product comprising a computer readable storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method for performing the steps of the invention.

[0007] Viewed from a further aspect, the present invention provides a computer program stored on a computer readable medium and loadable into the internal memory of a digital computer, comprising software code portions, when said program is run on a computer, for performing the steps of the invention.

[0008] A computer program product for assessing a state of a physical system, the computer program product comprising: a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to: generate a model prediction using a calibrated model of a physical system; and monitor measured data of the physical system using a plurality of sensors connected to a routing node, wherein a first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification, and to combine the uncertainty quantification with the model prediction to output a state of the physical system.

[0009] According to one embodiment of the present invention, a method of assessing a state of a physical system, the method comprising generating a model prediction using a calibrated model of a physical system and monitoring measured data of the physical system using a plurality of sensors connected to a routing node, where a first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification regarding the measured data and to combine the uncertainty quantification with the model prediction to output a state of the physical system.

[0010] According to another embodiment, a system includes a calibrated model of a physical system configured to generate a model prediction, and a plurality of sensors monitoring measured data of the physical system and connected to a routing node, where a first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification and to combine the uncertainty quantification with the model prediction to output a state of the physical system.

[0011] According to another embodiment, a computer program product for assessing a state of a physical system, the computer program product comprising a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to generate a model prediction using a calibrated model of a physical system, and monitor measured data of the physical system using a plurality of sensors connected to a routing node, where a first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification and to combine the uncertainty quantification with the model prediction to output a state of the physical system.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

[0012] The present invention will now be described, by way of example only, with reference to preferred embodiments, as illustrated in the following figures:

[0013] Figure 1 is block diagram of another embodiment of a computing system configured to monitor, model, and facilitate determining a state of a physical system;

[0014] Figure 2 is block diagram of another embodiment of a computing system configured to monitor and facilitate determining a state of a physical system at the sensor level;

[0015] Figures 3 is a flowchart of an embodiment of a method of performing aspects of data assimilation to model a state of a complex physical system using sensor network processes;

[0016] Figure 4 is a flowchart of an embodiment of a method of performing aspects of data assimilation to model a state of a complex physical system using local data assimilation analytics;

[0017] Figure 5 is a flowchart of an embodiment of a method of performing aspects of data assimilation to model a state of a complex physical system using core data assimilation analytics;

[0018] Figure 6 shows a block diagram of a computing system in accordance with an embodiment; and

[0019] Figure 7 further illustrates a server, such as the server of Figure 6, according to one embodiment.

DETAILED DESCRIPTION

[0020] An embodiment of a system may use data assimilation to optimally combine available observations with a numerical model in order to perform predictive analysis of the system. The system may integrate sensors within a predictive data assimilation framework by enabling advanced capabilities to the sensor. An embodiment of the system may automatically integrate noisy and redundant sensor observations with predictive systems used to monitor and manage complex physical systems, such as a fluid system in a lake.

[0021] Associated methods may output a state of the physical system using a calibrated model of the physical system. A calibrated model may be used to generate a model prediction. The system includes a plurality of sensors connected to a routing node are used to monitor measured data of the physical system. A first sensor of the plurality of sensors includes a logic module configured to determine an uncertainty quantification, and to combine the uncertainty quantification with the model prediction to output the state of the physical system. [0022] Unlike in conventional data assimilation, the system may include combining local and edge (on- sensor) analytics to generate a better data assimilation method. The edge analytics may be used to estimate sensor uncertainty and the weight attached to measurements relative to model estimate.

[0023] A particular embodiment of a system may bridge a gap between pure data collection by sensors and online predictive modeling. The predictive modeling may be oriented to decision support in management of complex physical systems. The system may include integrated sensors and predictive models within a data assimilation framework.

[0024] An embodiment of the system may estimate with high accuracy the uncertainties of measured data in real time using knowledge of the raw sensor data and a data filtering process. The system may identify sensors and parameters that may be modified in a raw data filtering process based on accuracy of corrected model predictions. An automatic calibration mechanism of the system may use feedback from the data assimilation framework at the core analytics level in order to optimize the type and parameters of the data filtering process at the sensor level.

[0025] An embodiment of the system may model a state of a complex physical system (e.g., a hurricane, lake system, or forested area). The system may use a calibrated coupled model (e.g., weather, hydrodynamics, and/or runoff models) of the physical system. The system may include a sensor network, local data assimilation analytics, and core data assimilation analytics.

[0026] The sensor network of an embodiment may include a plurality of sensors connected to the system through one or more routing nodes. The sensors may be configured to perform data acquisition, stream data filtering, and the transmission of data to a cloud or a central data warehouse. Notably, the sensors may additionally be configured to perform uncertainty quantification and may report in real time. The sensors may perform an acquisition of feedback from local and core data assimilation analytics. The sensors may also perform automatic type selection and parameter setting of a filtering mechanism using system feedback. The sensors may use a wide range of stream data filter types.

[0027] The local data assimilation analytics may include components of edge architecture, such as gateways, a messaging interface, and sensor data storage. Notably, the data assimilation analytics may be in charge of optimizing and otherwise tuning the filtering process at sensor level.

[0028] The core data assimilation analytics may include sensor observations that may be assimilated. For instance, the sensor observations may be combined with model predictions using information on uncertainty at a sensor level. The uncertainty estimation may be used dynamically according to results of model performance or after data assimilation analytics.

[0029] Parameters at the sensor level may be related to a stream data filtering process. Parameters at the core data analytics level may be related to covariance calculations used in assimilating available measurements. A heuristics process may be used to tune the parameters at both levels.

[0030] The system may include a calibrated coupled model (e.g., hydrodynamics, runoff, weather) relating to a physical system, as well as a plurality of sensors connected to a physical system through a routing node. The first sensor of the plurality of sensors may be configured to determine uncertainty quantification. The uncertainty quantification may be reported in real time. The system may combine sensor observations with model predictions using information on uncertainty at a sensor level.

[0031] An embodiment of the system may enable advanced analytic capabilities at the sensor level for the purpose of intelligently integrating physical sensing, modeling, and data assimilation. They system may perform observation processing on the sensor side synchronized with data processing at the data assimilation framework. The data processing may include processes that extend beyond simple filtering on the sensor measurements. For example, the data processing at the sensors may include synchronized filtering and data assimilation. The system may enable quality control at the sensor side guided by the data assimilation framework. One or more sensors may be configured to perform a diagnosis of the quality of the signal. An embodiment of a sensor may perform measurement noise characterization, as well as adaptive sensor polling according to feedback from the data assimilation framework. The sensor may further provide a diagnosis oriented to improving the sensor mesh network.

[0032] Data filtering may include processing data at the sensor level with the objective of reducing noise. An illustrative embodiment of data filtering may include using a low pass filter.

[0033] Data assimilation may include a process where observations from sensors of the physical system are used to correct predictions of a numerical model of the physical system of interest. Local sensor data assimilation analytics may include analytics positioned at the sensor (e.g., edge, or gateway) level to optimize a raw data stream filtering process through the tuning of parameters using feedback from a predictive accuracy at the core data assimilation analytics level.

[0034] An edge gateway may include a component capable of not only of steering sensor data traffic, but also of storing, and acting on the data. Action of an embodiment may be performed through the local data assimilation analytics. Core data assimilation analytics may combine sensor data and metadata with model predictions to improve model results. The core data assimilation analytics may also improve the data assimilation process using real-time filtered sensor data, plus information regarding an uncertainty real-time filtered sensor data.

[0035] In one particular implementation, the data assimilation system may include a network of sensor sondes deployed throughout a lake. The sensor sondes may be integrated with the local and core analytics. Each sonde of the embodiment acquires data on several environmental parameters frequently and at a constant rate.

The streams of data generated may be filtered at the sonde level to reduce noise. Accurate measurements and information about the uncertainty of the sonde sensor data may be provided by the sonde sensors in real time. The data assimilation system may tune the filtering process to obtain the best possible information at the sensor level in order to assimilate the data and data uncertainty towards improving model predictions.

[0036] Continuing with the above example, for a given variable (e.g., temperature), a sensor may collect a stream of raw data at a high sampling frequency (e.g., 4Hz). The raw data measurements may be relatively noisy due to local environmental conditions. The sensor may be equipped with a library of filters to preprocess the raw data.

[0037] Filtered data point (e.g., the output of a moving average filter) may include an associated time and time interval. The filter may have a parameter comprising a length of a rolling window. The uncertainty of the reported measurements may be estimated during the filtering process. Any other type of filter (e.g., an adaptive filter) and filter parameters may produce a different preprocessed pair.

[0038] This feature contrasts conventional sensors that neither report this uncertainty nor receive feedback to select a different filter (and its parameters). The uncertainty may be affected considerably by the filter parameters and changes with time. The parameters may be continuously tuned using feedback from the core data assimilation analytics.

[0039] Field measurements may be mapped to the physical model of the lake with a predefined spatial- temporal resolution. Data assimilation in this example may include use of an optimal interpolation scheme:

[0040] A computation and update may comprise a measurement covariance matrixes for measurements and model. The computational process may use real-time uncertainty estimates. Assimilation processes may include optimally combining data and data uncertainties, model predictions, modelling uncertainties, and covariance estimates. Output of the data assimilation analytics may be assessed in terms of improving model accuracy.

[0041] An optimization process of an embodiment of the system may tune parameters at the core data assimilation level by adjusting parameters of the state error covariance calculations (e.g., measurement uncertainties). Another or the same embodiment may turn parameters at the local data assimilation level by providing feedback to tune the data filtering parameters. The modeling system may use data assimilation to optimally combine available observations with a numerical model in order to perform predictive analysis of the physical system. Associated methods may output a state of a physical system using a calibrated model of the physical system, where the calibrated model is used to generate a model prediction. The system includes a plurality of sensors connected to a routing node are used to monitor measured data of the physical system. The system may integrate sensors within a predictive data assimilation framework by enabling advanced capabilities to the sensor. At least one of the sensors includes a logic module configured to determine an uncertainty quantification regarding the measured data and to combine the uncertainty quantification with the model prediction to output the state of the physical system. An embodiment of the system may automatically integrate noisy and redundant sensor observations with predictive systems used to monitor and manage complex physical systems.

[0042] Figure 1 is a block diagram of an embodiment of a system 100 configured to model a state of a complex physical system. The system may include a sensor network 102 comprising of a plurality of sensors 108, local data assimilation analytics 104, and core data assimilation analytics 106 (denoted by dashed boundary lines). The physical system may comprise natural forces such are present in physical systems such as: a geographical region, a water system, a gravitational system, a thermal system, and a wind system, among others.

[0043] The sensor network 102 of an embodiment may include a plurality of sensors 108 connected to the system 100 through one or more routing nodes 112. The sensors 108 may be configured to perform data acquisition, stream data filtering, and the transmission of data to a cloud or a central data warehouse. The sensors 102 may additionally be configured to perform uncertainty quantification and may report results in real time. The sensors 108 may perform an acquisition of feedback from local and core data assimilation analytics. The sensors108 may also perform automatic type selection and parameter setting of a filtering mechanism using system feedback. The sensors 108 may use a wide range of stream data filter types.

[0044] In operation, the sensor network 102 may perform processes that include the physical sensors 108- 111 acquiring environmental data at a constant rate. A filtering algorithm performed at the sensors 108 (or at a processor in communication with the sensors 108) may process the data stream to produce data that is stored in a historical database 118. The type of filtering algorithm and parameters of the filtering may be automatically optimized at the core and local data assimilation analytics levels 104, 106 and may be set accordingly at the sensor level 102. The sensors 108 may monitor and provides feedback on the measurement uncertainty (e.g., an accuracy of the measurements) based on automatic analysis during the filtering process.

[0045] The local data assimilation analytics 104 may include components of edge architecture, such as gateways, a messaging interface, and sensor data storage. The data assimilation analytics 104 may be in charge of optimizing and otherwise tuning the filtering process at sensor level. As shown in Figure 1, the local data assimilation analytics 104 may include an edge gateway module 114, a sensor messaging interface 116, sensor data storage 118, and a data assimilation analytics module 120.

[0046] Filtered sensor data may be received at the edge gateway module 114 and combined with relevant metadata to provide the filtered measurements, uncertainty characteristics, and information about the filtering process. Data may be routed to the data assimilation analytics module 120 via the sensor messaging interface 116. Local or edge analytics at the data assimilation analytics module 120 may optimize the filtering process through the tuning of parameters using feedback from predictive accuracy at the core data assimilation analytics level.

[0047] The core data assimilation analytics 106 may include sensor observations that may be assimilated. For instance, the sensor observations may be combined with model predictions using information on uncertainty at a sensor level. The uncertainty estimation may be used dynamically according to results of model performance or after data assimilation analytics.

[0048] Parameters at the sensor level may be related to a stream data filtering process. Parameters at the core data analytics level may be related to covariance calculations used in assimilating available measurements. A heuristics process may be used to tune the parameters at both levels.

[0049] As shown in the embodiment of Figure 1, the core data assimilation analytics 106 may include an observation processing module 122, a data assimilation module 124, a physical model module 126, a forcings and boundary conditions module 128, an improved model results module 130, and a data assimilation optimization module 132.

[0050] The physical model module 126 may model a state of a complex physical system (e.g., a lake system). The system may use a calibrated coupled model (e.g., hydrodynamics, runoff, and/or weather models) of the physical system.

[0051] The data assimilation module 124 may receive historical and real time sensor data from the sensor data module 118 of the local data assimilation analytics 104. The sensor data may be filtered and include an indication of its uncertainty. The data assimilation module 124 may additionally include model predictions. The model predictions may be provided by the physical model module 126 and the forcings and boundary conditions module 128. [0052] The observation processing module 122 may provide filtered observations and information concerning observation errors to the data assimilation module 124. The data assimilation module 124 may provide data assimilation feedback to the observation processing module 122.

[0053] The data assimilation module 124 may provide optimally combined observations and model results to the physical model module 126. The physical model module 126 may provide model results and information modelling errors back to the data assimilation module 124.

[0054] The data assimilation module 124 may combine the sensor data and metadata with the model predictions to improve model results. The data assimilation module 124 may optimize results by tuning the data assimilation parameters and by providing feedback for tuning the filtering/uncertainty estimation processes (e.g., provided at the sensor level).

[0055] Figure 2 is block diagram of another embodiment of a computing system 200 configured to monitor and facilitate determining a state of a physical system. All or some of the modules shown in Figure 2 may be present and executed at the sensor level, including sensor 202. As such, the sensor 202 of the system 200 may be coupled to or otherwise in communication with additional sensors 204, a core data assimilation analytics level 206, and a local data assimilation analytics level 208. For instance, the sensor module 202 may be connected directly or via a plurality of nodes 210.

[0056] The sensor module 202, or sensor, may include a processor 212, an interface 214, and a memory 216. As shown in the embodiment of the system 200 of Figure 2, the memory 216 may include stored and real time environmental data 218, a filtering algorithms module 220, and parameters 222 for using in analysis. The memory 216 may additionally include data stream data 224, historical data 226, an uncertainty measurements module 228, an analysis module 230, a real time feedback module 232, and monitoring module 234.

[0057] The system 200 may perform processes that include the physical sensors 202, 204 acquiring the environmental data 218 at a constant rate. The filtering algorithm 218 performed at the sensors 202, 204 .may process the data stream to produce data that is stored in a historical database 226. The type of filtering algorithm 218 and parameters 222 of the filtering may be automatically optimized at the core and local data assimilation analytics levels 206, 208 and may be set accordingly at the sensor level. The sensors 202, 204 may monitor and provides feedback on the measurement uncertainty based on automatic analysis during the filtering process

[0058] Figures 3-5 are flowcharts that illustrate embodiments of methods 300, 400, 500 of performing aspects of data assimilation in a manner consistent with embodiments of the system. The methods may be performed by a system, such as the illustrative system 100 of Figure 1 to model a state of a complex physical system using sensor network processes, local data assimilation analytics, and core data assimilation analytics.

[0059] Turning more particularly to the sensor network processes of the flowchart of Figure 3, the sensor network 102 at 302 may perform processes that include the physical sensors 108-111 acquiring environmental data at a constant rate. A filtering algorithm executed at the sensors 108-111 (or at a processor in communication with the sensors 108-111) may process the data stream at 304 to produce data that is stored in a historical database 118.

[0060] At 306, the type of filtering algorithm and parameters of the filtering may be automatically optimized at the core and local data assimilation analytics levels 104, 106 and may be set accordingly at the sensor level 102. The sensors 108-111 at 308 may monitor and provides feedback on the measurement uncertainty (e.g., an accuracy of the measurements) based on automatic analysis during the filtering process.

[0061] Turning more particularly to the sensor network processes of the embodiment of the method 400 shown in Figure 4, filtered sensor data may be received at the edge gateway module at 402 and combined at with relevant metadata at 404 to provide the filtered measurements, uncertainty characteristics, and information about the filtering process.

[0062] Data may be routed at 406 to the data assimilation analytics module 120 via the sensor messaging interface 116. Local or edge analytics at the data assimilation analytics module 120 may optimize the filtering process through the tuning of parameters at 408 using feedback from predictive accuracy at the core data assimilation analytics level.

[0063] Turning more particularly to the core data assimilation analytics processes of Figure 5, the data assimilation module 124 may at 502 receive historical and real time sensor data from the sensor data module 118 of the local data assimilation analytics 104. The sensor data may be filtered and include an indication of its uncertainty at 504. The data assimilation module 124 may additionally receive model predictions at 506. The model predictions may be provided by the physical model module 126 and the forcings and boundary conditions module 128.

[0064] The data assimilation module 124 may combine the sensor data and metadata with to improve model results at 508. The data assimilation module 124 may optimize results by tuning the data assimilation parameters at 510 and by providing feedback at 512 for tuning the filtering/uncertainty estimation processes (e.g., provided at the sensor level). [0065] Figure 6 illustrates another example computing system according to one embodiment, such as may be realized using a networked environment. As shown, the computing environment 600 includes a client computer 605, a web server 610, a server 615, an application 616, and an application server 620. The client computer 605 may be a physical system (e.g., a desktop, laptop computer, mobile device, etc.) or a virtual computing instance executing in the cloud. The client computer 605 includes a web browser 607. A user may access data services through the web browser 607 over a network 625 (e.g., the Internet).

[0066] For instance, a user may access a web service 612 executing on a web server 610. In one embodiment, the web service 612 provides a web interface for an application server 620 (e.g., executing an application service 622). More specifically, the application service 622 provides a database 624. The database 624 may include data presented to users on the web browser 607.

[0067] Figure 7 further illustrates a server 715, such as the server 615 of Figure 6, according to one embodiment. The server 715 generally includes a processor 704 connected via a bus to a memory 706, a network interface device 718, a storage 708, an input device 721, and an output device 724. The server 715 is generally under the control of an operating system. Examples of operating systems include the UNIX operating system, versions of the Microsoft Windows operating system, and distributions of the Linux operating system (UNIX is a registered trademark of The Open Group in the United States and other countries. Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both). More generally, any operating system supporting the functions disclosed herein may be used. The processor 704 is included to be representative of a single CPU, multiple CPUs, a single CPU having multiple processing cores, and the like. Similarly, the memory 706 may be a random access memory. While the memory 706 is shown as a single identity, it should be understood that the memory 706 may comprise a plurality of modules, and that the memory 706 may exist at multiple levels, from high speed registers and caches to lower speed but larger DRAM chips. The network interface device 718 may be any type of network communications device allowing the navigation server 710 to communicate with other computers via the network 525.

[0068] The storage 708 may be a persistent storage device. Although the storage 708 is shown as a single unit, the storage 708 may be a combination of fixed and/or removable storage devices, such as fixed disc drives, solid state drives, removable memory cards, optical storage and network storage systems.

[0069] As shown, the memory 706 contains the application 717, which may be an application generally executed to take actions described herein. Storage 708 contains the algorithms 714, filtered measurements 717, and uncertainty characteristics 719. [0070] The input device 721 may provide a keyboard and/or a mouse, etc. The output device 724 may be any conventional display screen. Although shown separately from the input device 721, the output device 724 and input device 721 may be combined. For example, a display screen with an integrated touch-screen may be used.

[0071] The descriptions of the various embodiments of the present invention have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations may be apparent to those of ordinary skill in the art without departing from the scope of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

[0072] In the following, reference is made to embodiments presented in this disclosure. However, the scope of the present disclosure is not limited to specific described embodiments. Instead, any combination of the following features and elements, whether related to different embodiments or not, is contemplated to implement and practice contemplated embodiments. Furthermore, although embodiments disclosed herein may achieve advantages over other possible solutions or over the prior art, whether or not a particular advantage is achieved by a given embodiment is not limiting of the scope of the present disclosure. Thus, the following aspects, features, embodiments and advantages are merely illustrative and are not considered elements or limitations of the appended claims except where explicitly recited in a claim(s). Likewise, reference to "the invention” shall not be construed as a generalization of any inventive subject matter disclosed herein and shall not be considered to be an element or limitation of the appended claims except where explicitly recited in a claim(s).

[0073] Aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit,” "module” or "system.”

[0074] The present invention may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.

[0075] The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.

[0076] Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.

[0077] Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.

[0078] Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It may be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

[0079] These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.

[0080] The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

[0081] The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It may also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.

[0082] Embodiments of the invention may be provided to end users through a cloud computing infrastructure. Cloud computing generally refers to the provision of scalable computing resources as a service over a network. More formally, cloud computing may be defined as a computing capability that provides an abstraction between the computing resource and its underlying technical architecture (e.g., servers, storage, networks), enabling convenient, on-demand network access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction. Thus, cloud computing allows a user to access virtual computing resources (e.g., storage, data, applications, and even complete virtualized computing systems) in "the cloud,” without regard for the underlying physical systems (or locations of those systems) used to provide the computing resources.

[0083] Typically, cloud computing resources are provided to a user on a pay-per-use basis, where users are charged only for the computing resources actually used (e.g. an amount of storage space consumed by a user or a number of virtualized systems instantiated by the user). A user can access any of the resources that reside in the cloud at any time, and from anywhere across the Internet. In context of the present invention, a user may access applications (e.g., threshold adjustment algorithms) or related data available in the cloud. For example, the modules of Figure 1 could execute on a computing system in the cloud and. In such a case, the threshold adjustment algorithms could adjust response thresholds and store the new values at a storage location in the cloud. Doing so allows a user to access this information from any computing system attached to a network connected to the cloud (e.g., the Internet).

[0084] While the foregoing is directed to embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof. While certain embodiments are applicable to spoken language systems, the claims are not limited or even particularly applicable to spoken language interfaces. In one example, an embodiment of a method may not relate to speech modality. The scope thereof is thus determined by the claims that follow.