[Title of Invention]

ENCODER, ABSOLUTE POSITIONING ENCODER METHOD, AND ABSOLUTE POSITIONING ENCODER SYSTEM

[Technical Field]

[0001]

The present disclosure relates generally to terahertz-based (absolute) positioning systems, and more particularly to decoding pseudo-random patterns from THz-band (transmission or reflection) measurements.

[Background Art]

[0002]

Conventional terahertz (THz) sensing has been applied for gas sensing, moisture analysis, package inspection, biomedical diagnosis, and security screening.

[0003]

In a raster scanning mode, a sample under inspection is illuminated by a THz point source with a time-compact source pulse and a small spot size (or aperture). The THz emitter sends a focused beam at a normal incident angle to inspect a small area (or a pixel) of the sample, the detector then samples corresponding reflected waveform via the electro-optic sampling process, and a programmable mechanical raster moves the sample in the plane perpendicular to the incidental waveform in order to measure the two-dimensional surface of the sample. The THz with the raster scanning mode is used in commercial applications with a fast scanning rate (up to 1,000 Hz). However, some key challenges is how to address the depth variations and the raster scanning induced delay/phase variation from one pixel to another, due to either the irregular sample surface, or vibration from a mechanical raster scanning process. Consequently, the depth variation (e.g., at the millimeter level) changes the reflection path lengths to the detector from one pixel to another. For the THz wave with a wavelength less than 1 mm, such depth variation results in phase distortions and causes sweep distortions in the reflected waveform, which limits the use to only a few specific applications.

[0004]

Accordingly, there is need for developing a THz sensing system that can read pseudo-random reflectance patterns using THz waves that can operate within extreme harsh environments, including operating scenarios with capabilities of penetrating environments having dust, fire and vibration, among other aspects.

[Summary of Invention]

[0005]

The present disclosure relates to providing systems and methods to terahertz-based absolute positioning systems, and more particularly to decoding pseudo-random patterns from THz-band measurements.

[0006]

Some embodiments of the present disclosure are able to read pseudo-random transmission/reflectance patterns using THz waves while operating within harsh environments, including having the capability of penetrating dust, fire, wide bandwidth and vibration.

[0007]

Some embodiments of the present disclosure are related to using THz transceivers to illuminate a scale covered by multiple layers of materials which can be penetrated by THz wave with each layer marked by a pseudo-random pattern for absolute positioning.

[0008] During experimentation, several methods were tested, one particular approach included using a raster scanning approach across multiple tracks for a given position. However, we learned that the raster scanning approach can be successful, if certain variables are below each of their specific predetermined threshold. For example, some specific variables can include motion (i.e. which needs to be below a motion threshold), vibration (i.e. needs to be below a vibration threshold), scanning time of THz sensor over a certain area (i.e. the scan time needs to be below a threshold). Otherwise, if anyone varriable is not below their individual specific predetermined threshold, then more likely the quality and operation of the raster scanning method, among other things, will mostly likely correspondingly decrease. Some reasons the raster scanning approach can be effected by these certain varriables can include, among other things, a lack or disregard of maintenance to mechanical movable parts, which can result in vibration to the raster scanning. For example, a raster scanning approach exposed to amounts of vibration can result in an operation failure of positioning systems, such as extremely high-speed absolute positioning systems, e.g., high-speed elevators.

[0009]

The second approach tested during experimentation included using multiple THz tranceivers or an array of THz tranceivers in one or two-dimensional domains, wherein each THz transceiver is aligned to a specific track. An aspect of this second approach included concerns, such as costs and compactness of the hardware components, which depending upon a user’s resources, could _, limit or prohibit deployment of a multiple THz receiver approach for some commercial applications.

[0010]

According to some embodiments of the present disclosure, an approach learned from experimentation includes using a compressed scanning scheme to decode multi-track pseudo-random transmission/reflectance patterns. At least one discovered advantage to this approach, among many discovered advantages, is that this compressed scanning scheme completely removes the problems mentioned above regarding for example the mechanical raster scanning steps. In particular, the compressed scanning scheme does not have a heavy maintenance burden of mechanical movable parts, is capable of opererating with effects of vibration, and can operate at extremely high-speed absolute positioning systems, including high-speed elevators, by non-limiting example.

[0011]

Another advantage to the compressed scanning scheme, of the many advantages, is that there is only one THz transceiver which reduces hardware cost and compactness of hardware components, and thus, overcomes our second approach concerns, noted earlier. Through experimentation with the compressed scanning scheme for THz-based absolute positioning systems, several algorithms to decode pseudo-random patterns from the THz-band measurements were created, and later found to be successful. Noted from experimentation is that compressed scanning scheme can be used in industrial applications using the THz wave with a frequency range, by non-limiting example, from 0.3 to 3 terahertz (1 THz = io ¹² Hz), and corresponding wavelengths by non-limiting example, from 1 mm to 0.1 mm (or 100 mh ). Specific applications can include positioning at elevator and train systems, content extraction from scanned layered samples, non-destructive evaluation, composite material inspection, and explosives or drugs identification.

[0012]

Another application of the pseudo-random decoding algorithm can be symbol detection for wireless communications when the transmitted symbol is subject to transmitting errors due to hardware impairments. The pseudo-random decoding algorithm maybe preferred in the massive multiple-input multiple-output (MIMO) systems where a large number of transmitting antennas is used.

[0013]

According to an embodiment of the present disclosure, an encoder including a scale with a multi-layer reflective/transmissive structure. Wherein each layer includes a matrix having rows, such that each row of the matrix corresponds to a pattern used to form a measurement. An emitter to emit a terahertz (THz) waveform to the scale while in relative motion with the scale. A receiver to measure amplitudes of the THz waveform reflected from or passing through the scale. A computer hardware memory to store data including patterns corresponding to predetermined positions of the emitter or a set of training amplitudes of reflected/transmitted THz waveforms, based on patterns of the layers from the scale. A processor to determine a position of the emitter from the measurements of the amplitudes received by the receiver based on the stored data. An output interface to render the position of the emitter.

[0014]

According to another embodiment of the present disclosure, an encoder including a scale with at least one layer reflective/transmissive structure, wherein the at least one layer includes a matrix having rows. Such that each row of the matrix corresponds to a pattern used to form a measurement. An emitter to emit a terahertz (THz) waveform to the scale while in relative motion with the scale. A receiver to measure amplitudes of the THz waveform reflected from or passing through some rows of the at least one layer of the scale. A computer hardware memory to store data including patterns corresponding to predetermined positions of the emitter or a set of training amplitudes of reflected THz waveforms, based on patterns of the at least one layer from the scale. A processor to determine a position of the emitter from the measurements of the amplitudes received by the receiver, based on the stored data. An output interface to render the position of the emitter.

[0015]

According to another embodiment of the present disclosure, an absolute positioning encoder method for an encoder. The method includes the steps of emitting by an emitter of the encoder, a Terahertz (THz) waveform while in relative motion with the scale, to a scale with a multi-layer reflective/transmissive structure. Wherein each layer of the multi-layer reflective/transmissive structure includes a matrix having rows, such that each row of the matrix corresponds to a pattern used to form a measurement. Measuring by a receiver of the encoder, amplitudes of the THz waveform reflected from some rows of each layer of the scale. Retrieving from a computer hardware memory of the encoder, stored data including patterns corresponding to predetermined positions of the emitter or a set of training amplitudes of THz waveforms, based on patterns on the multi-layer reflective/transmissive structure of the scale. Determining by a processor of the encoder, a position of the emitter from the measurements of the amplitudes received by the receiver, based on the stored data. Rendering the position of the emitter to an output interface.

[0016]

According to another embodiment of the present disclosure, an absolute positioning encoder system including an encoder, the encoder having a scale with at least one reflective/transmissive structure including a matrix having rows. Wherein the at least one layer includes a matrix having rows, such that each row of the matrix corresponds to a pattern used to form a measurement. The system includes an emitter of the encoder that emits a terahertz (THz) waveform to the scale while in relative motion with the scale. A receiver of the encoder measures amplitudes of the THz waveform reflected from, or passing through, some rows of the at least one layer of the scale. A computer hardware memory of the encoder to store data including patterns corresponding to predetermined positions of the emitter or a set of training amplitudes of reflected THz waveforms, based on patterns of the layers from the scale. A processor of the encoder to determine a position of the emitter from the measurements of the amplitudes based on the data. An output interface to render the position of the emitter.

[Brief Description of Drawings]

[0017]

[FIG. 1A]

FIG. 1A is a flow diagram illustrating an encoder that emits a waveform to a scale of a terahertz-based absolute positioning system used for decoding pseudo-random code patterns from THz-band measurements, according to embodiments of the present disclosure.

[FIG. IB]

FIG. IB is a schematic illustrating ^r an encoder, according to embodiments of the present disclosure.

[FIG. 2]

FIG. 2 is a block diagram illustrating a computer-based position information system, according to embodiments of the present disclosure.

[FIG. 3]

FIG. 3 is a block diagram illustrating a receiver to measure amplitudes of the waveform reflected from the scale, according to embodiments of the present disclosure.

[FIG. 4] FIG. 4 is a schematic illustrating a multi-layer, multi-track and multi-level encoder system, according to embodiments of the present disclosure.

[FIG. 5A]

FIG. 5A is a schematic illustrating a single track of binary coded pattern of the scale, according to embodiments of the present disclosure.

[FIG. 5B]

FIG. 5B is a schematic illustrating a multi-track of binary coded pattern of the scale, according to embodiments of the present disclosure.

[FIG. 5C]

FIG. 5C is a schematic illustrating a multi-track of multi-level coded pattern of the scale, according to embodiments of the present disclosure.

[FIG. 6A]

FIG. 6A is a schematic illustrating using a single THz transceiver to mechanically scan the multi-layer, multi-track, multi-level scale, according to embodiments of the present disclosure.

[FIG. 6B]

FIG. 6B is a schematic illustrating using multiple THz transceivers with each THz transceiver aligned with one track, according to embodiments of the present disclosure.

[FIG. 6C]

FIG. 6C is a schematic illustrating using a single THz transceiver together with collimating/focusing lenses, spatial light modulators at the THz band, according to embodiments of the present disclosure.

[FIG. 6D]

FIG. 6D is a schematic illustrating a elevator system using position encoder according to some embodiments to determine a position of the elevator car, according to embodiments of the present disclosure. [FIG. 6E]

FIG. 6E is a schematic illustrating a train system using principles of some embodiments to determine a position of a train moving on the railroad track, according to embodiments of the present disclosure.

[FIG. 7]

FIG. 7 is a block diagram illustrating a non-transitory computer readable medium embodied thereon a program executable by a processor for performing position estimation, according to embodiments of the present disclosure.

[FIG. 8A]

FIG. 8A is a schematic illustrating performance of modules of FIG. 7, according to embodiments of the present disclosure.

[FIG. 8B]

FIG. 8B is a schematic illustrating performance of modules of FIG. 7, according to embodiments of the present disclosure.

[FIG. 9]

FIG. 9 is a schematic illustrating a lookup table providing a mapping between sequences of amplitude values of the reflected wave and the position of the emitter, according to embodiments of the present disclosure. [FIG. 10 A]

FIG. 10A is a block diagram illustrating a de-biased constrained optimization approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver, according to embodiments of the present disclosure.

[FIG. 10B]

FIG. 1 OB is a block diagram illustrating a de-biased L-infmity norm regularized Minimization approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver, according to embodiments of the present disclosure.

[FIG. 10C]

FIG. 10C is a block diagram illustrating a de-biased Bayesian inference approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver, according to embodiments of the present disclosure.

[FIG. 10D]

FIG. 10D is a block diagram illustrating steps of the de-biased Bayesian inference approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver, according to embodiments of the present disclosure.

[FIG. 11 A]

FIG. 11A is a graph illustrating a truncated Gaussian mixture prior distribution for binary coefficients which is to be estimated, according to embodiments of the present disclosure.

[FIG. 1 IB]

FIG. 11B is a schematic illustrating the overall hierarchical signal model including the noise and prior distributions on the unknown coefficients and hyper-prior parameters, according to embodiments of the present disclosure.

[FIG. 12 A]

FIG. 12A is a schematic illustrating a computing apparatus that can be used to implement some techniques of the methods and systems, according to embodiments of the present disclosure.

[FIG. 12B] FIG. 12B is a schematic illustrating a mobile computing apparatus that can be used to implement some techniques of the methods and systems, according to embodiments of the present disclosure.

[Description of Embodiments]

[0018]

While the above-identified drawings set forth presently disclosed embodiments, other embodiments are also contemplated, as noted in the discussion. This disclosure presents illustrative embodiments by way of representation and not limitation. Numerous other modifications and embodiments can be devised by those skilled in the art which fall within the scope and spirit of the principles of the presently disclosed embodiments.

[0019]

The present disclosure relates to providing devices, systems and methods for a terahertz-based absolute positioning system used for decoding pseudo-random patterns from THz-band measurements, according to embodiments of the present disclosure. The system can include an encoder including a scale with a multi-layer reflective/transmissive structure includes a matrix having rows, wherein each row of the matrix corresponds to a plurality of patterns, such that each pattern is used to form a measurement. An emitter emits a THz waveform to the scale while in relative motion with the scale. A receiver can be used to measure amplitudes of the THz waveform reflected/transmitted from some rows of each layer of the scale. A computer hardware memory can store data including predetermined positions of the emitter with training amplitudes of reflected training THz waveforms, based on the patterns of the layers from the scale. Wherein one or more processor can determine a position of the emitter from the measurements of the amplitudes based on the data. Finally, an output interface can be used to render the position of the emitter. [0020]

FIG. 1A is a flow diagram illustrating an encoder that emits a waveform to a scale of a terahertz-based absolute positioning system used for decoding pseudo-random code patterns from THz-band measurements, according to embodiments of the present disclosure.

[0021]

Step 111 of FIG. 1 A includes an encoder 100A including a scale with a multi-layer reflective structure includes a matrix having rows, wherein each row of the matrix corresponds to a pattern used to form a measurement.

[0022]

Step 117 includes the encoder 100A includes an antenna to emit a THz waveform to the scale while in relative motion with the scale.

[0023]

Step 125 includes the encoder 100A having a receiver to measure amplitudes of the THz waveform reflected from some rows of each layer of the scale.

[0024]

Step 133 includes the encoder 100 A including a computer hardware memory to store data including predetermined positions of the emitter with training amplitudes of reflected training THz waveforms, based on the patterns of the layers from the scale.

[0025]

Step 137 includes the encoder 100 A having a processor to determine a position of the emitter from the measurements of the amplitudes based on the data.

[0026]

Step 139 includes the encoder 100 A including an output interface to render the position of the emitter. [0027]

Embodiments of the present disclosure provide unique aspects, by non-limiting example, contactless sensing of pseudo-random patterns can be used in the absolute positioning systems in rough environments such as low light condition, heavy dust, fast positioning time, lower hardware costs, and robust against vibration during earthquake.

[0028]

FIG. IB shows a schematic of an encoder 100B according to some embodiments of the present disclosure. The encoder 100B can be a position encoder that encodes a position, at least in part, in the absorption of a polarized waveform. To that end, the encoder 100B includes a scale 130 to encode the position based on reflection of the incident waveform 129 emitted by an emitter 121 transmitting the waveform 127 via an antenna 122.

[0029]

The encoder 100B also includes a position information system 1 10 and a THz waveform system 120, to form at least part of a position detector 101 capable of being in relative motion with the scale 130 during operation. For example, in some embodiments, the scale 130 can be fixed to a fixed body such as a railroad track of a rail system or an elevator wall of an elevator system, by non-limiting example, while the position detector 101 can be fixed to a mobile object such as a train and an elevator car, by non-limiting example. In such a manner, the encoder 100B can be used for detecting the position of the mobile object.

[0030]

Still referring to FIG. IB, the THz waveform system 120 can include an emitter 121 to emit a THz waveform to the layered structure of the scale 130. The emitter 121 can generate a waveform and transmit the waveform 127 via free space to the scale 130 from the antenna 122. [0031]

The THz waveform system 120 can include a receiver 124 to measure amplitudes of the waveform reflected 129 from the layered structure 130 and collected by an antenna 123 of the receiver 124. The measurements of the reflected waveform 129 are submitted to the position information system 110 to determine the position of the position detector 101 and/or the emitter 121 and to render the position to an output interface 141.

[0032]

Still referring to FIG. IB, the position information system 110 can include a memory 108 to store data indicative of positions of the emitter 121, wherein a processor 102 can determine a position of the emitter 121 from the measurements of the amplitudes based on the data indicative of a pattern formed by the scale 130.

[0033]

FIG. 2 shows a block diagram of a computer-based position information system 110 in accordance with some embodiments of the present disclosure. The position information system 110 can include a processor 102 configured to execute stored instructions, as well as a memory 108 that can store instructions executable by the processor. The processor 102 can be a single core processor, a multi-core processor, a computing cluster, or any number of other configurations. The memory 108 can include random access memory (RAM), read only memory (ROM), flash memory, or any other suitable memory systems. The processor 102 is connected through a bus 206 to one or more input interface / device 265 and output interface / device 141.

[0034]

These instructions stored in the memory 108 can implement a position estimation of the emitter based on reflection and absorption of the polarized wave emitted by the emitter. Notably, the emitter can be rigidly arranged within the position detector 101, and the position of the emitter can be a direct indication of the position of the position detector 101. In this disclosure, the positions of the emitter the detector are used interchangeably.

[0035]

Referring to FIG. 2, the position information system 110 of FIG. IB can also include a storage device 204 and memory 108 of FIG. IB adapted to store data 231 indicative of positions of the emitter. Specifically, the data 231 can relate positions of the wave emitter with the reflected wave signal 129 of FIG. IB, based on a pattern formed by the layered structure 130 of FIG. IB. Examples of the data 231 can include one or combination of the energy levels, track index, and layered index of reflectance coded patterns. Examples of the data 231 can also include a signal model of the reflected signal designed based on the code pattern, and a code including a sequence of bits representing the pattern.

[0036]

The storage device 204 can be implemented using a hard drive, an optical drive, a thumbdrive, an array of drives, or any combinations thereof. Additionally, or alternatively, the storage device can be implemented as the memory. In some implementations, the memories of the storage device 204 and memory 108 can be merged into one non-transitory computer readable storage medium.

[0037]

Still referring to FIG. 2, the position information system 110 of FIG. IB can include an output interface / device 141 to render the estimated position. In some embodiments, the output interface 141 may include a printer interface (not shown) adapted to connect the encoder to a printing device (not shown). In some embodiments, a display interface 247 can be adapted to connect the processor 102 to a display device 248. The display device 247 can include a camera, computer, scanner, mobile device, webcam, or any combination thereof. In some embodiments, a network interface 243 is adapted to connect the processor 102 and also potentially to one or several third party devices 244 on the network 290. In some embodiments, an application interface 245 can be used to submit the estimated position to a position based application devices 246, such as a controller, by non-limiting example, controlling the motion of the mobile object such as the elevator car or the train, by non-limiting example.

[0038]

The position information system 110 of FIG. IB can also include an input interface 265 to receive the amplitude measurements 295 of the amplitude of the reflected signal 129. For example, a network interface controller (NIC) 260 can be adapted to connect the position information system 110 of FIG. IB through the bus 206 to the network 290. The network 290 can be implemented as the wired or wireless network. Through the network 290 and/or other implementations of the input interface 265, the measurements 295 of the amplitude of the reflected signal can be downloaded and stored within the computer's storage system 208 for storage and/or further processing.

[0039]

FIG. 3 is a block diagram illustrating a receiver 124 of FIG. IB to measure amplitudes of the waveform reflected 129 of FIG. IB from the scale 130 of FIG. IB, according to embodiments of the present disclosure. The reflected signal 129 of FIG. IB is received by the antenna 123, and filtered with a filter, i.e. band-pass filter, 360 passing through the frequencies of the THz signal emitted by the emitter 121 of FIG. IB. The filter analog signal 365 is directly submitted to the position information system 110 of FIG. IB or optionally converted into a digital representation 375 by an analog-to-digital converter (ADC) 370.

[0040]

FIG. 4 is a schematic illustrating a multi-layer, multi-track and multi-level encoder system, according to embodiments of the present disclosure. Wherein the layered structure 130 of FIG. IB is illustrated as an exploded schematic 130AA, includes multiple tracks 401 of coded patterns and multiple layers 402 of coded patterns. In each track, the number 403 specifies a level of reflectance of the coded pattern in the THz band. For example, 0 means a complete absorption of THz emitted signal, while 1 means a strong reflection of THz emitted signal. The number 403 can be binary or multi-level with a pre-defmed mapping between the reflectance and the number. It is noted the THz emitted signal 127 of FIG. IB is transmitted by an antenna 122 of FIG. IB of an emitter 121 of FIG. IB. Wherein the reflected signal 129 of FIG. IB is received by an antenna 123 of FIG. IB of a receiver 124 of FIG. IB.

[0041]

FIG. 5 A shows a schematic of a single track 501 (for example, track 403 of FIG. 4), of binary coded pattern of the scale 130 (for example, 130AA of FIG. 4), where the number 503 specifies a level of reflectance of the coded pattern in the THz band. The window 505 is the size of binary coded patterns which can be used to uniquely determine the position within the maximum repetitive length. One example of forming the binary coded pattern is the pseudo-random binary sequence or, equivalently, the -sequence.

[0042]

FIG. 5B shows a schematic of a multi-track 501AA, 50 IBB, 50 ICC of binary coded pattern of the scale 130 of FIG. IB, where the number 503 specifies the level of reflectance of the coded pattern in the THz band. The window 505 is a two-dimensional box including codes from two tracks.

[0043]

FIG. 5C shows a schematic of a multi-track 501 AA, 501BB, 501CC of multi-level coded pattern of the scale 130 of FIG. IB, where the number 503 specifies the level of reflectance of the coded pattern in the THz band. The number 503 can be multi-level. Further, the window 505 can be a two-dimensional box including codes from two tracks, i.e. K, K-l .

[0044]

FIG. 6A shows a schematic of using a single THz transceiver 606 to mechanically scan the multi-layer 602, multi-track 601, multi-level scale, i.e., across the track and along the track, to receive the reflected waveforms to identify the coded pattern for the position. Alternatively, the single THz transceiver can be a transmitter, wherein the transmitted THz waveform passes through the multi-layered scale, and is received by a receiver 609. In particular, the transmitted THz waveform passes through the multi-layered / multi-level scale, and the THz waveform continues directly to the receiver 609 to identify the coded pattern for the position.

[0045]

FIG. 6B shows a schematic of using multiple THz transceivers 607 (or a THz transceiver array), wherein each THz transceiver in the array can be aligned with a single track 601. Each THz transceiver can also be able to receive the reflected waveforms to identify the coded pattern of corresponding track for the position. The THz transceiver array 607 can move simultaneously along the track direction D for absolute positioning.

[0046]

FIG. 6C shows a schematic of using a single THz transceiver 606 together with collimating/focusing lenses 611, spatial light modulators 612 at the THz band. The single transceiver 606 sends the THz waveform to the collimating lens 611. The waveform is collimated by the collimating lens 611 and then modulated by the spatial light modulator 612 with random patterns. The reflected THz waveform passes through the focusing lens 611 and detected by the single THz transceiver 606.

[0047]

FIG. 6D shows a schematic of elevator system using a position encoder according to some embodiments of the present disclosure, to determine a position of the elevator car 610. The scale 130 of FIG. IB is installed at the guide rails 650 of the elevator system. The THz position detector 620 that includes emitters and receivers, can be installed on elevator car 610, and positioned so as to transmit the THz waveform to the scale 130 and receive reflected THz waveform back from the scale 130.

[0048]

FIG. 6E shows a schematic of a train system using position decoder 101 of FIG. IB, according to some embodiments of the present disclosure, to determine a position of the train 660 moving on the railroad track 670 along the direction 665. In this particular embodiment, the position detector 101 can be installed on the train 660, while the scale 130 of FIG. IB can be arranged on or approximate the railroad track 670.

[0049]

FIG. 7 shows an exemplar schematic of a non-transitory computer readable medium 700, having embodied thereon, a program executable by a processor for performing position estimation according to different embodiments of the present disclosure. The program can be organized in a number of software modules for executing different functions of the position information system 110 of FIG. IB.

[0050] For example, the signal processing software 710 can be responsible for preparing the received signal indicative of measurements of amplitudes of the waveform reflected from the scale. For example, the signal processing software 710 can remove noise from the signal as well as normalize, sample, threshold, and/or modulate the signal. The mapping module 720 receives the processed signal and maps the processed signal to the position of the encoder.

[0051]

FIG.s 8 A and 8B show schematics of performance of the modules of FIG. 7, according to some embodiments of the present disclosure. For example, FIG. 8 A shows an illustration of the signal 810 indicative of measurements of amplitudes of the waveform, and a corresponding decoded sequence 820. The decoded sequence 820 can be a part of de Bruijn sequence encoding the position. A look-up table of length 2n can be used to determine the position decoded sequence within the entire de Bruijn sequence.

[0052]

For example, FIG. 8B shows the code 830, which is de Bruijn sequence encoding the position, and the result 840 of matching the decoded sequence 820 with the portion of the de Bruijn sequence 830 to produce the position 850.

[0053]

FIG. 9 shows a lookup table 930 providing a mapping between sequences of amplitude values of the reflected wave and the positon of the emitter according to one embodiment. In this embodiment, the processor decodes the code 931 from the measurements of the amplitudes of the reflected wave, and maps the code 931 to the position of the emitter 932.

[0054]

FIG. 10A shows a block diagram of a de-biased constrained optimization approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver. Method step 1010 receives a sequence of measurements from the compressed scanning scheme with a single THz transceiver. The next step 1020 uses the sequence of measurements to obtain an initial estimate of the coded patterns via a de-biased constrained optimization approach. For example, the de-biased constrained optimization aims to recover an estimate of binary coded patterns by minimizing the least-squared fitting criterion under the constraint that the solution can be only one of two possible values or that the solution is within a range. The initial estimate of coded patterns is then hard-thresholded 1030 with respect to a baseline. The baseline can be the middle point of the two estimated values or the estimated range. With the hard-thresholded result, one can refine the estimate of the code pattern 1040.

[0055]

FIG. 10B shows a block diagram of a de-biased L-infinity norm regularized minimization approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver. The method receives 1010 a sequence of measurements from the compressed scanning scheme with a single THz transceiver.

[0056]

The next step 1050 uses the sequence of measurements to obtain an initial estimate of the coded patterns via a de-biased L-infinity norm regularized minimization. For example, the de-biased L-infinity norm regularized minimization recovers an initial estimate of binary coded patterns by minimizing the weighted sum of the least-squared fitting criterion and the L-infinity norm of the solution.

[0057]

Referring to FIG. 10B, the initial estimate of coded patterns is then hard-thresholded 1030 with respect to a baseline. The baseline can be the middle point of the two estimated values or the estimated range. With the hard-thresholded result, one can refine the estimate of the code pattern 1040.

[0058]

FIG. 10C shows the block diagram of a de-biased Bayesian inference approach to recover the coded patterns from the compressed scanning scheme with a single THz transceiver. The method receives 1010 a sequence of measurements from the compressed scanning scheme with a single THz transceiver.

[0059]

The next step 1060 uses the sequence of measurements to obtain an initial estimate of the coded patterns via a Bayesian inference approach. For example, the Bayesian inference approach recovers an initial estimate of binary coded patterns by imposing a prior distribution on the solution and iteratively maximizing the posterior likelihood function.

[0060]

Referring to FIG. 10C, the initial estimate of coded patterns is then hard-thresholded 1030 with respect to a baseline. The baseline can be the middle point of the two estimated values or the estimated range. With the hard-thresholded result, one can refine the estimate of the code pattern 1040.

[0061]

FIG. 10D shows the detailed steps of the de-biased Bayesian inference approach 1060 of FIG. 10C, to recover the coded patterns from the compressed scanning scheme with a single THz transceiver. It includes a step 1011 to pre-process the measurements including the projection of the measurement into a subspace, a step 1021 to compute the approximated decoupled likelihood function, and a step 1031 to use the variational Bayesian inference to update the deterministic unknown parameters.

[0062] During experimentation, experiments includes THz sensing in either a reflection or transmission mode. Some experiments included gas sensing, moisture analysis, non-destructive evaluation, biomedical diagnosis, package inspection, and security screening. Learned from experimentation is that by sending an ultra-short pulse (e.g., 1-2 picoseconds), the THz system is able to inspect not only the top surface of the sample but also its internal structure, either a defect underneath the top layer or a multi-layer structure, due to its capability of penetrating a wide range of non-conducting materials. At the same time, the ultra-short pulse can also give rise to ultra-wideband spectrum over a band of several THz, providing a spectroscopic inspection of material properties of the sample, according to some experiments experimented during experimentation.

[0063]

Learned from experimentation is that the THz can operate in a raster or compressed scanning mode. In the raster scanning mode, as shown in Fig. 6A, a sample under inspection can be illuminated by a THz point source with a time-compact source pulse and a small spot size (or aperture). Also, the THz emitter can send a focused beam at a normal incident angle to inspect a small area (or a pixel) of the sample, the detector then samples corresponding reflected waveform via a electro-optic sampling process, and a programmable mechanical raster moves the sample in the plane perpendicular to the incidental waveform in order to measure the two-dimensional surface of the sample. Further learned from experimentation is that the THz with the raster scanning mode can have a fast scanning rate (up to 1000 Hz) and may be applied to, among other industrial applications, art and archaeology, quality control, thickness estimation and multi-layer content extraction. However, discovered from experimentation is at least one key challenge, that is, how to address the depth variations and its induced delay/phase variation from one pixel to another, due to either the irregular sample surface, or the vibration from the mechanical scanning process.

[0064]

What was discovered during experimentation is that in a compressed scanning mode, as shown in Fig. 6C, the THz pulse can be first collimated to a broad beam, and then spatially encoded with a random mask with the help of a spatial light modulator (SLM) that operates in the terahertz regime. Wherein, at the receiver side, the spatially encoded beam can be re-focused by a focusing lens and received by a single-pixel photoconductive detector. In other words, what was learned from experimentation is that only one measurement is formed for a mask at a time. Such that, the compressed scanning process repeats with different realizations of random masks and collects multiple sequential measurements. The sample image can then be recovered by, normally, using sparsity-driven minimization methods. Also discovered is that a total-variation minimization method can be used to reconstruct the sample image of a Chinese character,“light”, with a small number of measurements than the number of pixels.

[0065]

(Signal Model)

FIG. 1 1 A is a graph illustrating a truncated Gaussian mixture prior distribution for binary coefficients which is to be estimated, according to embodiments of the present disclosure. FIG. 11B is a schematic illustrating the overall hierarchical signal model including the noise and prior distributions on the unknown coefficients and hyperprior parameters, according to embodiments of the present disclosure.

[0066]

Let ^x ί ^{C i} · ^C2 - ·’ ^x',v ] denote a binary reflectance vector by stacking the columns of the two-dimensional reflectance matrix of the sample. As the THz source illuminates the sample from a spatially encoded mask, the received measurement can be expressed as

y = Ax + v, x„€ {/ii,M ₂ }.

where ^{A -} [ai, . . . , a,w] is the measurement matrix, ^v — fai I ^V M] ^T is the Gaussian distributed noise with zero mean and an unknown variance p y = [yi , · > VMY , M is the number of measurements, and ^m ' for ^{i = 1 ,2} are two unknown reflectance coefficients. Moreover, the

reflectance coefficient is assumed to be non-negative, i.e., ^{Xn ³ 0} . The signal model of (1) can, in fact, describe both raster and compressed scanning acquisitions:

• In the case of the raster scanning, i.e., each pixel is illuminated and measured individually, we have = N _an d A reduces to a diagonal matrix with diagonal elements responsible for the depth variation.

• In the case of the compressed scanning, we have ^{M < N} and each row of the measurement matrix A corresponds to one random mask pattern used to form one measurement ^y,n

[0067]

To account for the non-negative binary feature of x, we introduce the following hierarchical Gaussian mixture prior distribution,

where is a binary latent label variable for the pixel ^x " , and the truncated Gaussian distribution is given as

with ^m as its mean, ^{a 1} as the variance (or ^a as the precision parameter) and h as the normalization factor where is the cumulative distribution function of the standard normal distribution. In addition, the binary label vector follows an i.i.d. Bernoulli distribution with parameter ^p ,

We can show that the pixel-wise reflectance coefficient ^Xn has independent truncated Gaussian mixture prior distribution by integrating over the latent label variable ^Cn

[0068]

The resulting truncated Gaussian mixture prior distribution 1101 of ^x " is illustrated in FIG. 11(A) with pixel-dependent precision parameters, i.e., ^a " _’ ¹ and ^a " _’ ² , and two shared mean parameters and A .

[0069] Furthermore, we treat the pixel-dependent precision parameters _an( j OL 2— [<¾i.2 _? · · ; c¾/v,2] _as i .cf random variables and assume the Gamma distribution as their hyperprior distribution

(6) where Cramma(a | a,b) = G(a) ’e ^ha with a - b - 10 ⁶ f _or non-informative hyperpriors.

[0070]

Overall, the hierarchical signal model can be described in a graphical representation shown in FIG. 11(B), where blue and red circles denote observed and hidden random variables, respectively, squares denote the unknown deterministic model parameters, and diamonds denote the pre-determined user parameters ( ^p , ^a and ^b ).

[0071]

(Solutions)

In the case of binary reflection (complete absorption and reflection), the maximum likelihood (ML) estimation is given by

x = arg min y - Ax|| ² ,

C<E {0, 1 } ^N which is often computationally intractable, especially when the dimension N is large.

[0072]

The simplest relaxation of the ML estimation is to relax the feasible set to the TV dimensional space

z = arg min ||y— Az|| ² , which essentially removes the constraints and converts the discrete optimization problem into a continuous one. Since the cost function is convex in its variable, this problem has a unique minimum and the decorrelator takes the sign of the above solution

x— sign z}

[0073]

The constraint set consists of comer points of the unit hypercube (box). An effective way to find an approximated solution is to relax the constraint set to cover the whole hypercube and convert to a convex programming problem

z = arg min y - Az|| ² .

xe[o,i

Both the cost function and the constraint set are convex. Thus, it has a unique minimum. However, the optimum point does not have a closed form and one should use iterative methods to find the solution. Then the solution is hard-thresholded to produce the final binary estimate

x = sign{z}

[0074]

We can also use the L-infinity norm regularized to solve the problem of interest, particularly when the range of constraint set is not known

[z, ¾ ₁ , u ₂ ] = arg

where the hypercube constraint may not be symmetric. Denoting b = (u _! + U ₂ )/2 and c = (U ₂ -U _I )/2, the above optimization problem is equivalent to

N

a = A1 jv

where n=i . The middle point of the unknown range can be estimated as

b = (a ^T a) ¹ a ^T (y— Aw)

and the remaining optimization reduces to

[w

where (h ^T h)- is the projection matrix onto the orthogonal complement space of h, y = P _h y _an<i H = P _h H

[0075]

One way to solve this optimization problem is to use the L-infmity regularized minimization

This L-infmity regularized minimization can be solved iteratively by FITRA algorithm. Once w is estimated, we can perform the hard-threshold operation with respect to zero and estimate the coefficient c using the estimated sign.

[0076]

Another way to solve the problem of interest is to derive a variational Bayesian inference for the posterior distribution of the hidden random variables and a cost function to update the deterministic model parameters. Particularly, a two-step approach is used: First, we factorize the original likelihood function, coupled over x due to the measurement matrix A, into a pixel-wise decoupled likelihood function with the principle of GAMP. Second, with the decoupled likelihood function on x, the variational expectation-maximization (EM) algorithm is used to derive the posterior distribution and the (7-function to update the unknown model parameters.

[0077]

(Pixel-Wise Decoupled Likelihood Function)

The likelihood function of y is given by where each measurement ^y,n is coupled with all pixels . In order to enable a fast, pixel-wise Bayesian inference, we can approximate the likelihood function of y onto the pixel coefficient ” :

In other words, the approximated marginal likelihood function is given by 71 ^ N n _> ) , , roximated , r _J

v ^y where the app mean ⁿ and vanance ⁿ can be found by the GAMP algorithm. As a result, the likelihood function of y is factorized as a product of independent decoupled likelihood function of ^« with mean ^r " and variance ^r« .

[0078]

Variational Bayesian Inference: Given the decoupled likelihood function, we use the variational Bayesian framework to derive the posterior distributions of all hidden random variables ^ {x, Oί i , OL2 , c}

(circles 1204 in FIG. 12B), and then update the unknown deterministic parameters ⁼ (squares in Fig.12B) by maximizing the expectation of the complete likelihood function over the posterior distribution of the hidden variables.

[0079]

Posterior distributions of hidden variables { ^{c; ai} > ^a 2, ^c } · j _n the conventional Bayesian framework, the posterior of the hidden variables can be found via the E-step of the EM framework. Generally, the E-step is to find a probability density function ?( ^z ) which, given the current estimate of the model parameters maximizes the marginal likelihood of the measurement p( y 0) . With the variational Bayesian framework, we can factorize )q(oc ₂ )q(c) _an(j; instead of joint optimization over z, the E-step can find the optimal probability density function of each class of hidden variables, leading to

lng(x) = (lnp(y,z;0)) _{9(ei)9(t2)9(c)} + const,

1hV (a = (lnp (y, z; Q)) _{q{x)q(a2)q{c)} + const,

1hV(a ₂ ) = (lnp (y, z; Q)) _{q(x)q(ai)q{c)} + const,

1hV (c) = (lnp(y,z;0)) _{9(x)9(ei)9(ea)} + const,

where , c, 0) j _s the complete likelihood function of the observable and hidden variables and ^ is the posterior distribution of the corresponding class of hidden variables.

[0080] We start with the first class of hidden variables: the pixel-wise reflectance coefficient x. By keeping terms related to ^Xn , we can show that

( _g ΐ LG

i * ^/« = ⁱ have independent truncated Gaussian posterior distributions

where the posterior mean ^m ” and posterior variance ^s " are given as

with F = 1 - F(- ¾,/s _h ) as the normalization factor.

[0081]

For the second class of hidden variables of ^a i , its posterior distribution is the Gamma distribution

Similarly, for the third class of its posterior distribution is also the Gamma distribution

a n, 2 a+0.5<l -c„> b _{n l} = 6 + 0.5(l - c„)((x„ - /¾) ² )

with

[0083] Finally, for the latent label variable ^ , its posterior distribution is the Bernoulli distribution

ln q( ^c „) ⁼ (l„ _,i - /„ _,2 ) ^c n + const,

above parameters associated with the posterior distributions, we need the following expressions:

<C„> = (l + e ^, "’ ^2~, ”’ ^, ) ^_1 _:

where is the digamma function.

[0084]

Updating for deterministic parameters : The next step is to find an updating rule for the deterministic unknown parameters by maximizing the following ^ -function argmin(lnp(y, z; 0)) _g(z)

First derive the updating rule for the noise variance

where is the -th element of ^{w =} Ax . Then we obtain the updating rule for the two shared means A and A . With the above derivations, the corresponding ^ -function reduces to the function si ) defined as

¾ = ¹ - ^f (-« _L /¾ )' = { ¹ . ² } where the two normalization factors are a

2

\m. .

function of the hidden variables J ^J i=l and A i ¹ },. . As a result, we need to compute the expectation of over the posterior distributions of these hidden variables which results in no closed-form expressions . Instead, we replace an by their current

\nn ⁾

estimates from the previous iteration ^, i.e., ^{m /} /« ^k , 1 ⁾ - and j \n ¹¹ r ¹ Ii ^{k

,n, ² . With this approximation, the updates of A and are decoupled as

which turn out to be the weighted averages of all posterior means. With the estimated x, one can perform hard-threshold operations on x with respect to the estimated middle point, and then refine the estimate of the binary reflectance coefficients.

[0085]

Rather than relying on the sparsity assumption of the sample spatial pattern, we here exploit only the non-negative binary nature of reflectance coefficient of the sample and recover its reflectance pattern with compressed measurements. This is motivated by applications such as absolute positioning encoder systems where a non-sparse binary pseudo-random pattern (e.g., quick response (QR) code) may be used for the sample. To this end, the proposed method imposes a hierarchical truncated Gaussian mixture prior model to enforce the non-negative binary feature of the reflectance, and uses the principles of generalized approximate message passing (GAMP) and variational Bayesian inference to develop a decoupled pixel-wise iterative recovery algorithm for fast signal recovery. The key challenge here is that, to update the deterministic unknown parameters, i.e., the two unknown means of reflectance coefficients, we need to compute the expectation of the logarithm of two normalization factors (due to the truncated Gaussian mixture model) over the posterior distribution, resulting in no closed-form expressions. To address this issue, we propose an approximate, closed-form updating mle by replacing the expectations with its values from the previous iteration. The performance is numerically evaluated by using the Monte-Carlo simulation on a sample with a binary QR-like reflectance pattern.

[0086]

(Features)

According to aspects of the present disclosure, the emitter emits the THz waveform to the scale according to one of a THz compressed scanning scheme, a THz Raster scanning scheme having a single THz transceiver, or a line scanning scheme having an array of THz transceivers or some combination thereof.

[0087]

Another aspect of the present disclosure can include the emitter emits the THz waveform to the scale according to one of a THz compressed scanning scheme, a THz Raster scanning scheme having a single THz transceiver, or a line scanning scheme having an array of THz transceivers or some combinatin thereof, with reflected measurements, transmitted measurements, or both, to decode a single-row or multi-row patterns of at least one layer of the scale. Further another aspect can include the emitter emits the THz waveform to the scale according to a THz compressed scanning scheme with reflected measurements, transmitted measurements, or both, to decode a single-layer or multi-layer pseudo-random patterns for absolute positioning systems.

[0088]

Another aspect of the present disclosure can include the emitter emits the THz waveform to the scale according to a THz compressed scanning scheme, such that the THz compressed scanning scheme uses an _¥ -regularized least squared approach to decode the pseudo-random patterns with signal pre-processing steps. Further another aspect can include the emitter emits the THz waveform to the scale according to a THz compressed scanning scheme, such that the THz compressed scanning scheme uses a box-constrained optimization approach to decode the pseudo-random patterns with signal pre-processing steps.

[0089]

Another aspect of the present disclosure can include the emitter emitting the THz waveform to the scale according to a THz compressed scanning scheme, such that the THz compressed scanning scheme uses prior distributions on the reflectance/transmission coefficients of patterns to identify signal features including positiveness and binary/multi- level values, with signal pre-processing steps. Wherein the processor uses a variational Bayesian approach to recover the reflected/transmitted THz waveform or a binary/multi-level reflectance waveform of the scale. Further, wherein the variational Bayesian approach used in the processor uses approximated ^Q function in the M-step of the EM (expectation-maximization) algorithm. Further still, wherein the EM algorithm is an iterative variational EM algorithm, so as to recover binary/multi-level patterns of the scale.

[0090]

FIG. 12A is a schematic illustrating by non-limiting example a computing apparatus 1200A that can be used to implement some techniques of the methods and systems, according to embodiments of the present disclosure. The computing apparatus or device 1200 A represents various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers.

[0091]

The computing device 1200A can include a power source 1208, a processor 1209, a memory 1210, a storage device 1211, all connected to a bus 1250. Further, a high-speed interface 1212, a low-speed interface 1213, high-speed expansion ports 1214 and low speed connection ports 1215, can be connected to the bus 1250. Also, a low-speed expansion port 1216 is in connection with the bus 1250. Contemplated are various component configurations that may be mounted on a common motherboard, by non-limiting example, depending upon the specific application. Further still, an input interface 1217 can be connected via bus 1250 to an external receiver 1206 and an output interface 1218. A receiver 1219 can be connected to an external transmitter 1207 and a transmitter 1220 via the bus 1250. Also connected to the bus 1250 can be an external memory 1204, external sensors 1203, machine(s) 1202 and an environment 1201. Further, one or more external input/output devices 1205 can be connected to the bus 1250. A network interface controller (NIC) 1221 can be adapted to connect through the bus 1250 to a network 1222, wherein data or other data, among other things, can be rendered on a third party display device, third party imaging device, and/or third party printing device outside of the computer device 1200 A.

[0092]

Contemplated is that the memory 1210 can store instructions that are executable by the computer device 1200 A, historical data, and any data that can be utilized by the methods and systems of the present disclosure. The memory 1210 can include random access memory (RAM), read only memory (ROM), flash memory, or any other suitable memory systems. The memory 1210 can be a volatile memory unit or units, and/or a non-volatile memory unit or units. The memory 1210 may also be another form of computer-readable medium, such as a magnetic or optical disk.

[0093]

Still referring to FIG. 12 A, a storage device 1211 can be adapted to store supplementary data and/or software modules used by the computer device 1200A. For example, the storage device 1211 can store historical data and other related data as mentioned above regarding the present disclosure. Additionally, or alternatively, the storage device 1211 can store historical data similar to data as mentioned above regarding the present disclosure. The storage device 1211 can include a hard drive, an optical drive, a thumb-drive, an array of drives, or any combinations thereof. Further, the storage device 1211 can contain a computer-readable medium, such as a floppy disk device, a hard disk device, an optical disk device, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations. Instructions can be stored in an information carrier. The instructions, when executed by one or more processing devices (for example, processor 1209), perform one or more methods, such as those described above.

[0094]

The system can be linked through the bus 1250 optionally to a display interface or user Interface (HMI) 1223 adapted to connect the system to a display device 1225 and keyboard 1224, wherein the display device 1225 can include a computer monitor, camera, television, projector, or mobile device, among others.

[0095]

Still referring to FIG. 12 A, the computer device 1200A can include a user input interface 1217 adapted to a printer interface (not shown) can also be connected through bus 1250 and adapted to connect to a printing device (not shown), wherein the printing device can include a liquid inkjet printer, solid ink printer, large-scale commercial printer, thermal printer, UV printer, or dye-sublimation printer, among others.

[0096]

The high-speed interface 1212 manages bandwidth- intensive operations for the computing device 1200 A, while the low-speed interface 1213 manages lower bandwidth-intensive operations. Such allocation of functions is an example only. In some implementations, the high-speed interface 1212 can be coupled to the memory 1210, a user interface (HMI) 1223, and to a keyboard 1224 and display 1225 (e.g., through a graphics processor or accelerator), and to the high-speed expansion ports 1214, which may accept various expansion cards (not shown) via bus 1250. In the implementation, the low-speed interface 1213 is coupled to the storage device 1211 and the low-speed expansion port 1215, via bus 1250. The low-speed expansion port 1215, which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) may be coupled to one or more input/output devices 1205, and other devices a keyboard 1224, a pointing device (not shown), a scanner (not shown), or a networking device such as a switch or router, e.g., through a network adapter.

[0097]

Still referring to FIG. 12 A, the computing device 1200 A may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a standard server 1226, or multiple times in a group of such servers. In addition, it may be implemented in a personal computer such as a laptop computer 1227. It may also be implemented as part of a rack server system 1228. Alternatively, components from the computing device 1200 A may be combined with other components in a mobile device (not shown), such as a mobile computing device 1200B. Each of such devices may contain one or more of the computing device 1200 A and the mobile computing device 1200B, and an entire system may be made up of multiple computing devices communicating with each other.

[0098]

FIG. 12B is a schematic illustrating a mobile computing apparatus that can be used to implement some techniques of the methods and systems, according to embodiments of the present disclosure. The mobile computing device 1200B includes a bus 1295 connecting a processor 1261, a memory 1262, an input/output device 1263, a communication interface 1264, among other components. The bus 1295 can also be connected to a storage device 1265, such as a micro-drive or other device, to provide additional storage. [0099]

Referring to FIG. 12B, the processor 1261 can execute instructions within the mobile computing device 1200B, including instructions stored in the memory 1262. The processor 1261 may be implemented as a chipset of chips that include separate and multiple analog and digital processors. The processor 1261 may provide, for example, for coordination of the other components of the mobile computing device 1200B, such as control of user interfaces, applications run by the mobile computing device 1200B, and wireless communication by the mobile computing device 1200B. Contemplated are various component configurations that may be mounted on a common motherboard, by non-limiting example, 1299, depending upon the specific application.

[0100]

The processor 1261 may communicate with a user through a control interface 1266 and a display interface 1267 coupled to the display 1268. The display 1268 may be, for example, a TFT (Thin-Film-Transistor Liquid Crystal Display) display or an OLED (Organic Light Emitting Diode) display, or other appropriate display technology. The display interface 1267 may comprise appropriate circuitry for driving the display 1268 to present graphical and other information to a user. The control interface 1266 may receive commands from a user and convert them for submission to the processor 1261. In addition, an external interface 1269 may provide communication with the processor 1261, so as to enable near area communication of the mobile computing device 1200B with other devices. The external interface 1269 may provide, for example, for wired communication in some implementations, or for wireless communication in other implementations, and multiple interfaces may also be used.

[0101] Still referring to FIG. 12B, the memory 1262 stores information within the mobile computing device 1200B. The memory 1262 can be implemented as one or more of a computer-readable medium or media, a volatile memory unit or units, or a non-volatile memory unit or units. An expansion memory 1270 may also be provided and connected to the mobile computing device 1299 through an expansion interface 1269, which may include, for example, a SIMM (single in line memory module) card interface. The expansion memory 1270 may provide extra storage space for the mobile computing device 1299, or may also store applications or other information for the mobile computing device 1299. Specifically, the expansion memory 1270 may include instructions to carry out or supplement the processes described above, and may include secure information also. Thus, for example, the expansion memory 1270 may be providing as a security module for the mobile computing device 1299, and may be programmed with instructions that permit secure use of the mobile computing device 1200B. In addition, secure applications may be provided via the SIMM cards, along with additional information, such as placing identifying information on the SIMM card in a non-hackable manner.

[0102]

The memory 1262 may include, for example, flash memory and/or NVRAM memory (non-volatile random access memory), as discussed below. In some implementations, instructions are stored in an information carrier, that the instructions, when executed by one or more processing devices (for example, processor 1200B), perform one or more methods, such as those described above. The instructions can also be stored by one or more storage devices, such as one or more computer or machine readable mediums (for example, the memory 1262, the expansion memory 1270, or memory on the processor 1262). In some implementations, the instructions can be received in a propagated signal, for example, over the transceiver 1271 or the external interface 1269.

[0103]

The mobile computing apparatus or device 1200B of FIG. 12B is intended to represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart-phones, and other similar computing devices. The mobile computing device 1200B may communicate wirelessly through the communication interface 1264, which may include digital signal processing circuitry where necessary. The communication interface 1264 may provide for communications under various modes or protocols, such as GSM voice calls (Global System for Mobile communications), SMS (Short Message Service), EMS (Enhanced Messaging Service), or MMS messaging (Multimedia Messaging Service), CDMA (code division multiple access), TDMA (time division multiple access), PDC (Personal Digital Cellular), WCDMA (Wideband Code Division Multiple Access), CDMA2000, or GPRS (General Packet Radio Service), among others. Such communication may occur, for example, through the transceiver 1271 using a radio-frequency. In addition, short-range communication may occur, such as using a Bluetooth, WiFi, or other such transceiver (not shown). In addition, a GPS (Global Positioning System) receiver module 1273 may provide additional navigation and location related wireless data to the mobile computing device 1200B, which may be used as appropriate by applications running on the mobile computing device 1200B.

[0104]

The mobile computing device 1200B may also communicate audibly using an audio codec 1272, which may receive spoken information from a user and convert it to usable digital information. The audio codec 1272 may likewise generate audible sound for a user, such as through a speaker, e.g., in a handset of the mobile computing device 1200B. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.) and may also include sound generated by applications operating on the mobile computing device 1200B.

[0105]

Still referring to FIG. 12B, the mobile computing device 1200B may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a cellular telephone 1274. It may also be implemented as part of a smart-phone 1275, personal digital assistant, or other similar mobile device.

[0106]

(Embodiments)

The following description provides exemplary embodiments only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the following description of the exemplary embodiments will provide those skilled in the art with an enabling description for implementing one or more exemplary embodiments. Contemplated are various changes that may be made in the function and arrangement of elements without departing from the spirit and scope of the subject matter disclosed as set forth in the appended claims.

[0107]

Specific details are given in the following description to provide a thorough understanding of the embodiments. However, understood by one of ordinary skill in the art can be that the embodiments may be practiced without these specific details. For example, systems, processes, and other elements in the subject matter disclosed may be shown as components in block diagram form in order not to obscure the embodiments in unnecessary detail. In other instances, well-known processes, structures, and techniques may be shown without unnecessary detail in order to avoid obscuring the embodiments. Further, like reference numbers and designations in the various drawings indicated like elements.

[0108]

Also, individual embodiments may be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process may be terminated when its operations are completed, but may have additional steps not discussed or included in a figure. Furthermore, not all operations in any particularly described process may occur in all embodiments. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, the function’s termination can correspond to a return of the function to the calling function or the main function.

[0109]

Furthermore, embodiments of the subject matter disclosed may be implemented, at least in part, either manually or automatically. Manual or automatic implementations may be executed, or at least assisted, through the use of machines, hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the necessary tasks may be stored in a machine readable medium. A processor(s) may perform the necessary tasks.

[0110]

Further, embodiments of the present disclosure and the functional operations described in this specification can be implemented in digital electronic circuitry, in tangibly-embodied computer software or firmware, in computer hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Further some embodiments of the present disclosure can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a tangible non transitory program carrier for execution by, or to control the operation of, data processing apparatus. Further still, program instructions can be encoded on an artificially generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. The computer storage medium can be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of them.

[0111]

According to embodiments of the present disclosure the term“data processing apparatus” can encompass all kinds of apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers. The apparatus can include special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit). The apparatus can also include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them.

[0112]

A computer program (which may also be referred to or described as a program, software, a software application, a module, a software module, a script, or code) can be written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data, e.g., one or more scripts stored in a markup language document, in a single file dedicated to the program in question, or in multiple coordinated files, e.g., files that store one or more modules, sub programs, or portions of code. A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network. Computers suitable for the execution of a computer program include, by way of example, can be based on general or special purpose microprocessors or both, or any other kind of central processing unit. Generally, a central processing unit will receive instructions and data from a read only memory or a random access memory or both. The essential elements of a computer are a central processing unit for performing or executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks. However, a computer need not have such devices. Moreover, a computer can be embedded in another device, e.g., a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device, e.g., a universal serial bus (USB) flash drive, to name just a few.

[0113] To provide for interaction with a user, embodiments of the subject matter described in this specification can be implemented on a computer having a display device, e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user and a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input. In addition, a computer can interact with a user by sending documents to and receiving documents from a device that is used by the user; for example, by sending web pages to a web browser on a user's client device in response to requests received from the web browser.

[0114]

Embodiments of the subject matter described in this specification can be implemented in a computing system that includes a back end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front end component, e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a local area network (“LAN”) and a wide area network (“WAN”), e.g., the Internet.

[0115]

The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.