Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHOD OF AND SYSTEM FOR BLIND EXTRACTION OF MORE THAN TWO PURE COMPONENTS OUT OF SPECTROSCOPIC OR SPECTROMETRIC MEASUREMENTS OF ONLY TWO MIXTURES BY MEANS OF SPARSE COMPONENT ANALYSIS
Document Type and Number:
WIPO Patent Application WO/2010/058230
Kind Code:
A2
Abstract:
The present invention generally relates to a computer-implemented system for processing data for the purpose of blind extraction of more than two pure components from two mixtures recorded in the fields of spectroscopy and spectrometry. Specifically, the invention is related to the application of the method of sparse component analysis, also known as underdetermined blind source separation, to blind decomposition of spectroscopic data consisting of two mixtures X into more than two pure components S and concentration matrix A. Spectroscopic data refers to data gathered by nuclear magnetic resonance (NMR) spectroscopy, electron paramagnetic resonance (EPR) spectroscopy, infrared (IR) spectroscopy, ultraviolet (UV) spectroscopy, Raman spectroscopy or mass spectrometry. Two mixtures are either analyzed in a recording domain or in a first new representation domain by using linear transform T1, wherein pure components in the first new representation domain are sparser than in the recording domain. The number of pure components and mixing matrix are estimated in either the recording domain or the first new representation domain by means of a data clustering algorithm. The pure components are estimated by means of linear programming, convex programming with quadratic constraint (l2-norm based constraint) or quadratic programming method with I1-norm based constraint in either the recording domain, the first new representation domain or the second new representation domain, wherein the second new representation domain is obtained through another linear transform T2 and the second new representation domain must be the domain where the results are presented. The estimated pure components are ranked using negentropy based criterion. Components with negentropy measure that differs 10 orders of magnitudes or more from the negentropy of the majority of the components are classified as outliers and eliminated. If pure components are estimated in the first new representation domain, inverse transform T1 -1 is applied to estimate pure components to transfrom them back into recording domain of the two mixtures.

Inventors:
IVICA KOPRIVA (HR)
IVANKA JERIC (HR)
VILKO SMRECKI (HR)
Application Number:
PCT/HR2008/000037
Publication Date:
May 27, 2010
Filing Date:
November 24, 2008
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
INST RUDJER BOSKOVIC (HR)
IVICA KOPRIVA (HR)
IVANKA JERIC (HR)
VILKO SMRECKI (HR)
International Classes:
G06K9/62
Other References:
BOFILL<1> P ET AL: "Underdetermined blind source separation using sparse representations", SIGNAL PROCESSING, ELSEVIER SCIENCE PUBLISHERS B.V. AMSTERDAM, NL, vol. 81, no. 11, 1 November 2001 (2001-11-01), pages 2353-2362, XP004308514, ISSN: 0165-1684, DOI: 10.1016/S0165-1684(01)00120-7
MOVAHEDI NAINI F ET AL: "Estimating the mixing matrix in Sparse Component Analysis (SCA) based on partial k-dimensional subspace clustering", NEUROCOMPUTING, ELSEVIER SCIENCE PUBLISHERS, AMSTERDAM, NL, vol. 71, no. 10-12, 1 June 2008 (2008-06-01), pages 2330-2343, XP022703822, ISSN: 0925-2312, DOI: 10.1016/J.NEUCOM.2007.07.035 [retrieved on 2008-02-15]
ZIBULEVSKY M ET AL: "Blind source separation by sparse decomposition in a signal dictionary", 1 January 2001 (2001-01-01), INDEPENDENT COMPONENT ANALYSIS: PRINCIPLES AND PRACTICE, CAMBRIDGE UNIVERSITY PRESS, PAGE(S) 181 - 208, XP008143700, ISBN: 978-0-521-79298-1 the whole document
PANDO GEOL'GIEV ET AL: "Sparse Component Analysis: A New Tool for Data Mining", DATA MINING IN BIOMEDICINE, SPRINGER, PAGE(S) 91 - 116 , 1 January 2007 (2007-01-01), XP008143662, ISSN: 1931-6828 ISBN: 0-387-69318-1 Retrieved from the Internet: URL:http://dx.doi.org/10.1007/978-0-387-69319-4
WEI ZHANG ET AL: "A New Two-Stage Approach to Underdetermined Blind Source Separation using Sparse Representation", 2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING 15-20 APRIL 2007 HONOLULU, HI, USA, IEEE, PISCATAWAY, NJ, USA, 15 April 2007 (2007-04-15), pages III-953, XP031463629, ISBN: 978-1-4244-0727-9
KUDO M ET AL: "Performance Analysis of Minimum>tex<$ell_1$>/tex<-Norm Solutions for Underdetermined Source Separation", IEEE TRANSACTIONS ON SIGNAL PROCESSING, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 52, no. 3, 1 March 2004 (2004-03-01), pages 582-591, XP011107793, ISSN: 1053-587X, DOI: 10.1109/TSP.2003.822284
Shoji Makino et al: "Blind Speech Separation", 1 January 2007 (2007-01-01), Springer, XP2660485, pages 271-304, page 278, paragraph 2 - page 280, paragraph 2 page 287 - page 292
FOO-TIM CHAU ET AL: "Chapter 11 Applications of wavelet transform in spectroscopic studies 0110 0229", 1 January 2000 (2000-01-01), WAVELETS IN CHEMISTRY, ELSEVIER SCIENCE PUBLISHERS B.V, NL, PAGE(S) 241 - 262, XP008143461, ISBN: 978-0-444-50111-0 [retrieved on 2007-03-25] page 242 page 246
SATU-PIA REINIKAINEN ED - ALEXEY L POMERANTSEV (ED): "Wavelets in compressing spectral data", 1 January 2005 (2005-01-01), PROGESS IN CHEMOMETRICS RESEARCH : [COLLECTED PAPERS OF SCIENTISTS, WHO PARTICIPATED IN THE THIRD WINTER SCHOOL ON CHEMOMETRICS (WSC-3) HELD IN RUSSIA, IN PUSHKINSKIE GORY VILLAGE (NEAR PSKOV CITY), 2004], NOVA SCIENCE PUBL, NEW YORK, NY, USA, PAGE(S, XP008143546, ISBN: 978-1-59454-257-2 page 28
TIMOTHY D W CLARIDGE ED - TIMOTHY D W CLARIDGE: "Chapter 2 Introducing high-resolution NMR", 1 January 2000 (2000-01-01), HIGH-RESOLUTION NMR TECHNIQUES IN ORGANIC CHEMISTRY, PERGAMON, NETHERLANDS, PAGE(S) 13 - 44, XP008143545, ISBN: 0-08-042799-5 [retrieved on 2007-06-24] page 24 - paragraph 2
ATTA-UR-RAHMAN ET AL: "Passage of Chapter 1 - The Basics of Modern NMR Spectroscopy", 1 January 1996 (1996-01-01), SOLVING PROBLEMS WITH NMR SPECTROSCOPY, ACADEMIC PRESS, US, PAGE(S) 20 - 89, XP008143540, ISBN: 0-12-066320-1 [retrieved on 2007-07-31] page 32 - page 35
Leslie D. Field: "Organic Structures from Spectra", 1 January 2008 (2008-01-01), Wiley, XP008143729, pages 32-61, page 39
TERRY M PETERS ET AL: "Chapter 4 - The Fourier Transform in Magnetic Resonance Imaging", 1 January 1998 (1998-01-01), THE FOURIER TRANSFORM IN BIOMEDICAL ENGINEERING (APPLIED AND NUMERICAL HARMONIC ANALYSIS), BIRKHÄUSER, BOSTON, MASS., USA, PAGE(S) 89 - 128, XP008143538, ISBN: 0-8176-3941-1 page 127
Attorney, Agent or Firm:
VUKMIR & ASSOCIATES (Zagreb, HR)
Download PDF:
Claims:
CLAIMS

1. Method of blind extraction of more than two pure components out of spectroscopic or spectrometric measurements of only two mixtures by means of sparse component analysis, characterised in that said blind extraction comprises the following steps: recording two mixtures data X wherein a recording domain of the two mixture data is defined by equation [I]:

X = AS [I] where S is an unknown matrix of pure components and A is an unknown mixing or concentration matrix, storing the recorded two mixtures data, transforming the two mixtures data X into a first new representation domain by using linear transform Ti wherein the transformed mixtures Tj(X) are represented by equation [H]:

T1(X)=Ar1(S) [II] and pure components in the first new representation domain defined by equation [II] are sparser than in recording domain defined by equation [I],

- estimating the number of pure components S and the mixing or concentration matrix A in the first new representation domain defined by equation [II] by means of a data clustering algorithm, provided that the results presentation domain is the recording domain of the two mixtures data, estimating the mixing or concentration matrix A and the number of the pure components 7/(S) in the first new representation domain by means of linear programming, constrained convex programming or constrained quadratic programming, inverse transforming the estimated pure components Tj(S) from the first new representation domain defined by equation [II] to the recording domain defined by equation [I] by applying the inverse of the transform Tj according to equation [IV]:

S = T1-1 (7; (S)) [IV]

- provided that the results presentation domain is the second new representation domain defined by equation [III], transforming the mixtures data from the recording domain defined by equation [I] to a second new representation domain by using linear transform T2, wherein the transformed mixtures T2(X) are represented by equation [III]:

Γ2(X)=AΓ2(S) [in] and pure components in the second new representation domain defined by equation

[III] are sparser than in recording domain defined by equation [I], estimating the pure components in the second new representation domain defined by equation [III] by means of linear programming, constrained convex programming or constrained quadratic programming, selecting the estimated pure components in accordance with the negentropy-based raking criteria, and presenting the selected pure components.

2. Method according to claim 1, wherein the linear transform T\ is a wavelet transform with either Morlet or Mexican hat wavelet.

3. Method according to claim 1 or 2, wherein the linear transform T2 is a Fourier transform.

4. Method according to any one of the preceding claims, wherein the data clustering algorithm is of the type capable to simultaneously estimate the mixing matrix and the number of pure components in the first new representation domain.

5. Method according to anyone of the preceding claims, wherein a numerical method is used to estimate the pure components in the second new representation domain that is a linear programming method, a convex programming method with quadratic constraint ( I1 -norm based constraint) or a quadratic programming method with Ix - norm based constraint.

6. Method according to any one of claims 1 to 3, wherein the linear transform T\ is a wavelet transform with the second to eight order Daubechies wavelets or symlets or coiflets of the order one to five.

7. Method according to claim 6, wherein the data clustering algorithm is of the type capable to simultaneously estimate the mixing matrix and the number of pure components in the first new representation domain.

8. Method according to claim 6 or 7, wherein a numerical method is used to estimate the pure components in the first new representation domain that is a linear programming methods, a convex programming method with quadratic constraint (^2 -norm based constraint) or a quadratic programming method with Ix -norm based constraint.

9. Method according to any one of the preceding claims, wherein said method is applied to the identification of the compounds in chemical synthesis, food quality inspection or pollution inspection i. e. environment protection.

10. Computer-readable medium having computer-executable instructions stored thereon which, when executed by a computer, will cause the computer to carry out a method according to any one of the preceding claims.

11. System for blind extraction of more than two pure components out of spectroscopic or spectrometric measurements of only two mixtures by means of sparse component analysis, comprising: a mixtures sensing device (1) for recording mixtures data X, an input storing device or medium (2) for storing the mixture data X recorded by the mixtures sensing device (1),

- a processor (3), wherein code is implemented or carried out for executing a method, according to any one of claims 1 to 9 based on the mixtures data X stored in/on the input storing device or medium (2),

- an output storing device or medium (4) for storing the result of the method carried out by the processor.

12. System according to claim 11, wherein the output storing device (4) is a printer or plotter and the output storing medium (4) is a memory based device that is computer- readable.

3. System according to claim 11 or 12, wherein the mixtures sensing device (1) is a nuclear magnetic resonance (NMR) spectrometer, ultraviolet spectrometer, IR spectrometer, electron paramagnetic resonance spectrometer, Raman spectrometer or mass spectrometer.

Description:
Method. of and system for blind extraction of more than two pure components out of spectroscopic or spectrometric measurements of only two mixtures by means of sparse component analysis

TECHNICAL FIELD

[0001] The present invention generally relates to a computer-implemented system for processing data for the purpose of blind extraction of pure components from the mixtures recorded in the fields of spectroscopy and spectrometry. Specifically, the invention relates to the application of the method of sparse component analysis (SCA), also known as underdetermined blind source separation (uBSS), to blind decomposition of two spectroscopic data (also called mixtures) into more than two pure components. Spectroscopic data refers to data gathered by nuclear magnetic resonance (NMR) spectroscopy, electron paramagnetic resonance (EPR) spectroscopy, infrared (IR) spectroscopy, ultraviolet (UV) spectroscopy, Raman spectroscopy or mass spectrometry. Identified pure components are used for identification of the compounds in chemical synthesis, food quality control, environment protection etc.

STATE OF THE ART

[0002] In a number of applications it is of interest to extract pure chemical compounds from the collections of their linear combinations also called mixtures. Quantification and identification of the components present in the mixture is a traditional problem in NMR, IR, UV, EPR and Raman spectrosopcy, mass spectrometry, etc. Identification of the spectra of mixtures proceeds in majority of the cases by matching the mixture's spectra with a library of reference compounds. This approach is ineffective with the accuracy strongly dependent on the library's content of the pure component spectra. In addition to that, for a number of new chemical compounds synthesized for proteomics and metabollomics related studies there is no library of pure components available yet. [0003] As opposed to the previous library-based approach it has been repeatedly demonstrated over the last ten years the possibility to separate mixture's spectra into pure component spectra employing the methodology known as blind source separation (BSS) that uses only the measurements of the mixture's spectra. Two widely spread methods in this domain are independent component analysis (ICA) and nonnegative matrix factorization (NMF). ICA belongs to group of statistical methods for solving blind linear inverse problems. Assumptions upon which the ICA algorithms are built are that unknown pure components are statistically independent and non-Gaussian, as well as that the number of linearly independent mixtures is greater than or equal to the number of pure components. NMF belongs to the group of algebraic methods for solving linear inverse problems. It also requires that the number of linearly independent mixtures is greater than or equal to the number of pure components as well as that pure components are nonnegative and sparse. Nonnegativity requirement and sparseness requirement are not satisfied simultaneously in a majority of spectroscopic applications. The general principle of blind extraction of pure components employing the BSS approach is schematically shown in figure 1 that will be discussed below.

[0004] One of the most known ICA algorithms is described in the patent US5706402 (B2), patent application WO 9617309 (A), as well as in the paper: A. J. Bell and T. J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation; vol. 7, pp.l 129-1159, 1995. Reference literature for the field of blind source separation and independent component analysis are: A. Hyvarinen, J. Karhunen, E. Oja. Independent Component Analysis, John Wiley, 2001; A. Cichocki, S. Amari. Adaptive Blind Signal and Image Processing, John Wiley, 2002.

[0005] We point out here that the two assumptions made by standard BSS methods: (i) the number of linearly independent mixtures is greater or equal to the unknown number of pure components; (ii) the pure comoponents are statistically independent, are not easily and always met in real world applications in spectroscopy and spectrometry. The first assumption implies that concentrations of the pure components in different mixtures are different. This is not always easy to meet in practice. Therefore a methodlogy for blind decomposition of pure components from as few mixtures as possible is of great practical importance. The second assumption implies a small level of overlapping between the pure components. This is known not to be the case in a number of occasions. Few examples include IH NMR spectroscopy, EPR spectroscopy, UV and IR spectroscopy. [0006] As described below in paragraphs, [0007]-[0012], BSS methods, mostly ICA, are used to extract pure components from the plurality of the spectroscopic or spectrometric signals. In a number of occasions it is emphasized that statistical independence among the pure components is not a correct assumption in spectroscopy and spectrometry. What is in common to the BSS methods to be elaborated is that number of linearly independent mixtures is required to be greater than or equal to the unknown number of pure components.

[0007] Review of application of ICA in signal processing for analytical chemistry is given in: G. Wang, Q. Ding, Z. Hou, "Independent component analysis and its applications in signal processing for analytical chemistry," Trends in Analytical Chemistry, vol. 27, No. 4, 368-376, 2008.

[0008] The BSS based approach to blind decomposition of the NMR spectra is presented in: D. Nuzillard, S. Bourg and J.-M. Nuzillard, "Model-Free Analysis of Mixtures by NMR Using Blind Source Separation," Journal of Magnetic Resonance 133, 358-363, 1998; D. Nuzillard, J.-M. Nuzzilard, "Application of Blind Source Separation to 1-D and 2-D Nuclear Magnetic Resonance Spectroscopy," IEEE Signal Processing Letters, vol. 5, No. 8, 209-211, 1998; K. Stadlthanner, et al. "Separation of water artifacts in 2D NOESY protein spectra using congruent matrix pencil," Neurocomputing 69, 497-522, 2006. Employed BSS methodologies assumes: (i) that the number of linearly independent mixtures is greater or equal to the unknown number of pure components; (ii) the pure comoponents are statistically independent. Statistical independence assumption has been relaxed in: W. Naanaa, J.-M. Nuzzilard, "Blind source separation of positive and partially correlated data," Signal Processing 85, 1711-1722, 2005. However it is still required that the number of linearly independent mixtures is greater than or equal to the unknown number of pure components.

[0009] The use of ICA and mean filed ICA in blind decomposition of the signals in gas chromatography-mass spectrometry (GC-MS) is elaborated respectively in: X. Shao, G. Wang, S. Wang, Q. Su, "Extraction of Mass- Spectra and Chromatographic Profiles from Overlapping GC/MS Signal with Background," Analytical Chemistry 76, 5143-5148, 2004; G. Wang, W. Cai, X. Shao, "A primary study on resolution of overlapping GC-MS signal using mean-field approach independent component analysis," Chemometrics and Intelligent Laboratory Systems 82, 137-144, 2006. The later reference elaborates a method for blind decomposition of statistically dependent spectrometric signals. However, it is still required that the number of linearly independent mixtures is greater than or equal to the unknown number of pure components.

[00010] Blind decomposition of the EPR mixture spectra is introduced in: J. Y. Ren, et al., "Free radical EPR spectroscopy analysis using blind source separation," Journal of Magnetic Resonance 166, 82-91, 2004. The standard ICA algorithm (FastICA) has been applied for blind separation of the EPR spectra. In the following reference it has been however realized that pure components in EPR spectroscopy are not statistically independent as well as that EPR spectra are sparse: C. Chang et al., "Novel sparse component analysis approach to free radical EPR spectra decomposition," Journal of Magnetic Resonance 175, 242-255, 2005. Sparseness has been used to cope with statistical dependence problem among the pure components and novel contrast function that measures sparseness of the EPR spectra is proposed in this reference. However, the number of mixtures is still required to be greater than or equal to the number of pure components.

[00011] The use of latent variable analysis, specifically non-negative ICA, for blind decomposition of Raman spectra is elaborated in: V. A. Shashilov et al., "Latent variable analysis of Raman spectra for structural characterization of proteins," Journal of Quantitative Spectroscopy & Radiative Transfer 102, 46-61, 2006. Non-negative ICA took into account non-negativity of the variables in the assumed linear mixture model but still the number of mixtures was required to be greater or equal to the unknown number of pure components.

[00012] ICA has been applied to IR spectral data analysis in: J.Chen, X.Z. Wang, "A New Approach to Near-Infrared Spectral Data Analysis Using Independent Component Analysis," J. Chem. Inf. Comput. Sci. 41, 992-1001, 2001. It is however known that pure components in the spectral domain are statistically dependent: J.M.P. Nascimento, J.M. Bioucas Dias, "Does Independent Component Analysis Play a Role in Unmixing Hyperspectral Data?," IEEE Transactions on Geoscience and Remote Sensing 43, 175-187, 2005. Because statistical independence among the pure components is the obligated condition for the ICA to work, the ICA approach to IR spectra decomposition has limited accuracy. In addition to that, the number of spectral measurements (mixtures) is still required to be greater than or equal to the unknown number of pure components. [00013] Paragraphs, [0014]-[0031], discuss patents and patent applications related to BSS concepts that fall into two categories: those that are claimed for applications in spectroscopy and spectrometry and those that solve the BSS problem using two mixtures only. The methods of the first category still require the number of mixtures to be greater than or equal to the number of pure components. The methods of the second category are based on assumptions made on the structure of the source signals that are specific to application domain (voice signals) what disables their applicability in the fields of spectroscopy and spectrometry.

[00014] The US patent application 20040111220 "Methods of decomposing complex data" presents a method for blind decomposition of the mixture matrix that is a statistically based data mining technique. It claims applications in spectroscopy, spectrometry, genomics, proteomics, etc. It however requires the number of mixtures to be greater than the number of the unknown components. This is evident at the first stage of the algorithm where principal component analysis (PCA) is used to remove outlier and noisy components from data. This is done by inspecting eigenvalues of the data co variance matrix wherein the overall number of eigenvalues equals the number of mixtures. Thus, this method can not work when number of mixtures is smaller than number of pure components.

[00015] The US patent application 20070252597 "Magnetic resonance spectroscopy with sparse spectral sampling and interleaved dynamic shimming" is related to 4D (three spatial and one spectral dimension) magnetic resonance spectroscopy and is characterized by sparse sampling across spectral dimension. Here sparseness of the components is a consequence of the multidimensionality of the data, i.e. sensing device.

[00016] The patent application WO2007138544 "Coding and decoding: seismic data modeling, acquisition and processing" presents a method for blind decomposition of seismic data. In said application uBSS problem is converted to determined problem generating new equations by means of higher order statistics. This is however specific for the seismic data processing domain only.

[00017] The patent application CN 1932849 "Initial method for image independent component analysis" exploits sparseness of the data in wavelet domain in order to obtain more accurate estimate of the mixing matrix. The estimate of the mixing matrix is then used as the initial condition for standard ICA algorithms. Thus, said application is essentially related to even- or over-determined BSS problems that require the number of mixtures to be greater than or equal to the number of pure components.

[00018] The patent application WO2007112597 "Blind extraction of pure component mass spectra from overlapping mass spectrometric peaks" is related to blind extraction of the pure components from recorded multicomponent gas chromatography-mass spectrometric signals (mixtures) by means of entropy minimization approach. It also estimates the unknown number of the pure components based on the ranking of the singular values of the sample data covariance matrix and discarding the small singular values that are attributed to chemical noise. Thus, said application ultimately requires the number of mixtures to be greater than the unknown number of pure components.

[00019] The US Patent 7,295,972 "Method and apparatus for blind source separation using two sensors" is related to a novel algorithm for blind extraction of multiple source signals from two mixtures only. The method transforms mixtures into frequency domain and employs the strategy that is similar to famous DUET algorithm (Blind Separation of Disjoint Orthogonal Signals: Demixing n sources from 2 mixtures, by A. Jourjine, S. Rickard, and O. Yilmaz, in Proc. Int. Conf. on Acoust, Speech, Signal Processing, 2000, vol. 5, pp. 2985- 2988) where specific assumption on disjoint orthogonality is made. The requirement of this assumption is that only one source signals exist at the point in the time-frequency plane. This assumption is very restrictive and seems to be approximately true for the voice signals only. Thus said method is not applicable to the field of spectroscopy and spectrometry where pure components exist simultaneously in time and frequency (few examples include 1 H NMR and EPR signals).

[00020] The US Patent 7,280,943 "Systems and methods for separating multiple sources using directional filtering," is related to semi-blind extraction of multiple source signals from one or more received signals. The method is semi-blind because it assumes that each source signals can be represented by a set of known basis functions and directional filters that incorporate prior knowledge on the type of the sources and their directions of arrival. The last assumption surely does not hold when spectroscopy and spectrometry are considered as application domains. This is because the signals arising in spectroscopy and spectrometry do not have spatial structure, i.e. there are no distinct spatial locations to which the pure component signals can be associated and there are no distinct spatial locations of the receiving sensors (the multiple mixtures are acquired over different time slots or different wavelengths).

[00021 ] The US Patent 7,010,514 "Blind signal separation system and method, blind signal separation program and recording medium thereof presents a solution of the BSS problems, including uBSS problem, using probabilistic approach known as maximum likelihood (M.S. Lewicki et. al., "Learning Overcomplete Representations," Neural Computation, vol. 12, pp. 337-365, 2000.). It is assumed in the patent that the number of sources (also called pure components) is known. This is a first significant limitation of said patent. Probabilistic maximum likelihood approach implies that prior distribution of the unknown pure components is known in order to obtain the learning equation for the unknown mixing matrix. Because related uBSS problem can be solved only if sources have proper degree of sparseness this implies that problem must be transformed into the basis with enough degree of sparseness. Then, in order to obtain mathematically tractable learning rule for the mixing matrix, the Laplacian distribution is assumed for the prior distribution of the sources in the given basis. This is a second significant limitation of said patent. In practice we can not dictate distribution of the sources in the chosen basis because the number of available bases is limited and most frequently used basis, such as Fourier or wavelet basis, do not represent all types of signals with the same degree of sparseness. Therefore assumed Laplacian distribution of the sources will in reality deviate from the true distribution and this will be the source of errors in estimation of the mixing matrix.

[00022] The US Patent 6,944,579 "Online blind source separation," aims to extract multiple source signals from two mixtures only. The method transforms mixtures into time-frequency domain and employs the strategy of the algorithm published in: Blind Separation of Disjoint Orthogonal Signals: Demixing n sources from 2 mixtures, by A. Jourjine, S. Rickard, and O. Yilmaz, in Proc. Int. Conf. on Acoust, Speech, Signal Processing, 2000, vol. 5, pp. 2985- 2988. The specific request of patented algorithm is that source signals are disjointly orthogonal in time-frequency plane. It is empirically known that this assumption is fulfilled for the voice signals. However, there is no rational to believe that it will be fulfilled for arbitrary type of signals such as for example those that arise in the fields of spectroscopy or spectrometry. The reason is that pure components residing in the spectroscopic mixture signals are active simultaneously in time and frequency. Hence, said method is not applicable to the fields of spectroscopy or spectrometry. [00023] The US Patent 6,577,966 Optimal ratio estimator for multisensor system," aims to extract multiple source signals from two mixtures only. Separation method based on optimal ratio estimation is possible provided that source signals do not overlap in time-frequency domain. As already commented this assumption approximately holds for the voice-type of signals and the purpose of said method is separation of multiple voice signals from two- microphone recordings. As already discussed in the previous paragraph it is not realistic to expect for arbitrary type of signals, such as those arising for example in the fields of spectroscopy of spectrometry, not to overlap in time-frequency plane. The reason is that pure components residing in the spectroscopic mixture signals are active simultaneously in time and frequency. Hence, said method is not applicable to the fields of spectroscopy or spectrometry.

[00024] The US Patent Application 20070257840 "Enhancement Techniques for Blind Source Separation," is related to improving performance of the BSS algorithms for separation of audio signals from two microphone recordings. Decorrelation based pre- and post-filtering (least means square filtering) is applied to the first and second microphone signals for the enhancement purpose. The method assumes that a first microphone is in the proximity of a first source signal and a second microphone is in the proximity of a second source signal. In this sense the known method is very limited and can not be applied to the field of spectroscopy and spectrometry where mixtures are obtained over time or wavelength (there is no plurality of the physical sensors) and more than two sources (pure components) exist.

[00025] The US patent application 20060064299 "Device and method for analyzing an information signal," is related to extraction of multiple audio signals from single mixture. The method splits the mixture into plurality of component signals and finds information content of each component .signal based on calculation of their features; wherein feature is defined so that it is correlated with two source signals in two different subspaces. The features are audio signal specific and that is what limits this patent application to separate audio signals only. Hence, the algorithm presented in cited patent application is not applicable to the type of signals that arise in the fields of spectroscopy and spectrometry.

[00026] The US patent application 20060058983 "Signal separation method, signal separation device, signal separation program and recording medium," presents a signal separation algorithm capable to separate multiple source signals from multiple mixtures wherein the number of sources can be greater than the number of mixtures. The algorithm relies on standard concept when dealing with uBSS problems: transforming mixtures into frequency domain, performing data clustering to estimate number of sources and performing frequency domain ICA at those frequencies where two or more sources are active. Thus, the algorithm in cited patent applications has the following deficiencies: (i) the number of sensors must be greater than two if more than two sources are active at the same frequency; (ii) in relation to comment (i) Fourier basis (frequency domain), that is used by the cited application, is not optimal for the type of signals that arise in spectroscopy.

[00027] The US patent application 20050032231 "Identifying component groups with independent component analysis," presents ICA based solution for blind decomposition of multivariate spectrometric data. The solution of the cited application has the following deficiencies: (i) because the blind decomposition problem is solved by ICA the number of mixtures must be greater than or equal to the unknown number of pure components; (ii) because ICA is used to solve blind decomposition problem pure component must be statistically independent what is known not to be generally true for pure components arising in spectrometry: G. Wang et. al., "A primary study on resolution of overlapping GC-MS signal using mean-field approach independent component analysis," Chemometrics and Intelligent Laboratory Systems 82, 137-144, 2006; W. Naanaa, J.-M. Nuzzilard, "Blind source separation of positive and partially correlated data," Signal Processing 85, 1711-1722, 2005. Hence, the algorithm presented in cited application can not separate more than two spectroscopic signals that are statistically dependent using two mixtures only.

[00028] The US patent application 20030088384 "Chemical substance classification apparatus, chemical substance classification method, and program" presents an ICA based solution for blind decomposition of multivariate chemical substance data. The same comments apply as in relation to the previously cited US patent application 20050032231.

[00029] The patent application WO2008076680 (US2008147763) "Method and Apparatus for Using State Space Differential Geometry to Perform Nonlinear Blind Source Separation," presents quite general state space differential geometry based approach to nonlinear blind source separation. The set of application domains covered by claims is quite wide. The main assumption of the algorithm proposed in the cited application is that the number of mixtures that contain possibly nonlinear combinations of the pure component signals is greater than or equal to the number of pure components as well as that pure component signals are statistically independent. Hence, algorithm presented in the cited application can not separate more than two spectroscopic signals that are statistically dependent using two mixtures only.

[00030] The patent application WO2007103037 (US2007004966) "System and Method for Generate a Separated Signal," applies a concept of independent vector analysis to separate multiple source signals from multiple mixtures whereas the number of mixtures must be greater than or equal to the number of source signals. Hence, the algorithm presented in the cited application can not separate more than two spectroscopic signals using two mixtures.

[00031] The patent application US2006256978 "Sparse signal mixing model and application to noisy blind source separation," presents an algorithm for blind extraction of two or more signals from two mixtures only by transforming measured signals into time-frequency domain. The fundamental assumption made on the two source signals is that they are disjointly orthogonal, i.e. that at each time-frequency location only one source signal exists. This assumption is quite restrictive and even in the cited application it is stated that it approximately holds for voice signals only. The known method will not work in the case of spectroscopic signals because the pure components are simultaneously active in time and frequency.

[00032] Accordingly, it is the aim of the present invention to provide a method and system for blind extraction of more than two pure components that requires measurement of two mixtures only in spectroscopy and spectrometry.

[00033] This aim is achieved by a method of blind extraction of more than two pure components out of spectroscopic or spectrometric measurements of only two mixtures by means of sparse component analysis, characterised in that said blind extraction comprises the following steps:

- recording two mixtures data X wherein a recording domain of the two mixtures data is defined by equation [I]:

X = AS [I] where S is an unknown matrix of pure components and A is an unknown mixing or concentration matrix, - storing the recorded two mixtures data,

- transforming the two mixtures data X into a first new representation domain by using linear transform Ti, wherein the transformed mixtures Ti(X) are represented by equation [H]:

T 7 (X)=Ar 7 (S) [H] and pure components in the first new representation domain defined by equation [II] are sparser than in recording domain defined by equation [I],

- estimating the number of pure components S and the mixing or concentration matrix A in the first new representation domain defined by equation [II] by means of a data clustering algorithm,

- provided that the results presentation domain is the recording domain of the two mixtures data, estimating the mixing or concentration matrix A and the number of the pure components Ti(S) in the first new representation domain by means of linear programming, constrained convex programming or constrained quadratic programming, inverse transforming the estimated pure components Ti (S) from the first new representation domain defined by equation [II] to the recording domain defined by equation [I] by applying the inverse of the transform Ti according to equation [IV]:

S=T 1 ^(T 1 (S)) [IV]

- provided that the results presentation domain is the second new representation domain defined by equation [III], transforming the mixtures data from the recording domain defined by equation [I] to the second new representation domain by using linear transform T 2, wherein the transformed mixtures T 2 (X) are represented by equation [III]:

Γ 2 (X)=AΓ 2 (S) [in] and pure components in the second new representation domain defined by equation [III] are sparser than in recording domain defined by equation [I],

- estimating the pure components in the second new representation domain defined by equation [III] by means of linear programming, constrained convex programming or constrained quadratic programming,

- selecting the estimated pure components in accordance with the negentropy-based raking criteria, and

- presenting the selected pure components.

[00034] Further, this aim is achieved by a system for blind extraction of more than two pure components out of spectroscopic or spectrometric measurements of only two mixtures by means of sparse component analysis, comprising: a mixtures sensing device (1) for recording mixtures data X, " an input storing device or medium (2) for storing the mixture data X recorded by the mixtures sensing device (1), a processor (3), wherein code is implemented or carried out for executing a method, according to any one of the claims 1 to 9 based on the mixtures data X stored in/on the input storing device or medium (2), an output storing device or medium (4) for storing the result of the method carried out by the processor.

[00035] According to a preferred embodiment of the method, the linear transform 7 / is a wavelet transform with either Morlet or Mexican hat wavelet.

[00036] Furthermore or alternatively, the linear transform T 2 can be a Fourier transform.

[00037] Preferably, the data clustering algorithm is of the type capable to simultaneously estimate the mixing matrix and the number of pure components in the first new representation domain.

[00038] Advantageously, a numerical method is used to estimate the pure components in the second new representation domain that is a linear programming method, a convex programming method with quadratic constraint ( 2 -norm based constraint) or a quadratic programming method with • -norm based constraint.

[00039] According to further preferred embodiment, a linear transform Tj is a wavelet transform with the second to eight order Daubechies wavelets or symlets or coiflets of the order one to five.

[00040] In particular, the data clustering algorithm is of the type capable to simultaneously estimate the mixing matrix and the number of pure components in the first new representation domain.

[00041] Furthermore, a numerical method can be used to estimate the pure components in the first new representation domain that is a linear programming methods, a convex programming method with quadratic constraint ( 2 -norm based constraint) or a quadratic programming method with ' -norm based constraint. [00042] Advantageously, a computer-readable medium having computer-executable instructions stored thereon which, when executed by a computer, will cause the computer to carry out a method of the present invention.

[00043] Preferably, said method is applied to the identification of the chemical compounds in chemical synthesis, food quality inspection or pollution inspection i. e. environment protection.

[00044] In a preferred embodiment of the system, the output storing device can be a printer or plotter and the output storing medium can be a memory base device that is computer- readable.

[00045] Finally, a preferred embodiment, the mixtures sensing device is a nuclear magnetic resonance (NMR) spectrometer, ultraviolet spectrometer, IR spectrometer, electron paramagnetic resonance spectrometer, Raman spectrometer or mass spectrometer.

BRIEF DESCRIPTION OF DRAWINGS

[00046] In the sequel a more detailed description of the invention will be given with references to the following figures, in which: figure 1 schematically illustrates a block diagram of a device for blind decomposition of spectroscopic or spectrometric data into more than two pure components using two mixtures only and employing methodology of sparse component analysis and underdetermined blind source separation according to an embodiment of the present invention; figures 2A to 2F demonstrate a concept of sparse component analysis by blind extraction of four sinusoid signals with different frequencies from two mixtures; figure 3 shows positions of the three unit length mixing vectors in the coordinate system defined by mixtures xi and X 2 ; figures 4A and 4B show the real part of a time domain 1 H NMR signal (pure component) and Morlet wavelet at the corresponding scale; figure 5 shows a normalized absolute value of wavelet coefficients vs. scale (resolution levels) and time shifts that are obtained by transforming time domain 1 H NMR data shown in drawing 4 A to the scale-time shift domain by means of continuous wavelet transform and Morlet wavelet; figures 6A to 6K demonstrate experimentally blind extraction of three pure components and two outliers from two 1 H NMR mixtures by means of sparse component analysis; figures 7A to 71 demonstrate experimentally blind extraction of three pure components from two 13 C NMR mixtures by means of sparse component analysis; figures 8A to 8H demonstrate experimentally blind extraction of two pure components and one outlier from two UV mixtures by means of sparse component analysis; and figures 9A to 91 demonstrate experimentally blind extraction of two pure components and one outlier from two IR mixtures by means of sparse component analysis.

[00047] A schematic block diagram of a device for blind decomposition of spectroscopic or spectrometric data into more than two pure components using two mixtures only defined by equation [I] and employing methodology of sparse component analysis and underdetermined blind source separation according to an embodiment of the present invention is shown in figure 1. The device consists of: mixtures sensing device 1 used to gather spectroscopic or spectrometric data; storing device 2 used to store gathered spectroscopic or spectrometric data; CPU 3 or computer where algorithms for sparse component analysis and underdetermined blind source separation are implemented for blind extraction of pure components from gathered spectroscopic or spectrometric data; and output device 4 used to store and present extracted pure components.

[00048] The procedure for processing gathered and stored spectroscopic or spectrometric mixture data with the aim to blindly extract pure components is implemented in the software or firmware in the CPU 3 and according to an embodiment of the present invention consists of the following steps: two recorded mixtures defined by equation [I] are transformed by linear transform Ti into the first new representation domain defined by equation [II] with the aim to increase sparseness of the pure components; the transformed mixtures equation [II] are used for estimation of the number of pure components and estimation of the mixing matrix (also called concentration matrix); based on the estimated mixing matrix pure components are estimated by either linear programming, convex programming with constraints or quadratic programming with constrains using two mixtures in the first new representation domain defined by equation [II] or the second new representation domain defined by equation [III] that are obtained by transforming two mixtures from recording domain defined by equation

[I] by another linear transform Tf, if the first new representation domain defined by equation

[II] in which pure components are estimated is not the domain in which results are presented, estimated components are transformed into recording domain defined by equation [I] by applying on the estimated pure components inverse of the transform Ti, blindly extracted pure components are stored and presented in the final form on the output device or medium 4.

[00049] In detail, according to an embodiment of the present invention procedure for extraction of the pure components using sparse component analysis for blind decomposition of the recorded two mixtures of spectroscopic or spectrometric data consists of the following steps:

- recording two mixtures data X defined by equation [I] with mixtures sensing device 1 , for e.g. nuclear magnetic resonance spectroscopy, infrared spectroscopy, ultraviolet spectroscopy, electron paramagnetic resonance spectroscopy, Raman spectroscopy or mass spectrometry, wherein mixtures are defined as a product of an unknown mixing matrix A. (also called concentration matrix) and matrix of the unknown pure components S,

- transforming two recorded mixtures data X having an original domain represented by equation [I] into a first new representation domain defined by equation [II] by means of the linear transform T \ , wherein transformed mixtures T 1 (X) represented by equation [H] are defined as a product of the mixing matrix A and transformed matrix of the pure components Ti(S), estimating the mixing matrix A and number of pure components S in the first new representation domain Ti(X) defined by equation [II] by means of a data clustering algorithm, - estimating the pure components T 1 (S) in the first new representation domain defined by _equation [II] or pure components T 2 (S) in the second new representation domain defined by equation [III] (obtained by transforming two recorded mixtures defined by equation [I] by another linear transform T 2 ) by means of linear programming, convex programming with constraints or quadratic programming with constrains,

- provided-mat the first new representation domain defined by equation [II] is not the domain where final results are presented estimated pure components are transformed into the results presentation domain that coincides with the recording domain defined by equation [I] by applying inverse of the transform T 1 on estimated pure components Ti(S) (see equation [IV]), selecting estimated pure components of interest in accordance with negentropy-based ranking criteria, and

- storing and presenting selected pure components at the chosen output device 4.

[00050] Figures 2A to 2F demonstrate the concept of sparse component analysis by blind extraction of four sinusoid signals with different frequencies from two mixtures. The four sinusoid signals, that play the role of pure components, have frequencies of 200 Hz, 400 Hz, 800 Hz and 1600 Hz. Figure 2A shows four sinusoid signals in time domain on large time scale, while figure 2B shows the same four signals in zoomed time interval. The overlap between the time domain pure component signals is evident, especially in figure 2A on large time scale. There, instead of being mutually sparse signals are very dense. Figure 2C shows the same four sinusoid signals in frequency domain. Since pure components occupy different frequencies, they are 3-sparse at each frequency (this is equivalent to m-1 sparseness requirement, wherein m=4), i.e. there is no overlap between pure components in the frequency domain. Figure 2D shows the amplitude spectrum of the two mixtures obtained by mixing four pure components shown in figure 2C with the mixing matrix consisting of the four 2D mixing vectors. The mixing angles, see discussion associated with figure 3 in paragraph [0067], in degrees were: [63.44 25.57 14.04 71.57]. Figure 2E shows clustering function in the mixing angle domain. Four peaks at the approximate locations of the mixing angles are distinguished. The estimates of the mixing angles in degrees were: [63.54 26.55 14.05 71.57]. Thus, the algorithm estimated the existence of the four pure components in the mixtures. Figure 2F shows the amplitude spectrum of the estimated four pure components. Similarity with the true pure components, the amplitude spectrum of which is shown in figure 2C, is evident. Note that in this case the first new representation domain defined by equation [II] and the second new representation domain defined by equation [III] were the same, i.e. there was only one transform Tj used and that was the Fourier transform. The reason was that the Fourier transform yields perfectly sparse representation for the sinusoid signals.

[00051] Figures 6 A to 6K demonstrate experimentally blind extraction of three pure components and two outliers from two 1 H NMR mixtures by means of sparse component analysis according to an embodiment of the present invention. Compounds used in this analysis were derivatives of amino acids tyrosine and phenylalanine with large structural similarities and significant overlapping in NMR spectra. Figures 6 A to 6C show 1 H NMR amplitude spectra (in the Fourier basis) of the three pure components. Negentropy measures calculated on the amplitude spectra of the three pure components were: 1.955x1017, 2.793x1016 and 2.627x1016. Figures 6D and 6E show IH NMR amplitude spectra of the two mixtures. Figure 6F shows clustering function in the mixing angle domain wherein for Tj continuous wavelet transform with the Morlet wavelet has been used to transform two mixtures from recording domain defined by equation [I] to the first new representation domain defined by equation [H]. When the dispersion factor is set to σ=0.04, the number of the pure components is estimated as 4 with the RMSE data reconstruction error RMSE=I.32x10-11. When the dispersion factor is set to σ=0.035 the number of the pure components is estimated as 5 with the RMSE data reconstruction error RMSE=8. Ix 10-13. The clustering function shown in figure 6F illustrates this later case. The amplitude spectra of the estimated pure components that correspond to the three true pure components are shown in figures 6G to 61. Since in the case of the NMR spectroscopy the frequency (Fourier) domain is the domain where final results are presented, the two mixtures were transformed from the recording domain defined by equation [I] in the second new representation domain defined by equation [III] by transform T 2 that was a Fourier transform. Since linear programming allows that two pure components can overlap at each frequency, we have estimated the pure components in the frequency domain. Negentropy measures calculated on the amplitude spectra of these estimated pure components were: 1.542x1016, 6.602x1016 and 1.379x1012. Figures 6J and 6K show the amplitude spectra of two components that are classified as outliers. As it is seen, their amplitudes are between one and two orders of magnitudes smaller than the amplitudes of the estimates of the true pure components. Most importantly, their negentropies were: 1.536x106 and 1.89, that is 10 orders of magnitude or more different that the negentropies of the true pure components. Thus, the negentropy criterion can serve as a basis to discriminate estimates that correspond to the true pure components from those that are classified as outliers. Note also relatively large discrepancy between the third true pure component, figure 6C, and their estimate, figure 61. This is consequence of the great spectral similarity between the second and third pure component and small amount of concentration of the third pure component in the mixtures.

[00052] Figures 7 A to 71 demonstrate experimentally the concept of sparse component analysis by blind extraction of three pure components from two 13 C NMR mixtures according to an embodiment of the present invention. The compounds used to illustrate the SCA concept on 13 C NMR data were the same as in the previous paragraph [0051], where the SCA concept was illustrated on IH NMR data. Figures 7A to 7C show 13 C NMR amplitude spectra (in Fourier basis) of the three pure components. Figures 7D and 7E show 13 C NMR amplitude spectra of the two mixtures. Figure 7F shows the clustering function in the mixing angle domain, wherein for Ti continuous wavelet transform with the Morlet wavelet has been used to transform mixtures from recording domain defined by equation [I] to the first new representation domain defined by equation [II]. When the dispersion factor is set to σ=0.0425 the number of the pure components is estimated as 3 with the data reconstruction error RMSE=2.5. The clustering function shown in figure 7F illustrates this case. The dispersion factor could be varied as in the previous case of 1 H NMR data and negentropy measure could be used to discriminate estimates of the true pure components from those that are classified as outliers. The amplitude spectra of the estimated pure components that correspond to the true tree pure components are shown in figures 7G to 71. Note also the relatively large discrepancy between the true third pure component, figure 7C, and its estimate, figure 71. This is the consequence of the great spectral similarity between the second and third pure components and the small amount of concentration of the third pure component in the mixtures.

[00053] Figures 8A to 8H demonstrate experimentally the concept of sparse component analysis by blind extraction of two pure components from two UV mixtures according to an embodiment of the present invention. The compounds used to illustrate the SCA concept on UV data were the same as in the previous paragraphs [0051] and [0052], where the SCA concept was illustrated on 1 H and 13 C NMR data. Figures 8 A to 8C show UV spectra of the three pure components. Note that the second and third pure components have the same UV spectra, because they have the same chromophore responsible for the UV absorption (aromatic ring). Consequently, only two true pure components will show up in the mixtures. Figures 8D and 8E show UV spectra of the two mixtures defined by equation [I]. Figure 8F shows the clustering function in the mixing angle domain, wherein for Ti continuous wavelet transform with the second order Daubechies wavelet has been used to transform two mixtures from recording domain defined by equation [I] to the first new representation domain defined by equation [H]. When the dispersion factor is set to σ=0.09, the number of the pure components is estimated as 3 with the data reconstruction error RMSE=7.4xlO-14. The clustering function shown in figure 8F illustrates this case. The dispersion factor could be varied as in the previous cases of 1 H and 13 C NMR data and the negentropy or smoothness measures could be used to discriminate estimates of the true pure components from those that are classified as outliers. The spectra of the estimated pure components that correspond to the true two pure components are shown in figures 8G and 8H. Note the good agreement between the true pure components shown in figures 8A and 8B and their estimates shown in figures 8G and 8H.

[00054] Figures 9A to 91 demonstrate experimentally the concept of sparse component analysis by blind extraction of two pure components from two IR mixtures according to an embodiment to the present invention. The compounds used to illustrate the SCA concept on IR data were the same as in the previous paragraphs [0051], [0052] and [0053] where the SCA concept was illustrated on 1 H and 13 C NMR data and UV data. Figures 9 A to 9C show IR spectra of the three pure components. Figures 9D and 9E show IR spectra of the two mixtures defined by equation [I]. Figure 9F shows the clustering function in the mixing angle domain, wherein for Ti continuous wavelet transform with the fourth order symmlet wavelet has been used to transform two mixtures from recording domain define by equation [I] to the first new representation domain defined by equation [H]. When the dispersion factor is set to σ=0.025 the number of the pure components is estimated as 4. The clustering function shown in figure 9F illustrates this case. As it was the case with 1 H and 13 C NMR data, negentropy measure has been used to discriminate estimates of the true pure components from the outlier. The IR spectra of the three estimated pure components that correspond to the three true pure components, are shown in drawings 9G to 91.

DETAILED DESCRIPTION OF THE INVENTION [00055] The present invention relates to the field of spectroscopy and spectrometry. More specific, the invention relates to the application of the method of SCA and uBSS for blind extraction of more than two pure chemical compounds from two spectroscopic or spectrometric mixtures, wherein mixtures are gathered by NMR spectroscopy, EPR spectroscopy, IR spectroscopy, UV spectroscopy, Raman spectroscopy or mass spectrometry. Proposed blind mixture decomposition approach estimates the unknown number of pure components from the mixtures. Identified pure components can be used for identification of the compounds in chemical synthesis, food quality control, environment protection, etc.

[00056] The enabling concept for blind extraction of more than two possibly statisically dependent pure components from two mixtures only is known under the common name sparse component analysis (SCA). The concept is schematically illustrated in figures 2A to 2F where four sinousiod signals with different frequencuies are blindly extracted from two mixtures only.

[00057] Theoretical foundations of the solution of the uBSS problems employing SCA are laid down in: P. Bofill and M. Zibulevsky, "Underdetermined blind source separation using sparse representations. Signal Processing 81, 2353-2362, 2001; Y. Li, A. Cichocki, S. Amari, "Analysis of Sparse Representation and Blind Source Separation," Neural Computation 16, pp. 1193-1234, 2004; Y. Li, S. Amari, A. Cichocki, D.W.C. Ho, S. Xie, "Underdetrmined Blind Source Separation Based on Sparse Representation," IEEE Trans, on Signal Processing, vol. 54, No. 2, 423-437, 2006; P. Georgiev, F. Theis, and A. Cichocki, "Sparse Component Analysis and Blind Source Separation of Underdetermined Mixtures," IEEE Trans, on Neural Networks, vol. 16, No. 4, 992-996, 2005.

[00058] Let us assume the number of mixtures to be n and the unknown number of pure components to be m. The uBSS problem is solvable by SCA approach, if pure components in some domain are (m-n+l)-sparse what implies that at each coordinate (for example frequency in Fourier basis) m-n+1 components are zero. By setting the number of mixtures to be n=2 this implies that at each coordinate in the domain of representation m-1 pure components must be zero, i.e., the assumption is that pure components do not overlap in new representation domain. This assumption is recently relaxed by a concept known as k-plane clustering: F.M. Naini, G.H. Mohimani, M. Babaie-Zadeh, Ch. Jutten, "Estimating the mixing matrix in Sparse Component Analysis (SCA) based on partial k-dimensional subspace clustering," Neurocomputing 71, 2330-2343, 2008; Y. Washizava, A. Cichocki, "On-Line k- plane clustering learning algorithm for sparse component analysis," in: Proceedings of ICASSP'06, Toulouse, France, pp. 681-684, 2006. Robustness with respect to noise and outliers is achieved by assuming that pure components are in average (m-n+l)-sparse. Hence, it is allowed that pure components at certain number of coordinates violate (m-n+1)- sparseness assumption. In the sequel we shall assume the pure components are in average m-1 sparse in the new representation domain wherein only two mixtures are available.

[00059] As already elaborated, the number of pure components residing in the recorded mixtures is always unknown. Accurate estimation of this number is a challenging task and is accomplished by fairly complex statistical methods such as maximum likelihood, bootstrapping and jack-knifing: F. Westad, M. Kermit, "Cross validation and uncertainty estimates in independent component analysis," Analytica Chimica Acta 490, 341-354, 2003; E. Levina et al., "Estimating the number of pure chemical components in a mixture by maximum likelihood," Journal of Chemometrics 21, 24-34, 2007. These methods are based on statistical ranking the singular values of the sample data co variance matrix by discarding those that may be associated with outliers or chemical noise. In solving uBSS problems such methods can not be applied because the number of pure components exceeds the overall number of singular values that equals the number of mixtures. In the case of the present invention that is two.

[00060] According to the present invention the unknown number of pure components during the mixing matrix estimation phase in the new representation domain is estimated by means of the clustering method recently proposed in: F.M. Naini et al., "Estimating the mixing matrix in Sparse Component Analysis (SCA) based on partial k-dimensional subspace clustering," Neurocomputing 71, 2330-2343, 2008.

[00061] When the mixing matrix is estimated, the pure components are recovered by solving an underdetermined system of linear equations in the new representation domain. If the pure components are in average m-1 sparse, the solution can be obtained by several methods that are based on constrained convex optimization: J.A. Tropp, A.C. Gilbert, "Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit," IEEE Transactions on Information Theory, vol. 53,No. 12, 4655-4666, 2007; SJ. Kim et al., "An Interior-Point Method for Large-Scale ' -Regularized Least Squares," IEEE Journal of Selected Topics in Signal Processing, vol. 1, No. 4, 606-617, 2007. Moreover, it has been proven (I. Takigawa, M. Kudo J. Toyama, "Performance Analysis of Minimum 11 -Norm Solutions for Underdetermined Source Separation," IEEE Tr. on Signal Processing, vol. 52, No.3, 582-591, 2004) that linear programming yields perfect solution when mixing matrix is known and when no more than n sources are active at each coordinate, i.e. when sources are (m-n)-sparse. By fixing the number of mixtures to be n=2 this implies that linear programming will yield an accurate solution for the (m-2)-sparse components, i.e., at each coordinate at most 2 pure components are allowed to exist. Since the described clustering algorithm requires that pure components be in average (m-l)-sparse they are automatically (m-2)-sparse. Hence, linear programming will yield a robust solution of the blind spectra decomposition problem, if no more than 2 pure components are active at each frequency coordinate.

[00062] Blind extraction of the pure components from two mixtures data X is achieved by the combined use of linear transform Ti to transform recorded mixtures into the first new representation domain defined by equation [II] where transformed pure components are sparse, estimating the unknown mixing or concentration matrix and the unknown number of pure components in the first new representation domain defined by equation [II] by means of data clustering algorithm described in [0058], [0065], [0066], estimating the unknown pure components by means of linear programming, constrained convex programming or constrained quadratic programming either in the first new representation domain defined by equation [II] or the second new representation domain defined by equation [III] obtained by linear transformation of the two mixtures defined by equation [I] by another linear transform T 2 , and applying inverse of the transform Ti on estimated pure components, if the domain, where results are presented, differs from the first new representation domain defined by equation [H].

[00063] The problem of the blind decomposition of two recorded mixtures by means of the

SCA algorithms can algebraically be expressed as a matrix factorization problem by means of which recorded mixtures are represented by equation [I]:

X = AS [I] In equation [I] X represents recorded two mixtures data, where A e R" 0+xm represents unknown mixing matrix (also called concentration matrix) and S f= R mxΛ ' represents matrix of the unknown pure components. In adopted notation n=2 represents number of recorded spectroscopic or spectrometric mixtures, N represent number of samples in the mixture, and m represents unknown number of the pure components. When referring to individual mixtures one or two we shall use notation xi or x 2 respectively. They are represented by the corresponding rows of the mixture matrix X. Since we are assuming m≥n, wherein n=2, resulting blind source separation problem is underdetermined. Such kind of blind problems can not be solved by means of the ICA algorithms discussed in paragraphs [0003] and [0004].

[00064] In the present invention, a term "the two mixtures recording domain" is defined by equation [I]. A domain which was obtained by applying linear transform Ti on the mixtures in recording domain defined by equation [I], and which is called in the present invention "the first new representation domain" is defined by equation [H]. Also, domain which was obtained by applying linear transform T 2 on the mixtures in recording domain defined by equation [I], and which is called in the present invention "the second new representation domain" is defined by equation [III]. A term "results presentation domain" relates to the domain where results obtained by blind decomposition algorithm ought to be presented. Depending on the mixtures sensing device that relates to the chosen spectroscopic technology the results presentation domain can be mixtures recording domain defined by equation [I], the first new representation domain defined by equation [II] or the second new representation domain defined by equation [III].

[00065] As previously discussed in paragraphs [00055]-[00060], underdetermined blind source separation problem is solvable if pure components are m-1 sparse in the first new representation domain one that is obtained by applying linear transform Ti on the recorded mixtures given by equation [I]:

T 1 (X)=Ar 1 (S) [II]

The challenge is to find the linear transform Ti that will produce m-1 sparse representations of the pure components Ti(S). We remind that m-1 sparse representations means that at each coordinate in the first new representation domain defined by equation [II] at most one pure component is non-zero i.e. it is assumed that pure component do not overlap in the first new representation domain defined by equation [H]. Candidates for the linear transform Ti are the Fourier transform or wavelet transform. The Fourier transform can be a good choice for 13 C NMR data, where a small degree of overlap between pure components is expected. However the m-1 sparseness requirement is not very likely to be met, when Fourier transform is applied on 1 H NMR data or some other spectroscopic or spectrometric data.

[00066] The wavelet transform has greater chance to yield sparse pure components T](S) due to possibility to choose a wavelet basis function that matches the structure of the spectroscopic or spectrometric signals defined by equation [I]. For example it will be demonstrated that Morlet and Mexican hat wavelets match the structure of the NMR signals very well. Thus, the Morlet or Mexican hat based wavelet transform yields very sparse representation of the NMR signals. For example, figures 4A and 4B respectively show the real part of the time domain 1 H NMR signal (pure component) and Morlet wavelet at the corresponding scale. The similarity of the waveforms is evident. Hence, by transforming (projecting) time domain data on the basis defined by Morlet or Mexican hat wavelet it is expected to obtain large values of the wavelet coefficients at the few scale (resolution) levels only. This conjecture is further supported by figure 5. It shows the normalized absolute value of the wavelet coefficients vs. scales (resolution levels) and time shifts that is obtained by transforming time domain 1 H NMR data shown in figure 4 A to the scale-time shift domain by means of the continuous wavelet transform and Mexican hat wavelet. Large values of the wavelet coefficients exist at the few scales only. Likewise, for the fixed scale parameter large values of the wavelet coefficients exist at the few time shifts only. Thus, choosing transformed data at the scale which gives maximal value of the wavelet coefficients yields very sparse representation of the NMR signals in the wavelet basis. As opposed to this the same NMR signal in Fourier domain, shown in 6B, is evidently not so sparse. It is a nontrivial problem to identify the optimal wavelet function for other types of spectroscopic or spectrometric data.

[00067] For two mixtures data model defined by equation [I] the number of mixtures used in the representation described in paragraph [0063] is n=2. The number of unknown pure components m contained in recorded mixtures defined by equation [I] has to be estimated. As elaborated in [0059] advance statistical methods developed for overdetermined BSS problems (m>n) are not applicable to underdetermined BSS problem. According to an embodiment of the present invention we adopt the approach proposed in: F.M. Naini et al., "Estimating the mixing matrix in Sparse Component Analysis (SCA) based on partial k-dimensional subspace clustering," Neurocomputing 71, 2330-2343, 2008. Assuming the number of mixtures to be n=2, we model the column vectors of the mixing matrix (we also call them mixing vectors) as unit length vectors with mixing angles describing their position in the mixtures Xj-X 2 coordinate system a = t cos tø) sm tø)] (illustration is given in figure 3). Since the mixing matrix has the chemical interpretation of concentrations of the pure components in the mixtures, it is nonnegative. Thus the mixing angles are confined in the interval [0, π/2].

[00068] Provided that small samples of the two mixtures in the first new representation domain defined by equation [II] are eliminated and that remaining samples are normalized to unit length, the following function

clusters mixtures data in the first new representation domain defined by equation [II] into the clusters the number of which corresponds with the number of pure components. N ≤ N denotes the number of samples that remained after small samples elimination process. In the clustering function J(a), d denotes distance calculated as

d ( (T } (x ( ) , a) j = Jl - (T 1 (x, ) • a) and (T λ (x, ) a) denotes the inner or dot product. Parameter σ defines the resolving power of the function βai). When σis set to a sufficiently small value, in our experiments this turned out to be σ«0.05, the value of the function^a) will approximately equal the number of data points close to a. Positions of the centers of the clusters in the space of mixing angles correspond with the mixing angles that define the mixing vectors. Figure 2E shows the clustering function for the example when four sinusoid signals with different frequencies were mixed into two mixtures and then transformed into Fourier domain, i.e. T \ is implemented by Fourier transform. Two more examples are shown in figures 6F and 7F for the case of experimental 1 H and 13 C NMR data comprised of three pure components with one component contained in small concentration and two components contained in similar concentrations. [00069] After the number of pure components and the mixing matrix are estimated, the pure components themselves ought to be estimated. This can be achieved either in the first new representation domain defined by equation [II] and implemented by transform Ti, or in the second new representation domain defined by equation [III] and obtained by applying linear transform T 2 on the two mixtures defined by equation [I]. This yields

T 2 (X)=Ar 2 (S) [III]

Provided that either pure components in the first new representation domain defined by equation [II] or the second new representation domain defined by equation [III] are m-2 sparse linear programming will yield accurate solution for the estimate of the pure components Ti(S) or ^(S) based on the estimate of the mixing matrix A and transformed mixtures Tj(X) defined by equation [II] or T (X) defined by equation [III]. This result has been proven in: I. Takigawa, M. Kudo J. Toyama, "Performance Analysis of Minimum 11- Norm Solutions for Underdetermined Source Separation," IEEE Tr. on Signal Processing, vol. 52, No.3, 582-591, 2004. Other methods for estimation of the pure components Tj(S) in the first new representation domain defined by equation [II] or 7XS) in the second new representation domain defined by equation [III] that are based on the estimate of the mixing matrix A and transformed data Ti(X) or 7χX) include: matching pursuit algorithm (Mallat, S., Zhang, Z, "Matching pursuits with time-frequency dictionaries," IEEE Transactions on Signal Processing, 41(12), 3397-3415, 1993) ; orthogonal matching pursuit algorithm (Tropp, J.A., Gilbert, A.C., " Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit," IEEE Transactions on Information Theory, 53(12), 4655-4666, 2007); interior-point method specialized for large-scale ' -regularized least squares problems (Kim, S.J., Koh, K.,

Lustig, M., Boyd, S., Gorinevsky, D., "An Interior-Point Method for Large-Scale ' - Regularized Least Squares," IEEE Journal of Selected Topics in Signal Processing, 1(4), 606- 617, 2007).

[00070] Transform T 2 is useful when the domain in which results are presented differs from the two mixtures recording domain defined by equation [I] and from the first new representation domain defined by equation [II] obtained by means of transform Ti. Provided that transformed pure components 7χS) are comparably sparse as the transformed components Ti(S), the second new representation domain defined by equation [III] enables the estimation of the pure components. For example, when sparse component analysis is applied for blind decomposition of NMR mixtures, the mixing matrix is most accuratley estimated in the new representation domain one defined by equation [II], wherein transform Ti represents wavelet basis with either Morlet or Mexican hat wavelets. This is because such basis provides the sparsest representation of the NMR signals. On the other hand it is customary to present results of the NMR data analysis in the frequency domain (in the ppm scale). Thus, if Fourier transform is chosen for the transform T 2 , where pure components are comparably sparse as in the wavelet basis, pure components can be estimated directly in the frequency domain. Due to the result cited in the previous paragraph, pure components 7χS) ought only to be m-2 sparse, what actually relaxes the sparseness requirement on the Fourier bases when it is used for the transform T 2 . Thus, in the case of NMR data, when pure

components 7χS) are estimated in the Fourier basis, no inverse transform ' from the first new data representation domain defined by equation [II] to the two mixtures recording domain defined by equation [I] and then direct transform T 2 from two mixtures recording domain defined by equation [I] to the second new representation domain defined by equation [III] are necessary.

[00071] If the pure components are estimated in the first new representation domain defined by equation [II] and results ought to be presented in the two mixtures recording domain τ-ι defined by equation [I], the inverse transform ' must be used to obtain estimated pure components in the two mixtures recording domain defined by equation [I], i.e.

s = r,- 1 (r, (S)) [IV]

For example, this is necessary when sparse component analysis is applied to blind decomposition of IR, UV or Raman spectroscopic data, wherein direct transform T / and

inverse transform • are wavelet and inverse wavelet transforms with suitable chosen wavelet function.

[00072] As explained in paragraph [0068] the number of pure components is estimated simultaneously with the mixing matrix employing a data clustering algorithm in the first new representation domain defined by equation [H]. The sensitivity of the clustering function is regulated through the dispersion factor σ. Since the experimental data can contain errors due the presence of chemical noise or outliers, as discussed in the US patent application 20040111220 in paragraph [0014], it is necessary to derive a robust estimator of the number of pure components. For this purpose we propose to slightly variate the dispersion factor σ and estimate the mixing matrix, related number of pure components m and pure components themselves for each value of σ. To evaluate the quality of the estimates of the mixing matrix and pure components we propose to use the root-mean-squared-error (RMSE) criterion between original and reconstructed data as for example in: G. Wang, W. Cai, X. Shao, "A primary study on resolution of overlapping GC-MS signal using mean-field approach independent component analysis," Chemometrics and Intelligent Laboratory Systems 82, 137- 144, 2006.

As the solution for the mixig matrix A and pure components S we present the one that minimizes RMSE criterion.

[00073] When working with experimental data, the presence of outliers (sources that are not pure components in the true sense but are the consequence of chemical noise or other imperfections present in the real world applications) must be allowed. In order to discriminate estimated pure components that correspond to the true pure components from the outliers we propose an information theoretic measure called negentropy: A. Hyvarinen, J. Karhunen, E. Oja. Independent Component Analysis, John Wiley, 2001. Negentropy is entropy defined relatively in relation to the entropy of the Gaussian random process. Since the Gaussian random process has the largest entropy its negentropy will be zero. The more informative (non-Gaussian) the random process is, the largest negentropy it has. Since we intuitively expect the pure components to be informative we also expect their negentropies to be large. As opposed to that we expect the negentropies of the possible outliers to be small.

[00074] The present invention is related to blind extraction of more than two pure components from the two mixtures of the chemical compounds by means of sparse component analysis and underdetermined blind source separation. The invention is insensitive to statistical dependence among the pure components and is capable of automatically determining their number from the two available mixtures.

[00075] As opposed to the state-of-the art blind spectra decomposition methods that require the number of measured spectral data (also called mixtures) to be equal to or greater than the unknown number of pure components, paragraphs [0002] - [0012], proposed SCA approach requires measurement of two mixtures only for blind extraction of more than two pure components. Also, as opposed to the blind spectra decomposition methods referred to as state- of-the-art, proposed blind spectra decomposition approach does not require the number of pure components to be known in advance but estimates it from the available measured data.

[00076] It is clear from the to be elaborated sparse component analysis and underdetermined BSS concepts that full exploitation of the redundancies present in the spectroscopic data enables solution of the related BSS problem by using two mixtures only, what is the main characteristic of the present invention.

[00077] The present invention solves blind decomposition problem using two mixtures only and estimates the unknown number of pure components using data clustering algorithm commented in paragraphs [0058], [0067] and [0068]. It is related to spectroscopy where sparseness is generally not ensured but is achieved by transforming recorded data into either Fourier or wavelet basis with properly chosen wavelet function that matches the structure of the related spectroscopic or spectrometric signals. The present invention estimates mixing matrix using purely geometric approach known as data clustering. In particular an algorithm is used (F.M. Naini, et. al, "Estimating the mixing matrix in Sparse Component Analysis (SCA) based on partial k-dimensional subspace clustering," Neurocomputing, vol. 71, pp.2330-2343, 2008) that assumes that in the given basis sources, or pure components, are in average 1 -sparse. This presumes that at the majority of coordinates in the transformed basis (also called first new representation domains defined by equation [II] or the second new representation domain defined by equation [III]) only one source is active. As demonstrated in the innovation this is fulfilled by using continuous wavelet transform with properly chosen resolution level and wavelet function that resembles structure of the spectroscopic signal of interest. Moreover, it has been demonstrated in the presented innovation that high level of sparseness among the pure components can not be ensured in the Fourier basis i.e. frequency domain, but in wavelet basis with a carefully chosen wavelet function that resembles time structure of the signals arising in spectroscopy. Specifically, it has been found in the presented innovation that the highest level of sparseness, when NMR signals are projected to wavelet basis, is achieved when Morlet's wavelet or Mexican hat wavelet (the second order derivative of the Gaussian function) are chosen for wavelet function in the continuous wavelet transform.

[00078] The invention can be applied to identification of the compounds in the pharmaceutical industry in the chemical synthesis of new compounds with different properties. It can also be applied in the food quality inspection and environment protection through pollution inspection. Another application of the proposed invention is in software packages, as the built in computer code, that are used for the analysis and identification of the chemical compounds.