Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
FREQUENCY ESTIMATION
Document Type and Number:
WIPO Patent Application WO/2004/005945
Kind Code:
A1
Abstract:
A method for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise, comprising the steps of: performing the fast Fourier transform (FFT) on the tone; estimating the frequency as the frequency corresponding to the largest FFT output coefficient magnitude; computing a discriminant which is proportional to the frequency error in the initial frequency estimate using modified coefficients of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the initial frequency estimate; mapping the value of the discriminant into the estimate of the frequency error in the initial frequency estimate using a mathematically derived function; adding the estimate of the frequency error to the initial frequency estimate to get a first interpolated frequency estimate; computing a further discriminant which is proportional to the frequency error in the first interpolated frequency estimate using modified coefficients of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the first interpolated frequency estimate; mapping the value of the further discriminant into the estimate of the frequency error in the first interpolated frequency estimate using the mathematically derived function; and adding the estimate of the frequency error in the first interpolated frequency estimate to the first interpolated frequency estimate to get a second interpolated frequency estimate.

Inventors:
REISENFELD SAM (AU)
ABOUTANIOS ELIAS (AU)
Application Number:
PCT/AU2003/000862
Publication Date:
January 15, 2004
Filing Date:
July 04, 2003
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
UNIV SYDNEY TECH (AU)
REISENFELD SAM (AU)
ABOUTANIOS ELIAS (AU)
International Classes:
G01R23/16; (IPC1-7): G01R29/26; H04B17/00; H04L27/16
Foreign References:
US6101230A2000-08-08
EP0945994A21999-09-29
US5874916A1999-02-23
EP0762703A11997-03-12
Other References:
See also references of EP 1540358A4
Attorney, Agent or Firm:
F B RICE & CO (Balmain, New South Wales 2041, AU)
Download PDF:
Claims:
THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS:
1. A method for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise, comprising the steps of: performing the fast Fourier transform (FFT) on the tone; estimating the frequency as the frequency corresponding to the largest FFT output coefficient magnitude; computing a discriminant which is proportional to the frequency error in the initial frequency estimate using modified coefficients of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the initial frequency estimate; mapping the value of the discriminant into the estimate of the frequency error in the initial frequency estimate using a mathematically derived function; adding the estimate of the frequency error to the initial frequency estimate to get a first interpolated frequency estimate; computing a further discriminant which is proportional to the frequency error in the first interpolated frequency estimate using modified coefficients of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the first interpolated frequency estimate; mapping the value of the further discriminant into the estimate of the frequency error in the first interpolated frequency estimate using the mathematically derived function; and adding the estimate of the frequency error in the first interpolated frequency estimate to the first interpolated frequency estimate to get a second interpolated frequency estimate.
2. The method according to claim 1, wherein the first interpolated frequency estimate is in a region of relatively low noise induced frequency error.
3. The method according to claim 1 or 2, wherein the method is implemented in computer hardware and/or computer software.
4. The method according to any one of the preceding claims, wherein the method is utilised in communications, signal processing and biomedical applications.
5. The method according to any one of the preceding claims, further comprising the steps of : iteratively deriving an interpolated frequency estimate, and using the frequency discriminant, to obtain a more precise frequency estimate.
6. The method according to claim 5, wherein the steps of iteratively deriving an interpolated frequency estimate and using the frequency discriminant are repeated until a fixed point solution occurs, where at this fixed point, the discriminant function has zero value.
7. The method according to any one of the preceding claims, wherein the frequency discriminant is computed by: <BR> <BR> D(#,#) = |ß||α|<BR> <BR> <BR> <BR> <BR> |ß|+|α|<BR> <BR> <BR> kmax where, # = fTs , N # = #Ts kmax/N, and ß and α are the modified DFT coefficients defined by, thus, the initial frequency estimate using the FFT, #0Ts = kmax/N and # = 0.
8. The method according to any one of claims 1 to 6, wherein the frequency discriminant is computed by: <BR> <BR> D = 1#ß#γ#α#γ, for γ > 0.,<BR> <BR> <BR> <BR> rlßlr +laylS where 6 and a are the modified DFT coefficients defined by, 9. The method according to any one of claims 1 to 6, wherein the discriminant of frequency estimation error is computed by: <BR> <BR> #ß#2#α#2<BR> <BR> D = 1/2,<BR> <BR> <BR> <BR> <BR> #ß#2+#α#2 where 6 and a are the modified DFT coefficients defined by, 10. The method according to any one of claims 1 to 6, wherein the frequency discriminant is computed by: <BR> <BR> D = Re[ßα*]<BR> <BR> <BR> ß+α* where Re [.] is the real part and * denotes the complex conjugate, and 8 and a are the modified DFT coefficients defined by, 11. The method according to any one of preceding claims, wherein the frequency discriminant is computed by using more than two DFT coefficients.
9. 12 The method according to claim 11, wherein 2M+2 coefficients are used, where 0 # M # N/21 and the FFT coefficients are used in the frequency discriminant with optimal weighting coefficients obtained by using the concept of matched filtering is, where, 0 # M # N/21, mod N indicates modulo N, and, where, * denotes complex conjugate. and, Y (kmaX + 2 + m) and Y (kma,2m) are the modified DFT coefficients given by,.
10. The method according to claim 11 or 12, wherein the frequency discriminant using more than two DFT coefficients us used in the last iteration to obtain additional frequency accuracy.
11. The method according to any one of claims 11 to 13, wherein the frequency discriminant is computed by using more than two DFT coefficients and less or equal to all N FFT coefficients.
12. The method according to any one of the preceding claims, wherein additional frequency accuracy is obtained by computing the frequency discriminant recursively until convergence for the frequency estimate is reached.
13. The method according to claim 15, wherein convergence for the frequency estimate is reached after zero to three iterations, the number of iterations being dependent on the specific discriminant used and the signal to noise ratio.
14. The method according to claim 15 or 16, wherein in any iteration, the frequency discriminant is computed using any one of the functional forms: fm (T = 1 t1 m am t () fs OI' 1 4 Irm _ | a Irm h 1)/ ? mJy tm 2N [I ß + | a |] fS s for r = l, or 2Ny. 1, 8. j, m +Ia. Im Af, (r) = 1 Rvamfs for y=1, or 2N tAiH< ! Afm (r) =11, 6m 12 +1 am 12. I f,, for r = 2. 4N 18.
15. The method according to claim 17, wherein y varies on each iteration.
16. The method according to claim 15 or 16, wherein in any iteration, the <BR> <BR> frequency discriminant is computed using:<BR> 1 ßm αm*<BR> <BR> #fm (r) = Re[ ] fs,<BR> <BR> 2N ßm + αm* where, Re [. ] denotes the real part and * denotes the complex conjugate.
17. The method according to any one of claims 17 to 19, wherein the frequency incremental shift, Af. (r), is related to the previously defined frequency discriminant, D, by, #fm(r) = fs/2N D.
18. The method according to any one of claims 15 to 20, wherein the frequency discriminant is driven to zero input and output values by either modifying the frequency of the DFT coefficients or frequency translating the signal.
19. The method according to any one of claims 15 to 21, wherein signal frequency translation is achieved by multiplication of the signal by a locally generated complex exponential signal.
20. The method according to claim 22, wherein frequency multiplication of the signal is implemented with a standard hardware, software, or combination hardware/software FFT.
21. The method according to claim 23, wherein the hardware/software FFT is highly optimized for at least one processor operating as a system.
22. The method according to any one of claims 15 to 24, further comprising the step of scaling the frequency estimate during recursion, to save multiplies.
23. The method according to claim 25, further comprising a final step of multiplying the scaled frequency estimate fm+iT, with the sampling frequency fs to remove the scaling from the frequency estimate.
24. A frequency estimation software program for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise, wherein the frequency estimation program has functionality to perform the method according to any one of claims 1 to 26.
25. A computer system programmed to perform the method according to any one of claims 1 to 26.
26. The computer system according to claim 28, wherein the hardware includes a DSP processor chip.
Description:
Title "Frequency Estimation" Technical Field This invention concerns a method for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise. In another aspect the invention is a frequency estimation program for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise. In further aspects, the invention is computer hardware programmed to perform the method.

Background Art Earlier work to estimate the frequency of a single frequency complex exponential tone in additive Gaussian noise uses the fast Fourier transform (FFT) algorithm. The initial work on this topic was introduced by Rife and Boorstyn [1-3]. This paper introduces an algorithm employing the FFT, which produces an estimate of the frequency with extremely low variance of the error.

The variance of the frequency estimate is independent of the frequency of the signal. The algorithm has a low computational complexity implementation.

The received signal, r [n], is given by, r [n] = s [n] + [n], for n = 0, 1, 2,..., N-1 (1) where: <BR> <BR> <BR> s[n]=Aej2#fnTs,<BR> <BR> <BR> <BR> {#[n]}0N-1 is a set of independent, complex, zero mean, Gaussian random variables with variance 62, <BR> <BR> <BR> #R[n]=Re{#[n]},<BR> <BR> <BR> <BR> <BR> <BR> <BR> [n] =Imag {77 [n]}, f is the frequency of the tone, Ts is the sampling period, 62 - = var [7ZR ]=var[#1[n]]

and, A is the signal amplitude.

The sampling frequency, fs, is given by, <BR> <BR> <BR> <BR> fs = T samples/s (2)<BR> <BR> s The signal to noise ratio of each complex signal plus noise sample is given by, <BR> <BR> <BR> <BR> <BR> <BR> <BR> A2<BR> A2 SNR = (3) #² Rife and Boorstyn [1-4] suggest a method of estimating f by using a FFT.

It is assumed that 0 < f < fs. First, a coarse search is performed. Under noiseless conditions, the absolute value of the FFT output coefficient corresponding to the bin centre frequency closest to f will be maximum over the set of absolute values of the FFT output coefficients. The coarse search, performed by the FFT, narrows the frequency uncertainty, to <BR> <BR> <BR> <BR> <BR> N Hz, whereanNpointFFTisused. Then, a fine search method is used to further reduce the frequency uncertainty. A secant method is used to compute the estimate of f by successful approximates.

Define, where, Y =FFT (r) and FFT (. ) is the Fast Fourier Transform Operator.

Then the Rife and Boorstyn coarse search is, <BR> <BR> <BR> <BR> kmax = max-1 {#Y(k)#:0#k#N-1}<BR> <BR> 0 # k # N - 1 (5) and,

ko (kmax) f (6) where, fo is the coarse frequency estimate in Hz.

Numerous other frequency estimation approaches have been suggested in the literature [5-10].

Disclosure of the Invention In a first aspect the invention is a method for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise, comprising the steps of: performing the fast Fourier transform (FFT) on the tone; estimating the frequency as the frequency corresponding to the largest FFT output coefficient magnitude; computing a discriminant which is proportional to the frequency error in the initial frequency estimate using modified coefficients of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the initial frequency estimate; mapping the value of the discriminant into the estimate of the frequency error in the initial frequency estimate using a mathematically derived function; adding the estimate of the frequency error to the initial frequency estimate to get a first interpolated frequency estimate; computing a further discriminant which is proportional to the frequency error in the first interpolated frequency estimate using modified coefficients of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the first interpolated frequency estimate; mapping the value of the further discriminant into the estimate of the frequency error in the first interpolated frequency estimate using the mathematically derived function; and adding the estimate of the frequency error in the first interpolated frequency estimate to the first interpolated frequency estimate to get a second interpolated frequency estimate.

The first interpolated frequency estimate is quite accurate because it is in a region of relatively low noise induced frequency error. The method generates an unbiased, low error variance estimate of the frequency. The performance of the method, above the signal to noise ratio threshold, is about 0.06 dB above the Cramer-Rao lower bound. The method is ideally suited to be utilised in a number of communications, signal processing and biomedical applications.

The method is easily implemented in hardware or software with low computational overhead.

In theory, this technique of iteratively deriving an interpolated frequency estimate and then, using the frequency discriminant, a more precise frequency estimate can be continued infinitely times until a fixed point (or solution) occurs.

At this fixed point, the discriminant function has zero value.

Several functions have been identified to compute the discriminant. In practice, different functions may require a different number of iterations to essentially converge to a fixed-point solution. However, discriminant functions defined by a wide class of functions using two DFT coefficients as the input converge to the same solution and therefore exhibit identical noise performance.

A first example of the discriminant, or distance metric, of frequency estimation error is: <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> |ß|-|α|<BR> D(#,#) = (9)<BR> <BR> <BR> <BR> |ß|+|α| kmax where, # = fTs - N (10) and, # = ftS - kmax N So for the initial frequency estimate using the FFT, #0 Ts = kmax/N and # = 0.

Other examples of the discriminant having the properties required for the algorithm include: <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> 1 |ß|γ - |α|γ<BR> D = , for γ > 0., γ|ß|γ + |α|γ and in particular,

1|ß|²-|α|²<BR> D = ,<BR> <BR> <BR> 2|ß|²+|α|²<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> and<BR> ß - α* D = Re[ ] ß α* where Re [. ] is the real part and * denotes the complex conjugate.

In these equations, B and a are the modified DFT coefficients defined by, It is also possible to define discriminant functions which use more than two DFT coefficients to obtain further improvements in frequency estimation performance in additive Gaussian noise relative to discriminants that use only two DFT coefficients. An example wher WM+2 coefficients are used, where 0#M#N -1 and the FFT coefficients are sued in the discriminant with 2 optimal weighting coefficients obtained by using the concept of matched filtering is, where, 0#M#N/2-1, mod N indicates modulo N, and, where, denotes complex conjugate.

and, Y(kmax+1/2+m) and Y(kmax-1/2-m) are the modified DFT coefficients given by, The discriminant using more than two DFT coefficients may be used in the last iteration to obtain additional frequency accuracy. In a similar manner, discriminant functions may be formulated which use more than two DFT coefficients and less or equal to all N FFT coefficients.

Additional frequency accuracy may be obtained by computing the frequency discriminant recursively until convergence for the frequency estimate is reached.

Convergence for the frequency estimate may be reached after zero to three iterations, depending upon the specific discriminant used and the signal to noise ratio.

In any iteration, the frequency discriminant may be computed using any one of the functional forms: Af. (r) I tan-, [1) 6' I-Ia. I tan (7r)] f, Im I'lam I 2N I/. i Y. _ I a 17°m 2Nym [l ß r + i rn,] fs f where Ym isaconstant, ym > 0. 2Nrm 1, 6m 1,'m + I a. irm 2N Im+am Afm (r) = [LMBJ] f, for=l 2N ! AJ+) J 4N γ may vary on each iteration. <BR> <BR> <P> 1 ßm - α m*<BR> #fm(r) = Re[ ]fs where, Re[.] denotes the real part and *<BR> <BR> <BR> <BR> 2N ßm + αm* denotes the complex conjugate In general, the frequency incremental shift #fm(r) is related to the previously defined frequency discriminant, D, by, #fm(r)=fs/2ND

The frequency discriminant may be driven to zero input and output values by either modifying the frequency of the DFT coefficients or frequency translating the signal. Signal frequency translation may be achieved by multiplication of the signal by a locally generated complex exponential signal.

The advantage of frequency multiplication of the signal is that the algorithm may be implemented with a standard hardware, software, or combination hardware/software FFT. This FFT may be highly optimized for one or a multiplicity of processors operating as a system.

The process for obtaining additional frequency accuracy may be scaled to save multiplies by scaling the frequency estimate during recursion. The process may involve a final step of multiplying the scaled frequency estimate fm+iTs with the sampling frequency fs to remove the scaling from the frequency estimate.

In a second aspect, the invention is a frequency estimation program for estimating the frequency of a single frequency complex exponential tone in additive Gaussian noise, wherein the frequency estimation program has functionality to perform the method.

In a third aspect, the invention is computer hardware programmed to perform the method. The hardware may comprise a DSP processor chip, or any other programmed hardware.

Brief Description of the Drawings Examples of the invention will now be described with reference to the accompanying drawings, in which: Fig. 1 is a graph that illustrates the FFT Coefficients, where the signal frequency is closer to the lower FFT frequency than the higher FFT frequency; Fig. 2 is a graph that illustrates the FFT Coefficients, there are two equal peak coefficients and the signal frequency is half way between; Fig. 3 is a graph that illustrates the FFT Coefficients, where the signal frequency is closer to the upper FFT frequency than the lower FFT frequency; Fig. 4 is a Flow Diagram for the Frequency Determination Algorithm; Fig. 5 is a graph that illustrates the ratio of the variance of the normalized frequency error, to Cramer-Rao Bound variance in dB as a function of the FFT length, N; and Fig. 6 is a graph that illustrates the variance of the normalised estimator frequency error estimate against the frequency error for the first interpolation.

Simulations of the invention show the rms frequency error performance of the algorithm vs SNR in dB, for different values of N.

Figures 7-12 include curves for one interpolation, two interpolations, and the Cramer-Rao Bound, where: Fig. 7 is a graph showing RMS normalised frequency error vs SNR for N=2; Fig. 8 is a graph showing RMS normalised frequency error vs SNR for N=4; Fig. 9 is a graph showing RMS normalised frequency error vs SNR for N=16 ; Fig. 10 is a graph showing RMS normalised frequency error vs SNR for N=64; Fig. 11 is a graph showing RMS normalised frequency error vs SNR for N=256; and Fig. 12 is a graph showing RMS normalised frequency error vs SNR for N=1024.

Fig. 13 is a Flow Diagram for the Frequency Determination Algorithm using a fixed number of iterations stopping rule.

Fig. 14 is a Flow Diagram for the Frequency Determination Algorithm using a magnitude of the frequency error discriminant stopping rule.

The two-interpolation case essentially achieves the performance of the infinite interpolation case.

Best Modes of the Invention Referring first to Figs. 1 to 4, the received signal r [n] is given by: r [n] = s [n] + ruz [n], for n = 0,1, 2,..., N-1 (1) s [n] =Aej2#fnTs, where: {[n]}0N-1 is a set of independent, complex, zero mean, Gaussian random variables 77iM=Imag {77 [n]}, f is the frequency of the tone, Ts is the sampling period,

#2 -= var [ [n]] =var [77j [n] ] and, A is the signal amplitude.

A fast Fourier transform is performed and the sampling frequency, fs, is given by, fs = T samples/s (2) Ts Then, an initial frequency estimate fez is taken as the frequency corresponding to the largest FFT output coefficient magnitude. A discriminant which is proportional to the frequency error in the initial frequency estimate fez is computed using modified coefficients α0, ? o of the discrete Fourier transform (DFT) with center frequencies plus one half and minus one half of the FFT bin spacing relative to the initial frequency estimate fO.

The value of the discriminant is then mapped into the estimate of the frequency error in the initial frequency estimate fo using a mathematically derived function.

The estimate of the frequency error is added to the initial frequency estimate , to get a next interpolated frequency estimate fi.

The process is then repeated, using the next interpolated frequency estimate fi and computing a new frequency discriminant to produce a next, more precise, frequency estimate f2.

THE FREQUENCY INTERPOLATION DISCRIMINANT It is assumed that the signal to noise ratio (SNR) is sufficiently high such that the largest magnitude FFT coefficient corresponds to a frequency closest to the signal frequency. This assumes that the signal to noise ratio is sufficiently high that the probability of the statistical outlier event of a noise only FFT bin magnitude being larger than a FFT bin containing both signal and noise is negligible.

Define,

Then the discriminant, or distance metric, of frequency estimation error is defined as, <BR> <BR> #ß#-#α#<BR> D(#,#)= (9)<BR> <BR> <BR> <BR> <BR> <BR> #ß#+#α# where, #=fTs - kmax/N (10) and, #=fTs - kmax/N For the initial frequency estiamte using the FFT, #0Ts = kmax/N and # = 0.

In the noiseless case, D (e, ) is a monotonically increasing function of # - #. Therefore, eachD (s,), there is a unique inverse mapping to #-#. Clearly, D(#,#)) may be used as a discriminant for fine frequency interpolation between FFT bin centre frequencies. <BR> <BR> <P>There some functional relationship such that,<BR> <BR> <BR> <BR> <BR> <BR> f1Ts = kmax/N #[D(#, #] ,(12) where, # (. ) is a monotone increasing function.

(.) is called the frequency interpolation function and fi is the first interpolated frequency estimate.

The requirement that f, has zero error in the noiseless case is, #[D(#,#)]=#-#, for-11#D#1. Therefore, #-1(#-#)=(#,#).

THE FREQUENCY INTERPOLATION FUNCTION <BR> <BR> Assume that, kmax - 1 # fTs # kmax + 1 .<BR> <BR> <P> N 2N N 2N

Then, - 1 # #-##1. (13)<BR> <BR> <BR> <BR> 2N 2N<BR> <BR> <BR> <BR> <BR> <BR> r [n] = s [n] =Aej2#fnTs, n=0,1,2,..., N-1 (14) Without loss of generality, assume that g =0. Also assume the noise free case.

The FFT output coefficients are given by, <BR> <BR> 1 2##N<BR> Y(k)=A k=0,1,...,N-1<BR> 1-ej2##<BR> <BR> <BR> <BR> <BR> sin(##N) (15)<BR> <BR> <BR> <BR> <BR> <BR> = Ae<BR> <BR> <BR> <BR> <BR> <BR> sin(##) The discriminant can be expressed as, After some trigonometric simplification, <BR> <BR> tan<BR> <BR> <BR> D (#,0) = 2N/tan(#s) (17)<BR> <BR> tan(##) This inverse mapping from D (6, s) to s-s can be obtained as, <BR> <BR> #-#=#[D(#,#)]=1/#tan-1[D(#,#)tan(#/2N)] (18) Then the first interpolated frequency estiamte, #1, may be obtained, where, The implication is that a two point (N=2) FFT is sufficient to obtain zero error frequency determination in the noiseless case. However, the Cramer-Rao lower bound is relatively large for N=2 and the SNR threshold is relatively large.

There is a motivation to use larger N to reduce the rms frequency estimation error. However, the implication of larger N is increased computational complexity and longer delay time to obtain the transform results. It is desirable to obtain low frequency estimation error with the smallest possible N.

Define, #1(D)=D/2N, for -1#D#1.

For large N or for any N and small #D#, the function #1(D) closely approximates (D).

FREQUENCY ESTIMATION BY ITERATION For the case of r [n] consisting of signal plus noise, the noise will cause a perturbation of D (6, b), and some error in the frequency estimate will result.

Although an algorithm for the exact frequency determination in the noiseless case has been presented, it will be shown that the noise performance of this algorithm improves substantially when | is close to zero. Since the discriminant D (F, ) can be used to get an interpolated frequency estimate with less than one half FFT bin size error, it then follows that the algorithm can be iterated to move ##-## towards zero and gD (e towards zero. ln this way the variance of the frequency estimator output can be reduced.

The iterative algorithm is defined below.

Define, Define a monotone increasing function of 1<BR> D, # (D), such that 0 (0) = 0, 4X (1) =1/2N,and#(-1)=-1/2N.

and, <BR> <BR> <BR> <BR> <BR> <BR> #=fTs-kmax/N<BR> <BR> <BR> <BR> <BR> #m=fmTs - kmax/N The iterative algorithm is defined by, f0Ts = Kmax/N , which implies that #0 = 0.

Then, <BR> <BR> <BR> <BR> <BR> <BR> f1Ts = f0Ts+#[D(#,#0]<BR> #2Ts=#1Ts+#[D(#,#1]<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> ...<BR> fmTs = fm-1Ts+#[D(#,#m-1]<BR> and,<BR> <BR> f#=lim fm<BR> <BR> <BR> <BR> <BR> m##<BR> <BR> <BR> <BR> D#=lim(Dm)<BR> <BR> <BR> <BR> m## The steady state frequency estiamte at the end of the iteration is ##.

Define, #k=#kTs-kmax/N, for k-0,1,2,3 Then, ## = f#Ts - kmax/N and, the normalized frequency error is, ##-#=(##-f)Ts The iteration may be viewed as a convergence to a fixed point of the equation, #m=g(#m-1)=#m-1-#[D(#,#m-1)], for m # 1 and -1/2N # #0 # 1/2N

Theorem 1 below is referenced, [21]; <BR> <BR> <BR> <BR> <BR> <BR> Let g (x) be a continuous function on [-1/@,1/@] and g ([a,b]) c [-1/@,1/2].<BR> <BR> <BR> <P> 2N 2N 2N 2N Furthermore, assume that there is a constant 0 < A < 1, with, #g(x)-g(y)####x-y#, for all x, y E [a, b], Then, x = g (x) has a unique solution x# in [a, b], also, the iteration xn =g(xn-1),for n > 1 will converge to x «, Ofor any choice of xo E [a, b], and, <BR> <BR> <BR> <BR> #n<BR> <BR> <BR> <BR> <BR> |x# - xn|# 1-# |x1 - x0| In the situation under analysis, for fixed {r[n]}0N-1 and #,#(.) is a function of #. g(#)=#-#(#) and, <BR> <BR> <BR> |g(x)-g(y)|#||x-y||1-#(x)-#(y)|.<BR> <BR> <BR> <BR> x-y<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> If 0 < #(x)-#(y) <2<BR> <BR> <BR> <BR> x-y Then, <BR> <BR> <BR> #g(x)-g(y)#<# x-y#,<BR> <BR> <BR> <BR> <BR> #(x)-#(y)<BR> where, # = max|1- | for x,y #[-1/2N,1/2N]<BR> <BR> x-y Using Theorem 1, it follows that the iteration will always converge to a fixed point under the appropriate conditions.

Also, #(D#)=0, and from the properties of # (.), D =0.

The fixed point solution, f satisfies, The two previously defined functions V (D) andW, (D) fulfil the requirements of # (D) and may be used in the iteration to obtain f. While gu (D) iteration will tend to converge more rapidly than tv, (D) iteration, both will yield identical values of .. However, evaluation of V, (D) has lower computational complexity than evaluation of u (D). There is performance advantage in using (D) when the computation is limited to a few iterations.

ADDITIONAL FREQUENCY ACCURACY Assuming that the SNR is sufficiently high, it is highly probable that f#[f0 - fs, f0 + fs]. This is an above threshold condition [1]. A fine interpolation 2N 2N is obtained to improve the frequency accuracy.

The normalized frequency estimate kr,, is computed recursively in order to save computational complexity.

After computation of frs, f is obtained by (frs) fs =f First Algorithm Referring to Figures 13 and 14, a first algorithm is provided to improve the accuracy of the frequency estimation. At step 1, the N point complex FFT is computed. The FFT output coeffficents are Y (k), 0#k#N-1.

At step 2, the peak search to find kmax is: kmax -max-1[#Y[k]#:0#k#N-1].

At step 3, the initial frequency estimate is computed by: fo = kN fs At step 4, recursion is started at m=0.

At step 5, the DFT coefficients for the m: th frequency estimate are computed:

The frequency discriminant is then computed: <BR> <BR> #fm(r) = 1 tan-1[|ßm|-|αm|tan(#)] fs<BR> <BR> <BR> <BR> <BR> # |ßm|+|αm| 2N The m+1 : th frequency estimate, is computed: #m+1 = #m + #fm (r) At step 6, convergence for the frequency estimate is reached if is sufficiently small. If there is convergence, then the frequency estimate is #m+1.

If convergence for the frequency estimate has not been reached, then m is incremented by 1 and step 5 is repeated. In practice, the algorithm will converge for m=2. Therefore, only fm for m=0, 1, and 2 need to be computed (two iterations) which means that the frequency estimate is f2.

Second Algorithm To handle large N, a modification to the first algorithm is made. The <BR> <BR> modification is made to the step of computing the frequency discriminant:<BR> |ßm|-|αm|<BR> <BR> <BR> <BR> <BR> <BR> #f(r) = 1/#tan-1[ tan(#/2N)] fs<BR> <BR> <BR> <BR> <BR> |ßm|+|αm|<BR> |ßm|-|αm|<BR> <BR> <BR> <BR> <BR> <BR> <BR> # 1/# tan-1 [ ##/2N#] fs<BR> |ßm|+|αm|<BR> <BR> <BR> <BR> |ßm|-|αm|<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> # 1/2N [ ] fs<BR> <BR> <BR> <BR> <BR> <BR> |ßm|+|αm| Third Algorithm A third algorithm is provided to improve the frequency accuracy. At step 1, the the N point complex FFT is computed. The FFT output coeffficents are Y (k), 0#k#N-1.

At step 2, the peak search to find kmax is: kmax = max-1[#Y [k] 1 : °s k<N-1] At step 3, the initial frequency estimate is computed by: #o = kmax/Nfs At step 4, the DFT coefficients for the initial frequency estimate are computed: The frequency discriminant is then computed: Afo (r) = 1/ tan-1[#ß0#-#α0# tan (#/@@)] fs<BR> # #ß0#+#α0# 2N The first interpolated frequency estimate is computed: fi = fO + Afo (r) At step 5, recursion is started at m=1 At step 6, the DFT coefficients for the m: th frequency estimate are computed: The frequency discriminant is then computed: <BR> <BR> <BR> <BR> <BR> |ßm|²-|αm|² <BR> <BR> #fm(r) = 4N [|ßm|²+|αm|²]fs The m+1 : th frequency estimate, fmAl7 is computed: #m+1 = #m + #fm (r) At step 7, convergence for the frequency estimate is reached if is sufficiently small. If convergence has been reached, then the frequency estimate is #m+1. If convergence for the frequency estimate has not been reached, then m is incremented by 1 and step 6 is repeated. In practice, the algorithm will converge after 2 iS evaluated. Therefore, only fm for m=0, 1, and 2 need to be computed. This algorithm is less computationally complex than the first algorithm and has essentially the same convergence properties in the recursion.

Fourth Algorithm A fourth algorithm is provided to improve the frequency accuracy. At step 1, the N point complex FFT is computed. The FFT output coeffficents are Y (k), 0<k<N-1.

At step 2, the peak search to find kmax is: kmax =maux-' [lY [k] ! : 0 # k # N -1] At step 3, the initial frequency estimate is computed by: ko = kN3X fs At step 4, the DFT coefficients for the initial frequency estimate are computed:

The frequency discriminant is then computed: #f0 = 1 [|ß0|-|α0|] fs<BR> 2N |ß0|+|α0| The first interpolated frequency estimate is computed: fi = fo + Afo At step 5, recursion is started at m=1 At step 6, the DFT coefficients for the m: th frequency estimate are computed: The frequency discriminant is then computed: <BR> <BR> 1 |ßm|²-|αm|²<BR> <BR> <BR> <BR> #fm = 4N [|ßm|²+|αm|²]fs The m+1 : th frequency estimate, fm+l, is computed: #m+1 =#m + #fm (r) At step 7, convergence for the frequency estimate is reached if is sufficiently small. If convergence has been reached, then the frequency estimate is If convergence for the frequency estimate has not been reached, then m is incremented by 1 and step 6 is repeated. In practice, the algorithm will converge after f2 is evaluated. Therefore, only fm for m=0, 1, and 2 need to be computed. This algorithm is less computationally complex than the first, second or third algorithms and has essentially the same convergence properties in the recursion. There is reduced computational complexity in the computation of #f1 (r) because of the elimination of the need to compute square roots in the evaluation of the absolute value of complex variables.

Fifth Algorithm A fifth algorithm is provided to improve the frequency accuracy. At step 1, the N point complex FFT is computed. The FFT output coeffficents are Y (k), 0#k#N- 1.

At step 2, the peak search to find kmax is : km =max-' 1[#Y[k]#:0 # k # N-1] At step 3, the initial frequency estimate is computed by: fo = kmax/Nfs At step 4, recursion is started at m=0 At step 5, the DFT coefficients for the m: th frequency estimate are computed: The frequency discriminant is then computed: <BR> <BR> 1 [|ßm|γm-|αm|γm] fs, where, γm is a set of non-negative constants.<BR> <BR> <P>#fm(r) = 2Nγm |ßm|γm+|αm|γm γm is a cons tan t, γm > 0 The m+1 : th frequency estimate, im+,, is computed: fm+l = fm + Afm (r) At step 6, convergence for the frequency estimate is reached if jfm+i-fm !'s sufficiently small. If convergence has been reached, then the frequency estimate is im+,. If convergence for the frequency estimate has not been reached, then m is incremented by 1 and step 5 is repeated.

Scaled Computational Version of an algorithm The frequency scaled frequency estimate can be computed and then multiplied by fs. This process is described using the example of the first algorithm but can similarly be done for all the algorithms. The scaled computational version of the first algorithm is more computational efficient as it saves multiplies.

At step 1, the N point complex FFT is computed. The FFT output coeffficents are Y (k), O<k<N-1.

At step 2, the peak search to find kmax is : kmax = max-1[#Y[k]#: 0 # k # N-1] At step 3, the initial frequency estimate is computed by: #oTs = kmax/N At step 4, recursion is started at m=0 At step 5, the DFT coefficients for the m: th frequency estimate are computed:

The frequency discriminant is then computed:<BR> #ßm#-#αm#<BR> <BR> <BR> <BR> <BR> <BR> #fm(r)Ts = 1/# tan-1 [ tan(#/2N)]<BR> <BR> <BR> <BR> <BR> <BR> #ßm#+#αm# The m+1 : th frequency estimate, foal, is computed: #m+1Ts = #mTs + #fm(r) Ts At step 6, convergence for the frequency estimate is reached if is sufficiently small. If convergence has been reached then the scaled frequency estimate is fm+lTs-If convergence for the frequency estimate has not been reached, then m is incremented by 1 and step 5 is repeated.

As a final operation, one additional multiply is require to remove the scaling from the frequency estimate.

(fmlTs) fs = fml since TSfs=1 where i. +, is the m+1 : th frequency estimate.

Sixth Algorithm A sixth algorithm is provided to improve the frequency accuracy. The sixth algorithm uses any of the previously defined functional forms for Afm (r) for any step. The difference between the sixth algorithm and the other algorithms types is that the frequencies of the two modified DFT coefficients are not changed.

Instead, the centre frequency of the signal is modified by multiplying the <BR> <BR> previously defined signal by e-j 2 # n # fmTs to obtain<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> fx [7 e-j 2 # n # fmTs}. The effect of this multiplication is to frequency translate the signal by-Afm Hertz. The frequency discriminant is driven to zero input and output values by either modifying the frequency of the DFT coefficients or frequency translating the signal. The principle of driving the discriminant to zero by recursion is the same. The frequency error performance of the algorithm as a function of signal to noise ratio is the same whether the signal is frequency translated or whether the DFT coefficients are frequency shifted.

There are situations where standard FFT or DFT functions are available in hardware, software, or combined hardware and software configurations. These FFT and DFT functions are highly optimised for their respective signal processors and are run at very high computational efficiency. Often, parallel processing for multiple processors is utilised extremely effectively. In these cases, the technique of frequency translation of the signal is of considerable implementation benefit. Very efficient computation is achievable. Frequently, an optimised large N point FFT runs faster on a parallel processor than the computation of two DFT coefficient.

For the sixth algorithm, zo (n) = r(n), n = 0, 1,2, 3,... is initialised.

At step 1, the N point complex FFT is computed. The FFT output coefficients are Y (k), OsksN-1.

At step 2, the peak search to find kmax is: kmax = max-1[#Y[k]#: 0 # k # N-1] At step 3, the initial frequency estimate is computed by: #o = kmax/Nfs At step 4, recursion is started at m=0 At step 5, the DFT coefficients for the m: th frequency estimate are computed: The frequency discriminant, #fm(r), is then computed for any of the functional forms as a function of am and ßm- The m+1 : th frequency estimate, #m is computed: fm+l = fm + Afm (r) At step 6, convergence for the frequency estimate is reached if is sufficiently small. If convergence has been reached, then the frequency estimate is fm+l. If convergence for the frequency estimate has not been reached, then the signal is frequency translated (by complex time domain multiplication) : zm+1(n) = zm(n)3-j2#n#fmTs, for n = 0,1,2,...,N-1 then m is incremented by 1 and step 5 is repeated.

For convergence, all algorithms have the same steady state performance.

In the noiseless case, the first algorithm gives the exact frequency for one iteration, which is of great benefit in some applications. The exact frequency is obtained for any N, including N=2. The reason is that an exact functional mapping from the magnitudes of the two DFT coefficients to the frequency was analytically derived and used in the algorithm. This is a new analytical result and forms the basis of the algorithm.

PERFORMANCE ANALYSIS For the case of signal in additive noise, D is a random variable. <BR> <BR> <BR> var[##Ts] = var[##] =var [0 (D, O) ]<BR> <BR> <BR> #ß#-#α#<BR> D(#,##) =<BR> <BR> <BR> <BR> #ß#+#α# In general, #α# and #ß# are both Rician distributed random variables. However, under high signal to noise ratio, both #α# and 101 are essentially Gaussian distributed random variables. which is a random variable, is found by the constraint, 0 = D# = D(#,##) = #######, for f = f# so, will be perturbed by the noise component in D.,,. Even though D. is constrained to be zero, the constraint and noise induce randomness in s",. The noise perturbation in D induces the perturbation in co.

The approach taken is the computation of the variance of D from the point of view of the creation of D from noisy observations and then to find the corresponding perturbation of For high signal to noise ratios, D (£,) may be represented by the first three terms of the Taylor Series expansion about, µα and µß, which are the means of lul and IA, respectively.

D = |ß|-|α| = f(α,ß) = µß-µα + 2µß (|α|-µα) - 2µα (|ß|-µß)<BR> <BR> <BR> |ß|+|α| µß + µα (µß+µα) (µß + µα)²<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> Assuming ## = # A µα = µß =<BR> <BR> <BR> <BR> sin(#/2N) and for high signal to noise ratio, <BR> <BR> #2 = #2 = 1/ N#2<BR> <BR> <BR> Then, Then, E[D]=0, <BR> <BR> 4µß2#α2 4µα2#ß2<BR> var[D] =<BR> <BR> <BR> <BR> (µα + µß)4 (µα + µß)4 It then follows that, <BR> <BR> <BR> <BR> <BR> <BR> <BR> Nsin2(#/@@)<BR> <BR> <BR> <BR> var [D] = 2N<BR> <BR> <BR> <BR> 4 (SNR)<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> A2<BR> where, SNR = #²<BR> <BR> <BR> <BR> <BR> 1<BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> <BR> #-# = tan-1 [D tan(#)]<BR> <BR> <BR> # 2N Then, for high signal to noise ratio, the normalized frequency error may be computed. The largest part of the probability density function of D is in the region of where the atan (x) # x. Therefore, PERFORMANCE COMPARISON TO THE CRAMER-RAO LOWER BOUND

The Cramer-Rao Lower Bound on the variance of the frequency error of any unbiased frequency estimator is given by, 2 6 (2N (N-1) (SNR) The performance of the DFT based estimator may be compared to the Cramer- Rao Lower Bound.

For high SNR and large N, the performance frequency estimation variance is 10 log10 (#4/96) = 0.063282577 dB .above the Cramer-Rao Lower Bound.

Figure 5 shows ##2/2 in dB verses N, where N is the length of the FFT.

(7CRLB JUSTIFICATION FOR ITERATION TOWARD A ZERO VALUE OF THE DISCRIMINANT The reason for the performance improvement of the proposed class of algorithms relative to prior algorithms is the first frequency interpolation allows the computation of two DFT coefficients, which are Y2 DFT bin spacing above the first interpolated frequency and 1/2 DFT bin space below the first interpolated frequency. While the first interpolation may still have significant error, which is dependent on the relationship of the true frequency relative to the FFT coefficient frequencies, the error discriminant evaluated for the first interpolated frequency will have a value close to zero. The variance of the frequency error is relatively low in the region of small values of the frequency discriminant. Therefore, the second interpolated frequency will have small error variance. There is significant noise performance advantage in using the first interpolation to allow a low error variance second interpolation. The interpolation may be iterated, with diminishing improvements of estimation accuracy, until convergence to a fixed point solution is obtained. Figure 6 shows the variance of the normalised estimator frequency error estimate vs the

frequency error for the first interpolation. For the figure, N=64 and the signal to noise ratio is 6 dB. There is a very sharp reduction the rms error of the frequency estimator in the region of the frequency being close to the center frequency of the frequency discriminator. This indicates that tremendous improvement in performance obtained by iteration.

ALGORITHM SIMPLIFICIATONS RESULTING IN LARGE REDUCTIONS IN COMPUTATIONAL COMPLEXITY Simulation results have verified a single FFT and two iterations involving the computation of the discriminant function D (s, so) and D (s) are sufficient to obtain RMS frequency error performance close to the computation of f. The first iteration moves the discriminant towards zero and decreases of 16-b, 1.

The estimate resulting from the second iteration therefore results in small error variance of s-sa.

The algorithm has complexity of O (N log2 (N) +0 (8N) =O [N log2 (N) ] The algorithm has the same order of complexity as the original FFT for performance, which is very close to the Cramer-Rao Lower Bound.

The algorithm has the same order of complexity as the original FFT for performance, which is very close to the Cramer-Rao Lower Bound.

Iteration with yrl (D) = D yield results very close to yr (D) and saves considerable computational complexity. The fixed point solution for the two cases is identical.

Since the algorithm comes very close to convergence with two iterations, two iterations are sufficient for most applications. The performance improvement with additional iterations is small.

OTHER FREQUENCY DISCRIMINANTS WITH THE SAME NOISE PERFORMANCE There are a number of discriminants, which have the same performance, when used iteratively to obtain the fixed point solution, as the previously introduced discriminants. The noise performance is identical, for iteration, because the fixed point solution is identical.

This class of discriminants includes functional forms, <BR> <BR> <BR> 1|ß|γ-|α|γ<BR> D = , for γ > 0.,<BR> <BR> <BR> <BR> γ|ß|γ+|α|γ

<BR> 1#ß#2-#α#2<BR> and in particular, D =<BR> 2|ß|²+|α|² and, D = Re [ß-α*], where * denotes complex conjugate.<BR> <P> /ja And where Re [. ] is the real part.

SIMULATION Figures 7 to 12 show the rms frequency error performance of the algorithm vs SNR in dB, for N=2,4, 16,64, 246, and 1024, respectively. Both the cases of one interpolation and two iterative interpolations are shown. The two interpolation case is essentially achieves the performance of the infinite interpolation case.

In summary, a new, low computational complexity, class of algorithms, which interpolates the result of a FFT, has been presented for the precise estimation of frequency of a complex exponential function in additive Gaussian noise. The performance of the algorithm, above the threshold in additive Gaussian noise, is about 0.06 dB above the Cramer-Rao lower bound. The algorithm is ideally suited to be utilized in a number of communications, signal processing and biomedical applications. The algorithm also has ideal characteristics for digital signal processor implementation.

Industrial Application There are a large number of applications for this invention, including : - Rapid frequency initialisation of a phase lock loop for rapid signal acquisition; - Radar processing for precision radial velocity and radial acceleration target measurements; - Sonar processing for precision radial velocity and radial acceleration target measurements; - Satellite orbit determination; - Missile trajectory determination; - Ultra sound imaging Doppler measurements for blood and other biological fluid velocity measurements;

- Ultra sound imaging for tomography processing involving Doppler shift measurements; - Coherent carrier tracking for coherent digital demodulators-large frequency acquisition range and rapid signal acquisition; - Noncoherent digital communication system frequency tracking-large frequency acquisition range and rapid signal acquisition; - Frequency estimation for electronic test equipment displays including frequency meters, oscilloscopes, spectrum analyzers and network analyzers; - Ultra low distortion, ultra high performance FM demodulator; and - Generalised software modules in Matlab and other commercial software packages.

It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.

REFERENCES [1] D. C. Rife and R. R. Boorstyn,"Single tone parameter estimation from discrete-time observations,"IEEE Transaction Inform. Theory, IT-20, No. 5, pp 591-598, Sept. 1974.

[2] D. C. Rife, "Digital tone parameter estimation in the presence of Gaussian noise, "Ph. D. dissertation, Polytechnic Institute of Brooklyn, June, 1973.

[3] D. C. Rife and R. R. Boorstyn,"Multiple tone parameter estimation from discrete-time observations,"The Bell System Technical Journal, Vol. 55, No. 9, pp 1389-1410, November, 1976.

[4] D. C. Rife and G. A. Vincent, "Use of the discrete Fourier transform in the measurement of frequencies and levels of tones,"The Bell System Technical Journal, Vol. 49, No. 2, pp. 197-228, Feb. , 1970.

[5] S. A. Tretter,"Estimating the frequency of a noisy sinusoid by linear regression,"IEEE Trans. Inform. Theory, vol IT-31, pp 832-835, Nov. , 1985.

[6] S. M. Kay, "A fast and accurate single frequency estimator,"IEEE Trans.

Acoust. , Speech, Signal Processing, vol. 37, pp. 1987-1990, Dec. , 1989.

[7] B. G. Quinn, "On Kay's frequency estimator," [8] G. W. Lank, I. S. Reed, and G. E. Pollon,"A semicoherent detection and Doppler estimation statistic,"IEEE Transactions on Aerospace and Electronic Systems, vol. AES-9, pp 151-165, Mar. , 1973..

[9] B. C. Lovell, P. J. Kootsookos, and R. C. Williamson,"The circular nature of discrete-time frequency estimators, in Proc. ICASSP, 1991.

[10] D. R. A. McMahon and R. F. Barrett, Generalisation of the method for the estimation of frequencies of tones in noise from the phases of discrete Fourier transforms,"Signal Processing, vol. 12, no. 4, pp371-383, April, 1987.

[11] B. G. Quinn, "Some new high accuracy frequency estimators", Proceedings of the Third International Symposium on Signal Processing and Its Applications, Volume 2,16-21 August, 1992, Gold Coast, Australia, pp 323-326, 1992.

[12] B. G. Quinn, V. Clarkson, P. J. Kootsookos, "Comments on the performance of the weighted linear predictor estimator,"IEEE Transactions on Signal Processing, Vol 46, pp 526-527, 1998.

[13] B. G. Quinn and J. M. Fernandes, "A fast efficient technique for the estimation of frequency,"Biometrika, vol 78, pp 489-498,1991.

[14] B. G. Quinn and P. J. Thomas, "Estimating the frequency of a periodic function, "Biometrika, vol 78, pp 65-74., 1991.

[15] G. W. Lank, I. S. Reed, and G. E. Pollon,"A semicoherent detection and Doppler estimation statistic,"IEEE Transactions on Aerospace and Electronic Systems, vol. AES-9, pp 151-165, Mar. , 1973.

[16] B. C. Lovell, P. J. Kootsookos, and R. C. Williamson,"The circular nature of discrete-time frequency estimators", in Proc. ICASSP, 1991.

[17] D. R. A. McMahon and R. F. Barrett, An efficient method for the estimation of frequency of a single tone in noise from the phases of the discrete Fourier transforms,"Signal Processing, vol 11, pp 169-177,1986.

[18] D. R. A. McMahon and R. F. Barrett, "Generalisation of the method for the estimation of frequencies of tones in noise from the phases of discrete Fouriertransforms,"Signal Processing, vol. 12, no. 4, pp371- 383, April, 1987.

[19] E. J. Hannan, "The estimation of frequency, "Journal of Applied Probability, Vol 10, pp 510-519,1973.

[20] D. Huang, "Approximate maximum likelihood algorithm for frequency estimation, "Statitica Sinica, vol 10, pp 157-171,2000.

[21] K. E. Atkinson, An Introduction to Numerical Analysis, New York: Wiley, 1989.