Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
MICROPHONE AUTOLOCALIZATION USING MOVING ACOUSTIC SOURCE
Document Type and Number:
WIPO Patent Application WO/2015/102883
Kind Code:
A1
Abstract:
Provided are methods and systems for calibrating a distributed sensor (e.g., microphone) array using time-of-flight (TOF) measurements for a plurality of spatially distributed acoustic events at the sensors. The calibration includes localization and gain equalization of the sensors. Accurate measurements of TOFs are obtained from spatially distributed acoustic events using a controlled signal emitted at known intervals by a moving acoustic source. A portable user device capable of playing out audio is used to produce a plurality of acoustic events (e.g., sound clicks) at known intervals of time and at different, but arbitrary locations based on the device being moved around in space by a user while producing the acoustic events. As such, the times of the acoustic event generation are known, and are spatially diverse. The calibration signals emitted by the acoustic source are designed to provide robustness to noise and reverberation.

Inventors:
GAUBITCH NIKOLAY D (US)
KLEIJN WILLEM BASTIAAN (US)
HEUSDENS RICHARD (US)
Application Number:
PCT/US2014/070554
Publication Date:
July 09, 2015
Filing Date:
December 16, 2014
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
GOOGLE INC (US)
International Classes:
G01S3/801; G01S5/18; G01S5/30
Domestic Patent References:
WO2012164448A12012-12-06
Other References:
GAUBITCH NIKOLAY D ET AL: "Auto-localization in ad-hoc microphone arrays", 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP); VANCOUCER, BC; 26-31 MAY 2013, INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS, PISCATAWAY, NJ, US, 26 May 2013 (2013-05-26), pages 106 - 110, XP032509297, ISSN: 1520-6149, [retrieved on 20131018], DOI: 10.1109/ICASSP.2013.6637618
PATTERSON W R ET AL: "Microphone Position and Gain Calibration for a Large-Aperture Microphone Array", IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 13, no. 1, 1 January 2005 (2005-01-01), pages 42 - 52, XP011123542, ISSN: 1063-6676, DOI: 10.1109/TSA.2004.834459
KOZINTSEV I ET AL: "Position Calibration of Microphones and Loudspeakers in Distributed Computing Platforms", IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 13, no. 1, 1 January 2005 (2005-01-01), pages 70 - 83, XP011123587, ISSN: 1063-6676, DOI: 10.1109/TSA.2004.838540
KHANAL S ET AL: "A Free-Source Method (FrSM) for Calibrating a Large-Aperture Microphone Array", IEEE TRANSACTIONS ON AUDIO, SPEECH AND LANGUAGE PROCESSING, IEEE SERVICE CENTER, NEW YORK, NY, USA, vol. 21, no. 8, 1 August 2013 (2013-08-01), pages 1632 - 1639, XP011519772, ISSN: 1558-7916, DOI: 10.1109/TASL.2013.2256896
Attorney, Agent or Firm:
BILLINGS, Chad (Stewart Kolasch & Birch, LLP,P.O. Box 74, Falls Church VA, US)
Download PDF:
Claims:
Claims

1. A compiner-implenienied method comprising:

measuring, arrival times of a set of acoustic events at a set of sensors, wherein the acoustic events are generated at time intervals known to the sensors; and

estimating internal delays of the sensors based on registered arrival times of the acoustic events at the sensors,

2. The method of claim I, f urther comprising:

calculating times of flight for the acoustic events to reach the sensors based on the registered arrival times of the acoustic events at the sensors and event generation times for the acoustic events; arid

determining locations of the sensors using the times of flight for the acoustic events to reach the sensors,

3. The method of claim 2, wherein calculating the times of flight for the acoustic events to reach the sensors is performed iterative!}' to refine the times of flight.

4. The method of claim 2, further comprising selecting the first acoustic event generated as a reference time for calculating the times of flight for the acoustic events to reach the sensors,

5. The method of claim 2, further comprising determining a relative gain for each of the sensors using the calculated location of the sensor and the registered arrival times of the events at the sensor. 6, The method of claim ] , wherein each of the acoustic events is a calibration signal tha t is a Gaussian modulated sinusoidal pulse.

7. The method of claim I , wherein each of the acoustic events is a calibration signal that Is a time-stretched pulse.

8. The method of claim 1, wherein eac of the acoustic events is a calibration signal thai is a unit impulse.

9. The method of claim .1 , wherein the set of sensors is a set of microphones,

10. The method of claim .1 , wherein the set of events is generated by a device with a loudspeaker from a plurality of different locations relative to the sensors. ϊ I . The method of claim L wherein one or more of the sensors are microphones located on mobile telephones.

12. A. computer-implemented method comprising:

calculating (310) times of flight for a set of acoustic events to reach a set of sensors based on registered arrival times of the acoustic events at the sensors and event, generation times for the acoustic events, wherein the acoustic events are generated at time i tervals .known to the sensors; calculating (325) locations of the sensors using the times of flight .for the acoustic events to reach the sensors; and

determining (330) a relative gam for each of the sensors using the calculated location of the sensor and the registered arrival times of the events at the sensor.

13. The method of claim 12, further comprising;

measuring (305) arrival times of the set of acoustic events at the set of sensors; and estimating internal delays of the sensors based on die registered arrival times of the acoustic events at the sensors.

14. The method of claim .12, wherein calculating the times of flight for the acoustic events to reach the sensors is performed Iteratively to refine the times of flight.

15. The method of claim 12, further comprising selecting the first acoustic event generated as a reference time for calculating the times of flight for the acoustic events to reach the sensors.

1 . The method of claim 12. wherein the relative gain for each of the sensors is determined based on an estimation of the signal-to-noise (S.NR.) at the sensor.

17. The method, of claim .12, wherein each of the acoustic events is a calibration signal, that is a Gaussian modulated sinusoidal pulse.

18. The method of claim 12, wherein each of the acoustic events is a calibration signal that is a time-stretched pulse.

19. The method of claim 12, wherein each of the acoustic events is a calibration signal that is a unit impulse.

20. The method of claim 1 , wherein the set of sensors is a set of microphones (220) and the set of events (215) is generated by a device (250) with a loudspeaker (255) from a plurality of different locations relative to the microphones.

Description:
MICROPHONE AUTOLOCALIZATION USING MOVING ACOUSTIC SOURCE BACKGROUND

ft> 0l| In order for microphones (e.g., installed on portable user devices, such as cellular phones) to be capable of determining their own locations (e.g., relative to one another and to one or more sources of sound) it is necessary to have a set of acoustic events, in an existing approach to self-localization of microphones, acoustic events are created independently of the devices, for example, by a user clapping hands. Such an approach introduces four unknowns per acoustic event (the three spatial coordinates aod the time of die event). As the problem of computing the unknowns is highly non-linear, it is difficult to deal with all of these additional unknowns, hi particular, the unknown event timing of the acoustic events prolongs the convergence of existing self-localization algorithms.

SUMMARY

( 0 21 This Summary introduces a selection of concepts in a simplified form in order to provide a basic understanding of some aspects of the present disclosure. This Summary is not an extensive overview of the disclosure, and is not intended to identify key or critical elements of the disclosure or to delineate the scope of the disclosure. This Summary merely presents some of the concepts of the disclosure as a prelude to the Detailed Description provided below.

f0003| The present disclosure generally relates to methods and systems for signal processing. More specifically, aspects of the present disclosure relate to calibrating distributed sensors using irae-of-arrival measurements from spatially distributed acoustic events.

f 004| One embodiment of the present disclosure relates to a computer-implemented method comprising measuring arrival times of a set of acoustic events at a set of sensors, wherein the acoustic events are generated at time intervals .known to the sensors, and estimating internal delays of the sensors based on registered arrival, times of the acoustic events at the sensors.

oOSf In another embodiment, the method further comprises calculating times of flight for the acoustic events to reach the sensors based on the registered arrival times of the acoustic events at the sensors and event generation times for the acoustic events, and determining locations of the sensors using the times of flight for the acoustic events to reach the sensors,

| 06j In another embodiment, tfoe method further comprises selecting the first acoustic event generated as a reference time for calculating the tones of flight for the acoustic events to reach the sensors.

|(Jft 7| In yet another embodiment:, the method further comprises determining a relative gain for each of the sensors using the calculated location of the sensor and the registered arrival times of the events at the sensor.

| «08{ Another embodiment of the present disclosure relates to a .method comprising: calculating times of flight for a set of acoustic events to reach a set of sensors based on registered arrival limes of the acoustic events at the sensors and event generation times for die acoustic events, wherein the acoustic events are generated at time intervals known to the sensors; calculating locations of the sensors using the times of flight for the acoustic events to reach the sensors; and determining a relative gain for each of the sensors using the calculated location of the sensor and the registered arrival times of the events at. the sensor.

009) In another embodiment, the method further comprises measuring arrival, times of the set of acoustic events at the set of sensors, and estimating internal delays of the sensors based on the registered arrival times of the acoustic events at the sensors. f 061.0) In another embodiment, the method farther comprises selecting the first acoustic event generated as a reference time for calculating the times of flight for the acoustic events to reach the sensors

oiif In one or more other embodiments, the methods and systems described herein may optionally include one or more of the following additional features: calculating the times of flight for the acoustic events to reach the sensors is performed iteratively to refine the times of flight; each of the acoustic events is a calibration signal that is a Gaussian modulated sinusoidal pulse; each of the acoustic events is a calibration signal that is a time-stretched pulse; each of the acoustic events is a calibration signal that is a unit impulse; the set of sensors is a set of microphones; the set of events is generated by a device with a loudspeaker from a plurality of different locations relative to the sensors; one or mote- of the sensors are microphones located on mobile telephones; and/or the relative gain for each of the sensors is determined based on an estimation of the signal-to-noise (SNR) at the sensor,

{0012) Further scope of applicability of the present disclosure will become apparent from the Detailed Description given below. However, it should, be understood that the Detailed Description and specific examples, while indicating preferred embodiments, are given by way of illustration only, since various changes and modifications within, the spirit and. scope of the disclosure wilt become apparent to those skilled in the art from this Detailed Description.

BRIEF DESCRIPTION OF DRAWINGS

00I3{ These and other objects, features and characteristics of the present disclosure will become more apparent to those skilled in the art from a study of the following Detailed 1 Description in conjunction with, the appended claims and. drawings, all of which form a part of this specification. In the drawings: | .4) Figure 1 is a schematic diagram illustrating, an example application for autolocalwation of sensors in a signaling environment according to one or more embodiments described herein.

|00151 Figure 2 is a schematic diagram illustrating an example moving acoustic source emitting a calibration signal at known intervals accordin to one or more embodiments described herein.

ft>0K>| Figure 3 is a flowchaii illustrating an example method fo calibrating a distributed sensor array using time-of-ffight measurements according to one or more embodiments described herein.

|001?1 Figure 4 is a graphical representation illustrating example estimation error results for extracting iime-of-flight measurements of a plurality of unit impulse calibration signals at a set of sensors according to one or more embodiments described herein.

f(KM8| Figure 5 is a graphical representation illustrating example estimation error results for extracting tinie-of-flight measurements of a plurality of Gaussian modulated sinusoidal pulse (GMSP) calibration signals at a set of sensors according to one or more embodiments described herein.

i*}| Figure 6 is a graphical representation illustrating example estimation, error results for extracting iime-of-ftight. measurements of a plurality a time-stretched pulse (TSP) calibration signals at set of sensors according to one or more embodiments described herein.

f0020| Figure 7 is a graphical representation illustrating example results for determining relative gains for a set of sensors using estimated time-of-flight measurements according to one or more embodiments described herein. f ΐ> 21 Figure 8 is a graphical representation illustrating example results for determining locations of a set of sensors based on time-of-arrival measurements of a plurality of calibration signals at the set of sensors according to one or more embodiments described herein.

f0022j Figure 9 is a graphical representation illustrating example results for determining locations of a set of sensors of a particular type and in a particaiar environment based on time-of-a va! measurements of a plurality of calibration signals at the set of sensors according to one or more embodiments described herein.

1 23} Figure 10 is a block diagram illustrating an. example computing device arranged for calibrating a distributed sensor array using time-of-arrival measurements according to one or more embodiments described herein.

|0024] The headings provided herein are for convenience only and do not necessarily affect the scope or meaning of what is claimed in the present disclosure.

|0025{ .In the drawings, the same reference numerals and any acronyms identify elements or acts with the same or similar structure or functionality for ease of understanding and convenience. The drawings will be described in detail in the course of the following Detailed

Description.

DETAILED DESCRIPTION

f0026j Overview

|002?J Various examples and embodiments will now be described. The following description provides specific details for a thorough understanding and enabling description of these examples. One skilled in the relevant art will understand, however, that one or more embodiments described herein may be practiced without many of these details, likewise, one skilled in the relevant art wiil also understand that one or more embodimems of the present disclosure -can include many other obvious features not described m detail herein. Additionally, some well-known structures or functions may not be shown or described in detail below, so as to avoid unnecessarily obscuring the relevant description.

((H ) 281 Embodiments of the present disclosure relate to methods and systems for calibrating a distributed sensor array using ttme-of-tlight (TOF) measurements of a plurality of spatially distributed acoustic events at the sensors (e.g., audio input devices, such as microphones), in accordance with one or more embodiments, the calibration may include localization and gain equalization of the sensors. The localization and gain equalization information generated for the sensors may be used, for example, for near-field beam-forming, which allows for selecting between different talkers and reducing environmental acoustic noise. Example applications of the methods and systems described herein include ad-hoc conference calling, group video chat, and the like.

(ηη2'>! The accurate estimation of TOF is an important element for successful calibration of distributed sensor arrays. As such, the present disclosure provides a method for pracucal and accurate measurements of TOF from spatially distributed acoustic events using a controlled signal emitted at known intervals by a moving acoustic source. As will be described in greater detail herein, the signals may be designed to provide robustness to noise and reverberation. Furthermore, the present disclosure will demonstrate that the measured TOFs may be used for accurate sensor localization to an accuracy of 1 -3 cm, and will also describe a new method for gain calibration based on the measured TOFs. Examples utilizing the methods described herein will illustrate that accurate sensor localization and gain calibration may be achieved even in the presence of noise and reverberation.

[»03ft] One or more embodiments described herein may utilize a moving acoustic source emittin a calibration signal at known intervals. For example, a. portable user device (e.g., a mobile telephone, smartphone, etc.) capable of playing out audio may be used to produce a plurality of acoustic events (e.g., sound clicks) at known intervals of time (e.g., even/ 0,5 seconds, every 1 second, etc.) and at different, but arbitrary locations based on the device being moved in spaced (e.g., by a user or operator of the de vice) while producing the acoustic events. As such, the times of the acoustic event generation are known, and are spatially diverse. As will be described in greater detail below, the TOFs of these emitted calibration signals at a set of microphones and the observed signals at these microphones may be used to estimate the gain differences between microphones in addition to performing microphone localization.

{0031 FIG. 1 illustrates an example application for auto-localization of sensors in a signaling environment according to one or more embodiments described herein. A plurality of signal sources 105 (e.g., talkers, loudspeakers, etc) may e located amongst a plurality of sensors 120 (e.g., microphones or other audio input devices),

{0032| Microphone arrays facilitate a wide range of algorithms for speech and audio processing. For many of these algorithms to operate correctly, there are two requirements on the microphone array: (i) the relative locations of the microphones must be known and (ii) the microphones must be calibrated to have the same gain and to reduce deviations from, an ideal (e.g., flat) transfer function. This can be achieved by careful selection of the microphones and priori defined microphone configuration so that the relative distances are known. However, there are several disadvantages with such an approach: fixed arrays do require dedicated hardware, microphone characteristics change over time and, depending on the structure of the array, the locations of the microphones may also change. Consequently, an automatic configuration scheme would be useful. Such an automatic procedure would also facilitate the use of more flexible ad-hoc microphone arrays where devices containing microphones such as mobile phones, tablets and laptops, are deployed.

|0033| The present disclosure provides a method that uses a moving controlled acoustic (e.g., sound) source to solve both the microphone localisation and calibration problems. As will be described in greater detail below, the method forms a complete microphone array coafi guratiosi system.

|0034} Microphone arrays can be used to capture speech and audio ' signals in adverse acoustic environments. The microphone signals may be processed and combined in order to focus on a signal originating from a particular location with respect to the microphones while suppressing signals from all other locations. Such a technique results in reduced noise and reverberation compared to an unprocessed, single-microphone observation,

} 035| A common approach to microphone array processing is beam-forming. While there are several existing beam-forming techniques, there are often two common requirements for these techniques to operate correctly: (i) the relative locations of the microphones must be known and (it) the microphones must be calibrated. One straightforward, solution is to manually measure the inter-microphone distances and to carefully select and calibrate the microphones. However, such an approach may not be feasible where, for example, ad-hoc microphone arrays are involved, in such a scenario, an automatic procedure may be preferred.

|0036} While some existing methods for localization of microphones and acoustic sources rely on measurements of the TOP, or, equivalently, iime-of-arrfval at the sensor (TOA), from spatially-distributed acoustic events, other alternative approaches have also been explored including, for example, time~difference-of-arrival (TDOA), signal energy, and the diffuse noise field coherence. It has also been shown that gain calibration is important for several heamforming algorithms and some algorithms for automatic gain calibration have been proposed.

10037} Despite the existence of TOF-based localization methods, there has ' been relatively little discussion on how to obtain accurate TOF measurements in practice, and errors in such measurements are typically modeled as additive measurement noise. However, as will be described in greater detail below, the methods and systems of the present disclosure are designed to obtain accurate TOF measurements by accounting for, among other things, the following considerations. First, the registered time-of-arrival ( TOA) for a specific acoustic event (e.g., generated from an acoustic source, such as a loudspeaker of a portable user device) needs to be identified correctly for all microphones. In accordance with the embodiments described herein, the RTOA may be considered the sum of the time that the signal arrives at the sensor and the device-internal delay due to, for example, buffering and/or processing. Second, the onset time of the acoustic event (e.g., the time at which the acoustic source begins transmitting the sound) needs to be identified. Thir d, the internal delay of each microphone (e.g., the time from, which the sound reaches the microphone to the time that the sound is registered as received by the user device in which the microphone is installed) needs to be identified. As will be described in greater detail below, for a given, microphone, subtracting the internal delay of the microphone and the onset time of the acoustic event from the RTOA identified for the microphone gives the TOF for the microphone. It should be noted that if an internal delay associated with the acoustic source is constant, such delay may not factor in to the computations described above.

{0038} One existing approach to microphone localization proposes to use chirps or maximum length sequences (M ' LSs) to identify the acoustic events. Under such an approach. the onset times are estimated trader the assumption that each microphone s associated with an acoustic event occurring in its proximity while the internal delays are measured manually. f©039} The following disclosure illustrates that a complete cahbraiioa of a distributed sound acquisition system may be achieved provided that accurate TOF measurements are available, In accordance with at least one embodiment, a portable user device (e.g., mobile telephone, smartphone, etc.) may be used to emit a calibration signal irom which the TOF measurements are obtained. The calibration signal may be emitted at l wn time intervals, which may determine the source onset times. FIG. 2 illustrates an example of such a mov ing acoustic source 250 emitting a calibration signal 215 at known intervals according to one or more embodiments described herein. The acoustic source 250 may include an output device (e.g., loudspeaker) 255 configured to generate and output the calibrating signals 215 while being moved to different: locations relative to a plurality of sensors 220 (e.g., microphones or other audio input devices), it should be understood that the acoustic source 250 utilized to generate the calibration signals 215 may be moved in any of a variety of manners and/or directions relative to the sensors 220 in addition to or instead of the example manner illustrated in FIG . 2.

{0040} As will be described in greater detail below, an algorithm is derived, to estimate die internal delays of the microphones. It will also be shown that such a controlled source facilitates the design of a calibration signal that is robust to noise and reverberation. The measured TOFs may be utilized to localize the microphones, and may further be utilized in conjunction with the observed calibration signals to estimate the relative gain differences between the microphones. Thus, the approach described herein provides complete calibration for a distributed microphone array. I I fOtHlJ FIG. 3 illustrates, an example process for calibrating a. distributed sensor array using ti e-of-flight measurements according to one or more embodiments described herein. At block 305, RTOAs of a particular acoustic event (e.g., generated from as acoustic source, such as a loudspeaker of a portable user device) at a plurality of sensors may be measured, and the measured RTOAs used as initial TOF measurements for the acoustic events to reach the sensors. At block 3 0, updated TOF measurements for the acoustic events to reach the sensors may be obtained using the initial TOF measurements determined at block 305.

00421 At block 315. it may be determined, for each of the sensors, whether the change from the initial TOF measurement from block 305 to the updated TOF measurement calculated at block 310 is sufficiently small (e.g., whether the change from the initial TOF measurement to the updated TOF measurement is small enough that the updated TOF measurement can he considered accurate for source localization purposes), if it is determined at biock 3 15 that the change from the initial TOF measurement (e.g., from block 305) to the updated TOF measurement (e.g., from block 310) for each of the sensors is sufficiently small, then at block 325 the updated TOF measurements for the sensors may be used to calculate the locations of the sensors and of the sources. On the other hand, if it is determined at block 3 15 that the change from the initial TOF measurement (e.g., from block 305) to the updated TOF measurement, (e.g., from block 310) for each of the sensors is not sufficiently small, then at block 320 a determination may be made as to whether a predetermined limit on the number of iterations to be performed has been reached.

[0043] if it is determined at. biock 320 that the iteration limit has been reached, then the process may return to biock 310 where further updated (e.g., refined) TOF measurements for the acoustic events to reach the sensors may be obtained using the initial. TOF measurements determined at block 305. However, if it is instead determined at block 320 that the iteration limit has been reached, then the process may move to block 325 where the updated TOP measurements for the sensors may be used to calciilate the locations of the sensors and. of the sources, as described above,

(00441 At block 330, relative gain differences between the sensors may be determined using the calculated locations of the sensors from block 325 and the observed calibration signals at the sensors.

|ΘΘ 5) Each of the blocks comprising the example process 300 will be described in greater detail in the sections that follow below,

[0o46| Problem Formulation

J0047J Consider, for example, a 3 -dimensional space where J calibration signals 5/ (n) (e.g., acoustic events) originating from different and unknow locations s } — [s x>f s v s z _ j f are captured by i microphones at unknown locations r< ~ [r x j. r yti r 2ii ] T . The signal from source J to microphone can be written.

¾/(**) ~ G ( (hi j (n) * s s (n) + (n)), (1 ) where ha(n) is the acoustic impulse response (AiR) and t¾(n) is additive measurement noise and * denotes convolution. Each microphone has an associated unknown gain, <7 έ . (0048] In accordance with at least one embodiment described herein, a method is provided for accumtely extracting the TOF for each caiibration signal and each microphone from, the observed signals χ</(η), using the TOFs to calculate the relative locations of the microphones r f s and using the TOFs and observed signals ¾(«) to estimate the microphone gains G t ,

(O049| RTOA Measurements f 005ft) The availability of accurate STOA measurements is- important to many microphone localization algorithms. STOA measurements may be obtained from the observed signals ¾(n) full slop. The measured RTOA of acoustic event S at microphone r i: may be determined as

where c is the speed of sound, jj « \\ denotes Euclidean norm, 6y is measutement. noise, S t is (he nh microphone internal delay, and denotes the onset time of the jih acoustic- event. Furthermore, + Xj is the STOA. As used herein, the "internal delay" refers to the time from which a sound (e.g., acoustic event) reaches an audio capture device (e.g., microphone} to the time the sound is registered as received by the capture device. Accurate localization depends on the TOF c~ 'l |(rj— S jj , and: therefore the source onset times and internal delays should be compensated tor, and the measurement error should be kept to a minimum. As will be further described in the following, one or more embodiments of the present disclosure present a robust approach to localization that achieves these aims by using a controlled signal from a moving source.

{0051] Excitation Signals

{0 5 1 -In accordance with at least one- embodiment described herein, acoustic events may be generated by a portable user device capable- of audio playback (e.g., a mobile- telephone, smartphone. etc.), which may be considered an "audio source device." It may be assumed that microphones installed in oilier user devices involved in an audio communication session (e.g.. an audi conference) have a line of sight of the audio source device. The audio source device may be used to play out (e.g., produce, generate, etc.) signals S j (n), which may be identical signals played, each, played out with a unique onset time r t . The total output signal of the audio source device may be a sum of the indiv dual signals S j (n) ; thai is ¾(n) ~ where the sum is over all excitation signals played out. In at least the present example, it ma be assumed that die signals S; (n) are separated in time by a fixed period of 7 p seconds (s). In this case ¾(n) = s (n— j T p ). Such a fixed time separation makes the overall output signal s(n), which represents the sum of the signals s } n) periodic during the calibration signal generation process.

| 0S3| If should be noted, however, that the assumption of the fixed time separation described above is -not a requirement of the embodiments described herein. Instead, in accordance -with one or more embodiments, the time interval between the emitted calibration signals ¾ (»·) may not be fixed and/or the emitted signals may not necessarily be the same. In accordance with an such embodiments, however, the emitted signals should be known. f0054j While the excitation, signals are played out by the audio source device, as described above, the device may be moved in a waving motion (e.g., by an operaior of the device) and the generated audio may be captured at each applicable microphone being used in a communication session, if the duration of each of the excitation signals S j n) is short in comparison to the velocity of the moving audio source device, each signal may be treated as a distinct acoustic event Sj(n) with onset time τ ; ·— τ ϋ + /T P . By substituting x i with τ 0 - / P in equation (2), above, it is realized that the source onset times may be corrected for by subtracting the known /Tp from the observed RTOAs. Further, setting the onset time of the first acoustic event as the time origin, r 0 - 0, gives the following i ' if = c - 1 |jr f - Sj \\ + δ ( + v tJ (3) ft should be noted that the above logic may still apply regardless of any internal delay at the transmit device (e.g., the audio source device).

f©055} A controlled signal such as thai described above has several properties thai improve the accuracy of microphone and source localization For example, using such a signal eliminates the unknown acoustic source onset time, allows a large number of acoustic evems to be generated in a short period of time, and the excitation signals s,-(n) may be chosen to facilitate accurate TOA measurements.

|0056} In accordance wit at least one embodiment, the signal that may be used for s } (n) may be chosen based on the criteria that the measurement should be robust to additive noise and .reverberation, and the signal should be of short duration (e.g., as compared to the velocity of the sound source). For example, the following three candidate signals may be considered as possibilities: (i) a unit impulse; (it) a time-stretched pulse (TSP),. which in some existing approaches is used for measurement of AI s and has the desirable feature that the pulse can be much shorter than the length of the AIR; and (iis) a Gaussian modulated sinusoidal pulse (GMSP). which is understood by those skilled in the art as being a pulse thai has the best trade-off between time and frequency localization according to a commonly utilized measure. One example advantage of the localized frequency of the GMSP is that the pulse may be centered on a spectral region where the microphone characteristics can be assumed favorable, in accordance with at. least one embodiment, the excitation signals ¾(n) may be chosen as impulsive signals such that the RTOAs may be measured based on their peak values. fOOS?} The received signals may be post-processed using a matched filter h m f (n) , which is the time-reversed version of the excitation signal, ¾ (— n) and the RTOAs tif may be extracted usin a peak picking algorithm. For example, in accordance with at least one embodiment, the peak picking algorithm may inclitde processing the input signal ¾,·(«) in .non-overlapping frames of T P and the peak of each frame with the highest energy may be selected as candidate RTOAs. The / peaks with highest energy may then be selected from the identified candidates.

[ίΚ ) 58] in the case of the I SP, the matched filter is equivalent to the inverse filter of the sequence and it results in an impulse (leaving the AIR). For the GMS.P, and the unit impulse, it results in a peak at the maximum correlation between the two signals, in general, matched filtering also efficiently suppresses imeorrelated additive noise; the amount of noise suppression increases with sampling frequency and with filter length. Thus, it will not have an effect for the unit impulse,

|0 5 1 Internal Delay Estimation

| 06 | The RTOAs obtained in the manner described above may be considered accurate estimates of the TOFs up to an interna! delay associated with each device. Because the probiems associated with unknown, source onset times have been resoived through the utilization of a controlled audio source, as described above, only the internal delays of the devices need to be estimated (the first onset time of the generating ma e arbitrarily selected as zero). This leads to a simplified algorithm as described in greater detail below.

[ ) (K>i| Without loss of generality, it may be assumed that c ~ 1 and that the RTOAs have been extracted correctly (up to an internal delay) such that £,·,· = 0. Squaring both sides of equation (31 subtracting the equation for i = 1, and then subtracting the equation for j = 1 gives the following:

-i ~ r 3. ) r (sy - ¾) - 0S(t* ~ t¾ - tl + t j) ~ ¾(t iy - t a ) + 6,(1, 1 - t„), (4) ί ~ 2, .. , , , ~ 2, .. . ,/. Equation (4) may further be expressed as

-K S T = T + A(«S), (5) where R is the (/ ' - I) x 3 location matrix of the microphones relative to rj . , S is the (J - ί ) x 3 location matrix of the acoustic events relative to s i , ~ 0$(ty— t ' f, - £¾ + i 3 ), vee{A(<S)} :::: W<$, δ— [0 " } δ 2 ... Sif, and W is a matrix composed of terms (¾ ~ ½) and (.-. ,— t n ). ft should be noted that vee iX) defines an operator thai stacks the columns of a matrix into a column vector,

| 062] From equation (5), above, it may be seen that matrix R " §* is at most rank 3. As a result, a two-stage iterative algorithm may be used to estimate the internals delays S such that T — T - Α(£ ϊ! ) is of rank 3. in accordance with at least one embodiment, in the first stage the current estimate of δ, ό" may be used. Keeping this estimate fixed, the estimate of R § r may be determined according to the following optimization problem. f } - arg min j|f< w > - f 3 1| s.t. rank {f 3 >≤ 3 , (6) where† (n) — T + A(S {n) ) ; Ύ^' is the best (according to the Frohenios norm) rank-3 approximation of ; >! i , and therefore, the best approximation of R S T . The solution, to equation (6) may be obtained using, for example, the Eckhart-Yoxing- irsky low-rank approximation theorem. Consider, for example, the singular value decomposition (SVD) of f f ( « ) = v '! which may ' be written as

T ( « ) = [fj j tl 2 ] 00 where £ s. contains the three largest singular values and Uj and Vj are the corresponding lefi- and right-singular vectors. The optimal rank-3 approximation in terms of ihe Fro enius norm may be obtained as f 3 ( = UiSjV . (8)

|0063J In the second stage, the estimate of t he internal delays may be updated as

where E^ = - T and W + is the pseudo-inverse of W. The additional {constraint on, term} |T^ | is introduced in order to force the solution to have reasonable delay values, which increases the initial convergence rate. However, λ should be set to zero when the solution, has become reasonable according to some criterion to allow the algorithm to converge fully. In accordance with at least one embodiment, this may be done by monitoring

F^" = [JfW jj^ and setting A = 0 when the change from one iteration to the next is below a threshold. It should be noted that the precise value of this threshold only affects convergence rate, and a reasonable value for this threshold may be selected by noting that the Frobenius norm has unit time squared. As such, the threshold may be set to be small compared to the square of a typical tinre-oMight For example, in accordance with at least one embodiment, the threshold may be selected as 0.0Ί ms~.

|0 64{ Similarly, — ||E^— Α(δ)|| may be monitored and the algorithm may be stopped when the change from one iteration to the next is below a threshold value. Again, this threshold may be set t be a small value as compared to the square of the typical ttrae-of- flight. For e ample, the threshold mm be . set sufficiently small such that its value may not affect the precision of the algorithm output. In accordance with at least one embodiment described herein, this threshold may also be selected as 0.01 ms\

| 065{ in accordance with at least one embodiment, the algorithm may converge in terms of the Frobenius norm for λ ~ 0. 11 should be noted that, unlike some existing approaches, the algorithm described above does not include arty step that requires non-linear optimization. As such, the convergence of the two-step algorithm described herein is an improvement over other existing approaches.

|0 66j Microphone Localization

|066?1 Given accurate estimates of the internal delays of the microphones, as described above, the corrected matrix of relative TOAs,†, may be used to estimate the locations of the sources and the microphones. First, T may be converted to a squared distance matrix as 0 ~ c 2 T, where c ::: 343 m/s, and where equation (5) is written as— R Ψ— D. Taking the SVD of D gives D— U∑V T , and since S T is a matrix of rank 3, only the three largest singular values in∑ need to be considered similar to equation (?) above. The remaining values in should be zero or dose thereto. Therefore, the following applies;

K = U', C (10)

where C is an invertible 3 x 3 matrix (to be estimated). The minimum solution for the localisation is invariant to rotations or translations of the source-raicrophone configuration. Therefore, the coordinates of the first microphone may be constrained to be the origin, r f - 10 0 O f', and the coordinates of the first source to be on the x-axis, s.i - i¾i 0 O ' j 7 . The matrix C and of can then be estimated using the non-linear least-squares (LS) optimization criterion, as follows;

C - arg maxc∑[ l∑£¾(i« ? C]| + [U'<¾ + [U f C]¾) 2 + {W∑'V% - 1\W C] i3.¾ , -

where ,- = c{t i — <¼) . The estimated source and the microphone positions may be determined by substituting€ and ¾j into equation (10). Such an approach results i the estimation of only ten parameters, independent of the number of acoustic events and microphones. It is known that increasing the number of acoustic events or microphones increases the estimation accuracy. In accordance with at least one embodiment, all of the estimated parameters may be used as initialization for a final refinement of the estimates using the non-linear LS criterion based on equation (3):

|ΘΘ68{ Microphone Gain Calculation

|0069| In accordance with one or more embodiments described herein, the estimated TOFs may be used together with the received calibration signals to determine the unknown gains Gi at each microphone. A free-field AIR may be considered and it may be assumed that the noise and excitation signals are uneorrelated. From equation (! ) the energy at the ii microphone due to the. th acoustic event, including the microphone gain, may be written as where B S J is the energy of the signal at the acoostic source at the./th location, B V is the energy of the measurement noise, and d if ™ Jjr f — s ; -jj— ct^ is the distance between the /ill acoustic source and the ith microphone. It should, be noted thai the TOF measurements or the estimated source-microphone locations may be used, for the distance estimate.

|M7i)| Given the above, an arbitrary reference microphone may be selecieci for example, the first / = I, which leads to the following expression for the microphone gains relative to the reference microphone

where ξ () - is the signal-to-nosse ratio (SNR) for the jth source at the ith microphone. From equation ( 16), presented below, it is understood that the observation noise will add a bias to the estimated relative gains for the microphones, and this bias will depend on the SNR, at the observations. For spatially diffuse noise or for closely spaced, microphones where ihe SNR can be expected to be the same across the microphones, noise will have little effect. However, for other scenarios, the bias may be corrected if the SNR at the microphones is estimated. Although reverberation is not explicitly considered, its effects may be minimized in practice by making the excitation intervals 7 " p greater than the reverberation time.

|ΘΘ711 The relative microphone gains may be determined as

where the measured TOF and the pnori knowledge of the emitted calibration signal durations may be used to evaluate the signal energies. It should be noted that in accordance with the various embodiments described herein, the TOF estimation is independent of gain differences between the microphones.

| 072| .Exam le Calculations 77

| 73J The following presents some additional examples to farther illustrate the microphone array calibration method described herein, in one example provided below, the RTOA is evaluated using different calibration signals, m the second and third examples, the measured TOFs are used for microphone localization and gain calibration. Each of these example processes is described in greater detail below. 074| All of the following examples are based on the same initial conditions and setup. The setup begins by generating observed signals according to equation (1 ), described above. The acoustic environment may be simulated using a source-image method known to those skilled in the art. The illustrative example is for a room with the following example dimensions: 6 ra (meters) χ 5 ra * 4 m. The reverberation time is varied between 0 s (e.g., free-field) and 0.6 s in steps of 0. i5 s, ::: 8 microphones are positioned randomly within a rectangular space of 2 m * 2 m x 1 m in the center of the room and J ~- 30 sources are randomly distributed in a one meter cubic ( I «v') space -positioned at random in the room. Ten different source-mi crop hone configurations are then generated. Each source-point is defined by the AIR !f (n} and emulates an instantaneous location of the moving acoustic source. The calibration signal s f {rt) used may he an impulse, a 1.3 ms TSP, or a I ms GMSP, with a display interval of T p ~ 0.1 s.

[WIS] White Gaussian additive noise may be assumed for v ; ,(fl). The noise level is adjusted with reference to the free-field unit impulse according to desired S R and held constant for the other excitation signals. The examples consider SNRs between -25 dB and -5 dB (performance is found to be unaffected for SMRs above -5 dB). Furthermore, a random gain factor <?* varying between 0.5 and 1, and a random internal delay ' between 0 and 1 s are applied to each microphone. The sampling rate is set to J 48 kHz. 076| Example 1

{ { M ) 77| in a first example, different calibration signals may be evaluated for extracting the TOFs in accordance with the method described above (e.g., . in Section 3.1..). in the present example , the internal delays are assumed known for the purpose of evaluation. For each ease, the percentage of correctly identified TOFs within. ±1 sample may be calculated, FIGS, 4-6 illustrate exampie results of performing this calculation for the different calibration signals, where the sampling rate used is 48 kHz. FIG. 4 is a graphical representation 400 showing example estimation error (in % correct TOFs to within ±1 sample) for the unit impulse as the calibration signal FIG. 5 is a graphical representing 500 showing example estimation error using the GMSP as the calibration signal. In addition, FIG. (> is a graphical representation 600 showing exampie estimation error using the TSP as the calibration signal. It can be seen from the example results shown in FIGS. 4-6 that the TSP has the greatest tolerance to noise and reverberation as compared with the other two calibrations signal types, and all TOFs are extracted accurately.

|0078] Example 2

|0079{ In another example the estimated TOFs .may he utilized to find the gains relative to microphone ::: 1 in accordance with the method described above (e.g., in "Microphone Gain. Calibration"). FIG. 7 is a graphical representation 700 illustrating example results for different noise levels and different levels of reverberation.

1008 ] ExperimerU 3

10081] In yet another example, the updated TOFs may be used to find the locations of the microphones and the sources in accordance with the method described above (e.g., in "Microphone Localization"). FIG. 8 is a graphical .representation 800 illustrating example results using exactly known interna! delays 830, estimated interna! delays 820, and no consideration of the internal delays 10.

|0082| Experiment 4

(ti«83| in still another example, all of the processes described in the previous examples may be performed using five AKG C417 lapel microphones connected to an RME Fireface 800 through an RME Octaraic II microphone preamplifier, in such an. example, the microphones may be positioned randomly on a table with dimensions of 0.75 m 1.5 m in a quiet, mildly reverberant room. A mobile telephone may be used as a sound source and a pulse train with 50 pulses at F p ~ 0.1 s intervals may be produced by the telephone while it is being moved in a waving motion (e.g., by a user). An additional random delay between 0 and 100 ms may be added to each microphone signal to simulate different interna! delays. FIG. 9 is a graphical representatio 900 illustrating example results of the microphone localization. The microphones may be localized to an accuracy of 2.9 cm, while using the centralized clock only resulted in an root mean squared error C MSE) of 1.4 cm.

10084} FIG. 10 is a high-level block diagram of an exemplary computer (1000) arranged for calibrating a distributed sensor (e.g., microphone) array using TOF measurements for a plurality of spatially distributed acoustic events at the sensors according to one or more embodiments described herein , In a very basic configuration (1001 ), the computing device (1000) typically includes one or more processor's (1010) arid system memory (1020). A memory bus (1030) can be used for communicating between the processor (1010) and the system memory (1020), 0085j Depending on the desired configuration, the processor (1010) can be of any type including but not limited to a microprocessor (μΡχ a microcontroller (μθ, a digital signal processor (DSP), or any combination thereof The processor (1010) can include one more levels of caching, such as a level one cache (101 ! ) and a level two cache (1 12), a processor core (1013), and registers (1014). The processor core (1013) can include an arithmetic logic unit (ALU), a floating point unit (FPU), a digital signal processing core (DSP Core), or any combination thereof. A memory controller (1016) can also be used with the processor (lOiO), or in some implementations the memory controller (1015) can. be an internal pan of the processor { 1010),

(iH ) 861 Depending on the desired configuration, the system memory (1 20) can be of any type including but not limited to volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.) or any combination thereof System, memory (1020) typically includes an operating system (1021), one or more applications ( 1022), and program data (1024). The application (1022) may include localisation and. gai calibration, algorithm (1023) for calibrating a plurality of sensors using TOF measurements for a plurality of spatially distributed acoustic events at the sensors according to one or more embodiments described herein. Program Data (1024) ma include storing instructions that, when executed by the one or more processing devices,, implement a method for calibrating a distributed sensor (e.g., microphone) array using TOF measurements for a plurality of spatially distributed acoustic events at the sensors according to one or more embodiments described herein.

| 8?j Additionally, in accordance with at least one embodiment, program data ( 1024) may include calibration signal data (1025), which may include data about the properties and/or characteristics of a particular signal type used as an excitation signal emitted from an audio source device to improve the accuracy of microphone and source localization (e.g., excitation signals S / (n) } as described above in the section "Excitation Signals"). For example, calibration signal data (1025) may include various properties data about any of the following example signal types that may be selected to facilitate accurate RTOA measurements: (ø a unit impulse; (it) a time-stretched pulse (TSP); and (iii) a Gaussian modulated sinusoidal pulse (GMSP). In some embodiments, the application (1022) can be arranged to operate with program data (1024) on an operating system (1021 ).

(8888] The computing device ( 3000) can have additional features or functionality, and additional interfaces to facilitate communications between the basic configuration ( 10 1 ) and any required devices and interfaces.

|8889j System memory (1020) is an example of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or an other medium which can be used to store the desired information and which can be accessed by computing device 1000. Any such computer storage media can be part of the device ( 1000).

!OOiHi] The computing device (1000) can be implemented as a portion of a small-form factor portable (or mobile) electronic device such as a cell phone, a smart phone, a personal data assistant (PDA), a personal media p!ayer device, a tablet computer (tablet), a wireless weh- aieh device, a personal headset device, an application-specific device, or a hybrid device that include any of the above functions. The computing device (1000) can also be implemented as a personal computer including both laptop computer and non-laptop computer configurations. fO091J The foregoing detailed, description has set forth various embodiments of the devices and/or processes via the use of block diagrams, flowcharts, and/or examples, insofar as such block diagrams, flowcharts, and/or examples contain one or more functions aid or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or virtually any combination thereof. In one embodiment, several portions of the subject matter described herein may be implemented via Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), digital signal processors (DSPs), or other integrated formats. However, those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be eqirivalently implemented in integrated circuits, as one or more computer programs running on one or more computers, as one or more programs running on one or more processors, as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure,

10 .921 .In addition, those skilled in the art will appreciate that the mechanisms of the subject mailer described herein are capable of being distributed as a program product in a variety of forms, and thai an illustrative embodiment of the subject matter described herein applies regardless of the particular type of non-transitory signal bearing medium used to actually carry out the distribution. Examples of a non~ transitory signal bearing medium include, but. are not limited to, the following: a recordable type medium such as a floppy disk, a hard disk drive, a Compact Disc (CD), a Digital Video Disk (DVD), a digital tape, a computer memory, etc.; and. a transmission type medium such as a digital and/or an analog communication medium, (e.g J a fiber optic cable, a waveguide, a wired comniirai.cat.itms link, a wireless communication link, etc.)

|0093| With respect to the use of substantially any plural and/or singular terms herein, those having skill in the art can translate from the plural to the singular and/or from the singular to the plural as is appropriate to the context and/or application.. The various singular/plural permutations may be expressly set forth herein for sake of clarity , ΘΘ94Ϊ, Thus, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims, in. some eases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results, in certain implementations, multitasking and parallei processing may be advantageous.