VAN DEN HEUVEL, Koen Erik Broer (14 Mars Road, Lane Cove, New South Wales 2066, AU)
| THE CLAIMS:
1. A sound processor for a hearing system for use by a user, the sound processor comprising: a receiver for receiving sounds external to the user; a sound analyser for analysing the sounds received by the receiver and for outputting a sound analysis signal; an information signal generator for generating an information signal for delivery to the user; and an information scheduler for controlling the time at which the information signal is delivered to the user, in accordance with the sound analysis signal.
2. A sound processor as claimed in claim 1 wherein the information scheduler causes the information signal to be delivered to the user when the sound analysis signal indicates that there is silence about the user.
3. A sound processor as claimed in claim 1 wherein the information scheduler causes the information signal to be delivered to the user after the sound analysis signal indicates that the user has completed an utterance.
4. A sound processor as claimed in any one of claims 1 to 3, wherein the information signal is assigned a priority and the time at which the information signal is delivered to the user is determined in accordance with both the sound analysis signal and the assigned priority.
5. A sound processor as claimed in any one of claims 1 to 4 wherein the information signal is delivered to the user in accordance with a set of rules.
6. A sound processor as claimed in any one of claims 1 to 5, wherein, the information signal relates to a status of the hearing system.
7. A sound processor as claimed in claim 6, wherein, the hearing system is a cochlear implant system.
8. A method of delivering an information signal to a user of a hearing system, the method comprising: determining a delivery time to deliver the information signal to the user in accordance with an analysis of external sound; and delivering the information signal to the user at the determined delivery time.
9. A method as claimed in claim 8, wherein the information signal is delivered to the user when the analysis of the external sound indicates that there is silence about the user.
10. A method as claimed in claim 8, wherein the information signal is delivered to the user after the analysis of the external sound indicates that the user has completed an utterance.
11. A method as claimed in claim 8, further comprising assigning a priority to the information signal and determining the delivery time in accordance with the analysis of the external sound and the assigned priority.
12. A method as claimed in any one of claims 8 to 11 further comprising determining the delivery time in accordance with the analysis of the external sound and in accordance with a set of rules.
13. A hearing system for a user comprising: a sound processor according to any one of claims 1 to 6; and a signal output stimulator for providing the processed sound to the user.
14. A hearing system as claimed in claim 13 wherein the signal output stimulator is a cochlear implant electrode.
15. A hearing system as claimed in claim 13 or 14 wherein the signal output stimulator is a speaker.
16. A cochlear implant system for implanting in a user, the cochlear implant system comprising:
A sound processor comprising: a receiver for receiving a sound signal external to the user; a sound analyser for analysing the sound signal received by the receiver and for outputting a sound analysis signal; an information signal generator for generating an information signal for delivery to the user; an information scheduler for controlling the time at which the information signal is delivered to the user, in accordance with the sound analysis signal; a signal processor for processing the received sound signal and for generating a stimulation signal representative of the received sound signal; a mixer for mixing the information signal and the stimulation signal as controlled by the information scheduler; and a transmitter for transmitting the stimulation signal mixed with the information signal; and A stimulator comprising: a receiver for receiving the stimulation signal mixed with the information signal from the sound processor and for delivering the stimulation signal mixed with the information signal to a cochlear stimulation electrode for stimulation of auditory nerves of the user's cochlea.
17. A processor for a hearing system for use by a user, the processor comprising: a receiver for receiving an input signal representative of a state external to the hearing system; a sound analyser for analysing the input signal received by the receiver and for outputting an input signal analysis signal; an information signal generator for generating an information signal for delivery to the user; and an information scheduler for controlling the time at which the information signal is delivered to the user, in accordance with the input signal analysis signal.
18. A processor as claimed in claim 17 wherein the input signal is a signal indicative of a state of wakefulness of the user.
19. A processor as claimed in claim 17 wherein the input signal is a signal indicative of an orientation of the user.
20. A processor as claimed in claim 17 wherein the input signal is a sound signal external to the user. |
SOUND PROCESSOR FOR A MEDICAL IMPLANT
TECHNICAL FIELD
The present invention relates to medical implants for users and to systems for providing information to the user from the medical implant.
PRIORITY CLAIM
This application claims priority from Australian Provisional Patent Application No. 2008902011 entitled "Sound Processor for a Medical Implant", filed on 17 April 2008.
The entire content of this application is hereby incorporated by reference.
INCORPORATION BY REFERENCE
The following documents are referred to in the present application:
- US Patent No. 5604812 entitled "Programmable Hearing Aid With Automatic Adaption To Auditory Conditions";
US5819217 entitled "Method And System For Differentiating Between Speech And Noise";
- European Patent Application No. EP0707433 entitled "Hearing Aid"; - US Patent No. 3,909,532 entitled "Apparatus And Method For Determining The Beginning And The
End Of A Speech Utterance"; and
- PCT Patent Application No PCT/AU96/00403 (WO97/01314) entitled "Apparatus And Method Of Controlling Speech Processors And For Providing Private Data Input Via The Same";
US Patent No. 6009396 entitled "Method and system for microphone array input type speech recognition using band-pass power distribution for sound source position/direction estimation"
- US Patent No. 4297685 entitled "Apparatus and method for sleep detection";
- US Patent No. 4711128 entitled "Micromachined accelerometer with electrostatic return";
- US Patent No. 6862359 entitled "Hearing prosthesis with automatic classification of the listening environment".
The entire content of each of these documents is hereby incorporated by reference.
BACKGROUND
A variety of medical implants apply electrical energy to tissue of a user to stimulate that tissue. Examples of such implants include pace makers, auditory brain stem implants (ABI), devices using Functional Electrical Stimulation (FES) techniques, Spinal Cord Stimulators and cochlear implants.
A cochlear implant allows for electrical stimulating signals to be applied directly to the auditory nerve fibres of a user, allowing the brain to perceive a hearing sensation approximating the natural hearing sensation.
These stimulating signals are applied by an array of electrodes implanted into the user's cochlea.
The electrode array is connected to a stimulator unit which generates the electrical signals for delivery to the electrode array. The stimulator unit in turn is operationally connected to a signal processing unit which also contains a microphone for receiving audio signals from the environment, and for processing these signals to generate control signals for the stimulator.
The complexity and sophistication of cochlear implants is increasing and its use and maintenance is becoming more complicated. In order to simplify the use for the user, some modern systems provide for information such as system status information or instructions to be provided directly to the user, from the implant.
SUMMARY
According to a first aspect of the present invention, there is provided a sound processor for a hearing system for use by a user, the sound processor comprising: a receiver for receiving sounds external to the user; a sound analyser for analysing the sounds received by the receiver and for outputting a sound analysis signal; an information signal generator for generating an information signal for delivery to the user; and an information scheduler for controlling the time at which the information signal is delivered to the user, in accordance with the sound analysis signal.
In one form, the information scheduler causes the information signal to be delivered to the user when the sound analysis signal indicates that there is silence about the user.
In one form, the information scheduler causes the information signal to be delivered to the user after the sound analysis signal indicates that the user has completed an utterance.
In one form, the information signal is assigned a priority and the time at which the information signal is delivered to the user is determined in accordance with both the sound analysis signal and the assigned priority.
In one form, the information signal is delivered to the user in accordance with a set of rules.
In one form, the information signal relates to a status of the medical implant system.
In one form, the hearing system is a cochlear implant system.
According to a second aspect of the present invention, there is provided a method of delivering an information signal to a user having a hearing system, the method comprising: determining a delivery time to deliver the information signal to the user in accordance with an analysis of external sound; and delivering the information signal to the user at the determined delivery time.
In one form, the information signal is delivered to the user when the analysis of the external sound indicates that there is silence about the user.
In one form, the information signal is delivered to the user after the analysis of the external sound indicates that the user has completed an utterance.
In one form, the method further comprises assigning a priority to the information signal and determining the delivery time in accordance with the analysis of the external sound and the assigned priority.
In one form, the method further comprises determining the delivery time in accordance with the analysis of the external sound and in accordance with a set of rules.
According to a third aspect of the present invention, there is provided a hearing system for a user comprising: a sound processor according to any one of claims 1 to 6; and a signal output stimulator for providing the processed sound to the user.
In one form, the signal output stimulator is a cochlear implant electrode.
In one form, the signal output stimulator is a speaker.
According to a fourth aspect of the present invention, there is provided a cochlear implant system for implanting in a user, the cochlear implant system comprising: a sound processor comprising: a receiver for receiving a sound signal external to the user; a sound analyser for analysing the sound signal received by the receiver and for outputting a sound analysis signal; an information signal generator for generating an information signal for delivery to the user; an information scheduler for controlling the time at which the information signal is delivered to the user, in accordance with the sound analysis signal;
a signal processor for processing the received sound signal and for generating a stimulation signal representative of the received sound signal; a mixer for mixing the information signal and the stimulation signal as controlled by the information scheduler; and a transmitter for transmitting the stimulation signal mixed with the information signal; and A stimulator comprising: a receiver for receiving the stimulation signal mixed with the information signal from the sound processor and for delivering the stimulation signal mixed with the information signal to a cochlear stimulation electrode for stimulation of auditory nerves of the user's cochlea.
According to a fifth aspect of the present invention, there is provided a processor for a hearing system for use by a user, the processor comprising: a receiver for receiving an input signal representative of a state external to the hearing system; a sound analyser for analysing the input signal received by the receiver and for outputting an input signal analysis signal; an information signal generator for generating an information signal for delivery to the user; and an information scheduler for controlling the time at which the information signal is delivered to the user, in accordance with the input signal analysis signal.
In one form, the input signal is a signal indicative of a state of wakefulness of the user.
In one form, the input signal is a signal indicative of an orientation of the user.
In one form, the input signal is a sound signal external to the user.
DRAWINGS
The various aspects of the present invention are described in detail with reference to the following drawings in which:
Figure 1 - shows a system block diagram of a sound processor of one aspect of the present invention; Figure 2 - shows an input audio signal categorised into different groups; Figure 3 - shows how various information signals are scheduled in the audio signal of Figure 2;
Figure 4 - shows another example of an environment classified into different categories;
Figure 5 - shows a further example of how information signals are scheduled, without the use of priorities, in the environment of Figure 4;
Figure 6 - shows another example of how various information signals are scheduled
in the audio signal; Figure 7 - shows a system block diagram of a variation of the sound processor of
Figure 1;
Figure 8 - shows a system block diagram of a further variation of the processor of Figure 1;
Figure 9 - shows a block diagram of yet another variation of the processor of Figure
1; and Figure 10 - shows a cochlear hearing system comprising a sound processor and an implanted stimulator.
DETAILED DESCRIPTION
In a sound processor the incoming external sound of the microphone is digitized by an analogue to digital converter (AD) and then processed in the digital domain by a digital signal processor (DSP). Digital to analogue (DA) converters are used to output analogue output to, for example, a speaker and/or to stimulate electrodes via a cochlear implant electrode.
Apart from the sound processing functions a sound processor may also have a number of supporting functions. This includes monitoring the system and informing the user of any problems. Typical examples of this include: 1. Warn the user that the battery is going flat
2. Inform the user that a program change has occurred
3. Inform the user that a cable is broken
4. Inform the user that an accessories cable is being connected
5. Inform the user that the telecoil is on 6. Inform the user that the microphone protection cover needs replacement
This information may be provided to the user in a number of ways as information signals, including inserting a number of beeps into the sound processing path. Examples of these information signals are: 1. Play one low tone beep if program 1 becomes active
2. Play two low tone beeps if program 2 becomes active
3. Play a high tone beep if the battery needs replacement within the hour
4. Play two high tone beeps if the battery is going flat in 10 minutes
Another option is to play pre-recorded sentences (samples) to inform the user. In this way the user does not have to remember what the different types of beeps indicate. Examples of these information signals are:
1. The sound processor says: "Please change your microphone protection cover" when the sound processor determines that the sound quality of the incoming microphone signal is poor.
2. The sound processor says: "Program 1 active" when program 1 becomes active.
3. The sound processor says: 'Your batteries will be flat in one hour" when the battery voltage drops under a certain level.
Alternatively, these vocal messages may be generated in real time rather than being pre-recorded.
While the user is listening with the device, the beeps or the samples are mixed into the same signal path. This might sometimes be annoying for the user since he might be interrupted at the moment he is trying to understand someone talking. Alternatively, the user might be sleeping and not be interested in information that is not time critical, e.g. "please change your microphone protection cover". Alternatively, if the user is talking, he might miss information that is played at the same time.
According to one aspect of the present invention, there is provided a method and apparatus that reduces the interruption of the normal use of the implant due to the delivery of the information signals. In this aspect, the delivery of the information is controlled so as to reduce interruptions. In one aspect, this involves the analysis of the surrounding or external sounds around the user, to determine an appropriate delivery time. In another aspect, there is also provided an information signal scheduler to control the delivery of the information signals in accordance with the results of the surrounding sound analysis.
Figure 1 shows a schematic block diagram of a sound processor 100 embodying these features. Shown in Figure 1 is receiver 10 for receiving sounds external to the user. Receiver 10 may be any suitable audio receiver such as a microphone. The sounds received by receiver 10 are provided to sound analyser 20, which performs one or more suitable signal processing functions to the received sound to determine an appropriate time for delivery of information signals to the user. These processes will be described in more detail below.
Sound analyser 20 may be incorporated within the normal signal processing function of a traditional sound processor, or may be provided as a separate device. It may also be provided as software in the microprocessor, or a dedicated processing chip.
Information signal generator 30 generates appropriate information signals for the user, such as those described above. These information signals may pertain to the status of the system, such as low battery, or may pertain to any other information as will be described further below. Again, as previously described, the information signal may be in the form of a series of sounds such as beeps, or actual spoken words, either prerecorded or generated in real time. Information signal generator 30 outputs the generated information signals to the information scheduler 40 to control/co-ordinate the delivery of the information signal in accordance with the sound analysis signal output from the sound analyser 20.
The sound analyser 20 outputs a sound analysis signal and provides this to information scheduler 40 to allow information scheduler 40 to determine an appropriate time for any information signals generated by information signal generator 30 to be delivered to the user.
Several information signals may be stored in a queue in the information scheduler for delivery at an appropriate time. The stored information signals may be delivered on a first-in-first-out basis, or alternatively, each information signal may have assigned to it, a priority, which will affect the delivery time of that information signal, as will be described in more detail below.
When the information scheduler 40 determines that it is an appropriate time to deliver a received information signal, it applies the information signal to mixer 50 for delivery to the user. Mixer 50 will mix the received information signal with the signal provided by a signal processor processing external sounds such as speech, for delivery to the user in the normal course of events as will be described in more detail below with reference to Figures 7 to 9. In accordance with this aspect of the invention, the information signal will be mixed into the normal stream at an appropriate moment such as when there is silence around the user, as determined by the sound analyser 20. In this way, the information signal is less likely to interfere with the normal operation of the implant by the user (e.g. interrupting speech) and is more likely to be clearer to the user since it is not interfered with by other sound.
In one form, the sound analyser 20 uses the microphone (or receiver 10) signal to classify the environment of the user. Typical environments that can be classified include:
1. User speaking
2. Someone is speaking to the user
3. User is in a silent environment 4. User is sleeping
5. User is in a noise environment
6. User is listening to music
Several ways to classify sound are described in the prior art. Typically, the results of this classification are used to automatically optimize certain sound processing parameters or switch programs. An example of this is to switch on the directional microphone when in a noisy environment. The algorithms used typically extract certain features from the signal and use a rule-based decision approach. Examples of such systems and/or algorithms are described in various patents and patent applications. In European Patent Application No. EP0707433 entitled "Hearing Aid" (previously incorporated by reference), there is described a method and means for detecting a voiceless period based on an analysis of sound received by a sound input means. This method can be used in one aspect of the present invention, in which information signals are delivered to the user during periods that are determined to be voiceless.
In US5604812 entitled "Programmable Hearing Aid With Automatic Adaption To Auditory Conditions" (previously incorporated by reference), there is described an apparatus and method for analysing ambient noise conditions and causing the apparatus to perform certain functions (such as activating a directional microphone when in a noisy environment). This method may be used in one aspect of the present invention to classify ambient or environmental noise conditions.
In US5819217 entitled "Method and System for Differentiating Between Speech and Noise", (previously incorporated by reference), there is described a method and system for differentiating between speech and noise by separating an incoming audio signal into frames, evaluating energy levels of selected frames, and determining whether the period associated with those frames is noise or speech depending upon the energy evaluation. This method may be used in one aspect of the present invention to, for example, classify different noise conditions to therefore determine an appropriate time for delivering information signals to the user.
In US 3,909,532 entitled "Apparatus and Method For Determining the Beginning and the End of a Speech Utterance" (previously incorporated by reference), there is described a method for determining the energy of a code word and determining whether it is the beginning or end of an utterance by comparing the code word energy with a threshold. This information can be used in one aspect of the present invention to determine periods between speech utterances to, for example, deliver a short information signal of high priority to the user.
In US Patent No. 6009396 (previously incorporated by reference), there is described a method of determining when someone is speaking to the user. By using multiple microphones, the direction of the incoming sound can be determined. It can be assumed that when speech is coming from in front of the user this is a person talking to the user. When speech is coming from the side or behind the user, this can be considered to be less likely to be someone talking to the user.
The state of the user sleeping can be detected in several ways using sensors. One method involves measuring the body temperature of the user. It is known that a slight temperature drop in the brain occurs when sleeping. This temperature drop may be measured in the auditory canal. Such a method is described in US Patent No. 4297685 (previously incorporated by reference). To apply this method to the present application, a temperature sensor could be added to the internal (implant) or external part (sound processor or hearing aid).
Another way of determining that the user is asleep, or at least resting, is to measure the orientation of the body. When the body is in a horizontal position for a while it can be assumed that the user is resting or sleeping. The orientation of the body can be measured using a gravity sensor. Typical MEMS based accelerometers are small and can be integrated into the internal (implant) or external part (sound processor or hearing aid). An example of such a small accelerometer is described in US Patent No. 4711128 (previously incorporated by reference).
Other forms of environment may be determined using hidden Markov models as described in US Patent No. 6862359 (previously incorporated by reference).
Other features may also be used to control the delivery of the information signal. For example, the system could be made to adapt to what the user finds acceptable or unacceptable. One way to implement this is to add an input to the device by which the user can indicate that he is annoyed by the information given by the system. For example, an "annoyed" button can be added to the hearing aid. When the user is interrupted while listening to someone else talking and is annoyed by this, the user can actuate the "annoyed" button. The system will now adapt its scheduler rules not to interrupt the user again in this environment.
In yet a further implementation, a clock may be integrated into the system and the information signal delivery be based on the clock. For example, a user using a fully implantable hearing solution may elect not to get a "battery low warning" in the middle of the night. In this application, the user could set the system not to deliver this particular message or information signal to the user between for example, 10pm and 8am.
Figure 2 shows a time graph showing an input audio signal that has been analysed and classified into different categories using any suitable analysis and/or classification technique including one or more of the techniques described in the abovereferenced patents. Shown there is an input audio signal separated over time, as "user speaking", "someone else is speaking to the user" and "silence".
In one form, the sound analyser classifies in a continuous way. As shown in Figure 2, at every moment in time the system chooses a certain environment or classification.
As previously described, the information scheduler 40 (Figure 1) decides on when to mix information in the sound processing path. For this, the information scheduler 40 compares the incoming information queue with the sound environment. In a further aspect of the invention, a rule-based system may be used to determine where to mix the information in the path. An example of such a rules-based system is shown below in Table
1.
TABLE 1
Information Priority
In this aspect, the incoming information queue contains the information that needs to be communicated to the user (generated by the Information Signal Generator 30) together with a priority. The queue can be of any length and is only limited by the amount of memory available in the system. The queue can be more advanced and include additional information such as the number of times a message needs to be repeated or specific timing information such as preference to inform something early in the morning or during the charging process.
In one embodiment, to determine where to mix the information in the sound path using mixer 50, the information scheduler 40 uses a rules-based system. The information scheduler checks a number of rules one by one over and over again. When the rules results in a decision to provide the information the beep or sample is mixed in the sound processing path.
Example of rules: 1. If information available of priority 1 and user not speaking, mix the message.
2. If information available of priority 2 and user not speaking and someone else is not speaking, mix the message.
3. If information available of priority 3 and silence for longer than 2 seconds, mix the message.
If the example rules above use the incoming information queue in Table 1 with the sound environment analysis as shown in Figure 2 the result appears as shown in Figure 3.
At moment 2 in time, the first rule is valid and the message of priority 1 is processed and removed from the information queue. At moment 4 the 2 nd rule is valid and the message of priority 2 is processed and removed from the information queue. At moment 8 the 3 rd rule is valid and the message of priority 3 is processed and removed from the information queue.
The following pseudo code provides an example for carrying out the method described above in relation to Figure 3:
timer = 0 silence = 0
// endless loop Begin Loop
// silence counter
If (Environment == "Silence") then silence = silence + 1
Else silence = 0 End if
// implementation of the first rule
If (Information_QueueJPriority__l != null) AND (Environment != "User speaking") then
Process(Information_Queue_Priority_l) End if
// implementation of the second rule
If (Information_Queue_Priority__2 != null) AND (Environment != "User speaking") AND (Environment != "Someone else speaking to the user") then
Process(Information_Queue_Priority_2) End if
// implementation of the third rule
If (Information_Queue_Priority_3 != null) AND (silence == 2) then
Process(Information_Queue_Priority_3) End if // timer counter timer = timer + 1
End Loop
In another example, in which the use of priorities is not made, is shown with respect to Figures 4 and 5. The sound analyser 20 classifies the sound into different categories in a continuous way as previously described and as shown in Figure 4.
At the same time the information scheduler 40 identifies moments at which information can be given to the user, for example, at moments when there is more than 1 second of silence. Figure 5 shows where the information scheduler 40 has identified an information slot for delivery of the information signal, This is shown at time 7 seconds. At that moment, the category silence was active for more than 1 s.
Yet another example, in which priorities are assigned, is described with reference to Figure 6. In an implementation in which information is prioritised, in one embodiment, the information scheduler 40 determines slots for each type of information. As shown in Figure 6, the information scheduler 40 has determined that information of priority 1 can be given at all times. Information of priority 2 (lower priority) can be given at times during which the user is not sleeping. Priority 3 is for when the user is not talking or being talked to (silence, noise or music). Priority 4 does not interrupt music and is active during noise and silence.
Figure 7 shows a block diagram of a sound processor 100 for a cochlear implant having incorporated therein, the arrangement of Figure 1. Shown is receiver 10 (in this case provided by a microphone), analogue-to- digital (AD) converter 106 for converting the received analogue sound signal to a digital signal for processing by digital signal processor (DSP) 107, to generate the required electrical stimulation signals that
is representative of the sound signal for cochlear implant or stimulating electrode 300. Also shown is user interface block 200 which allows the user to control the sound processor 100, microcontroller 101 which controls the various communications within sound processor 100, memory 102 and power supply or battery 104. The user "annoyed" button previously described may be provided in the user interface 200.
The arrangement of Figure 1 is shown integrated within sound processor 100, with sound analyser 20 receiving the digitized audio input signal for analysis as previously described. It will be understood that in some embodiments, the sound analysis as previously described may in fact be integrated with and provided by DSP 107 itself, without the need for a separate sound analysis block 20. Such an arrangement is shown in Figure 8, in which all functions of the present invention are performed by conventional elements.
Information signal generator 30 generates the information signals pertaining for example, to system status and information scheduler 40 controls the integration of the information signals received from information signal generator 30 in accordance with signals received from sound analyser 20, via mixer 50. According to this aspect of the invention, the information signals are placed into the signal path at times deemed appropriate as described previously. In the particular embodiment shown in Figure 7, two possible signal outputs are available. The first is via speaker 108 to provide acoustic stimulation, and the second is via cochlear implant electrode 300 for direct electrical stimulation to the user's auditory nerves within the user's cochlea. Both of these outputs are in analogue form, having been converted from digital signals to analogue signals by DA converters 104 and 105. It will be understood however, that one or the other output means is able to be provided. For example, in one embodiment, the audio signal and mixed information signals might be provided only via cochlear implant electrode 300, and not by any acoustic means as shown for example in Figure 8.
In a further embodiment, the sound input for sound analysis may be provided by a dedicated receiver 10' instead of from the microphone or receiver for receiving sound input for electrical stimulation of the user. This variation is shown in Figure 8, in which receiver 10' provides an input directly to sound analyser 20. In this case, sound analyser 20 may have its own dedicated DA conversion, or the input of receiver 10' will be converted by the standard DA block 106 before input to sound analyser 20. Figure 8 shows a further variation in that the output of sound processor 100 is delivered solely through cochlear electrode 300 instead of through both electrode 300 and an audio speaker 108 as shown in the variation in Figure 7. In yet a further alternatively, the information signals generated by information signal generator may be provided through an audio speaker 108 (Figure 7), while the sound received by microphone 10 is provided to the user via electrode 300, with the information signals still being timed to be provided at the most appropriate time so as not to interfere with stimulation, even though the two paths are separate.
Figure 9 shows yet a further variation in which the functionality of the sound analyser is provided by the DSP block 107, the functionality of the information signal generator is provided by memory 102 and microprocessor/microcontroller 101 and the functionality of the information scheduler is provided by microprocessor/microcontroller 101. In this arrangement, separate blocks for these elements are not required.
The scheduled information signals are then mixed into the usual audio path via mixer 50. In this example, the output is by way of cochlear implant electrode 300, although, the output could be to an audio speaker or both electrode and audio speaker as previously described.
It will be appreciated that any other combination of the above variations is also possible.
It will also be appreciated that Figures 7-9 are representative only in that in a cochlear implant system, the processor is provided as a separate unit to the stimulator to which implant electrode 300 is attached. In use, the processor 100 is external to the user and the stimulator and implant electrode 300 are implanted into the user.
Figure 10 shows an example of such an arrangement. Shown is a cochlear implant system 500 comprising sound processor 100 and stimulator 400. As shown, stimulator 400 with associated stimulating electrode 300 is implanted into the user. The sound processor 100 and stimulator 400 communicate through the user's tissue 1 (in this case, the scalp of the user behind the user's head) transcutaneously by wireless communications as will be understood by the person skilled in the art.
Processor 100 receives input sound signals from about the user via receiver (e.g. microphone 10), which are then processed as described above, including the scheduling of the information signals, and applied to D/A converter 105. The input sound signal is processed to provide a stimulation signal that is representative of the input sound signal for delivery to the user. The sound processor 100 also includes a mixer as described above for mixing in the information signals generated by the information signal generator with the generated stimulation signal at times as controlled by the information scheduler as previously described.
The signals output by D/A converter 105 (as shown in Figures 7-9) are applied to transmitter 120 which then transmit the signals wirelessly to corresponding receiver 420 of stimulator 400, through tissue 1. The received stimulation signals are then converted into signals (for example, electrical or photonic) and applied directly to auditory nerves in the user's cochlea by implant or stimulating electrode 300, again as will be understood by the person skilled in the art.
In a further aspect of the present invention, the input signal received by receiver 10 need not be a sound signal. As previously described, the input signal could be a signal representative of a state external to the user. For example, this could be a state of wakefulness, or an orientation of the user. For example, if the user is determined to be asleep, it may be that the processor does not issue the information signal unless it is urgent. This state may be determined by measuring the user's body temperature (in which the receiver will be a sensor and in particular, a thermometer), or by determining that the user has assumed a horizontal orientation, in which case the receiver may be a gravity sensor, as previously described. The state analyser will then generate a general input signal analysis signal which is then provided to the information scheduler
for controlling the time of delivery of the information signal in accordance with the input signal analysis signal.
In some embodiments, the processor may have multiple receivers, one or more being a microphone to receive the sound signal, and one or more others being a thermometer and/or a gravity sensor. In this embodiment, the state analyser may be used to provide the sound analyser as well as analysis of other states such as user wakefulness and user orientation.
The various aspects of the present invention may be used in many types of hearing aids, including one as described in International Patent Application No. PCT/AU96/00403 (WO97/01314) entitled "Apparatus And Method Of Controlling Speech Processors And For Providing Private Data Input Via The Same" (previously incorporated by reference). This application describes a hearing aid device that receives ambient sounds as well as voice commands from the user to control aspects of the operation of the device. The device can also deliver messages to the user, including various preset alarms, as well as customised recorded messages by the user. The various aspects of the present invention may be applied to the various embodiments described in this mentioned application to provide a more user-friendly or convenient system of delivering messages or information signals to the user.
The various aspects of the present invention described herein may be applied to all types of hearing aid devices including: behind the ear hearing aids, in the ear hearing aids, in the canal hearing aids, partial implanted cochlear implant hearing aids, partial implanted middle ear implant hearing aids, partial implanted inner ear implant hearing aids, partial implanted brain implant hearing aids, partial implanted bone conducting hearing aids, fully implanted cochlear implant hearing aids, fully implanted middle ear implant hearing aids, fully implanted inner ear implant hearing aids, fully implanted brain implant hearing aids, fully implanted bone conducting hearing aids, Direct Acoustic Cochlear Stimulation (DACS) systems, mobile phone headsets and combinations of all the above.
Throughout the specification and the claims that follow, unless the context requires otherwise, the words "comprise" and "include" and variations such as "comprising" and "including" will be understood to imply the inclusion of a stated integer or group of integers, but not the exclusion of any other integer or group of integers.
The reference to any prior art in this specification is not, and should not be taken as, an acknowledgement of any form of suggestion that such prior art forms part of the common general knowledge.
Next Patent: COLLECTIVE KIT OF STORAGE AND ORGANIZATION OF PRODUCTS FOR ORAL HYGIENE