Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
BIMODAL HEARING STIMULATION SYSTEM
Document Type and Number:
WIPO Patent Application WO/2017/097342
Kind Code:
A1
Abstract:
There is provided a system comprising a first device for neural stimulation (10) of a patient's ipsilateral ear; a second hearing stimulation device (21) using a stimulation mode different from that of the first stimulation device; and a fitting device (13, 15, 31, 33) for adjusting the first stimulation device and the second stimulation device. The first stimulation device comprises a sound processor (11) for generating a neural stimulation signal for each of a plurality of stimulation channels from an input audio signal according to a neural stimulation model including a set of stimulation parameters. The second stimulation device comprises an audio signal processing unit (27) for generating a stimulation signal from an input audio signal according to a stimulation model including a set of stimulation parameters. The system further comprises a memory for storing, for at least some of the stimulation channels, at least one of a hearing threshold neural stimulation signal level, a most comfortable neural stimulation signal level and an uncomfortable neural stimulation signal level. The fitting device comprises a data processing unit (33) for calculating, for at least some audiometric frequencies, at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level by taking into account the stimulation model of the second stimulation device, using the values of the stimulation parameters as read from the second stimulation device, and for calculating, for at least some audiometric frequencies, at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level from the respective stored hearing threshold neural stimulation signal level, most comfortable neural stimulation signal level and uncomfortable stimulation neural stimulation signal level, respectively, taking into account the stimulation model of the first stimulation device, using the values of the stimulation parameters as read from the first stimulation device, and a graphical user interface (31) configured to present an acoustic level audiogram representation of the calculated at least one of the aided hearing threshold level, the aided most comfortable level and the aided uncomfortable level as a function of the audiometric frequency both for neural stimulation by the first device and for stimulation by the second device.

Inventors:
CHALUPPER JOSEF (DE)
GEISSLER GUNNAR (DE)
Application Number:
PCT/EP2015/078988
Publication Date:
June 15, 2017
Filing Date:
December 08, 2015
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
ADVANCED BIONICS AG (CH)
International Classes:
A61N1/36; A61B5/12
Foreign References:
US20120109006A12012-05-03
US20150341731A12015-11-26
US20140105408A12014-04-17
US20120245655A12012-09-27
US20130218237A12013-08-22
Attorney, Agent or Firm:
SCHWAN SCHORER & PARTNER MBB (DE)
Download PDF:
Claims:
Claims

1. A system comprising:

a first device for neural stimulation (10) of a patient's ipsilateral ear;

a second hearing stimulation device (21) selected from the group consisting of a device for stimulation of the patient's ipsilateral ear and a device for stimulation of the patient's contralateral ear, wherein the stimulation mode of the second stimulation device is different from that of the first stimulation device ; and

a fitting device (13, 15, 31 , 33) configured to be communicatively connected to the first and second stimulation device for adjusting the first stimulation device and the second stimulation device;

the first stimulation device comprising

an implantable neural stimulation arrangement (12) comprising a plurality of stimulation channels (18, 52) for neural stimulation of the ipsilateral ear at various stimulation sites according to a neural stimulation signal; and

a sound processor (11) for generating a neural stimulation signal for each stimulation channel from an input audio signal according to a neural stimulation model including a set of stimulation parameters;

the second stimulation device comprising

an audio signal processing unit (27) for generating a stimulation signal from an input audio signal according to a stimulation model including a set of stimulation parameters; and

an output transducer (23) for stimulation of the respective ear according to the stimulation signal,

the system further comprising:

a memory

for storing, for at least some of the stimulation channels, at least one of a hearing threshold neural stimulation signal level, a most comfortable neural stimulation signal level and an uncomfortable neural stimulation signal level;

the fitting device comprising

a data processing unit (33) for calculating, for at least some audiometric frequencies, at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level by taking into account the stimulation model of the second stimulation device, using the values of the stimulation parameters as read from the second stimulation device, and

for calculating, for at least some audiometric frequencies, at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level from the respective stored hearing threshold neural stimulation signal level, most comfortable neural stimulation signal level and uncomfortable stimulation neural stimulation signal level, respectively, taking into account the stimulation model of the first stimulation device, using the values of the stimulation parameters as read from the first stimulation device; and a graphical user interface (31) configured

to present an acoustic level audiogram representation of the calculated at least one of the aided hearing threshold level, the aided most comfortable level and the aided uncomfortable level as a function of the audiometric frequency both for neural stimulation by the first device and for stimulation by the second device.

The system of claim 1 , wherein the first stimulation device is a cochlear implant (10) for electric stimulation of the ipsilateral cochlea, the cochlear implant stimulation arrangement comprising an electrode array (19), and wherein the neural stimulation signal is an electrode stimulation current.

The system of claim 2, wherein the second stimulation device is cochlear implant for optical stimulation of the ipsilateral cochlea or an auditory brainstem implant.

The system of one of claims 1 and 2, wherein the second stimulation device (21) is for acoustic stimulation within an acoustic stimulation frequency range, wherein the stimulation signal is an acoustic stimulation signal, wherein the output transducer (23) is for generating a vibration output according to the acoustic stimulation signal; wherein the memory is for storing, for at least some frequency bands of an input audio signal, at least one of an unaided hearing threshold level, an unaided most comfortable level and an unaided uncomfortable level, wherein the data processing unit (33) is for calculating, for at least some audiometric frequencies within the acoustic stimulation frequency range said at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level from the respective stored unaided level, respectively.

5. The system of claim 4, wherein the second stimulation device is an electro-acoustic hearing aid (21) comprising a loudspeaker (23) as the output transducer, a bone conduction hearing aid, a middle ear implant (MEI) or a direct acoustic cochlea stimulator (DACS).

6. The system of one of the preceding claims, wherein the graphical user interface (31) is configured to enable adjustment, in the aided audiogram representation by a user, of the values of the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels, respectively, both for stimulation by the first device (10) and for stimulation by the second device (21), wherein the fitting device (13, 15, 31 , 33) is configured to adjust the stimulation parameters of the first and second stimulation device in conformity with such aided level adjustment by the user, so as to accordingly adjust the first and second stimulation device.

7. The system of one of the preceding claims, wherein the graphical user interface (31) is configured to present the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels, respectively, for both the first stimulation device (10) and the second stimulation device (21) in a common audiogram representation.

8. The system of claim 7, wherein the graphical user interface (31) is configured to allow the user to change, by user input, between a common audiogram representation of the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels, respectively, for both the first stimulation device (10) and the second stimulation device (21), and separate audiogram representations for the first stimulation device and the second stimulation device, respectively.

9. The system of one of the claims 4 and 5, wherein the graphical user interface (31) is configured to present the unaided hearing threshold levels, the unaided most comfortable levels and the unaided uncomfortable levels, respectively, in an audiogram representation as a function of the audiometric frequency.

10. The system of one of the preceding claims, wherein the graphical user interface (31) is configured to present at least the aided hearing threshold levels for both the first stimulation device (10) and the second stimulation device (21).

11. The system of one of claims 1 to 9, wherein the graphical user interface (31) is configured to present at least the aided hearing threshold levels and the aided most comfortable levels for both the first stimulation device (10) and the second stimulation device (21).

12. The system of claims 1 to 9, wherein the graphical user interface (31) is configured to present the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels for both the first stimulation device (10) and the second stimulation device (21).

13. The system of one of the preceding claims, wherein the graphical user interface (31) is configured to present the audiogram representation of the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels, respectively, for both the first stimulation device (10) and the second stimulation device (21) in dB HL, in dB SPL at the eardrum or in dB SPL free-field.

14. The system of claim 9, wherein the graphical user interface (31) is configured to present the audiogram representation of the unaided hearing threshold levels, the unaided most comfortable levels and the unaided uncomfortable levels, respectively, in dB HL, in dB SPL at the eardrum or in dB SPL free-field.

15. The system of one of the preceding claims, wherein the graphical user interface (31) is configured to mark in the audiogram representation an area of audiometric frequencies and stimulation levels which are particularly important for speech understanding.

16. The system of claim 6, wherein the graphical user interface (31) is configured to

enable adjustment of the aided levels by "drag-and-drop" action on the respective aided level representation by the user.

17. The system of one of claims 4 and 5, wherein the graphical user interface (31) is configured to enable adjustment, by the user, of the bandwidth of the acoustic stimulation by the second stimulation device (21) and the bandwidth of the neural stimulation by the first stimulation device (10), by adjustment of the neural stimulation frequency range and the acoustic stimulation frequency range.

18. The system of claim 17, wherein the graphical user interface (31) is configured to enable selection of a crossover frequency by the user, the crossover frequency separating acoustic and neural stimulation in that at frequencies below the crossover frequency stimulation is to take place by the second stimulation device (21) only and that at frequencies above the crossover frequency stimulation is to take place by the first stimulation device (10) only.

19. The system of one of claims 4 and 5, wherein the fitting device (13, 15, 31 , 33) is configured to cause the second stimulation device (21) to present acoustic test stimulation signals to the patient, and wherein the fitting device is configured to record a perceptual behavioral response of the patient to such acoustic test stimulation signals in order to determine said at least one of the unaided hearing threshold level, the unaided most comfortable level and the unaided uncomfortable level as a function of the frequency of the acoustic test stimulation signals.

20. The system of one of the preceding claims, wherein the fitting device (13, 15, 31 , 33) is configured to cause the first stimulation device (10) to present neural test stimulation signals to the patient, and wherein the fitting device is configured to record a perceptual behavioral response of the patient to such neural test stimulation signals in order to determine, for at least some of the stimulation channels, said at least one of the hearing threshold neural stimulation signal level, the most comfortable neural stimulation signal level and the uncomfortable neural stimulation signal level.

21. The system of one of the preceding claims, wherein the system comprises a loudspeaker for presenting test sounds to the patient, the test sounds being produced from test audio signals generated by the fitting device (13, 15, 31 , 33) and supplied to the loudspeaker, and wherein the fitting device is configured to record a perceptual behavioral response of the patient to such test sounds when wearing and using the first (10) and second stimulation device (21).

22. The system of claim 21 , wherein the fitting device (13, 15, 31 , 33) is configured to determine from the recorded perceptual behavioral response of the patient to the test sound at least one of a measured aided hearing threshold level, a measured aided most comfortable level and a measured aided uncomfortable level at least for at least some audiometric frequencies, and the fitting device is configured to compare each measured aided level to the respective calculated aided level.

23. The system of claim 22, wherein the fitting device (13, 15) is configured to adjust the stimulation parameters of the first (10) and second stimulation device (21 ) in order to compensate for deviations between the measured aided levels and the respective calculated aided levels so as to make the calculated aided levels match with the respective measured aided levels.

24. The system of one of claims 22 and 23, wherein the fitting device (13, 15, 31 , 33) is configured to issue a warning in case that the deviations between the measured aided levels and the respective calculated aided levels exceed a certain degree.

25. The system of one of the preceding claims, wherein the neural stimulation model used by the fitting device (13, 15, 31 , 33) for calculating the aided levels includes an auditory model.

26. The system of claim 25, wherein the auditory model includes data from objective neural stimulation response measurements, such as ECAP, NRI, eSRT and/or ABR.

27. The system of one of claims 25 and 26, wherein the auditory model includes spread of masking estimations derived from such data from objective neural stimulation response measurements.

28. The system of one of claims 25 to 27, wherein the system is configured to perform objective neural stimulation response measurements for obtaining data to be used in the auditory model for calculating the aided levels for neural stimulation by the first device (10).

29. The system of one of the preceding claims, wherein the fitting device (13, 15, 31 , 33) is configured to calculate the aided levels for acoustic stimulation and for neural stimulation by taking into account measured microphone sensitivity data of the microphones (20, 29) of the first (10) and second stimulation device (21).

30. The system of claim 6, wherein the fitting device (13, 15, 31 , 33) is configured to initially set at least part of the values of the stimulation parameters of the first (10) and second stimulation device (21) according to default values which are specific to the type of the first and the type of the second stimulation device, respectively, with the initially set values of the stimulation parameters being adjustable via said user adjustment of the values of the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels in the aided audiogram representation.

31. The system of one claims 4 and 5, wherein the fitting device (13, 15, 31 , 33) is configured to initially set at least part of the values of the stimulation parameters of the first (10) and second stimulation device (21) according to values calculated based on the respective stored hearing threshold neural stimulation signal level, most comfortable neural stimulation signal level and uncomfortable stimulation neural stimulation signal level, and the respective stored unaided hearing threshold level, unaided most comfortable level and unaided uncomfortable level, respectively, with the initially set values of the stimulation parameter being adjustable via said user adjustment of the values of the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels in the aided audiogram representation.

32. The system of claim 2, wherein each stimulation channel is attributed to a certain one of the electrodes (18).

33. The system of claims 2 and 32, wherein the system is configured to obtain electrode current data via back telemetry from the first stimulation device (10), and wherein the fitting device (13, 15, 31 , 33) is configured to calculate the aided levels for neural stimulation by using such electrode current data obtained via back telemetry measurements.

34. Method for fitting a first device (10) for neural stimulation of a cochlea of a patient's ipsilateral ear and a second hearing stimulation device (21) selected from the group consisting of a device for stimulation of the patient's ipsilateral ear and a device for stimulation of the patient's contralateral ear via a fitting device (13, 15, 31 , 33) communicatively connected to the first and second stimulation device for adjusting the first stimulation device and the second stimulation device;

the first stimulation device comprising

an implantable neural stimulation arrangement (12) comprising a plurality of stimulation channels (18, 52) for stimulating the ipsilateral ear at various stimulation sites according to a neural stimulation signal; and

a sound processor (11) for generating a neural stimulation signal for each stimulation channel from an input audio signal according to a neural stimulation model including a set of stimulation parameters;

the second stimulation device comprising an audio signal processing unit (27) for generating an stimulation signal from an input audio signal according to a stimulation model including a set of stimulation parameters; and

an output transducer (23) for stimulation of the respective ear according to the stimulation signal;

the method comprising

determining, for at least some of the stimulation channels, at least one of a hearing threshold neural stimulation signal level, a most comfortable neural stimulation signal level and an uncomfortable neural stimulation signal level; calculating, by a data processing unit (33) of the fitting device, for at least some audiometric frequencies at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level by taking into account the stimulation model of the second stimulation device, using the values of the stimulation parameters as read from the second stimulation device, and calculating, by a data processing unit (33) of the fitting device, for at least some audiometric frequencies, at least one of an aided hearing threshold level, an aided most comfortable level and an aided uncomfortable level from the respective stored hearing threshold neural stimulation signal level, most comfortable neural stimulation signal level and uncomfortable stimulation neural stimulation signal level, respectively, taking into account the stimulation model of the first stimulation device, using the values of the stimulation parameters as read from the first stimulation device;

presenting, to a user, by a graphical user interface (31) of the fitting device, an acoustic level audiogram representation of at least one of the aided hearing threshold levels, the aided most comfortable levels and the aided uncomfortable levels as a function of the audiometric frequency both for neural stimulation by the first device and for stimulation by the second device.

Description:
BIMODAL HEARING STIMULATION SYSTEM

The invention relates to a bimodal hearing stimulation system comprising a first device for neural stimulation of the cochlea at one ear, a second device for stimulation of the same ear or the other ear by using a stimulation mode different from that of the first device and a fitting device for individually adjusting the stimulation devices to the patient.

Typically, such bimodal systems combine neural stimulation, e.g. by a cochlear implant and acoustic stimulation. Cochlear implants comprise an electrode array for electrical stimulation of the cochlear at various stimulation sites determined by the position of the respective electrode. Typical systems for bimodal stimulation of the hearing comprise a cochlear implant at the ipsilateral ear and a device for acoustic stimulation of the ipsilateral ear or the contralateral ear. Systems with electric and acoustic stimulation of the same ear are also known as hybrid devices or EAS devices. In systems with contralateral acoustic stimulation the acoustic stimulation device typically is an (electro-acoustic) hearing aid; alternatively, acoustic stimulation can be achieved by a bone conduction hearing aid. For fitting a bimodal stimulation device a fitting device is connected to the electric stimulation device and the acoustic stimulation device in order to adjust the respective stimulation parameters individually so as to optimize the hearing impression of the patient. In a relatively simple model, the impact of the stimulation parameters may be described by the input/output (I/O) curves of the electric stimulation and the acoustic stimulation. For acoustic stimulation, the I/O curve represents the output level provided by the loudspeaker as the function of the input sound level at the microphone; the acoustic stimulation I/O curves vary as a function of the frequency (or the frequency band) of the audio signal (in a hearing instrument, the input audio signals are divided into various frequency channels for further signal processing). For electrical stimulation, the I/O curves represent the stimulation current for each stimulation channel (e.g. for each stimulation electrode) as a function of the input sound level at the microphone.

A fitting device typically has a graphical user interface which allows the audiologist to see the characteristic audiometric data of the patient, such as the hearing threshold level and the most comfortable level for various stimulation frequencies (such audiogram representation is typically used for fitting of acoustic stimulation devices, such as hearing aids) and allows the audiologist to manually adjust the stimulation parameters, such as the I/O curves of the acoustic stimulation for the patient, thereby individually optimizing the respective aided threshold and most comfortable levels.

For electrical stimulation the fitting device typically uses a representation in the graphical user interface which is different from that of a fitting device for a hearing aid; in particular, the graphical user interface of a fitting device for electrical stimulation typically shows the stimulation currents for each electrode which correspond to the hearing threshold level and/or the most comfortable level.

Further, the workflows for fitting of acoustic stimulation devices and for fitting electric stimulation devices typically are very different, so that usually an audiologist in a clinic where CI devices and bimodal stimulation devices are implanted is not familiar with the fitting of acoustic stimulation devices. Further, for fitting of acoustic stimulation devices air conduction thresholds and an estimate of the vent size for the patient are required.

Thus, the fitting of electroacoustic (i.e. bimodal) hearing systems, both for ipsi- and contralateral stimulation, is counterintuitive, difficult-to-use and inefficient for the audiologist. A consequence for the patient is that the patient often will not receive the optimum individual fitting with bimodal systems.

WO 2012/056427 A9 relates to a method of fitting a bimodal system, wherein the fitting device comprises a graphical user interface which shows for each acoustic stimulation channel the aided hearing threshold level and the aided most comfortable level in dB SPL (sound pressure level), while for each electric stimulation channel the aided hearing threshold level and the aided most comfortable level are shown in electric level current units; the acoustic stimulation channels and the electric stimulation channels are shown in a common representation. The graphical user interface allows the audiologist to adjust the respective aided levels shown in the graphical interface in order to adjust the I/O curves of the bimodal device.

It is an object of the invention to provide for a bimodal stimulation system which enables fitting of both a neural stimulation device and a second stimulation device using a stimulation mode different from that of the neural device in an easy-to-understand and convenient manner. It is a further object to provide for a corresponding fitting method. According to the invention, these objects are achieved by a system as defined in claim 1 and a method as defined in claim 34, respectively. The invention is beneficial in that, by presenting in the graphical user interface an acoustic level audiogram representation of the aided hearing threshold levels, the aided most comfortable levels and/or the aided uncomfortable levels as a function of the audiometric frequency represented by the respective frequency band of the input audio signal for both stimulation modes, both stimulation devices can be fitted in an easy-to-understand and convenient manner even without knowledge of the technical characteristics of the stimulation devices (e.g. number and center frequencies of the filterbank). In particular, the stimulation levels for both stimulation modes are visualized in a comparable and meaningful manner. Such fitting device allows to expedite the clinical workflow, making fitting of the bimodal stimulation device easier and faster.

Preferred embodiments of the invention are defined in the dependent claims.

Hereinafter, the invention will be illustrated by reference to the attached drawings, wherein:

Fig. 1 is a schematic representation of an example of a system according to the invention;

Fig. 2 is a schematic representation of an example of the CI device of Fig. 1 ;

Fig. 3 is a schematic cross section of a human cochlea with marked stimulation sites;

Fig. 4 is a block diagram of an example of the signal processing structure of a CI device to be used with the invention;

Fig. 5 is an example of a workflow of a method for fitting a bimodal system according to the invention;

Fig. 6 is an example of an acoustic level audiogram representation of the hearing threshold levels and most comfortable levels of a bimodal stimulation system, as shown by a graphical user interface of a fitting device according to the invention;

Figs. 7A and 7B are examples of an I/O curve of the acoustic stimulation device of a bimodal stimulation device and an I/O curve of the electric stimulation device of the bimodal stimulation device, respectively;

Fig. 8 is a schematic representation of an example of a system according to the invention. Fig. 1 is a schematic representation of an example of a bimodal stimulation system according to the invention, comprising a fitting/programming unit 13, which may be implemented as a computer, a programming interface 15, a CI device 10 comprising a sound processing subsystem 11 and an implantable stimulation subsystem 12 and being worn by a patient 17 at the ipsilateral ear, and a hearing aid 21 worn at the contralateral ear and comprising a loudspeaker 23 for acoustic stimulation of the contralateral ear. The programming unit 13 communicates with the sound processing subsystem 11 and with the hearing aid 21 via the programming interface 15, which may be implemented as a wired or wireless connection (alternatively, there may be separate programming interfaces for electric and acoustic stimulation).

The programming unit 13 serves to control the sound processing subsystem 11 of the CI device 10 such that probe neural stimulation signals may be applied to the ipsilateral ear of the patient 17 via the stimulation subsystem 12 and to control the hearing aid 21 such that probe acoustic stimulation signals are presented via the loudspeaker 23 to the contralateral ear of the patient 17. Such probe stimulation signals may be presented separately (i.e. subsequently / independently) for acoustic and electric stimulation, or the probe stimulation signals may be presented for acoustic and electric stimulation in a synchronized manner. The perceptual behavioral response of the patient 17 to the such stimulation is recorded by the programming unit 13 via a user interface, which may be part of the programming unit (such as the computer keyboard) or may be provided separately (as schematically indicated at 25 in Fig. 1), in order to be used in the fitting of the CI device 10 and the hearing aid 21 , respectively, as will be explained below in detail.

It is to be understood that the programming unit 13 is used with the CI device 10 and the hearing aid 21 only for adjustment / fitting, but not during normal operation of the CI device 10 and the hearing aid 21.

In case that the fitting/programming unit 13 is adapted to generate audio signals / stimulation signals on its own, the programming interface 15 may be replaced by an audio interface for supplying the audio signals generated by the fitting/programming unit 13 to the CI device.

In Fig. 2 an example of the cochlear implant device 10 of the system of Fig. 1 is shown schematically. The sound processing sub-system 11 serves to detect or sense an audio signal and divide the audio signal into a plurality of analysis channels, each containing a frequency domain signal (or simply "signal") representative of a distinct frequency portion of the audio signal. A signal level value is determined for each analysis channel by analyzing the respective frequency domain signal Stimulation parameters are generated based on the frequency domain signal and are transmitted to the stimulation sub-system 12.

Stimulation sub-system 12 serves to generate and apply electrical stimulation (also referred to herein as "stimulation current" and/or "stimulation pulses") to stimulation sites at the auditory nerve within the cochlear of a patient 17 in accordance with the stimulation parameters received from the sound processing sub-system 11. Electrical stimulation is provided to the patient 17 via a CI stimulation assembly 18 comprising a plurality of stimulation channels. The stimulation parameters may control various parameters of the electrical stimulation applied to a stimulation site including, but not limited to, frequency, pulse width, amplitude, waveform (e.g., square or sinusoidal), electrode polarity (i.e., anode- cathode assignment), location (i.e., which electrode pair or electrode group receives the stimulation current), burst pattern (e.g., burst on time and burst off time), duty cycle or burst repeat interval, spectral tilt, ramp-on time, and ramp-off time of the stimulation current that is applied to the stimulation site.

Fig. 3 illustrates a schematic structure of the human cochlea 200. As shown in Fig. 3, the cochlea 200 is in the shape of a spiral beginning at a base 202 and ending at an apex 204. Within the cochlea 200 resides auditory nerve tissue 206 which is organized within the cochlea 200 in a tonotopic manner. Low frequencies are encoded at the apex 204 of the cochlea 200 while high frequencies are encoded at the base 202. Hence, each location along the length of the cochlea 200 corresponds to a different perceived frequency. Stimulation subsystem 12 is configured to apply stimulation to different locations within the cochlea 200 (e.g., different locations along the auditory nerve tissue 206) to provide a sensation of hearing. Returning to Fig. 2, sound processing subsystem 11 and stimulation subsystem 12 is configured to operate in accordance with one or more control parameters. These control parameters may be configured to specify one or more stimulation parameters, operating parameters, and/or any other parameter as may serve a particular application. Exemplary control parameters include, but are not limited to, most comfortable current levels and threshold current levels (as will be discussed in more detail below), input dynamic range parameters, channel acoustic gain parameters, front and backend dynamic range parameters, current steering parameters, amplitude values, pulse rate values, pulse width values, polarity values, filter characteristics, and/or any other control parameter as may serve a particular application. In particular, the control parameters may include a frequency allocation table (FAT) which determines the respective frequency range allocated to a certain electrode.

In the example shown in Fig. 2, the stimulation sub-system 12 comprises an implantable cochlear stimulator ("ICS") 14, a lead 16 and the stimulation assembly 18 disposed on the lead 16. The stimulation assembly 18 comprises a plurality of "stimulation contacts" 19 for electrical stimulation of the auditory nerve. The lead 16 may be inserted within a duct of the cochlea in such a manner that the stimulation contacts 19 are in communication with one or more stimulation sites within the cochlea, i.e. the stimulation contacts 19 are adjacent to, in the general vicinity of, in close proximity to, directly next to, or directly on the respective stimulation site.

In the example shown in Fig. 2, the sound processing sub-system 11 is designed as being located external to the patient 17; however, in alternative examples, at least one of the components of the sub-system 11 may be implantable. In the example shown in Fig. 2, the sound processing sub-system 11 comprises a microphone 20 which captures audio signals from ambient sound, a microphone link 22, a sound processor 24 which receives audio signals from the microphone 20 via the link 22, and a headpiece 26 having a coil 28 disposed therein. The sound processor 24 is configured to process the captured audio signals in accordance with a selected sound processing strategy to generate appropriate stimulation parameters for controlling the ICS 14 and may include, or be implemented within, a behind-the-ear (BTE) unit or a portable speech processor ("PSP"). In the example of Fig. 2 the sound processor 24 is configured to transcutaneously transmit data (in particular data representative of one or more stimulation parameters) to the ICS 14 via a wireless transcutaneous communication link 30. The headpiece 26 may be affixed to the patient's head and positioned such that the coil 28 is communicatively coupled to the corresponding coil (not shown) included within the ICS 14 in order to establish the link 30. The link 30 may include a bidirectional communication link and/or one or more dedicated unidirectional communication links. According to an alternative embodiment, the sound processor 24 and the ICS 14 may be directly connected by wires. In Fig. 4 a schematic example of a sound processor 24 is shown. The audio signals captured by the microphone 20 are amplified in an audio front end circuitry 32, with the amplified audio signal being converted to a digital signal by an analog-to-digital converter 34. The resulting digital signal is then subjected to automatic gain control using a suitable automatic gain control (AGC) unit 36.

After appropriate automatic gain control, the digital signal is subjected to a fiiterbank 38 comprising a plurality of filters F7 ... Fm (for example, band-pass filters) which are configured to divide the digital signal into m analysis channels 40, each containing a signal representative of a distinct frequency portion of the audio signal sensed by the microphone 20. For example, such frequency filtering may be implemented by applying a Discrete Fourier Transform to the audio signal and then distribute the resulting frequency bins across the analysis channels 40. The signals within each analysis channel 40 are input into an envelope detector 42 in order to determine the amount of energy contained within each of the signals within the analysis channels 40 and to estimate the noise within each channel. After envelope detection the signals within the analysis channels 40 may be input into a noise reduction module 44, wherein the signals are treated in a manner so as to reduce noise in the signal in order to enhance, for example, the intelligibility of speech by the patient. Examples of the noise reduction module 44 are described in WO 201 1/032021 A1.

The optionally noise reduced signals are supplied to a mapping module 46 which serves to map the signals in the analysis channels 40 to the stimulation channels Si ... Sn. For example, signal levels of the noise reduced signals may be mapped to amplitude values used to define the electrical stimulation pulses that are applied to the patient 17 by the ICS 14 via M stimulation channels 52. For example, each of the m stimulation channels 52 may be associated to one of the stimulation contacts 19 or to a group of the stimulation contacts 19.

The sound processor 24 further comprises a stimulation strategy module 48 which serves to generate one or more stimulation parameters based on the noise reduced signals and in accordance with a certain stimulation strategy (which may be selected from a plurality of stimulation strategies). For example, stimulation strategy module 48 may generate stimulation parameters which direct the ICS 14 to generate and concurrently apply weighted stimulation current via a plurality 52 of the stimulation channels S1 ... Sn in order to effectuate a current steering stimulation strategy. Additionally or alternatively the stimulation strategy module 48 may be configured to generate stimulation parameters which direct the ICS 14 to apply electrical stimulation via only a subset N of the stimulation channels 52 in order to effectuate an N-of-M stimulation strategy.

The sound processor 24 also comprises a multiplexer 50 which serves to serialize the stimulation parameters generated by the stimulation strategy module 48 so that they can be transmitted to the ICS 14 via the communication link 30, i.e. via the coil 28.

The sound processor 24 may operate in accordance with at least one control parameter which is set by a control unit 54. Such control parameters, which may be stored in a memory 56, may be the most comfortable listening current levels (MCL), also referred to as "M levels", threshold current levels (also referred to as "T levels"), dynamic range parameters, channel acoustic gain parameters, front and back end dynamic range parameters, current steering parameters, amplitude values, pulse rate values, pulse width values, polarity values, the respective frequency range assigned to each electrode and/or filter characteristics. Examples of such auditory prosthesis devices, as described so far, can be found, for example, in WO 2011/032021 A1. The programming unit 13 may act on the control unit 54 via the interface 15 for causing the ICS 14 and the electrode array 19 to apply a certain probe stimulus to the cochlear 200 as will be discussed in detail below.

The hearing aid 21 comprises a microphone arrangement 29 for capturing audio signals from ambient sound, an audio signal processing unit 27 for processing the captured audio signals and the loudspeaker 23 to which the processed audio signals are supplied to. The programming unit 13 may act, via the interface 15, on the audio signal processing unit 27 in order to cause the loudspeaker 23 to emit probe signals to be supplied to the contralateral ear.

Further, the programming unit 13 may adjust the respective stimulation parameters via the interface 15 in order to change, for examples the I/O curves of the CI device 10 and the hearing aid 21.

Fig. 5 shows an example of a workflow for fitting of a bimodal stimulation system, such as the system of Fig. 1 comprising a CI device 10 and a hearing aid 21.

In a first step 100 appropriate hearing levels are empirically determined which characterize the residual hearing of the patient (residual hearing typically is present at relatively low frequencies, such as below 2 kHz), such as the hearing threshold level, the most comfortable level and/or the uncomfortable level. Such "unaided" levels are determined for various frequencies or frequency bands by presenting test sound at a certain level and at frequency/frequency band to the patient in order to obtain a certain behavioral feedback by the patient to the acoustic stimulation.

The hearing threshold level ("T-level") corresponds to the minimum sound level at which the hearing perception at a given frequency starts; the most comfortable level ("M-level") corresponds to the sound level which is perceived as being most comfortable at the respective frequency; and the uncomfortable level ("U-level") is the sound level at which the sound perception at the respective frequency starts to become uncomfortable. Preferably, the measurement of the unaided levels is done in-situ, i.e. with the patient wearing the hearing aid 21 and with the fitting device 13 controlling the sound processor 27 of the hearing aid 21 in a manner so as to generate and present appropriate test sound signals via the hearing aid loudspeaker 23 to the patient. Preferably, all three levels (i.e. T, M and U) are measured, but in some cases one may consider to measure only two of them, in particular T and M, or the T-level only.

Typically, such T-, M- and U-levels are given in "dB HL" (dB hearing level), i.e. dB relative to the level of the quietest sound a normal hearing person is able to perceive at a given frequency. Alternatively, T-, M- and U-levels may be given in "dB SPL" (dB sound pressure level) at the ear drum or free-field (in this case, the level is not related to the perception of the normal hearing person).

In step 102, the sensitivity of the patient's hearing with regard to electric stimulation is empirically evaluated, in particular by measuring the required current level applied to a certain electrode of the CI device 10 in order to achieve the respective hearing perception; typically, these levels will be the hearing threshold current level (i.e. the minimum level of the current to be applied to the respective electrode in order to create a hearing sensation by the patient), the most comfortable current level (i.e. the current level at which the most comfortable hearing impression is created), and/or the uncomfortable current level (i.e. the current level at which the hearing impression starts to become uncomfortable). The respective levels are determined for each electrode. The required probe current signal is generated by the fitting device 13 which controls the CI device 10 accordingly. Typically, the current level measurements require behavioral feedback by the patient. However, in principle it is also possible to determine at least the T-levels by objective measurements (such as electrically evoked compound action potential (ECAP), neural response imaging (NRI) and auditory brainstem, response (ABR)), wherein the neural response to the current stimulus is detected, typically by back-telemetry; optionally, M-levels may be determined via eSRT (electrically evoked stapedius reflex threshold) measurements. It is to be understood that, while preferred embodiments of the invention relate to electric stimulation of the cochlea via an electrode array implanted within the cochlea, the invention also may be applied to other kinds of neural stimulation, such as optical stimulation via optical fibers implanted within the cochlea. Thus, the above-mentioned electrical stimulation signal (stimulation current) is to be understood only as a specific example of a general neural stimulation signal. It is also to be understood that a stimulation electrode of an electrode array is only a specific example of a stimulation channel which, in the case of optical stimulation, may be represented by one of several light emission areas in the cochlea.

The unaided acoustic stimulation levels determined in step 100 and the electric stimulation levels determined in step 102 are stored in a memory of the fitting device 13; alternatively or in addition, these levels also may be stored in the hearing aid 21 and the CI device 10, respectively.

In general, as already mentioned above, signal processing in a hearing stimulation device occurs according to a certain "stimulation model" including a set of stimulation parameters. In relatively simple cases the stimulation model may be described on the base of I/O curves; for acoustic stimulation, a separate I/O curve may be provided for each input frequency band, and for electric stimulation, a separate I/O curve may be provided for each electrode. More complex stimulation models may include frequency manipulation, such as frequency shifting and/or frequency compression, both for acoustic and electric stimulation, and simultaneous stimulation of adjacent electrodes ("current steering", wherein e.g. two adjacent electrodes may be stimulated in order to achieve a pitch in-between the pitches attributed to the electrodes). The stimulation model may include an auditory model for taking into account effects like spread of excitation and masking.

In step 104 the unaided acoustic stimulation levels of step 100 and the electric stimulation levels of step 102 are used to calculate, by taking into account the respective stimulation model including the presently set values of stimulation parameters , such as I/O curves of the acoustic stimulation in the hearing aid 21 and the electrical stimulation in the CI device 10, the respective "aided" acoustic stimulation levels and the respective "aided" electric stimulation levels; the calculated aided levels then are displayed on the graphical user interface (such as a screen 31) of the fitting device 15 in an aided audiogram representation as shown in Fig. 6. For the acoustic stimulation, such calculation may be performed for various audiometric frequencies which may equal the frequencies or frequency bands for which the respective unaided levels are known; alternatively or in addition, such calculation may be performed for other audiometric frequencies by appropriate interpolation. For the electric stimulation, such calculation may be performed for the audiometric frequencies corresponding the center frequency of each electrode; however, such calculation may be performed also for audiometric frequencies in-between the center frequencies of the electrodes. Examples for I/O curves for acoustic stimulation by the hearing aid 21 and electric stimulation by the CI device 10 are shown in Figs. 7A and 7B, respectively. An I/O curve for acoustic stimulation represents the level of the sound output provided by the loudspeaker 23 (typically given in dB HL) as a function of the sound level to which the microphone 29 of the hearing aid 21 is exposed to (typically also given in dB HL). An I/O curve for electric stimulation represents the stimulation current applied to the respective electrode as a function of the sound level to which the microphone of the CI device is exposed (typically given in dB HL). There is a separate I/O curve for each stimulation channel (i.e. for each stimulation electrode). In general, there are adjustable/variable contributions (namely the signal processing parameters which are adjustable by the fitting procedure) and non-adjustable contributions to the I/O curves.

For example, for the hearing aid 21 , the primary adjustable contributions are the gain applied in the linear (i.e. non-compressed) range up to the knee-point input level L K at which compression starts, the compression ratio applied for input levels above L K , and the value of L K . The main-non-adjustable contributions are the sensitivity of the microphone 29, the noise floor of the input stage (noise of microphone and noise of analog to digital converter) and the type and coupling of the receiver 23 to the ear canal.

For electric stimulation, the adjustable parameters are all fitting parameters which affect the "mapping function", such as the sensitivity of the CI device (at low sensitivity, close sound is more preferred over remote sound than at high sensitivity), the input level at which the AGC turns on / off, the input dynamic range (IDR) (the IDR of a CI sound processor is the ratio between the loudest and softest sounds that will be presented by the CI device to the patient), the "technical T-level" and the "technical M-level". The technical T-level denotes the stimulation current applied at very low input levels; and the technical M-level denotes the stimulation current applied at the input level at the knee-point in the curve of Fig. 7B (however, it is to be noted that these "technical" T and M-levels are not the same as the electric T- and M-levels measured in step 102 which are indicated at "T etectr j C " and "M e iectric" in Fig. 7B (and which may also be labeled "behavioral T-level" and "behavioral M-level"); the technical T- and M-levels typically differ slightly from the hearing threshold current level and the most comfortable current level determined in step 102 for an optimized fitting of the CI device 10. The main non-adjustable contributions to the I/O curves of electric stimulation are the sensitivity of the microphone 20 and the coupling of the respective electrode 18 to the auditory nerve.

For the non-adjustable contributions of the initially used I/O curves (i.e. the I/O curves forming the starting point of the fitting process) one may use default values known for the respective hearing aid type and CI device type. However, accuracy of the initial I/O curves may be enhanced by conducting technical measurements concerning the actual microphone sensitivities and the actual electrode currents (electrode currents may be measured via back-telemetry) utilizing the fitting device 13 in order to replace the respective default values by individually determined empirical values. In other words, generally at least part of the initially used stimulation parameters may be set to default values. According to one example, for the initially used I/O curves not only the non-adjustable contributions but also the adjustable contributions may be set according to default values which are specific to the respective type of hearing aid and CI device (i.e., according to one example, all of the initially used stimulation parameters may be set to default values).

According to an alternative, more preferred embodiment, initially the adjustable stimulation parameters (such as the adjustable parameters of the initially used I/O curves) may be set according to values calculated based on the unaided levels determined in step 100 and the electric levels determined in step 102. For example, for acoustic stimulations such "precalculation" of the fitting parameters may be based on the usual prescription fitting formulas, such as NAL-NL1 , etc. For electric stimulation, the pre-calculation may provide for an empirical estimation of how much the fitting parameters "technical T-level" and the "technical M-level" may differ from the hearing threshold current level "T e i e ctric" and the most comfortable current level "M e i ec tric" determined in step 102; for example, according to a default setting without pre-calculation, these differences could be set to zero. In general, the "pre- calculation" of the I/O curves should advance the initially used I/O curves as close as possible towards the optimal I/O curves in order to shorten the (manual) fitting procedure.

The arrows in Fig. 7A show schematically how the aided T-level is determined from the unaided T-level by taking into account the I/O curve of the respective frequency channel (or a combination of channels, e.g. if the audiometric frequency is in the middle between two adjacent filters): the aided T-level is that value of the input level which is associated, via the I/O curve, with an output level which has the value of the unaided T-level. The same procedure applies to the respective M-levels (and U-levels). In the most simple case, the aided electric levels may be determined in the same manner as for the acoustic stimulation in Fig. 7A, as indicated by the dashed arrows in Fig. 7B, i.e. the aided electric T-level "T aide d" is that value of the input level which is associated, via the I/O curve, with an output current which has the value of the measured behavioral T-level "T e iectric"-

However, as already mentioned above, more sophisticated calculations may take into account an appropriate auditory model based on the selected coding strategy, in order to take into account, for example, the impact of overlapping electric fields at adjacent electrodes and refractory effects on loudness. Such auditory model may take into account the result of objective measurements (such as ECAP, NRI, eSRT and/or ABR) in order to estimate, for example, the spread of excitation inside the cochlea.

The aided acoustic and electric levels are shown in a common acoustic level audiogram representation as a function of the audiometric frequency, with the levels being given for both acoustic stimulation and electric stimulation in an acoustic level unit (in example of Fig. 6, the unit is "dB HL"), so that the aided electric levels are directly comparable to the aided acoustic levels; further, the aided levels for electric and acoustic stimulation are fully comparable not only with regard to the level value, but also with regard to frequency, since also the aided electric stimulation levels are shown as a function of frequency, like the aided acoustic stimulation levels (to this end, the frequency allocation of the stimulation channels/electrodes is used).

In the example of Fig. 6, the aided electric and acoustic T-levels and M-levels are shown. Typically, for EAS patients acoustic stimulation takes place at relatively low frequencies, such as below 1 kHz, and electric stimulation takes place at higher frequencies, such as above 1 kHz (a typical start frequency for electric stimulation is around 200Hz and is not changed for patients with electric stimulation at one ear and acoustic stimulation at the other ear; for EAS patients the electric start frequency may be increased regularly). According to an embodiment, there may be a distinct crossover frequency which separates acoustic stimulation from electric stimulation; according to an alternative embodiment, there may be an overlapping frequency range in which both acoustic and electric stimulation may take place.

According to the example of Fig. 6, the unaided levels determined in step 100 may be shown together with the calculated aided levels, or they may be shown in an alternating manner with regard to the calculated aided levels. Further, normal hearing curves may be shown together with or alternatingly with other curves on the graphical user interface. Typically, the user will be allowed to select which curves are displayed. In particular, there may be a representation in which the aided electric levels are shown only, and there may be a representation in which the aided acoustic levels are shown only, in addition to the common representation in the example of Fig. 6, wherein both aided electric and acoustic levels are shown on the same screen. While in the example of Fig. 6 the common level unit is "dB HL" for acoustic and electric stimulation, as an alternative the selected unit may be "dB SPL at ear drum" or "dB SPL free- field"; preferably, the presently used unit may be selectable by the user.

The user may interact with the graphical user interface in a manner so as to adjust the aided levels, preferably by "drag-and-drop-action" on the respective symbol, i.e. the symbols may be manually shifted vertically upwards or downwards in order to increase or decrease the respective aided level. This applies both to the acoustic and the electric levels. Upon such adjustment of the respective aided level, the fitting device 13 will adjust the values of the stimulation parameters (such as the respective I/O curve) in conformity with the aided level adjustment so as to accordingly adjust the respective stimulation device, i.e. the hearing aid 21 or the CI device 10. In other words, adjustment of the aided level by the audiologist causes a corresponding adjustment of the stimulation parameters (such as the adjustable parameters of the respective I/O curve).

For example, when an aided electric T-level is manually increased (see arrows in Fig. 6), the respective I/O curve in Figure 7B is changed in such a manner that the current levels at low input levels are increased, thus making the CI device 10 more sensitive at low input levels of the respective frequency band/electrode. Similarly, when an aided acoustic T-level is manually increased, the gain of the respective I/O curve may be increased accordingly.

According to one example, the audiogram representation of Fig. 6 may include a marked area of audiometric frequencies and stimulation levels which are particularly important for speech understanding (also called "speech banana").

Preferably, the user interface allows adjustment of the bandwidth of the acoustic stimulation and the bandwidth of the electric stimulation by a manual adjustment of the respective frequency ranges. In particular, the graphical user interface may allow selection and adjustment of a crossover frequency between acoustic and electric stimulation. The above-mentioned manual adjustment of the aided levels and the bandwidth / crossover frequency is shown as step 106 in the workflow of Fig. 5.

According to one embodiment, the fitting device 13 may be designed to allow behavioral measurements, with the patient both utilizing the hearing aid 21 and the CI device 10, in order to actually measure the aided electric and acoustic stimulation levels which have been previously calculated, so that the accuracy of the calculation can be evaluated. Such behavioral measurements may include loudness scaling (in a loudness scaling procedure, the patient has to assign a number of verbal categories, such as soft, very loud, etc., to a stimulus, such as an electric pulse train or acoustic narrowband noise, at different levels; the result is a loudness growth function). According to one option, deviations between the measured aided levels and the respective calculated aided levels may be automatically (or manually) compensated. According to another option, a warning may be issued by the fitting device 13 in case that the deviations between the measured aided levels and the respective calculated aided levels exceed a certain degree.

Alternatively or in addition, objective measurements (such as ECAP or NRI) may be used for electric stimulation in order to improve inaccuracy of the auditory models and thus the accuracy of the calculation of the aided levels.

While the above examples relate to fitting by visualization and adjustment of the T- and M- levels, it is to be understood that in some cases only one of the levels, in particular the T- level, may be visualized and adjusted, or that all three levels (T-, M- and U-levels) may be visualized and adjusted. Preferably, at least two of the three levels (T-, M- and U-levels) are visualized and adjusted. While according to the examples described so far the first stimulation device may be a cochlear implant for electric stimulation of the (ipsilateral) cochlea, it could be, alternatively, any other device for neural hearing stimulation, such as cochlear implant for optical stimulation of the cochlea or an auditory brainstem implant. As already mentioned above, the second stimulation device preferably is an acoustic stimulation device in the sense that it provides for vibrational stimulation of the ipsilateral and/or the contralateral ear; for example, the second stimulation device may be an electro- acoustic hearing aid comprising a loudspeaker as the output transducer, a bone conduction hearing aid, a middle ear implant (MEI) or a direct acoustic cochlea stimulator (DACS). However, according to an alternative embodiment, the second stimulation device also may be neural stimulation device which, however, uses a stimulation mode different from that of the first stimulation device. In this regard, different stimulation modes use qualitatively or quantitatively different outputs. For example, if the first stimulation device is a cochlear implant for electric stimulation of the (ipsilateral) cochlea, second stimulation device may be a cochlear implant for optical stimulation of the (contralateral) cochlea (optical output rather than electric output) or an auditory brainstem implant (electric output of different magnitude, etc.).

It is to be understood that the audiometric frequency, i.e. the frequency in an audiogram representation, corresponds to the frequency / pitch resulting from a stimulus as perceived by the patient (for acoustic stimulation, the pitch corresponds to the vibration frequency of the output transducer; for electric stimulation the pitch primarily is determined by the current pattern (current levels of the electrodes) and the electrode positions, wherein an auditory model may be used to calculate/estimate the pitch (and the loudness) resulting from a certain stimulation current pattern). For example, the audiogram representation of an aided T-level at 1 kHz indicates the minimum level at which a 1kHz (sine or narrowband) sound has to be presented to the patient wearing the stimulation device in order to create a hearing sensation. It is also to be understood that the audiometric frequency at which an aided level is given in the audiogram representation may be different from the center frequencies of the filterbanks used for dividing the input sound. In Fig. 8 a schematic representation of a fitting system architecture of the invention is shown, according to which a graphical user interface (GUI) 31 is connected via an "interface unit" 33 with the first stimulation device 10 and the second stimulation device 21. The unit 33 forms part of the fitting system and serves as an interface between the GUI 31 and the stimulation devices 10, 21 in a manner so as to render the GUI 31 independent from the stimulation devices 10, 21 in the sense that what is displayed on the GUI 31 , such as the aided audiogram representation described above, is the same for all types of stimulation devices 10, 21 , irrespective of which stimulation mode the respective stimulation device 10, 21 utilizes. The unit 33 functionally corresponds to a data processing unit which reads the presently set values of the stimulation parameters from the first stimulation device 10 and the second stimulation device 21 and then calculates the aided levels for the audiogram representation from these values, taking into account the respective stimulation model (which is implemented in the unit 33 for each type of stimulation device). The unaided levels for acoustic stimulation and the neural stimulation signal levels for neural stimulation may be read as well from the first stimulation device 10 and the second stimulation device 21 (if available on these devices), or they may be stored by the unit 33 (if supplied from another source). The results of the calculations are supplied to the GUI 31.

The audiologist may act on the GUI 31 so as to adjust the aided levels, which adjustment is supplied as input to the unit 33 which calculates the accordingly adjusted values of the stimulation parameters in order to set these adjusted values as the new values of the stimulation parameters in the first stimulation device 10 and the second stimulation device 21.