Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
  • H04R25/00—Electric hearing aids
  • H04R25/35—Electric hearing aids using translation techniques
  • H04R25/353—Frequency, e.g. frequency shift or compression

Definitions

• the present invention relates to an upper audio range (UAR) hearing apparatus and method that converts speech waveform envelope into upper audio frequencies (> 10 kHz), for delivery to the ear, or skin of the head or neck, which are then provided to the inner ear and then the brain.
• UAR upper audio range
• 4,982,434 involves frequency-converting the speech to an ultrasonic region (> 30,000 Hz), while another approach involves frequency transposition focusing the speech into a bass region ( ⁇ 300 Hz).
• the invention is directed to a hearing aid, which includes a plurality of channels for receiving an input speech signal, one of the channels filtering the speech signal with a first filter centered at a first predetermined audio frequency and having a first predetermined filter bandwidth, another of the channels filtering the speech signal with a second filter centered at a second predetermined audio frequency and having a second filter bandwidth.
• the hearing aid also includes an envelope extraction unit for extracting an envelope of an output of each of the channels, and a multi-channel frequency multiplication unit for performing a modulation of each of the envelopes obtained from the output of each of the channels using a carrier that is in an upper audio frequency range.
• the hearing aid further includes a transducer unit for providing vibration and sound in the ear canal or preferably as a vibration to the skin of a user based on the modulated envelopes.
• Figure 1 is a block diagram of an upper audio hearing aid according to one embodiment of the invention.
• Figure 2 shows speech perception for various upper audio carrier frequencies used in an upper audio range hearing aid according to the invention
• Figure 3 shows word discrimination for both a single- and a dual-channel upper audio range hearing aid according to the invention
• Figure 4 shows the frequency spectra and envelope for the words “mole”, “bowl” and “pole”;
• Figures 5-7 show the output of a three-channel upper audio range hearing aid according to the invention, for the words “mole”, “bowl” and “pole”;
• Figures 8-12 show the frequency spectrum of the vowel "ah” with no conversion, conversion using a 5 kHz carrier, conversion using a 10 kHz carrier, conversion using a 15 kHz carrier, and conversion using a 20 kHz carrier, respectively.
• An upper audio range hearing device converts speech waveform envelope into the upper audio frequencies, > 10 kHz, for delivery into the ear canal or to the head or neck of a user and eventually into the inner ear.
• the device can be single or multi- channeled, such that in the multi-channeled configuration, a plurality of signals that are extracted from the original speech waveform are processed to be each converted to upper audio frequency signals. Since the signals are all derived from the same source, they are coherent and can be correlated temporally by the brain into intelligible speech.
• the speech signal is converted to the upper audio frequency range by one of amplitude modulation, frequency modulation, or by other means in either analog or digital form. If only a single channel is desired, then it can be selected from the plurality of channels based on frequency content.
• the upper audio range signals also can be combined with the original speech waveform, either in its natural form or amplified form, to enhance intelligibility in the hearing impaired.
• the upper audio frequency signal is provided by way of a transducer, such as a piezoelectric device, which vibrates in the upper audio frequency range.
• the transducer is preferably positioned on the skin of the patient near the ear, but alternatively the transducer can be implanted in the middle or inner ear, such that the upper audio range speech waveform is directly provided to the ossicle, or window or wall of the inner ear.
• the transducer can alternatively be placed into the ear canal, such that the result is vibratory and sound waves. In this alternative, the output will be sound in the ear canal and vibration in the canal wall to which the transducer touches.
• a transducer in the inner ear and a transducer on the head or neck may be utilized as another alternative.
• a series of filters extract envelope information from a broadband speech signal.
• Each channel carries separate amplitude information based on the passband of the filter in that channel.
• the signal in each channel is multiplied by an upper audio range (UAR) carrier.
• At least one of the filters is preferably set in the vowel frequency range, for example 500 Hz.
• At least another of the filters is preferably set in the range of high frequency consonants, for example 3.1 kHz.
• the lowest frequency channel (fundamental vocal frequency) can be presented as low-pass-amplified sound.
• the lowest frequency channel is directly provided to the transducer, and in another embodiment, the lowest frequency channel is multiplied by a carrier to the upper audio frequency range.
• the outputs of the multiple channels are amplified, and delivered via transformers to skin vibrators, or transducers. Outputs of the channels may be mixed or combined prior to output to a single transformer and a single transducer. Alternatively, the outputs of the channels may be individually attenuated (shaped) or presented separately to an array of transducers ⁇ one for each channel output. The transducer array may be phase or otherwise manipulated to result in an acceptable sound image for the listener.
• the embodiments of the invention have been developed based on the fact that clinical hearing is not generally measured above 10,000 Hz because there is little speech above 6,000 Hz. Thus, while human hearing is present above 10,000 Hz, it is often neglected. There is early hearing loss in this region due to aging, noise or toxicity. Hearing in this range is sometimes monitored to assess insult such as toxicity, but little else.
• the upper range of normal human hearing for air conducted sound is generally accepted to be about 20,000 Hz, although there have been some reports of human hearing up to about 26,000 Hz. In any event, the threshold of hearing increases rapidly from 10,000 to 26,000 Hz. This range can be exploited by either air pressure in the canal or vibration of the head and inner ear.
• Upper audio range frequencies while caring little direct speech energy, are used in the embodiments of the invention to deliver speech information to the inner ear. If the conventional speech frequencies (100 Hz to 6000 Hz) are shifted such that the fundamental vocal frequency (f 0 ) is now in the UAR frequencies (either by some form of amplitude modulation, frequency modulation, or synthetic generation), the ear will be stimulated and speech perception will occur.
• the embodiments of the invention transmit the multiplied speech to the skin of the head or neck of the user.
• the vibrations pass into the inner ear by bone or fluid conduction. While the complete method of transduction at possible inner ear sites is not completely understood at present and need not be known in order to practice the invention, the cochlea and possibly part of the vestibular system is activated. Direct stimulation of nerve VIII that provides speech signals to the brain is less likely, but possible due to the piezoelectric nature of the head anatomy.
• the UAR signal that is provided to a vibration unit according to the invention is complementary to normal air conduction hearing, and may serve as a reinforcement of speech perception under poor listening conditions, such as in areas where there is high ambient noise.
• a single channel is used to shift up the speech to the upper auditory range, via amplitude modulation, upper-sideband modulation, double-sideband modulation, frequency modulation, or the like, to thereby create an upper auditory range signal.
• That signal is amplified and then provided to a transducer, which is disposed in the ear canal or on the head or neck of a user, and which outputs a vibration to the user that is received in the inner ear. That vibration is transferred to the auditory cortex of the brain, where it is interpreted as speech.
• a plurality of channels are used, such that different frequencies, such as the consonant frequencies that are often overshadowed by the higher-intensity (but lower frequency) vowel frequencies, can be emphasized.
• high and low frequency consonant sounds can be processed to have better perceptual salience.
• Vowel sounds typically having about 20 dB more energy in the original signal than consonant sounds, may overpower those consonant sounds if only a single channel is used, as in the first embodiment.
• the second embodiment provides better speech perception, but at the cost of greater size and power consumption. This better speech perception of the second embodiment as compared to the first embodiment can be seen from the charts shown in Figures 2 and 3.
• the channels do not necessarily have to be integrated, because the ear and brain fuse the information into a single percept. That is, the outputs of each of the channels can be separately provided to a corresponding transducer, and each transducer may then provide a vibration based on the UAR speech in the channel connected to that transducer.
• the outputs of the plurality of transducers are received by the inner ear and transferred as signals to the brain (by way of nerve VIII), where they are perceived as speech.
• the outputs of the channels can be combined, or mixed, and then processed (by a transformer/attenuator network), to be provided to a single transducer. That single transducer produces a vibration based on the signals from all of the channels, which is passed into the inner ear, which in turn provides a signal to the auditory cortex of the brain (via nerve VIII), where it is perceived as speech.
• Figure 4 shows the frequency spectra and envelope of the words “mole”, “bowl”, and “pole”, for conventional speech in the audible frequency range.
• Figures 5, 6 and 7 shows the output of a three-channel UAR hearing aid according to the invention, for inputs of the words “mole”, “bowl”, and “pole”, respectively.
• envelopes of these channel outputs are then extracted by an envelope extractor, and those envelopes are converted to the upper audio frequency range by either amplitude modulation (am), frequency modulation (fm), upper-sideband modulation, single-sideband modulation, full am, or the like.
• modulated signals can be combined and then amplified by an amplifier/transformer unit, or they can be separately amplified by an amplifier/transformer array.
• the amplifier/transformed signal(s) is/are then provided to a transducer unit/array, which is fitted on the head or neck of a user.
• Figures 8-12 respectively show the spectra of the sound "ah” for: a) manual voice (no modulation), b) 5 kHz carrier, c) 10 kHz carrier, d) 15 kHz carrier, and e) 20 kHz carrier.
• the envelope of the sound “ah” stays substantially the same regardless of the carrier used. Therefore, based on the envelope of the speech signal corresponding to the sound "ah” that has been upconverted to the UAR frequency range, the brain's auditory cortex is able to process the spoken sound "ah” .
• Figure 1 shows a UAR hearing aid according to the second embodiment of the invention, in which speech is received by a microphone 110.
• the output of the microphone 110 is provided to a plurality of filters 120-1, 120-2, . . . , 120- n.
• the output of the microphone 110 is also provided to an input speech preamplifier 130, which does not filter the speech, as is done in the other channels 120-1, 120-2, . . ., 120-n.
• the preamplifier 130 provides speech directly to an optional mixer 140 or to a transformer/attenuator network 185 if the mixer 140 is not provided. That way, both UAR speech and original speech is provided to the inner ear of the user.
• Each channel 120-1, 120-2, . . ., 120-n has a filter that has a passband and center frequency at a different portion of the audio (or audible) frequency range. That way, certain portions of the audible speech range can be either emphasized or attenuated, as desired.
• the outputs of each channel are provided to an envelope extractor 160, which includes a plurality of extractors provided on a one-to-one basis for the plurality channels.
• Each envelope extractor is operable to extract the envelope of the output of the corresponding channel.
• Envelope extractors are readily available, and a discussion of such elements is not provided herein. For example, an RC filter having an appropriate time constant may be used to extract the envelope of a filtered speech signal.
• the extracted envelopes are then provided to a multi-channel frequency multiplication network 170, where each extracted envelope is separately modulated and frequency converted to a UAR frequency.
• modulation techniques such as am, fin, double-sideband modulation, full am, single-sideband modulation, or the like, may be utilized.
• the modulated signals also may be amplified, as required, in the multiplication network 170.
• the output of the multiplication network 170 is shown as being provided to the optional mixer 140. In the second embodiment shown in Figure 1, the mixer 140 mixes or combines each of the UAR signals, as well as the unmodulated speech signal received from preamplifier 130.
• the output of the mixer 140 is provided to a transformer/attenuator array 185, where the unmodulated speech signal is amplified, attenuated, or processed based on commands received over-the-air by a radio frequency receiver (not shown) in the transformer/attenuator array 185. Those commands are output by way of a hand-held programmer 188. If a mixer is not provided, then the separate UAR signals and the non-UAR signal (output from preamplifier 130) are separately provided to the transformer/attenuator array 185, which is configured to separately process each of the received signals based on commands received by way of the hand-held programmer 188.
• the transducer unit 150 provides vibrations based on the input signals to that unit.
• the transducer unit 150 is made up of one or more piezoelectric devices. If a mixer is used, the transducer unit 150 corresponds to a single transducer. If a mixer is not used, then the outputs of the transformer/attenuator array 185 are separately provided to a bank of transducers within the transducer unit 150.
• the vibrations caused by the transducer/transducers are received in the inner ear 195, where they are processed and provided to the brain 195 and interpreted as intelligible speech.
• the transducer unit 150 may be phase or otherwise manipulated to result in an acceptable sound image for the listener.
• the transducer unit 150 may be disposed on the head or neck of the user, or it may be disposed, as shown by transducer unit 199, in the ear canal, where it is in contact with the walls of the ear canal.
• Transducer unit 199 produces vibrations of the canal wall, as well as sound in the canal.
• Transducer unit 199 can alternatively be used together with transducer unit 150 in another possible implementation.
• the UAR hearing aid according to the invention differs from the supersonic hearing aid in that, for certain embodiments of the invention, both air and bone conducted signals are provided to the ear.
• the UAR hearing aid is a multi-channel instrument that allows the brain to combine correlated waveforms, which have been extracted from the same speech signal, into precepts of the original speech band, by relying on the amplitude time information and not the spectrum to accomplish this task.
• the supersonic hearing does not use the low ultrasonic frequency range ( ⁇ 30 kHz), as in the embodiments of the invention.
• the supersonic hearing aid does not incorporate such an audio signal to be provided with other signals in speech perception.
• the present invention also differs from other speech envelope extracting systems in that the present invention is high frequency and low ultrasonic (10 - 30 kHz) and that no speech waveform rectifier is necessary in that biorectification is present.
• the present invention allows for preferentially amplifying envelope aspects of the full speech signal to enhance perception as high frequency consonants. These sound units are often overshadowed by vowel energy in the single channel hearing aids and, as a result, intelligibility of speech is lowered.
• the embodiments of the invention also are designed to serve as an augmentation to normal communications systems in high noise areas.
• the speech envelope cues used in the embodiments of the invention are resistant to audio noise masking, and helps reduce ambiguity in audio speech.
• ultrasonic speech decoding is based on spectra cues (hence the need for frequency expansion to increase intelligibility), and can be either a single-channel or a multi-channel device.
• Certain embodiments of the invention also are based on the use of amplitude cues to enhance intelligibility, by combining several channels, as is done in the second embodiment.
• multi-channeled second embodiment was explained with reference to three channels, one of ordinary skill in the art will recognize that any number of channels may be utilized while remaining with the spirit and scope of the invention, and the specific filters for each channel may be chosen with different passbands as well.

Landscapes

• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Neurosurgery (AREA)
• Otolaryngology (AREA)
• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Acoustics & Sound (AREA)
• Signal Processing (AREA)
• Circuit For Audible Band Transducer (AREA)
• Electrically Operated Instructional Devices (AREA)

Applications Claiming Priority (3)

Publications (1)

Family

ID=22299740

Family Applications (1)

Country Status (3)

Family Cites Families (4)

• 1999
  • 1999-10-14 EP EP99954633A patent/EP1123636A2/de not_active Withdrawn
  • 1999-10-14 WO PCT/US1999/021618 patent/WO2000022879A2/en not_active Ceased
  • 1999-10-14 AU AU10937/00A patent/AU1093700A/en not_active Abandoned

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events