EP2437258B1 - Verfahren und Vorrichtung zur Frequenzkompression mit selektiver Frequenzverschiebung - Google Patents
Verfahren und Vorrichtung zur Frequenzkompression mit selektiver Frequenzverschiebung Download PDFInfo
- Publication number
- EP2437258B1 EP2437258B1 EP11183051.9A EP11183051A EP2437258B1 EP 2437258 B1 EP2437258 B1 EP 2437258B1 EP 11183051 A EP11183051 A EP 11183051A EP 2437258 B1 EP2437258 B1 EP 2437258B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- frequency
- channel
- channels
- shifting
- mapping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Electric hearing aids
- H04R25/35—Electric hearing aids using translation techniques
- H04R25/353—Frequency, e.g. frequency shift or compression
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
Definitions
- the present invention relates to a method of frequency-compressing an audio signal by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels.
- the present invention relates to a corresponding device for frequency compression of an audio signal with a shifting device for shifting or mapping a portion of the audio signal.
- the present invention also relates to a hearing device with such a device.
- a hearing device is understood to mean any sound-emitting device that can be worn in or on the ear, such as a hearing aid, a headset, headphones and the like.
- Hearing aids are portable hearing aids that are used to care for the hearing impaired.
- hearing aids such as behind-the-ear hearing aids (BTE), receiver in the canal (RIC) and in-the-ear hearing aids (Id0), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
- BTE behind-the-ear hearing aids
- RIC receiver in the canal
- Id0 in-the-ear hearing aids
- ITE canal hearing aids
- the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
- bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
- Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
- the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic Receiver, e.g. B. an induction coil.
- the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
- the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed.
- a signal processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them.
- the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
- the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
- the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
- Hearing aids are essentially two common methods to increase speech intelligibility.
- a frequency-dependent level compensation is generally performed by means of AGC (Automatic Game Control) in order to lift signals above the hearing threshold of the hearing impaired, so that he can perceive the signals again.
- AGC Automatic Game Control
- the second method is usually used in addition to the first and aims at hearing damage, in which even by pure amplification of the signal, the threshold of hearing in certain, typically high, frequencies can not be achieved. These high frequencies are mapped to a low (audible) frequency range so that they can be lifted above the threshold of hearing by amplification.
- the method is called frequency compression because the desired frequency range is mapped to a smaller, more audible frequency range.
- the method used uses properties of the filter bank used for easy implementation. It selectively copies individual channels, depending on their instantaneous power, to other channels, so that the frequency components contained in these channels, shifted at the output, reappear in a different frequency range. Where the channels are displayed determines a mapping rule and is adjustable, so that different compression ratios can be realized.
- FIG. 2 shows the principle of frequency compression by simply copying channels.
- the center frequency 14 is associated with a channel 14 '.
- the frequency of the sound (dominant instantaneous frequency 11 "and 14") relative to the respective channel center within the source and destination channel is identical.
- a method in which a higher, first frequency band, which lies above the hearing range of a deaf person, is transposed into a second frequency band which is audible to the carrier.
- a dominant signal is detected in the higher band and this transposed down by means of an oscillator with adaptive frequency and a mixer in the audible range.
- the shifted signal of the first frequency band and the signal of the second frequency band present in the audible target area are mixed.
- the object of the present invention is therefore to the frequency compression of an audio signal to the effect optimize that creates an improved listening experience. It is a corresponding method and a corresponding device to propose.
- this object is achieved by a method for frequency compression of an audio signal, by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, wherein a dominant instantaneous frequency in the first frequency Frequency channel is determined in the move or mapping first the entire first frequency channel including the dominant instantaneous frequency is shifted or mapped into the second frequency channel, wherein the dominant instantaneous frequency receives an intermediate frequency position, a final frequency position for the dominant instantaneous frequency by a predetermined continuous compression characteristic in the second Frequency channel is determined based on the frequency position of the dominant instantaneous frequency in the first frequency channel and the dominant Instantanfre shifted or imaged from the intermediate frequency position to the final frequency position.
- the invention provides a device for frequency compression of an audio signal with a first displacement device for shifting or imaging a portion of the audio signal provided in a plurality of frequency channels from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, and comprising estimating means for determining a dominant instantaneous frequency in the first frequency channel, wherein with the first displacement means the entire first frequency channel including the dominant instantaneous frequency in the second frequency channel being displaceable or mappable such that the dominant instantaneous frequency obtains an intermediate frequency position, computing means for determining a final frequency position for the dominant instantaneous frequency by a predetermined continuous compression characteristic in the second frequency channel from the frequency position of the dominant instantaneous frequency in the first frequency channel, and second shifting means for shifting or mapping the dominant instantaneous frequency from the intermediate frequency quency position to the final frequency position.
- the shifting or mapping of the dominant instantaneous frequency from the intermediate frequency position to the final frequency position is accomplished by amplitude modulation.
- the amplitude modulation corresponds to a multiplication of the signal with the modulation term exp (j * 2 ⁇ f * t). This in turn corresponds in the spectral range of a shift by the frequency .DELTA.f.
- the second frequency channel for the displacement or mapping of the first frequency channel is fixed. In this way, calculation time can be saved in the channel shift.
- the second frequency channel is for shifting or mapping the first frequency channel determined by the compression curve.
- the second frequency channel for the displacement is not specified here, so that one or more frequency channels can be determined on the basis of the compression characteristic that comes into question for the second frequency channel.
- the second frequency channel one of several possible frequency channels can be selected, in which the dominant instantaneous frequency is arranged closest to the respective channel center. In this way, artifacts, which can arise through the modulation avoid.
- the frequency compression device may comprise a polyphase filter bank for providing the audio signal in a plurality of frequency channels. This makes it possible to generate only positive frequency components in the channels.
- the device according to the invention is particularly advantageously used in a listening device and in particular in a hearing aid.
- a frequency compression in hearing aid users can be realized with fewer artifacts.
- FIG. 4 is a channel arrangement similar to FIG. 2 shown. There are several channels with the center frequencies 10 to 15 reproduced.
- a displacement of the channel 14 'to the channel 11' is performed in a first step 17.
- a tone or a dominant instantaneous frequency 14 " which becomes, as in connection with FIG. 2 already explained, here too in the first step 17, shifted from a frequency position f s to the intermediate frequency position f z .
- the distance of the intermediate frequency position f z to the channel center 11 of the second channel 11 ' corresponds to the distance of the frequency position f s of the original instantaneous frequency 14 "relative to the channel center 14 of the source channel or first channel 14'.
- the first step 17 of the frequency shift represents only a coarse channel-by-channel shift. It is unlikely that the tone 14 "will actually land at a frequency position that results directly from a frequency compression characteristic
- FIG. 4 is a frequency position f d on which the sound 14 "would actually land if the image is taken with a predetermined compression characteristic, therefore, the aim of the present invention is to perform a further shift step after the first step 17 in order to obtain the shifted sound 11". to shift to the final frequency position f d , so that the target tone 18 results.
- the shifted tone 11 is shifted by amplitude modulation in a second step 19.
- the shifting takes place here by the amount ⁇ f.
- the tone is thus shifted to its final position f d .
- first frequency channel 14 ' a specific frequency range
- second frequency channel 11' another range
- the dominant instantaneous frequency can be accurately modulated where it is expected according to the mapping characteristic.
- this method can be used in a polyphase filter bank which generates only the complex-valued, analytical signal (only positive frequency component of a Fourier transformation) in the channels.
- the method can be applied regardless of the tonality of the channel, as there are no negative effects to be feared in noisy proportions.
- FIG. 5 shows the measurement result of the frequency compression according to the invention.
- the output frequency f o and in the abscissa the input frequency f i shown.
- a frequency sweep is applied to the input.
- the modulation in the target channel creates a continuous frequency response.
- the assignment of source frequency to target frequency is referred to as a compression characteristic. So there are no more frequency jumps and thus no related artifacts.
- mapping rule from source to target frequency must be provided by appropriate means of audiology.
- a mapping can typically be made on the basis of a Bark ERB or Spinc frequency division, as in the document EP 1 333 700 A2 is described.
- FIG. 6 shows a block diagram of a possible embodiment of a frequency compression device according to the invention.
- the instantaneous source frequency f s is estimated by an estimator 21.
- each target channel 22, 22' is estimated.
- the assignment scheme may either be fixed, ie a fixed selection of the source channels 20, 20', 20 "will be assigned to a single destination channel, or variable, ie dependent on the frequency estimate and the compression characteristic is determined for each source channel 20, 20 ', 20 ", to which destination channel 22, 22', 22" it is assigned.
- the signal from the selected source channel is modulated by a modulator 24 by means of amplitude modulation such that the mapping of source frequency to target frequency exactly corresponds to the compression characteristic.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Otolaryngology (AREA)
- Neurosurgery (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Stereophonic System (AREA)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102010041653.3A DE102010041653B4 (de) | 2010-09-29 | 2010-09-29 | Verfahren und Vorrichtung zur Frequenzkompression mit selektiver Frequenzverschiebung |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP2437258A2 EP2437258A2 (de) | 2012-04-04 |
| EP2437258A3 EP2437258A3 (de) | 2013-09-04 |
| EP2437258B1 true EP2437258B1 (de) | 2015-11-11 |
Family
ID=44720711
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP11183051.9A Active EP2437258B1 (de) | 2010-09-29 | 2011-09-28 | Verfahren und Vorrichtung zur Frequenzkompression mit selektiver Frequenzverschiebung |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US9031269B2 (da) |
| EP (1) | EP2437258B1 (da) |
| DE (1) | DE102010041653B4 (da) |
| DK (1) | DK2437258T3 (da) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI504282B (zh) * | 2012-07-20 | 2015-10-11 | Unlimiter Mfa Co Ltd | 增加聽障者聽到聲音正確性之方法及助聽器 |
| US9084050B2 (en) * | 2013-07-12 | 2015-07-14 | Elwha Llc | Systems and methods for remapping an audio range to a human perceivable range |
| TWI543634B (zh) * | 2013-12-10 | 2016-07-21 | 元鼎音訊股份有限公司 | 處理聲音段之方法及其電腦程式產品及助聽器 |
| KR102308541B1 (ko) * | 2015-01-16 | 2021-10-05 | 삼성전자주식회사 | 필터뱅크 기반 다중 반송파 무선 통신 시스템에서 패킷 전송 방법 및 장치 |
| KR102494080B1 (ko) * | 2016-06-01 | 2023-02-01 | 삼성전자 주식회사 | 전자 장치 및 전자 장치의 사운드 신호 보정 방법 |
| US11188292B1 (en) | 2019-04-03 | 2021-11-30 | Discovery Sound Technology, Llc | System and method for customized heterodyning of collected sounds from electromechanical equipment |
| CN110265042B (zh) * | 2019-05-31 | 2021-07-23 | 歌尔科技有限公司 | 声音信号处理方法、装置及设备 |
| CN110491407B (zh) * | 2019-08-15 | 2021-09-21 | 广州方硅信息技术有限公司 | 语音降噪的方法、装置、电子设备及存储介质 |
| US11965859B1 (en) | 2020-11-18 | 2024-04-23 | Discovery Sound Technology, Llc | System and method for empirical estimation of life remaining in industrial equipment |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6577739B1 (en) * | 1997-09-19 | 2003-06-10 | University Of Iowa Research Foundation | Apparatus and methods for proportional audio compression and frequency shifting |
| FR2822000B1 (fr) * | 2001-03-08 | 2003-05-23 | Thomson Multimedia Sa | Dispositif d'emission limitant les parasites hors de la bande de frequence allouee |
| EP1333700A3 (en) * | 2003-03-06 | 2003-09-17 | Phonak Ag | Method for frequency transposition in a hearing device and such a hearing device |
| AU2003904207A0 (en) | 2003-08-11 | 2003-08-21 | Vast Audio Pty Ltd | Enhancement of sound externalization and separation for hearing-impaired listeners: a spatial hearing-aid |
| AU2005333866B2 (en) * | 2005-06-27 | 2009-04-23 | Widex A/S | Hearing aid with enhanced high frequency reproduction and method for processing an audio signal |
| DE102006019728A1 (de) * | 2006-04-27 | 2007-11-15 | Siemens Audiologische Technik Gmbh | Zeit-adaptives Einstellen einer Hörhilfevorrichtung und entsprechendes Verfahren |
| DK2369859T3 (da) * | 2008-05-30 | 2017-03-13 | Sonova Ag | Metode til tilpasning af lyd i et høreapparat ved frekvensændring og en sådan en indretning / Method for adapting sound in a hearing aid device by frequency modification and such a device |
| FR2950497B1 (fr) * | 2009-09-24 | 2011-10-21 | Eutelsat Sa | Charge utile pour satellite multifaisceaux |
-
2010
- 2010-09-29 DE DE102010041653.3A patent/DE102010041653B4/de active Active
-
2011
- 2011-09-28 EP EP11183051.9A patent/EP2437258B1/de active Active
- 2011-09-28 DK DK11183051.9T patent/DK2437258T3/da active
- 2011-09-29 US US13/248,167 patent/US9031269B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| EP2437258A3 (de) | 2013-09-04 |
| DE102010041653B4 (de) | 2015-04-02 |
| US9031269B2 (en) | 2015-05-12 |
| DK2437258T3 (da) | 2016-02-15 |
| DE102010041653A1 (de) | 2012-03-29 |
| EP2437258A2 (de) | 2012-04-04 |
| US20120076333A1 (en) | 2012-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2437258B1 (de) | Verfahren und Vorrichtung zur Frequenzkompression mit selektiver Frequenzverschiebung | |
| EP2180726B2 (de) | Richtungshören bei binauraler Hörgeräteversorgung | |
| EP3926982B1 (de) | Verfahren zur richtungsabhängigen rauschunterdrückung für ein hörsystem, welches eine hörvorrichtung umfasst | |
| EP2229010A2 (de) | Verfahren zum Kompensieren eines Störschalls bei einer Hörvorrichtung, Hörvorrichtung und Verfahren zum Anpassen derselben | |
| EP2919485A1 (de) | Übertragung eines windreduzierten Signals mit verminderter Latenzzeit | |
| DE102011006129B4 (de) | Hörvorrichtung mit Rückkopplungsunterdrückungseinrichtung und Verfahren zum Betreiben der Hörvorrichtung | |
| EP1912470A2 (de) | Verfahren zur Dynamikkompression eines Audiosignals und entsprechende Hörvorrichtung | |
| EP2822300B1 (de) | Erkennen von Hörsituationen mit unterschiedlichen Signalquellen | |
| EP2437521B2 (de) | Verfahren zur Frequenzkompression mit harmonischer Korrektur und entsprechende Vorrichtung | |
| EP2606660B1 (de) | Verfahren zum anpassen einer hörvorrichtung mit perzentil-analyse | |
| DE102007035173A1 (de) | Verfahren zum Einstellen eines Hörsystems mit einem perzeptiven Modell für binaurales Hören und entsprechendes Hörsystem | |
| EP2190218B1 (de) | Filterbanksystem mit spezifischen Sperrdämpfungsanteilen für eine Hörvorrichtung | |
| DE102013207080A1 (de) | Binaurale Mikrofonanpassung mittels der eigenen Stimme | |
| EP2648424B1 (de) | Verfahren zur Ausgangspegelbegrenzung bei Hörvorrichtungen | |
| DE102014200677A1 (de) | Verfahren und Vorrichtung zur Analyse von Hörhilfeeinstellungen | |
| DE102011089865B4 (de) | Verfahren zum Anpassen einer Frequenzkompressionseinrichtung einer Hörvorrichtung und entsprechende Anpassungsvorrichtung | |
| EP2622879B1 (de) | Verfahren und vorrichtung zur frequenzkompression | |
| EP1909534A2 (de) | Hörvorrichtung mit unsymmetrischer Klangwaage und entsprechendes Einstellverfahren | |
| DE102010039303A1 (de) | Verfahren zum Reduzieren von Interferenzen und Hörvorrichtung | |
| DE102011087692B4 (de) | Hörvorrichtung und Verfahren zur Verbesserung der Wahrnehmbarkeit eines Anteils eines Eingangssignals für einen Benutzer der Hörvorrichtung | |
| EP2699020B1 (de) | Verfahren und Vorrichtung zum Bestimmen eines Verstärkungsfaktors eines Hörhilfegeräts | |
| WO2012041372A1 (de) | Verfahren zur frequenzkompression, anpasseinrichtung und hörvorrichtung | |
| EP2437522A1 (de) | Hörhilfegerät zur Frequenzkompression |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
| AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 21/00 20130101AFI20130730BHEP Ipc: H04R 25/00 20060101ALI20130730BHEP Ipc: G10L 19/02 20130101ALN20130730BHEP |
|
| 17P | Request for examination filed |
Effective date: 20140303 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| 17Q | First examination report despatched |
Effective date: 20140709 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101ALI20150423BHEP Ipc: G10L 19/02 20130101ALN20150423BHEP Ipc: G10L 21/00 20130101AFI20150423BHEP |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 25/00 20060101ALI20150429BHEP Ipc: G10L 19/02 20130101ALN20150429BHEP Ipc: G10L 21/00 20130101AFI20150429BHEP |
|
| INTG | Intention to grant announced |
Effective date: 20150519 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIVANTOS PTE. LTD. |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 760804 Country of ref document: AT Kind code of ref document: T Effective date: 20151215 Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502011008323 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20160209 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160211 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160311 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160211 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160311 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160212 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502011008323 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
| 26N | No opposition filed |
Effective date: 20160812 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160930 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160928 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160928 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 760804 Country of ref document: AT Kind code of ref document: T Effective date: 20160928 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20160930 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160928 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20110928 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151111 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240820 Year of fee payment: 14 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20240820 Year of fee payment: 14 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240820 Year of fee payment: 14 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240820 Year of fee payment: 14 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20241001 Year of fee payment: 14 |
|
| REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20250930 |