EP2437258A2 - Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif - Google Patents

Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif Download PDF

Info

Publication number
EP2437258A2
EP2437258A2 EP20110183051 EP11183051A EP2437258A2 EP 2437258 A2 EP2437258 A2 EP 2437258A2 EP 20110183051 EP20110183051 EP 20110183051 EP 11183051 A EP11183051 A EP 11183051A EP 2437258 A2 EP2437258 A2 EP 2437258A2
Authority
EP
European Patent Office
Prior art keywords
frequency
channel
channels
mapping
dominant
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20110183051
Other languages
German (de)
English (en)
Other versions
EP2437258A3 (fr
EP2437258B1 (fr
Inventor
Robert BÄUML
Ulrich Kornagel
Thomas Pilgrim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Siemens Medical Instruments Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Medical Instruments Pte Ltd filed Critical Siemens Medical Instruments Pte Ltd
Publication of EP2437258A2 publication Critical patent/EP2437258A2/fr
Publication of EP2437258A3 publication Critical patent/EP2437258A3/fr
Application granted granted Critical
Publication of EP2437258B1 publication Critical patent/EP2437258B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Electric hearing aids
    • H04R25/35Electric hearing aids using translation techniques
    • H04R25/353Frequency, e.g. frequency shift or compression
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition

Definitions

  • the present invention relates to a method of frequency-compressing an audio signal by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels.
  • the present invention relates to a corresponding device for frequency compression of an audio signal with a shifting device for shifting or mapping a portion of the audio signal.
  • the present invention also relates to a hearing device with such a device.
  • a hearing device is understood to mean any sound-emitting device that can be worn in or on the ear, such as a hearing aid, a headset, headphones and the like.
  • Hearing aids are portable hearing aids that are used to care for the hearing impaired.
  • hearing aids such as behind-the-ear hearing aids (BTE), Hearing Aid Receiver (RIC) and In-the-Ear Hearing Aids (Id0), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
  • BTE behind-the-ear hearing aids
  • RIC Hearing Aid Receiver
  • Id0 In-the-Ear Hearing Aids
  • ITE Canal hearing aids
  • the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
  • bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
  • Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic Receiver, e.g. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed.
  • a signal processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them.
  • the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
  • the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
  • the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
  • Hearing aids are essentially two common methods to increase speech intelligibility.
  • a frequency-dependent level compensation is generally performed by means of AGC (Automatic Game Control) in order to lift signals above the hearing threshold of the hearing impaired, so that he can perceive the signals again.
  • AGC Automatic Game Control
  • the second method is usually used in addition to the first and aims at hearing damage, in which even by pure amplification of the signal, the threshold of hearing in certain, typically high, frequencies can not be achieved. These high frequencies are mapped to a low (audible) frequency range so that they can be lifted above the threshold of hearing by amplification.
  • the method is called frequency compression because the desired frequency range is mapped to a smaller, more audible frequency range.
  • the method used uses properties of the filter bank used for easy implementation. It selectively copies individual channels, depending on their instantaneous power, to other channels, so that the frequency components contained in these channels, shifted at the output, reappear in a different frequency range. Where the channels are displayed determines a mapping rule and is adjustable, so that different compression ratios can be realized.
  • FIG. 2 shows the principle of frequency compression by simply copying channels.
  • the center frequency 14 is associated with a channel 14 '.
  • the frequency of the sound (dominant instantaneous frequency 11 "and 14") relative to the respective channel center within the source and destination channel is identical.
  • the object of the present invention is therefore to optimize the frequency compression of an audio signal to the effect that an improved hearing impression is created. It is a corresponding method and a corresponding device to propose.
  • this object is achieved by a method for frequency compression of an audio signal, by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, wherein a dominant instantaneous frequency in the first frequency Frequency channel is determined in the move or mapping first the entire first frequency channel including the dominant instantaneous frequency is shifted or imaged in the second frequency channel, wherein the dominant instantaneous frequency receives an intermediate frequency position, a final frequency position for the dominant instantaneous frequency by a predetermined compression characteristic in the second frequency channel is determined from the frequency position of the dominant instantaneous frequency in the first frequency channel and the dominant instantaneous frequency of the Zw frequency position is pushed or mapped to the final frequency position.
  • the invention provides a device for frequency compression of an audio signal with a first displacement device for shifting or imaging a portion of the audio signal provided in a plurality of frequency channels from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, and comprising estimating means for determining a dominant instantaneous frequency in the first frequency channel, wherein with the first displacement means the entire first frequency channel including the dominant instantaneous frequency in the second frequency channel being displaceable or mappable such that the dominant instantaneous frequency obtains an intermediate frequency position, computing means for determining a final frequency position for the dominant instantaneous frequency by a predetermined compression characteristic in the second frequency channel from the frequency position of the dominant instantaneous frequency in the second frequency channel first frequency channel, and second shifting means for shifting or mapping the dominant instantaneous frequency from the intermediate frequency position f is the final frequency position.
  • the shifting or mapping of the dominant instantaneous frequency from the intermediate frequency position to the final frequency position is accomplished by amplitude modulation.
  • the amplitude modulation corresponds to a multiplication of the signal with the modulation term exp (j * 2 ⁇ f * t). This in turn corresponds in the spectral range of a shift by the frequency .DELTA.f.
  • the second frequency channel for the displacement or mapping of the first frequency channel is fixed. In this way, calculation time can be saved in the channel shift.
  • the second frequency channel is for shifting or mapping the first frequency channel determined by the compression curve.
  • the second frequency channel for the displacement is not specified here, so that one or more frequency channels can be determined on the basis of the compression characteristic that comes into question for the second frequency channel.
  • the second frequency channel one of several possible frequency channels can be selected, in which the dominant instantaneous frequency is arranged closest to the respective channel center. In this way, artifacts, which can arise through the modulation avoid.
  • the frequency compression device may comprise a polyphase filter bank for providing the audio signal in a plurality of frequency channels. This makes it possible to generate only positive frequency components in the channels.
  • the device according to the invention is particularly advantageously used in a listening device and in particular in a hearing aid.
  • a frequency compression in hearing aid users can be realized with fewer artifacts.
  • FIG. 4 is a channel arrangement similar to FIG. 2 shown. There are several channels with the center frequencies 10 to 15 reproduced.
  • a displacement of the channel 14 'to the channel 11' is performed in a first step 17.
  • a tone or a dominant instantaneous frequency 14 " which becomes, as in connection with FIG. 2 already explained, here too in the first step 17, shifted from a frequency position f s to the intermediate frequency position f z .
  • the distance of the intermediate frequency position f z to the channel center 11 of the second channel 11 ' corresponds to the distance of the frequency position f s of the original instantaneous frequency 14 "relative to the channel center 14 of the source channel or first channel 14'.
  • the first step 17 of the frequency shift represents only a coarse channel-by-channel shift. It is unlikely that the tone 14 "will actually land at a frequency position that results directly from a frequency compression characteristic
  • FIG. 4 is a frequency position f d on which the sound 14 "would actually land if the image is taken with a predetermined compression characteristic, therefore, the aim of the present invention is to perform a further shift step after the first step 17 in order to produce the shifted sound 11". to shift to the final frequency position f d , so that the target tone 18 results.
  • the shifted tone 11 is shifted by amplitude modulation in a second step 19.
  • the shifting takes place here by the amount ⁇ f.
  • the tone is thus shifted to its final position f d .
  • first frequency channel 14 ' a specific frequency range
  • second frequency channel 11' another range
  • the dominant instantaneous frequency can be accurately modulated where it is expected according to the mapping characteristic.
  • this method can be used in a polyphase filter bank which generates only the complex-valued, analytical signal (only positive frequency component of a Fourier transformation) in the channels.
  • the method can be applied regardless of the tonality of the channel, as there are no negative effects to be feared in noisy proportions.
  • FIG. 5 shows the measurement result of the frequency compression according to the invention.
  • the output frequency f o and in the abscissa the input frequency f i shown.
  • a frequency sweep is applied to the input.
  • the modulation in the target channel creates a continuous frequency response.
  • the assignment of source frequency to target frequency is referred to as a compression characteristic. So there are no more frequency jumps and thus no related artifacts.
  • mapping rule from source to target frequency must be provided by appropriate means of audiology.
  • a mapping can typically be made on the basis of a Bark ERB or Spinc frequency division, as in the document EP 1 333 700 A2 is described.
  • FIG. 6 shows a block diagram of a possible embodiment of a frequency compression device according to the invention.
  • the instantaneous source frequency f s is estimated by an estimator 21.
  • each target channel 22, 22' is estimated.
  • the assignment scheme may either be fixed, ie a fixed selection of the source channels 20, 20', 20 "will be assigned to a single destination channel, or variable, ie dependent on the frequency estimate and the compression characteristic is determined for each source channel 20, 20 ', 20 ", to which destination channel 22, 22', 22" it is assigned.
  • the signal from the selected source channel is modulated by a modulator 24 by means of amplitude modulation such that the mapping of source frequency to target frequency exactly corresponds to the compression characteristic.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)
EP11183051.9A 2010-09-29 2011-09-28 Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif Active EP2437258B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102010041653.3A DE102010041653B4 (de) 2010-09-29 2010-09-29 Verfahren und Vorrichtung zur Frequenzkompression mit selektiver Frequenzverschiebung

Publications (3)

Publication Number Publication Date
EP2437258A2 true EP2437258A2 (fr) 2012-04-04
EP2437258A3 EP2437258A3 (fr) 2013-09-04
EP2437258B1 EP2437258B1 (fr) 2015-11-11

Family

ID=44720711

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11183051.9A Active EP2437258B1 (fr) 2010-09-29 2011-09-28 Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif

Country Status (4)

Country Link
US (1) US9031269B2 (fr)
EP (1) EP2437258B1 (fr)
DE (1) DE102010041653B4 (fr)
DK (1) DK2437258T3 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI504282B (zh) * 2012-07-20 2015-10-11 Unlimiter Mfa Co Ltd 增加聽障者聽到聲音正確性之方法及助聽器
US9084050B2 (en) * 2013-07-12 2015-07-14 Elwha Llc Systems and methods for remapping an audio range to a human perceivable range
TWI543634B (zh) * 2013-12-10 2016-07-21 元鼎音訊股份有限公司 處理聲音段之方法及其電腦程式產品及助聽器
KR102308541B1 (ko) * 2015-01-16 2021-10-05 삼성전자주식회사 필터뱅크 기반 다중 반송파 무선 통신 시스템에서 패킷 전송 방법 및 장치
KR102494080B1 (ko) * 2016-06-01 2023-02-01 삼성전자 주식회사 전자 장치 및 전자 장치의 사운드 신호 보정 방법
US11188292B1 (en) 2019-04-03 2021-11-30 Discovery Sound Technology, Llc System and method for customized heterodyning of collected sounds from electromechanical equipment
CN110265042B (zh) * 2019-05-31 2021-07-23 歌尔科技有限公司 声音信号处理方法、装置及设备
CN110491407B (zh) * 2019-08-15 2021-09-21 广州方硅信息技术有限公司 语音降噪的方法、装置、电子设备及存储介质
US11965859B1 (en) 2020-11-18 2024-04-23 Discovery Sound Technology, Llc System and method for empirical estimation of life remaining in industrial equipment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1333700A2 (fr) 2003-03-06 2003-08-06 Phonak Ag Procédé de transposition de fréquence dans une prothèse auditive et une telle prothèse auditive

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6577739B1 (en) * 1997-09-19 2003-06-10 University Of Iowa Research Foundation Apparatus and methods for proportional audio compression and frequency shifting
FR2822000B1 (fr) * 2001-03-08 2003-05-23 Thomson Multimedia Sa Dispositif d'emission limitant les parasites hors de la bande de frequence allouee
AU2003904207A0 (en) 2003-08-11 2003-08-21 Vast Audio Pty Ltd Enhancement of sound externalization and separation for hearing-impaired listeners: a spatial hearing-aid
AU2005333866B2 (en) * 2005-06-27 2009-04-23 Widex A/S Hearing aid with enhanced high frequency reproduction and method for processing an audio signal
DE102006019728A1 (de) * 2006-04-27 2007-11-15 Siemens Audiologische Technik Gmbh Zeit-adaptives Einstellen einer Hörhilfevorrichtung und entsprechendes Verfahren
DK2369859T3 (en) * 2008-05-30 2017-03-13 Sonova Ag Method of adapting sound in a hearing aid by frequency change and such a device / Method of adapting sound in a hearing aid device by frequency modification and such a device
FR2950497B1 (fr) * 2009-09-24 2011-10-21 Eutelsat Sa Charge utile pour satellite multifaisceaux

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1333700A2 (fr) 2003-03-06 2003-08-06 Phonak Ag Procédé de transposition de fréquence dans une prothèse auditive et une telle prothèse auditive

Also Published As

Publication number Publication date
EP2437258A3 (fr) 2013-09-04
DE102010041653B4 (de) 2015-04-02
US9031269B2 (en) 2015-05-12
DK2437258T3 (da) 2016-02-15
DE102010041653A1 (de) 2012-03-29
EP2437258B1 (fr) 2015-11-11
US20120076333A1 (en) 2012-03-29

Similar Documents

Publication Publication Date Title
EP2437258B1 (fr) Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif
EP2180726B2 (fr) Localisation du son avec des prothèses auditives binauriculaires
EP2919485B1 (fr) Transmission d'un signal à bruits de vent réduits à temps de latence diminué
DE102011006129B4 (de) Hörvorrichtung mit Rückkopplungsunterdrückungseinrichtung und Verfahren zum Betreiben der Hörvorrichtung
EP3926982A2 (fr) Procédé de réduction directionnelle du bruit pour un système auditif comprenant un dispositif auditif
EP1912470B1 (fr) Procédé pour la compression dynamique d'un signal audio et appareil auditif correspondant
DE102014218672B3 (de) Verfahren und Vorrichtung zur Rückkopplungsunterdrückung
EP2822300B1 (fr) Reconnaissance de situations d'écoute à l'aide de différentes sources de signal
EP2437521B1 (fr) Procédé de compression fréquentielle à l'aide d'une correction harmonique et dispositif correspondant
EP2373063A1 (fr) Dispositif auditif et procédé de réglage de celui-ci pour un fonctionnement sans contre-réaction
EP2606660B1 (fr) Procédé d'adaptation d'un appareil auditif
DE102007008739A1 (de) Hörvorrichtung mit Störsignaltrennung und entsprechendes Verfahren
DE102007035173A1 (de) Verfahren zum Einstellen eines Hörsystems mit einem perzeptiven Modell für binaurales Hören und entsprechendes Hörsystem
DE102013111295A1 (de) Vorrichtung zum Vergleichstest von Hörgeräten
EP2190218B1 (fr) Système d'ensemble de filtres avec atténuation de bande affaiblie spécifique pour un dispositif auditif
DE102014200677A1 (de) Verfahren und Vorrichtung zur Analyse von Hörhilfeeinstellungen
DE102007030067B4 (de) Hörgerät mit passiver, eingangspegelabhängiger Geräuschreduktion und Verfahren
DE102006046699B3 (de) Hörvorrichtung mit unsymmetrischer Klangwaage und entsprechendes Einstellverfahren
EP2622879B1 (fr) Procédé et dispositif de compression de fréquence
DE102010039303A1 (de) Verfahren zum Reduzieren von Interferenzen und Hörvorrichtung
EP4404591A1 (fr) Système auditif binaural comportant deux instruments auditifs ainsi que procédé de fonctionnement d'un tel système auditif
DE102011087692B4 (de) Hörvorrichtung und Verfahren zur Verbesserung der Wahrnehmbarkeit eines Anteils eines Eingangssignals für einen Benutzer der Hörvorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 21/00 20130101AFI20130730BHEP

Ipc: H04R 25/00 20060101ALI20130730BHEP

Ipc: G10L 19/02 20130101ALN20130730BHEP

17P Request for examination filed

Effective date: 20140303

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20140709

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101ALI20150423BHEP

Ipc: G10L 19/02 20130101ALN20150423BHEP

Ipc: G10L 21/00 20130101AFI20150423BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101ALI20150429BHEP

Ipc: G10L 19/02 20130101ALN20150429BHEP

Ipc: G10L 21/00 20130101AFI20150429BHEP

INTG Intention to grant announced

Effective date: 20150519

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 760804

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151215

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502011008323

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160209

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160211

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502011008323

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

26N No opposition filed

Effective date: 20160812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 760804

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160928

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20110928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240820

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20240820

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240820

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240820

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20241001

Year of fee payment: 14

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20250930