EP0669606B1 - Verfahren zur Geräuschreduktion eines gestörten Sprachsignals - Google Patents
Verfahren zur Geräuschreduktion eines gestörten Sprachsignals Download PDFInfo
- Publication number
- EP0669606B1 EP0669606B1 EP95101977A EP95101977A EP0669606B1 EP 0669606 B1 EP0669606 B1 EP 0669606B1 EP 95101977 A EP95101977 A EP 95101977A EP 95101977 A EP95101977 A EP 95101977A EP 0669606 B1 EP0669606 B1 EP 0669606B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- speech
- median
- median filtering
- signal
- noise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000009467 reduction Effects 0.000 title claims description 12
- 238000001914 filtration Methods 0.000 claims abstract description 44
- 230000003595 spectral effect Effects 0.000 claims abstract description 33
- 238000012546 transfer Methods 0.000 claims abstract description 19
- 238000001228 spectrum Methods 0.000 claims abstract description 16
- 230000000694 effects Effects 0.000 claims description 11
- 230000008569 process Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 12
- 230000002123 temporal effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000013016 damping Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000009499 grossing Methods 0.000 description 3
- 230000001629 suppression Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000011410 subtraction method Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
Definitions
- the invention relates to a method for noise reduction a disturbed speech signal using the spectral Subtraction.
- Noise reduction using the spectral subtraction method is used in automatic speech recognition or with hands-free systems to improve the Speech quality, e.g. when calling from the motor vehicle.
- the noise reduction by spectral subtraction draws is characterized by the fact that relatively stationary Interference can typically be reduced by approx. 10dB, without additional information about the fault is needed. Only the disturbed voice channel is required.
- the speech signal is divided into short overlapping time segments divided and processed segment by segment.
- Estimate of the fault is subtracted in the spectral range.
- the spectral subtraction can be implemented in different ways, but is usually used as a multiplicative filter implemented in the frequency domain. This spectral subtraction shows the unwanted side effect of a musical Residual noise, the "musical tones" and a speech distortion.
- the object of the present invention is a method to indicate the noise reduction of a disturbed speech signal, which with high speech quality of the output signal a strong reduction in noise, in particular the "musical tones" also makes it possible.
- Median filtering has proven to be an advantageous method for further substantially improving the spectral subtraction method for reducing the noise of a disturbed speech signal.
- the median filtering can be applied both to the magnitude spectrum of the disturbed input signal or the noise-reduced output signal after spectral subtraction and to the transfer function determined from the application of a transfer characteristic and can be carried out in the time direction or in the frequency direction.
- the magnitude spectrum of the speech signal is composed of a sequence of segment spectra in accordance with the segmentation of the speech time signal.
- the transfer function is represented by the time and frequency discrete values K i, l (for example, equation (3)). A combination of different of these procedures can also be advantageous.
- a preferred method provides, in speech pauses by using median filtering, preferably in the temporal direction, to preserve the natural impression of a weak background noise on the transmission function, and during speech activity by applying median filtering to the range of magnitudes of the speech signal to strongly suppress the "musical tones" to reach.
- the separate detection of speech pauses and speech activity is provided and known in any case for determining an average noise signal during speech pauses, so that no special effort is required for this.
- the methods according to the invention are easy to implement.
- Median filtering is also used to process speech signals already known. For example, in DE 32 43 231 Al and DE 32 43 232 A1 a median filter on successive Short-term averages, which are a measure of the represent average power of speech signal sections, applied as a smoothing filter. By comparing the smoothed Values following a threshold become speech pauses recognized. This eliminates interference from the speech signal not instead.
- FIG. 1 shows an example of an input signal E and a output signal filtered with a median filter of length 3 A.
- the median filter first sorts the values within of the data window F and then gives the average value med out.
- the median filter hides short signal peaks, but receives the remaining signal edges.
- the filtering on the amount is the filtering on the amount square basically equivalent.
- the following noise example was used: vehicle interior noise at 140km / h, 12kHz sampling frequency, segment length 512 Values, the last 256 values of each segment become zero are set, the first 256 values of each segment are marked with Hanning window multiplied, segments are half overlapped, i.e. a new segment every 10.67ms.
- FIG. 2 first shows the frequency (linear 0 to 6kHz) the spectrum for 4 successive segments (Time interval 10.67ms, index 1) and then above the Time (0 to 2.5sec) the waveform for 4 consecutive discrete frequencies (index i), representative for all 256 frequencies. It shows up as a typical property the "musical tones" that the course over frequency has relatively extensive disturbances (broad impulses), whereas the course over time is strongly impulsive Character (narrow impulses). Exactly the impulsive Median filtering makes character in the temporal direction particularly effective here. An impulsive The fault is deleted. For impulsive disturbances with wider pulses is a larger window length of the median filter required.
- the median filter can also be used instead of the output signal Input signal, performed before spectral subtraction become. Ideally, this will not result in any "musical tones ", which are otherwise generated by post-filtering be solved with the median filter.
- the median filtering on the input signal can be advantageous if "musical tones" the various processing steps implemented in the spectral subtraction filter (except the characteristic function). It should go on not on possible advantages or disadvantages of median filtering be received at the input or output signal. in the In principle, both possibilities are given and of special ones Cases of implementation apart from being equivalent.
- the median filter can be used instead of the magnitude spectrum Speech signal also performed on the transfer function K. become.
- FIG. 4 shows the transfer function K over time and over frequency. The same section is shown as in FIG. 2.
- the transfer function shows a similar one Behavior like the output signal in FIG. 2nd
- FIG. 5 shows that in the time direction with the 3-fold median filtered transfer function. The is shown same section as in FIG. 3. Here too is the median filtering in time from the same Reasons like the output signal extremely effective.
- An input signal with a pulse-like disturbance caused the corresponding pulse-like change in the transfer function.
- the spectrum of the Input signal is with the transfer function multiplied.
- the pulse-like disturbance becomes additional is now increasingly audible as a "musical tone".
- the pulse-suppressing property of median filtering affects the increased impulse disturbance particularly clearly and thus the "musical tones".
- the median filtering has a repairing effect on the impulsive disturbance.
- the median filtering on the magnitude spectrum of the input or Output signal indicates compared to the median filtering the transfer values the higher gain in suppression of impulsive disturbances, but can also particularly noticeable in speech pauses as unnatural perceived changes while median filtering the transmission values in speech pauses essentially leads to a pure attenuation of the signal sounds quieter but natural. Ideally, none arise "musical tones".
- a preferred embodiment of the invention takes advantage of this by using median filtering in the case of language activity on the range of amounts and during language breaks is carried out on the transfer values. The required Speech-pause decision stands with the spectral Subtraction is available anyway since the formation of the noise estimate only carried out during language breaks becomes.
- the window length as given in the example equal to the minimum median window length 3. Larger window lengths lead in this case to further suppress the "musical tones", possibly but also to a leveling felt as unnatural of the speech signal.
- the preferred window length is therefore 3 as indicated by way of example. For shorter ones Segments can have a larger window length when median filtering be appropriate.
- the one from the window of temporal Median filtering covered time interval should however be 50ms do not exceed.
- the Window length of the median filter at the data segment length For filtering in the frequency direction, the Window length of the median filter at the data segment length.
- the data segment length should be numerically described Example is less than 64, the median filter is not greater than 5.
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Noise Elimination (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
- Interconnected Communication Systems, Intercoms, And Interphones (AREA)
Description
- S and:
- geschätztes Ausgangssignal
- K:
- Übertragungsfunktion
- Y:
- gestörtes Sprachsignal
- S:
- Sprachsignal
- N:
- Störgeräusch
- b:
- Hintergrundrestgeräusch (spectral floor)
- a:
- Überschätzfaktor (overestimate)
- N and2:
- in Sprachpausen geschätzte Störung
- i:
- Frequenzindex
- l:
- Zeitindex des Segments
Claims (11)
- Verfahren zur Geräuschreduktion eines gestörten Sprachsignals mit Hilfe der spektralen Subtraktion, dadurch gekennzeichnet. daß das Betragsspektrum des Sprachsignals einer Medianfilterung unterzogen wird.
- Verfahren nach Anspruch 1, dadurch gekennzeichnet, daß die Medianfilterung auf das Betragsspektrum des gestörten Eingangssignals angewandt wird.
- Verfahren nach einem der Ansprüche 1 und 2, dadurch gekennzeichnet, daß die Medianfilterung auf das Betragsspektrum des Ausgangssignals der spektralen Subtraktion angewandt wird.
- Verfahren zur Geräuschreduktion eines gestörten Sprachsignals mit Hilfe der spektralen Subtraktion, wobei aus einer vorgebbaren Übertragungskennlinie eine Übertragungsfunktion für die spektrale Subtraktion bestimmt wird, dadurch gekennzeichnet, daß die Übertragungsfunktion einer Medianfilterung unterzogen werden.
- Verfahren zur Geräuschreduktion eines gestörten Sprachsignals mit einer Kombination der Merkmale aus Anspruch 4 und aus einem der Ansprüche 1 bis 3.
- Verfahren nach Anspruch 5, dadurch gekennzeichnet, daß die Medianfilterung in Sprachpausen auf die Übertragungswerte und bei Sprachaktivität auf das Betragsspektrum des Sprachsignals angewandt wird.
- Verfahren nach einem der Ansprüche 1 bis 6, dadurch gekennzeichnet, daß die Medianfilterung in zeitlicher Richtung angewandt wird.
- Verfahren nach Anspruch 7, dadurch gekennzeichnet, daß die Fensterlänge des Medianfilters drei aufeinanderfolgende Zeitsegmente umfaßt.
- Verfahren nach Anspruch 7 oder Anspruch 8, dadurch gekennzeichnet, daß die Fensterlänge des Medianfilters kleiner als 50ms ist.
- Verfahren nach einem der Ansprüche 1 bis 6, dadurch gekennzeichnet, daß die Medianfilterung in Frequenzrichtung angewandt wird.
- Verfahren nach Anspruch 10, dadurch gekennzeichnet, daß die Fensterlänge des Medianfilters nicht mehr als 5 Frequenzwerte umfaßt.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE4405723A DE4405723A1 (de) | 1994-02-23 | 1994-02-23 | Verfahren zur Geräuschreduktion eines gestörten Sprachsignals |
| DE4405723 | 1994-02-23 |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP0669606A2 EP0669606A2 (de) | 1995-08-30 |
| EP0669606A3 EP0669606A3 (de) | 1995-10-25 |
| EP0669606B1 true EP0669606B1 (de) | 1999-09-22 |
Family
ID=6510930
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP95101977A Expired - Lifetime EP0669606B1 (de) | 1994-02-23 | 1995-02-14 | Verfahren zur Geräuschreduktion eines gestörten Sprachsignals |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP0669606B1 (de) |
| AT (1) | ATE185014T1 (de) |
| DE (2) | DE4405723A1 (de) |
| ES (1) | ES2138669T3 (de) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012098261A2 (de) | 2011-01-21 | 2012-07-26 | Behr Gmbh & Co. Kg | Kältemittelkondensatorbaugruppe |
| US8712076B2 (en) | 2012-02-08 | 2014-04-29 | Dolby Laboratories Licensing Corporation | Post-processing including median filtering of noise suppression gains |
| US9173025B2 (en) | 2012-02-08 | 2015-10-27 | Dolby Laboratories Licensing Corporation | Combined suppression of noise, echo, and out-of-location signals |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3484757B2 (ja) * | 1994-05-13 | 2004-01-06 | ソニー株式会社 | 音声信号の雑音低減方法及び雑音区間検出方法 |
| DE19629132A1 (de) * | 1996-07-19 | 1998-01-22 | Daimler Benz Ag | Verfahren zur Verringerung von Störungen eines Sprachsignals |
| EP1366617B1 (de) | 2001-03-07 | 2005-08-03 | T-Mobile Deutschland GmbH | Verfahren und vorrichtung zur verbesserung der sprachqualität auf transparenten telekommunikations-übertragungswegen |
| DE10136491B4 (de) * | 2001-03-07 | 2004-11-25 | T-Mobile Deutschland Gmbh | Verfahren und Vorrichtung zur Verbesserung der Sprachqualität auf transparenten Telekommunikations-Übertragungswegen |
| DE10311587A1 (de) * | 2003-03-14 | 2004-09-23 | Volkswagen Ag | Verfahren und Vorrichtung zum Freisprechen in einem Kraftfahrzeug |
| WO2012109384A1 (en) * | 2011-02-10 | 2012-08-16 | Dolby Laboratories Licensing Corporation | Combined suppression of noise and out - of - location signals |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS58196595A (ja) * | 1982-05-12 | 1983-11-16 | 日本電気株式会社 | パタ−ン特徴抽出装置 |
| DE3243231A1 (de) * | 1982-11-23 | 1984-05-24 | Philips Kommunikations Industrie AG, 8500 Nürnberg | Verfahren zur erkennung von sprachpausen |
| DE3243232A1 (de) * | 1982-11-23 | 1984-05-24 | Philips Kommunikations Industrie AG, 8500 Nürnberg | Verfahren zur erkennung von sprachpausen |
| US4682230A (en) * | 1986-03-21 | 1987-07-21 | Rca Corporation | Adaptive median filter system |
| DE4229577A1 (de) * | 1992-09-04 | 1994-03-10 | Daimler Benz Ag | Verfahren zur Spracherkennung mit dem eine Anpassung von Mikrofon- und Sprachcharakteristiken erreicht wird |
-
1994
- 1994-02-23 DE DE4405723A patent/DE4405723A1/de not_active Withdrawn
-
1995
- 1995-02-14 ES ES95101977T patent/ES2138669T3/es not_active Expired - Lifetime
- 1995-02-14 DE DE59506864T patent/DE59506864D1/de not_active Expired - Lifetime
- 1995-02-14 AT AT95101977T patent/ATE185014T1/de active
- 1995-02-14 EP EP95101977A patent/EP0669606B1/de not_active Expired - Lifetime
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012098261A2 (de) | 2011-01-21 | 2012-07-26 | Behr Gmbh & Co. Kg | Kältemittelkondensatorbaugruppe |
| US8712076B2 (en) | 2012-02-08 | 2014-04-29 | Dolby Laboratories Licensing Corporation | Post-processing including median filtering of noise suppression gains |
| US9173025B2 (en) | 2012-02-08 | 2015-10-27 | Dolby Laboratories Licensing Corporation | Combined suppression of noise, echo, and out-of-location signals |
Also Published As
| Publication number | Publication date |
|---|---|
| ES2138669T3 (es) | 2000-01-16 |
| EP0669606A3 (de) | 1995-10-25 |
| DE59506864D1 (de) | 1999-10-28 |
| EP0669606A2 (de) | 1995-08-30 |
| ATE185014T1 (de) | 1999-10-15 |
| DE4405723A1 (de) | 1995-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP0912974B1 (de) | Verfahren zur verringerung von störungen eines sprachsignals | |
| DE19747885B4 (de) | Verfahren zur Reduktion von Störungen akustischer Signale mittels der adaptiven Filter-Methode der spektralen Subtraktion | |
| DE69627580T2 (de) | Verfahren zur Rauschverminderung in einem Sprachsignal | |
| DE60131639T2 (de) | Vorrichtungen und Verfahren zur Bestimmung von Leistungswerten für die Geräuschunterdrückung für ein Sprachkommunikationssystem | |
| DE3752288T2 (de) | Sprachprozessor | |
| DE69420027T2 (de) | Rauschverminderung | |
| DE69531710T2 (de) | Verfahren und Vorrichtung zur Verminderung von Rauschen bei Sprachsignalen | |
| DE112011104737B4 (de) | Geräuschunterdrückungsvorrichtung | |
| DE112017007005B4 (de) | Akustiksignal-verarbeitungsvorrichtung, akustiksignalverarbeitungsverfahren und freisprech-kommunikationsvorrichtung | |
| EP0668007B1 (de) | Mobilfunkgerät mit freisprecheinrichtung | |
| DE69616724T2 (de) | Verfahren und System für die Spracherkennung | |
| EP1386307B1 (de) | Verfahren und vorrichtung zur bestimmung eines qualitätsmasses eines audiosignals | |
| DE4243831A1 (de) | Verfahren zur Laufzeitschätzung an gestörten Sprachkanälen | |
| DE112011106045B4 (de) | Audiosignal-Wiederherstellungsvorrichtung und Audiosignal-Wiederherstellungsverfahren | |
| EP0669606B1 (de) | Verfahren zur Geräuschreduktion eines gestörten Sprachsignals | |
| DE69130687T2 (de) | Sprachsignalverarbeitungsvorrichtung zum Herausschneiden von einem Sprachsignal aus einem verrauschten Sprachsignal | |
| EP2080197B1 (de) | Vorrichtung zur geräuschunterdrückung bei einem audiosignal | |
| EP1155561B1 (de) | Vorrichtung und verfahren zur geräuschunterdrückung in fernsprecheinrichtungen | |
| EP0623995A1 (de) | Anordnung zur geräuschabhängigen Regelung der Lautstärke eines Autoradios | |
| DE3733983A1 (de) | Verfahren zum daempfen von stoerschall in von hoergeraeten uebertragenen schallsignalen | |
| DE102013011761A1 (de) | Kraftfahrzeug mit einer Freisprecheinrichtung und Verfahren zur Erzeugung eines Frequenzganges für Freisprecheinrichtungen | |
| DE10137348A1 (de) | Verfahren und Schaltungsanordnung zur Geräuschreduktion bei der Sprachübertragung in Kommunikationssystemen | |
| DE10157535A1 (de) | Verfahren und Vorrichtung zur Reduzierung zufälliger, kontinuierlicher, instationärer Störungen in Audiosignalen | |
| DE3230391C2 (de) | ||
| DE69423703T2 (de) | Rauschunterdrückungseinrichtung zur Vorverarbeitung und/oder Nachbearbeitung von Sprachsignalen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT CH DE ES FR GB IT LI NL |
|
| PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
| AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT CH DE ES FR GB IT LI NL |
|
| 17P | Request for examination filed |
Effective date: 19951117 |
|
| GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
| 17Q | First examination report despatched |
Effective date: 19981112 |
|
| GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
| GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
| GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: DAIMLERCHRYSLER AG |
|
| GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT CH DE ES FR GB IT LI NL |
|
| REF | Corresponds to: |
Ref document number: 185014 Country of ref document: AT Date of ref document: 19991015 Kind code of ref document: T |
|
| ITF | It: translation for a ep patent filed | ||
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: KIRKER & CIE SA Ref country code: CH Ref legal event code: EP |
|
| REF | Corresponds to: |
Ref document number: 59506864 Country of ref document: DE Date of ref document: 19991028 |
|
| ET | Fr: translation filed | ||
| REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2138669 Country of ref document: ES Kind code of ref document: T3 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed | ||
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PUE Owner name: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH Free format text: DAIMLERCHRYSLER AG#EPPLESTRASSE 225#70567 STUTTGART (DE) -TRANSFER TO- HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH#BECKER-GOERING-STRASSE 16#76307 KARLSBAD (DE) |
|
| NLS | Nl: assignments of ep-patents |
Owner name: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH Effective date: 20050630 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20110228 Year of fee payment: 17 Ref country code: CH Payment date: 20110223 Year of fee payment: 17 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 59506864 Country of ref document: DE Representative=s name: GRUENECKER, KINKELDEY, STOCKMAIR & SCHWANHAEUS, DE |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 59506864 Country of ref document: DE Representative=s name: GRUENECKER, KINKELDEY, STOCKMAIR & SCHWANHAEUS, DE Effective date: 20120411 Ref country code: DE Ref legal event code: R081 Ref document number: 59506864 Country of ref document: DE Owner name: NUANCE COMMUNICATIONS, INC. (N.D.GES.D. STAATE, US Free format text: FORMER OWNER: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH, 76307 KARLSBAD, DE Effective date: 20120411 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: V1 Effective date: 20120901 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Owner name: NUANCE COMMUNICATIONS, INC., US Effective date: 20120924 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120229 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120229 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120901 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20140113 Year of fee payment: 20 Ref country code: IT Payment date: 20140213 Year of fee payment: 20 Ref country code: FR Payment date: 20140211 Year of fee payment: 20 Ref country code: AT Payment date: 20140128 Year of fee payment: 20 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20140212 Year of fee payment: 20 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20140417 Year of fee payment: 20 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 59506864 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20150213 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK07 Ref document number: 185014 Country of ref document: AT Kind code of ref document: T Effective date: 20150214 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20150213 |
|
| REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20150826 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20150215 |