EP4254408A4 - Speech processing method and apparatus, and apparatus for processing speech - Google Patents

Speech processing method and apparatus, and apparatus for processing speech Download PDF

Info

Publication number
EP4254408A4
EP4254408A4 EP21896310.6A EP21896310A EP4254408A4 EP 4254408 A4 EP4254408 A4 EP 4254408A4 EP 21896310 A EP21896310 A EP 21896310A EP 4254408 A4 EP4254408 A4 EP 4254408A4
Authority
EP
European Patent Office
Prior art keywords
speech
processing
processing method
speech processing
processing speech
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP21896310.6A
Other languages
German (de)
French (fr)
Other versions
EP4254408A1 (en
EP4254408B1 (en
Inventor
Yun Liu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sogou Technology Development Co Ltd
Original Assignee
Beijing Sogou Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sogou Technology Development Co Ltd filed Critical Beijing Sogou Technology Development Co Ltd
Publication of EP4254408A1 publication Critical patent/EP4254408A1/en
Publication of EP4254408A4 publication Critical patent/EP4254408A4/en
Application granted granted Critical
Publication of EP4254408B1 publication Critical patent/EP4254408B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L21/0232—Processing in the frequency domain
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/27—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique
    • G10L25/30—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique using neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
EP21896310.6A 2020-11-27 2021-06-29 Speech processing method and apparatus, and apparatus for processing speech Active EP4254408B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011365146.8A CN114566180A (en) 2020-11-27 2020-11-27 Voice processing method and device for processing voice
PCT/CN2021/103220 WO2022110802A1 (en) 2020-11-27 2021-06-29 Speech processing method and apparatus, and apparatus for processing speech

Publications (3)

Publication Number Publication Date
EP4254408A1 EP4254408A1 (en) 2023-10-04
EP4254408A4 true EP4254408A4 (en) 2024-05-01
EP4254408B1 EP4254408B1 (en) 2025-10-01

Family

ID=81712330

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21896310.6A Active EP4254408B1 (en) 2020-11-27 2021-06-29 Speech processing method and apparatus, and apparatus for processing speech

Country Status (4)

Country Link
US (1) US20230253003A1 (en)
EP (1) EP4254408B1 (en)
CN (1) CN114566180A (en)
WO (1) WO2022110802A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3996035B1 (en) * 2020-11-05 2025-07-23 Leica Microsystems CMS GmbH Methods and systems for training convolutional neural networks
CN115101084A (en) * 2022-06-21 2022-09-23 北京达佳互联信息技术有限公司 Model training method, audio processing method, device, sound box, equipment and medium
CN115622626B (en) 2022-12-20 2023-03-21 山东省科学院激光研究所 Distributed sound wave sensing voice information recognition system and method
CN116153282B (en) * 2023-01-13 2026-04-14 全时云商务服务股份有限公司 Single-channel voice noise reduction method and device
CN116524942B (en) * 2023-05-25 2026-04-21 厦门亿联网络技术股份有限公司 A speech enhancement method, apparatus, terminal device, and storage medium
CN116755092B (en) * 2023-08-17 2023-11-07 中国人民解放军战略支援部队航天工程大学 Radar imaging translational compensation method based on complex domain long-short-term memory network
CN117676185B (en) * 2023-12-05 2025-09-30 无锡中感微电子股份有限公司 Method, device and related equipment for compensating audio data packet loss
CN117711417B (en) * 2024-02-05 2024-04-30 武汉大学 Voice quality enhancement method and system based on frequency domain self-attention network
CN118038883A (en) * 2024-03-21 2024-05-14 北京字跳网络技术有限公司 Audio repair method, device, program, medium and equipment
CN121148407A (en) * 2025-10-28 2025-12-16 中国传媒大学 A real-time speech denoising method and system based on deep neural networks

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9100735B1 (en) * 2011-02-10 2015-08-04 Dolby Laboratories Licensing Corporation Vector noise cancellation
US10283140B1 (en) * 2018-01-12 2019-05-07 Alibaba Group Holding Limited Enhancing audio signals using sub-band deep neural networks
KR102460676B1 (en) * 2019-05-07 2022-10-31 한국전자통신연구원 Apparatus and method for speech processing using a densely connected hybrid neural network
CN110739002B (en) * 2019-10-16 2022-02-22 中山大学 Complex domain speech enhancement method, system and medium based on generation countermeasure network
CN110808063A (en) * 2019-11-29 2020-02-18 北京搜狗科技发展有限公司 Voice processing method and device for processing voice
CN111081268A (en) * 2019-12-18 2020-04-28 浙江大学 A Phase-Correlated Shared Deep Convolutional Neural Network Speech Enhancement Method
CN111508518B (en) * 2020-05-18 2022-05-13 中国科学技术大学 Single-channel speech enhancement method based on joint dictionary learning and sparse representation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
See also references of WO2022110802A1 *
XIAOFEI LI ET AL: "Narrow-band Deep Filtering for Multichannel Speech Enhancement", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 23 September 2020 (2020-09-23), XP081768060 *
YANXIN HU ET AL: "DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 23 September 2020 (2020-09-23), XP081769171 *

Also Published As

Publication number Publication date
WO2022110802A1 (en) 2022-06-02
CN114566180A (en) 2022-05-31
EP4254408A1 (en) 2023-10-04
US20230253003A1 (en) 2023-08-10
EP4254408B1 (en) 2025-10-01

Similar Documents

Publication Publication Date Title
EP4254408A4 (en) Speech processing method and apparatus, and apparatus for processing speech
EP4336490A4 (en) Voice processing method and related device
EP4224733A4 (en) Beam processing method and apparatus, and related device
EP4216045A4 (en) Operation method and apparatus
EP4099648A4 (en) Method for processing segment id, and apparatus
EP4333390A4 (en) Packet processing method, apparatus and system
EP4250807A4 (en) Beam processing method and apparatus, and communication device
EP4135338A4 (en) Service processing method, apparatus and device
EP4391597A4 (en) Positioning method, apparatus, and system
EP4241860A4 (en) Method and apparatus for processing resources
EP4443296A4 (en) Event rule processing method and apparatus, and event processing method and apparatus
EP4181598A4 (en) Collision processing method and apparatus
EP4195015A4 (en) Method and apparatus for processing interaction event
EP4113446A4 (en) Sticker processing method and apparatus
EP4354429A4 (en) Method and device for processing speech by distinguishing speakers
EP4129621A4 (en) Apparatus, method, and program
EP4318354A4 (en) Account opening method, system, and apparatus
EP4428700A4 (en) Service processing method and apparatus
EP4485891A4 (en) Path calculation method, apparatus and system
GB2598563B (en) System and method for speech processing
EP4354750A4 (en) Communication processing method and communication processing apparatus
EP4239975A4 (en) Packet processing method and related apparatus
EP4435599A4 (en) Task processing method and apparatus
EP4220403A4 (en) Service processing method and related apparatus
EP3968294B8 (en) Apparatus, system, method and program

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230627

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G10L0021023200

Ipc: G10L0025300000

Ref country code: DE

Ref legal event code: R079

Ref document number: 602021039818

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G10L0021023200

Ipc: G10L0025300000

A4 Supplementary search report drawn up and despatched

Effective date: 20240328

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 21/0232 20130101ALN20240325BHEP

Ipc: G10L 25/18 20130101ALN20240325BHEP

Ipc: G10L 21/0208 20130101ALI20240325BHEP

Ipc: G10L 25/30 20130101AFI20240325BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 21/0232 20130101ALN20250408BHEP

Ipc: G10L 25/18 20130101ALN20250408BHEP

Ipc: G10L 21/0208 20130101ALI20250408BHEP

Ipc: G10L 25/30 20130101AFI20250408BHEP

INTG Intention to grant announced

Effective date: 20250423

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Ref country code: CH

Ref legal event code: F10

Free format text: ST27 STATUS EVENT CODE: U-0-0-F10-F00 (AS PROVIDED BY THE NATIONAL OFFICE)

Effective date: 20251001

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602021039818

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20251001

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1843419

Country of ref document: AT

Kind code of ref document: T

Effective date: 20251001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260202

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251001