WO2006121896A3 - Microphone array based selective sound source listening and video game control - Google Patents

Microphone array based selective sound source listening and video game control Download PDF

Info

Publication number
WO2006121896A3
WO2006121896A3 PCT/US2006/017483 US2006017483W WO2006121896A3 WO 2006121896 A3 WO2006121896 A3 WO 2006121896A3 US 2006017483 W US2006017483 W US 2006017483W WO 2006121896 A3 WO2006121896 A3 WO 2006121896A3
Authority
WO
WIPO (PCT)
Prior art keywords
sound
listening zone
listening
video game
sound source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2006/017483
Other languages
French (fr)
Other versions
WO2006121896A2 (en
Inventor
Richard L Marks
Xiadong Mao
Gary M Zalewski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Priority to DE602006018897T priority Critical patent/DE602006018897D1/en
Priority to EP06752342A priority patent/EP1878013B1/en
Priority to JP2008510282A priority patent/JP4886770B2/en
Priority to AT06752342T priority patent/ATE491503T1/en
Publication of WO2006121896A2 publication Critical patent/WO2006121896A2/en
Priority to PCT/US2007/065686 priority patent/WO2007130765A2/en
Priority to JP2009509909A priority patent/JP4866958B2/en
Priority to PCT/US2007/065701 priority patent/WO2007130766A2/en
Priority to JP2009509908A priority patent/JP4476355B2/en
Priority to EP07759884A priority patent/EP2012725A4/en
Priority to EP07759872A priority patent/EP2014132A4/en
Priority to CN201210496712.8A priority patent/CN102989174B/en
Priority to CN201210037498.XA priority patent/CN102580314B/en
Priority to CN200780025400.6A priority patent/CN101484221B/en
Priority to PCT/US2007/067010 priority patent/WO2007130793A2/en
Priority to KR1020087029705A priority patent/KR101020509B1/en
Priority to CN201710222446.2A priority patent/CN107638689A/en
Priority to PCT/US2007/067005 priority patent/WO2007130792A2/en
Priority to EP07251651A priority patent/EP1852164A3/en
Priority to JP2009509932A priority patent/JP2009535173A/en
Priority to EP10183502A priority patent/EP2351604A3/en
Priority to EP07760947A priority patent/EP2013864A4/en
Priority to PCT/US2007/067324 priority patent/WO2007130819A2/en
Priority to JP2007121964A priority patent/JP4553917B2/en
Publication of WO2006121896A3 publication Critical patent/WO2006121896A3/en
Anticipated expiration legal-status Critical
Priority to JP2009185086A priority patent/JP5465948B2/en
Priority to JP2010019147A priority patent/JP4833343B2/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0272—Voice signal separating
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/424—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/215—Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/105—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals using inertial sensors, e.g. accelerometers, gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1081—Input via voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Position Input By Displaying (AREA)
  • Stereophonic System (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
  • User Interface Of Digital Computer (AREA)
  • Mechanical Control Devices (AREA)

Abstract

A sound capture unit is configured to identify one or more sound sources. The sound capture unit generates data capable of being analyzed to determine a listening zone at which to process sound to the substantial exclusion of sounds outside the listening zone. Sound captured and processed for the listening zone may be used for interactivity with the computer program. The listening zone may be adjusted based on the location of a sound source. One or more listening zones may be pre-calibrated. The apparatus may optionally include an image capture unit configured to capture one or more image frames. The listening zone may be adjusted based on the image. A video game unit may be controlled by generating inertial, optical and/or acoustic signals with a controller and tracking a position and/or orientation of the controller using the inertial, acoustic and/or optical signal.
PCT/US2006/017483 2005-05-05 2006-05-04 Microphone array based selective sound source listening and video game control Ceased WO2006121896A2 (en)

Priority Applications (25)

Application Number Priority Date Filing Date Title
DE602006018897T DE602006018897D1 (en) 2005-05-05 2006-05-04 Video game control via joystick
EP06752342A EP1878013B1 (en) 2005-05-05 2006-05-04 Video game control with joystick
JP2008510282A JP4886770B2 (en) 2005-05-05 2006-05-04 Selective sound source listening for use with computer interactive processing
AT06752342T ATE491503T1 (en) 2005-05-05 2006-05-04 VIDEO GAME CONTROL USING JOYSTICK
PCT/US2007/065686 WO2007130765A2 (en) 2006-05-04 2007-03-30 Echo and noise cancellation
JP2009509909A JP4866958B2 (en) 2006-05-04 2007-03-30 Noise reduction in electronic devices with farfield microphones on the console
PCT/US2007/065701 WO2007130766A2 (en) 2006-05-04 2007-03-30 Narrow band noise reduction for speech enhancement
JP2009509908A JP4476355B2 (en) 2006-05-04 2007-03-30 Echo and noise cancellation
EP07759884A EP2012725A4 (en) 2006-05-04 2007-03-30 Narrow band noise reduction for speech enhancement
EP07759872A EP2014132A4 (en) 2006-05-04 2007-03-30 Echo and noise cancellation
CN201710222446.2A CN107638689A (en) 2006-05-04 2007-04-14 Obtain the input of the operation for controlling games
CN200780025400.6A CN101484221B (en) 2006-05-04 2007-04-14 Obtain input for controlling the execution of the game program
CN201210037498.XA CN102580314B (en) 2006-05-04 2007-04-14 Obtain input for controlling the execution of the game program
CN201210496712.8A CN102989174B (en) 2006-05-04 2007-04-14 Obtain the input being used for controlling the operation of games
PCT/US2007/067010 WO2007130793A2 (en) 2006-05-04 2007-04-14 Obtaining input for controlling execution of a game program
KR1020087029705A KR101020509B1 (en) 2006-05-04 2007-04-14 How to Obtain Inputs to Control the Execution of a Program
EP07760947A EP2013864A4 (en) 2006-05-04 2007-04-19 System, method, and apparatus for three-dimensional input control
EP10183502A EP2351604A3 (en) 2006-05-04 2007-04-19 Obtaining input for controlling execution of a game program
EP07251651A EP1852164A3 (en) 2006-05-04 2007-04-19 Obtaining input for controlling execution of a game program
JP2009509932A JP2009535173A (en) 2006-05-04 2007-04-19 Three-dimensional input control system, method, and apparatus
PCT/US2007/067005 WO2007130792A2 (en) 2006-05-04 2007-04-19 System, method, and apparatus for three-dimensional input control
PCT/US2007/067324 WO2007130819A2 (en) 2006-05-04 2007-04-24 Tracking device with sound emitter for use in obtaining information for controlling game program execution
JP2007121964A JP4553917B2 (en) 2006-05-04 2007-05-02 How to get input to control the execution of a game program
JP2009185086A JP5465948B2 (en) 2006-05-04 2009-08-07 How to get input to control the execution of a game program
JP2010019147A JP4833343B2 (en) 2006-05-04 2010-01-29 Echo and noise cancellation

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US67841305P 2005-05-05 2005-05-05
US60/678,413 2005-05-05
US71814505P 2005-09-15 2005-09-15
US60/718,145 2005-09-15

Publications (2)

Publication Number Publication Date
WO2006121896A2 WO2006121896A2 (en) 2006-11-16
WO2006121896A3 true WO2006121896A3 (en) 2007-06-28

Family

ID=36942221

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/017483 Ceased WO2006121896A2 (en) 2005-05-05 2006-05-04 Microphone array based selective sound source listening and video game control

Country Status (5)

Country Link
EP (2) EP1878013B1 (en)
JP (1) JP4886770B2 (en)
AT (1) ATE491503T1 (en)
DE (1) DE602006018897D1 (en)
WO (1) WO2006121896A2 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8310656B2 (en) 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
US8313380B2 (en) 2002-07-27 2012-11-20 Sony Computer Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US8781151B2 (en) 2006-09-28 2014-07-15 Sony Computer Entertainment Inc. Object detection using video input combined with tilt angle information
US8947347B2 (en) 2003-08-27 2015-02-03 Sony Computer Entertainment Inc. Controlling actions in a video game unit
US9174119B2 (en) 2002-07-27 2015-11-03 Sony Computer Entertainement America, LLC Controller for providing inputs to control execution of a program when inputs are combined
US9393487B2 (en) 2002-07-27 2016-07-19 Sony Interactive Entertainment Inc. Method for mapping movements of a hand-held controller to game commands

Families Citing this family (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8797260B2 (en) 2002-07-27 2014-08-05 Sony Computer Entertainment Inc. Inertially trackable hand-held controller
US10086282B2 (en) 2002-07-27 2018-10-02 Sony Interactive Entertainment Inc. Tracking device for use in obtaining information for controlling game program execution
US8139793B2 (en) 2003-08-27 2012-03-20 Sony Computer Entertainment Inc. Methods and apparatus for capturing audio signals based on a visual image
US8570378B2 (en) 2002-07-27 2013-10-29 Sony Computer Entertainment Inc. Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
US8160269B2 (en) 2003-08-27 2012-04-17 Sony Computer Entertainment Inc. Methods and apparatuses for adjusting a listening area for capturing sounds
US8233642B2 (en) 2003-08-27 2012-07-31 Sony Computer Entertainment Inc. Methods and apparatuses for capturing an audio signal based on a location of the signal
DE602006001051T2 (en) * 2006-01-09 2009-07-02 Honda Research Institute Europe Gmbh Determination of the corresponding measurement window for sound source location in echo environments
USRE48417E1 (en) 2006-09-28 2021-02-02 Sony Interactive Entertainment Inc. Object direction using video input combined with tilt angle information
DE602007004185D1 (en) 2007-02-02 2010-02-25 Harman Becker Automotive Sys System and method for voice control
EP2132650A4 (en) * 2007-03-01 2010-10-27 Sony Comp Entertainment Us System and method for communicating with a virtual world
US7974841B2 (en) 2008-02-27 2011-07-05 Sony Ericsson Mobile Communications Ab Electronic devices and methods that adapt filtering of a microphone signal responsive to recognition of a targeted speaker's voice
JP5681633B2 (en) * 2008-10-27 2015-03-11 株式会社ソニー・コンピュータエンタテインメント Control device for communicating visual information
JP5129794B2 (en) * 2009-08-11 2013-01-30 日本電信電話株式会社 Objective signal enhancement device, method and program
US9838784B2 (en) 2009-12-02 2017-12-05 Knowles Electronics, Llc Directional audio capture
US9210503B2 (en) * 2009-12-02 2015-12-08 Audience, Inc. Audio zoom
US8798290B1 (en) 2010-04-21 2014-08-05 Audience, Inc. Systems and methods for adaptive signal equalization
US9558755B1 (en) 2010-05-20 2017-01-31 Knowles Electronics, Llc Noise suppression assisted automatic speech recognition
JP6377312B2 (en) * 2010-11-10 2018-08-22 株式会社ユニバーサルエンターテインメント Gaming machine
JP6179081B2 (en) * 2011-09-15 2017-08-16 株式会社Ｊｖｃケンウッド Noise reduction device, voice input device, wireless communication device, and noise reduction method
US9563265B2 (en) * 2012-01-12 2017-02-07 Qualcomm Incorporated Augmented reality with sound and geometric analysis
US10049685B2 (en) 2013-03-12 2018-08-14 Aaware, Inc. Integrated sensor-array processor
US9443529B2 (en) 2013-03-12 2016-09-13 Aawtend, Inc. Integrated sensor-array processor
US10204638B2 (en) 2013-03-12 2019-02-12 Aaware, Inc. Integrated sensor-array processor
US9536540B2 (en) 2013-07-19 2017-01-03 Knowles Electronics, Llc Speech signal separation and synthesis based on auditory scene analysis and speech modeling
KR20160122835A (en) 2014-03-18 2016-10-24 로베르트 보쉬 게엠베하 Adaptive acoustic intensity analyzer
WO2016040885A1 (en) 2014-09-12 2016-03-17 Audience, Inc. Systems and methods for restoration of speech components
CN115550821A (en) 2014-09-30 2022-12-30 苹果公司 Loudspeaker with reduced audio coloration caused by reflections from surfaces
GB2533373B (en) * 2014-12-18 2018-07-04 Canon Kk Video-based sound source separation
CN107210824A (en) 2015-01-30 2017-09-26 美商楼氏电子有限公司 The environment changing of microphone
US9554207B2 (en) 2015-04-30 2017-01-24 Shure Acquisition Holdings, Inc. Offset cartridge microphones
US9565493B2 (en) 2015-04-30 2017-02-07 Shure Acquisition Holdings, Inc. Array microphone system and method of assembling the same
US9530426B1 (en) 2015-06-24 2016-12-27 Microsoft Technology Licensing, Llc Filtering sounds for conferencing applications
WO2017163688A1 (en) * 2016-03-24 2017-09-28 Panasonic Intellectual Property Management Co., Ltd. Monitoring system and monitoring method
JP6664119B2 (en) * 2016-03-24 2020-03-13 パナソニックＩｐマネジメント株式会社 Monitoring system and monitoring method
US9820042B1 (en) 2016-05-02 2017-11-14 Knowles Electronics, Llc Stereo separation and directional suppression with omni-directional microphones
US10074012B2 (en) 2016-06-17 2018-09-11 Dolby Laboratories Licensing Corporation Sound and video object tracking
US10257608B2 (en) 2016-09-23 2019-04-09 Apple Inc. Subwoofer with multi-lobe magnet
US10367948B2 (en) 2017-01-13 2019-07-30 Shure Acquisition Holdings, Inc. Post-mixing acoustic echo cancellation systems and methods
US11215709B2 (en) 2017-04-21 2022-01-04 Hewlett-Packard Development Company, L.P. Audio data gather
JP6755843B2 (en) 2017-09-14 2020-09-16 株式会社東芝 Sound processing device, voice recognition device, sound processing method, voice recognition method, sound processing program and voice recognition program
CN112335261B (en) 2018-06-01 2023-07-18 舒尔获得控股公司 patterned microphone array
US11297423B2 (en) 2018-06-15 2022-04-05 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11310596B2 (en) 2018-09-20 2022-04-19 Shure Acquisition Holdings, Inc. Adjustable lobe shape for array microphones
US11558693B2 (en) 2019-03-21 2023-01-17 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality
US11303981B2 (en) 2019-03-21 2022-04-12 Shure Acquisition Holdings, Inc. Housings and associated design features for ceiling array microphones
JP7572964B2 (en) 2019-03-21 2024-10-24 シュアー アクイジッション ホールディングス インコーポレイテッド Beamforming with rejection Autofocus, autofocus in area, and autoplacement of microphone lobes
TW202101422A (en) 2019-05-23 2021-01-01 美商舒爾獲得控股公司 Steerable speaker array, system, and method for the same
WO2020243471A1 (en) 2019-05-31 2020-12-03 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
US11810587B2 (en) 2019-07-26 2023-11-07 Hewlett-Packard Development Company, L.P. Noise filtrations based on radar
CN114467312A (en) 2019-08-23 2022-05-10 舒尔获得控股公司 Two-dimensional microphone array with improved directivity
KR20190107623A (en) * 2019-09-02 2019-09-20 엘지전자 주식회사 Signage apparatus and method for operating thereof
US12028678B2 (en) 2019-11-01 2024-07-02 Shure Acquisition Holdings, Inc. Proximity microphone
US11552611B2 (en) 2020-02-07 2023-01-10 Shure Acquisition Holdings, Inc. System and method for automatic adjustment of reference gain
CN111580049B (en) * 2020-05-20 2023-07-14 陕西金蝌蚪智能科技有限公司 Dynamic target sound source tracking and monitoring method and terminal equipment
US11706562B2 (en) 2020-05-29 2023-07-18 Shure Acquisition Holdings, Inc. Transducer steering and configuration systems and methods using a local positioning system
JP7814400B2 (en) 2021-01-28 2026-02-16 シュアー アクイジッション ホールディングス インコーポレイテッド Hybrid Audio Beamforming System
US12452584B2 (en) 2021-01-29 2025-10-21 Shure Acquisition Holdings, Inc. Scalable conferencing systems and methods
US12542123B2 (en) 2021-08-31 2026-02-03 Shure Acquisition Holdings, Inc. Mask non-linear processor for acoustic echo cancellation
US12289584B2 (en) 2021-10-04 2025-04-29 Shure Acquisition Holdings, Inc. Networked automixer systems and methods
EP4427465A1 (en) 2021-11-05 2024-09-11 Shure Acquisition Holdings, Inc. Distributed algorithm for automixing speech over wireless networks
US12250526B2 (en) 2022-01-07 2025-03-11 Shure Acquisition Holdings, Inc. Audio beamforming with nulling control system and methods
CN115022716B (en) * 2022-05-09 2024-12-03 海信视像科技股份有限公司 Display device, sound field adjustment method, storage medium and program product
US12598261B2 (en) 2022-09-28 2026-04-07 Shure Acquisition Holdings, Inc. Wideband doubletalk detection for optimization of acoustic echo cancellation
CN119741939A (en) * 2025-03-03 2025-04-01 北京亮亮视野科技有限公司 Subtitle display method, device, equipment, head-mounted device and program product

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5335011A (en) * 1993-01-12 1994-08-02 Bell Communications Research, Inc. Sound localization system for teleconferencing using self-steering microphone arrays
EP0652686A1 (en) * 1993-11-05 1995-05-10 AT&T Corp. Adaptive microphone array
EP0867798A2 (en) * 1997-03-26 1998-09-30 International Business Machines Corporation Data processing system user interface
EP1033882A1 (en) * 1998-06-01 2000-09-06 Sony Computer Entertainment Inc. Input position measuring instrument and entertainment system
US6173059B1 (en) * 1998-04-24 2001-01-09 Gentner Communications Corporation Teleconferencing system with visual feedback
EP1074934A2 (en) * 1999-08-02 2001-02-07 Lucent Technologies Inc. Computer input device having six degrees of freedom for controlling movement of a three-dimensional object
US20030063065A1 (en) * 2001-09-11 2003-04-03 Samsung Electronics Co., Ltd. Pointer control method, pointing apparatus, and host apparatus therefor
EP1335338A2 (en) * 2002-02-07 2003-08-13 Microsoft Corporation A system and process for controlling electronic components in a computing environment
US20030160862A1 (en) * 2002-02-27 2003-08-28 Charlier Michael L. Apparatus having cooperating wide-angle digital camera system and microphone array
US20040047464A1 (en) * 2002-09-11 2004-03-11 Zhuliang Yu Adaptive noise cancelling microphone system
EP1411461A1 (en) * 2002-10-14 2004-04-21 STMicroelectronics S.r.l. User controlled device for sending control signals to an electric appliance, in particular user controlled pointing device such as mouse or joystick, with 3D-motion detection
US20040213419A1 (en) * 2003-04-25 2004-10-28 Microsoft Corporation Noise reduction systems and methods for voice applications
EP1489596A1 (en) * 2003-06-17 2004-12-22 Sony Ericsson Mobile Communications AB Device and method for voice activity detection
US20050047611A1 (en) * 2003-08-27 2005-03-03 Xiadong Mao Audio input system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19540795C2 (en) * 1995-11-02 2003-11-20 Deutsche Telekom Ag Speaker localization method using a microphone array
US5892501A (en) * 1996-01-17 1999-04-06 Lg Electronics Inc, Three dimensional wireless pointing device
JP2002007057A (en) * 2000-06-23 2002-01-11 Shinsedai Kk Input device for processor
EP1184676B1 (en) * 2000-09-02 2004-05-06 Nokia Corporation System and method for processing a signal being emitted from a target signal source into a noisy environment
JP2002091692A (en) * 2000-09-12 2002-03-29 Seiko Instruments Inc Pointing system
JP4195267B2 (en) * 2002-03-14 2008-12-10 インターナショナル・ビジネス・マシーンズ・コーポレーション Speech recognition apparatus, speech recognition method and program thereof
US7970147B2 (en) 2004-04-07 2011-06-28 Sony Computer Entertainment Inc. Video game controller with noise canceling logic
JP2004192306A (en) * 2002-12-11 2004-07-08 Nippon Telegr & Teleph Corp <Ntt> Display position changing device, display position changing method, display position changing program, and recording medium recording the program

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5335011A (en) * 1993-01-12 1994-08-02 Bell Communications Research, Inc. Sound localization system for teleconferencing using self-steering microphone arrays
EP0652686A1 (en) * 1993-11-05 1995-05-10 AT&T Corp. Adaptive microphone array
EP0867798A2 (en) * 1997-03-26 1998-09-30 International Business Machines Corporation Data processing system user interface
US6173059B1 (en) * 1998-04-24 2001-01-09 Gentner Communications Corporation Teleconferencing system with visual feedback
EP1033882A1 (en) * 1998-06-01 2000-09-06 Sony Computer Entertainment Inc. Input position measuring instrument and entertainment system
EP1074934A2 (en) * 1999-08-02 2001-02-07 Lucent Technologies Inc. Computer input device having six degrees of freedom for controlling movement of a three-dimensional object
US20030063065A1 (en) * 2001-09-11 2003-04-03 Samsung Electronics Co., Ltd. Pointer control method, pointing apparatus, and host apparatus therefor
EP1335338A2 (en) * 2002-02-07 2003-08-13 Microsoft Corporation A system and process for controlling electronic components in a computing environment
US20030160862A1 (en) * 2002-02-27 2003-08-28 Charlier Michael L. Apparatus having cooperating wide-angle digital camera system and microphone array
US20040047464A1 (en) * 2002-09-11 2004-03-11 Zhuliang Yu Adaptive noise cancelling microphone system
EP1411461A1 (en) * 2002-10-14 2004-04-21 STMicroelectronics S.r.l. User controlled device for sending control signals to an electric appliance, in particular user controlled pointing device such as mouse or joystick, with 3D-motion detection
US20040213419A1 (en) * 2003-04-25 2004-10-28 Microsoft Corporation Noise reduction systems and methods for voice applications
EP1489596A1 (en) * 2003-06-17 2004-12-22 Sony Ericsson Mobile Communications AB Device and method for voice activity detection
US20050047611A1 (en) * 2003-08-27 2005-03-03 Xiadong Mao Audio input system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FIALA M ET AL: "A panoramic video and acoustic beamforming sensor for videoconferencing", HAPTIC, AUDIO AND VISUAL ENVIRONMENTS AND THEIR APPLICATIONS, 2004. HAVE 2004. PROCEEDINGS. THE 3RD IEEE INTERNATIONAL WORKSHOP ON OTTAWA, ONT., CANADA 2-3 OCT. 2004, PISCATAWAY, NJ, USA,IEEE, US, 2 October 2004 (2004-10-02), pages 47 - 52, XP010765301, ISBN: 0-7803-8817-8 *
WILSON K W ET AL: "Audio-video array source localization for intelligent environments", 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING. PROCEEDINGS. (ICASSP). ORLANDO, FL, MAY 13 - 17, 2002, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), NEW YORK, NY : IEEE, US, vol. VOL. 4 OF 4, 13 May 2002 (2002-05-13), pages II - 2109, XP010804318, ISBN: 0-7803-7402-9 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8313380B2 (en) 2002-07-27 2012-11-20 Sony Computer Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US9174119B2 (en) 2002-07-27 2015-11-03 Sony Computer Entertainement America, LLC Controller for providing inputs to control execution of a program when inputs are combined
US9381424B2 (en) 2002-07-27 2016-07-05 Sony Interactive Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US9393487B2 (en) 2002-07-27 2016-07-19 Sony Interactive Entertainment Inc. Method for mapping movements of a hand-held controller to game commands
US8947347B2 (en) 2003-08-27 2015-02-03 Sony Computer Entertainment Inc. Controlling actions in a video game unit
US8310656B2 (en) 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
US8781151B2 (en) 2006-09-28 2014-07-15 Sony Computer Entertainment Inc. Object detection using video input combined with tilt angle information

Also Published As

Publication number Publication date
EP1878013B1 (en) 2010-12-15
EP2352149B1 (en) 2013-09-04
EP2352149A3 (en) 2012-08-29
WO2006121896A2 (en) 2006-11-16
JP4886770B2 (en) 2012-02-29
DE602006018897D1 (en) 2011-01-27
ATE491503T1 (en) 2011-01-15
JP2008542798A (en) 2008-11-27
EP2352149A2 (en) 2011-08-03
EP1878013A2 (en) 2008-01-16

Similar Documents

Publication Publication Date Title
WO2006121896A3 (en) Microphone array based selective sound source listening and video game control
TW200740209A (en) Surveillance system and method of performing video and audio surveillance
TW200708328A (en) Selective sound source listening in conjunction with computer interactive processing
KR102481454B1 (en) Hands free device with directional interface
KR102282366B1 (en) Method and apparatus of enhancing speech
TWI473009B (en) System for enhancing audio and method for outputting audio from a computing device
TW200625956A (en) Methods and systems for audio and video communication
EP2140450A4 (en) A method and an apparatus for processing an audio signal
WO2008099685A1 (en) Image reproducing apparatus, image reproducing method, imaging apparatus and method for controlling the imaging apparatus
WO2006026812A3 (en) Apparatus and method for sound enhancement
DK1665881T3 (en) Method for controlling the directional determination of the sound reception characteristic of a hearing aid and a signal processing apparatus for a hearing aid with controllable directional characteristics
ATE362296T1 (en) SYSTEM AND METHOD FOR AUTOMATICALLY ADJUSTING THE SOUND AND VISUAL PARAMETERS OF A HOME THEATER SYSTEM
JP7717170B2 (en) Head-Mounted Computing Device Using Microphone Beam Steering - Patent application
WO2007118109A3 (en) Method and apparatus for providing motion control signals between a fixed camera and a ptz camera
WO2007145876A3 (en) Communication system, apparatus and method
DK1699261T3 (en) System and method for determining the directionality of sound detected by a hearing aid
ATE487333T1 (en) DIRECTED AUDIO CAPTURE
DK1530402T3 (en) Method of fitting a hearing aid, taking into account the position of the head and a corresponding hearing aid
TW200729706A (en) Method and audio system for controlling a gain of a voice signal
WO2006000824A3 (en) Control of data processing using inter-frame motion and audio signal
WO2009020200A1 (en) Screen, control device and method, program and recording medium
US9853758B1 (en) Systems and methods for signal mixing
WO2005033883A3 (en) Directional pad having integrated acoustic system and lighting system
SI1933590T1 (en) Method for adjusting hearing aids
TW200707197A (en) Multimedia apparatus and control method thereof capable of automatically selecting preset audio/video setting according to selected signal source

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006752342

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2008510282

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU