WO2020006410A1 - Systèmes et procédés d'association de dispositifs de lecture à des services d'assistant vocal - Google Patents

Systèmes et procédés d'association de dispositifs de lecture à des services d'assistant vocal Download PDF

Info

Publication number
WO2020006410A1
WO2020006410A1 PCT/US2019/039828 US2019039828W WO2020006410A1 WO 2020006410 A1 WO2020006410 A1 WO 2020006410A1 US 2019039828 W US2019039828 W US 2019039828W WO 2020006410 A1 WO2020006410 A1 WO 2020006410A1
Authority
WO
WIPO (PCT)
Prior art keywords
playback
devices
user
zone
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2019/039828
Other languages
English (en)
Inventor
Sein Woo
John G. TOLOMEI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sonos Inc
Original Assignee
Sonos Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/022,662 external-priority patent/US10681460B2/en
Application filed by Sonos Inc filed Critical Sonos Inc
Priority to EP19740292.8A priority Critical patent/EP3815384A1/fr
Priority to CN202311238129.1A priority patent/CN117316150A/zh
Priority to CN201980056604.9A priority patent/CN112640475B/zh
Publication of WO2020006410A1 publication Critical patent/WO2020006410A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/2849—Audio/video appliances

Definitions

  • SONOS, Inc. filed for one of its first patent applications, entitled “Method for Synchronizing Audio Playback between Multiple Networked Devices,” and began offering a media playback system for sale in 2005.
  • the SONOS Wireless HiFi System enables people to experience music from many sources via one or more networked playback devices. Through a software control application installed on a smartphone, tablet, or computer, one can play what he or she wants in any room that has a networked playback device. Additionally, using the controller, for example, different songs can be streamed to each room with a playback device, rooms can be grouped together for synchronous playback, or the same song can be heard in all rooms synchronously.
  • Figure 2A is a functional block diagram of an example playback device
  • a VAS may process a voice input to determine an intent of the voice input. Based on the response, the network microphone device may cause one or more smart devices to perform an action. For example, the network microphone device may instruct an illumination device to turn on/off based on the response to the instruction from the VAS.
  • the various playback, network microphone, and controller devices 102-104 and/or other network devices of the MPS 100 may be coupled to one another via point-to-point connections and/or over other connections, which may be wired and/or wireless, via a LAN 111 including a network router 109.
  • the playback device l02j (which may be designated as“Left”) in the Den lOld ( Figure 1A) may have a point-to-point connection with the playback device l02a in the Den lOld (which may be designated as“Right”).
  • the Left playback device l02j may communicate over the point-to-point connection with the Right playback device l02a.
  • the Left playback device l02j may communicate with other network devices via the point-to-point connection and/or other connections via the LAN 111.
  • the playback device l02b named Front may be bonded with the playback device l02k named SUB.
  • the Front device l02b may render a range of mid to high frequencies and the SUB device l02k may render low frequencies as, e.g., a subwoofer. When unbonded, the Front device l02b may render a full range of frequencies.
  • Figure 3C shows the Front and SUB devices l02b and l02k further bonded with Right and Left playback devices l02a and l02k, respectively.
  • the Right and Left devices l02a and l02k may form surround or“satellite” channels of a home theater system.
  • the bonded playback devices l02a, l02b, l02j, and l02k may form a single Zone D (Figure 3D).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Automation & Control Theory (AREA)
  • Databases & Information Systems (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)

Abstract

L'invention concerne des systèmes et des procédés de lecture multimédia par l'intermédiaire d'un système de lecture multimédia comprenant la détection d'un premier mot de réveil par l'intermédiaire d'un premier dispositif de microphone de réseau d'un premier dispositif de lecture, la détection d'un second mot de réveil par l'intermédiaire d'un second dispositif de microphone de réseau d'un second dispositif de lecture et la formation d'une zone liée comprenant le premier dispositif de lecture et le second dispositif de lecture. En réponse à la détection du premier mot de réveil, un premier énoncé vocal suivant le premier mot de réveil est transmis à un premier service d'assistant vocal. En réponse à la détection du second mot de réveil, un second énoncé vocal suivant le second mot de réveil est transmis à un second service d'assistant vocal. Le contenu multimédia demandé reçu en provenance du premier et/ou du second service d'assistant vocal est lu par l'intermédiaire du premier dispositif de lecture et du second dispositif de lecture en synchronie l'un avec l'autre.
PCT/US2019/039828 2018-06-28 2019-06-28 Systèmes et procédés d'association de dispositifs de lecture à des services d'assistant vocal Ceased WO2020006410A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP19740292.8A EP3815384A1 (fr) 2018-06-28 2019-06-28 Systèmes et procédés d'association de dispositifs de lecture à des services d'assistant vocal
CN202311238129.1A CN117316150A (zh) 2018-06-28 2019-06-28 用于将回放设备与语音助理服务相关联的系统和方法
CN201980056604.9A CN112640475B (zh) 2018-06-28 2019-06-28 用于将回放设备与语音助理服务相关联的系统和方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862691587P 2018-06-28 2018-06-28
US16/022,662 US10681460B2 (en) 2018-06-28 2018-06-28 Systems and methods for associating playback devices with voice assistant services
US16/022,662 2018-06-28
US62/691,587 2018-06-28

Publications (1)

Publication Number Publication Date
WO2020006410A1 true WO2020006410A1 (fr) 2020-01-02

Family

ID=67297439

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/039828 Ceased WO2020006410A1 (fr) 2018-06-28 2019-06-28 Systèmes et procédés d'association de dispositifs de lecture à des services d'assistant vocal

Country Status (3)

Country Link
EP (1) EP3815384A1 (fr)
CN (2) CN117316150A (fr)
WO (1) WO2020006410A1 (fr)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023049866A3 (fr) * 2021-09-24 2023-04-27 Sonos, Inc. Règles de simultanéité pour dispositifs de microphone réseau ayant de multiples services d'assistant vocal
WO2024123319A1 (fr) * 2022-12-05 2024-06-13 Google Llc Génération d'une session d'assistant automatisé de groupe pour fournir un contenu à une pluralité d'utilisateurs par l'intermédiaire d'écouteurs
US12375052B2 (en) 2018-08-28 2025-07-29 Sonos, Inc. Audio notifications
US12450025B2 (en) 2016-07-22 2025-10-21 Sonos, Inc. Calibration assistance
US12464302B2 (en) 2016-04-12 2025-11-04 Sonos, Inc. Calibration of audio playback devices
US12495258B2 (en) 2012-06-28 2025-12-09 Sonos, Inc. Calibration interface
US12498899B2 (en) 2016-02-22 2025-12-16 Sonos, Inc. Audio response playback
US12501229B2 (en) 2011-12-29 2025-12-16 Sonos, Inc. Media playback based on sensor data
US12505832B2 (en) 2016-02-22 2025-12-23 Sonos, Inc. Voice control of a media playback system
US12620395B2 (en) 2022-12-05 2026-05-05 Google Llc Generating a group automated assistant session to provide content to a plurality of users via headphones

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8234395B2 (en) 2003-07-28 2012-07-31 Sonos, Inc. System and method for synchronizing operations among a plurality of independently clocked digital data processing devices
US8483853B1 (en) 2006-09-12 2013-07-09 Sonos, Inc. Controlling and manipulating groupings in a multi-zone media system
US8965033B2 (en) 2012-08-31 2015-02-24 Sonos, Inc. Acoustic optimization
US9084058B2 (en) 2011-12-29 2015-07-14 Sonos, Inc. Sound field calibration using listener localization
US20160098992A1 (en) * 2014-10-01 2016-04-07 XBrain, Inc. Voice and Connection Platform
WO2017058654A1 (fr) * 2015-09-28 2017-04-06 Google Inc. Diffusion en continu de contenu multimédia multi-zone, synchronisée dans le temps
US20170133011A1 (en) * 2015-11-06 2017-05-11 Google Inc. Voice commands across devices
US20170242651A1 (en) * 2016-02-22 2017-08-24 Sonos, Inc. Audio Response Playback
US9916839B1 (en) * 2014-03-27 2018-03-13 Amazon Technologies, Inc. Shared audio functionality based on device grouping

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8463875B2 (en) * 2009-08-20 2013-06-11 Google Inc. Synchronized playback of media players
US9715365B2 (en) * 2012-06-27 2017-07-25 Sonos, Inc. Systems and methods for mobile music zones
US9501533B2 (en) * 2013-04-16 2016-11-22 Sonos, Inc. Private queue for a media playback system
US9232277B2 (en) * 2013-07-17 2016-01-05 Sonos, Inc. Associating playback devices with playback queues
US9836271B2 (en) * 2013-07-17 2017-12-05 Booktrack Holdings Limited Delivery of synchronised soundtracks for electronic media content
US9537819B2 (en) * 2013-09-30 2017-01-03 Sonos, Inc. Facilitating the resolution of address conflicts in a networked media playback system
US9654536B2 (en) * 2014-06-04 2017-05-16 Sonos, Inc. Cloud queue playback policy
US9766702B2 (en) * 2014-06-19 2017-09-19 Apple Inc. User detection by a computing device
US20160055847A1 (en) * 2014-08-19 2016-02-25 Nuance Communications, Inc. System and method for speech validation
US9910634B2 (en) * 2014-09-09 2018-03-06 Sonos, Inc. Microphone calibration
US9875081B2 (en) * 2015-09-21 2018-01-23 Amazon Technologies, Inc. Device selection for providing a response
US9947316B2 (en) * 2016-02-22 2018-04-17 Sonos, Inc. Voice control of a media playback system
US9847904B2 (en) * 2016-04-27 2017-12-19 Blackfire Research Corporation Semi-automated configuration of a low-latency multimedia playback system
US10115400B2 (en) * 2016-08-05 2018-10-30 Sonos, Inc. Multiple voice services
US9942678B1 (en) * 2016-09-27 2018-04-10 Sonos, Inc. Audio playback settings for voice interaction
US10217453B2 (en) * 2016-10-14 2019-02-26 Soundhound, Inc. Virtual assistant configured by selection of wake-up phrase
US10783883B2 (en) * 2016-11-03 2020-09-22 Google Llc Focus session at a voice interface device
CN106910500B (zh) * 2016-12-23 2020-04-17 北京小鸟听听科技有限公司 对带麦克风阵列的设备进行语音控制的方法及设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8234395B2 (en) 2003-07-28 2012-07-31 Sonos, Inc. System and method for synchronizing operations among a plurality of independently clocked digital data processing devices
US8483853B1 (en) 2006-09-12 2013-07-09 Sonos, Inc. Controlling and manipulating groupings in a multi-zone media system
US9084058B2 (en) 2011-12-29 2015-07-14 Sonos, Inc. Sound field calibration using listener localization
US8965033B2 (en) 2012-08-31 2015-02-24 Sonos, Inc. Acoustic optimization
US9916839B1 (en) * 2014-03-27 2018-03-13 Amazon Technologies, Inc. Shared audio functionality based on device grouping
US20160098992A1 (en) * 2014-10-01 2016-04-07 XBrain, Inc. Voice and Connection Platform
WO2017058654A1 (fr) * 2015-09-28 2017-04-06 Google Inc. Diffusion en continu de contenu multimédia multi-zone, synchronisée dans le temps
US20170133011A1 (en) * 2015-11-06 2017-05-11 Google Inc. Voice commands across devices
US20170242651A1 (en) * 2016-02-22 2017-08-24 Sonos, Inc. Audio Response Playback

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12501229B2 (en) 2011-12-29 2025-12-16 Sonos, Inc. Media playback based on sensor data
US12574697B2 (en) 2011-12-29 2026-03-10 Sonos, Inc. Media playback based on sensor data
US12495258B2 (en) 2012-06-28 2025-12-09 Sonos, Inc. Calibration interface
US12498899B2 (en) 2016-02-22 2025-12-16 Sonos, Inc. Audio response playback
US12505832B2 (en) 2016-02-22 2025-12-23 Sonos, Inc. Voice control of a media playback system
US12464302B2 (en) 2016-04-12 2025-11-04 Sonos, Inc. Calibration of audio playback devices
US12450025B2 (en) 2016-07-22 2025-10-21 Sonos, Inc. Calibration assistance
US12375052B2 (en) 2018-08-28 2025-07-29 Sonos, Inc. Audio notifications
WO2023049866A3 (fr) * 2021-09-24 2023-04-27 Sonos, Inc. Règles de simultanéité pour dispositifs de microphone réseau ayant de multiples services d'assistant vocal
WO2024123319A1 (fr) * 2022-12-05 2024-06-13 Google Llc Génération d'une session d'assistant automatisé de groupe pour fournir un contenu à une pluralité d'utilisateurs par l'intermédiaire d'écouteurs
US12620395B2 (en) 2022-12-05 2026-05-05 Google Llc Generating a group automated assistant session to provide content to a plurality of users via headphones

Also Published As

Publication number Publication date
CN117316150A (zh) 2023-12-29
EP3815384A1 (fr) 2021-05-05
CN112640475A (zh) 2021-04-09
CN112640475B (zh) 2023-10-13

Similar Documents

Publication Publication Date Title
US12279096B2 (en) Systems and methods for associating playback devices with voice assistant services
US12360734B2 (en) Systems and methods for voice-assisted media content selection
US12154569B2 (en) Home graph
US12210801B2 (en) Media playback system with concurrent voice assistance
US20200110571A1 (en) Systems and methods for media content selection
US20190179611A1 (en) Systems and Methods of Receiving Voice Input
CN112640475B (zh) 用于将回放设备与语音助理服务相关联的系统和方法
US12513466B2 (en) Device designation of playback and network microphone device arrangements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19740292

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2019740292

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2019740292

Country of ref document: EP

Effective date: 20210128