Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
  • H04R3/00—Circuits for transducers
  • H04R3/02—Circuits for transducers for preventing acoustic reaction, i.e. acoustic oscillatory feedback
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
  • H04R1/00—Details of transducers, loudspeakers or microphones
  • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
  • H04R1/1016—Earpieces of the intra-aural type
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
  • H04R25/00—Electric hearing aids
  • H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback

Definitions

• a hearable includes an acoustic circuit, which can perform active noise cancellation and/or can provide a transparency mode.
• the hearable employs howling prevention to monitor for one or more conditions that can lead to the unintentional generation of howling via the acoustic circuit.
• the hearable Upon detecting a condition, the hearable appropriately configures the acoustic circuit to prevent howling from occurring.
• the hearable can quickly detect the condition and proactively adjust a gain of the acoustic circuit to maintain stability' of the acoustic circuit and avoid howling.
• With howling prevention an overall user experience with hearables is improved while supporting features such as active noise cancellation and/or a transparency mode.
• some hearables can be configured to perform howling prevention without the need for additional hardware.
• FIG. 1 illustrates an example environment in which how ling prevention can be implemented
• FIG. 2-2 illustrates an example feedback path that may cause an acoustic circuit to produce howling
• FIG. 4 illustrates example components of a hearable capable of performing howling prevention
• FIG. 6 illustrates an example implementation of a hearable
• FIG. 7 illustrates an example implementation of ho wling-prev ention logic
• FIG. 8 illustrates an example implementation of an acoustic sensor
• FIG. 10 illustrates an example implementation of a hearable capable of performing howling prevention using active acoustic sensing
• FIG. 11 illustrates an example sensor signal of an acoustic sensor for performing aspects of howling prevention
• FIG. 12 illustrates an example sensor signal of an optical sensor for performing aspects of howling prevention
• FIG. 13 illustrates an example method for performing how ling prevention
• FIG. 14 illustrates another example method for performing howling prevention using active acoustic sensing
• FIG. 15 illustrates an example computing system embodying, or in which techniques may be implemented that enable use of, howling prevention. DETAILED DESCRIPTION
• Wireless hearables can provide users freedom of movement while listening to audio content.
• some wireless hearables can provide additional features, such as active noise cancellation (ANC) or a transparency mode (TM).
• ANC active noise cancellation
• TM transparency mode
• ANC active noise cancellation
• a wireless hearable attenuates noise that is present in an external environment to make it easier for the user to hear the audio content.
• the transparency mode enables sounds from the external environment to pass through the hearable to the user’s ear.
• the transparency mode enables the hearable to function as a hearing aid and further amplify the sounds from the external environment to assist with a hearing impairment.
• acoustic circuit that performs the active noise cancellation and/or provides the transparency mode.
• One such challenge involves a susceptibility of the acoustic circuit to producing an undesired “howling’' (or “whistling”) sound.
• howling is an audible, high-intensity signal that can cause some users discomfort.
• the howling can occur when a feedback loop of the acoustic circuit becomes unstable due to a sudden injection of noise at a microphone of the hearable. In some instances, this noise injection occurs as the user repositions the hearable.
• the howling can continue to be amplified by the acoustic circuit to a level that can potentially damage the user’s hearing and/or can potentially damage components of the hearable 102 (e.g.. a speaker or the microphone).
• some hearables can detect the howling and take steps to suppress it.
• the problem with these reactive techniques is that there is an inherent delay between when the howling starts and when it is adequately suppressed. During this delay, the user can experience discomfort while listening to the howling and waiting for it to subside. As the howling sound can, at the very least, be annoying to the user, its occurrence can degrade the overall user experience with the hearable.
• a hearable includes an acoustic circuit, which can perform active noise cancellation and/or can provide a transparency mode.
• the hearable employs howling prevention to monitor for one or more conditions that can lead to the unintentional generation of howling via the acoustic circuit.
• the hearable Upon detecting a condition, the hearable appropriately configures the acoustic circuit to prevent howling from occurring.
• An example condition involves the user repositioning the hearable, which causes an insertion depth and/or an orientation of the hearable to change.
• the hearable can quickly detect the movement of the hearable and adjust a gain of the acoustic circuit to maintain stability of the acoustic circuit and avoid howling.
• howling prevention an overall user experience with hearables is improved while supporting features such as active noise cancellation and/or a transparency mode.
• some hearables can be configured to perform howling prevention without the need for additional hardware.
• FIG. 1 is an illustration of an example environment 100 in which howling prevention can be implemented.
• a hearable 102 is connected to a computing device 104 using a physical or wireless interface.
• the hearable 102 is a device that can play audio content provided by the computing device 104 and direct the audio content into a user 106’s ear 108.
• the hearable 102 operates together with the computing device 104.
• the hearable 102 can operate or be implemented as a stand-alone device.
• the computing device 104 can include other types of devices, including those described with respect to FIG. 3.
• the user 106 positions the hearable 102 at the ear 108 in a manner that creates at least a partial seal 110 around or in the ear 108. Some parts of the ear 108 are shown in FIG. 1, including the ear canal 112 and an ear drum 114 (or tympanic membrane). While positioned at the user 106’s ear 108, the hearable 102 can render the audio content to the user 106 or perform additional functions, as further described below.
• the hearable 102 includes at least one acoustic circuit 116 providing at least one of adaptive noise cancellation and/or transparency (e g., a transparency mode).
• Example acoustic circuits 116 include an active-noise-cancellation (ANC) circuit 118 (ANC circuit 118) and a transparency -mode circuit 120 (TM circuit 120).
• ANC active-noise-cancellation
• TM transparency -mode circuit 120
• a single hybrid audio circuit can provide both adaptive noise cancellation and transparency.
• the hearable 102 uses the active-noise-cancellation circuit 118, the hearable 102 performs active noise cancellation to reduce environmental sounds (e.g., background noise) at the ear 108. This can make it easier for the user 106 to hear the audio content.
• the transparency-mode circuit 120 provides (and optionally amplifies) the environmental sounds for the user 106. This can make it easier for the user 106 to hear another person speaking while wearing the hearable 102.
• a design of the acoustic circuit 116 can cause the acoustic circuit 116 to be susceptible to producing howling 122.
• Howling 122 is a high-intensity, audible sound that can cause some users 106 discomfort.
• the howling 122 can occur when a feedback loop of the acoustic circuit 116 becomes unstable due to a sudden injection of noise at a microphone of the hearable 102. Left unchecked, the howling 122 can be amplified by the acoustic circuit 116 to a level that can potentially damage the user 106’s hearing and/or can potentially damage components of the hearable 102 (e.g., a speaker or the microphone).
• the hearable 102 performs howling prevention 124, which is a proactive technique that prevents howling 122 from occurring.
• howling prevention 124 enables the acoustic circuit 116 to maintain stability ⁇ (e.g., maintain a stable condition or state) such that howling 122 is not generated by the acoustic circuit 1 16.
• the hearable 102 can employ various sensing techniques to detect one or more conditions that can lead to the unintentional generation of the howling 122 based on a current operational state of acoustic circuit 116.
• the hearable 102 can use active acoustic sensing 126, optical sensing 128, capacitive sensing 130, or some combination thereof to detect a condition.
• active acoustic sensing 126 optical sensing 128, capacitive sensing 130, or some combination thereof to detect a condition.
• optical sensing 128, capacitive sensing 130 or some combination thereof to detect a condition.
• capacitive sensing 130 or some combination thereof to detect a condition.
• Active acoustic sensing 126 involves, at least in part, measuring properties associated with an acoustic circuit that fonns between the hearable 102, the ear canal 112, and the ear drum 1 14 due to the seal 110.
• the properties of the acoustic circuit can change due to a variety 7 of different situations or actions, including movement of the hearable 102.
• the repositioning of the hearable 102 at the ear 108 can modulate an amplitude and/or phase of an acoustic signal that propagates through the ear canal 112 and is received using active acoustic sensing 126.
• Active acoustic sensing 126 can be performed without the use of other auxiliary sensors, such as an optical sensor or an electrical sensor.
• active acoustic sensing 126 can have a higher sensitivity to detecting movement of the hearable 102 compared to other sensing techniques. This is because a w avelength of an acoustic signal that is received using active acoustic sensing 126 can be, in some implementations, on-par with a distance the hearable 102 moves due to the repositioning. This causes characteristics of the acoustic signal to be modified by a significant amount (e.g., a readily detectable amount) compared to other motions that are much larger relative to the wavelength of the acoustic signal.
• a significant amount e.g., a readily detectable amount
• Optical sensing 128 can involve active and/or passive sensing techniques.
• optical sensing 128 involves detecting an optical signal that reflects off of some portion of the ear 108. In some cases, a distance can be measured based on an amount of time it takes the emitted light to be received.
• optical sensing 128 involves sensing an amount of light that is visible at the hearable 102. In other words, it determines a degree to which ambient light is blocked by the user 106’s ear 108.
• the optical signal can have frequencies associated with visible light, infrared, and/or ultraviolet light. Variations in the received optical signal can indicate movement of the hearable 102 relative to the ear 108.
• Capacitive sensing 130 involves detecting a change in capacitive coupling between the user 106's ear 108 and a sensor. As the hearable 102 moves, the measured capacitance can change and this change can be detected to determine that the user 106 is repositioning the hearable 102.
• the hearable 102 includes at least one sensor 132.
• Example sensors 132 are further described with respect to FIG. 4.
• the sensor 132 performs additional functions, such as on-head detection, biometric sensing, and so forth.
• the sensor 132 can detect movement of the hearable 102 relative to the user 106’s ear 108. This movement can occur, for instance, while the user 106 repositions the hearable 102.
• An example repositioning of the hearable 102 is further described with respect to FIG. 2-1.
• FIG. 2-1 illustrates example changes in a position of the hearable 102 relative to the user 106’s ear 108.
• the user 106 may adjust a position of the hearable 102 relative to their ear 108.
• the user 106 changes an orientation of the hearable 102 by rotating and/or twisting the hearable 102 clockwise or counter-clockwise, as indicated at 202.
• the user 106 changes an insertion depth of the hearable 102 by pushing the hearable 102 farther into their ear 108 or pulling it farther out of their ear 108, as indicated at 204.
• adjusting or re-adjusting a position of the hearable 102 can refer to changing an orientation of the hearable 102, rotating the hearable 102, changing an insertion depth of the hearable 102, changing a distance between the hearable 102 and the ear canal 112, and/or repositioning the hearable 102 at the ear 108.
• An intentional repositioning of the hearable 102 by the user 106 can have a significantly greater impact on a signal generated by the sensor 132 compared to other body motions or activities (e.g., talking, w alking, runningjumping, or chewing), which may inadvertently change a position of the hearable 102.
• signal fluctuations caused by the intentional repositioning of the hearable 102 by the user 106 can be on the order of several times greater than fluctuations indirectly caused by other activities (e g., two times greater, ten times greater, thi rty times greater, and so forth). Changing the position of the hearable 102 can sometimes lead to howling 122, as further described with respect to FIG. 2-2.
• FIG. 2-2 illustrates an example feedback path that may cause the acoustic circuit 116 to produce howling 122.
• the hearable 102 is shown to include the acoustic circuit 116, at least one speaker 206, and at least one microphone 208.
• the hearable 102 includes a first microphone 208-1 and a second microphone 208-2.
• the first microphone 208-1 represents a feedforward microphone
• the second microphone 208-2 represents a feedback microphone.
• the first microphone 208-1 is oriented towards an external environment. In other words, the first microphone 208-1 is oriented away from the user 106's ear canal 112. For active noise cancellation and/or for the transparency mode, the first microphone 208-1 provides information regarding sounds that are present within the external environment.
• the speaker 206 and the second microphone 208-2 are oriented towards the user 106’s ear canal 112. In other words, the speaker 206 and the second microphone 208-2 are oriented away from the external environment. For active noise cancellation and/or the transparency mode, the second microphone 208-2 provides information regarding the sounds that are present within the ear canal 112. This information can be used to tune the performance of the acoustic circuit 116.
• the acoustic circuit 116 is coupled to the speaker 206 and the microphones 208-1 and 208-2. A feedback path 210 exists from the speaker 206 to the second microphone 208-2. When the user 106 repositions the hearable 102 (as described with respect to FIG. 2-1), noise 212 is produced.
• this noise 212 can occur from the hearable 102 moving against the user 106’s ear 108.
• the noise 212 can be sensed by the microphone 208-2 and injected into the feedback path 210 of the acoustic circuit 116. Left unchecked, this noise 212 can cause the acoustic circuit 116 to become unstable and generate howling 122.
• the acoustic circuit 116 can selectively operate in one of multiple states 214-1 to 214-S, where S represents a positive integer that is greater than or equal to two.
• Each state 214 provides a different tradeoff between performance 216 and a howling risk 218 (e g., a risk of howling occurring due to movement of the hearable 102).
• the acoustic circuit 116 can realize a higher level of performance 216 at the cost of a higher risk of howling 122.
• the acoustic circuit 116 can accept a lower level of performance 216 to decrease the howling risk 218.
• the performance 216 can indicate a degree to which the acoustic circuit 116 cancels environmental noise at the user 106’s ear 108.
• the performance 216 can indicate a degree to which the acoustic circuit 116 provides sounds from the external environment to the user 106’s ear 108.
• the performance 216 of the acoustic circuit 116 is based, at least in part, on a gain 220 of the acoustic circuit 116. For active noise cancellation, for instance, a higher gain 220 can enable the environmental noise to be attenuated by a larger amount at the user 106’s ear 108.
• a higher gain 220 can enable the sounds from the external environment to be presented at the user 106’s ear 108 with a higher amplitude.
• the gain 220 is considered to have a direct relationship between the gain 220 of the acoustic circuit 116 and the performance 216 of the acoustic circuit 116. This means that increasing the gain 220 improves the performance 216 of the acoustic circuit 116 while decreasing the gain 220 degrades the performance 216 of the acoustic circuit 116.
• the gain 220 is considered to have a direct relationship between the gain 220 of the acoustic circuit 116 and the howling risk 218.
• the acoustic circuit 116 can operate in accordance with a first state, which is represented by state 214-1, or a second state, which is represented by state 214-S.
• the first state 214-1 represents a nonnal mode (or a responsive mode) in which the acoustic circuit 116 can quickly provide a signal with a desired amount of gain for active noise cancellation and/or for a transparency mode based on the information provided by the microphones 208-1 and/or 208-2.
• the acoustic circuit 116 applies a first amount of gain 220.
• the acoustic circuit 116 Due to the gain 220 of the first state 214-1, the acoustic circuit 116 has an increased risk of becoming unstable if noise 212 is injected into the feedback path 210. As such, the first state 214-1 has a significantly higher risk of generating howling 122 if the user 106 changes the position of the hearable 102.
• the second state 214-S represents a light mode (or a conservative mode) in which the acoustic circuit 116 provides a signal with less gain 220 for active noise cancellation and/or for to reduce the nsk of the acoustic circuit 116 becoming unstable due to noise 212.
• the acoustic circuit 116 applies a second amount of gain 220 that is less than the first amount associated with the first state 214-1.
• the smaller gain 220 of the second state 214-S enables the acoustic circuit 116 to maintain a stable condition (or improves a probability of the acoustic circuit 116 maintaining a stable condition) even if the noise 212 is injected into the feedback path 210.
• the second state 214-S significantly decreases the risk of howling 122 if the user 106 changes the position of the hearable 102.
• the first state 214-1 is designed for improving the performance 216 of the acoustic circuit 116 while the second state 214-S is designed to avoid howling 122 by reducing the howling risk 218.
• the gain 220 of the first state 214-1 is several decibels greater than the gain 220 of the second state 214-S.
• the gain 220 of the first state 214-1 can be approximately tw o, three, four, six, or ten decibels greater than the gain 220 of the second state 214-S.
• the acoustic circuit 116 can be designed to operate with any quantity of states 214.
• other states 214 can exist between the first state 214-1 and the second state 214-S to provide further options regarding the performance 216 and the howling risk 218.
• the acoustic circuit 116 includes at least one combiner 222 and at least one amplifier 224.
• the combiner 222 has inputs coupled to the microphones 208-1 and 208-2.
• the amplifier 224 is coupled between the combiner 222 and the speaker 206.
• the acoustic circuit 116 can include one or more components that are coupled between the combiner 222 and the microphones 208-1 and/or 208-2, coupled between the combiner 222 and the amplifier 224, coupled between the amplifier 224 and the speaker 206, or some combination thereof.
• the amplifier 224 represents an output amplification stage of the acoustic circuit 116.
• the gain 220 of the acoustic circuit 116 is at least partially dependent on a gain of the amplifier 224.
• the gain 220 of the acoustic circuit 116 represents the gain of the amplifier 224.
• the various states 214-1 to 214-S can specify different gains of the amplifier 224 to realize the desired performance 216 and howling risk 218.
• the gain 220 of the acoustic circuit 116 represents a gain of one or more amplifiers 224 that are coupled between the microphone 208-2 and the speaker 206.
• the amplifier 224 is at least a part of the feedback path 210 and can amplify the noise 212 that is received by the microphone 208-2. Appropriately adjusting the gain of the amplifier 224 can enable the acoustic circuit 116 to realize the target performance 216 and howling risk 218 for a particular state 214.
• One aspect of howling prevention 124 involves dynamically adjusting an active state of the acoustic circuit 116 to manage the howling risk 218 and the performance 216 of the acoustic circuit 116, as further described with respect to FIGs. 5 and 6.
• the computing device 104 and the hearable 102 are further described with respect to FIGs. 3 and 4, respectively.
• FIG. 3 illustrates an example implementation of the computing device 104.
• the computing device 104 is illustrated with various non-limiting example devices including a desktop computer 104-1, a tablet 104-2, a laptop 104-3, a television 104-4, a computing watch 104-5, computing glasses 104-6, a gaming system 104-7, a microwave 104-8, and a vehicle 104-9.
• Other devices may also be used, such as an augmented and/or virtual reality headset, a home service device, a smart speaker, a smart thermostat, a baby monitor, a Wi-FiTM router, a drone, a trackpad, a drawing pad, a netbook, an e-reader, a home automation and control system, a wall display, and another home appliance.
• the computing device 104 can be wearable, non-wearable but mobile, or relatively immobile (e.g., desktops and appliances).
• the computing device 104 includes one or more computer processors 302 and at least one computer-readable medium 304, which includes memory media and storage media. Applications and/or an operating system (not shown) embodied as computer-readable instructions on the computer-readable medium 304 can be executed by the computer processor 302 to provide some of the functionalities described herein.
• the computer-readable medium 304 can optionally include an application 306.
• the application 306 can render audio content for the user. Other implementations are also possible in which the application 306 can control an operation of the hearable 102 to activate or deactivate certain features, such as active noise cancellation and/or a transparency mode.
• the computing device 104 can also include a network interface 308 for communicating data over wired, wireless, or optical networks.
• the network interface 308 may communicate data over a local-area-network (LAN), a wireless local-area-network (WLAN), a personal-area-network (PAN), a wire-area-network (WAN), an intranet, the Internet, a peer-to- peer network, point-to-point network, a mesh network, Bluetooth®, and the like.
• the computing device 104 may also include the display 310.
• the hearable 102 can be integrated within the computing device 104, or can connect physically or wirelessly to the computing device 104. The hearable 102 is further described with respect to FIG. 4.
• FIG. 4 illustrates an example hearable 102.
• the hearable 102 is illustrated with various non-limiting example devices, including wireless earbuds 402-1, wired earbuds 402-2, and headphones 402-3.
• the earbuds 402-1 and 402-2 are a type of in-ear device that fits into the ear canal 112.
• Each earbud 402-1 or 402-2 can represent a hearable 102.
• Headphones 402-3 can rest on top of or over the ears 108.
• the headphones 402-3 can represent closed-back headphones, open-back headphones, on-ear headphones, or over-ear headphones.
• Each headphone 402-2 includes two hearables 102, which are physically packaged together. In general, there is one hearable 102 for each ear 108.
• the headphones 402-3 may be designed in some manner or may utilize techniques, such as beamforming, to assist with directing signals used for active acoustic sensing 126 into the ear canal 112.
• the hearable 102 can also represent a hearing aid (not shown).
• the hearable 102 includes at least one speaker 206, at least one microphone 208, and at least one acoustic circuit 116.
• the acoustic circuit 116 can be implemented using the active-noise-cancellation circuit 118 or the transparency -mode circuit 120.
• the hearable 102 includes both the active-noise-cancellation circuit 118 and the transparency-mode circuit 120.
• the hearable 102 also includes a communication interface 404 to communicate with the computing device 104, though this need not be used when the hearable 102 is integrated within the computing device 104.
• the communication interface 404 can be a wired interface or a wireless interface, in which audio content is passed from the computing device 104 to the hearable 102.
• the hearable 102 can also use the communication interface 404 to pass data associated with howling prevention 124 to the computing device 104.
• the data provided by the communication interface 404 is in a format usable by the application 306 or another application of the computing device 104.
• the communication interface 404 also enables the hearable 102 to communicate with another hearable 102.
• the hearable 102 includes at least one system processor 406 and at least one system medium 408 (e.g., one or more computer-readable storage media).
• the system medium 408 includes howling-prevention logic 410.
• the howling- prevention logic 410 dynamically controls an active state 214 of the acoustic circuit 116 to enhance performance and to prevent howling 122 from occurring.
• Example implementations of the howling-prevention logic 410 are further described with respect to FIGs. 6 and 7.
• the howling-prevention logic 410 is also capable of detecting a condition that can cause the acoustic circuit 116 to produce howling 122 based on information provided by one or more sensors 132. [0045] As shown in FIG.
• the hearable 102 also includes at least one sensor 132.
• the sensor 132 sensitive to movement of the hearable 102 that is caused by the user 106 repositioning the hearable 102 at their ear 108.
• the sensor 132 may not be particularly sensitive to other movements of the hearable 102 that are unintentionally caused by the user 106 performing another activity, such as walking, running, talking, and/or chewing.
• the sensor 132 is further able to detect the onset and the ending of the movement. By providing this information to the howling-prevention logic 410, the howling-prevention logic 410 and the sensor 132 operate together to perform aspects of howling prevention 124.
• the sensor 132 is also capable of performing on-head detection.
• Example sensors 132 include an acoustic sensor 412, an optical sensor 414, and a capacitive sensor 416.
• the acoustic sensor 412 can perform active acoustic sensing 126 to detect if the hearable 102 is being repositioned by the user 106.
• Active acoustic sensing 126 also known as audioplethysmography, is capable of sensing subtle changes that are observable at the user 106’s outer and middle ear.
• the acoustic sensor 412 transmits and receives acoustic signals that at least partially propagate within the user 106’s ear canal 112.
• An example implementation and operation of the acoustic sensor 412 is further described with respect to FIGs. 8 and 9, respectively.
• the acoustic sensor 412 is implemented as an ultrasound sensor.
• the acoustic sensor 412 can be implemented using existing hardware within the hearable 102.
• the acoustic sensor 412 can be implemented using the speaker 206 and the microphone 208 of the hearable 102. In this case, howling prevention 124 can be implemented without the need for additional hardware.
• the acoustic sensor 412 can also be used to perform on-head detection.
• the acoustic sensor 412 can have a faster sampling rate than another type of sensor, such as the optical sensor 414 and/or the capacitive sensor 416. This faster sampling rate can improve the reaction time for detecting the movement of the hearable 102 and appropriately configuring the acoustic circuit 116 to prevent howling 122.
• the optical sensor 414 can perform optical sensing 128 to determine whether the hearable 102 is being repositioned by the user 106.
• the optical sensor 414 is implemented using an infrared sensor.
• a footprint and cost of the infrared sensor can make it readily accessible for integrating within the hearable 102.
• Some implementations of the hearable 102 may already include an infrared sensor for on-head detection.
• the infrared sensor can also be used for howling prevention 124.
• Other example optical sensors 414 such as a camera or a photodetector, can also be implemented to perfomi aspects of howling prevention 124 for some hearables 102.
• the capacitive sensor 416 can perform capacitive sensing 130 to determine whether the hearable 102 is being repositioned by the user 106.
• the capacitive sensor 416 is implemented using a capacitor. A footprint and cost of the capacitive sensor 416 can make it readily accessible for integrating within the hearable 102.
• Some implementations of the hearable 102 may already include a capacitive sensor 416 for on-head detection. In this case, the capacitive sensor 416 can also be used for howling prevention 124.
• IMU inertial measurement unit
• radar radar
• the inertial measurement unit can be sensitive to other movements that are made by the user 106, including those associated with certain activities. In this case, additional logic may be necessary' to distinguish between movements of the hearable 102 that are caused by normal activities and movements that are caused by the intentional repositioning of the hearable 102.
• An example operation of the howling-prevention logic 410 for performing howling prevention 124 is further described with respect to FIG. 5.
• FIG. 5 illustrates an example scheme 500 implemented by the hearable 102 for performing howling prevention 124.
• the hearable 102 performs on-head detection.
• the hearable 102 uses the sensor 132 (or another sensor) to determine whether the user 106 is wearing the hearable 102 (e.g., to determine whether the hearable 102 is at the user 106’s ear 108).
• the hearable 102 determines whether on-head detection is “true” or “false”. If on-head detection is false, the hearable 102 can wait a predetermine amount of time before returning to 502 and performing on-head detection. If on-head detection is true, the hearable 102 proceeds to 506.
• the hearable 102 can optionally set an initial state of the acoustic circuit 116 at 508 prior to proceeding to 506.
• the hearable 102 can configure the acoustic circuit 116 to be in the second state 214-S when activated.
• the second state 214-S can decrease the howling risk 218 of the acoustic circuit 116 relative to the first state 214-1, as explained with respect to FIG. 2-2.
• initializing the acoustic circuit 116 at the second state 214-S instead of the first state 214-1 can better configure the acoustic circuit 116 to prevent howling 122.
• the hearable 102 detects if it is moving (e.g., determines if it is being adjusted or repositioned by the user 106). More specifically, the sensor 132 provides information that enables the howling-prevention logic 410 to determine if the hearable 102’s is moving. The movement of the hearable 102 can change its orientation and/or its insertion depth relative to the ear 108, as described with respect to FIG. 2-1. If the howling-prevention logic 410 determines that the hearable 102 is not moving (or is not moving by a sufficient amount to increase the risk of howling 122), the howling-prevention logic 410 causes the acoustic circuit 116 to operate in the first state 214-1, as shown at 510.
• the first state 214-1 enables the acoustic circuit 116 to enhance its performance 216.
• the howling-prevention logic 410 detennines that the hearable 102 is moving (e.g., is moving by a sufficient amount to increase the risk of howling 122)
• the howling-prevention logic 410 causes the acoustic circuit 116 to operate in the second state 214-S, as shown at 512.
• the second state 214-S enables the acoustic circuit 116 to decrease its howling risk 218 and prevent howling 122 from occurring.
• the active state of the acoustic circuit 116 can be dynamically set to enhance performance 216 or to enhance howling prevention 124.
• the howling-prevention logic 410 upon detecting the condition, causes the acoustic circuit 116 to operate in accordance with the second state 214-S to enhance howling prevention 124.
• howling-prevention logic 410 causes the acoustic circuit 116 to operate in accordance with the first state 214-1 to prioritize performance 216.
• these techniques are proactive in preventing howling 122 from occurring and are proactive in enhancing performance 216 when the conditions indicate that howling 122 is less likely to occur. In this way, an overall experience of the user 106 is improved.
• An example relationship between the sensor 132, the howling-prevention logic 410, and the acoustic circuit 116 is further described with respect to FIG. 6.
• the howling-prevention logic 410 is implemented using a machine- learned model 604.
• the machine-learned model 604 is composed of one or more neural networks.
• a neural network includes a group of connected nodes (e.g., neurons or perceptrons), w hich are organized into one or more layers.
• the machine-learned model 604 includes a deep neural network, which includes an input layer, an output layer, and one or more hidden layers positioned between the input layer and the output layers.
• the nodes of the deep neural network can be partially-connected or fully-connected between the layers.
• the neural network is a recurrent neural network (e.g., a long short-term memory (LSTM) neural network) with connections between nodes forming a cycle to retain infonnation from a previous portion of an input data sequence for a subsequent portion of the input data sequence.
• the neural network is a feed-forward neural network in which the connections between the nodes do not form a cycle.
• the machine-learned model 604 includes another type of neural network, such as a convolutional neural network.
• the machine-learned model 604 can also include one or more types of classification models.
• the machine-learned model 604 can be implemented using a single-channel -input machine-learned model or a multi-channel-input machine-learned model.
• the single-channel-input machine-learned model accepts information from a single sensor 132.
• the multi-channel-input machine-learned model accepts information from multiple sensors 132.
• an output of the machine-learned model 604 can indicate whether or not a condition that can cause howling 122 is detected (e.g., indicate whether or not the hearable 102 is moving by a significant amount that can lead to howling 122).
• the speaker 804 and the microphone 806 of the acoustic sensor 412 are directed towards the ear canal 112 (e g., oriented towards the ear canal 112). Accordingly, the speaker 804 can direct acoustic signals towards the ear canal 112, and the microphone 806 is responsive to receiving acoustic signals from the direction associated with the ear canal 112.
• the acoustic sensor 412 also includes at least one system processor 810 and at least one system medium 812 (e.g., one or more computer-readable storage media).
• the system medium 812 includes a pre-processing module 814 and optionally includes a calibration module 816.
• the pre-processing module 814 and the calibration module 816 can be implemented using hardware, software, firmware, or a combination thereof.
• the system processor 810 implements the pre-processing module 814 and the calibration module 816.
• the system processor 406 of the hearable 102 can implement at least a portion of the pre-processing module 814 and the calibration module 816. Operations of the pre-processing module 814 and the calibration module 816 are further described with respect to FIG. 10.
• FIG. 9 illustrates example operations of two hearables 102-1 and 102-2.
• the hearables 102-1 and 102-2 perform single-ear active acoustic sensing 126.
• the hearables 102-1 and 102-2 independently perform active acoustic sensing 126 on different ears 108 of the user 106.
• the first hearable 102-1 is proximate to (arranged at) the user 106’s right ear 108
• the second hearable 102-2 is proximate to (arranged at) the user 106‘s left ear 108.
• Each hearable 102-1 and 102-2 includes an acoustic sensor 412-1 and 412-2.
• the hearables 102-1 and 102-2 can operate in a monostatic manner during the same time period or during different time periods. In other words, each hearable 102-1 and 102-2 can independently transmit and receive ultrasound signals.
• the two hearables 102-1 and 102-2 perform two-ear active acoustic sensing 126. This means that the hearables 102-1 and 102-2 jointly perform acoustic sensing 126 across two ears 108 of the user 106. The hearables 102-1 and 102-2 operate together in a bistatic manner during the same time period.
• the first hearable 102-1 transmits a third acoustic transmit 902-3 using the acoustic sensor 412-1.
• the third acoustic transmit signal 902-3 propagates through the user 106’s right ear canal 112.
• the third acoustic transmit signal 902-3 also propagates through an acoustic channel that exists between the right and left ears 108.
• the third acoustic transmit signal 902-3 propagates through the user 106's left ear canal 112 and is represented as a third acoustic receive signal 904-3.
• the second hearable 102-2 receives the third acoustic receive signal 904-3 using the acoustic sensor 412-2.
• the third acoustic receive signal 904-3 represents a version of the third acoustic transmit signal 902-3 that is modified by the acoustic circuit associated with the right ear canal 112. modified by the acoustic channel associated with the user 106’s face, and modified by the acoustic circuit associated with the left ear canal 1 12. This modification can change an amplitude, phase, and/or frequency of the third acoustic receive signal 904-3 relative to the third acoustic transmit signal 902-3.
• the hearable 102-2 measures the time-of-flight (ToF) associated with the propagation from the first hearable 102-1 to the second hearable 102-2.
• ToF time-of-flight
• the acoustic transmit signals 902 of FIG. 9 can represent a variety of different types of signals as described above with respect to FIG. 8.
• the acoustic transmit signal 902 can be a continuous-wave signal (e.g., a sinusoidal signal) or a pulsed signal.
• Some acoustic transmit signals 902 can have a particular tone (or frequency).
• Other acoustic transmit signals 902 can have multiple tones (or multiple frequencies).
• a variety' of modulations can be applied to generate the acoustic transmit signal 902.
• Example modulations include linear frequency modulations, triangular frequency modulations, stepped frequency modulations, phase modulations, or amplitude modulations.
• FIG. 10 illustrates an example implementation of the hearable 102 capable of performing howling prevention 124 using active acoustic sensing 126.
• the hearable 102 includes the acoustic sensor 412, which is coupled to the howling-prevention logic 410.
• the acoustic sensor 412 includes the speaker 804, the microphone 806, the analog circuit 808, the pre-processing module 814, and the calibration module 816.
• Other implementations of the hearable 102 are also possible in which the hearable 102 does not include the calibration module 816 to reduce processing power requirements.
• the preprocessing module 814 can perform aspects of frequency selection as further described below to improve the signal-to-noise ratio for active acoustic sensing 126.
• Outputs of the speaker 804 and the microphone 806 are coupled to inputs of the analog circuit 808.
• the pre-processing module 814 has inputs that are coupled to outputs of the analog circuit 808.
• the pre-processing module 814 also has an output that is coupled to inputs of the howling-prevention logic 410 and the calibration module 816.
• the pre-processing module 814 includes at least one in-phase and quadrature mixer (I/Q mixer) and at least one filter.
• the in-phase and quadrature mixer performs frequency down-conversion and can be implemented using at least two mixers, at least one phase shifter, and at least one combiner (e.g., a summation circuit).
• the filter attenuates intermodulation products that are generated by the in-phase and quadrature mixer.
• the filter is implemented using a low-pass filter.
• the pre-processing module 814 can optionally include at least one frequency selector.
• the frequency selector can identify and select one or more tones (or carrier frequencies) that provide a high-quality signal for later processing.
• the frequency selector can further pass the selected tones to other processing modules (e.g., the howling-prevention logic 410) and filter (or attenuate) other tones that are not selected.
• the frequency selector can be implemented in a similar manner as the calibration module 816, which is further described below'.
• the calibration module 816 has an output that is coupled to the speaker 804.
• the calibration module 816 includes at least one frequency selector.
• the frequency selector can include at least one amplitude detector, at least one phase detector, at least one quality detector, and at least one comparator. Using the frequency selector, the calibration module 816 can perform a calibration procedure that determines appropriate characteristics (e.g., waveform or signal characteristics) of acoustic transmit signals 902 to improve active acoustic sensing 126 (e.g., to enhance the perfomiance of howling prevention 124).
• the calibration procedure enables active acoustic sensing 126 to take into account the wear of the hearable 102 (e.g., the position of the hearable 102 relative to the ear canal 112) and the physical structure of the ear canal 112 to determine a transmission frequency that can increase sensitivity.
• the hearable 102 includes the calibration module 816. With the calibration module 816, the hearable 102 can perform a calibration procedure prior to performing a measurement procedure.
• the acoustic sensor 412 can perform on-head detection (or in-ear detection) by detecting the presence of the seal 110 and initiating the calibration procedure and/or the measurement procedure based on a determination that on-head detection is “true.” In other circumstances, the acoustic sensor 412 can initiate the calibration procedure based on a specified schedule or a timer, which can be controlled by the user 106 via the computing device 104 or the hearable 102.
• the calibration procedure and the measurement procedure are further descnbed below.
• the speaker 804 transmits the acoustic transmit signal 902 and the microphone 806 receives the acoustic receive signal 904.
• the acoustic transmit signal 902 and the acoustic receive signal 904 can have tones 1002-1 to 1002-M, where M represents a positive integer.
• the multiple tones 1002-1 to 1002-M can be transmitted in parallel or in series over a given time interval.
• the acoustic transmit signal 902 can have a particular bandwidth on the order of several kilohertz.
• the acoustic transmit signal 902 can have a bandwidth of approximately 4. 5, 6, 8, 10, 16, or 20 kHz.
• the acoustic transmit signal 902 is transmitted over multiple seconds, such as 2, 3, 4, 6, or more seconds.
• a duration of each tone 1002 can be evenly divided over a total duration of the acoustic transmit signal 902.
• the acoustic transmit signal 902 for the calibration procedure can have seven tones 1002 (e.g., equals 7).
• the tones 1002 are evenly distributed across an interval.
• the tones 1002 can be in 1 kHz increments between 32 kHz and 38 kHz (e.g., at approximately 32, 33, 34, 35, 36, 37, and 38 kHz).
• the term “approximately” means that the tones 1002 can be within 5% of a given value or less (e.g., within 3%, 2%, or 1% of the given value).
• An amplitude of the calibration procedure’s acoustic transmit signal 902 can be approximately the same across the tones 1002-1 to 1002-M. In this manner, power is evenly distributed across each tone 1002.
• the quantity of tones 1002 (e.g., M) can be determined based on an output power of the speaker 804. Increasing the quantity of tones 1002 can increase a likelihood that the hearable 102 can support howling prevention 124 across various conditions including user wear and a physical structure of the user 106’s ear canal 112. However, an amplitude of the acoustic transmit signal 902 can be limited across these tones 1002 based on the output power of the speaker 804. Thus, the quantity of tones 1002 can be optimized based on an amount of output power that is available for active acoustic sensing 126.
• the acoustic transmit signal 902 and the acoustic receive signal 904 can have selected tones 1004-1 to 1004-N, where /V represents a positive integer that is less than or equal to M.
• the selected tones 1004-1 to 1004-N can represent a subset (sometimes a proper subset) of the tones 1002-1 to 1002-M.
• the selected tones 1004 can be transmitted in parallel or in series over a given time interval.
• An amplitude of the measurement procedure’s acoustic transmit signal 902 can be approximately the same across the selected tones 1004-1 to 1004-N. In this manner, power is evenly distributed across each selected tone.
• the amplitude of the measurement procedure’s acoustic transmit signal 902 can be higher than the amplitude of the calibration procedure’s acoustic transmit signal 902 because the available output power is distributed across fewer tones.
• a duration of each of the selected tones 1004 of the measurement procedure’s acoustic transmit signal 902 can be longer than the duration of the tones 1002 of the calibration procedure’s acoustic transmit signal 902.
• the higher amplitude and/or the longer duration can further improve the signal-to-noise ratio performance of the acoustic sensor 412 for active acoustic sensing 126.
• the measurement procedure can achieve a higher level of accuracy and sensitivity for howling prevention 124.
• the analog circuit 808 performs analog-to-digital conversion to generate a digital transmit signal 1006 and a digital receive signal 1008 based on the acoustic transmit signal 902 and the acoustic receive signal 904, respectively.
• the pre-processing module 814 perfonns frequency downconversion and demodulation to generate at least one pre-processed signal 1010 based on the digital transmit signal 1006 and the digital receive signal 1008.
• the pre-processing module 814 can also apply filtering to generate the pre-processed signal 1010.
• the calibration module 816 processes the pre-processed signal 1010 to determine the selected tones 1004-1 to 1004-N.
• the selected tones 1004-1 to 1004-N can improve performance of active acoustic sensing 126 during the measurement procedure.
• the calibration module 816 extracts the amplitude and/or phase of the pre-processed signal 1010 using the amplitude detector and the phase detector, respectively.
• the quality detector of the calibration module 816 measures quality metrics for each tone (or frequency) of the pre-processed signal 1010 and for each of the characteristics (e g., amplitude and/or phase).
• Example quality metrics can include peak-to-average ratios and/or signal-to-noise ratios.
• the peak-to-average ratio represents a peak intensity within a frequency range of interest divided by an average intensity within this frequency range.
• a higher quality metric indicates a higher-quality signal, or more generally, better performance for active acoustic sensing 126.
• the comparator of the calibration module 816 can evaluate the quality metrics with respect to a threshold. In an example implementation, the comparator determines the selected tones 1004-1 to 1004-N for a subsequent measurement procedure based on the frequencies associated with the quality metrics that are greater than or equal to a threshold. Additionally or alternatively, the comparator can evaluate the quality metrics with respect to each other. In an example implementation, the comparator determines one of the selected tones based on a frequency with the highest quality metric across the amplitude. Also, the comparator can determine one of the selected tones 1004-1 to 1004-N based on a frequency with the highest quality metric across the phase. In other implementations, the comparator can determine a single selected tone based on a frequency having the highest quality metric associated with either the amplitude or the phase.
• the calibration module 816 enables the selected tones 1004-1 to 1004-N to be dynamically adjusted prior to the measurement procedure based on a current environment, which can account for a wear of the hearable 102 (e.g., a current insertion depth and/or rotation), a physical structure of the user 106’s ear canal 112, and a response characteristic of the hearable 102 (e.g., speaker, microphone, and/or housing). In this manner, the calibration module 816 can improve the signal-to-noise ratio performance of the acoustic sensor 412 for the measurement procedure.
• the calibration module 816 can also determine which tones 1004 generate acoustic receive signals 904 with desired characteristics for howling prevention 124. In general, the calibration procedure can be performed whether or not the user 106 is speaking.
• the calibration module 816 communicates the selected tones 1004-1 to 1004-N to the speaker 804 using a control signal.
• the speaker 804 accepts the control signal that identifies the selected tones 1004-1 to 1004-N and can transmit a subsequent acoustic transmit signal 902 for howling prevention 124 using the selected tones 1004-1 to 1004-N.
• the hearable 102 can dynamically adjust the transmission frequency (e.g., one or more carrier frequencies) each time the seal 110 is formed (e.g., based on the wear of the hearable 102) and based on the unique physical structure of the ear 108. Through this calibration procedure, the hearables 102 on different ears 108 may operate with one or more different ultrasound frequencies.
• the howling-prevention logic 410 can perform aspects of howling prevention 124 using the pre-processed signal 1010 to generate the control signal 610.
• the pre-processed signal 1010 represents the sensor signal 608 of FIG. 6.
• the howling-prevention logic 410 analyzes the pre- processed signal 1010 and detects a significant variation or fluctuation in an amplitude and/or phase of the pre-processed signal 1010. This variation is caused by the movement of the hearable 102 as the user 106 repositions the hearable 102 at the ear 108.
• the how ling-prevention logic 410 can be implemented in a variety of ways to detect the variation in the pre-processed signal 1010, as described with respect to FIGs. 6 and 7.
• the term “significantly'’ can mean that the values of the amplitude and/or the phase can change by 20% or more relative to a previous value (e.g., relative to an average of a set of previous values). Additionally or alternatively, a slope of the amplitude and/or the phase can vary significantly. Sometimes the slope of the amplitude and/or the phase can change signs (e.g., from a positive slope to a negative slope, or vice versa). A magnitude of the slope of the amplitude and/or the phase can sometimes change by approximately 10% or more.
• the calibration procedure and the measurement procedure are described as individual procedures that occur at different time intervals.
• the calibration procedure occurs before the measurement procedure.
• the acoustic transmit signal 902 for the measurement procedure to be transmitted with fewer tones than the acoustic transmit signal 902 used for the calibration procedure, which can increase signal-to-noise ratio performance for active acoustic sensing 126.
• the hearable 102 can have sufficient output power to perform the measurement procedure with the multiple tones 1002-1 to 1002-M using a single acoustic transmit signal 902.
• aspects of the calibration module 816 can be integrated within the pre-processing module 814 via a frequency selector. This frequency selector can effectively pass the selected tones 1004-1 to 1004-N to the howling-prevention logic 410.
• FIGs. 11 and 12 illustrate an impact of a user 106’s repositioning the hearable 102 on different types of sensor signals 608.
• the repositioning of the hearable 102 can significantly impact an amplitude (or an intensity) and/or a phase of the sensor signal 608.
• the change in the amplitude and/or the phase can be relative to a previous state or relative to a previous trend in the amplitude and/or the phase.
• the previous state can refer to values of the amplitude and/or the phase during which the user 106 does not intentionally move the hearable 102.
• the user 106 may or may not be performing other activities during this time.
• 11 includes a graph 1100 of an amplitude 1102 and a phase 1104 of a sensor signal 608 that is generated by an acoustic sensor 412.
• time is depicted along the horizontal axis.
• the user 106 repositions the hearable 102, as indicated at 1106. This causes the amplitude 1102 and/or the phase 1104 of the acoustic receive signal 904 to change significantly relative to a previous state (e.g., a state prior to time TO).
• a previous state e.g., a state prior to time TO.
• the howling-prevention logic 410 can detect that the user 106 is repositioning the hearable 102 based on the change in the amplitude 1102 and/or the phase 1104 of the sensor signal 608.
• FIG. 12 includes a graph 1200 of an intensity 1202 of a sensor signal 608 that is generated by an optical sensor 414.
• the optical sensor 414 is an infrared sensor.
• time is depicted along the horizontal axis.
• the user 106 repositions the hearable 102, as indicated at 1204. This causes the intensity of the sensor signal 608 to change significantly relative to a previous state (e.g., a state prior to time TO).
• the howling-prevention logic 410 can detect that the user 106 is repositioning the hearable 102 based on the change in the intensity of the sensor signal 608.
• FIGs. 13 and 14 depict example methods 1300 and 1400 for implementing aspects of howling prevention 124.
• Methods 1300 and 1400 are shown as sets of operations (or acts) performed but not necessarily limited to the order or combinations in which the operations are shown herein. Further, any of one or more of the operations may be repeated, combined, reorganized, or linked to provide a wide array of additional and/or alternate methods.
• an acoustic circuit of a hearable is caused to operate in accordance with a first state.
• the first state has a first amount of gain.
• the howling-prevention logic 410 causes the acoustic circuit 116 to operate in accordance with the first state 214-1, which has a first amount of gain 220.
• the first state 214-1 can represent a state 214 with the largest gain 220, and thereby the highest performance 216 and the highest howling risk 218.
• the gain 220 represents a gain of an amplifier 224 that is positioned within at least the feedback path 210 of the acoustic circuit 11 .
• the amplifier 22 can be part of an output amplification stage of the acoustic circuit 116 in some cases.
• the howling-prevention logic 410 detects, during a first time period and using at least one sensor 132 of the hearable 102, movement of the hearable 102 relative to the ear 108 of the user 106.
• the movement can involve a change in an orientation of the hearable 102, as shown at 200-1 in FIG. 2-1, and/or a change in an insertion depth of the hearable 102, as shown at 200-2 in FIG. 2-1.
• the at least one sensor 132 can be implemented using an acoustic sensor 412 (e.g., an ultrasound sensor), an optical sensor 414 (e.g., an infrared sensor), a capacitive sensor 416, or some combination thereof.
• the acoustic circuit is caused to operate in accordance with a second state based on the detecting.
• the second state has a second amount of gain that is less than the first amount.
• the howling-prevention logic 410 causes the acoustic circuit 116 to operate in accordance with a second state 214-S based on the detecting.
• the second state 214-S has a second amount of gain 220 that is less than the first amount.
• a difference between the second amount and the first amount is at least one decibel.
• the difference can be equal to approximately 1, 2, 4, or 6 decibels.
• the second state 214-S can represent a state 214 with the smallest gain 220, and thereby the lowest performance 216 and the lowest howling risk 218.
• active acoustic sensing is performed to detect movement of the hearable.
• the movement is caused by a user repositioning the hearable at their ear.
• the hearable 102 performs active acoustic sensing 126 using the acoustic sensor 412 to detect movement of the hearable 102, which is caused by the user 106 repositioning the hearable 102 at their ear 108.
• the hearable 102 transmits and receives an acoustic signal (e.g., transmits the acoustic transmit signal 902 and receives the acoustic receive signal 904).
• the hearable is determined to have moved based on the active acoustic sensing.
• the hearable 102 uses the howling- prevent! on logic 410 to determine that the hearable 102 moved (or is moving) based on the active acoustic sensing 126.
• the howling- prevention logic 410 can make this determination by analyzing the acoustic receive signal 904 using signal-processing techniques or using machine-learning techniques. In some examples, the howling-prevention logic 410 analyzes the mean 722, the variance 728, and/or the cumulative sum 730 of the acoustic receive signal 904 to make this determination.
• an active state of an acoustic circuit is controlled based on the determination.
• the howling-prevention logic 410 generates the control signal 610, which controls the active state 612 of the acoustic circuit 116.
• the active state 612 of the acoustic circuit 116 is controlled in a manner so as to prevent howling 122 from occurring or at least to significantly decrease a probability of howling 122 occurring due to the movement of the hearable 102.
• FIG. 15 illustrates various components of an example computing system 1500 that can be implemented as any ty pe of client, server, and/or computing device as described with reference to the previous FIGs. 3 and 4 to implement aspects of howling prevention 124 using a hearable 102.
• the computing system 1500 includes communication devices 1502 that enable wired and/or wireless communication of device data 1504 (e.g., received data, data that is being received, data scheduled for broadcast, or data packets of the data).
• the communication devices 1502 or the computing system 1500 can include one or more hearables 102.
• the device data 1504 or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with a user of the device.
• Media content stored on the computing system 1500 can include any ty pe of audio, video, and/or image data.
• the computing system 1500 includes one or more data inputs 1506 via which any ty pe of data, media content, and/or inputs can be received, such as human utterances, user-selectable inputs (explicit or implicit), messages, music, television media content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source.
• the computing system 1500 also includes communication interfaces 1508, which can be implemented as any one or more of a serial and/or parallel interface, a wireless interface, any type of network interface, a modem, and as any other type of communication interface.
• the communication interfaces 1508 provide a connection and/or communication links between the computing system 1500 and a communication network by which other electronic, computing, and communication devices communicate data with the computing system 1500.
• the computing system 1500 includes one or more processors 1510 (e.g., any of microprocessors, controllers, and the like), which process various computer-executable instructions to control the operation of the computing system 1500.
• processors 1510 e.g., any of microprocessors, controllers, and the like
• the computing system 1500 can be implemented with any one or combination of hardware, firmware, or fixed logic circuitry' that is implemented in connection with processing and control circuits which are generally identified at 1512.
• the computing system 1500 can include a system bus or data transfer system that couples the various components within the device.
• a system bus can include any one or combination of different bus structures, such as a memory' bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
• the computing system 1500 also includes a computer-readable medium 1514, such as one or more memory devices that enable persistent and/or non-transitory data storage (i.e., in contrast to mere signal transmission), examples of which include random access memory' (RAM), non-volatile memory (e.g., any one or more of a read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device.
• RAM random access memory
• non-volatile memory e.g., any one or more of a read-only memory (ROM), flash memory, EPROM, EEPROM, etc.
• the disk storage device may be implemented as any ty pe of magnetic or optical storage device, such as a hard disk drive, a recordable and/or rewriteable compact disc (CD), any type of a digital versatile disc (DVD), and the like.
• the computing system 1500 can also include a mass storage medium device (storage medium) 1516.
• the computer-readable medium 1514 provides data storage mechanisms to store the device data 1504, as well as various device applications 1518 and any other types of information and/or data related to operational aspects of the computing system 1500.
• an operating system 1520 can be maintained as a computer application with the computer-readable medium 1514 and executed on the processors 1510.
• the device applications 1518 may include a device manager, such as any form of a control application, software application, signal-processing and control module, code that is native to a particular device, a hardware abstraction layer for a particular device, and so on.
• the device applications 1518 also include any system components, engines, or managers to implement howling prevention 124.
• the device applications 1518 include the howling-prevention logic 410.
• Example 1 A method performed by a hearable that is positioned at an ear of a user, the method comprising: causing an acoustic circuit of the hearable to operate in accordance with a first state, the first state having a first amount of gain; detecting, during a first time period and using at least one sensor of the hearable, movement of the hearable relative to the ear of the user; and causing, based on the detecting, the acoustic circuit to operate in accordance with a second state, the second state having a second amount of gain that is less than the first amount.
• Example 2 The method of example 1, wherein: the causing of the acoustic circuit to operate in accordance with the second state results in preventing the acoustic circuit from generating howling.
• Example 3 The method of any previous example, wherein the movement of the hearable is caused by the user repositioning the hearable at their ear during the first time period.
• Example 4 The method of example 3, wherein the detecting of the movement of the hearable comprises at least one of the following: detecting, during the first time period and using the at least one sensor, a change in an orientation of the hearable relative to the ear of the user; and/or detecting, during the first time period and using the at least one sensor, a change in an insertion depth of the hearable relative to the ear of the user.
• Example 5 The method of any previous example, further comprising: detecting, during a second time period and using the at least one sensor, cessation of the movement of the hearable; and causing, based on the detecting, the acoustic circuit to operate in the first state.
• Example 6 The method of example 5, further comprising: detecting, during a third time period and using the at least one sensor of the hearable, that the hearable is relatively stationary, the user performing an activity during the third time period; and causing, based on the detecting, the acoustic circuit to remain in the first state.
• Example 7 The method of example 6, wherein the activity comprises the user performing at least one of the following: talking; walking; running; or chewing.
• Example 8 The method of any previous example, further comprising at least one of the following: performing, using the at least one sensor, active acoustic sensing to detect the movement of the hearable; performing, using the at least one sensor, optical sensing to detect the movement of the hearable; and/or performing, using the at least one sensor, capacitive sensing to detect the movement of the hearable.
• Example 9 The method of example 8, wherein: the at least one sensor comprises a first sensor; the performing of the active acoustic sensing comprises: transmitting, using the first sensor, an acoustic transmit signal that propagates within at least a portion of an ear canal of the user; and receiving, using the first sensor, an acoustic receive signal, the acoustic receive signal representing a version of the acoustic transmit signal with one or more characteristics modified based on the propagation within the ear canal and based on the movement of the hearable relative to the ear of the user; and the detecting of the movement of the hearable comprises detecting the movement of the hearable based on the acoustic receive signal.
• Example 10 The method of example 9, wherein the detecting of the movement of the hearable comprises one or more of the following: detecting the movement of the hearable based on a change in a mean of an amplitude and/or a phase of the acoustic receive signal being greater than a first threshold; detecting the movement of the hearable based on a variance of the amplitude and/or the phase of the acoustic receive signal being greater than a second threshold; and/or detecting the movement of the hearable based on a cumulative summation of the amplitude and/or the phase of the acoustic receive signal being greater than a third threshold.
• Example 11 The method of example 9 or 10, wherein: the at least one sensor further comprises a second sensor; the performing of the optical sensing comprises generating, using the second sensor, a signal having an intensity that varies based on an amount of light that is sensed by the second sensor; and the detecting the movement of the hearable comprises detecting the movement of the hearable based on a fluctuation in the acoustic receive signal and based on a fluctuation in the intensity of the signal.
• Example 12 The method of any previous example, further comprising: prior to causing the acoustic circuit to operate in accordance with the first state, determining, using the at least one sensor, that the hearable is relatively stationary, wherein the causing the acoustic circuit to operate in accordance with the first state is based on the determining that the hearable is relatively stationary.
• Example 13 The method of example 12, further comprising: prior to detennining that the hearable is relatively stationary', determining, using the at least one sensor, that the hearable is being worn by the user.
• Example 14 The method of any previous example, further comprising: performing active noise cancellation using the acoustic circuit; or providing a transparency mode using the acoustic circuit.
• Example 15 A non-transitory computer-readable storage medium comprising instructions that, responsive to execution by a processor, cause a hearable to perform any one of the methods of examples 1 to 14.
• Example 16 A hearable comprising: at least one sensor; at least one acoustic circuit; and at least one processor, the hearable configured to perform, using the at least one sensor and the at least one processor, any one of the methods of examples 1 to 14.
• Example 17 The hearable of example 16, wherein the at least one sensor comprises at least one of the following: an acoustic sensor; an infrared sensor; or a capacitive sensor.
• Example 18 The hearable of example 17, further comprising: a speaker coupled to the at least one acoustic circuit; and a microphone coupled to the at least one acoustic circuit, wherein: the at least one sensor comprises the acoustic sensor; and the acoustic sensor is coupled to the speaker and the microphone.
• Example 19 The hearable of any one of examples 16 to 18, wherein the at least one acoustic circuit comprises at least one of the following: an active-noise-cancellation circuit; or a transparency-mode circuit.
• Example 20 The hearable of any one of examples 16 to 19, wherein the device comprises at least one earbud.

Landscapes

• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Acoustics & Sound (AREA)
• Signal Processing (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Otolaryngology (AREA)
• Circuit For Audible Band Transducer (AREA)

Applications Claiming Priority (1)

Publications (1)

Family

ID=91586149

Family Applications (1)

Country Status (2)

Family Cites Families (2)

• 2024
  • 2024-05-24 EP EP24734668.7A patent/EP4677863A1/de active Pending
  • 2024-05-24 WO PCT/US2024/030960 patent/WO2025244651A1/en active Pending

Also Published As

Similar Documents

Legal Events