WO2009139726A1 - Portable audio enhancement and media player device - Google Patents

Portable audio enhancement and media player device Download PDF

Info

Publication number
WO2009139726A1
WO2009139726A1 PCT/SG2009/000161 SG2009000161W WO2009139726A1 WO 2009139726 A1 WO2009139726 A1 WO 2009139726A1 SG 2009000161 W SG2009000161 W SG 2009000161W WO 2009139726 A1 WO2009139726 A1 WO 2009139726A1
Authority
WO
WIPO (PCT)
Prior art keywords
external device
data
portable
audio
media player
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/SG2009/000161
Other languages
French (fr)
Inventor
Yew Teng Too
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Creative Technology Ltd
Original Assignee
Creative Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Creative Technology Ltd filed Critical Creative Technology Ltd
Priority to CN2009801175354A priority Critical patent/CN102027444A/en
Priority to EP09746883A priority patent/EP2286329A4/en
Publication of WO2009139726A1 publication Critical patent/WO2009139726A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43622—Interfacing an external recording device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Definitions

  • This invention relates generally to audio enhancement and media player devices, and more particularly to a portable device with media player functionality that enables an electronic product such as a personal computer to obtain enhanced audio output.
  • the consumer electronics market includes different types of electronic devices such as personal computers, personal digital assistants (PDA), cellular phones, televisions, etc. that are equipped to playback media having different data formats.
  • PDA personal digital assistants
  • One of the most popular types of such consumer electronic devices is portable media playback devices. These portable media playback devices come in all sizes and offer a variety of functionalities. However, these portable media playback devices are typically stand-alone devices, and at the very most, also serve as an additional data storage device for a user. Such devices typically do not have any secondary functionality.
  • An aspect of the invention is a portable media processing device for connecting with and enabling an external device with audio enhancement functionality, the portable device comprising a housing and a connector interface for connecting and exchanging data with the external device; a media player module for processing data; and a controller for identifying the data received from the external device and selectively controlling the media player module for processing the data from the external device and supplying the processed data.
  • An embodiment of the invention is a user interface port for connecting user interface devices.
  • the user interface device may be selected from the group consisting of: speakers, earphones, headphones, displays, and monitors.
  • the portable media processing device may further comprise a player module having an audio data processor, and a media data processor.
  • the portable media processing device may further comprise data storage for storing the processed data.
  • the controller may supply the processed data to either the external device or the user interface port.
  • the connector interface may be a USB connector interface or a firewire connector interface.
  • the external device may be a device selected from the group consisting of a notebook, a personal computer, a television, a mobile telephone, a games console, a camera, a CD player, and a DVD player. A portion of memory allocated for the processing of audio signals in the external device may be freed up for use by a processor in the external device and processing of non-audio related tasks in the external device is enhanced.
  • An aspect of the invention is a method for enabling an external device with audio enhancement functionality with a portable media processing device, the portable device comprising connecting the portable device having a housing and a connector for connecting the portable device to the external device; receiving data from the external device; identifying the data received from the external device; selectively controlling a media player module, the media player module for processing the data; supplying the processed data to either the external device or a user interface port.
  • FIG. 1 illustrates a block diagram of a portable device in accordance with an embodiment of the invention.
  • FIG. 2 illustrates a flow chart of a method in accordance with an embodiment of the invention.
  • the portable media processing device 10 connects with an external device 50 and enables the external device 50 with audio enhancement functionality.
  • the external device 50 may be, for example, a notebook, a personal computer, a television, a mobile telephone, a games console, a camera, a CD player, a DVD player and so forth.
  • the portable device 10 comprises housing 40 for a controller 22 and a storage 24 connected to the controller 22.
  • the controller 22 is connected to a media player module 12.
  • the media player module 12 has data processors 16,18.
  • the portable device 10 has a connector interface 20 that connects to a corresponding connector interface 52 of the external device 50. Through the connector interfaces 20,52 the portable device 10 is able to exchange data with the external device 50 when the portable device 10 is connected to the external device 50.
  • the portable device 10 is able to function independently as a media playback device in a first mode when the portable device 10 is not connected to the external device 50.
  • the controller 22 receives media data from the storage 24. Subsequently, the controller 22 identifies the media data and selectively controls the media player module 12 to process the data using at least one of the media data processor 18, and the audio data processor 16. The processed data is then sent back to the controller 22 and is subsequently sent to the user interface connect 26 for audio output 32 and display output 34.
  • the audio output 32 may include, for example, speakers, earphones, headphones and so forth.
  • the controller 22 receives audio data from the external device 50.
  • the controller 22 identifies the audio data received from the external device 50 and selectively controls the media player module 12 to process the data.
  • the audio data may be processed using the audio data processor 16.
  • the data processed by the audio data processor 16 is returned to the controller 22 and may transmit the processed data either to the external device 50 or to a user interface connect 26 within the portable device 10.
  • the user interface connect 26 may comprise a port or another connector for connecting external user interface devices.
  • the external user interface devices include audio input 30, output devices 32 such as, for example, speakers, earphones, headphones and so forth.
  • Other external user interface devices include output display devices 34 such as, for example, displays, monitors and the like.
  • the audio data processor 16 in the media player module 12 may enable the incorporation of advanced sound enhancement effects. These advanced effects cover a wide range including but not limited to 3D audio spatialization (virtualization) and transient enhancement.
  • the portable device 10 is configured to receive an audio input signal through the connect interface 20, in analog or digital form, consequently enhance the received signal in media player module 12, and subsequently transmit an output audio signal through the user interface connect 26 having the enhanced effects embedded in the signal.
  • the output signal may be either digital or analog.
  • the output signal may be, for example, a mono signal, a stereo signal, a MIDI signal, or a multichannel signal (such as 2.1, 5.1 , 7.1, etc.).
  • the audio enhancements include but are not limited to dramatic improvements to the recording and playback of MP3 music, enhancement to the listening experiences for movies, and improvements in general to the capabilities, performance and quality of audio and music creation.
  • the media player module 12 is configured to enable the user to select from several surround audio enhancement effects and to control the amount of the effect to suit the users' preferences.
  • these audio enhancements are commercially available in computer sound cards provided by Creative Technologies Ltd.
  • the X-Fi soundcard provided by Creative Technologies Ltd. presently allows a user options including MultiSpeaker Surround 3D Surround, MultiSpeaker Surround 3D Headphone, MultiSpeaker Surround 3D Virtual, X-Fi Crystalizer, Dolby Digital decoder, DTS-lnteractive 5.1 Encoder.
  • X-Fi CMSS®-3D enables a user to upgrade MP3 music and movies into surround sound with headphones or multichannel speakers. This is important because it enables a consumer to enjoy stereo MP3s and movies in surround sound created with X-Fi CMSS®-3D technology. While the present invention is intended to include the basic upmixing of stereo content, the audio enhancement module 12 is preferably configured to remix the audio intelligently to match the speaker system (including headphones).
  • the audio enhancement techniques that may be configured into the media player module 12 include advanced techniques to extract specific audio elements so music and movies sound more alive than ever, i.e., to add in one embodiment "punchiness".
  • the potential benefits when listening to or creating music are abundant.
  • static stereo music may be converted into surround sound suitable for playback over multichannel speakers.
  • the enhanced listening experience is provided when listening to music tracks, the invention includes other forms of media content.
  • videos or movies may be enhanced to provide surround sound over headphones or speakers.
  • an example surround sound processing technique suitable for integration into the module to enjoy movies is the X-Fi CMSSO-3D.
  • X-Fi CMSSO-3D Surround Provides a multichannel playback for stereo music or movies.
  • X-Fi CMSS®-3D Headphone Provides a multichannel playback experience over headphones for all types of content
  • X-Fi CMSS®-3D Virtual Provides a multichannel playback experience over two loudspeakers for all types of content
  • X-Fi CrystalizerTM provided dynamic enhancements based on detection of transients and other energy level variations.
  • the media player module 12 includes at least 3D audio virtualization technologies such as X-Fi CMSS®-3D Headphone and X-Fi CMSS®-3D Virtual. These virtual technologies are designed to reproduce a natural sounding multi-channel listening experience over headphones or two loudspeakers, with both multi-channel and two-channel source formats.
  • X-Fi Creative MultiSpeaker Surround 3D(CMSS-3D) is available for both rendering over headphones and speakers.
  • Creative's CMSS®-3D Headphone technology helps the listener forget that he or she is wearing headphones, by delivering a compelling multi-channel listening experience, with any two-channel or multi-channel audio content. This is the result of the combination of three exclusive ingredients: HRTF filters, Environmental early reflections and Ambience extraction.
  • X-Fi CMSS®-3D Headphone Timbre preservation; Improved externalization, frontalization and front-back discrimination. Further benefits include a natural sense of immersion, for both multi-channel and two-channel sources as well as reduced listening fatigue.
  • Creative's CMSS®-3D Headphone technology employs advanced signal processing algorithms to place listeners in a natural, fully immersive sound field. Through these processing techniques operating with the assistance of the audio data processor 16 in the media player module 12, the auditory awareness of wearing headphones vanishes and is replaced by a transparent listening experience and the sensation of "being there".
  • Creative's CMSS®-3D Virtual technology provides a convincing multi-channel listening illusion using only two loudspeakers for a listener located at the "sweet spot", with any two-channel or multi-channel audio content. It combines the following ingredients: HRTF filters, Cross-talk canceller and Ambience extraction.
  • the benefits of X-Fi CMSS®-3D Virtual include timbre preservation, convincing side and rear virtual loudspeaker localization, natural sense of immersion, with both multi-channel and two-channel sources.
  • the media player module 12 is configured to provide calibration according to the placement of the loudspeakers with respect to the listener. That is, the user can control the amount of the virtualization effect to optimize the effect to adjust for the loudspeaker positions.
  • Transient enhancement is provided in one embodiment by Creative's X-Fi Crystalizer. This is an intelligent, automated audio-restoration processor carefully designed to bring the full benefit of audio playback to 16-bit legacy audio content. Crystalizer selectively identifies significant transients in the original 16-bit audio playback stream and dynamically enhances these to compensate for the studio mastering compromises inherent in the limited dynamic range of CD audio. The end result of applying Crystalizer enhancement depends to some extent on the details of the content to which it is applied and to the user-specified degree of enhancement. In general, though, Crystalizer produces crisper high frequencies, punchier mid-range percussion (snare drums, congas) and note onsets, and stronger kick bass hits.
  • This audio enhancement technique is thought to be especially beneficial to listeners of compressed music such as music encoded in the mp2, wma, or ATRAC formats.
  • This configuration is believed to enhance MP3s and movies to the point of even sounding better to many listeners than content available from the original CD or DVD.
  • It is a low-impact algorithm designed to improve the dynamic range of an audio stream by enhancing the natural transients.
  • the transient enhancement provided by the Crystalizer algorithms can be very effective at sharpening an audio track (particularly compressed tracks, such as MP3 files), brightening sound effects, etc.
  • Music benefits provided include low and high frequencies are enhanced while the dynamics are improved. Movie benefits include adding realism to explosions, gun-shots and high-impact audio sequences.
  • the portable device 10 may be configured with any number and other types of media format processing modules.
  • the external device 50 includes a processor 54, memory 56 and user interface connect 58 for connecting output user interface devices 60,62,64.
  • the external user interface devices include audio output devices 62 such as, for example, speakers, earphones, headphones and so forth.
  • Other external user interface devices include input 60, output display devices 64 such as, for example, displays, monitors and the like.
  • the connector interface 20,52 and/or the user interface connect 26 may be connection ports such as USB connector interface, firewire connector interface (IEEE 1394), or the like.
  • the controller 22 and media player module 12 is powered by the external device 50 through the connector ports of the connector interfaces 20,52.
  • the user interface devices 30,32,34 connected to the portable device 10 are also powered by the external device 50 through the connector ports of the connector interfaces 20,52 and user interface connect 26.
  • the media player module 12 of the portable device 10 When the media player module 12 of the portable device 10 is processing audio data from the external device 50, a portion of the memory 56 allocated for the processing of audio signals in the external device 50 is freed up for use by the processor 54. Consequently, processing of non- audio related tasks in the external device 50 is enhanced.
  • FIG. 2 A flow chart of a method 100 of an embodiment of the invention is shown in FIG. 2.
  • the portable device 10 is connected 102 to the external device 50.
  • the controller 22 of the portable device 10 receives 104 data from the external device 50, and determines 105 the particular type of data. If the data is deemed by the controller 22 to be audio data, the controller 22 switches 106 the portable device 10 from a first mode as a media playback device to a second mode as an audio enhancement device. If the data is deemed by the controller 22 to be non-audio data, the portable device 10 remains in the first mode as the media playback device 107.
  • the controller 22 When the portable device 10 is in the second mode, the controller 22 operates 108 a media player module 12 to process the audio data 110. Once processed, the controller 22 supplies 112 the processed audio data to the external device 50 and/or the user interface connect 26 of the portable device 10.
  • the external user interface devices include audio output devices 62 such as, for example, speakers, earphones, headphones and so forth.
  • Other external user interface devices include output display devices 64 such as, for example, displays, monitors and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Headphones And Earphones (AREA)

Abstract

A portable audio enhancement and media player device and disclosed for enabling an electronic consumer product such as personal computer, mobile phone etc., to process and format media having different data formats like "mp3", "wav" etc. The portable device may be connected to an electronic consumer product via a connector like universal serial bus, firewire.etc. By connecting the portable device via one of the connector, the portable device provides the required processors for processing audio/video media data necessary to play such data formats and enable the electronic consumer product with sound card and media player functionality. The portable device also enables an electronic product to obtain an additional secondary functionality such as audio enhancement when connected to the host computer and also aid in processing data when connected to the host computer.

Description

PORTABLE AUDIO ENHANCEMENT AND MEDIA PLAYER DEVICE
FIELD OF THE INVENTION
This invention relates generally to audio enhancement and media player devices, and more particularly to a portable device with media player functionality that enables an electronic product such as a personal computer to obtain enhanced audio output.
BACKGROUND
The consumer electronics market includes different types of electronic devices such as personal computers, personal digital assistants (PDA), cellular phones, televisions, etc. that are equipped to playback media having different data formats. One of the most popular types of such consumer electronic devices is portable media playback devices. These portable media playback devices come in all sizes and offer a variety of functionalities. However, these portable media playback devices are typically stand-alone devices, and at the very most, also serve as an additional data storage device for a user. Such devices typically do not have any secondary functionality.
Additionally, even when these portable media playback devices are connected to a host computer for either data synchronization or data transfer, processing resources on these portable media playback device are not utilised.
Many personal computers and notebooks nowadays are equipped with embedded audio processing chips, and the quality of audio reproduction suffers as a capability of such embedded audio processing chips is lacking. There are thus many people who hanker for improved audio reproduction quality from their personal computers and notebooks which are equipped with such embedded audio processing chips.
Therefore, there is a need for a portable device with media player functionality which is able to provide an additional secondary functionality of audio enhancement when connected to the host computer and also aid in processing data when connected to the host computer. SUMMARY
An aspect of the invention is a portable media processing device for connecting with and enabling an external device with audio enhancement functionality, the portable device comprising a housing and a connector interface for connecting and exchanging data with the external device; a media player module for processing data; and a controller for identifying the data received from the external device and selectively controlling the media player module for processing the data from the external device and supplying the processed data.
An embodiment of the invention is a user interface port for connecting user interface devices. The user interface device may be selected from the group consisting of: speakers, earphones, headphones, displays, and monitors. The portable media processing device may further comprise a player module having an audio data processor, and a media data processor. The portable media processing device may further comprise data storage for storing the processed data. The controller may supply the processed data to either the external device or the user interface port. The connector interface may be a USB connector interface or a firewire connector interface. The external device may be a device selected from the group consisting of a notebook, a personal computer, a television, a mobile telephone, a games console, a camera, a CD player, and a DVD player. A portion of memory allocated for the processing of audio signals in the external device may be freed up for use by a processor in the external device and processing of non-audio related tasks in the external device is enhanced.
An aspect of the invention is a method for enabling an external device with audio enhancement functionality with a portable media processing device, the portable device comprising connecting the portable device having a housing and a connector for connecting the portable device to the external device; receiving data from the external device; identifying the data received from the external device; selectively controlling a media player module, the media player module for processing the data; supplying the processed data to either the external device or a user interface port.
BRIEF DESCRIPTION OF THE DRAWINGS
In order that embodiments of the invention may be fully and more clearly understood by way of non-limitative examples, the following description is taken in conjunction with the accompanying drawings in which like reference numerals designate similar or corresponding elements, regions and portions, and in which:
FIG. 1 illustrates a block diagram of a portable device in accordance with an embodiment of the invention; and
FIG. 2 illustrates a flow chart of a method in accordance with an embodiment of the invention.
DETAILED DESCRIPTION
Referring to FIG. 1 , a block diagram of a portable media processing device 10 is shown. The portable media processing device 10 connects with an external device 50 and enables the external device 50 with audio enhancement functionality. The external device 50 may be, for example, a notebook, a personal computer, a television, a mobile telephone, a games console, a camera, a CD player, a DVD player and so forth. The portable device 10 comprises housing 40 for a controller 22 and a storage 24 connected to the controller 22. The controller 22 is connected to a media player module 12. The media player module 12 has data processors 16,18. The portable device 10 has a connector interface 20 that connects to a corresponding connector interface 52 of the external device 50. Through the connector interfaces 20,52 the portable device 10 is able to exchange data with the external device 50 when the portable device 10 is connected to the external device 50.
The portable device 10 is able to function independently as a media playback device in a first mode when the portable device 10 is not connected to the external device 50. The controller 22 receives media data from the storage 24. Subsequently, the controller 22 identifies the media data and selectively controls the media player module 12 to process the data using at least one of the media data processor 18, and the audio data processor 16. The processed data is then sent back to the controller 22 and is subsequently sent to the user interface connect 26 for audio output 32 and display output 34. The audio output 32 may include, for example, speakers, earphones, headphones and so forth.
In a second mode, the controller 22 receives audio data from the external device 50. The controller 22 identifies the audio data received from the external device 50 and selectively controls the media player module 12 to process the data. The audio data may be processed using the audio data processor 16.
The data processed by the audio data processor 16 is returned to the controller 22 and may transmit the processed data either to the external device 50 or to a user interface connect 26 within the portable device 10. The user interface connect 26 may comprise a port or another connector for connecting external user interface devices. The external user interface devices include audio input 30, output devices 32 such as, for example, speakers, earphones, headphones and so forth. Other external user interface devices include output display devices 34 such as, for example, displays, monitors and the like.
The audio data processor 16 in the media player module 12 may enable the incorporation of advanced sound enhancement effects. These advanced effects cover a wide range including but not limited to 3D audio spatialization (virtualization) and transient enhancement. The portable device 10 is configured to receive an audio input signal through the connect interface 20, in analog or digital form, consequently enhance the received signal in media player module 12, and subsequently transmit an output audio signal through the user interface connect 26 having the enhanced effects embedded in the signal. The output signal may be either digital or analog. The output signal may be, for example, a mono signal, a stereo signal, a MIDI signal, or a multichannel signal (such as 2.1, 5.1 , 7.1, etc.). In some embodiments, the audio enhancements include but are not limited to dramatic improvements to the recording and playback of MP3 music, enhancement to the listening experiences for movies, and improvements in general to the capabilities, performance and quality of audio and music creation.
Preferably, the media player module 12 is configured to enable the user to select from several surround audio enhancement effects and to control the amount of the effect to suit the users' preferences. Many of these audio enhancements are commercially available in computer sound cards provided by Creative Technologies Ltd. For example, the X-Fi soundcard provided by Creative Technologies Ltd. presently allows a user options including MultiSpeaker Surround 3D Surround, MultiSpeaker Surround 3D Headphone, MultiSpeaker Surround 3D Virtual, X-Fi Crystalizer, Dolby Digital decoder, DTS-lnteractive 5.1 Encoder.
X-Fi CMSS®-3D enables a user to upgrade MP3 music and movies into surround sound with headphones or multichannel speakers. This is important because it enables a consumer to enjoy stereo MP3s and movies in surround sound created with X-Fi CMSS®-3D technology. While the present invention is intended to include the basic upmixing of stereo content, the audio enhancement module 12 is preferably configured to remix the audio intelligently to match the speaker system (including headphones).
The audio enhancement techniques that may be configured into the media player module 12 include advanced techniques to extract specific audio elements so music and movies sound more alive than ever, i.e., to add in one embodiment "punchiness". The potential benefits when listening to or creating music are abundant. For example, static stereo music may be converted into surround sound suitable for playback over multichannel speakers. Although in one embodiment, the enhanced listening experience is provided when listening to music tracks, the invention includes other forms of media content. For example, videos or movies may be enhanced to provide surround sound over headphones or speakers. Thus, an example surround sound processing technique suitable for integration into the module to enjoy movies is the X-Fi CMSSO-3D.
Other processing techniques provided in other embodiments enable up mixing, virtualization over output channels, transient enhancement, and decoding. These are generally described with the following examples:
1. X-Fi CMSSO-3D Surround: Provides a multichannel playback for stereo music or movies.
2. X-Fi CMSS®-3D Headphone: Provides a multichannel playback experience over headphones for all types of content
3. X-Fi CMSS®-3D Virtual: Provides a multichannel playback experience over two loudspeakers for all types of content
4. X-Fi CrystalizerTM - provided dynamic enhancements based on detection of transients and other energy level variations.
5. Dolby Digital decoder
6. DTS-lnteractive 5.1 Encoder
Preferably, the media player module 12 includes at least 3D audio virtualization technologies such as X-Fi CMSS®-3D Headphone and X-Fi CMSS®-3D Virtual. These virtual technologies are designed to reproduce a natural sounding multi-channel listening experience over headphones or two loudspeakers, with both multi-channel and two-channel source formats. In further detail, X-Fi Creative MultiSpeaker Surround 3D(CMSS-3D) is available for both rendering over headphones and speakers. Creative's CMSS®-3D Headphone technology helps the listener forget that he or she is wearing headphones, by delivering a compelling multi-channel listening experience, with any two-channel or multi-channel audio content. This is the result of the combination of three exclusive ingredients: HRTF filters, Environmental early reflections and Ambience extraction. The benefits of X-Fi CMSS®-3D Headphone include Timbre preservation; Improved externalization, frontalization and front-back discrimination. Further benefits include a natural sense of immersion, for both multi-channel and two-channel sources as well as reduced listening fatigue. Creative's CMSS®-3D Headphone technology employs advanced signal processing algorithms to place listeners in a natural, fully immersive sound field. Through these processing techniques operating with the assistance of the audio data processor 16 in the media player module 12, the auditory awareness of wearing headphones vanishes and is replaced by a transparent listening experience and the sensation of "being there".
Creative's CMSS®-3D Virtual technology provides a convincing multi-channel listening illusion using only two loudspeakers for a listener located at the "sweet spot", with any two-channel or multi-channel audio content. It combines the following ingredients: HRTF filters, Cross-talk canceller and Ambience extraction. The benefits of X-Fi CMSS®-3D Virtual include timbre preservation, convincing side and rear virtual loudspeaker localization, natural sense of immersion, with both multi-channel and two-channel sources. Preferably the media player module 12 is configured to provide calibration according to the placement of the loudspeakers with respect to the listener. That is, the user can control the amount of the virtualization effect to optimize the effect to adjust for the loudspeaker positions.
Transient enhancement is provided in one embodiment by Creative's X-Fi Crystalizer. This is an intelligent, automated audio-restoration processor carefully designed to bring the full benefit of audio playback to 16-bit legacy audio content. Crystalizer selectively identifies significant transients in the original 16-bit audio playback stream and dynamically enhances these to compensate for the studio mastering compromises inherent in the limited dynamic range of CD audio. The end result of applying Crystalizer enhancement depends to some extent on the details of the content to which it is applied and to the user-specified degree of enhancement. In general, though, Crystalizer produces crisper high frequencies, punchier mid-range percussion (snare drums, congas) and note onsets, and stronger kick bass hits. This audio enhancement technique is thought to be especially beneficial to listeners of compressed music such as music encoded in the mp2, wma, or ATRAC formats. This configuration is believed to enhance MP3s and movies to the point of even sounding better to many listeners than content available from the original CD or DVD. It is a low-impact algorithm designed to improve the dynamic range of an audio stream by enhancing the natural transients. The transient enhancement provided by the Crystalizer algorithms can be very effective at sharpening an audio track (particularly compressed tracks, such as MP3 files), brightening sound effects, etc. Music benefits provided include low and high frequencies are enhanced while the dynamics are improved. Movie benefits include adding realism to explosions, gun-shots and high-impact audio sequences.
In the embodiment shown in FIG. 1, only a single media player module 12 is incorporated in the portable device 10. In other embodiments the portable device 10 may be configured with any number and other types of media format processing modules.
The external device 50 includes a processor 54, memory 56 and user interface connect 58 for connecting output user interface devices 60,62,64. The external user interface devices include audio output devices 62 such as, for example, speakers, earphones, headphones and so forth. Other external user interface devices include input 60, output display devices 64 such as, for example, displays, monitors and the like.
The connector interface 20,52 and/or the user interface connect 26 may be connection ports such as USB connector interface, firewire connector interface (IEEE 1394), or the like. When the portable device 10 is connected to the external device 50, the controller 22 and media player module 12 is powered by the external device 50 through the connector ports of the connector interfaces 20,52. Similarly, the user interface devices 30,32,34 connected to the portable device 10 are also powered by the external device 50 through the connector ports of the connector interfaces 20,52 and user interface connect 26.
When the media player module 12 of the portable device 10 is processing audio data from the external device 50, a portion of the memory 56 allocated for the processing of audio signals in the external device 50 is freed up for use by the processor 54. Consequently, processing of non- audio related tasks in the external device 50 is enhanced.
A flow chart of a method 100 of an embodiment of the invention is shown in FIG. 2. The portable device 10 is connected 102 to the external device 50. The controller 22 of the portable device 10 receives 104 data from the external device 50, and determines 105 the particular type of data. If the data is deemed by the controller 22 to be audio data, the controller 22 switches 106 the portable device 10 from a first mode as a media playback device to a second mode as an audio enhancement device. If the data is deemed by the controller 22 to be non-audio data, the portable device 10 remains in the first mode as the media playback device 107.
When the portable device 10 is in the second mode, the controller 22 operates 108 a media player module 12 to process the audio data 110. Once processed, the controller 22 supplies 112 the processed audio data to the external device 50 and/or the user interface connect 26 of the portable device 10. The external user interface devices include audio output devices 62 such as, for example, speakers, earphones, headphones and so forth. Other external user interface devices include output display devices 64 such as, for example, displays, monitors and the like.
While embodiments of the invention have been described and illustrated, it will be understood by those skilled in the technology concerned that many variations or modifications in details of design or construction may be made without departing from the present invention.

Claims

CLAIMS:
1. A portable media processing device for connecting with and enabling an external device with audio enhancement functionality, the portable device comprising: a housing and a connector interface for connecting and exchanging data with the external device; a media player module for processing data; and a controller for identifying the data received from the external device and selectively controlling the media player module for processing the data from the external device and supplying the processed data.
2. The portable media processing device of claim 1 further comprising a user interface port for connecting user interface devices.
3. The portable media processing device of claim 2, wherein the user interface devices are selected from the group consisting of: speakers, earphones, headphones, displays, and monitors.
4. The portable media processing device of claim 1 , wherein the media player module includes an audio data processor, and a media data processor.
5. The portable media processing device of claim 1 or 2 further comprising data storage for storing the processed data.
6. The portable media processing device of claim 2 wherein the controller supplies the processed data to either the external device or the user interface port.
7. The portable media processing device of any one of the preceding claims wherein the connector interface is either a USB connector interface or a firewire connector interface.
8. The portable media processing device of any one of the preceding claims wherein the external device is a device selected from the group consisting of: a notebook, a personal computer, a television, a mobile telephone, a games console, a camera, a CD player, and a DVD player.
9. The portable media processing device of claim 1, wherein a portion of memory allocated for the processing of audio signals in the external device is freed up for use by a processor in the external device and processing of non-audio related tasks in the external device is enhanced.
10. A method for enabling an external device with audio enhancement functionality with a portable media processing device, the portable device comprising: connecting the portable device having a housing and a connector for connecting the portable device to the external device; receiving data from the external device; identifying the data received from the external device; selectively controlling a media player module, the media player module for processing the data; supplying the processed data to either the external device or a user interface port.
PCT/SG2009/000161 2008-05-13 2009-05-05 Portable audio enhancement and media player device Ceased WO2009139726A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN2009801175354A CN102027444A (en) 2008-05-13 2009-05-05 Portable audio enhancement and media player device
EP09746883A EP2286329A4 (en) 2008-05-13 2009-05-05 Portable audio enhancement and media player device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/120,050 2008-05-13
US12/120,050 US20090287324A1 (en) 2008-05-13 2008-05-13 Portable audio enhancement and media player device

Publications (1)

Publication Number Publication Date
WO2009139726A1 true WO2009139726A1 (en) 2009-11-19

Family

ID=41316907

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2009/000161 Ceased WO2009139726A1 (en) 2008-05-13 2009-05-05 Portable audio enhancement and media player device

Country Status (5)

Country Link
US (1) US20090287324A1 (en)
EP (1) EP2286329A4 (en)
CN (1) CN102027444A (en)
TW (1) TW200949673A (en)
WO (1) WO2009139726A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101958139A (en) * 2010-08-10 2011-01-26 闫天时 High definition lossless audio playing (HDAP) system
CN105955694A (en) * 2012-12-27 2016-09-21 中兴通讯股份有限公司 Method and device for outputting HiFi audio frequency

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2955202B1 (en) * 2009-12-10 2012-08-03 St Microelectronics Crolles 2 INTEGRATED MICROELECTRONIC DEVICE WITH THROUGH CONNECTIONS.
US9281013B2 (en) 2011-11-22 2016-03-08 Cyberlink Corp. Systems and methods for transmission of media content
US9167296B2 (en) 2012-02-28 2015-10-20 Qualcomm Incorporated Customized playback at sink device in wireless display system
US9535455B2 (en) 2014-04-11 2017-01-03 Harman International Industries, Inc. Portable media enhancement device
CN105989824B (en) * 2015-02-16 2021-01-12 北京天籁传音数字技术有限公司 Karaoke system of mobile equipment and mobile equipment
CN112399326B (en) * 2019-08-19 2025-11-21 创新科技有限公司 Systems, methods, and devices for audio reproduction
CN111176605B (en) * 2019-11-29 2022-07-26 联想(北京)有限公司 Audio output method and electronic equipment
CN115497496B (en) * 2022-09-22 2023-11-14 东南大学 Voice enhancement method based on FirePS convolutional neural network

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060156349A1 (en) * 2005-01-05 2006-07-13 Herschel Naghi Digital video player accessory
US20070118240A1 (en) * 2005-11-16 2007-05-24 Cho Kuo H Accessory multi-media player
US20080008324A1 (en) * 2006-05-05 2008-01-10 Creative Technology Ltd Audio enhancement module for portable media player
US20080092200A1 (en) * 2006-10-13 2008-04-17 Jeff Grady Interface systems for portable digital media storage and playback devices

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7359624B2 (en) * 1997-10-06 2008-04-15 Silicon Image, Inc. Portable DVD player
TW576529U (en) * 2002-12-02 2004-02-11 Mitac Technology Corp Multi-function portable digital video and audio apparatus
CN1567282A (en) * 2003-06-30 2005-01-19 杨心怀 Multifunctional composite mould portable digital audio player
CN1860544A (en) * 2003-09-25 2006-11-08 三星电子株式会社 Apparatus and method for displaying audio and video data, and storage medium recording thereon a program to execute the displaying method
US20050135792A1 (en) * 2003-12-19 2005-06-23 Microtek International, Inc. Compact multimedia player
US20050184161A1 (en) * 2004-02-20 2005-08-25 Jung-Wei Chen Multimedia card reader

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060156349A1 (en) * 2005-01-05 2006-07-13 Herschel Naghi Digital video player accessory
US20070118240A1 (en) * 2005-11-16 2007-05-24 Cho Kuo H Accessory multi-media player
US20080008324A1 (en) * 2006-05-05 2008-01-10 Creative Technology Ltd Audio enhancement module for portable media player
US20080092200A1 (en) * 2006-10-13 2008-04-17 Jeff Grady Interface systems for portable digital media storage and playback devices

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2286329A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101958139A (en) * 2010-08-10 2011-01-26 闫天时 High definition lossless audio playing (HDAP) system
CN105955694A (en) * 2012-12-27 2016-09-21 中兴通讯股份有限公司 Method and device for outputting HiFi audio frequency
CN105955694B (en) * 2012-12-27 2019-01-08 中兴通讯股份有限公司 A kind of HiFi audio-frequency inputting method and device

Also Published As

Publication number Publication date
EP2286329A4 (en) 2012-10-10
EP2286329A1 (en) 2011-02-23
CN102027444A (en) 2011-04-20
TW200949673A (en) 2009-12-01
US20090287324A1 (en) 2009-11-19

Similar Documents

Publication Publication Date Title
US9100765B2 (en) Audio enhancement module for portable media player
US20090287324A1 (en) Portable audio enhancement and media player device
TWI489887B (en) Virtual audio processing for loudspeaker or headphone playback
JP5752345B2 (en) Multi-channel signal spatial processing method, processing module, and virtual surround sound system
CN102568513B (en) Audio data processing method and interacting method
US6175489B1 (en) Onboard speaker system for portable computers which maximizes broad spatial impression
US8509463B2 (en) Multi-mode sound reproduction system and a corresponding method thereof
US8204615B2 (en) Information processing device, information processing method, and program
CN105679345B (en) Audio processing method and electronic equipment
AU2008295723A1 (en) A method and an apparatus of decoding an audio signal
TW200931398A (en) Methods and apparatus for providing an interface to a processing engine that utilizes intelligent audio mixing techniques
CA2839088A1 (en) System for producing 3 dimensional digital stereo surround sound natural 360 degrees (3d dssr n-360)
CN112840678B (en) Stereo playing method, device, storage medium and electronic equipment
US8351622B2 (en) Audio mixing device
US9843883B1 (en) Source independent sound field rotation for virtual and augmented reality applications
US6917915B2 (en) Memory sharing scheme in audio post-processing
US11528554B2 (en) Near-field rendering of immersive audio content in portable computers and devices
JP2008511254A (en) How to unpack an audio mix to fill all available output channels
US7013012B2 (en) Method for processing sound effects in a notebook computer
US20050107900A1 (en) Portable computer adapted for use with a loudspeaker unit to reproduce audio playback information with surround sound effects
TWI420920B (en) Volume balancing system and portable electrical device
Beck The Immersive Computer-controlled Audio Sound Theater: History and current trends in multi-modal sound diffusion
JP2007053553A (en) Audio playback device
To QSound® Virtual Audio Rendering for Surround Formats
Blind Three Dimensional Acoustic Entertainment

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980117535.4

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09746883

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2009746883

Country of ref document: EP