Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
  • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Definitions

• the present invention relates to the field of mobile communications, and in particular, to a method and apparatus for real-time reproduction of content played on a mobile terminal to other data reproducing devices, and a device having the same Mobile terminal.
• mobile terminals such as mobile phones, such as watching news, playing videos, and the like.
• the user when the above application is performed, due to the limitation of the display screen size of the mobile terminal, the user usually cannot share the content seen on his mobile terminal conveniently and timely to the friends around him, thereby failing to achieve with more friends.
• the present invention provides a content reproducing method and apparatus, and a mobile terminal. It is an object of the present invention to provide a method for reproducing content played on a mobile terminal in real time onto one or more data reproduction devices.
• Another object of the present invention is to provide an apparatus for reproducing content played on a mobile terminal in real time onto one or more data reproducing apparatuses and a mobile terminal and system having the above apparatus.
• a method for real-time reproduction of content played on a mobile terminal onto one or more data reproduction devices is provided, wherein the mobile terminal and one or more at least include a wireless communication unit and decoding Establishing a wireless transmission link between the decoding devices of the unit, the one or more decoding devices being coupled to the one or more data reproduction devices via a data line, the method comprising: upon receiving the connection to the data reproduction device desired by the user After the playback content of the identification information of the decoding device is synchronously reproduced, the data played on the mobile terminal is captured; the captured data is encoded according to a specific encoding manner; and the encoded data is transmitted through the established wireless transmission link.
• the decoding device corresponding to the identification information included in the received playback content synchronous reproduction request is performed for reproduction on the data reproducing device connected to the decoding device.
• capturing data played on the mobile terminal may include: following a predetermined rate by a video data capture module built in the mobile terminal Performing screenshot processing on the mobile terminal to acquire video data; acquiring audio data synchronously with the video data through an audio data capture module built in the mobile terminal; and synchronizing the acquired audio data with the acquired video data to Get mixed video/audio data.
• the decoding device after receiving the encoded data transmitted from the mobile terminal, decodes the received encoded data into a playable manner according to a decoding manner corresponding to the encoding mode.
• the data is an IP address or a device name of a decoding device.
• the play content synchronization reproduction request is a user in the list of identification information of the decoding device including the decoding device that has established the wireless transmission link with the mobile terminal displayed on the mobile terminal. The identification information of one or more decoding devices connected to the desired data reproduction device is generated and issued, the list being displayed when the playback content synchronization reproduction application in the mobile terminal is activated.
• the play content synchronization reproduction request is based on a decoding device that has established a wireless transmission link with the mobile terminal when the user initiates the playback content synchronization reproduction application in the mobile terminal.
• the identification information of the decoding device as the target device determined by the preset condition is generated and issued.
• a method for real-time reproduction of content played on a mobile terminal onto one or more data reproduction devices wherein the mobile terminal and one or more at least comprise a wireless communication unit Establishing a wireless transmission link with the decoding device of the decoding unit, the one or more decoding devices being connected to the one or more data reproduction devices via a data line, the method comprising: receiving, in the mobile terminal, the inclusion and the user Acquiring the data played on the mobile terminal after the playback content synchronization reproduction request of the identification information of the decoding device connected to the desired data reproduction device; encoding the captured data according to a specific coding manner; and passing the established wireless transmission link Transmitting the encoded data to a decoding device corresponding to the identification information included in the received playback content synchronization reproduction request, and in the decoding device, after receiving the encoded data transmitted from the mobile terminal, according to the encoding
• the decoding method corresponding to the mode decodes the received encoded data Data can be played back; and the decoded
• an apparatus for reproducing content played on a mobile terminal to one or more data reproducing apparatuses in real time wherein the mobile terminal and one or more at least include a wireless communication unit Establishing a wireless transmission link with the decoding device of the decoding unit, the one or more decoding devices and one or A plurality of data reproducing devices are connected by a data line, the device comprising: a play data capturing unit, configured to capture the mobile after receiving the playback content synchronous reproduction request including the identification information of the decoding device connected to the data reproduction device desired by the user a data played on the terminal; a coding unit, configured to encode the captured data according to a specific coding manner; and a transmission unit, configured to transmit the encoded data to and received through the established wireless transmission link
• the decoding device corresponding to the identification information included in the playback content synchronization reproduction request decodes for reproduction on the data reproduction device connected to the data reproduction device.
• the play data capturing unit when the content played on the mobile terminal includes video and audio, includes: a video data capturing module, configured to perform a screen on the mobile terminal according to a predetermined rate The screenshot processing is performed to obtain video data; the audio data capture module is configured to acquire audio data synchronously with the video data; and the mixing module is configured to synchronously mix the acquired audio data with the acquired video data to obtain a mixed video/ Audio data.
• the apparatus may further include: a play content synchronization reproduction request generating unit, configured to generate and issue a play content synchronization including the identification information of the decoding device connected to the data reproduction device desired by the user Reproduce the request.
• the play content synchronization reproduction request generating unit may be configured to receive an identifier of a decoding device displayed on the mobile terminal that includes a wireless transmission link that has been established with the mobile terminal by the user
• the selected content synchronization reproduction request is generated and issued when the identification information of one or more decoding devices connected to the data reproduction device desired by the user in the list of information is selected, and the list is synchronized in the playback content in the startup mobile terminal Displayed when the application is reproduced.
• the apparatus may further include: a target data reproduction device determining unit, configured to: when the user initiates the playback content synchronization reproduction application in the mobile terminal, according to the preset condition, from the already moved Determining, by the decoding device that establishes a wireless transmission link, the decoding device as the target device, wherein the playback content synchronization reproduction request generating unit is configured to generate and issue based on the determined identification information of the decoding device as the target device Play content synchronous reproduction request.
• a mobile terminal comprising the apparatus as described above.
• a system for reproducing content played on a mobile terminal to one or more data reproducing devices in real time comprising: a mobile terminal as described above; one or more data a reproducing device; one or more data reproducing devices connected to the one or more decoding devices through the data line; and one or more decoding devices, each of the decoding devices comprising: a wireless communication unit, configured to establish with the mobile terminal a wireless transmission link for performing data transmission; a decoding unit, configured to decode the received encoded data into playable data according to a decoding manner corresponding to the encoding mode; and a transmitting unit configured to decode through the data line
• the subsequent data is sent to a data reproducing device connected to the decoding device via the data line to be reproduced on the data reproducing device.
• the present invention also provides a computer readable storage medium storing a program for performing any of the methods of the present invention for reproducing a content played on a mobile terminal in real time onto one or more data reproducing devices.
• content played on the mobile terminal can be reproduced to one or more other data reproductions such as a television set by clicking a screen content reproduction application (ie, a screen synchronization program) set on the mobile terminal.
• a screen content reproduction application ie, a screen synchronization program
• FIG. 1 is a flow chart showing a method for real-time reproduction of content played on a mobile terminal onto one or more data reproduction devices according to an embodiment of the present invention
• FIG. 3 illustrates another example of a generation process of a playback content synchronous reproduction request according to an embodiment of the present invention
• FIG. 4 illustrates an embodiment according to the present invention.
• Process for capturing an example of data played on a mobile terminal in a method FIG. 5A is a diagram showing an example of wirelessly transmitting data content played on a mobile terminal based on a WiFi network, according to an embodiment of the present invention
• 5B shows a schematic diagram of another example of wirelessly transmitting data content played on a mobile terminal based on a WiFi network according to an embodiment of the present invention
• FIG. 6 illustrates content for playing on a mobile terminal according to an embodiment of the present invention.
• Fig. 7 is a block diagram showing an example of the playback data capturing unit shown in Fig. 6.
• FIG. 8 is a block diagram showing a mobile terminal having the apparatus shown in Fig. 6.
• Fig. 9 shows A block diagram of a system for reproducing content played on a mobile terminal to one or more data reproduction devices in real time in accordance with an embodiment of the present invention; and
• FIG. 10 shows an example of the decoding device of FIG. Box diagram.
• the same reference numerals are used throughout the drawings to refer to the DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The invention will be described in detail below with reference to the drawings in conjunction with the embodiments.
• FIG. 1 shows a flow diagram of a method for reproducing content played on a mobile terminal to one or more data reproduction devices in real time, in accordance with an embodiment of the present invention.
• the method is performed by a mobile terminal 10, one or more decoding devices 20 including at least a wireless communication unit and a decoding unit, and one or more data reproduction devices 30, wherein the mobile terminal 10 is associated with one or more A wireless transmission link is established between the decoding devices 20, and the one or more decoding devices 20 are connected to the corresponding data reproduction device 30 in one or more data reproduction devices via a data line.
• one decoding device 20 may be built in the data reproducing device 30 or may be provided outside the data reproducing device 30.
• a decoding device 20 may be connected to only one data reproducing device or may be connected to a plurality of data reproducing devices. Before the method shown in Fig. 1 is performed, it is necessary to bring the data reproducing device 30 and the decoding device 20 into a power-on state (i.e., turn on the power of the data reproducing device 30 and the decoding device 20), and then, for example, by wireless communication such as a WiFi local area network. The network establishes a wireless transmission link between the mobile terminal 10 and the decoding device 20. After the above preparation, as shown in Fig.
• step S110 the user initiates synchronous reproduction of the playback content including the identification information of the decoding device 20 connected to the data reproduction device 30 desired by the user by performing an operation on the mobile terminal 10. request.
• the identification information is information for identifying the decoding device 20, for example, the IP address of the decoding device 20, the device name of the decoding device 20, and the like.
• FIG. 2 shows an example of a generation process of a play content synchronous reproduction request according to an embodiment of the present invention. As shown in FIG.
• the user when the user needs to synchronously reproduce the content played on the mobile terminal on other data reproducing devices, the user activates the play content synchronous reproduction application set in the mobile terminal (step S111), and the play content synchronous reproduction application It may be an application installed in the mobile terminal for performing synchronous reproduction of the playback content.
• the playback content synchronization reproduction application After the playback content synchronization reproduction application is launched, a list of all the identification information of the decoding device that has been selected by the user and has established a wireless transmission link with the mobile terminal is displayed on the display screen of the mobile terminal.
• step S113 the user selects identification information of the decoding device connected to the data reproducing device that the user desires to transfer from the list (step S113), for example, selecting a single identification information by clicking or touching, or selecting one by touching a pull-down or a cursor pull-down manner. Or multiple identification information.
• step S115 based on the selected identification information, a playback content synchronization reproduction request including the identification information is generated and issued.
• FIG. 3 illustrates another example of a generation process of a play content synchronous reproduction request according to an embodiment of the present invention. As shown in FIG.
• step S11' when the user needs to synchronously reproduce the content played on the mobile terminal on the other data reproducing device, the user activates the playback content synchronous reproduction application set in the mobile terminal (step S11').
• the decoding device as the transmission destination ie, the target device
• the decoding device is determined from all the decoding devices that are available for the user to establish a wireless transmission link with the mobile terminal according to the pre-conditions (steps) S113').
• the preset condition may be, for example, whether the distance between the physical location of the data reproducing device connected to the decoding device and the mobile terminal or the distance between other users sharing the viewing content is within a predetermined range, or the decoding device or Whether the IP address of the data reproducing device is within a predetermined network segment.
• the preset condition is a decoding device that uses the most times. When the above conditions are satisfied, the decoding device is considered to be the target device.
• the preset condition may also be other suitable conditions.
• the mobile terminal After the mobile terminal receives the play content synchronization reproduction request including the identification information of at least one of the one or more decoding devices, the mobile terminal captures data played on the mobile terminal, for example, the client of the mobile terminal, in step S120 Recording the content currently being played (for example, page/video/audio, etc.) as a data source for the data reproduction device.
• the content played can be UC browser, games, related content on the video player, and the like.
• the mobile terminal client mentioned here may be a mobile device such as a mobile phone or a PDA.
• the recording may be a video card copy and a sound card copy, or other recording methods. 4 illustrates a process for capturing one example of data played on a mobile terminal in a method in accordance with an embodiment of the present invention.
• the content played on the mobile terminal contains video and audio.
• the mobile terminal after receiving the playback content synchronization reproduction request, performs screen shot processing on the mobile terminal at a predetermined rate through the built-in video data capture module to acquire video data (step S121).
• video data acquisition is implemented by timing a screenshot of the screen, where the timed screenshot refers to the single
• a predetermined number of screenshots are taken within a bit time, for example, 15 or more screenshots in 1 second, and then video compression is performed by a video compression algorithm to form a continuous video file.
• the audio data is acquired in synchronization with the video data through the audio data capture module built in the mobile terminal (step S123), for example, by using the recording interface provided in the Android system, the recording is started using the new thread synchronization, and the audio stream file is acquired. Then, the acquired audio data is synchronously mixed with the acquired video data to obtain mixed video/audio data (S125).
• the video data capture module may be, for example, a video card device in a mobile terminal
• the audio data capture module may be, for example, a sound card device in a mobile terminal.
• the captured data is encoded in a specific encoding manner.
• the specific coding method may be, for example, a coding method of a general H264 format.
• step S140 the encoded data is transmitted to the decoding device corresponding to the identification information included in the received playback content synchronization reproduction request via the established wireless transmission link.
• the encoded data is transmitted to a decoding device.
• the encoded data is transmitted to the plurality of decoding devices.
• the decoding device decodes according to the corresponding H264 protocol, and decodes the received encoded data into playable video digital signal data. Then, in step S160, the decoded data is transmitted to the data reproducing device connected to the decoding device through the data line. Subsequently, the decoded playable video digital signal data is reproduced on the data reproducing device, thereby realizing reproduction of the content played on the mobile terminal on one or more data reproducing devices.
• a decoding device can be connected to one or more data reproducing devices via a data line.
• FIG. 5A illustrates a schematic diagram of one example of wirelessly transmitting data content played on a mobile terminal based on a WiFi network, in accordance with an embodiment of the present invention. As shown in FIG.
• FIG. 5A illustrates a schematic diagram of another example of wirelessly transmitting data content played on a mobile terminal based on a WiFi network, in accordance with an embodiment of the present invention.
• the mobile terminal establishes a wireless transmission link between the mobile terminal and the decoding device through the WiFi P2P protocol. Also, this is well known in the art, and a detailed description thereof will be omitted herein.
• FIG. 6 shows a block schematic diagram of an apparatus 600 for reproducing content played on a mobile terminal to one or more data reproduction devices in real time, in accordance with an embodiment of the present invention.
• the apparatus 600 includes a play data capturing unit 610, an encoding unit 620, and a transmission unit 630.
• the play data capturing unit 610 is configured to capture data played on the mobile terminal after receiving the play content synchronous reproduction request including the identification information of the decoding device connected to the data reproduction device desired by the user.
• FIG. 7 shows a block diagram of one example of a play data capturing unit 610 when content played on a mobile terminal contains video data and audio data. As shown in FIG.
• the play data capture unit 610 includes a video data capture module 611 for performing screenshot processing on the mobile terminal to acquire video data according to a predetermined rate.
• the audio data capture module 613 is configured to synchronize with the video data. Obtaining audio data; and a mixing module 615, configured to synchronously mix the acquired audio data with the acquired video data to obtain mixed video/audio data. It will be apparent that when the content played on the mobile terminal is other forms of data, the play data capture unit 610 can take other suitable forms known in the art.
• the encoding unit 620 is configured to encode the captured data according to a specific encoding manner.
• the transmitting unit 630 is configured to transmit, by using the established wireless transmission link, the encoded data to a decoding device corresponding to the identifier information included in the received playback content synchronization reproduction request, for decoding with the data reproducing device The reproduction is performed on the connected data reproducing device.
• the apparatus 600 may further include a playback content synchronization reproduction request generating unit (not shown) for generating and transmitting an identifier including a decoding device connected to the data reproduction device desired by the user. The playback content of the information is synchronized with the reproduction request.
• the play content synchronization reproduction request generating unit may be configured to receive, upon receiving, a list of identification information displayed by the user on the mobile terminal including the decoding device that has established the wireless transmission link with the mobile terminal
• the list is displayed when the playback content synchronization reproduction application in the mobile terminal is activated.
• the apparatus 600 may further include a target data reproducing device determining unit (not shown) for when the user initiates the playing content synchronous reproduction application in the mobile terminal, according to a preset condition, A decoding device that is a target device is determined in a decoding device that has established a wireless transmission link with a mobile terminal. Then, the play content synchronization reproduction request generation unit generates and issues a play content synchronization reproduction request based on the determined identification information of the decoding device as the target device.
• FIG. 8 shows a block schematic diagram of a mobile terminal 10 in accordance with an embodiment of the present invention. As shown in FIG. 8, the mobile terminal 10 includes the apparatus 600 shown in FIG.
• FIG. 9 is a block diagram showing a playback content synchronous reproduction system 1 for reproducing content played on a mobile terminal to one or more data reproduction apparatuses in real time according to an embodiment of the present invention.
• the broadcast content synchronized reproduction system 1 includes the mobile terminal 10 shown in FIG. 8, one or more decoding devices 20, and one or more data reproducing devices 30.
• the mobile terminal 10 transmits the data played on the mobile terminal captured in response to the playback content synchronization reproduction request in a specific encoding manner, and then transmits the decoding device corresponding to the identification information included in the playback content reproduction request through the established wireless transmission link. 20.
• FIG. 10 shows a block schematic diagram of one example of the decoding device 20 of FIG.
• the decoding apparatus 20 may include a wireless communication unit 210, configured to establish a wireless transmission link with the mobile terminal for data transmission, and a decoding unit 220, configured to receive the received according to a decoding manner corresponding to an encoding mode.
• the encoded data is decoded into playable data; and a transmitting unit 230 is configured to transmit the decoded data to the data reproducing device connected to the decoding device through the data line through the data line to be reproduced on the data reproducing device .
• the wireless communication unit 210 may be, for example, a WiFi network module.
• Decoding unit 220 may be, for example, a video decoding chip.
• the transmitting unit 230 may be a general-purpose digital signal transmitting interface including, for example, an AV port that can output an analog signal and an HDMI output port and a DVI output port that output a digital signal.
• the decoding device 20 may further include a signal output control chip for controlling signal output of each output port of the decoding device.
• a method and apparatus for real-time reproduction of content played on a mobile terminal onto one or more data reproduction apparatuses in accordance with an embodiment of the present invention by clicking on a screen content reproduction application set on the mobile terminal (refer to FIG. 1 to FIG. That is, the screen synchronization program can reproduce the content played on the mobile terminal to one or more other data reproduction devices such as a television, thereby realizing enjoying the favorite video program with more friends, or implementing the whole family. All 3G video calls can be participated at the same time, thus bringing a better experience to users of mobile terminals.
• the content played on the mobile terminal can be synchronously displayed to the plurality of data.
• the device is reproduced so that more people can share the played content with the mobile terminal user, thereby improving the user experience.
• the playback device can be synchronously determined by clicking the play content set in the mobile terminal, and the decoding device connected to the data reproducing device that desires the synchronous reproduction is automatically determined based on the preset condition in the mobile terminal, and A playback content synchronization reproduction request including the identification information of the decoding device is generated, so that the synchronous reproduction of the playback content on the mobile terminal can be realized in one click.
• a program for performing the method of scroll display control interface display by an embodiment of the present invention may be stored in a computer readable storage medium.
• embodiments of the present invention also provide a computer readable storage medium storing a program for performing a method of reproducing content played back on a mobile terminal to one or more data reproducing devices in real time.
• the mobile terminal of the present invention may be various handheld terminal devices, such as a mobile phone, a personal digital assistant (PDA), etc., and thus the scope of protection of the present invention should not be limited to a particular type of mobile terminal.
• the method according to the invention can also be implemented as a computer program executed by a CPU. When the computer program is executed by the CPU, the above-described functions defined in the method of the present invention are performed.
• non-volatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash.
• Volatile memory can include random access memory (RAM), which can act as external cache memory.
• RAM can be obtained in a variety of forms, such as synchronous RAM (DRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM) and direct Rambus RAM (DRRAM).
• DRAM synchronous RAM
• DRAM dynamic RAM
• SDRAM synchronous DRAM
• DDR SDRAM double data rate SDRAM
• ESDRAM enhanced SDRAM
• SLDRAM Synchronous Link DRAM
• DRRAM direct Rambus RAM
• Storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
• the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. In order to clearly This interchangeability of hardware and software is described in the general description of various illustrative components, blocks, modules, circuits, and steps.
• a general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller or state machine.
• the processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
• the steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two.
• a software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
• An exemplary storage medium is coupled to the processor, such that the processor can read information from or write information to the storage medium.
• the storage medium can be integrated with a processor.
• the processor and the storage medium can reside in an ASIC.
• the ASIC can reside in the user terminal.
• the processor and the storage medium may reside as a discrete component in the user terminal.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Mobile Radio Communication Systems (AREA)
• Telephone Function (AREA)
• Information Transfer Between Computers (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=46816855

Family Applications (1)

Country Status (2)

Cited By (2)

Families Citing this family (11)

Citations (3)

Family Cites Families (2)

• 2012
  • 2012-04-28 CN CN201210132100.0A patent/CN102685597B/zh active Active
• 2013
  • 2013-04-16 WO PCT/CN2013/074272 patent/WO2013159663A1/fr not_active Ceased

Patent Citations (3)

Also Published As

Similar Documents

Legal Events