WO2021179557A1 - 视频流播放方法、系统、终端及存储介质 - Google Patents

视频流播放方法、系统、终端及存储介质 Download PDF

Info

Publication number
WO2021179557A1
WO2021179557A1 PCT/CN2020/114388 CN2020114388W WO2021179557A1 WO 2021179557 A1 WO2021179557 A1 WO 2021179557A1 CN 2020114388 W CN2020114388 W CN 2020114388W WO 2021179557 A1 WO2021179557 A1 WO 2021179557A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
video data
decoded
area
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/114388
Other languages
English (en)
French (fr)
Inventor
伍以文
许辉福
侯志龙
郭志俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Skyworth RGB Electronics Co Ltd
Original Assignee
Shenzhen Skyworth RGB Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Skyworth RGB Electronics Co Ltd filed Critical Shenzhen Skyworth RGB Electronics Co Ltd
Priority to EP20924078.7A priority Critical patent/EP3952318A4/en
Publication of WO2021179557A1 publication Critical patent/WO2021179557A1/zh
Priority to US17/683,680 priority patent/US20220272402A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42607—Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4392—Processing of audio elementary streams involving audio buffer management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols

Definitions

  • This application relates to the field of smart terminals, and in particular to a video stream playback method, system, terminal, and computer-readable storage medium.
  • the main purpose of this application is to propose a video stream playback method, system, terminal, and computer-readable storage medium, which aims to solve the problem of video data received in the existing video stream playback technology that is immediately sent to the decoder for decoding, resulting in frame loss, Stuttering, skipping, and/or sudden stop of playback.
  • this application provides a method for playing a video stream, which includes the steps:
  • the audio and video data stored first in the area to be decoded are extracted in real time, and the audio and video data stored first in the extracted area to be decoded are decoded and played.
  • the step of moving the audio and video data first stored in the buffer area to the area to be decoded in real time includes:
  • the step of receiving the audio and video data sent by the server in real time includes:
  • the preset second downlink network rate is used to receive the audio and video data sent by the server in real time, wherein the second downlink network rate is lower than the first downlink network rate.
  • the method before the step of using the preset second downlink network rate to receive the audio and video data sent by the server in real time, the method further includes:
  • the preset third downlink network rate is used to receive the audio and video data sent by the server in real time, where the third downlink network rate is lower than the second downlink network rate.
  • the method before the step of receiving the audio and video data sent by the server in real time, the method further includes:
  • the step of decoding and playing the first stored audio and video data in the extracted area to be decoded includes:
  • the video data and the audio data are played synchronously.
  • the decoding the first stored audio and video data in the extracted region to be decoded to obtain video data and audio data includes:
  • the video decoder and the sound decoder are used to decode the separated video data and the audio data corresponding to the video data to obtain the to-be-played video data and the to-be-played audio data corresponding to the to-be-played video data.
  • the method before the step of synchronously playing the video data and the audio data, the method further includes:
  • the step of synchronously playing the video data and the audio data includes:
  • the real-time receiving of audio and video data sent by the server further includes:
  • a fourth preset threshold is set for the amount of audio and video data stored in the buffer area, and the fourth preset threshold is greater than the third preset threshold;
  • this application also provides a video stream playback system, which includes:
  • the receiving module is used to receive the audio and video data sent by the server in real time, and store the received audio and video data in the buffer area;
  • the shift storage module is used to move the audio and video data first stored in the buffer area to the area to be decoded in real time;
  • the extraction module is used to extract the audio and video data stored first in the area to be decoded in real time, and decode and play the audio and video data stored first in the extracted area to be decoded.
  • the present application also provides a terminal, the terminal including a memory, a processor, and a computer program stored on the memory and running on the processor, and the computer program is executed by the processor. When executed, the steps of the video stream playback method described above are realized.
  • the present application also provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the video stream playback method described above are implemented. .
  • a video stream playback method, system, terminal, and computer-readable storage medium proposed in this application receive audio and video data sent by a server in real time, and store the received audio and video data in a cache area; and store the audio and video data in the cache area in real time
  • the first stored audio and video data is moved to the area to be decoded; the first stored audio and video data in the area to be decoded are extracted in real time, and the first stored audio and video data in the extracted area to be decoded is decoded and played.
  • the terminal sets up two buffer areas for storing audio and video data and an area to be decoded to prevent the acquired video data from being sent to the decoder immediately for decoding, which leads to the uneven amount of video data that the decoder needs to decode per unit time, which in turn leads to decoding
  • the decoding pressure of the receiver increases in a short period of time, resulting in the problem of picture freezes, and the audio and video data will first enter the buffer area and then enter the area to be decoded from the reception to the decoding process, and the storage of the two areas
  • the audio and video data adopts a first-in, first-out strategy to ensure that the received audio and video data are processed in order, effectively avoiding problems such as skipping of the playback screen, and better improving the user experience.
  • FIG. 1 is a schematic structural diagram of a hardware operating environment involved in a solution of an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a first embodiment of a video stream playing method according to this application;
  • FIG. 3 is a detailed flowchart of step S20 in the first embodiment of the video stream playback method of this application;
  • step S10 is a detailed flowchart of the step of receiving audio and video data sent by the server in real time in step S10 in the second embodiment of the video stream playing method of this application;
  • Fig. 5 is a schematic diagram of the functional modules of the video stream playing system of this application.
  • FIG. 1 is a schematic diagram of the hardware structure of a terminal provided in various embodiments of this application.
  • the terminal includes a communication module 01, a memory 02, a processor 03 and other components.
  • the processor 03 is respectively connected to the memory 02 and the communication module 01, and a computer program is stored on the memory 02, and the computer program is executed by the processor 03 at the same time.
  • the communication module 01 can be connected to external devices through the network.
  • the communication module 01 can receive data sent by an external device, and can also send data, instructions, and information to the external device.
  • the external device may be an electronic device such as a mobile phone, a tablet computer, a notebook computer, and a desktop computer.
  • the memory 02 can be used to store software programs and various data.
  • the memory 02 may mainly include a storage program area and a storage data area, where the storage program area can store an operating system, at least one application program required for a function (receiving audio and video data sent by the server in real time), etc.; the storage data area can store data according to the terminal Use the data or information created by the user.
  • the memory 02 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the processor 03 is the control center of the terminal. It uses various interfaces and lines to connect the various parts of the entire terminal. By running or executing software programs and/or modules stored in the memory 02, and calling data stored in the memory 02, Perform various functions of the terminal and process data to monitor the terminal as a whole.
  • the processor 03 may include one or more processing units; preferably, the processor 03 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface and application programs, etc., the modem
  • the processor mainly deals with wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 03.
  • the above-mentioned terminal may also include a circuit control module, which is used to connect to the mains to realize power control and ensure the normal operation of other components.
  • terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than shown in the figure, or combine some components, or arrange different components.
  • the video stream playing method includes the steps:
  • Step S10 receiving the audio and video data sent by the server in real time, and storing the received audio and video data in the buffer area;
  • the terminal establishes a communication connection with the server through a wireless network or a wired network.
  • the communication between the terminal and the server currently includes two modes of UDP and TCP transmission protocols.
  • TCP the Transmission Control Protocol
  • TCP transmission provides functions such as timeout retransmission, discarding duplicate data, checking data, flow control, etc., so as to ensure that data can be transmitted from one end to the other.
  • UDP the User Datagram Protocol
  • UDP does not provide reliability. It just sends datagrams out without guaranteeing that they can reach the destination.
  • UDP does not establish a connection between the client and the server before transmitting data, and there is no mechanism such as timeout retransmission, the transmission speed is very fast.
  • the video and audio data stream is continuous, and it is necessary to ensure that the synchronization points are consistent.
  • a connection-oriented reliable TCP transmission protocol is used in this solution.
  • the terminal After establishing a communication connection with the server, the terminal sends a video acquisition request to the server based on the needs of the user.
  • the video acquisition request may include the video name and/or the video download address, so that the server will respond to the video acquisition request according to the video acquisition request.
  • the video sends the audio and video data of the video to the terminal in real time in the form of a video stream.
  • the terminal receives the audio and video data sent by the server in real time.
  • the server transmits the video data to the terminal in a video streaming mode. Therefore, these audio and video data belong to the same video, and a video is divided into multiple audio and video data.
  • the terminal After receiving an audio and video data, the terminal stores the received audio and video data in the buffer area.
  • Step S20 Move the audio and video data first stored in the cache area to the area to be decoded in real time; while receiving the audio and video data sent by the server in real time, the terminal will remove the audio and video data first stored in the cache area from the cache in real time. Move out of the area and move to the area to be decoded.
  • Step S20 includes:
  • Step S21 judging whether the amount of audio and video data currently stored in the area to be decoded reaches a first preset threshold
  • Step S22 if not, move the audio and video data stored first in the buffer area to the area to be decoded.
  • a maximum storage data volume first preset will be set for the area to be decoded Threshold, before moving the audio and video data stored first in the buffer area to the area to be decoded, the terminal will first obtain the amount of audio and video data currently stored in the area to be decoded, and determine the audio and video currently stored in the area to be decoded Whether the amount of data reaches the first preset threshold, if it does not reach the first preset threshold, the first audio and video data stored in the buffer area will be removed from the buffer area in real time and moved to the area to be decoded for storage .
  • the first preset threshold it will temporarily stop removing the audio and video data stored first in the buffer area from the buffer area and move it to the area to be decoded. Instead, it will obtain the audio and video data currently stored in the area to be decoded in real time. The amount of video data, and determine whether the amount of audio and video data currently stored in the area to be decoded reaches the first preset threshold, as long as it is determined that the amount of audio and video data currently stored in the area to be decoded does not reach the first preset threshold , It will continue to remove the audio and video data first stored in the buffer area from the buffer area and move it to the area to be decoded.
  • Step S30 Extract the audio and video data first stored in the area to be decoded in real time, and decode and play the audio and video data stored first in the extracted area to be decoded.
  • the terminal While receiving the audio and video data sent by the server in real time, the terminal will also extract the first stored audio and video data from the area to be decoded in real time, and decode and play the extracted first stored audio and video data.
  • step S30 includes:
  • Step S31 Decoding the audio and video data stored first in the extracted area to be decoded to obtain video data and audio data;
  • Step S32 Play the video data and the audio data synchronously.
  • a decoding tool such as DirectShow technology, is used to decode the audio and video data stored first in the extracted region to be decoded. Specifically, first, a video stream separator is used to separate the first stored audio and video data in the extracted area to be decoded into video data and audio data corresponding to the video data, and then the corresponding pair of the video decoder and the sound decoder is used to separate the audio and video data.
  • the video data and the audio data corresponding to the video data are decoded to obtain the to-be-played video data and the to-be-played audio data corresponding to the to-be-played video data, and finally the to-be-played video data and the to-be-played video data corresponding to the Audio data to be played.
  • step S32 of synchronously playing the video data and the audio data the method further includes:
  • Step S33 rendering the video data and the audio data to obtain rendered video data and audio data
  • the step S32 of synchronously playing the video data and the audio data includes:
  • step S34 the rendered video data and audio data are played synchronously.
  • the rendering tool renders the video data to be played to obtain the rendered video data to be played, and also uses the audio rendering tool to perform audio rendering on the audio data corresponding to the video data to be played to obtain the rendered audio data to be played .
  • the step of rendering the video data and obtaining the rendered video data may be in the The rendering of the audio data is performed before the step of obtaining rendered audio data, or it can be performed after the step of rendering the audio data, or it can be performed synchronously.
  • the steps of rendering the video data and the step of rendering the audio data are not discussed here. The execution order is limited.
  • step S20 will be executed.
  • step S30 will be executed. The sequence between S20 and S30 is defined.
  • the user will send a video replacement instruction to the terminal.
  • the terminal After the terminal receives the video replacement instruction, it will clear the stored audio and video data in the buffer area and the area to be decoded.
  • clearing the stored audio and video data in the area to be decoded can be performed at a preset time after receiving the user's instruction to change the video.
  • a video request will be sent to the server, where the video request is Including the changed video name and/or the changed video download address, the server will stop the audio and video data currently being sent according to the new video request, and start to send the audio and video data corresponding to the replaced video to the terminal.
  • the terminal when the terminal receives a pause playback instruction sent by the user, the terminal will send a pause sending instruction to the server, so that the server stops sending audio and video data after receiving the pause sending instruction.
  • This example receives the audio and video data sent by the server in real time, and stores the received audio and video data in the buffer area; moves the first stored audio and video data in the buffer area to the area to be decoded in real time; extracts the area to be decoded in real time The first stored audio and video data in the extracted area to be decoded is decoded and played.
  • the terminal sets up two buffer areas for storing audio and video data and an area to be decoded to prevent the acquired video data from being sent to the decoder immediately for decoding, which leads to the uneven amount of video data that the decoder needs to decode per unit time, which in turn leads to decoding
  • the decoding pressure of the receiver increases in a short period of time, resulting in the problem of picture freezes, and the audio and video data will first enter the buffer area and then enter the area to be decoded from the reception to the decoding process, and the storage of the two areas
  • the audio and video data adopts a first-in, first-out strategy to ensure that the received audio and video data are processed in order, effectively avoiding problems such as skipping of the playback screen, and better improving the user experience.
  • FIG. 4 is a second embodiment of the video stream playing method of the present application according to the first embodiment of the video stream playing method of the present application.
  • the step S10 The steps of receiving the audio and video data sent by the server in real time include:
  • Step S11 obtaining the amount of currently stored audio and video data in the area to be decoded
  • Step S12 Determine whether the amount of currently stored audio and video data in the area to be decoded reaches a preset second preset threshold, where the first preset threshold is greater than the second preset threshold; if not, perform step S13; if yes, go to step S14;
  • Step S13 using the preset first downlink network rate to receive the audio and video data sent by the server in real time;
  • Step S14 using a preset second downlink network rate to receive audio and video data sent by the server in real time, wherein the second downlink network rate is less than the first downlink network rate.
  • the terminal Since the terminal extracts the audio and video data to be decoded from the area to be decoded for decoding, the audio and video data in the area to be decoded comes from the buffer area, and the audio and video data in the buffer area comes from the terminal real-time receiving server
  • the sent audio and video data as the terminal continues to extract audio and video data for decoding, when the amount of currently stored audio and video data in the area to be decoded is too small, the terminal will appear because there is no currently stored audio and video in the area to be decoded.
  • Data which causes the decoding to pause, which in turn causes the playback screen to pause.
  • the amount of audio and video data in the area to be decoded is large, it can already meet the continuous decoding of the terminal.
  • the terminal If the terminal continues to receive and store the audio and video data quickly, it will cause a large amount of The audio and video data is stored in the buffer area and the area to be decoded, occupying the terminal memory, affecting the performance of the terminal system, and then affecting the decoding and playback functions of the terminal, resulting in stuttering.
  • the area to be decoded A second preset threshold is set for the amount of stored audio and video data, where the first preset threshold is greater than the second preset threshold, and the terminal will obtain the amount of currently stored audio and video data in the area to be decoded in real time.
  • the second preset threshold if it does not reach, it means that the amount of audio and video data currently stored in the area to be decoded is too small, and decoding pauses may occur, and the terminal needs to be speeded up
  • the rate of receiving audio and video data will increase the network downlink rate, that is, the first downlink network rate is used to receive audio and video data sent by the server in real time; if it is not reached, it means that the amount of audio and video data currently stored in the area to be decoded is too much.
  • the network downlink rate will be reduced, that is, the second downlink network rate is used to receive the audio and video data sent by the server in real time, where the second downlink network rate is lower than the first downlink rate Network speed.
  • This embodiment adjusts the rate at which the terminal receives the audio and video data sent by the server according to the amount of audio and video data currently stored in the area to be decoded, so as to avoid video playback caused by too few audio and video data stored in the area to be decoded. Pause problem, and avoid the problem of video decoding and playback jams caused by the excessive amount of audio and video data stored in the area to be decoded.
  • a third embodiment of the video stream playing method of this application is proposed based on the foregoing embodiment of the video stream playing method of this application.
  • the step S14 further includes:
  • Step S15 Determine whether the amount of audio and video data currently stored in the buffer area reaches a third preset threshold; if not, perform step S14; if yes, perform step S16;
  • Step S14 using a preset second downlink network rate to receive the audio and video data sent by the server in real time;
  • Step S16 using a preset third downlink network rate to receive the audio and video data sent by the server in real time, wherein the third downlink network rate is less than the second downlink network rate.
  • the terminal will still continue to receive audio and video data and continue to store the audio and video data to In the cache area, there is still too much audio and video data currently stored in the cache area, occupying too much memory of the terminal system, and affecting the operation of the terminal system.
  • the cache area is preset
  • a third preset threshold is set for the amount of stored audio and video data.
  • the terminal In addition to obtaining the amount of audio and video data currently stored in the area to be decoded in real time, the terminal will also obtain the amount of audio and video data currently stored in the buffer area in real time, and When the number of audio and video data currently stored in the area to be decoded has reached the second preset threshold, but the number of audio and video data currently stored in the buffer area has not reached the third preset threshold, the terminal will use the preset second downlink The network rate receives the audio and video data sent by the server in real time; the number of audio and video data currently stored in the area to be decoded has reached the second preset threshold, and the number of audio and video data currently stored in the cache area has reached the third preset threshold At this time, the terminal will continue to reduce the downlink network rate, that is, use the preset third downlink network rate to receive the audio and video data sent by the server in real time, where the third downlink network rate is lower than the second downlink network rate.
  • a fourth preset threshold may also be set for the amount of audio and video data stored in the buffer area.
  • the fourth preset threshold is greater than the third preset threshold.
  • the terminal when the amount of audio and video data currently stored in the area to be decoded reaches the second preset threshold, according to the amount of audio and video data currently stored in the buffer area, the terminal receives the audio and video data sent by the server. Speed, so as to avoid the excessive amount of audio and video data stored in the buffer area from affecting the operation of the terminal system, thereby avoiding the phenomenon of system stalls.
  • this application also provides a video stream playback system, including:
  • the receiving module 10 is used for receiving the audio and video data sent by the server in real time, and storing the received audio and video data in the buffer area;
  • the shift storage module 20 is used to move the audio and video data stored first in the buffer area to the area to be decoded in real time;
  • the extraction module 30 is used to extract the audio and video data stored first in the area to be decoded in real time, and decode and play the audio and video data stored first in the extracted area to be decoded.
  • the migration and storage module 20 includes:
  • the first judging unit 21 is configured to judge whether the amount of audio and video data currently stored in the area to be decoded reaches a first preset threshold
  • the shift storage unit 22 is configured to, if the amount of audio and video data currently stored in the area to be decoded does not reach the first preset threshold, move the audio and video data first stored in the buffer area to the area to be decoded in real time.
  • the receiving module 10 includes:
  • the obtaining unit 11 is configured to obtain the amount of currently stored audio and video data in the area to be decoded;
  • the second determining unit 12 is configured to determine whether the amount of currently stored audio and video data in the area to be decoded reaches a preset second preset threshold, where the first preset threshold is greater than the second preset threshold;
  • the first receiving unit 13 is configured to use the preset first downlink network rate to receive the audio and video sent by the server in real time if the amount of currently stored audio and video data in the area to be decoded does not reach the preset second preset threshold. data;
  • the second receiving unit 14 is configured to receive the audio and video data sent by the server in real time at the preset second downlink network rate if the amount of currently stored audio and video data in the area to be decoded reaches the preset second preset threshold, The rate of the second downlink network is less than the rate of the first downlink network.
  • the second receiving unit 14 further includes:
  • the judging subunit 141 is configured to judge whether the amount of audio and video data currently stored in the buffer area reaches the third preset threshold
  • the first receiving subunit 142 is configured to, if not, use the preset second downlink network rate to receive the audio and video data sent by the server in real time;
  • the second receiving subunit 143 is configured to, if yes, use a preset third downlink network rate to receive the audio and video data sent by the server in real time, wherein the third downlink network rate is lower than the second downlink network rate.
  • the video stream playback system further includes:
  • the connection module 40 is used to establish a communication connection with the server using the TCP protocol.
  • the sending module 50 is configured to send a video acquisition request to the server, so that the server sends audio and video data according to the video acquisition request.
  • the extraction module 30 includes:
  • the decoding unit 31 is configured to decode the audio and video data stored first in the extracted area to be decoded to obtain video data and audio data;
  • the playing unit 32 is configured to synchronously play the video data and the audio data.
  • the extraction module 30 further includes:
  • the rendering unit 33 is configured to render the video data and the audio data to obtain rendered video data and audio data;
  • the playing unit 32 includes:
  • the playing subunit 321 is used for synchronously playing the rendered video data and audio data.
  • the computer-readable storage medium may be the memory 02 in the terminal of FIG. 1, or may be, for example, ROM (Read-Only Memory)/RAM (Random Access Memory), magnetic disk, and optical disk. At least one of the above, the computer-readable storage medium includes several pieces of information for enabling the terminal to execute the method described in each embodiment of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种视频流播放方法、系统、终端及存储介质，所述方法包括：实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；实时将缓存区域中最先存储的音视频数据移至待解码区域中；实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。

Description

视频流播放方法、系统、终端及存储介质
相关申请的交叉引用
本申请要求于2020年3月9日提交中国专利局、申请号为202010159919.0、申请名称为“视频流播放方法、系统、终端及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及智能终端领域，尤其涉及一种视频流播放方法、系统、终端及计算机可读存储介质。
 背景技术
目前，在电视上播放网络视频音频绝大多数都是采用数据流的形式进行传输。但当前视频流播放技术中，会将获取到的视频帧立即送到解码器解码，导致解码器在单位时间内需要解码的视频数据量不均匀，解码器的解码压力在短时间内增大，视频数据容易丢失或顺序错乱，从而使得播放过程中出现丢帧、卡顿、跳跃和/或突然停止播放现象。
 技术解决方案
本申请的主要目的在于提出一种视频流播放方法、系统、终端及计算机可读存储介质，旨在解决现有采用视频流播放技术中接收到视频数据立即送到解码器解码，导致丢帧、卡顿、跳跃和/或突然停止播放的问题。
为实现上述目的，本申请提供一种视频流播放方法，包括步骤：
实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；
实时将缓存区域中最先存储的音视频数据移至待解码区域中；
实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。
在一实施例中，所述实时将缓存区域中最先存储的音视频数据移至待解码区域中的步骤包括：
判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值；
若否，则实时将缓存区域中最先存储的音视频数据移至待解码区域中。
在一实施例中，所述实时接收服务器发送的音视频数据的步骤包括：
获取待解码区域中的当前存储的音视频数据的数量；
判断待解码区域中的当前存储的音视频数据的数量是否达到预设第二预设阈值，其中所述第一预设阈值大于所述第二预设阈值；
若否，则采用预设的第一下行网络速率实时接收服务器发送的音视频数据；
若是，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据，其中所述第二下行网络速率小于所述第一下行网络速率。
在一实施例中，所述采用预设的第二下行网络速率实时接收服务器发送的音视频数据的步骤之前还包括：
判断缓存区域中的当前存储的音视频数据的数量是否达到第三预设阈值；
若否，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据；
若是，则采用预设的第三下行网络速率实时接收服务器发送的音视频数据，其中所述第三下行网络速率小于所述第二下行网络速率。
在一实施例中，所述实时接收服务器发送的音视频数据的步骤之前还包括：
采用TCP协议与所述服务器建立通信连接；
发送视频获取请求至所述服务器，以使所述服务器根据所述视频获取请求发送音视频数据。
在一实施例中，所述对提取的待解码区域中最先存储的音视频数据进行解码播放步骤包括：
对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据；
同步播放所述视频数据和所述音频数据。
在一实施例中，所述对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据包括：
采用视频流分离器将提取的待解码区域中最先存储的音视频数据分离为视频数据和视频数据对应的音频数据；以及
采用视频解码器和声音解码器对应的对分离出的视频数据和视频数据对应的音频数据进行解码，获得待播放的视频数据和待播放的视频数据所对应的待播放的音频数据。
在一实施例中，所述同步播放所述视频数据和所述音频数据的步骤之前，还包括：
对所述视频数据和所述音频数据进行渲染，获得渲染后的视频数据和音频数据；
所述同步播放所述视频数据和所述音频数据的步骤包括：
同步播放渲染后的视频数据和音频数据。
在一实施例中，所述实时接收服务器发送的音视频数据还包括：
所述缓存区域中存储的音视频数据的数量设置了第四预设阈值，所述第四预设阈值大于所述第三预设阈值；
当所述待解码区域中当前存储的音视频数据的数量达到所述第二预设阈值，并且所述缓存区域中当前存储的音视频数据的数量达到所述第四预设阈值时，发送停止指令给所述服务器，以暂停接收所述服务器发送的音视频数据。
为实现上述目的，本申请还提供一种视频流播放系统，所述系统包括：
接收模块，用于实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；
移存模块，用于实时将缓存区域中最先存储的音视频数据移至待解码区域中；
提取模块，用于实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。
为实现上述目的，本申请还提供一种终端，所述终端包括存储器、处理器和存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如上所述的视频流播放方法的步骤。
为实现上述目的，本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如上所述的视频流播放方法的步骤。
本申请提出的一种视频流播放方法、系统、终端及计算机可读存储介质，通过实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；实时将缓存区域中最先存储的音视频数据移至待解码区域中；实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。终端通过设置了两个存储音视频数据的缓存区域和待解码区域，避免获取到的视频数据立即送到解码器解码，导致解码器在单位时间内需要解码的视频数据量不均匀，进而导致解码器的解码压力在短时间内增大，从而出现画面卡顿的问题，而且音视频数据从接收到解码过程中，是会先进入缓存区域再进入待解码区域，并且对两个区域中存储的音视频数据都是采用先进先出的策略，确保对接收到的音视频数据按顺序进行处理，有效避免播放画面跳跃等问题，更好地提高了用户体验。
 附图说明
图1是本申请实施例方案涉及的硬件运行环境的结构示意图；
图2为本申请视频流播放方法第一实施例的流程示意图；
图3为本申请视频流播放方法第一实施例中步骤S20的细化流程示意图；
图4为本申请视频流播放方法第二实施例中步骤S10中所述实时接收服务器发送的音视频数据的步骤的细化流程示意图；
图5为本申请视频流播放系统的功能模块示意图。
本申请目的的实现、功能特点及优点将结合实施例，参照附图做在一实施例中说明。
 本发明的实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
请参照图1，图1为本申请各个实施例中所提供的终端的硬件结构示意图。所述终端包括通信模块01、存储器02及处理器03等部件。本领域技术人员可以理解，图1中所示出的终端还可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。其中，所述处理器03分别与所述存储器02和所述通信模块01连接，所述存储器02上存储有计算机程序，所述计算机程序同时被处理器03执行。
通信模块01，可通过网络与外部设备连接。通信模块01可以接收外部设备发出的数据，还可发送数据、指令及信息至所述外部设备，所述外部设备可以是手机、平板电脑、笔记本电脑和台式电脑等电子设备。
存储器02，可用于存储软件程序以及各种数据。存储器02可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序（实时接收服务器发送的音视频数据）等；存储数据区可存储根据终端的使用所创建的数据或信息等。此外，存储器02可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
处理器03，是终端的控制中心，利用各种接口和线路连接整个终端的各个部分，通过运行或执行存储在存储器02内的软件程序和/或模块，以及调用存储在存储器02内的数据，执行终端的各种功能和处理数据，从而对终端进行整体监控。处理器03可包括一个或多个处理单元；优选的，处理器03可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器03中。
尽管图1未示出，但上述终端还可以包括电路控制模块，电路控制模块用于与市电连接，实现电源控制，保证其他部件的正常工作。
本领域技术人员可以理解，图1中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
根据上述硬件结构，提出本申请方法各个实施例。
参照图2，在本申请视频流播放方法的第一实施例中，所述视频流播放方法包括步骤：
步骤S10，实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；
在本方案中，终端通过无线网络或有线网络与服务器建立通信连接，终端和服务器端的通信目前包括两种方式UDP和TCP传输协议。TCP即传输控制协议是面向连接、可靠的数据流服务。在终端和服务器进行交换数据前，需要先在双方之间建立一个TCP连接，然后才能传输数据。TCP传输提供了超时重发，丢弃重复数据，检验数据，流量控制等功能，从而保证数据能从一端传到另一端。而UDP即用户数据报协议是一个简单的面向数据报的运输层协议，UDP不提供可靠性，它只是把数据报发送出去，不会保证它们能到达目的地。由于UDP在传输数据前不会在客户断和服务端之间建立一个连接，且没有超时重发等机制，故而传输速度很快。视音频数据流是连续的，需要确保同步点一致，为了适应这种数据传输在本方案中使用面向连接的可靠的TCP传输协议。在与服务器建立通信连接后，终端基于用户的需求，发送视频获取请求至服务器，该视频获取请求中可以包括视频名称和/或视频下载地址，以使服务器根据所述视频获取请求，将对应的视频以视频流的方式将该视频的音视频数据实时发送至终端。终端实时接收服务器发送的音视频数据，服务器是采用视频流方式传输视频数据至终端，故这些音视频数据是属于同一个视频，是一个视频被切分成多个音视频数据中一个音视频数据。终端接收到一个音视频数据后，就将接收到的一个音视频数据存储至缓存区域中。
步骤S20，实时将缓存区域中最先存储的音视频数据移至待解码区域中；终端在实时接收服务器发送的音视频数据的同时，会实时将缓存区域中最先存储的音视频数据从缓存区域中移出，并移至待解码区域中。
具体地的，请参照图3，图3为本申请一种实施例中实时将缓存区域中最先存储的音视频数据移至待解码区域中的步骤的流程细化示意图，基于上述实施例，步骤S20包括：
步骤S21，判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值；
步骤S22，若否，则将缓存区域中最先存储的音视频数据移至待解码区域中。
具体的，为了防止待解码区域中存储过多的音视频数据，占用终端太多内存，导致终端系统性能降低，影响终端的解码功能，会为待解码区域设置一个最大存储数据量第一预设阈值，在将缓存区域中最先存储的音视频数据移至待解码区域中之前，终端会先获取待解码区域中当前存储的音视频数据的数量，并判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值，若未达到第一预设阈值时，会实时地将缓存区域中最先存储的音视频数据从缓存区域中移除，并移至待解码区域中存储。若达到了第一预设阈值，则会暂时停止将缓存区域中最先存储的音视频数据从缓存区域中移除并移至待解码区域中，而是实时获取待解码区域中当前存储的音视频数据的数量，并判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值，只要当确定待解码区域中当前存储的音视频数据的数量未达到第一预设阈值时，便会继续将缓存区域中最先存储的音视频数据从缓存区域中移除并移至待解码区域中。
步骤S30，实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。
终端在实时接收服务器发送的音视频数据的同时，也会实时从待解码区域中提取最先存储的音视频数据，并对提取的最先存储的音视频数据进行解码播放。
具体地，步骤S30中所述对提取的待解码区域中最先存储的音视频数据进行解码播放的步骤包括：
步骤S31，对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据；
步骤S32，同步播放所述视频数据和所述音频数据。
本实施例中使用解码工具，例如使用DirectShow技术对提取的待解码区域中最先存储的音视频数据进行解码。具体的，首先采用视频流分离器将提取的待解码区域中最先存储的音视频数据分离为视频数据和视频数据对应的音频数据，然后采用视频解码器和声音解码器对应的对分离出的视频数据和视频数据对应的音频数据进行解码，获得待播放的视频数据和待播放的视频数据所对应的待播放的音频数据，最后同步播放待播放的视频数据和待播放的视频数据所对应的待播放的音频数据。
在一实施例中，所述同步播放所述视频数据和所述音频数据的步骤S32之前还包括：
步骤S33，对所述视频数据和所述音频数据进行渲染，获得渲染后的视频数据和音频数据；
所述同步播放所述视频数据和所述音频数据的步骤S32包括：
步骤S34，同步播放渲染后的视频数据和音频数据。
为了提高视频播放的质量和效果，在获得待播放的视频数据和待播放的音频数据之后，同步播放待播放的视频数据和所述待播放的视频数据对应的音频数据之前，会采用特定的视频渲染工具对待播放的视频数据进行渲染，获得渲染后的待播放的视频数据，还会采用音频渲染工具对所述待播放的视频数据对应的音频数据进行音频渲染，获得渲染后的待播放音频数据。
需要说明的是，由于进行视频数据的渲染的工具和进行音频渲染的工具是不同的，故本实例中，所述对所述视频数据进行渲染，获得渲染后的视频数据的步骤可以在所述对所述音频数据进行渲染，获得渲染后的音频数据的步骤之前进行，也可以在渲染音频数据的步骤之后进行，也可以同步进行，在此不对渲染视频数据的步骤和渲染音频数据的步骤的执行顺序进行限定。
需要说明的是，只要确定缓存区域中存储有音视频数据时，便会执行步骤S20，只要确定待解码区域中存储有音视频数据时，便会执行步骤S30，在此并不对步骤S10、步骤S20和步骤S30之间的顺序进行限定。
需要说明的是，在视频播放过程中，若用户需要更换视频，用户会发送更换视频指令至终端，终端接收到更换视频指令后，会清除缓存区域和待解码区域中已存储的音视频数据，当然，清除待解码区域中已存储的音视频数据可以在接收到用户更换视频指令后的预设时间进行，在清除缓存区域的音视频数据的同时会发送一个视频请求至服务器，其中视频请求中包括更换的视频名称和/或更换的视频下载地址，服务器会根据新的视频请求，会停止当前正在发送的音视频数据，而开始将更换的视频对应音视频数据发送至终端。在视频播放过程中，当终端接收到用户发送的暂停播放指令时，终端会发送暂停发送指令至服务器，以使服务器接收到暂停发送指令后，停止发送音视频数据。
本实例通过实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；实时将缓存区域中最先存储的音视频数据移至待解码区域中；实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。终端通过设置了两个存储音视频数据的缓存区域和待解码区域，避免获取到的视频数据立即送到解码器解码，导致解码器在单位时间内需要解码的视频数据量不均匀，进而导致解码器的解码压力在短时间内增大，从而出现画面卡顿的问题，而且音视频数据从接收到解码过程中，是会先进入缓存区域再进入待解码区域，并且对两个区域中存储的音视频数据都是采用先进先出的策略，确保对接收到的音视频数据按顺序进行处理，有效避免播放画面跳跃等问题，更好地提高了用户体验。
在一实施例中，请参照图4，图4为根据本申请视频流播放方法的第一实施例提出本申请视频流播放方法的第二实施例，在本实施例中，步骤S10中所述实时接收服务器发送的音视频数据的步骤包括：
步骤S11，获取待解码区域中的当前存储的音视频数据的数量；
步骤S12，判断待解码区域中的当前存储的音视频数据的数量是否达到预设第二预设阈值，其中所述第一预设阈值大于所述第二预设阈值；若否，则执行步骤S13；若是，则执行步骤S14；
步骤S13，采用预设的第一下行网络速率实时接收服务器发送的音视频数据；
步骤S14，采用预设的第二下行网络速率实时接收服务器发送的音视频数据，其中所述第二下行网络速率小于所述第一下行网络速率。
由于终端是从待解码区域中提取待解码的音视频数据进行解码，待解码区域中的音视频数据又是来自于缓存区域中，而缓存区域中的音视频数据则是源于终端实时接收服务器发送的音视频数据，随着终端持续的提取音视频数据进行解码，当待解码区域中的当前存储的音视频数据的数量过少时，终端会出现由于待解码区域中已没有当前存储的音视频数据，而导致解码停顿，进而导致播放画面停顿，而当待解码区域中的音视频数据的数量较多时，已经能够满足终端持续的解码，若终端继续快速的接收音视频数据并存储，导致大量的音视频数据被存储在缓存区域和待解码区域中，占据终端内存，影响终端系统性能，进而影响终端的解码和播放功能，导致出现卡顿现象，为了解决上述问题，预先为待解码区域中存储的音视频数据的数量设置了第二预设阈值，其中第一预设阈值大于第二预设阈值，终端会实时获取待解码区域中的当前存储的音视频数据的数量，当终端判断待解码区域中的当前存储的音视频数据的数量是否达到预设第二预设阈值，若未达到，说明当前待解码区域中存储的音视频数据量过少，可能出现解码停顿现象，需要加快终端接收音视频数据的速率，故会提高网络下行速率，即采用第一下行网络速率实时接收服务器发送的音视频数据；若未达到，说明当前待解码区域中存储的音视频数据量过多，不需要再增加终端中存储的音视频数据量了，故会降低网络下行速率，即采用第二下行网络速率实时接收服务器发送的音视频数据，其中第二下行网络速率小于所述第一下行网络速率。
本实施例通过根据待解码区域中当前存储的音视频数据的数量，来调整终端接收服务器发送音视频数据的速率，从而避免由于待解码区域中存储的音视频数据的数量过少导致的视频播放停顿问题，以及避免待解码区域中存储的音视频数据的数量过多导致的视频解码和播放卡顿的问题。
在一实施例中，基于本申请视频流播放方法前述实施例提出本申请视频流播放方法的第三实施例，在本实例中，所述步骤S14之前还包括：
步骤S15，判断缓存区域中的当前存储的音视频数据的数量是否达到第三预设阈值；若否，则执行步骤S14；若是，则执行步骤S16；
步骤S14，采用预设的第二下行网络速率实时接收服务器发送的音视频数据；
步骤S16，采用预设的第三下行网络速率实时接收服务器发送的音视频数据，其中所述第三下行网络速率小于所述第二下行网络速率。
即使在待解码区域中当前存储的音视频数据的数量已经达到第二预设阈值时，并且降低了终端的下行网络速率，但终端仍然会继续接收音视频数据，并继续将音视频数据存储至缓存区域中，仍然使得缓存区域中当前存储的音视频数据过多，占据终端系统过多内存，影响终端系统的运行，为了在一实施例中控制避免对系统运行的影响，预先为缓存区域中存储的音视频数据的数量设置了第三预设阈值，终端除了实时获取待解码区域中当前存储的音视频数据的数量，还会实时获取缓存区域中当前存储的音视频数据的数量，并在待解码区域中当前存储的音视频数据的数量已经达到第二预设阈值，但缓存区域中当前存储的音视频数据的数量未达到第三预设阈值时，终端会采用预设的第二下行网络速率实时接收服务器发送的音视频数据；在待解码区域中当前存储的音视频数据的数量已经达到第二预设阈值，并且缓存区域中当前存储的音视频数据的数量达到第三预设阈值时，终端会继续降低下行网络速率，即采用预设的第三下行网络速率实时接收服务器发送的音视频数据，其中第三下行网络速率小于第二下行网络速率。
需要说明的时，在一实施例中还可以为缓存区域中存储的音视频数据的数量设置了第四预设阈值，第四预设阈值大于第三预设阈值，当待解码区域中当前存储的音视频数据的数量已经达到第二预设阈值，并且缓存区域中当前存储的音视频数据的数量达到第四预设阈值时，终端会发送停止指令至服务器，以使服务器根据所述停止指令，停止发送音视频数据，从而终端会暂停接收服务器发送的音视频数据。
本实施例通过在待解码区域中当前存储的音视频数据的数量达到第二预设阈值的情况下，根据缓存区域中当前存储的音视频数据的数量，来调整终端接收服务器发送音视频数据的速率，从而避免缓存区域中存储的音视频数据的数量过多影响终端系统运行，进而避免导致系统出现卡顿现象。
参见图5，本申请还提供一种视频流播放系统，包括：
接收模块10，用于实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；
移存模块20，用于实时将缓存区域中最先存储的音视频数据移至待解码区域中；
提取模块30，用于实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。
在一实施例中，所述移存模块20包括：
第一判断单元21，用于判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值；
移存单元22，用于若待解码区域中当前存储的音视频数据的数量未达到第一预设阈值，则实时将缓存区域中最先存储的音视频数据移至待解码区域中。
在一实施例中，所述接收模块10包括：
获取单元11，用于获取待解码区域中的当前存储的音视频数据的数量；
第二判断单元12，用于判断待解码区域中的当前存储的音视频数据的数量是否达到预设第二预设阈值，其中所述第一预设阈值大于所述第二预设阈值；
第一接收单元13，用于若待解码区域中的当前存储的音视频数据的数量未达到预设第二预设阈值，则采用预设的第一下行网络速率实时接收服务器发送的音视频数据；
第二接收单元14，用于若待解码区域中的当前存储的音视频数据的数量达到预设第二预设阈值，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据，其中所述第二下行网络速率小于所述第一下行网络速率。
在一实施例中，所述第二接收单元14还包括：
判断子单元141，用于判断缓存区域中的当前存储的音视频数据的数量是否达到第三预设阈值；
第一接收子单元142，用于若否，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据；
第二接收子单元143，用于若是，则采用预设的第三下行网络速率实时接收服务器发送的音视频数据，其中所述第三下行网络速率小于所述第二下行网络速率。
在一实施例中，所述视频流播放系统还包括：
连接模块40，用于采用TCP协议与服务器建立通信连接。
发送模块50，用于发送视频获取请求至服务器，以使服务器根据所述视频获取请求发送音视频数据。
在一实施例中，所述提取模块30包括：
解码单元31，用于对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据；
播放单元32，用于同步播放所述视频数据和所述音频数据。
在一实施例中，所述提取模块30还包括：
渲染单元33，用于对所述视频数据和所述音频数据进行渲染，获得渲染后的视频数据和音频数据；
所述播放单元32包括：
播放子单元321，用于同步播放渲染后的视频数据和音频数据。
本申请还提出一种计算机可读存储介质，其上存储有计算机程序。所述计算机可读存储介质可以是图1的终端中的存储器02，也可以是如ROM（Read-Only Memory，只读存储器）/RAM（Random Access Memory，随机存取存储器）、磁碟、光盘中的至少一种，所述计算机可读存储介质包括若干信息用以使得终端执行本申请各个实施例所述的方法。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。

Claims (20)

  1. 一种视频流播放方法，其中，包括步骤：
    实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；
    实时将缓存区域中最先存储的音视频数据移至待解码区域中；
    实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。
  2. 根据权利要求1所述的视频流播放方法，其中，所述实时将缓存区域中最先存储的音视频数据移至待解码区域中的步骤包括：
    判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值；
    若否，则实时将缓存区域中最先存储的音视频数据移至待解码区域中。
  3. 根据权利要求2所述的视频流播放方法，其中，所述实时接收服务器发送的音视频数据的步骤包括：
    获取待解码区域中的当前存储的音视频数据的数量；
    判断待解码区域中的当前存储的音视频数据的数量是否达到预设第二预设阈值，其中所述第一预设阈值大于所述第二预设阈值；
    若否，则采用预设的第一下行网络速率实时接收服务器发送的音视频数据；
    若是，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据，其中所述第二下行网络速率小于所述第一下行网络速率。
  4. 根据权利要求3所述的视频流播放方法，其中，所述采用预设的第二下行网络速率实时接收服务器发送的音视频数据的步骤之前还包括：
    判断缓存区域中的当前存储的音视频数据的数量是否达到第三预设阈值；
    若否，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据；
    若是，则采用预设的第三下行网络速率实时接收服务器发送的音视频数据，其中所述第三下行网络速率小于所述第二下行网络速率。
  5. 根据权利要求1至4中任一项所述的视频流播放方法，其中，所述实时接收服务器发送的音视频数据的步骤之前还包括：
    采用TCP协议与所述服务器建立通信连接；
    发送视频获取请求至所述服务器，以使所述服务器根据所述视频获取请求发送音视频数据。
  6. 根据权利要求5所述的视频流播放方法，其中，所述对提取的待解码区域中最先存储的音视频数据进行解码播放步骤包括：
    对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据；
    同步播放所述视频数据和所述音频数据。
  7. 根据权利要求6所述的视频流播放方法，其中，所述对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据包括：
    采用视频流分离器将提取的待解码区域中最先存储的音视频数据分离为视频数据和视频数据对应的音频数据；以及
    采用视频解码器和声音解码器对应的对分离出的视频数据和视频数据对应的音频数据进行解码，获得待播放的视频数据和待播放的视频数据所对应的待播放的音频数据。
  8. 根据权利要求6或7所述的视频流播放方法，其中，所述同步播放所述视频数据和所述音频数据的步骤之前，还包括：
    对所述视频数据和所述音频数据进行渲染，获得渲染后的视频数据和音频数据；
    所述同步播放所述视频数据和所述音频数据的步骤包括：
    同步播放渲染后的视频数据和音频数据。
  9. 根据权利要求4所述的视频流播放方法，其中，所述缓存区域中存储的音视频数据的数量设置了第四预设阈值，所述第四预设阈值大于所述第三预设阈值；所述实时接收服务器发送的音视频数据还包括：
    当所述待解码区域中当前存储的音视频数据的数量达到所述第二预设阈值，并且所述缓存区域中当前存储的音视频数据的数量达到所述第四预设阈值时，发送停止指令给所述服务器，以暂停接收所述服务器发送的音视频数据。
  10. 一种视频流播放系统，其中，所述视频流播放系统包括：
    接收模块，用于实时接收服务器发送的音视频数据，并将接收到的音视频数据存储至缓存区域中；
    移存模块，用于实时将缓存区域中最先存储的音视频数据移至待解码区域中；
    提取模块，用于实时提取待解码区域中最先存储的音视频数据，并对提取的待解码区域中最先存储的音视频数据进行解码播放。
  11. 根据权利要求10所述的视频流播放系统，其中，所述移存模块包括：
    第一判断单元，用于判断待解码区域中当前存储的音视频数据的数量是否达到第一预设阈值；
    移存单元，用于若待解码区域中当前存储的音视频数据的数量未达到第一预设阈值，则实时将缓存区域中最先存储的音视频数据移至待解码区域中。
  12. 根据权利要求11所述的视频流播放系统，其中，所述接收模块包括：
    获取单元，用于获取待解码区域中的当前存储的音视频数据的数量；
    第二判断单元，用于判断待解码区域中的当前存储的音视频数据的数量是否达到预设第二预设阈值，其中所述第一预设阈值大于所述第二预设阈值；
    第一接收单元，用于若待解码区域中的当前存储的音视频数据的数量未达到预设第二预设阈值，则采用预设的第一下行网络速率实时接收服务器发送的音视频数据；
    第二接收单元，用于若待解码区域中的当前存储的音视频数据的数量达到预设第二预设阈值，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据，其中所述第二下行网络速率小于所述第一下行网络速率。
  13. 根据权利要求12所述的视频流播放系统，其中，所述第二接收单元还包括：
    判断子单元，用于判断缓存区域中的当前存储的音视频数据的数量是否达到第三预设阈值；
    第一接收子单元，用于若否，则采用预设的第二下行网络速率实时接收服务器发送的音视频数据；
    第二接收子单元，用于若是，则采用预设的第三下行网络速率实时接收服务器发送的音视频数据，其中所述第三下行网络速率小于所述第二下行网络速率。
  14. 根据权利要求10至13中任一项所述的视频流播放系统，其中，所述视频流播放系统还包括：
    连接模块，用于采用TCP协议与服务器建立通信连接。
    发送模块，用于发送视频获取请求至服务器，以使服务器根据所述视频获取请求发送音视频数据。
  15. 根据权利要求14所述的视频流播放系统，其中，所述提取模块包括：
    解码单元，用于对提取的待解码区域中最先存储的音视频数据进行解码，获得视频数据和音频数据；
    播放单元，用于同步播放所述视频数据和所述音频数据。
  16. 根据权利要求15所述的视频流播放系统，其中，所述解码单元，用于采用视频流分离器将提取的待解码区域中最先存储的音视频数据分离为视频数据和视频数据对应的音频数据；以及采用视频解码器和声音解码器对应的对分离出的视频数据和视频数据对应的音频数据进行解码，获得待播放的视频数据和待播放的视频数据所对应的待播放的音频数据。
  17. 根据权利要求15或16所述的视频流播放系统，其中，所述提取模块还包括：
    渲染单元，用于对所述视频数据和所述音频数据进行渲染，获得渲染后的视频数据和音频数据；
    所述播放单元包括：
    播放子单元，用于同步播放渲染后的视频数据和音频数据。
  18. 根据权利要求13所述的视频流播放系统，其中，所述缓存区域中存储的音视频数据的数量设置了第四预设阈值，所述第四预设阈值大于所述第三预设阈值，所述接收模块，还用于当所述待解码区域中当前存储的音视频数据的数量达到所述第二预设阈值，并且所述缓存区域中当前存储的音视频数据的数量达到所述第四预设阈值时，发送停止指令给所述服务器，以暂停接收所述服务器发送的音视频数据。
  19. 一种终端，其中，所述终端包括存储器、处理器和存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如权利要求1至9中任一项所述的视频流播放方法的步骤。
  20. 一种计算机可读存储介质，其中，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1至9中任一项所述的视频流播放方法的步骤。
PCT/CN2020/114388 2020-03-09 2020-09-10 视频流播放方法、系统、终端及存储介质 Ceased WO2021179557A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20924078.7A EP3952318A4 (en) 2020-03-09 2020-09-10 VIDEO STREAM REPLAY METHOD, SYSTEM AND TERMINAL, AND STORAGE MEDIUM
US17/683,680 US20220272402A1 (en) 2020-03-09 2022-03-01 Video stream playing method, system, terminal and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010159919.0A CN111246284B (zh) 2020-03-09 2020-03-09 视频流播放方法、系统、终端及存储介质
CN202010159919.0 2020-03-09

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/683,680 Continuation US20220272402A1 (en) 2020-03-09 2022-03-01 Video stream playing method, system, terminal and storage medium

Publications (1)

Publication Number Publication Date
WO2021179557A1 true WO2021179557A1 (zh) 2021-09-16

Family

ID=70880225

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/114388 Ceased WO2021179557A1 (zh) 2020-03-09 2020-09-10 视频流播放方法、系统、终端及存储介质

Country Status (4)

Country Link
US (1) US20220272402A1 (zh)
EP (1) EP3952318A4 (zh)
CN (1) CN111246284B (zh)
WO (1) WO2021179557A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174924A (zh) * 2022-07-20 2022-10-11 天翼数字生活科技有限公司 一种机顶盒、视频起播时延计算方法、系统、设备和介质

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111246284B (zh) * 2020-03-09 2021-05-25 深圳创维－Rgb电子有限公司 视频流播放方法、系统、终端及存储介质
CN112055231B (zh) * 2020-08-31 2021-10-15 浙江大华技术股份有限公司 视频解码方法、解码装置、解码器及电子设备
CN112395469B (zh) * 2020-11-27 2025-01-17 中国银联股份有限公司 生物特征存储方法、装置、设备及存储介质
CN112601109A (zh) * 2020-11-30 2021-04-02 海信视像科技股份有限公司 音频播放方法及显示设备
CN112600815B (zh) * 2020-12-08 2023-11-17 努比亚技术有限公司 视频显示方法、终端及计算机可读存储介质
CN114173426B (zh) * 2021-11-30 2023-09-29 广州番禺巨大汽车音响设备有限公司 基于无线音频传输的无线音箱播放控制方法、装置及系统
CN114528171B (zh) * 2022-02-25 2025-07-25 重庆紫光华山智安科技有限公司 丢帧判断方法、装置、存储服务器以及可读存储介质
CN115691513B (zh) * 2022-09-16 2026-02-03 广州赛特智能科技有限公司 一种实时语音通信系统、方法、设备及存储介质
CN116055810B (zh) * 2023-01-17 2024-11-12 阿里云计算有限公司 音视频播放方法、装置、系统、电子设备及存储介质
CN116170622B (zh) * 2023-02-21 2025-12-30 阿波罗智联(北京)科技有限公司 音视频播放方法、装置、设备及介质
CN117316169B (zh) * 2023-11-28 2024-09-06 深圳市东明炬创电子股份有限公司 音频数据处理方法、装置、设备及计算机可读存储介质
CN117499688B (zh) * 2023-12-29 2024-05-03 淘宝（中国）软件有限公司 直播连麦中音视频合流处理方法、设备及存储介质
CN117891377B (zh) * 2024-03-14 2024-07-26 荣耀终端有限公司 显示方法和电子设备
CN118573928B (zh) * 2024-07-31 2024-10-01 海马云（天津）信息技术有限公司 云应用画面处理方法与装置、电子设备及存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6434606B1 (en) * 1997-10-01 2002-08-13 3Com Corporation System for real time communication buffer management
CN1669019A (zh) * 2002-07-16 2005-09-14 诺基亚有限公司 多媒体流中实现分组交换延迟补偿的方法
CN1998239A (zh) * 2004-07-01 2007-07-11 奥伊加梅克拉斯特公司 向解码器提供数据的方法和设备
CN101098470A (zh) * 2006-06-28 2008-01-02 腾讯科技（深圳）有限公司 一种基于p2p技术的流媒体节目播放/接收方法及装置
CN101540882A (zh) * 2008-03-21 2009-09-23 盛大计算机（上海）有限公司 基于内存流传输的p2p点播方法
CN102547435A (zh) * 2011-12-16 2012-07-04 Tcl集团股份有限公司 一种多媒体文件播放处理系统及方法
CN103139103A (zh) * 2011-12-02 2013-06-05 京信通信系统（中国）有限公司 一种网络拥塞的控制方法及装置
CN105075281A (zh) * 2013-06-05 2015-11-18 松下电器（美国）知识产权公司 数据解码方法、数据解码装置及数据发送方法
CN111246284A (zh) * 2020-03-09 2020-06-05 深圳创维－Rgb电子有限公司 视频流播放方法、系统、终端及存储介质

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100759954B1 (ko) * 2003-02-13 2007-09-19 노키아 코포레이션 멀티미디어 스트리밍에서 클라이언트 레이트 능력을시그널링하는 방법
US7844727B2 (en) * 2003-04-24 2010-11-30 Nokia Corporation Method and device for proactive rate adaptation signaling
US8218439B2 (en) * 2004-11-24 2012-07-10 Sharp Laboratories Of America, Inc. Method and apparatus for adaptive buffering
US7743183B2 (en) * 2005-05-23 2010-06-22 Microsoft Corporation Flow control for media streaming
US7895629B1 (en) * 2007-11-07 2011-02-22 At&T Mobility Ii Llc Video service buffer management in a mobile rate control enabled network
WO2010100875A1 (ja) * 2009-03-02 2010-09-10 パナソニック株式会社 記録媒体、再生装置、及び集積回路
US9380091B2 (en) * 2012-06-12 2016-06-28 Wi-Lan Labs, Inc. Systems and methods for using client-side video buffer occupancy for enhanced quality of experience in a communication network
KR20110065100A (ko) * 2009-12-09 2011-06-15 삼성전자주식회사 멀티미디어 스트리밍 서비스를 지원하는 방법 및 장치
CN101873475B (zh) * 2010-01-07 2012-09-05 杭州海康威视数字技术股份有限公司 控制命令发送方法、数据传输方法、监控系统及设备
US9124520B2 (en) * 2013-08-27 2015-09-01 Cisco Technology, Inc. Reducing buffer bloat while probing for additional bandwidth in an adaptive bitrate network
CN103596040B (zh) * 2013-12-03 2017-02-15 百视通网络电视技术发展有限责任公司 数字电视地面广播与互联网双模式的电视接收系统
CN105472404B (zh) * 2014-09-11 2018-11-13 成都鼎桥通信技术有限公司 一种视频业务中的数据处理方法
CN105100874A (zh) * 2015-06-29 2015-11-25 百度在线网络技术（北京）有限公司 一种用于多媒体播放的方法与设备
US9985887B2 (en) * 2015-08-27 2018-05-29 Cavium Inc. Method and apparatus for providing a low latency transmission system using adaptive buffering estimation
CN105681893B (zh) * 2015-12-31 2019-02-12 传线网络科技（上海）有限公司 流媒体视频数据的解码方法和装置
CN108282657A (zh) * 2018-01-24 2018-07-13 深圳市道通科技股份有限公司 视频帧传输方法、探测器及用户设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6434606B1 (en) * 1997-10-01 2002-08-13 3Com Corporation System for real time communication buffer management
CN1669019A (zh) * 2002-07-16 2005-09-14 诺基亚有限公司 多媒体流中实现分组交换延迟补偿的方法
CN1998239A (zh) * 2004-07-01 2007-07-11 奥伊加梅克拉斯特公司 向解码器提供数据的方法和设备
CN101098470A (zh) * 2006-06-28 2008-01-02 腾讯科技（深圳）有限公司 一种基于p2p技术的流媒体节目播放/接收方法及装置
CN101540882A (zh) * 2008-03-21 2009-09-23 盛大计算机（上海）有限公司 基于内存流传输的p2p点播方法
CN103139103A (zh) * 2011-12-02 2013-06-05 京信通信系统（中国）有限公司 一种网络拥塞的控制方法及装置
CN102547435A (zh) * 2011-12-16 2012-07-04 Tcl集团股份有限公司 一种多媒体文件播放处理系统及方法
CN105075281A (zh) * 2013-06-05 2015-11-18 松下电器（美国）知识产权公司 数据解码方法、数据解码装置及数据发送方法
CN111246284A (zh) * 2020-03-09 2020-06-05 深圳创维－Rgb电子有限公司 视频流播放方法、系统、终端及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3952318A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174924A (zh) * 2022-07-20 2022-10-11 天翼数字生活科技有限公司 一种机顶盒、视频起播时延计算方法、系统、设备和介质
CN115174924B (zh) * 2022-07-20 2024-05-28 天翼数字生活科技有限公司 一种机顶盒、视频起播时延计算方法、系统、设备和介质

Also Published As

Publication number Publication date
US20220272402A1 (en) 2022-08-25
CN111246284A (zh) 2020-06-05
EP3952318A4 (en) 2023-01-11
EP3952318A1 (en) 2022-02-09
CN111246284B (zh) 2021-05-25

Similar Documents

Publication Publication Date Title
WO2021179557A1 (zh) 视频流播放方法、系统、终端及存储介质
US11792130B2 (en) Audio/video communication method, terminal, server, computer device, and storage medium
EP2781070B1 (en) Media streaming in mobile networks with improved efficiency
US20130346562A1 (en) Data transmission method and apparatus for mobile terminal
EP2744169A1 (en) Method and apparatus for playing streaming media files
CN114584833B (zh) 音视频的处理方法、装置及存储介质
WO2019019370A1 (zh) 一种音视频的直播处理方法、存储介质和一种移动终端
CN114051173B (zh) 一种基于rtp扩展头部的视频帧可靠传输方法、装置及设备
CN107820100B (zh) 互联网音视频播放方法及装置
WO2013116975A1 (zh) 流媒体播放方法、设备及系统
CN113242436B (zh) 直播数据的处理方法、装置及电子设备
CN107040825B (zh) 终端、电视机、多屏互动系统和抓屏参数的设置方法
WO2024244879A1 (zh) 网络传输优化方法、装置、存储介质、电子设备及程序产品
CN112866345B (zh) 一种基于WebSocket的流媒体低延时通信实现方法、电子设备、存储介质
KR101164746B1 (ko) 실시간 스트리밍 프로토콜을 기반으로 한 동영상 재생 서비스에서 동영상 재생 지연 보상 시스템 및 방법
US8493429B2 (en) Method and terminal for synchronously recording sounds and images of opposite ends based on circuit domain video telephone
KR100739172B1 (ko) 의사 스트리밍 기술을 이용한 이동 단말기의 동영상 전송방법
US20140226561A1 (en) Method and apparatus for video or multimedia content delivery
CN109982080A (zh) 一种视频传输的方法、存储介质、机器人及控制系统
CN100459695C (zh) 视频数据传输方法及其传输系统
CN114338624B (zh) 无线投屏数据处理方法、智能终端及可读存储介质
CN110266706A (zh) 一种多媒体流数据的播放方法和装置
CN115942000A (zh) 基于h.264格式的视频流转码方法及装置、设备及介质
CN117955920A (zh) 一种数据传输方法、装置、设备以及存储介质
CN116208584B (zh) 适用于多网卡设备的流媒体传输优化方法、设备及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20924078

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020924078

Country of ref document: EP

Effective date: 20211103

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: 2020924078

Country of ref document: EP