WO2016131223A1 - 一种视频帧丢帧方法及视频发送装置 - Google Patents

一种视频帧丢帧方法及视频发送装置 Download PDF

Info

Publication number
WO2016131223A1
WO2016131223A1 PCT/CN2015/083667 CN2015083667W WO2016131223A1 WO 2016131223 A1 WO2016131223 A1 WO 2016131223A1 CN 2015083667 W CN2015083667 W CN 2015083667W WO 2016131223 A1 WO2016131223 A1 WO 2016131223A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
video
sequence
video frame
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/083667
Other languages
English (en)
French (fr)
Inventor
付洋
王提政
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP15882362.5A priority Critical patent/EP3253064A4/en
Publication of WO2016131223A1 publication Critical patent/WO2016131223A1/zh
Priority to US15/678,846 priority patent/US10659847B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746—Control signals issued by the network directed to the server or the client
    • H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23406—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving management of server-side video buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets

Definitions

  • the present invention relates to the field of communications, and in particular, to a video frame dropping method and a video transmitting apparatus.
  • the video to be transmitted is encoded to generate a full frame rate code stream.
  • the full frame rate code stream is sent.
  • the frame rate of the video is quickly reduced by dropping frames.
  • Adapt to the actual network environment Specifically, when a buffer overflow occurs due to a poor network environment, the entire video frame between the last frame of the buffer and the next IDR frame is discarded. When the next IDR frame appears, a buffer overflow judgment is made. If the buffer is idle, the IDR frame is reserved and the subsequent frame is transmitted. If the buffer is still in an overflow state, the IDR frame is discarded until the next IDR frame.
  • This method of dropping frames is to discard a series of consecutive video frames. Because the number of discarded video frames in a lost frame is large, the picture is stuck for a long time. Especially after the IDR frame is discarded, the picture is more serious. , resulting in poor user experience.
  • Embodiments of the present invention provide a video frame dropping method and a video transmitting apparatus, which can reduce the number of dropped frames, thereby improving the smoothness of video playback and improving the user experience.
  • a video frame dropping method includes:
  • the reference relationship includes: the mth frame in the video frame sequence refers to the mth frame as a reference frame; the video frame sequence The nth frame in the video frame after the nth frame At least two video frames are referenced as reference frames; wherein m, h, and n are all natural numbers, m is greater than 1 and m is greater than h, and the number of video frames in the sequence of video frames is not less than n+2;
  • the video frame to be buffered is discarded, and all video frames in the video frame sequence that reference the video frame to be buffered according to the reference relationship as a reference frame are discarded.
  • the preset criterion is a requirement for smoothness of video playback
  • the IDR frame is the first frame of the video frame sequence.
  • the preset criterion is an importance of each video frame in the sequence of video frames
  • a video frame with a relatively high importance is directly referred to as a reference frame by a video frame with a relatively low importance.
  • the preset criterion is a reference transmission rate of the network
  • the IDR frame is the first frame of the video frame sequence.
  • the reference relationship between the video frames in the video frame sequence specifically includes:
  • each video frame after the IDR frame refers to the IDR frame as a reference frame.
  • each video frame in the sequence of video frames corresponds to a transmit buffer. Preset threshold.
  • the method further includes:
  • the current video frame to be buffered is stored in the sending buffer.
  • a video transmitting apparatus includes:
  • An acquiring unit configured to acquire a sequence of video frames of a video to be sent
  • a coding unit configured to establish, according to a preset criterion, a reference relationship between video frames in the video frame sequence acquired by the acquiring unit; the reference relationship includes: an mth frame reference in the video frame sequence
  • the mh frame is a reference frame
  • the nth frame in the video frame sequence is referred to as a reference frame by at least two video frames in the video frame after the nth frame; wherein m, h, and n are natural numbers, m is greater than 1 and m is greater than h, the number of video frames in the sequence of video frames is not less than n + 2;
  • a detecting unit configured to detect a data occupation length of a buffered video frame of the video sending buffer during the sending of the video frame sequence
  • a frame dropping unit configured to discard a video frame to be buffered when the detecting unit detects that the data occupation length is greater than a preset threshold, and discard the current reference in the video frame sequence according to the reference relationship
  • the video frame to be buffered is all video frames of the reference frame.
  • the preset criterion is a requirement for smoothness of video playback
  • the reference relationship between the video frames in the video frame sequence established by the coding unit includes: the higher the requirement of the video playback fluency, the more the video frames that directly reference the instant decoding and refresh the IDR frame as the reference frame;
  • the IDR frame is the first frame of the sequence of video frames.
  • the preset criterion is an importance of each video frame in the sequence of video frames
  • the reference relationship between the video frames in the video frame sequence established by the coding unit includes: a video frame with a relatively high importance is directly referred to as a reference frame by a video frame with a relatively low importance.
  • the preset criterion is a reference transmission rate of the network
  • the method includes: the higher the reference transmission rate of the network, the more video frames directly referencing the instant decoding refresh IDR frame as the reference frame.
  • the reference relationship between the video frames in the video frame sequence specifically includes:
  • each video frame after the IDR frame refers to the IDR frame as a reference frame.
  • each video frame in the sequence of video frames corresponds to a transmit buffer. Preset threshold.
  • the frame dropping unit is further configured to: when the detecting unit detects the When the data occupation length is not greater than the preset threshold, the current video frame to be buffered is stored in the sending buffer.
  • the video frame frame dropping method and the video transmitting apparatus establish a reference relationship between video frames in the video frame sequence according to a preset standard, and further determine whether to drop a frame.
  • the video frame to be buffered is discarded, and all the video frames in the video frame sequence that reference the video frame to be buffered according to the reference relationship as the reference frame are discarded.
  • the nth frame in the sequence of video frames is referenced by the at least two video frames in the video frame after the nth frame as a reference frame, and the video frame of the reference frame is the nth frame, when it is determined that the video frame is discarded, other
  • the video frame with the nth frame as the reference frame can still be reserved without dropping the frame until the IDR frame appears, thereby reducing the number of discarded video frames in one drop frame and avoiding the long-time picture jam.
  • the reserved video frame can be sent at a higher frame rate, thereby achieving the purpose of reducing or increasing the frame rate of the video transmission according to changes in the network environment, thereby reducing
  • the number of discarded video frames increases the smoothness of video playback.
  • FIG. 1 is a schematic flowchart of a method for dropping a video frame according to an embodiment of the present invention
  • 2-1 is a schematic diagram of a reference relationship between video frames according to an embodiment of the present invention.
  • FIG. 2-2 is a schematic diagram of a reference relationship between video frames in a video frame sequence according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a video sending apparatus according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of another video transmitting apparatus according to an embodiment of the present invention.
  • an IPC video on demand system includes a video transmitting device and a video receiving device.
  • the video transmitting device acquires a video frame sequence by imaging, and encodes the video frame sequence and transmits the video frame to the video receiving device through the network.
  • the transmission method includes a broadband network, a 3G (3rd-generation, third-generation mobile communication technology) network, or a 4G (4th-generation, fourth-generation mobile communication technology) network.
  • the effect of the ever-changing network environment on the smoothness of video playback is very significant.
  • the video frame dropping method provided by the embodiment of the present invention aims to improve video playback when performing video network on-demand in a network environment with good or bad changes. The fluency.
  • the video frame encoded by the video transmitting device can be a key frame or a non-key frame.
  • the key frame records a complete video picture. If a video frame is a key frame, the video playback device can obtain a complete video picture by decoding the video frame.
  • the non-key frame records a portion of the video that is different from the other frame. If a video frame is a non-key frame, the video playback device needs to decode the video frame based on the reference frame of the video to obtain a complete video picture.
  • a non-keyframe can reference a keyframe as a reference frame, or it can reference another non-keyframe as a reference frame. For a non-key frame, if its reference frame is lost, even if the video receiving device receives the video frame, a video screen or mosaic may appear when the frame is played.
  • the key frame is an IDR (Instantaneous Decoding Refresh) frame and the non-key frame is a forward predicted frame, that is, a P frame is taken as an example for description.
  • IDR Intelligent Decoding Refresh
  • the non-key frame is a forward predicted frame
  • P frame a forward predicted frame
  • a video frame dropping method provided by an embodiment of the present invention includes the following steps:
  • Step 101 Obtain a sequence of video frames of a video to be sent.
  • Step 102 Establish a reference relationship between video frames in a video frame sequence according to a preset criterion.
  • the reference relationship includes: the mth frame in the video frame sequence refers to the mth frame as a reference frame; and the nth frame in the video frame sequence At least two video frames in the video frame after the nth frame are referred to as reference frames; wherein m, h, and n are natural numbers, m is greater than 1 and m is greater than h, and the number of video frames in the video frame sequence is not less than n+2;
  • Step 103 In the process of sending the video frame sequence, detecting a data occupation length of the buffered video frame of the video transmission buffer;
  • Step 104 When the data occupation length is greater than the preset threshold, discard the video frame to be buffered, and discard all the video frames in the video frame sequence that reference the video frame to be buffered according to the reference relationship as the reference frame.
  • Steps 101-104 are further described as follows:
  • Step 101 Obtain a sequence of video frames of a video to be sent.
  • Video transmitting device will be sent The frequency is transmitted to the video receiving device through the network, and is played by the video receiving device.
  • the video to be transmitted includes a plurality of consecutive video frames, each of which corresponds to a frame of the video, and the video transmitting device transmits to the video receiving device, that is, a sequence of consecutive video frames.
  • the video frame sequence referred to in this embodiment does not refer to a sequence consisting of all video frames of the video to be transmitted, but a sequence including a certain number of video frames, wherein the first frame of the video frame sequence is an IDR frame.
  • a video frame other than the IDR in the video frame sequence is a P frame.
  • a sequence consisting of all video frames of a video to be transmitted is referred to as a sequence of original video frames
  • a sequence of original video frames may include a sequence of multiple video frames.
  • This embodiment describes the frame dropping method provided by the present invention for a video frame sequence. In the process of transmitting a to-be-sent video, the frame dropping method may be cyclically applied to a part or all of the video frame sequence included in the original video frame sequence.
  • the video sending device may acquire the original video frame sequence by means of imaging, and further acquire a video frame sequence of the video frame to be sent.
  • Step 102 Establish a reference relationship between each video frame in the video frame sequence according to a preset standard.
  • the video transmitting device needs to encode each video frame in the sequence of video frames, and establish a reference relationship between video frames in the sequence of video frames, and then send a sequence of video frames to the video receiving device.
  • the video transmitting apparatus can reduce the total amount of data of the video frame sequence by appropriately arranging the ratio of the DIR and the P frame.
  • the video receiving device can restore the complete according to the actually received video frame.
  • the video frame guarantees the integrity of each frame of the video during playback.
  • the reference relationship between video frames is established by direct reference to the video frame or indirectly to another video frame.
  • the reference relationship is represented by an arrowed curve in FIG. 2-1, and the video frame at the beginning of the curve is referenced to the video frame indicated by the arrow.
  • the figure includes a video frame X, a video frame Y, and a video frame Z, and the video frame X is located in the video frame Y and the video frame Z.
  • the video frame Y was located before the video frame Z, and there may be other video frames before, after or in the middle of the three video frames, which are not shown in the figure.
  • the video frame Z uses the video frame Y as a reference frame, that is, the video frame Z directly refers to the video frame Y.
  • the video frame Y uses the video frame X as a reference frame, that is, the video frame Y directly references the video frame X.
  • the reference frame of the video frame X that is, the video frame Y
  • the video frame directly or indirectly referring to the video frame is discarded, and the video receiving device can obtain a complete video picture according to the undiscarded video frame during video playback.
  • the specific frame loss mode can be changed by changing the reference relationship, including the number of frame loss occurrences in a certain network environment, and the frame loss occurs. The number of video frames discarded, etc.
  • the reference relationship established for the video frame in the video frame sequence includes: the mth frame in the video frame sequence refers to the mh frame as a reference frame, and if it is determined to discard the mh frame, Then, the mth frame is discarded together; at the same time, for the nth frame in the video frame sequence, at least two video frames in the video frame after the nth frame are referred to as reference frames, if the nth frame is determined to be discarded, The video frames that reference the nth frame as the reference frame are also discarded; wherein m, h, and n are natural numbers, m is greater than 1 and m is greater than h, and the number of video frames in the video frame sequence is not less than n+2.
  • the preset standard that is referred to in this embodiment may be a requirement for smoothness of video playback, that is, establishing a reference relationship according to a preset standard may be based on a requirement for smoothness of video playback, and establishing a video frame within a video frame sequence.
  • the reference relationship between the two wherein the higher the video playback fluency requirements, the more directly refer to the IDR frame as the reference frame of the video frame, and determine whether to directly drop the IDR frame as the reference frame video frame. For a video frame that directly references the IDR frame as a reference frame, if the frame loss is determined, it will not cause another video frame that directly references the IDR frame as the reference frame to be lost.
  • the preset criterion in this embodiment may also be the importance of each video frame in the video frame sequence, that is, the reference relationship may be established according to the preset standard according to the video frame sequence.
  • the importance of different video frames, the video frames in the video frame sequence are divided, and the reference relationship between the video frames in the video frame sequence is established according to the importance, wherein the video frames with relatively high importance are relatively less important.
  • the video frame is directly referenced as a reference frame, avoiding the situation where video frames of relatively high importance are discarded due to discarding video frames of relatively low importance.
  • the importance level between different video frames is determined according to the degree to which the user is interested in some video frames in the video, or the specific needs of the user.
  • the video to be sent is a surveillance video in a certain scene, such as a parking lot.
  • a surveillance video in a certain scene, such as a parking lot.
  • there are fewer vehicles or people in the monitoring area and most of the videos included are repeated and static pictures, and these video frames are less important.
  • the video frame corresponding to the ever-changing video picture is regarded as a video frame with higher importance. After a reference is established, the number of dropped frames is reduced as much as possible for video frames with higher importance. .
  • the preset criterion in the embodiment may be a reference transmission rate of the network, that is, establishing a reference relationship according to the preset criterion may be establishing a reference relationship between video frames in a video frame sequence according to a reference transmission rate of the network.
  • the higher the reference transmission rate of the network the better the network environment is, and the less likely it is to drop frames.
  • the number of video frames that directly reference the IDR frame as the reference frame can be more. In this way, for the video frame that directly references the IDR frame as the reference frame, it is determined whether the frame is dropped or not, and the occurrence of the frame loss is decentralized, thereby reducing the total number of dropped frames and improving the smoothness of the video playback.
  • Step 103 In the process of sending the video frame sequence, detecting the data occupation length of the buffered video frame of the video transmission buffer.
  • the send buffer is used to buffer several video frames that are about to be sent.
  • the data occupation length of the send buffer can reflect the changes of the network environment in real time. Under normal circumstances, when the network environment is good, the video frames buffered in the send buffer can be sent out very quickly, so the data buffer length of the send buffer is shorter. When the network environment is poor, the video frames buffered in the buffer are prone to stagnation, resulting in an increase in the data occupation length of the transmission buffer and even an overflow. Therefore, during the transmission of the video frame sequence, the data occupation length of the buffered video frame of the video transmission buffer is detected to determine whether the current video frame to be buffered is stored in the transmission buffer, or the video frame to be buffered is discarded.
  • Step 104 When the data occupation length is greater than a preset threshold, discard the current to be cached. A video frame, and discards all video frames in the sequence of video frames that reference the video frame currently to be buffered according to the reference relationship as a reference frame.
  • the data occupation length is greater than the preset threshold, indicating that the video frame buffered in the send buffer is stuck or even overflowed, so the current frame to be cached is discarded. At the same time, all video frames that reference the current frame to be buffered as a reference frame are discarded.
  • the video frame dropping method and the video transmitting apparatus establish a reference relationship between video frames in a video frame sequence according to a preset standard, and further determine whether to drop a frame.
  • the video frame to be buffered is discarded, and all video frames in the video frame sequence that reference the video frame to be buffered according to the reference relationship as a reference frame are discarded.
  • the frame is dropped until the IDR frame appears, which reduces the number of video frames discarded in one frame loss, avoids the situation of long-time picture stagnation, and improves the smoothness of the video broadcast.
  • an embodiment of the present invention provides another video frame drop frame method, where a reference relationship between video frames in a video frame sequence and a specific frame loss mode when a reference relationship is determined are performed. Refine the description. Specific steps are as follows:
  • Step 201 Obtain a sequence of video frames of a video to be sent.
  • the video frame sequence is a sequence of a number of video frames
  • the video frame sequence may be a segment of the original video frame sequence
  • the original video frame sequence may comprise a plurality of video frame sequences.
  • This embodiment describes the frame dropping method provided by the present invention for a video frame sequence.
  • the frame dropping method may be cyclically applied to a part or all of the video frame sequence included in the original video frame sequence.
  • Step 202 Establish a reference relationship between each video frame in the video frame sequence according to a preset standard.
  • the reference relationship includes: the mth frame in the sequence of video frames refers to the mh frame as a reference frame, that is, a video in a sequence of video frames, and a video frame before the video frame in the sequence of reference video frames is a reference frame; a sequence of video frames
  • the nth frame in the frame is referenced by the at least two video frames in the video frame after the nth frame as a reference frame, that is, one video frame in the video frame sequence, which can be simultaneously used by the video frame after the video frame in the video frame sequence.
  • At least two video frames are referenced as reference frames; wherein m, h, and n are all natural numbers, m is greater than 1 and m is greater than h, and the number of video frames in the video frame sequence is not less than n+2;
  • establishing a reference relationship according to a preset criterion may be based on a requirement for smoothness of video playback, establishing importance according to the importance of different video frames in a sequence of video frames, or according to a reference transmission rate of the network.
  • the reference relationship between video frames within a sequence may be based on a requirement for smoothness of video playback, establishing importance according to the importance of different video frames in a sequence of video frames, or according to a reference transmission rate of the network.
  • a video frame other than the IDR frame in the video frame sequence is divided into a basic frame and an extended frame, and the video frame sequence is divided into IDR frames.
  • the video frames other than the video frame are divided into K frame groups.
  • the IDR frame is the first frame of the video frame sequence
  • each of the K frame groups is a segment of a video sequence consisting of consecutive video frames
  • the base frame is a video directly referring to the IDR frame as a reference frame.
  • a frame, an extended frame is a video frame indirectly referring to an IDR frame; each of the K frame groups includes a base frame, and each of the frame groups except the base frame is an extended frame.
  • K is an integer greater than or equal to 1.
  • the number of video frames included in different frame groups may be the same or different.
  • the present invention does not limit the specific number of video frames included in different frame groups.
  • FIG. 2-2 is a schematic diagram showing an example of a reference relationship between video frames in a frame group when the video frame sequence is composed of three frame groups: frame group A, frame group B, and frame group C.
  • the basic frame a, the basic frame b, and the basic frame c all directly refer to the IDR frame, and may all correspond to the case where the m-th frame in the video frame sequence refers to the m-th frame as the reference frame.
  • the IDR frame is referenced by the three video frames of the basic frame a, the basic frame b, and the basic frame c as a reference frame, and may correspond to the nth frame in the video frame sequence, and at least two of the video frames after the nth frame.
  • a video frame is referred to as a reference frame.
  • a reference frame a case where a video frame is referenced by a plurality of video frames is referred to as a reference frame, and a video frame is referred to as a reference frame by at least two video frames thereafter, in the following description. No longer specify one by one.
  • the frame group is composed of at least one video frame, and the kth frame group includes a base frame, where k is an integer greater than or equal to 0 and less than or equal to K, that is, kth
  • the frame group may be any one of the K frame groups.
  • one video frame included in the kth frame group is the base frame.
  • the frame group A in Fig. 2-2 is a case where only one base frame, that is, the base frame a is included.
  • a reference between video frames in a sequence of video frames is established according to requirements for smoothness of video playback, or according to a reference transmission rate of the network.
  • the requirement for smoothness of video playback is higher or the reference transmission rate of the network is higher, the number of video frames directly referring to the IDR frame as the reference frame is larger.
  • each video frame following the IDR frame refers to the IDR frame as a reference frame. That is, each frame group in the K frame group includes only the base frame.
  • the kth frame group is composed of at least two video frames
  • the kth frame group is composed of a base frame and an extended frame sequence.
  • the base frame is the first frame of the kth frame group
  • the extended frame sequence is a sequence consisting of S video frames other than the base frame in the kth frame group.
  • the frame group B in FIG. 2-2 is composed of a basic frame b and an extended frame sequence, wherein the extended frame sequence is composed of 3 extended frames, and each video frame in the extended frame sequence directly refers to the basic frame b, and the basic frame b Directly referring to the IDR frame, each video frame in the extended frame sequence indirectly references the IDR frame.
  • the sth video frame of the S video frames with any video frame before the sth video frame in the kth frame group as a reference frame, where S is an integer greater than or equal to 1, and s is greater than or equal to 1 An integer less than or equal to S.
  • Step 203 In the process of sending the video frame sequence, detecting a data occupation length of the buffered video frame of the video transmission buffer.
  • the send buffer is used to buffer several video frames that are about to be sent.
  • the data occupation length of the send buffer can reflect the change of the network environment in real time. Therefore, during the process of sending the video frame sequence, the data occupation length of the cached video frame of the video transmission buffer is detected to determine the video frame to be currently cached. Store in the send buffer or discard the video frame currently being cached.
  • Step 204 When the data occupation length is greater than the preset threshold, discard the video frame to be buffered, and discard all the video frames in the video frame sequence that reference the video frame to be buffered according to the reference relationship as the reference frame.
  • Different reference relationships correspond to different frame loss modes.
  • the reference relationship is determined, for different video frames, when the frame loss is determined, the number of discarded video frames is different.
  • different video frames may respectively correspond to preset thresholds of one sending buffer.
  • each video frame in the sequence of video frames corresponds to a preset threshold of a transmit buffer.
  • Two videos The preset thresholds corresponding to the respective frames may be the same or different.
  • the preset thresholds corresponding to different video frames in the following description are respectively represented by a description of the first preset threshold and the second preset threshold.
  • the IDR frame when the IDR frame is the current video frame to be buffered, if the data occupation length of the transmission buffer is greater than a preset threshold, all the base frames in the video frame sequence are discarded. Further, for an extended frame that refers to a reference frame as a reference frame, since the IDR frame is indirectly referenced, it is discarded at the same time, and if the IDR frame is discarded, the entire video frame sequence is also discarded.
  • the preset threshold corresponding to the IDR frame is a first preset threshold. Further, if the data occupation length of the sending buffer is not greater than a preset threshold, the current video frame to be buffered is stored in the sending buffer. That is, if the data occupation length of the transmission buffer is not greater than the first preset threshold, it is not necessary to discard the IDR frame and store the IDR frame in the transmission buffer.
  • the IDR frame is the video frame to be buffered
  • the entire video frame sequence needs to be discarded. This situation should be avoided as much as possible to avoid affecting the smoothness of video playback.
  • the first preset threshold should be as large as possible.
  • the IDR frame is reserved as long as the unoccupied portion of the transmission buffer can accommodate the IDR frame. Avoid the loss of the entire video frame sequence to ensure the smoothness of video playback.
  • the sth video frame of the S video frames is referenced by any video frame that is located before the sth video frame in the kth frame group, that is, the sth video frame can reference the kth
  • the base frame of the frame group is a reference frame, and any video frame located before the sth video frame in the S video frames may be referred to as a reference frame.
  • each video frame in the kth frame group uses the adjacent previous video frame as a reference frame.
  • the first video frame in the S video frames with the base frame as the reference frame, the s+2 video frames in the S video frames, and the s+1th video frame as the reference frame, the s+1
  • the video frames are referenced by the sth video frame, where s is an integer greater than or equal to 1, that is, the sth video frame may be any one of the S video frames, and the other s+2 is less than or equal to S.
  • the preset threshold value is a second preset threshold.
  • Whether or not to drop frames may be further determined for the S video frames included in the extended frame sequence.
  • the preset threshold corresponding to the sth video frame is a third preset threshold.
  • the S video frames may directly reference the base frame of the kth frame group as a reference frame.
  • the frame group B in FIG. 2-2 is a case where each video frame in the extended frame sequence uses the base frame b as a reference frame.
  • the sth video frame is used as the video frame to be buffered to determine whether to drop frames.
  • the s+1th video frame may be further used as the current video frame to be buffered to determine whether to drop the frame, where s+1 is less than or equal to S.
  • the sth video frame and the at least one video frame in the video frame after the sth video frame are reference frames of the Sth video frames in the S video frames, where n is greater than or equal to A positive integer less than 0 and less than s. 2-2, in the extended frame sequence of the frame group C, there are two video frames citing the same video frame as the reference frame, and the video frame ⁇ and the video frame ⁇ in FIG. 2-2 directly refer to the video frame ⁇ as a reference. frame. Further, any video frame after the video frame ⁇ in the frame group C can also be directly referenced or indirectly referenced by several video frames in the subsequent video frames, which are not marked in the figure. Through this reference relationship, the number of video frames included in the extended frame sequence can be adjusted, and the number of video frames having a reference relationship with a certain video frame can be adjusted, thereby achieving video frames discarded for one frame loss. The purpose of the quantity adjustment.
  • the case where the s-th video frame and the s+nth video frame refer to the s-nth video frame as the reference frame is taken as an example, where s+n is less than or equal to S.
  • the video frames between the sn video frame and the sth video frame are reference frames adjacent to the previous video frame, and the s+n video in the S video frames. All video frames after the frame are reference frames adjacent to the previous video frame.
  • the video frame between the video frame ⁇ and the video frame ⁇ , and all the video frames after the video frame ⁇ are adjacent to each other.
  • a video frame is a reference frame.
  • the sn-th video frame, and the video frame between the sn-th video frame and the s-th video frame are discarded, and the s-th in the S video frames
  • the video frame and the video frame after the sth video frame are discarded together.
  • video frames located after the sth video frame in the S video frames may be directly referenced or indirectly applied to the sth video frame, and details are not described herein.
  • the change of the reference relationship causes the number of video frames that have a reference relationship with the video frame to be buffered to change accordingly.
  • the number of discarded video frames in one frame loss also changes accordingly.
  • the number of times of frame loss occurrence can be adjusted by adjusting the first threshold, the second threshold, and the third threshold.
  • the first threshold when determining whether to drop a frame for an IDR frame, the first threshold needs to be as large as possible.
  • the second threshold may be smaller than the first threshold. The smaller the second threshold, the more likely the frame loss occurs.
  • the third threshold may be smaller than the second threshold, and the smaller the third threshold, the more likely the frame loss occurs.
  • the video sending device can reduce the video transmission frame rate by dropping the frame. After the frame loss ends, if the network environment satisfies the requirement of retaining subsequent video frames, the frame is no longer dropped, and the video transmission frame rate is It then rises. That is, the video sending device can reduce or increase the video sending frame rate in time according to the change of the network environment, thereby improving the smoothness of the video playing and improving the user experience.
  • the video frame dropping method and the video transmitting apparatus establish a reference relationship between video frames in a video frame sequence according to a preset standard, and further determine whether to drop a frame.
  • the video frame to be buffered is discarded, and the current frame to be cached according to the reference relationship is discarded in the video frame sequence.
  • the video frame is all video frames of the reference frame without dropping frames until the IDR frame appears, which reduces the number of discarded video frames in one drop frame, and avoids the occurrence of long-time picture jamming.
  • the video transmitting device can reduce or increase the video sending frame rate according to the change of the network environment, thereby improving the smoothness of the video broadcasting and improving the video transmission. user experience.
  • an embodiment of the present invention provides a video sending apparatus 30 for performing the data frame dropping method provided by the present invention.
  • the video transmitting apparatus 30 includes an obtaining unit 301, an encoding unit 302, a detecting unit 303, and a frame dropping unit 304.
  • An obtaining unit 301 configured to acquire a sequence of video frames of a video to be sent
  • the encoding unit 302 is configured to establish, according to a preset criterion, a reference relationship between video frames in the video frame sequence acquired by the acquiring unit 301.
  • the reference relationship includes: the mth frame in the video frame sequence refers to the mth frame as a reference frame;
  • the nth frame in the video frame sequence is referred to as a reference frame by at least two video frames in the video frame after the nth frame; wherein m, h, and n are natural numbers, m is greater than 1 and m is greater than h, and the video frame
  • the number of video frames in the sequence is not less than n+2;
  • the detecting unit 303 is configured to detect a data occupation length of the buffered video frame of the video sending buffer during the sending of the video frame sequence;
  • the frame dropping unit 304 is configured to discard the video frame to be buffered when the detected data occupation length is greater than the preset threshold, and discard the video frame to be cached according to the reference relationship in the video frame sequence. All video frames of the frame.
  • the preset standard is a requirement for smoothness of video playback
  • the coding unit 302 the reference relationship between the video frames in the established video frame sequence includes: the higher the requirement of the video playback fluency, the more the video frames directly referencing the IDR frame as the reference frame.
  • the preset criterion is the importance of each video frame in the sequence of video frames
  • the coding unit 302 establishes a reference relationship between video frames in the sequence of video frames that the video frame with relatively high importance is directly referred to as a reference frame by a video frame with relatively low importance.
  • the preset criterion is a reference transmission rate of the network
  • the encoding unit 302 the reference relationship package between each video frame in the established video frame sequence Including: the higher the reference transmission rate of the network, the more direct reference to the instant decoding to refresh the IDR frame as the reference frame.
  • the reference relationship between the video frames in the video frame sequence specifically includes:
  • each video frame following the IDR frame refers to the IDR frame as a reference frame.
  • each video frame in the sequence of video frames corresponds to a preset threshold of a transmit buffer.
  • the frame dropping unit 304 is further configured to: when the detecting unit 303 detects that the data occupation length of the sending buffer is not greater than a preset threshold, storing the current video frame to be buffered into the sending buffer.
  • the video frame frame dropping method and the video transmitting apparatus establish a reference relationship between video frames in the video frame sequence according to a preset standard, and further determine whether to drop a frame.
  • the video frame to be buffered is discarded, and all video frames in the video frame sequence that reference the video frame to be buffered according to the reference relationship as a reference frame are discarded.
  • an embodiment of the present invention provides a video transmitting apparatus 40.
  • the apparatus may be embedded or itself a microprocessor computer, such as a general-purpose computer, a customized computer, or a mobile terminal.
  • the video transmitting device 40 includes: at least one processor 401, a memory 402, and a bus 403, and the at least one processor 401 and the memory 402 are connected by a bus 403 and complete communication with each other.
  • the bus 403 may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component) bus, or an EISA (Extended Industry Standard Architecture) bus.
  • the bus 403 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 4, but it does not mean that there is only one bus or one type of bus. among them:
  • the memory 402 is used to execute the application code of the solution of the present invention, and the method of the present invention is executed.
  • the application code of the case is stored in the memory and is controlled by the processor 401 for execution.
  • the memory can be a read only memory ROM or other type of static storage device that can store static information and instructions, a random access memory RAM or other type of dynamic storage device that can store information and instructions, or can be electrically erasable or programmable.
  • These memories are connected to the processor via a bus.
  • the processor 401 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more configured to implement the embodiments of the present invention. Integrated circuits.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • the processor 401 is configured to: call the program code in the memory 402, to perform the operations of the acquiring unit, the encoding unit detecting unit, and the frame dropping unit in the device embodiment corresponding to FIG. 3, including: acquiring a video frame sequence of the video to be sent Establishing a reference relationship between the video frames in the video frame sequence according to a preset criterion; the reference relationship includes: the mth frame in the video frame sequence refers to the mh frame as a reference frame; the video frame The nth frame in the sequence is referred to as a reference frame by at least two video frames in the video frame after the nth frame; wherein m, h, and n are all natural numbers, m is greater than 1 and m is greater than h, The number of video frames in the video frame sequence is not less than n+2; in the process of transmitting the video frame sequence, detecting the data occupation length of the buffered video frame of the video transmission buffer; when the data occupation length is greater than a preset threshold Discarding
  • the video frame frame dropping method and the video transmitting apparatus establish a reference relationship between video frames in the video frame sequence according to a preset standard, and further determine whether to drop a frame.
  • the video frame to be buffered is all video frames of the reference frame, and there is no need to drop frames until the IDR frame appears, which reduces the number of discarded video frames in one frame loss, avoiding the occurrence of long-time picture jamming and improving
  • the video is smooth.
  • the video transmitting apparatus in the present invention can be implemented by hardware, firmware implementation, or a combination thereof.
  • the functions described above may be stored in or transmitted as one or more instructions or code on a computer readable medium.
  • Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another.
  • a storage medium may be any available media that can be accessed by a computer.
  • the computer readable medium may include a RAM (Random Access Memory), a ROM (Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory).
  • CD-ROM Compact Disc Read Only Memory
  • CD-ROM Compact Disc Read Only Memory
  • disk storage media or other magnetic storage device, or can be used to carry or store a desired program in the form of an instruction or data structure. Code and any other medium that can be accessed by a computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

一种视频帧丢帧方法及视频发送装置，能够减少丢帧数量，从而提高视频播放的流畅度，改善用户体验。具体方案包括：获取待发送视频的视频帧序列；根据预设标准，建立所述视频帧序列中各视频帧之间的参考关系；在所述视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；当所述数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在所述视频帧序列中根据所述参考关系引用所述当前待缓存的视频帧为参考帧的所有视频帧。用于对视频帧进行丢帧处理。

Description

一种视频帧丢帧方法及视频发送装置 技术领域
本发明涉及通信领域，尤其涉及一种视频帧丢帧方法及视频发送装置。
背景技术
随着移动互联网的普及，IPC(IP Camera，网络摄像机)视频在手机等移动终装置上被点播的机率也越来越大。然而，受无线网络的稳定性和带宽不足的影响，容易出现视频画面不清晰，甚至出现视频画面卡住的情况，视频的播放不流畅。因此如何在网络不稳定、带宽有限的无线网络上进行视频的流畅播放，是一个迫切需要解决的问题。
现有技术中，对待发送视频进行编码，生成满帧率码流，当网络环境好时，发送满帧率码流，当网络环境差时，通过丢帧的方式快速降低视频发送帧率，以适应实际的网络环境。具体的，当网络环境差造成缓冲区溢出时，将缓冲区的最后一帧和下一个IDR帧之间的整段视频帧全部丢掉。当下一个IDR帧出现时，进行缓冲区溢出判断，若缓冲区有空闲，则保留该IDR帧并发送后续帧，若缓冲区仍然为溢出状态，则丢弃该IDR帧直到再下一个IDR帧。这种丢帧方式是将一段连续的视频帧集中丢弃，由于在一次丢帧中所丢弃视频帧的数量大，导致画面长时间卡顿的情形，尤其在丢掉IDR帧后，画面卡顿更加严重，导致用户体验差。
发明内容
本发明的实施例提供一种视频帧丢帧方法及视频发送装置，能够减少丢帧数量，从而提高视频播放的流畅度，改善用户体验。
为达到上述目的，本发明的实施例采用如下技术方案：
第一方面，一种视频帧丢帧方法，包括：
获取待发送视频的视频帧序列；
根据预设标准，建立所述视频帧序列中各视频帧之间的参考关系；所述参考关系包括:所述视频帧序列中的第m帧引用第m-h帧为参考帧；所述视频帧序列中的第n帧,被所述第n帧后的视频帧中的 至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，所述视频帧序列中视频帧的数量不小于n+2；
在所述视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；
当所述数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在所述视频帧序列中根据所述参考关系引用所述当前待缓存的视频帧为参考帧的所有视频帧。
结合第一方面，在第一种可能的实现方式中，所述预设标准为对视频播放流畅度的要求；
其中，所述参考关系中,所述视频播放流畅度的要求越高,直接引用即时解码刷新IDR帧为参考帧的视频帧越多；所述IDR帧为所述视频帧序列的首帧。
结合第一方面，在第二种可能的实现方式中，所述预设标准为所述视频帧序列内每个视频帧的重要性；
其中，所述参考关系中,重要性相对较高的视频帧被重要性相对较低的视频帧直接引用为参考帧。
结合第一方面，在第三种可能的实现方式中，所述预设标准为网络的基准发送速率；
其中，所述网络的基准发送速率越高，所述参考关系中,直接引用即时解码刷新IDR帧为参考帧的视频帧越多；所述IDR帧为所述视频帧序列的首帧。
结合第一方面至第一方面的第三种可能的实现方式中的任一种，在第四种可能的实现方式中，所述视频帧序列中各视频帧之间的参考关系具体包括：
当所述视频帧序列的首帧为即时解码刷新IDR帧时，所述IDR帧之后的每一个视频帧均引用所述IDR帧为参考帧。
结合第一方面至第一方面的第四种可能的实现方式中的任一种，在第五种可能的实现方式中，所述视频帧序列中每一个视频帧都对应有一个发送缓冲区的预设阈值。
结合第一方面至第一方面的第五种可能的实现方式中的任一种， 在第六种可能的实现方式中，所述方法还包括：
当所述数据占用长度不大于预设阈值时，将所述当前待缓存的视频帧存入所述发送缓冲区。
第二方面，一种视频发送装置，包括：
获取单元，用于获取待发送视频的视频帧序列；
编码单元，用于根据预设标准，建立所述获取单元获取的所述视频帧序列中各视频帧之间的参考关系；所述参考关系包括:所述视频帧序列中的第m帧引用第m-h帧为参考帧；所述视频帧序列中的第n帧,被所述第n帧后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，所述视频帧序列中视频帧的数量不小于n+2；
检测单元，用于在所述视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；
丢帧单元，用于当所述检测单元检测到所述数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在所述视频帧序列中根据所述参考关系引用所述当前待缓存的视频帧为参考帧的所有视频帧。
结合第二方面，在第一种可能的实现方式中，所述预设标准为对视频播放流畅度的要求；
所述编码单元建立的所述视频帧序列中各视频帧之间的参考关系包括：所述视频播放流畅度的要求越高,直接引用即时解码刷新IDR帧为参考帧的视频帧越多；所述IDR帧为所述视频帧序列的首帧。
结合第二方面，在第二种可能的实现方式中，所述预设标准为所述视频帧序列内每个视频帧的重要性；
所述编码单元建立的所述视频帧序列中各视频帧之间的参考关系包括：重要性相对较高的视频帧被重要性相对较低的视频帧直接引用为参考帧。
结合第二方面，在第三种可能的实现方式中，所述预设标准为网络的基准发送速率；
所述编码单元建立的所述视频帧序列中各视频帧之间的参考关 系包括：所述网络的基准发送速率越高，直接引用即时解码刷新IDR帧为参考帧的视频帧越多。
结合第二方面至第二方面的第三种可能的实现方式中的任一种，在第四种可能的实现方式中，所述视频帧序列中各视频帧之间的参考关系具体包括：
当所述视频帧序列的首帧为即时解码刷新IDR帧时，所述IDR帧之后的每一个视频帧均引用所述IDR帧为参考帧。
结合第二方面至第二方面的第四种可能的实现方式中的任一种，在第五种可能的实现方式中，所述视频帧序列中每一个视频帧都对应有一个发送缓冲区的预设阈值。
结合第二方面至第二方面的第五种可能的实现方式中的任一种，在第六种可能的实现方式中，所述丢帧单元，还用于当所述检测单元检测到所述数据占用长度不大于预设阈值时，将所述当前待缓存的视频帧存入所述发送缓冲区。
本发明的实施例所提供的视频帧丢帧方法及视频发送装置，根据预设标准建立所述视频帧序列中各视频帧之间的参考关系，并进一步确定是否丢帧。在所述视频帧序列发送的过程中，在确定丢帧时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧。视频帧序列中的第n帧,被第n帧后的视频帧中的至少两个视频帧引用为参考帧，针对第n帧为参考帧的一个视频帧，当确定丢弃该视频帧时，其它以第n帧为参考帧的视频帧仍旧可以保留，而无需丢帧直到出现IDR帧为止，从而减小了在一次丢帧中所丢弃视频帧的数量，避免出现长时间画面卡顿的情况。同时，在一次丢帧结束之后，如果网络环境好转，对于保留的视频帧则可以以较高的帧率发送，实现了按照网络环境的变化降低或者升高视频发送帧率的目的，从而减小了丢弃视频帧的数量，提高了视频播放的流畅度。
附图说明
为了更清楚地说明本发明的实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显 而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明的实施例所提供的一种视频帧丢帧方法的流程示意图；
图2-1为本发明的实施例所提供的一种视频帧之间参考关系的示意图；
图2-2为本发明的实施例所提供的一种视频帧序列内视频帧之间参考关系的示意图；
图3为本发明的实施例所提供的一种视频发送装置的结构示意图；
图4为本发明的实施例所提供的另一种视频发送装置的结构示意图。
具体实施方式
下面将结合本发明的实施例中的附图，对本发明的实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本发明的实施例提供一种视频帧丢帧方法，可以应用于进行实时视频的网络传输的应用场景中，例如视频会议，IPC视频点播等。本发明的实施例以IPC视频点播的应用场景为例进行说明。概括地讲，IPC视频点播系统包括视频发送装置和视频接收装置。其中，视频发送装置通过摄像获取视频帧序列，并对视频帧序列进行编码后通过网络向视频接收装置发送。发送方式包括宽带网络、3G(3rd-generation，第三代移动通信技术)网络或者4G(4th-generation，第四代移动通信技术)网络等。不断变化的网络环境对视频播放流畅度的影响十分显著，本发明的实施例所提供的视频帧丢帧方法，其目的即在于在好坏变化的网络环境下进行视频网络点播时，提高视频播放的流畅度。
经过视频发送装置编码所得的视频帧可以是关键帧或者非关键 帧。关键帧记录了一帧完整的视频画面，如果一个视频帧为关键帧，视频播放装置通过解码该视频帧可以得到完整的视频画面。非关键帧记录了一帧视频与另一帧视频所不同的部分，如果一个视频帧为非关键帧，视频播放装置需要基于该视频的参考帧对该视频帧进行解码，得到完整的视频画面。一个非关键帧可以引用关键帧为参考帧，也可以引用另一个非关键帧为参考帧。对于一个非关键帧，如果其参考帧丢失，视频接收装置即使接收到该视频帧，在播放该帧时也可能出现花屏或者马赛克。
本实施例中以关键帧为IDR(Instantaneous Decoding Refresh，即时解码刷新)帧、非关键帧为前向预测帧，即P帧的情况为例进行说明。当然，这并不意味着本发明所提供的丢帧方法只能适用于这种情况，本领域的技术人员可以理解的是，关键帧和非关键帧均可以有不仅一种具体的实现方式。
参照图1，本发明的实施例所提供的视频帧丢帧方法，包括以下步骤：
步骤101、获取待发送视频的视频帧序列；
步骤102、根据预设标准，建立视频帧序列中各视频帧之间的参考关系；参考关系包括:视频帧序列中的第m帧引用第m-h帧为参考帧；视频帧序列中的第n帧,被第n帧后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，视频帧序列中视频帧的数量不小于n+2；
步骤103、在视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；
步骤104、当数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧。
对步骤101-步骤104进一步说明如下：
步骤101、获取待发送视频的视频帧序列。
在IPC视频点播的应用场景中，当视频接收装置通过网络点播某一视频时，被点播的视频即为待发送视频。视频发送装置将待发送视 频通过网络发送至视频接收装置，由视频接收装置进行播放。
待发送视频包括连续的若干视频帧，每个视频帧对应该视频的一帧画面，视频发送装置向视频接收装置所发送的，即为一个个连续的视频帧所组成的序列。
本实施例中所指的视频帧序列，并不是指由待发送视频的全部视频帧所组成的序列，而是包括一定数量视频帧的一段序列,其中，视频帧序列的首帧为IDR帧，视频帧序列中除IDR之外的视频帧为P帧。
为便于描述，将待发送视频的全部视频帧所组成的序列称为原始视频帧序列，原始视频帧序列可以包括多个视频帧序列。本实施例就针对视频帧序列对本发明所提供的丢帧方法进行说明，在待发送视频的发送过程中，该丢帧方法可以循环应用于原始视频帧序列所包括的部分或者全部视频帧序列。
具体的，视频发送装置可以通过摄像的方式获取原始视频帧序列，并进一步获取待发送视频帧的视频帧序列。
步骤102、根据预设标准，建立视频帧序列中各视频帧之间的参考关系。
视频发送装置需要对视频帧序列中的每个视频帧进行编码，并建立视频帧序列中各视频帧之间的参考关系，然后向视频接收装置发送视频帧序列。
通常，相对于P帧，DIR帧数据量更大，因此发送关键帧也需占用更多网络资源。因此，视频发送装置在编码过程中，通过合理安排DIR和P帧的比例可以降低视频帧序列总体的数据量。同时，通过建立视频帧序列中各视频帧之间的参考关系，并根据参考关系进行丢帧，以使得在发生丢帧的情况下，视频接收装置能够根据实际接收到的视频帧，还原得到完整的视频帧，保证视频播放时每一帧画面的完整性。
视频帧之间的参考关系通过视频帧直接引用或者间接引用另一视频帧建立。结合图2-1，图2-1中用带箭头的曲线表示参考关系，曲线起点的视频帧以箭头所指的视频帧为参考帧。图中包括视频帧X、视频帧Y以及视频帧Z，视频帧X位于视频帧Y以及视频帧Z 之前，视频帧Y位于视频帧Z之前，这三个视频帧之前、之后或者中间可以有其它视频帧，图中未标出。
视频帧Z以视频帧Y为参考帧，即视频帧Z直接引用视频帧Y；同理，视频帧Y以视频帧X为参考帧，即视频帧Y直接引用视频帧X。同时，视频帧X虽然不是视频帧Z的参考帧，然而视频帧X的参考帧，即视频帧Y，以视频帧X为参考帧，如果视频帧X被丢弃，则导致视频帧Z的参考帧被丢弃，使得视频接收设备不能根据视频Z得到完整的一帧视频画面，即认为视频帧Z间接引用视频帧X。
针对一个视频帧，在确定丢帧时，将直接或者间接引用该视频帧的视频帧一并丢弃，视频接收装置在进行视频播放时，就能够根据未被丢弃的视频帧得到完整的视频画面。
由于视频帧之间的参考关系直接影响到具体的丢帧方式，使得通过对参考关系的改变，可以改变具体的丢帧方式，包括在一定网络环境下发生丢帧的次数，以及在发生丢帧时所丢弃视频帧的数量等。
本发明所提供的视频帧丢帧方法中，为视频帧序列中的视频帧建立的参考关系包括:视频帧序列中的第m帧引用第m-h帧为参考帧,那么如果确定丢弃第m-h帧，则将第m帧一并丢弃；同时，对于视频帧序列中的第n帧,被第n帧后的视频帧中的至少两个视频帧引用为参考帧，那么如果确定丢弃第n帧，则将引用第n帧为参考帧的视频帧也一并丢弃；其中，m、h、n均为自然数，m大于1且m大于h，视频帧序列中视频帧的数量不小于n+2。
可选的，本实施例所指的预设标准可以是对视频播放流畅度的要求，即根据预设标准建立参考关系可以是根据对视频播放流畅度的要求，建立视频帧序列内视频帧之间的参考关系，其中,对视频播放流畅度的要求越高,直接引用IDR帧为参考帧的视频帧越多，并针对直接引用IDR帧为参考帧的视频帧分别确定是否丢帧。对于一个直接引用IDR帧为参考帧的视频帧，如果确定丢帧，不会导致另一个直接引用IDR帧为参考帧的视频帧也被丢失。
可选的，本实施例所指的预设标准还可以是视频帧序列内每个视频帧的重要性，即根据预设标准建立参考关系可以是按照视频帧序列 内不同视频帧的重要性，对视频帧序列内视频帧进行划分，根据重要性不同建立视频帧序列内视频帧之间的参考关系，其中重要性相对较高的视频帧被重要性相对较低的视频帧直接引用为参考帧，避免发生因为丢弃重要性相对较低的视频帧而导致丢弃重要性相对较高的视频帧的情况。具体的，按照用户对视频中某些视频帧感兴趣的程度，或者用户的具体需求，确定不同视频帧之间的重要性等级。例如待发送视频是某个场景下的监控视频，比如停车场。在不同时段，监控区域内出入车辆或者人员较少，一段视频内包括的多是重复、静态的画面，则这些视频帧重要性较低。同时，将不断变化的视频画面所对应的视频帧，作为重要性较高的视频帧。按照重要性划分建立参考关系后，在发生丢帧时，对于重要性较高的视频帧尽量不丢帧或者少丢帧，对于重要性较低的视频帧则可以相对增加丢帧的次数和数量。
或者，本实施例所指的预设标准还可以是网络的基准发送速率，即根据预设标准建立参考关系可以是根据网络的基准发送速率，建立视频帧序列内视频帧之间的参考关系。网络的基准发送速率越高，说明网络环境越好，越不容易发生丢帧，则建立的参考关系中,直接引用IDR帧为参考帧的视频帧可以越多。这样，针对直接引用IDR帧为参考帧的视频帧，分别确定是否丢帧，将丢帧发生的情况分散化，从而减少了丢帧总量，提高视频播放流畅度。
步骤103、在视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度。
发送缓冲区用于缓存即将发送的若干视频帧。发送缓冲区的数据占用长度可以实时反应网络环境的好坏变化。通常状况下，网络环境较好时，在发送缓冲区中缓存的视频帧可以很快被发出，因此发送缓冲区的数据占用长度的较短。而当网络环境差时，缓冲区中缓存的视频帧很容易出现滞留，导致发送缓冲区的数据占用长度增加，甚至出现溢出。因此在视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度，以确定将当前待缓存的视频帧存入发送缓冲区，或者丢弃当前待缓存的视频帧。
步骤104、当数据占用长度大于预设阈值时，丢弃当前待缓存的 视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧。
数据占用长度大于预设阈值，说明发送缓冲区中缓存的视频帧出现了滞留甚至溢出，因此丢弃当前待缓存帧。同时，将引用当前待缓存帧为参考帧的所有视频帧一并丢弃。
本发明的实施例所提供的视频帧丢帧方法及视频发送装置，根据预设标准建立视频帧序列中各视频帧之间的参考关系，并进一步确定是否丢帧。在视频帧序列发送的过程中，在确定丢帧时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧，而无需丢帧直到出现IDR帧为止，减小了在一次丢帧中所丢弃视频帧的数量，避免出现长时间画面卡顿的情况，提高了视频播的流畅度。
基于图1所对应的实施例，本发明的实施例提供另一种视频帧丢帧方法，对视频帧序列中各视频帧之间的参考关系，以及在参考关系确定时的具体丢帧方式进行细化说明。具体步骤如下：
步骤201、获取待发送视频的视频帧序列。
视频帧序列是包括一定数量视频帧的一段序列，视频帧序列可以是原始视频帧序列中的一段，原始视频帧序列可以包括多个视频帧序列。本实施例就针对视频帧序列对本发明所提供的丢帧方法进行说明，在待发送视频的发送过程中，该丢帧方法可以循环应用于原始视频帧序列所包括的部分或者全部视频帧序列。
步骤202、根据预设标准，建立视频帧序列中各视频帧之间的参考关系。
参考关系包括:视频帧序列中的第m帧引用第m-h帧为参考帧,即视频帧序列中的一个视频，引用视频帧序列中该视频帧之前的某一视频帧为参考帧；视频帧序列中的第n帧,被第n帧后的视频帧中的至少两个视频帧引用为参考帧，即视频帧序列中的一个视频帧，可以同时被视频帧序列中该视频帧之后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，视频帧序列中视频帧的数量不小于n+2；
结合图1所对应的实施例，根据预设标准建立参考关系可以是根据对视频播放流畅度的要求、根据视频帧序列内不同视频帧的重要性或者根据网络的基准发送速率等，建立视频帧序列内视频帧之间的参考关系。
为了便于清楚描述本发明实施例的技术方案，在本发明的实施例中，将视频帧序列中除IDR帧之外的视频帧分为基础帧和扩展帧,并将视频帧序列中除IDR帧之外的视频帧划分为K个帧组。其中，IDR帧为视频帧序列的首帧，K个帧组中的每一个帧组，为视频序列中由连续的若干视频帧所组成的一段，基础帧为直接引用IDR帧为参考帧的视频帧，扩展帧为间接引用IDR帧的视频帧；K个帧组中，每个帧组均包括一个基础帧，每个帧组除基础帧之外的视频帧均为扩展帧。K为大于等于1的整数。
不同帧组所包括视频帧的数量可以相同，也可以不同。本发明对不同帧组所包括视频帧的具体数量不做限定。
结合图2-2，图2-2为视频帧序列由帧组A、帧组B以及帧组C三个帧组所组成时，帧组内各个视频帧之间参考关系的举例示意图。其中，基础帧a、基础帧b和基础帧c均直接引用IDR帧，均可对应视频帧序列中的第m帧引用第m-h帧为参考帧的情形。同时，IDR帧被基础帧a、基础帧b和基础帧c这3个视频帧引用为参考帧，可对应视频帧序列中的第n帧,被第n帧后的视频帧中的至少两个视频帧引用为参考帧的情形。图2-2所示的参考关系中，包括多处一个视频帧引用其之前某一视频帧为参考帧，以及一个视频帧被其之后至少两个视频帧引用为参考帧的情形，后续说明中不再一一指明。
针对K个帧组中的第k个帧组，该帧组由至少一个视频帧组成，第k个帧组包括一个基础帧，其中，k为大于等于0且小于等于K的整数，即第k个帧组可以是K个帧组中的任一帧组。
当第k个帧组仅由一个视频帧组成时，第k个帧组所包括的一个视频帧为基础帧。图2-2中帧组A为只包括一个基础帧，即基础帧a的情况。结合图1所对应的实施例，在根据对视频播放流畅度的要求，或者根据网络的基准发送速率建立视频帧序列内视频帧之间的参考 关系时，当对视频播放流畅度的要求越高或者网络的基准发送速率越高时，直接引用IDR帧为参考帧的视频帧的数量越多。可选的，IDR帧之后的每一个视频帧均引用IDR帧为参考帧。即K个帧组中每个帧组均只包括基础帧。这样，针对第k个帧组，当确定丢帧时，只丢失一个视频帧，从而提高视频播放流畅度。
当第k个帧组由至少两个视频帧组成时，第k个帧组由基础帧和扩展帧序列组成。其中，基础帧为第k个帧组的首帧，扩展帧序列为第k个帧组中除基础帧之外的S个视频帧所组成的序列。图2-2中的帧组B由基础帧b以及扩展帧序列组成，其中扩展帧序列由3个扩展帧所组成，扩展帧序列中的每个视频帧均直接引用基础帧b，基础帧b直接引用IDR帧，则扩展帧序列中的每个视频帧间接引用IDR帧。
S个视频帧中的第s个视频帧，以第k个帧组中位于第s个视频帧之前的任一视频帧为参考帧，其中，S为大于等于1的整数，s为大于等于1小于等于S的整数。
关于扩展帧序列中的S个视频帧内部视频帧之间的具体参考关系，将在后续步骤中结合具体丢帧方式进一步说明。
步骤203、在视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度。
发送缓冲区用于缓存即将发送的若干视频帧。发送缓冲区的数据占用长度可以实时反应网络环境的好坏变化，因此在视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度，以确定将当前待缓存的视频帧存入发送缓冲区，或者丢弃当前待缓存的视频帧。
步骤204、当数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧。
不同参考关系对应不同丢帧方式，在参考关系确定的情况下，针对不同视频帧，当确定丢帧时，丢弃视频帧的数量不同。可选的，不同视频帧可以分别对应一个发送缓冲区的预设阈值。优选的，视频帧序列中每一个视频帧都对应有一个发送缓冲区的预设阈值。两个视频 帧各自所对应的预设阈值，可以相同或者不同。
为方便描述，后续说明中对不同视频帧所对应预设阈值分别用第一预设阈值、第二预设阈值此类的描述来表示。
结合图2-2所示的参考关系，当IDR帧为当前待缓存的视频帧时，如果发送缓冲区的数据占用长度大于预设阈值，则丢弃视频帧序列中的全部基础帧。进一步的，对于引用基础帧为参考帧的扩展帧，由于间接引用IDR帧，因此一并丢弃，那么IDR帧如果被丢弃则最终整个视频帧序列也一并丢弃。
其中，IDR帧所对应的预设阈值的为第一预设阈值。进一步地，如果发送缓冲区的数据占用长度不大于预设阈值，将当前待缓存的视频帧存入发送缓冲区。即如果发送缓冲区的数据占用长度不大于第一预设阈值，则无需丢弃IDR帧，并将IDR帧存入发送缓冲区。
当IDR帧为当前待缓存的视频帧时，如果确定丢帧，需要丢弃整个视频帧序列，这种情况应该尽可能地避免，以免影响视频播放流畅度。为此，第一预设阈值应该尽可能地大，可选的，当IDR帧为当前待缓存的视频帧时，只要发送缓冲区未被占用的部分可以容纳IDR帧，就保留IDR帧，尽量避免将视频帧序列整体丢掉的情况发生，以保证视频播放的流畅度。
针对第k个帧组，结合图2-2对S个视频帧内部视频帧之间的具体参考关系，以及具体参考关系下的丢帧方式进行详细说明。
可选的，S个视频帧中的第s个视频帧，以第k个帧组中位于第s个视频帧之前的任一视频帧为参考帧，即第s个视频帧可以引用第k个帧组的基础帧为参考帧，也可以引用S个视频帧中位于第s个视频帧之前的任一视频帧为参考帧。例如，第k个帧组中的每一个视频帧，都以相邻的前一视频帧为参考帧。即S个视频帧中的第1个视频帧，以基础帧为参考帧，S个视频帧中的第s+2个视频帧，以第s+1个视频帧为参考帧，第s+1个视频帧以第s个视频帧为参考帧，其中s为大于等于1的整数，即第s个视频帧可以是S个视频帧中的任一视频帧，另s+2小于等于S。
对应上述参考关系，结合IDR帧被丢的情形，当第k个帧组的基 础帧为当前待缓存的视频帧时，如果确定丢弃第k个帧组的基础帧，则需要丢弃第k个帧组。其中，预设阈值的取值为第二预设阈值。
如果发送缓冲区的数据占用长度不大于预设阈值，即无需丢弃第k个帧组的基础帧。可以进一步针对扩展帧序列所包括的S个视频帧判定是否丢帧。
当确定丢弃第s个视频帧时，将第s个视频帧，以及S个视频帧中位于第s个视频帧之后的视频帧全部丢弃。其中，第s个视频帧对应的预设阈值为第三预设阈值，
优选地，S个视频帧可以均直接引用第k个帧组的基础帧为参考帧。图2-2中的帧组B，为扩展帧序列中的每个视频帧均以基础帧b为参考帧的情况。当第k个帧组的基础帧保留时，将第s个视频帧作为当前待缓存的视频帧判断是否丢帧。当确定丢弃第s个视频帧时，仅需丢弃第s个视频帧。进一步地，可以进一步以第s+1个视频帧作为当前待缓存的视频帧继续判定是否丢帧，其中，s+1小于等于S。
进一步优选地，第s个视频帧，以及第s个视频帧之后的视频帧中的至少一个视频帧，均以S个视频帧中的第s-n个视频帧为参考帧，其中，n为大于等于0且小于s的正整数。结合图2-2，帧组C的扩展帧序列中存在两个视频帧引用同一视频帧为参考帧的情况，图2-2中视频帧β以及视频帧γ，均直接引用视频帧α为参考帧。进一步地，帧组C中视频帧α之后的任一视频帧，也都可以被其后续视频帧中的若干视频帧直接引用或者间接引用，图中未标出。通过这种参考关系，可以对扩展帧序列所包括视频帧的数量进行调整，也能够对与某一视频帧存在参考关系的视频帧的数量进行调整，从而达到对一次丢帧所丢弃视频帧的数量进行调整的目的。
此处以第s个视频帧，以及第s+n个视频帧，均引用第s-n个视频帧为参考帧的情况为例进行说明，其中s+n小于等于S。可选的，S个视频帧中，第s-n个视频帧和第s个视频帧之间的视频帧，均以相邻前一视频帧为参考帧，S个视频帧中第s+n个视频帧之后的全部视频帧，均以相邻前一视频帧为参考帧。结合图2-2，视频帧β与视频帧γ之间的视频帧，以及视频帧γ之后的全部视频帧，均以相邻前 一视频帧为参考帧。
对应上述参考关系，当确定丢弃第s-n个视频帧时，将第s-n个视频帧，以及第s-n个视频帧和第s个视频帧之间的视频帧丢弃，同时S个视频帧中第s个视频帧以及第s个视频帧之后的视频帧以一并丢弃。
进一步地，S个视频帧中位于第s个视频帧之后的视频帧，均可以直接引用或者间接应用第s个视频帧，此处不再赘述。
当然，本领域内技术人员可以理解的是，通过对以上几种具体参考方式的结合或者变化，还可以得到S个视频帧之间的其它多种参考方式。使得扩展帧序列之间可以建立灵活多变的参考方式。
参考关系的变化，使得与当前待缓存的视频帧有参考关系的视频帧的数量也相应地变化，当确定丢帧时，一次丢帧所丢弃视频帧的数量也相应地变化。同时，在一定网络环境下，通过对第一阈值、第二阈值以及第三阈值大小的调整，可以对丢帧发生的次数进行调整。
具体地，针对IDR帧判定是否丢帧时，第一阈值需要尽可能大。针对基础帧判定是否丢帧时，第二阈值可以较第一阈值小。第二阈值越小，越容易出现丢帧的情况。同样，第三阈值可以较第二阈值更小，第三阈值越小，越容易出现丢帧的情况。
可选的，通过对参考关系以及预设阈值具体取值的调整，实现少量多次的丢帧策略，避免出现一次丢失大量连续视频帧的情况，以提高视频播放的流畅度。同时，在网络环境不好时，视频发送设备可以通过丢帧降低视频发送帧率，在一次丢帧结束后，如果网络环境满足保留后续视频帧的要求，则不再丢帧，视频发送帧率随之升高。即通过少量多次的丢帧方式，视频发送装置可以根据网络环境的变化及时降低或者提高视频发送帧率，从而提高视频播放流畅度，改善用户体验。
本发明的实施例所提供的视频帧丢帧方法及视频发送装置，根据预设标准建立视频帧序列中各视频帧之间的参考关系，并进一步确定是否丢帧。在视频帧序列发送的过程中，在确定丢帧时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存 的视频帧为参考帧的所有视频帧，而无需丢帧直到出现IDR帧为止，减小了在一次丢帧中所丢弃视频帧的数量，避免出现长时间画面卡顿的情况。同时，通过对参考关系的灵活调整，能够实现少量多次的丢帧方式，使得视频发送装置可以根据网络环境的变化及时降低或者提高视频发送帧率，从而提高了视频播的流畅度，改善了用户体验。
基于本发明所提供的视频帧丢帧方法，本发明的实施例提供一种视频发送装置30用于执行本发明所提供的数据帧丢帧方法。参照图3所示，视频发送装置30包括：获取单元301，编码单元302、检测单元303以及丢帧单元304。
获取单元301，用于获取待发送视频的视频帧序列；
编码单元302，用于根据预设标准，建立获取单元301获取的视频帧序列中各视频帧之间的参考关系；参考关系包括:视频帧序列中的第m帧引用第m-h帧为参考帧；视频帧序列中的第n帧,被第n帧后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，视频帧序列中视频帧的数量不小于n+2；
检测单元303，用于在视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；
丢帧单元304，用于当检测单元303检测所得的数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧。
可选的，预设标准为对视频播放流畅度的要求；
编码单元302，建立的视频帧序列中各视频帧之间的参考关系包括：视频播放流畅度的要求越高,直接引用IDR帧为参考帧的视频帧越多。
可选的，预设标准为视频帧序列内每个视频帧的重要性；
编码单元302，建立的视频帧序列中各视频帧之间的参考关系包括：重要性相对较高的视频帧被重要性相对较低的视频帧直接引用为参考帧。
可选的，预设标准为网络的基准发送速率；
编码单元302，建立的视频帧序列中各视频帧之间的参考关系包 括：网络的基准发送速率越高，直接引用即时解码刷新IDR帧为参考帧的视频帧越多。
可选的，视频帧序列中各视频帧之间的参考关系具体包括：
当视频帧序列的首帧为即时解码刷新IDR帧时，IDR帧之后的每一个视频帧均引用IDR帧为参考帧。
可选的，视频帧序列中每一个视频帧都对应有一个发送缓冲区的预设阈值。
可选的，丢帧单元304，还用于当检测单元303检测所得的发送缓冲区的数据占用长度不大于预设阈值时，将当前待缓存的视频帧存入发送缓冲区。
本发明的实施例所提供的视频帧丢帧方法及视频发送装置，根据预设标准建立所述视频帧序列中各视频帧之间的参考关系，并进一步确定是否丢帧。在所述视频帧序列发送的过程中，在确定丢帧时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当前待缓存的视频帧为参考帧的所有视频帧，而无需丢帧直到出现IDR帧为止，减小了在一次丢帧中所丢弃视频帧的数量，避免出现长时间画面卡顿的情况，提高了视频播放流畅度。
结合图3所对应的实施例，本发明的实施例提供一种视频发送装置40，参照图4所示，该设备可以嵌入或本身就是微处理计算机，比如：通用计算机、客户定制机、手机终端或平板机等便携设备，该视频发送装置40包括：至少一个处理器401、存储器402、和总线403，该至少一个处理器401和存储器402通过总线403连接并完成相互间的通信。
该总线403可以是ISA(Industry Standard Architecture，工业标准体系结构)总线、PCI(Peripheral Component，外部设备互连)总线或EISA(Extended Industry Standard Architecture，扩展工业标准体系结构)总线等。该总线403可以分为地址总线、数据总线、控制总线等。为便于表示，图4中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。其中：
存储器402用于执行本发明方案的应用程序代码，执行本发明方 案的应用程序代码保存在存储器中，并由处理器401来控制执行。
该存储器可以是只读存储器ROM或可存储静态信息和指令的其他类型的静态存储设备，随机存取存储器RAM或者可存储信息和指令的其他类型的动态存储设备，也可以是电可擦可编程只读存储器EEPROM、只读光盘CD-ROM或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质，但不限于此。这些存储器通过总线与处理器相连接。
处理器401可能是一个中央处理器401(Central Processing Unit，简称为CPU)，或者是特定集成电路(Application Specific Integrated Circuit，简称为ASIC)，或者是被配置成实施本发明实施例的一个或多个集成电路。
处理器401用于：调用存储器402中的程序代码，用以执行上述图3对应的设备实施例中获取单元、编码单元检测单元以及丢帧单元的操作，包括：获取待发送视频的视频帧序列；根据预设标准，建立所述视频帧序列中各视频帧之间的参考关系；所述参考关系包括:所述视频帧序列中的第m帧引用第m-h帧为参考帧；所述视频帧序列中的第n帧,被所述第n帧后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，所述视频帧序列中视频帧的数量不小于n+2；在所述视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；当所述数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在所述视频帧序列中根据所述参考关系引用所述当前待缓存的视频帧为参考帧的所有视频帧。其中，对各单元的具体描述，参照图3对应的设备实施例，这里不再赘述。
本发明的实施例所提供的视频帧丢帧方法及视频发送装置，根据预设标准建立所述视频帧序列中各视频帧之间的参考关系，并进一步确定是否丢帧。在所述视频帧序列发送的过程中，在确定丢帧时，丢弃当前待缓存的视频帧，并丢弃在视频帧序列中根据参考关系引用当 前待缓存的视频帧为参考帧的所有视频帧，而无需丢帧直到出现IDR帧为止，减小了在一次丢帧中所丢弃视频帧的数量，避免出现长时间画面卡顿的情况，提高了视频播放流畅度。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到本发明中的视频发送装置，可以用硬件实现，或固件实现，或它们的组合方式来实现。当使用软件实现时，可以将上述功能存储在计算机可读介质中或作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质，其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是计算机能够存取的任何可用介质。以此为例但不限于：计算机可读介质可以包括RAM(Random Access Memory，随机存储器)、ROM(Read Only Memory，只读内存)、EEPROM(Electrically Erasable Programmable Read Only Memory，电可擦可编程只读存储器)、CD-ROM(Compact Disc Read Only Memory，即只读光盘)或其他光盘存储、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质。
以上，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。

Claims (14)

  1. 一种视频帧丢帧方法，其特征在于，包括：
    获取待发送视频的视频帧序列；
    根据预设标准，建立所述视频帧序列中各视频帧之间的参考关系；所述参考关系包括:所述视频帧序列中的第m帧引用第m-h帧为参考帧；所述视频帧序列中的第n帧,被所述第n帧后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，所述视频帧序列中视频帧的数量不小于n+2；
    在所述视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；
    当所述数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在所述视频帧序列中根据所述参考关系引用所述当前待缓存的视频帧为参考帧的所有视频帧。
  2. 根据权利要求1所述的方法，其特征在于，所述预设标准为对视频播放流畅度的要求；
    其中，所述参考关系中,所述视频播放流畅度的要求越高,直接引用即时解码刷新IDR帧为参考帧的视频帧越多；所述IDR帧为所述视频帧序列的首帧。
  3. 根据权利要求1所述的方法，其特征在于，所述预设标准为所述视频帧序列内每个视频帧的重要性；
    其中，所述参考关系中,重要性相对较高的视频帧被重要性相对较低的视频帧直接引用为参考帧。
  4. 根据权利要求1所述的方法，其特征在于，所述预设标准为网络的基准发送速率；
    其中，所述网络的基准发送速率越高，所述参考关系中,直接引用即时解码刷新IDR帧为参考帧的视频帧越多；所述IDR帧为所述视频帧序列的首帧。
  5. 根据权利要求1-4任一项所述的方法，其特征在于，所述视频帧序列中各视频帧之间的参考关系具体包括：
    当所述视频帧序列的首帧为即时解码刷新IDR帧时，所述IDR帧之后的每一个视频帧均引用所述IDR帧为参考帧。
  6. 根据权利要求1-5任一项所述的方法，其特征在于，所述视频帧序列中每一个视频帧都对应有一个发送缓冲区的预设阈值。
  7. 根据权利要求1-6任一项所述的方法，其特征在于，所述方法还包括：
    当所述数据占用长度不大于预设阈值时，将所述当前待缓存的视频帧存入所述发送缓冲区。
  8. 一种视频发送装置，其特征在于，包括：
    获取单元，用于获取待发送视频的视频帧序列；
    编码单元，用于根据预设标准，建立所述获取单元获取的所述视频帧序列中各视频帧之间的参考关系；所述参考关系包括:所述视频帧序列中的第m帧引用第m-h帧为参考帧；所述视频帧序列中的第n帧,被所述第n帧后的视频帧中的至少两个视频帧引用为参考帧；其中，m、h、n均为自然数，m大于1且m大于h，所述视频帧序列中视频帧的数量不小于n+2；
    检测单元，用于在所述视频帧序列发送的过程中，检测视频发送缓冲区已缓存视频帧的数据占用长度；
    丢帧单元，用于当所述检测单元检测到所述数据占用长度大于预设阈值时，丢弃当前待缓存的视频帧，并丢弃在所述视频帧序列中根据所述参考关系引用所述当前待缓存的视频帧为参考帧的所有视频帧。
  9. 根据权利要求8所述的装置，其特征在于，所述预设标准为对视频播放流畅度的要求；
    所述编码单元建立的所述视频帧序列中各视频帧之间的参考关系包括：所述视频播放流畅度的要求越高,直接引用即时解码刷新IDR帧为参考帧的视频帧越多；所述IDR帧为所述视频帧序列的首帧。
  10. 根据权利要求8所述的装置，其特征在于，所述预设标准为所述视频帧序列内每个视频帧的重要性；
    所述编码单元建立的所述视频帧序列中各视频帧之间的参考关 系包括：重要性相对较高的视频帧被重要性相对较低的视频帧直接引用为参考帧。
  11. 根据权利要求8所述的装置，其特征在于，所述预设标准为网络的基准发送速率；
    所述编码单元建立的所述视频帧序列中各视频帧之间的参考关系包括：所述网络的基准发送速率越高，直接引用即时解码刷新IDR帧为参考帧的视频帧越多。
  12. 根据权利要求8-11任一项所述的装置，其特征在于，所述编码单元建立的所述视频帧序列中各视频帧之间的参考关系具体包括：
    当所述视频帧序列的首帧为即时解码刷新IDR帧时，所述IDR帧之后的每一个视频帧均引用所述IDR帧为参考帧。
  13. 根据权利要求8-12任一项所述的装置，其特征在于，所述视频帧序列中每一个视频帧都对应有一个发送缓冲区的预设阈值。
  14. 根据权利要求8-13任一项所述的装置，其特征在于，
    所述丢帧单元，还用于当所述检测单元检测到所述数据占用长度不大于预设阈值时，将所述当前待缓存的视频帧存入所述发送缓冲区。
PCT/CN2015/083667 2015-02-17 2015-07-09 一种视频帧丢帧方法及视频发送装置 Ceased WO2016131223A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP15882362.5A EP3253064A4 (en) 2015-02-17 2015-07-09 Frame loss method for video frame and video sending apparatus
US15/678,846 US10659847B2 (en) 2015-02-17 2017-08-16 Frame dropping method for video frame and video sending apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510091898.2 2015-02-17
CN201510091898.2A CN104702968B (zh) 2015-02-17 2015-02-17 一种视频帧丢帧方法及视频发送装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/678,846 Continuation US10659847B2 (en) 2015-02-17 2017-08-16 Frame dropping method for video frame and video sending apparatus

Publications (1)

Publication Number Publication Date
WO2016131223A1 true WO2016131223A1 (zh) 2016-08-25

Family

ID=53349678

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/083667 Ceased WO2016131223A1 (zh) 2015-02-17 2015-07-09 一种视频帧丢帧方法及视频发送装置

Country Status (4)

Country Link
US (1) US10659847B2 (zh)
EP (1) EP3253064A4 (zh)
CN (1) CN104702968B (zh)
WO (1) WO2016131223A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113873293A (zh) * 2021-10-09 2021-12-31 兰州乐智教育科技有限责任公司 动态调整视频帧率自适应网络的方法及相关设备

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702968B (zh) 2015-02-17 2019-06-11 华为技术有限公司 一种视频帧丢帧方法及视频发送装置
US9942552B2 (en) 2015-06-12 2018-04-10 Intel Corporation Low bitrate video coding
CN106331835B (zh) * 2015-06-26 2019-06-07 成都鼎桥通信技术有限公司 一种动态调整数据接收缓存的方法及视频解码设备
CN105611309B (zh) * 2015-12-22 2019-03-05 北京奇虎科技有限公司 一种视频传输方法和装置
CN107222427A (zh) * 2016-03-22 2017-09-29 华为技术有限公司 一种报文处理的方法及相关设备
CN105847946A (zh) * 2016-05-28 2016-08-10 刘健文 一种传屏视频处理方法
CN108235107A (zh) * 2016-12-15 2018-06-29 广州市动景计算机科技有限公司 视频录制方法、装置及电子终端
CN108243338A (zh) * 2016-12-23 2018-07-03 杭州海康威视数字技术股份有限公司 视频解码、编码方法、装置及系统
CN106993197B (zh) * 2017-04-10 2019-05-24 杭州星犀科技有限公司 一种基于编码器的丢帧方法
CN108063973A (zh) * 2017-12-14 2018-05-22 浙江大华技术股份有限公司 一种视频流解码方法及设备
CN109996088A (zh) * 2017-12-29 2019-07-09 阿里巴巴集团控股有限公司 一种直播数据处理方法及装置
CN110213308A (zh) * 2018-02-28 2019-09-06 杭州海康威视数字技术股份有限公司 一种解码视频数据的方法及装置
CN110248205B (zh) * 2018-09-03 2023-03-24 浙江大华技术股份有限公司 一种视频录像数据打包的方法及装置
US11445243B2 (en) * 2019-05-10 2022-09-13 Plantronics, Inc. Adaptive rate control adjustment for hardware encoder
CN111093083B (zh) * 2019-12-16 2022-12-09 西安万像电子科技有限公司 数据传输方法及装置
CN111131210B (zh) * 2019-12-16 2021-09-17 维沃移动通信有限公司 数据处理方法及电子设备
CN111159042A (zh) * 2019-12-31 2020-05-15 可牛网络技术（北京）有限公司 一种流畅度测试方法、装置及电子设备
CN111131878A (zh) * 2019-12-31 2020-05-08 北京百度网讯科技有限公司 视频预处理及丢帧检测方法、装置、电子设备及存储介质
CN111147884B (zh) * 2020-01-02 2021-12-17 广州虎牙科技有限公司 数据处理方法、装置、系统、用户端及存储介质
CN111491201B (zh) * 2020-04-08 2023-04-25 深圳市昊一源科技有限公司 调整视频码流的方法及视频丢帧处理方法
CN111884866B (zh) * 2020-08-05 2022-10-28 中国工商银行股份有限公司 网络优化方法、网络优化系统、计算机系统和存储介质
CN114071227A (zh) * 2020-08-06 2022-02-18 北京小米移动软件有限公司 数据处理方法及装置
US11470282B2 (en) 2020-12-09 2022-10-11 Waymo Llc Systems, apparatus, and methods for transmitting image data
CN112506447B (zh) * 2021-02-01 2021-04-30 成都焱之阳科技有限公司 一种用于视频监控设备的数据无锁缓存方法和服务器
CN113225617A (zh) * 2021-04-28 2021-08-06 臻迪科技股份有限公司 播放视频处理方法、装置及电子设备
CN113490055B (zh) * 2021-07-06 2023-09-19 三星电子（中国）研发中心 数据处理方法和装置
CN113271496B (zh) * 2021-07-15 2021-10-01 全时云商务服务股份有限公司 一种网络直播中视频平滑播放方法、系统和可读存储介质
CN114567796B (zh) * 2022-03-04 2024-11-26 北京字节跳动网络技术有限公司 一种丢帧方法、装置、服务器和介质
CN115037701B (zh) * 2022-06-20 2023-12-19 北京达佳互联信息技术有限公司 视频处理方法、装置、服务器及介质
US12457480B2 (en) 2023-01-05 2025-10-28 GM Global Technology Operations LLC Methods to maintaining network quality of service for in-vehicle applications
CN116055810B (zh) * 2023-01-17 2024-11-12 阿里云计算有限公司 音视频播放方法、装置、系统、电子设备及存储介质
US12126897B2 (en) 2023-01-24 2024-10-22 GM Global Technology Operations LLC Bandwidth saving for wireless camera using motion vectors
US12573093B2 (en) 2023-02-16 2026-03-10 GM Global Technology Operations LLC Object blurring on compressed videos
US12307779B2 (en) 2023-02-16 2025-05-20 GM Global Technology Operations LLC Vehicle video recording framework
US11936700B1 (en) * 2023-02-16 2024-03-19 GM Global Technology Operations LLC Vehicle video streaming system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101527834A (zh) * 2009-03-26 2009-09-09 浙江大华技术股份有限公司 一种无线窄带网络视频传输方法
US20100086280A1 (en) * 2008-10-02 2010-04-08 Horizon Semiconductors Ltd. Method for smoothly playing a video stream in reverse
CN103270728A (zh) * 2010-12-09 2013-08-28 赛格纳斯广播公司 在通信网络中对数据进行优先化以进行智能丢弃的系统和方法
CN103533356A (zh) * 2013-10-10 2014-01-22 深圳市智美达科技有限公司 视频数据传输方法和装置
CN104135486A (zh) * 2014-08-08 2014-11-05 浙江奇汇电子提花机有限公司 一种基于tcp协议的流媒体无线自适应传输方法
CN104702968A (zh) * 2015-02-17 2015-06-10 华为技术有限公司 一种视频帧丢帧方法及视频发送装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7133362B2 (en) * 2001-11-14 2006-11-07 Microsoft Corporation Intelligent buffering process for network conference video
US8296813B2 (en) * 2006-06-22 2012-10-23 Sony Computer Entertainment Inc. Predictive frame dropping to enhance quality of service in streaming data
KR100846802B1 (ko) * 2007-02-14 2008-07-16 삼성전자주식회사 동영상 프레임의 디코딩 방법 및 인코딩 방법
CN100593953C (zh) * 2008-04-10 2010-03-10 清华大学 基于pid控制和接收帧率稳定模型的视频传输控制方法
CN101466034A (zh) * 2008-12-25 2009-06-24 华为技术有限公司 发送、播放流媒体数据的方法和装置及流媒体点播系统
US20120121014A1 (en) * 2009-03-04 2012-05-17 Thomas Rusert Processing of Multimedia Data
US8531961B2 (en) 2009-06-12 2013-09-10 Cygnus Broadband, Inc. Systems and methods for prioritization of data for intelligent discard in a communication network
WO2010144833A2 (en) * 2009-06-12 2010-12-16 Cygnus Broadband Systems and methods for intelligent discard in a communication network
US9065779B2 (en) 2009-06-12 2015-06-23 Wi-Lan Labs, Inc. Systems and methods for prioritizing and scheduling packets in a communication network
US8443097B2 (en) * 2010-04-12 2013-05-14 Alcatel Lucent Queue management unit and method for streaming video packets in a wireless network
US20130058406A1 (en) * 2011-09-05 2013-03-07 Zhou Ye Predictive frame dropping method used in wireless video/audio data transmission
US20140132837A1 (en) 2011-09-05 2014-05-15 Cywee Group Limited Wireless video/audio data transmission system having i-frame only gop structure
CA2786200C (en) * 2011-09-23 2015-04-21 Cygnus Broadband, Inc. Systems and methods for prioritization of data for intelligent discard in a communication network
CN103124348A (zh) * 2011-11-17 2013-05-29 蓝云科技股份有限公司 一种在无线视频/音频数据传输中使用的预测丢帧方法
EP2680219A1 (en) * 2012-06-29 2014-01-01 Thomson Licensing Method for reframing images of a video sequence, and apparatus for reframing images of a video sequence
US9218848B1 (en) * 2014-07-01 2015-12-22 Amazon Technologies, Inc. Restructuring video streams to support random access playback

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100086280A1 (en) * 2008-10-02 2010-04-08 Horizon Semiconductors Ltd. Method for smoothly playing a video stream in reverse
CN101527834A (zh) * 2009-03-26 2009-09-09 浙江大华技术股份有限公司 一种无线窄带网络视频传输方法
CN103270728A (zh) * 2010-12-09 2013-08-28 赛格纳斯广播公司 在通信网络中对数据进行优先化以进行智能丢弃的系统和方法
CN103533356A (zh) * 2013-10-10 2014-01-22 深圳市智美达科技有限公司 视频数据传输方法和装置
CN104135486A (zh) * 2014-08-08 2014-11-05 浙江奇汇电子提花机有限公司 一种基于tcp协议的流媒体无线自适应传输方法
CN104702968A (zh) * 2015-02-17 2015-06-10 华为技术有限公司 一种视频帧丢帧方法及视频发送装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3253064A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113873293A (zh) * 2021-10-09 2021-12-31 兰州乐智教育科技有限责任公司 动态调整视频帧率自适应网络的方法及相关设备

Also Published As

Publication number Publication date
CN104702968A (zh) 2015-06-10
EP3253064A1 (en) 2017-12-06
US20170347158A1 (en) 2017-11-30
US10659847B2 (en) 2020-05-19
EP3253064A4 (en) 2017-12-06
CN104702968B (zh) 2019-06-11

Similar Documents

Publication Publication Date Title
WO2016131223A1 (zh) 一种视频帧丢帧方法及视频发送装置
CN106454395B (zh) 在服务器中用于自适应提供多码率流媒体的方法及装置
CN110636346B (zh) 一种码率自适应切换方法、装置、电子设备及存储介质
US8661152B2 (en) Method and apparatus for reducing deterioration of a quality of experience of a multimedia service in a multimedia system
CN110784740A (zh) 视频处理方法、装置、服务器及可读存储介质
CN103686221B (zh) 一种适应公用无线网络实现音视频流畅播出的方法
WO2019062050A1 (zh) 直播管控方法、装置及电子设备
EP1708506B1 (en) Rapid media channel changing mechanism and access network node comprising same
WO2020029935A1 (zh) 视频直播处理方法、装置及终端
CN102137275B (zh) 快速频道切换中快速推送单播流的方法和装置
CN110582012B (zh) 视频切换方法、视频处理方法、装置及存储介质
CN110519640B (zh) 视频处理方法、编码器、cdn服务器、解码器、设备及介质
WO2020228482A1 (zh) 视频处理方法、装置及系统
CN107800989B (zh) 基于动态帧率检测的视频显示方法、系统及网络录像机
CN111726657A (zh) 直播视频的播放处理方法、装置及服务器
CN104394426A (zh) 流媒体倍速播放方法和装置
CN116389437B (zh) 视频数据传输方法、设备、存储介质和系统
CN118764673A (zh) 一种面向户外大屏的视频传输方法及传输系统
CN110996035B (zh) 信息发送方法及装置
CN103929682B (zh) 一种在视频直播系统中设置关键帧的方法及装置
CN103621063A (zh) 用于控制视频流中的数据图像的呈现的系统、方法与介质
CN115278349A (zh) 一种在无线通信环境下的处理拖拽观看视频的方法
CN110062003B (zh) 视频数据发送方法、装置、电子设备及存储介质
CN112929667A (zh) 一种编解码方法、装置、设备及可读存储介质
CN119071538B (zh) 一种全景视频用户体验提升方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15882362

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2015882362

Country of ref document: EP