WO2017190329A1 - 视频业务的传输方法和装置 - Google Patents

视频业务的传输方法和装置 Download PDF

Info

Publication number
WO2017190329A1
WO2017190329A1 PCT/CN2016/081174 CN2016081174W WO2017190329A1 WO 2017190329 A1 WO2017190329 A1 WO 2017190329A1 CN 2016081174 W CN2016081174 W CN 2016081174W WO 2017190329 A1 WO2017190329 A1 WO 2017190329A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
video
substream
importance
nalu
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/081174
Other languages
English (en)
French (fr)
Inventor
魏冬冬
倪其玲
周国华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201680085347.8A priority Critical patent/CN109076260A/zh
Priority to PCT/CN2016/081174 priority patent/WO2017190329A1/zh
Priority to EP16900851.3A priority patent/EP3445059B1/en
Publication of WO2017190329A1 publication Critical patent/WO2017190329A1/zh
Priority to US16/179,815 priority patent/US10939127B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/188—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a video data packet, e.g. a network abstraction layer [NAL] unit
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/168—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] specially adapted for link layer protocols, e.g. asynchronous transfer mode [ATM], synchronous optical network [SONET] or point-to-point protocol [PPP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23605—Creation or processing of packetized elementary streams [PES]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M15/00—Arrangements for metering, time-control or time indication ; Metering, charging or billing arrangements for voice wireline or wireless communications, e.g. VoIP
    • H04M15/66—Policy and charging system
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H04W8/02—Processing of mobility data, e.g. registration information at HLR [Home Location Register] or VLR [Visitor Location Register]; Transfer of mobility data, e.g. between HLR, VLR or external networks
    • H04W8/08—Mobility data transfer

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for transmitting video services.
  • Video services are transmitted and stored in the network as video files. Since the amount of uncompressed raw video files is very large, transmission and storage require huge transmission bandwidth and storage space resources, so uncompressed original video files are not suitable for transmission and storage in the network.
  • the industry has introduced a video compression coding method.
  • H.264 is the International Telecommunication Union-Telecommunication Standardization Sector (ITU-T) Video Coding Expert Group and the International Organization for Standardization/International Electrotechnical Commission (ISO/ IEC) The Moving Video Experts Group (MPEG) combined video group standard for high compression ratio digital video codecs.
  • ITU-T International Telecommunication Union-Telecommunication Standardization Sector
  • ISO/ IEC International Organization for Standardization/International Electrotechnical Commission
  • MPEG Moving Video Experts Group
  • the video transmission scheme of the prior art may occur in the transmission process of the video service, especially when the transmission resource is limited, and the higher quality data cannot provide higher quality of service (QoS) guarantee.
  • QoS quality of service
  • the embodiment of the invention provides a method and a device for transmitting a video service, which can split data in a video data frame into at least two substreams according to the mapping relationship between the importance of the data and the substream. And, according to the port number corresponding to the substream, the data on the substream is mapped to the bearer corresponding to the substream for transmission. Because the network can adopt different processing methods for data on different bearers, the video service transmission method and apparatus provided by the embodiments of the present invention can preferentially ensure reliable transmission of high-importance video data frames, thereby limiting transmission resources. Improve the business experience of video users in the scenario.
  • an embodiment of the present invention provides a method for transmitting a video service, including: determining an importance of data in a video data frame; and determining data in a video data frame according to a mapping relationship between importance of the data and the substream.
  • the data is divided into at least two sub-streams.
  • the data on the sub-flow is mapped to the bearer corresponding to the sub-flow for transmission.
  • the substream data mapped to the bearer may be transmitted by using a secure transport protocol.
  • determining the importance of the data in the video data frame includes determining the importance of the video data frame or determining the importance of the network abstraction layer unit NALU in the video data frame.
  • the importance of the video data frame can be determined by first obtaining the frame type of the video data frame, and then determining the importance of the video data frame according to the mapping relationship between the frame type and the importance of the frame. .
  • the frame type of the video data frame can be obtained by using information in a frame header of the video data frame.
  • the importance of the NALU in the video data frame can be determined by: obtaining the NALU type of the NALU in the video data frame; determining the importance of the NALU according to the mapping relationship between the NALU type and the importance of the NALU Sex.
  • the NALU type of the NALU in the video data frame may be obtained by using the header information of the NALU in the video data frame.
  • the data is divided into at least two substreams in units of video data frames.
  • the data is offloaded to at least two substreams in units of NALU.
  • mapping data of high importance to meet the data pair The QoS requirements are carried on the substream to be transmitted, thereby being able to meet the QoS requirements of the data.
  • data of high importance is transmitted along with data of low importance in the network, since data of high importance and data of low importance are transmitted on different bearers, the network can adopt data of different importance. Different processing methods enable priority to ensure reliable transmission of data of high importance.
  • the media sub-component description corresponding to the sub-flow is determined according to the flow number of the sub-flow; further, the port number of the sender in the description of the media sub-component may be determined; further determining the sub-port by the port number of the sender Streaming the corresponding bearer; then mapping the data on the substream to the bearer corresponding to the substream for transmission.
  • the bearers of different sub-flows may all adopt Transmission Control Protocol (TCP) or both User Datagram Protocol (UDP) or partial bearer adopts TCP and other bearers.
  • TCP Transmission Control Protocol
  • UDP User Datagram Protocol
  • TCP is a reliable transmission mechanism and can be used to carry video data of high importance.
  • UDP is an unreliable transmission mechanism and can be used to carry video data of low importance.
  • the sub-stream data sequence number of the video data frame in the sub-stream after the shunt is included in the header information of the video data frame in the sub-stream (Data In addition to the Sequence Number (DSN), the original DSN of the video data frame before the offloading may also be included.
  • DSN Sequence Number
  • the existing Flexbile Macroblock Ordering (FMO) encoding method is extended to define a new macroblock-to-strip group mapping mode, which types can be defined by the mapping mode.
  • the macroblocks are mapped into the same stripe group, so that the macroblocks with high importance can be mapped into one stripe group, and the data of the same stripe group is encoded to generate the same type of NALU, and the same type can be further
  • the NALU is mapped to the bearer corresponding to the same substream for transmission, so that the macroblock with high importance can be preferentially obtained for reliable transmission.
  • the substream data may include, in addition to the substream DSN after the offload, the original DSN corresponding to each NALU in the substream data frame.
  • the video service sending apparatus may support at least one offloading scheme. Further, in a scenario where the video service sending apparatus supports more than one type of offloading scheme, the video service sending apparatus may further be related to the offloading scheme.
  • the configuration parameters determine which shunting scheme to use.
  • an embodiment of the present invention provides another method for transmitting video services, including: a video service receiving apparatus receives data on at least two substreams from at least two bearers, where the bearer is a port number through the receiving end. Corresponding to the substream; the data on the substream is obtained by dividing the video data according to the mapping relationship between the importance of the data in the video data frame and the substream; the video service receiving device then pairs the at least two substreams The data is aggregated.
  • the method is configured to receive the video data sent by the video service sending apparatus in the video service transmission method of the first aspect, and thus can also implement the beneficial effects of the first aspect of the video service transmission method.
  • the video service receiving apparatus may also perform different aggregation processing on the data on the received substream. If the video service sending apparatus uses the video data frame level offload, the video service receiving apparatus may aggregate the data of each substream and sort according to the original DSN before the offloading. If the video service sending apparatus uses the NALU-level offload, the video service receiving apparatus first aggregates the data of each sub-flow, and assembles the NALU according to the original DSN before the shunt corresponding to the NALU in the data. The previous video data frame is streamed, and then the generated video data frames are sorted according to the original DSN.
  • the video service receiving device can support the receiving process corresponding to at least one of the offloading schemes.
  • the video service receiving device determines the offloading scheme used when the video service is sent before performing the convergence process.
  • the video service receiving apparatus may determine, by using a cell related to the offloading scheme, a offloading scheme used when the video service is sent, where the cell related to the offloading scheme may be included in the signaling message or included in the video data.
  • Video service delivery The video service receiving device can also determine the shunting scheme used when the video service is sent by acquiring the characteristics of the video data frame. For the scenario that supports only one shunting scheme, the video service receiving device and the video can be agreed upon. A traffic distribution scheme supported by the service transmitting device.
  • an embodiment of the present invention provides a video service sending apparatus.
  • the device implements the functions of the video service sending device in the video service transmission method of the first aspect, and thus can also implement the beneficial effects of the video service transmission method in the first aspect.
  • the functions may be implemented by hardware or by corresponding software implemented by hardware.
  • the hardware or software includes at least one module corresponding to the functions described above.
  • the video service transmitting device includes a processor and a transceiver.
  • the processor is configured to determine the importance of the data in the video data frame, and is configured to offload data in the video data frame to at least two substreams according to the mapping relationship between the importance of the data and the substream, and is further configured to correspond to the substream according to the substream.
  • the port number maps the data on the substream to the bearer corresponding to the substream; the transceiver is configured to send the data on the bearer.
  • the manner and process of determining the importance of the data in the video data frame by the processor may refer to the related description in the method embodiment of the first aspect.
  • the processor to split the data in the video data frame into the at least two substreams according to the mapping relationship between the importance of the data and the substream refer to the related description in the method embodiment of the first aspect.
  • the processor maps the data on the sub-flow to the bearer corresponding to the sub-flow according to the port number corresponding to the sub-flow, and may refer to the related description in the foregoing method embodiment of the first aspect.
  • the processor may further perform encryption processing on the substream data mapped to the bearer by using a secure transmission protocol.
  • the video service transmitting device further includes a video encoder.
  • the video encoder is used to encode the video, obtain a video data frame, and send the encoded video data frame to the processor for processing.
  • the video service transmitting device may further include a memory.
  • Memory Used to store program code and data associated with video encoders, processors, and transceivers.
  • the data stored in the memory may include a mapping relationship between the frame type and the importance of the frame, a mapping relationship between the NALU type and the importance of the NALU, a mapping relationship between the macroblock and the stripe group, and importance and sub-data of the data. At least one of the mapping relationships of the flows.
  • the video service sending device is any one of a video server, a video conferencing terminal or a video conference management server.
  • an embodiment of the present invention provides another video service sending apparatus.
  • the device implements the function of the behavior of the video service sending device in the video service transmission method of the first aspect, and thus can also implement the beneficial effects of the video service transmission method of the first aspect.
  • the functions may be implemented by hardware or by corresponding software implemented by hardware.
  • the hardware or software includes at least one module corresponding to the functions described above.
  • the video service transmitting apparatus includes a data offloading unit, a bearer mapping unit, and a communication unit.
  • the data offloading unit is configured to determine the importance of the data in the video data frame; and is configured to offload the data in the video data frame to the at least two substreams according to the mapping relationship between the importance of the data and the substream.
  • the bearer mapping unit is configured to map the data on the substream to the bearer corresponding to the subflow according to the port number corresponding to the subflow.
  • the communication unit is configured to transmit data on the bearer.
  • the manner and process of determining the importance of the data in the video data frame by the data offloading unit may refer to the related description in the method embodiment of the first aspect.
  • the manner in which the data offloading unit divides the data in the video data frame to the at least two substreams according to the mapping relationship between the importance of the data and the substream is referred to the related description in the method embodiment of the first aspect.
  • the manner in which the bearer mapping unit maps the data on the sub-flow to the bearer corresponding to the sub-flow can refer to the related description in the method embodiment of the first aspect.
  • the bearer mapping unit may further perform encryption processing on the substream data mapped to the bearer by using a secure transmission protocol.
  • the video service transmitting apparatus further includes a video encoding unit for The video is encoded to obtain a video data frame, and the encoded video data frame is sent to the data shunting unit to perform shunt processing on the data.
  • the video service transmitting apparatus may further include a flexible macroblock sorting unit for performing mapping of the macroblock to the stripe group in the video image, and transmitting the stripe group data of the video image to the video encoding unit.
  • the flexible macroblock sorting unit can extend the existing FMO encoding method to define a new macroblock to the strip.
  • a mapping mode with groups that define which types of macroblocks can be mapped into the same stripe group.
  • the video service transmitting apparatus may further include a storage unit for storing a flexible macroblock sorting unit, a video encoding unit, a data offloading unit, a bearer mapping unit, and related program codes and data in the communication unit.
  • the data stored by the storage unit may include a mapping relationship between the frame type and the importance of the frame, a mapping relationship between the NALU type and the importance of the NALU, a mapping relationship between the macroblock and the strip group, and the importance of the data. At least one of a mapping relationship with a substream.
  • the video service sending device is any one of a video server, a video conferencing terminal or a video conference management server.
  • an embodiment of the present invention provides a video service receiving apparatus.
  • the device implements the functions of the video service receiving device in the video service transmission method in the second aspect, and thus can also implement the beneficial effects of the video service transmission method in the second aspect.
  • the functions may be implemented by hardware or by corresponding software implemented by hardware.
  • the hardware or software includes at least one module corresponding to the functions described above.
  • the video service receiving device includes a processor and a transceiver.
  • the transceiver is configured to receive data on the at least two substreams from the at least two bearers.
  • the bearer corresponds to the sub-flow through the port number of the receiving end; the data on the sub-flow is obtained by dividing the video data according to the mapping relationship between the importance of the data in the video data frame and the sub-flow.
  • the processor is used to pair The data on the at least two substreams is aggregated.
  • the video service receiving apparatus further includes a video decoder for decoding the aggregated processed data to obtain a pre-encoded video.
  • the manner and process of the processor performing the aggregation processing on the data may refer to the related description in the method embodiment of the second aspect.
  • the video service receiving device is any one of a terminal, a video conference terminal, and a video conference management server.
  • an embodiment of the present invention provides another video service receiving apparatus.
  • the device implements the function of the behavior of the video service receiving device in the video service transmission method of the second aspect, and thus can also realize the beneficial effects of the video service transmission method of the second aspect.
  • the functions may be implemented by hardware or by corresponding software implemented by hardware.
  • the hardware or software includes at least one module corresponding to the functions described above.
  • the video service receiving device includes a data aggregation unit and a communication unit.
  • the communication unit is configured to receive data on the at least two substreams from the at least two bearers.
  • the bearer corresponds to the sub-flow through the port number of the receiving end; the data on the sub-flow is obtained by dividing the video data according to the mapping relationship between the importance of the data in the video data frame and the sub-flow.
  • the data aggregation unit is configured to perform aggregation processing on data from the at least two substreams.
  • the video service receiving apparatus further includes a video decoding unit, configured to decode the aggregated data to obtain a pre-encoded video.
  • the manner and process of the data aggregation unit for performing the aggregation processing on the data may refer to the related description in the method embodiment of the second aspect.
  • the video service receiving device is any one of a terminal, a video conference terminal, and a video conference management server.
  • the Radio Access Network has multiple strategies to ensure priority. Reliable transmission of data over high-performance radio bearers,
  • the specific possible design is as follows.
  • the RAN can adopt different network configuration parameters, such as adopting different Radio Link Control Acknowledged Mode (RLC) mode, and data of high importance radio bearer adopts RLC confirmation mode (Acknowledged mode).
  • RLC Radio Link Control Acknowledged Mode
  • Acknowledged mode Mode, abbreviated as AM
  • the data of the radio bearer with low importance is in the unacknowledged mode (UM)
  • UM unacknowledged mode
  • HARQ Hybrid Automatic Repeat Request
  • the data of the high-priority radio bearer is configured with a large number of HARQ retransmissions, such as 6 times, to ensure reliable transmission, and configure a smaller number of HARQ retransmissions, such as 2 times, for data of a low importance radio bearer. In this way, in the case of limited resources, reliable transmission of data of high importance can be prioritized.
  • the RAN may also adopt different scheduling policies for different radio bearers, and preferentially allocate radio resources to data of high importance radio bearers, so that in the case of limited resources, priority can be given to high importance. Reliable transmission of data.
  • the RAN can also map different radio bearers to different carriers for bearer. For example, in a carrier aggregation scenario, since the path loss of the low-frequency point carrier is smaller than the path loss of the high-frequency point carrier, the radio bearer with high importance can be mapped to the low-frequency point carrier for transmission, and the radio bearer mapping with low importance is low. Transfer to the high frequency point carrier.
  • the RAN can also map different radio bearers to different spectrum types for bearer.
  • the licensed spectrum is a spectrum resource that the operator can control, and can effectively perform interference coordination and control; the unlicensed spectrum is not controlled by the operator, and the interference and conflict are uncontrollable.
  • the bandwidth and delay of data transmission on the unlicensed spectrum cannot be guaranteed, but the use of unlicensed spectrum is an effective supplement to the data transmission of the operator because of the low cost. Therefore, the radio bearer with high importance can be mapped to the authorization.
  • the transmission is performed on the spectrum, and the radio bearers with low importance are mapped to the unlicensed spectrum for transmission.
  • FIG. 1 is a schematic diagram of a possible application scenario according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a possible system network architecture according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a process of establishing a possible video service bearer according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a frame format of a possible video data frame according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a possible video service transmission method according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a possible video data split transmission of a video data frame level according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a possible NALU level video data offloading according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of video data convergence in a possible video data offload scenario of a NALU level according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of a possible video service sending apparatus according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of another possible video service sending apparatus according to an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of a possible video service receiving apparatus according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of another possible video service receiving apparatus according to an embodiment of the present invention.
  • the embodiment of the invention describes a method and a device for transmitting a video service, and the data is shunted according to the importance of the data in the video data frame, so as to implement different processing methods for data of different importance, and to ensure high importance. Reliable transmission of data.
  • the network 102 accesses the video server 103 to obtain a video service, such as a video broadcast or video on demand service.
  • the network 102 herein may include a mobile broadband access network, such as a Long Term Evolution (LTE) or a Universal Mobile Telecommunications System (UMTS) mobile broadband access network; Network access, such as Asymmetric Digital Subscriber Line (ADSL) or Fiber To The Home (FTTH) fixed broadband access network.
  • LTE Long Term Evolution
  • UMTS Universal Mobile Telecommunications System
  • ADSL Asymmetric Digital Subscriber Line
  • FTH Fiber To The Home
  • the embodiment of the present invention can also be applied to a video conference management system, that is, at least two video conference terminals perform video communication through a video conference management system.
  • the data transmission of the video service may be as follows: the video data is uploaded from the video conference terminal to the video conference management server.
  • the video conference terminal can be regarded as a transmission device of the video service, and the video conference management server is regarded as a video.
  • the receiving device of the service; the video conference management server synthesizes the received video data from the at least two video conference terminals, and pushes the synthesized video to the corresponding video conference terminal.
  • the video conference management server can be regarded as As a video service transmitting device, a video conferencing terminal is regarded as a video service receiving device.
  • the terminal involved in the embodiment of the present invention may also be referred to as a user equipment, and may be a wireless terminal or a wired terminal.
  • the wireless terminal can be a device that provides voice and/or data connectivity to the user, a handheld device with wireless connectivity, or other processing device that is connected to the wireless modem.
  • the wireless terminal can communicate with at least one core network via a radio access network (eg, RAN, Radio Access Network).
  • the wireless terminal can be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal, for example, a portable, pocket, handheld, computer built-in or vehicle-mounted mobile device,
  • the wireless access network exchanges voice and/or data.
  • a wireless terminal may also be called a Subscriber Unit, a Subscriber Station, a Mobile Station, a Mobile Station, a Remote Station, an Access Point, and a remote terminal.
  • Terminal Remote Terminal
  • Access Terminal User Terminal
  • User Agent User Equipment
  • a wired terminal may refer to a device that provides voice and/or data connectivity to a user by means of a wired connection, such as a cable videophone or a computer with a video communication terminal function.
  • a possible system network architecture diagram of an embodiment of the present invention is provided, which mainly includes a terminal 201, an E-UTRAN NodeB (eNB) 202, and a mobility management entity (Mobility Management Entity).
  • MME Mobility Management Entity
  • S-GW Serving Gateway
  • P-GW Packet Data Network Gateway
  • PCRF Policy and Charging Rules Function
  • video server 207 video server
  • 3GPP 3rd Generation Partnership Project
  • the video server performs message interaction with the PCRF through the Rx interface; the video server 207 performs message interaction with the P-GW 205 through the SGi interface; and the P-GW 205 performs message interaction with the S-GW 204 through the S5 interface;
  • the GW 205 performs message exchange with the PCRF 206 through the Gx interface;
  • the S-GW 204 performs message exchange with the MME 203 through the S11 interface;
  • the S-GW 204 performs message exchange with the eNB 202 through the S1-U interface;
  • the MME 203 communicates with the eNB 202 through the S1-MME interface.
  • the eNB 202 performs message interaction; the eNB 202 performs message interaction with the terminal 201 through the Uu interface.
  • the network architecture and the application scenarios described in the embodiments of the present invention are for the purpose of more clearly illustrating the technical solutions of the embodiments of the present invention, and do not constitute a limitation of the technical solutions provided by the embodiments of the present invention.
  • the technical solutions provided by the embodiments of the present invention are equally applicable to similar technical problems.
  • FIG. 3 is a schematic diagram of a process of establishing a possible video service bearer according to an embodiment of the present invention.
  • the video server After receiving the service request message sent by the terminal, the video server sends an authentication authorization request (AAR) to the PCRF through the Rx interface. Message.
  • AAR authentication authorization request
  • the service request message may be a Hypertext Transfer Protocol (HTTP) acquisition (GET) request message, or may be other similar service request messages.
  • HTTP Hypertext Transfer Protocol
  • GET Hypertext Transfer Protocol acquisition
  • the AAR message includes a user IP address, an application identifier, and media description information.
  • the media description information includes a media part number, a media type, and at least one media sub-component description information.
  • the media subcomponent description includes the stream number of the media subcomponent, the port number corresponding to the stream, the media stream description, the media stream status, and the media subcomponent uplink and downlink bandwidth request.
  • the port number corresponding to the stream includes the port number of the sender and the port number of the receiver.
  • the video server preferentially ensures reliable transmission of data of high importance, and can split the data according to the mapping relationship between the importance of the data in the video data frame and the substream.
  • the video server provides a media subcomponent description for each substream in the AAR message.
  • the data stream of one video is offloaded to multiple bearers for transmission, and the data stream transmitted on each bearer may be referred to as a video data substream, referred to as a substream.
  • the mapping between the importance of the data and the substream is also the mapping between the importance of the data and the bearer.
  • Different bearers may be set up to transmit data of different importance.
  • Each bearer has different Quality of Service (QoS) attributes.
  • QoS Quality of Service
  • different bearers have different uplink and downlink bandwidth requests.
  • the mapping between the importance of the data and the sub-flow can be established according to the following method, and the data with high importance is mapped to the QoS by satisfying the data.
  • the requirements of the bearer are transmitted on the substream.
  • the data of high importance has a downlink transmission bandwidth requirement of 10 Mbps.
  • the bearer B1 is defined, and the downlink bandwidth request of the bearer is 10 Mbps.
  • the data transmitted on the sub-flow F1 is transmitted on the bearer, and the flow number of the sub-flow is 1; the data in the importance of the downlink transmission bandwidth requirement is 5 Mbps.
  • the transmission bearer B2 is defined, and the downlink bandwidth request of the bearer is 5 Mbps, and the data transmitted on the sub-flow F2 is transmitted on the bearer.
  • Flow number is 2; low importance
  • the downlink transmission bandwidth requirement is 1 Mbps.
  • the transmission bearer B3 is defined.
  • the downlink bandwidth request of the bearer is 1 Mbps.
  • the data transmitted on the sub-flow F3 is transmitted on the bearer, and the stream number of the sub-flow is 3.
  • the PCRF After receiving the AAR message, the PCRF matches the user subscription service and the QoS parameter according to the Attribute-Value Pair (AVP) in the AAR message, and then initiates a Re-Authentication Request (Re-Authentication Request) to the P-GW.
  • the RAR) message request creates at least two dedicated bearers.
  • the RAR message includes a Policy and Charging Control (PCC) rule that is sent by the PCRF to the P-GW.
  • the PCC rule includes the QoS parameter of the data flow and its value. Therefore, the PCRF allocates different PCC rules for each sub-flow and sends them to the P-GW through RAR messages.
  • the QoS parameters herein may include a QoS Class Identifier (QCI), an Allocation and Retention Priority (ARP), and an allowed uplink and downlink bit rate.
  • QCI QoS Class Identifier
  • ARP Allocation and Retention Priority
  • the P-GW parses the PCC rule carried in the RAR message, and sends at least one create bearer request message to the S-GW according to the QoS parameter and the value in the PCC rule, and initiates establishment of at least two dedicated bearers.
  • the QoS parameter is included in the Create Bearer Request message.
  • a Create Bearer Request message can create a dedicated bearer or multiple dedicated bearers at the same time.
  • the S-GW After receiving the create bearer request message, the S-GW sends a create bearer request message to the MME, and initiates establishment of at least two dedicated bearers, where the message includes the QoS parameter and its value.
  • the MME After receiving the create bearer request message, the MME allocates an unused Evolved Packet System (EPS) bearer identifier to each of the created bearer requests, and then sends a bearer setup request message to the eNB to initiate establishment of at least two A dedicated bearer, where the bearer setup request message carries an EPS bearer identifier and a session management request.
  • EPS Evolved Packet System
  • the bearer setup request message received by the MME may include at least one create bearer request; the bearer setup request message sent by the MME to the eNB may include at least one bearer setup.
  • the request, an EPS bearer identifier corresponds to an EPS bearer.
  • the MME creates a session management request, where the request includes the QoS parameters of the EPS bearer and their values. Based on the session management request, the MME initiates a bearer setup request to the eNB.
  • the eNB After receiving the bearer setup request, maps the QoS parameters of the EPS bearer to the QoS parameters of the radio bearer, and sends a Radio Resource Control (RRC) connection reconfiguration message to the terminal, and initiates establishment of at least two dedicated bearers.
  • RRC Radio Resource Control
  • the message includes a session management request and a QoS parameter of the radio bearer.
  • the terminal sends an RRC connection reconfiguration complete message to the eNB, to confirm that the radio bearer is activated.
  • the eNB sends a bearer setup response to the MME for confirming bearer activation.
  • the Non-Access Stratum (NAS) of the terminal creates a session management response including an EPS bearer identifier, and the session management response bearer is sent to the eNB in a direct transmission message.
  • NAS Non-Access Stratum
  • the eNB sends a session management response message to the MME.
  • the MME After receiving the bearer setup response message and the session management response message fed back from the eNB, the MME sends a create bearer response to the S-GW, and is used to confirm the bearer activation to the S-GW.
  • the S-GW sends a create bearer response message to the P-GW, where it is used to confirm the bearer activation to the P-GW.
  • the P-GW After receiving the bearer response, the P-GW sends a Re-Authentication Answer (RAA) message to the PCRF, indicating that the bearer is successfully established.
  • RAA Re-Authentication Answer
  • the PCRF After receiving the RAA message, the PCRF notifies the video server that the bearer establishment is completed.
  • At least two end-to-end bearers are established between the video server and the terminal for carrying data transmission of at least two video substreams.
  • the port number of the sender of the sub-flow in the media sub-component description in the 301 is identified at the transmitting end, and the port number of the receiving end of the sub-flow in the media sub-component description in 301 is identified at the receiving end.
  • the data substream transmitted on the bearer is identified by the stream number in the media subcomponent description described in 301.
  • Different bearers Different QoS parameter values may be used, so that different transmission quality guarantees can be performed on the data on the substream transmitted on the bearer, thereby ensuring reliable transmission of data of high importance.
  • At least two bearers can be established at a time. It can be understood that one bearer can be established at a time, wherein the process of establishing a bearer is similar to the process of 301-314, and then at least two processes can be established through at least two processes. Bearers.
  • the process of establishing a video service bearer described in FIG. 3 is based on the application scenario shown in FIG. 1. It can be understood that the embodiment of the present invention can also be applied to other application scenarios, and correspondingly, there are similar processes for establishing a video service bearer. For example, at least two video conference terminals perform video communication through a video conference management system as described above. Application scenario. The process of establishing a corresponding video service bearer is understood and known by those skilled in the art, and details are not described herein again.
  • the process of video service bearer setup described in FIG. 3 is based on the system network architecture shown in FIG. 2. It can be understood that the embodiment of the present invention may also adopt other system network architectures, and correspondingly, there are similar processes of video service bearer establishment.
  • the video service sending device may be a video server, a video conferencing terminal, or a video conference management server
  • the video service receiving device may be a terminal, a video conference terminal, or a video conference management server.
  • the terms of the video service transmitting device and the video service receiving device will be directly used to describe the transmission method of the video service.
  • the video service transmitting apparatus encodes the video service to obtain a video data frame.
  • the method of encoding the video may adopt H.264, and other encoding methods may also be used.
  • a video is made up of multiple images.
  • An image can be segmented into at least one slice for encoding to generate a frame of video data.
  • FIG. 4 is a schematic diagram showing a frame format of a possible video data frame according to an embodiment of the present invention.
  • one strip is composed of at least one macro block, which is a basic unit of video encoding processing.
  • a strip The data after the code is encapsulated into at least one Network Abstraction Layer Unit (NALU).
  • NALU is the basic unit of video service transmission.
  • macroblocks can adopt different predictive coding methods such as intra prediction and inter prediction, the size and importance of different macroblocks will also be different.
  • I macroblocks I macroblocks, SI macroblocks (a special intra-coded macroblock), P macroblocks, and B macroblocks are defined in H.264, where I macroblocks and SI macroblocks are used.
  • Intra prediction; P macroblocks and B macroblocks use interframe prediction.
  • the importance of different macroblocks is: I macroblock > SI macroblock > P macroblock > B macroblock.
  • the video data frames after H.264 encoding can be divided into three types according to different encoding modes: intra-coded I-frame, forward-predictive coded P-frame and bi-directional predictive coded B-frame.
  • An I frame is a frame that directly encodes the original data frame before encoding without referring to other original data frames.
  • the I frame can independently restore the data frame before encoding with its own data.
  • the P frame performs motion prediction using the latest I frame or P frame as a comparison reference, and records the difference between the frame data and the reference frame data.
  • the encoding efficiency of the P frame is high, but the reference frame data needs to be referenced to restore the data frame before encoding.
  • the B frame simultaneously performs bidirectional predictive coding with the adjacent preceding data frame and the following data frame as references. Of the three data frames, the most important is the I frame, followed by the P frame, and finally the B frame.
  • FIG. 5 is a schematic diagram of a possible transmission method of a video service according to an embodiment of the present invention.
  • the data in the video data frame may refer to the video data frame itself, or may be a data unit in the video data frame, such as a NALU.
  • the importance of the video data frame can be determined by acquiring video data.
  • the frame type of the frame; the importance of the video data frame is determined according to the mapping relationship between the frame type and the importance of the frame.
  • the frame type of the video data frame can be obtained by using information in a frame header of the video data frame.
  • the importance of the NALU in the video data frame may be determined by acquiring a NALU type of the NALU in the video data frame, and determining the importance of the NALU according to a mapping relationship between the NALU type and the importance of the NALU.
  • the NALU type of the NALU in the video data frame may be obtained by using the header information of the NALU in the video data frame.
  • the video service sending apparatus divides data in the video data frame into at least two substreams according to the mapping relationship between the importance of the data and the substream.
  • mapping relationship between the importance of the data and the sub-flow can be configured differently according to different video services.
  • the video data of the high-definition video service is mapped in three categories of importance, and the video of the standard definition video service is displayed.
  • the data is only mapped according to the importance of the two types of high and medium; it is also possible to select different mapping relationships according to different user types, for example, mapping the importance of the video data of the gold medal user to the high and low categories, and the video of the silver user.
  • the data is only mapped in terms of high and medium importance.
  • the video service sending device maps the data on the substream to the bearer corresponding to the substream according to the port number corresponding to the substream.
  • the port number may be a port number of the sending end.
  • the sub-stream data mapped to the bearer may be transmitted by using a secure transmission protocol, thereby providing security and data integrity guarantee for the service.
  • Secure Socket Layer SSL is a widely used security transmission protocol.
  • the data on the substream 1 is mapped to the bearer 1 for transmission; the data on the substream 2 is mapped to the bearer 2 for transmission; and the data on the substream 3 is mapped to the bearer 3 for transmission.
  • each substream corresponds to one bearer
  • each bearer corresponds to one media subcomponent description.
  • the media subcomponent description includes the stream number and the port number of the sender of the stream and the port number of the receiver. Therefore, the media sub-component description corresponding to the sub-flow can be determined according to the flow number of the sub-flow; the port number of the sending end in the description of the media sub-component can be further determined; and the bearer corresponding to the sub-flow is further determined by the port number of the sending end, The mapping of the substream and the bearer is completed; then the data on the substream is mapped to the bearer corresponding to the substream for transmission.
  • the network can separately control the sub-stream data with different QoS requirements, and preferentially ensure the reliable transmission of the video data with high importance.
  • the bearers corresponding to the at least two sub-flows may all adopt a Transmission Control Protocol (TCP) or a User Datagram Protocol (UDP) or a partial bearer adopts TCP, and the remaining bearers are used.
  • TCP Transmission Control Protocol
  • UDP User Datagram Protocol
  • UDP is transmitted.
  • TCP can carry 1, bear 2, bear 3 is transmitted by TCP; can also carry 1, bear 2, bear 3 are transmitted by UDP; can also carry 1 using TCP for transmission, bearer 2 and bearer 3 using UDP transmission.
  • TCP is a reliable transmission mechanism and can be used to carry video data of high importance.
  • UDP is an unreliable transport mechanism that can be used to carry video data of low importance.
  • mapping relationship between the frame type described in 501 and the importance of the frame and the mapping relationship between the NALU type and the importance of the NALU are further described below.
  • the mapping relationship between the frame type and the importance of the frame may be one-to-one or many-to-one.
  • a one-to-one mapping relationship refers to the importance of one frame type corresponding to one type of frame; and a many-to-one mapping relationship refers to the importance of at least two frame types corresponding to the same type of frame.
  • the importance of a frame can be defined as three levels: high, medium, and low.
  • the corresponding frame can be mapped to a high importance level, the P frame is mapped to a level in importance, and the B frame is mapped. To a level of low importance.
  • the I frame can be mapped to a level of importance, and both the P frame and the B frame are mapped to levels in importance.
  • mapping relationship between the frame type and the importance of the frame can be predetermined. And stored in the video service sending device, further, the mapping relationship between the frame type and the importance of the frame may be the only one, or more than one, between the frame type and the importance of the frame. In a scenario where the mapping relationship is more than one type, the video service sending apparatus may further determine which mapping relationship is specifically adopted according to the configuration parameter related to the mapping relationship.
  • the data type in the NALU is the coded stripe data partitioning block B, which mainly includes the information of the I macroblock and the SI macroblock; when the NALU type value is 4,
  • the data type in the representation NALU is a coded stripe data partition block C, which mainly includes information of a P macroblock and a B macroblock.
  • the value of the NALU type may be extended. For example, when the value of the NALU type is 24, the information indicating that the NALU mainly includes the I macroblock is defined, and the value of the NALU type is 25. Yes, indicating that the NALU mainly includes the information of the SI macroblock. When the value of the NALU type is 26, it indicates that the NALU mainly includes the P macroblock. When the NALU type is defined as 27, the NALU mainly includes the B macroblock. Information.
  • the mapping relationship between the NALU type and the importance of the NALU can be one-to-one or many-to-one.
  • the one-to-one mapping relationship refers to the importance of a NALU type corresponding to a NALU; and the many-to-one mapping relationship refers to the importance of at least two NALU types corresponding to the same NALU.
  • the importance of the NALU can be defined as three levels: high, medium, and low.
  • the corresponding NALU of type 24 can be mapped to a level of high importance, and the NALU of type 25 can be mapped to a level of importance.
  • the NALUs of types 4, 26, and 27 are mapped to levels of low importance.
  • NALUs of type 3, 24, and 25 may be mapped to levels of importance
  • NALUs of types 4, 26, and 27 may be mapped to levels of importance.
  • the above is an example of the mapping between the NALU type and the importance of the NALU by using the extended NALU type as an example. It can be understood that the mapping between the NALU type and the importance of the NALU can also be based on the existing The value of the NALU type is not detailed here.
  • mapping relationship between the NALU type and the importance of the NALU can be predetermined and stored in the video service sending apparatus. Further, the mapping relationship between the NALU type and the importance of the NALU may be the only one. Or more than one type. In a scenario where the mapping relationship between the NALU type and the importance of the NALU is more than one, the video service sending apparatus may further determine which specific to adopt according to the configuration parameter related to the mapping relationship. Mapping relationship.
  • Flexible mapping can be obtained by extending the existing Flexbile Macroblock Ordering (FMO) encoding method.
  • FMO Flexbile Macroblock Ordering
  • This function supports mapping macroblocks into different stripe groups by configuring different mapping modes. This function is before video encoding. Completed.
  • the strip group includes at least one strip in the same image.
  • a slice is an independent predictive coding unit, and a sliced macroblock cannot be predicted by referring to another sliced macroblock. When there is a problem with one strip, the other strip can also be decoded independently so that the error does not spread.
  • H.264 In the H.264 standard, seven macroblock-to-strip group mapping modes are defined, which are Interleave mode, Dispersed mode, Foreground and Background mode, and hole-shaped (Box- Out) mode, Raster Scan mode, Wipe mode, Explicit mode, the first six are standard specifications, and the seventh is user-defined.
  • FMO field-shaped
  • one NALU corresponds to one strip
  • one stripe data may include different types of macroblocks. Extending the existing FMO encoding method can be achieved as follows:
  • an I macroblock can be mapped into stripe group 1, an SI macroblock is mapped into stripe group 2, a P macroblock is mapped into stripe group 3, and a B macroblock is mapped to a stripe group 4; or, map the I macroblock and the SI macroblock into the strip group 1, the P macroblock is mapped into the strip group 2, and the B macroblock is mapped into the strip group 3; or, the I macroblock and The SI macroblock is mapped into the stripe group 1, and both the P macroblock and the B macroblock are mapped into the stripe group 2.
  • the video service transmitting apparatus may determine which specific types of macroblocks are mapped into the same stripe group according to configuration parameters related to the macroblock to stripe group mapping.
  • the data is offloaded to at least two substreams, and there may be different shunting schemes.
  • it can be:
  • the splitting of the video data frame level is: according to the mapping relationship between the importance of the video data frame and the substream, the data is divided into at least two substreams in units of video data frames.
  • FIG. 6 is a schematic diagram of a possible video data split transmission of a video data frame level according to an embodiment of the present invention. As shown in FIG. 6, the I frame is offloaded to the substream 1, the B frame is shunted to the substream 2, and the P frame is shunted to the substream 3 for transmission.
  • the header information of the video data frame in the substream includes a substream data sequence number (DSN) of the video data frame in the substream after the offloading.
  • DSN substream data sequence number
  • the original DSN of the video data frame before the offloading may also be included.
  • the original DSNs of I1, B1, P1, I2, B2, and P2 are 1, 2, 3, 4, 5, and 6, respectively; after the shunt, I1 and I2 are in the substream 1.
  • the stream DSN is 1, 2; the substream DSN of B1 and B2 in substream 2 is 1, 2; and the substream DSN of P1 and P2 in substream 3 is 1, 2.
  • the NALU level is divided into: according to the mapping relationship between the importance of the NALU and the substream in the video data frame, and the data is offloaded to at least two substreams in units of NALU.
  • FIG. 7 is a schematic diagram of a possible NALU level video data offloading according to an embodiment of the present invention.
  • data frame 1 is composed of NALU1, NALU2, and NALU3
  • data frame 2 is composed of NALU4, NALU5, and NALU6,
  • data frame 3 is composed of NALU7, NALU8, and NALU9. composition.
  • the macroblock types included in NALU1, NALU4, and NALU7 are I macroblocks and SI macroblocks
  • the macroblock types included in NALU2, NALU5, and NALU8 are P macroblocks
  • the macroblock types included in NALU3, NALU6, and NALU9 are B. Macro block.
  • NALU1, NALU4, and NALU7 are offloaded to substream 1
  • NALU2, NALU5, and NALU8 are offloaded to substream 2
  • NALU3, NALU6, and NALU9 are offloaded to substream 3.
  • the header information of the video data frame in the substream may include, in addition to the substream DSN after the splitting, the corresponding NALU of the substream data frame.
  • Original DSN Taking FIG. 7 as an example, after offloading, NALU1, NALU4, and NALU7 form data frame 1 in substream 1, and the corresponding substream DSN is 1, and NALU2, NALU5, and NALU8 form data frame 1 in substream 2, corresponding to The substream DSN is 1, NALU3, NALU6, and NALU9 form a data frame 1 in the substream 3, and the corresponding substream DSN is 1; before the offload, the original DSN of the NALU1, NALU2, and NALU3 is 1, NALU4, NALU5, NALU6 The original DSN is 2, the original DSN3 of NALU7, NALU8, and NALU9.
  • the video service sending apparatus can support at least one type of offloading scheme. Further, in a scenario where the video service sending apparatus supports more than one type of offloading scheme, the video service sending apparatus can further perform configuration parameters related to the offloading scheme. Determine which shunting scheme to use.
  • the transmission method of the video service is introduced from the perspective of the video service sending device.
  • the transmission method of the video service will be described from the perspective of the video service receiving device.
  • the video service receiving apparatus receives data on at least two substreams from at least two bearers.
  • the bearer corresponds to the sub-flow through the port number of the receiving end; the data on the sub-flow is obtained by dividing the video data according to the mapping relationship between the importance of the data in the video data frame and the sub-flow.
  • the video service receiving apparatus performs aggregation processing on data from the at least two substreams.
  • the video service receiving device corresponding to the different data offloading modes adopted in 502, the video service receiving device The aggregation process performed on the data received on the substream will also be different.
  • the convergence process can be understood as the inverse process of the 502 data offload process.
  • the video service receiving device may aggregate the data of each substream and sort according to the original DSN before the offloading, where the data exists in the form of a video data frame. of.
  • the video service receiving apparatus aggregates the video data frames I1 and I2 on the substream 1, the video data frames B1 and B2 on the substream 2, and the video data frames P1 and P2 on the substream 3.
  • the sorting result is I1, B1, P1, I2, B2, P2.
  • the video service receiving device first aggregates the data of each sub-flow, and assembles the NALU before recovering the component stream according to the original DSN before the offload corresponding to the NALU in the data.
  • the video data frame is then sorted by the original DSN for the generated video data frames.
  • FIG. 8 is a schematic diagram of video data aggregation in a possible video data offload scenario of a NALU level according to an embodiment of the present invention.
  • the original DSNs of the NALU1, NALU2, and NALU3 are all 1, and the video service receiving apparatus reassembles the NALU1 on the substream 1 and the NALU2 on the substream 2 and the NALU3 on the substream 3 to generate a video data frame 1
  • the original DSNs of NALU4, NALU5, and NALU6 are all 2
  • the video service receiving apparatus reassembles the NALU4 on the substream 1 and the NALU5 on the substream 2 and the NALU6 on the substream 3 to generate a video data frame 2;
  • the original DSN of NALU9 is 3, and the video service receiving apparatus recombines the NALU7 on the substream 1, the NALU8 on the substream 2, and the NALU9 on the substream 3 to generate the video data frame 3.
  • the video service receiving apparatus can support the convergence processing corresponding to the at least one offloading scheme.
  • the video service receiving device determines the offloading scheme used when the video service is sent before performing the convergence process. Specifically, the video service receiving apparatus may determine, by using a cell related to the offloading scheme, a traffic distribution scheme used when the video service is sent, where the traffic distribution scheme is related to The cell may be included in the signaling message or included in the video data and sent by the video service sending device to the video service receiving device.
  • the video service receiving device may also determine the shunting scheme used when the video service is sent by acquiring the characteristics of the video data frame.
  • the NALUs included in the shunted video data frames are of the same type, and the video data frame-level shunting scheme is adopted, and the shunted video data frames include various types.
  • NALU For a scenario that supports only one type of offloading scheme, a shunting scheme supported by the video service receiving device and the video service transmitting device may be agreed.
  • the aggregated video service data is decoded and processed to obtain a video before encoding.
  • the Radio Access Network For a radio bearer with different QoS requirements, the Radio Access Network (RAN) has multiple policies to ensure reliable transmission of data on a highly important radio bearer.
  • RAN Radio Access Network
  • the RAN can adopt different network configuration parameters, such as adopting different Radio Link Control Acknowledged Mode (RLC) mode, and the data of high importance radio bearer adopts RLC acknowledgement mode (AM), which is important.
  • the low-frequency radio bearer data is in the RLC unacknowledged mode (UM); or the number of retransmissions of the Hybrid Automatic Repeat Request (HARQ) is configured for the radio bearer with high importance.
  • the data is configured with a large number of HARQ retransmissions, such as 6 times, to ensure reliable transmission, and a smaller number of HARQ retransmissions, such as 2 times, for data of low importance radio bearers. In this way, in the case of limited resources, reliable transmission of data of high importance can be prioritized.
  • the RAN can also adopt different scheduling policies for different radio bearers, and preferentially allocate radio resources to data of high importance radio bearers, so that in the case of limited resources, reliable transmission of data of high importance can be preferentially ensured.
  • the RAN can also map different radio bearers to different carriers for bearer. For example, in a carrier aggregation scenario, since the path loss of the low-frequency point carrier is smaller than the path loss of the high-frequency point carrier, the radio bearer with high importance can be mapped to the low-frequency point carrier for transmission, and the radio bearer mapping with low importance is low. Transfer to the high frequency point carrier.
  • the RAN can also map different radio bearers to different spectrum types for bearer.
  • the licensed spectrum is a spectrum resource that the operator can control, and can effectively perform interference coordination and control; the unlicensed spectrum is not controlled by the operator, and the interference and conflict are uncontrollable.
  • the bandwidth and delay of data transmission on the unlicensed spectrum cannot be guaranteed, but the use of unlicensed spectrum is also an effective supplement to the operator's data transmission due to its low cost. Therefore, the radio bearer with high importance can be mapped to the licensed spectrum for transmission, and the radio bearer with low importance is mapped to the unlicensed spectrum for transmission.
  • each network element such as a terminal, a video conference terminal, an eNB, an MME, an S-GW, a P-GW, a PCRF, a video server, a video conference management server, a video service sending device, and a video service receiving device, etc.
  • the above functions include hardware structures and/or software modules corresponding to the execution of the respective functions.
  • the present invention can be implemented in a combination of computer software or hardware or a combination of hardware and computer software, in combination with the elements and steps of the various embodiments described herein.
  • FIG. 9 is a schematic structural diagram of a possible video service sending apparatus according to an embodiment of the present invention.
  • the device implements the function of the video service sending device in the video service transmission method described in FIG. 5, and thus can also realize the beneficial effects of the video service transmission method.
  • the video service sending apparatus includes a processor 902 and a transceiver 903.
  • the processor 902 is configured to determine the importance of the data in the video data frame, and is configured to offload the data in the video data frame to the at least two substreams according to the mapping relationship between the importance of the data and the substream, and also according to the substream.
  • the corresponding port number maps the data on the substream to the bearer corresponding to the substream.
  • the transceiver 903 is configured to transmit data on the bearer.
  • the video service transmitting apparatus may further include a video encoder 901.
  • the video encoder 901 is configured to encode the video, obtain a video data frame, and send the encoded video data frame to the processor 902 for processing.
  • the video service transmitting device may further include a memory 904.
  • Memory 904 is used to store associated program code and data in video encoder 901, processor 902, and transceiver 903.
  • the data stored by the memory 904 may include a mapping relationship between a frame type and a frame importance, a mapping relationship between a NALU type and an importance of a NALU, a mapping relationship between a macroblock and a stripe group, and an importance of the data. At least one of the mapping relationships of the substreams.
  • the manner and process of the processor 902 determining the importance of the data in the video data frame may be referred to the related description in section 501 of the foregoing method embodiment.
  • the manner and process of the processor 902 to offload the data in the video data frame to the at least two substreams according to the mapping relationship between the importance of the data and the substream refer to the related description in section 502 of the foregoing method embodiment.
  • the processor 902 maps the macroblocks in the video image to the stripe group, and sends the stripe group data of the video image to the video encoder 901.
  • the mapping manner and process of the specific macroblock to the stripe group may be implemented by referring to the foregoing method. A description of the 501 part of the example.
  • the processor 902 maps the data on the sub-flow to the bearer corresponding to the sub-flow according to the port number corresponding to the sub-flow, and may refer to the related description in part 503 of the foregoing method embodiment.
  • the processor 902 can also perform encryption processing on the substream data mapped to the bearer by using a secure transmission protocol.
  • the video service sending apparatus of the embodiment of the present invention implements various steps/behaviors of the method performed by the video service sending apparatus in the foregoing method embodiment, and the functions of the various components may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process thereof Reference can be made to the related description in the above method embodiments.
  • FIG. 9 only shows one design of the video service transmitting apparatus.
  • the video service transmitting apparatus may include any number of video encoders, processors, transceivers, and memories, and all video service transmitting apparatuses that can implement the embodiments of the present invention are within the scope of the present invention.
  • FIG. 10 is a schematic structural diagram of another possible video service sending apparatus according to an embodiment of the present invention.
  • the device implements the function of the video service sending device in the video service transmission method described in FIG. 5, and thus can also realize the beneficial effects of the video service transmission method.
  • the video service transmitting apparatus includes a data offloading unit 1003, a bearer mapping unit 1004, and a communication unit 1005.
  • the data offloading unit 1003 is configured to determine the importance of the data in the video data frame, and is configured to offload the data in the video data frame to the at least two substreams according to the mapping relationship between the importance of the data and the substream.
  • the bearer mapping unit 1004 is configured to map data on the substream to the bearer corresponding to the substream according to the port number corresponding to the substream.
  • the communication unit 1005 is configured to send data on the bearer.
  • the data shunting unit 1003 determines the manner and process of the importance of the data in the video data frame, and may refer to the related description in section 501 of the foregoing method embodiment.
  • the manner in which the data offloading unit 1003 splits the data in the video data frame to the at least two substreams according to the mapping relationship between the importance of the data and the substream is referred to the related description in section 502 of the foregoing method embodiment.
  • the bearer mapping unit 1004 maps the data on the sub-flow to the bearer corresponding to the sub-flow according to the port number corresponding to the sub-flow, and may refer to the related description in part 503 of the foregoing method embodiment.
  • the bearer mapping unit 1004 may also perform encryption processing on the sub-stream data mapped to the bearer by using a secure transmission protocol.
  • the video service sending apparatus may further include a video encoding unit 1002, configured to encode the video, obtain a video data frame, and send the encoded video data frame to the data offloading unit 1003 to perform a shunting process on the data.
  • a video encoding unit 1002 configured to encode the video, obtain a video data frame, and send the encoded video data frame to the data offloading unit 1003 to perform a shunting process on the data.
  • the video service sending apparatus may further include a flexible macroblock sorting unit 1001, configured to complete mapping of the macroblock to the stripe group in the video image, and send the stripe group data of the video image to the video encoding list. Yuan 1002.
  • the flexible macroblock sorting unit 1001 may extend the existing FMO encoding method to define a new macroblock to the stripe group.
  • a mapping mode that defines which types of macroblocks can be mapped into the same stripe group.
  • the video service transmitting apparatus may further include a storage unit 1006 for storing the flexible macroblock sorting unit 1001, the video encoding unit 1002, the data offloading unit 1003, the bearer mapping unit 1004, and related program codes and data in the communication unit 1005.
  • the data stored by the storage unit 1006 may include at least a mapping relationship between the frame type and the importance of the frame, a mapping relationship between the NALU type and the importance of the NALU, a mapping relationship between the macroblock and the strip group, and data. The mapping relationship between importance and subflow.
  • the video service sending apparatus of the embodiment of the present invention implements various steps/behaviors of the method performed by the video service sending apparatus in the foregoing method embodiment, and the functions of the various components may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process thereof Reference can be made to the related description in the above method embodiments.
  • FIG. 11 is a schematic structural diagram of a possible video service receiving apparatus according to an embodiment of the present invention.
  • the device implements the function of the video service receiving device in the video service transmission method described in FIG. 5, and thus can also implement the beneficial effects of the video service transmission method.
  • the video service receiving device includes a processor 1102 and a transceiver 1103.
  • the transceiver 1103 is configured to receive data on at least two substreams from at least two bearers.
  • the bearer corresponds to the sub-flow through the port number of the receiving end; the data on the sub-flow is obtained by dividing the video data according to the mapping relationship between the importance of the data in the video data frame and the sub-flow.
  • the processor 1102 is configured to perform aggregation processing on data from the at least two substreams.
  • the video service receiving apparatus may further include a video decoder 1101, configured to decode the aggregated processed data to obtain a pre-encoded video.
  • Section 505 of the method embodiment the manner and process of the processor 1102 for performing aggregation processing on the data may be referred to Section 505 of the method embodiment.
  • Figure 11 only shows one design of a video service receiving device.
  • the video service receiving device may include any number of video decoders, processors and transceivers, and all video service receiving devices that can implement the present invention are within the scope of the present invention.
  • FIG. 12 is a schematic structural diagram of another possible video service receiving apparatus according to an embodiment of the present invention.
  • the device implements the function of the video service receiving device in the video service transmission method described in FIG. 5, and thus can also implement the beneficial effects of the video service transmission method.
  • the video service receiving apparatus includes a data aggregation unit 1202 and a communication unit 1203.
  • the communication unit 1203 is configured to receive data on at least two substreams from at least two bearers.
  • the bearer corresponds to the sub-flow through the port number of the receiving end; the data on the sub-flow is obtained by dividing the video data according to the mapping relationship between the importance of the data in the video data frame and the sub-flow.
  • the data aggregation unit 1202 is configured to perform aggregation processing on data from the at least two substreams.
  • the video service receiving apparatus may further include a video decoding unit 1201, configured to decode the aggregated data to obtain a video before encoding.
  • the manner and process of the data aggregation unit 1202 for the data aggregation process may be referred to the section 505 of the foregoing method embodiment.
  • the processor for performing the functions of the video service transmitting apparatus and the video service receiving apparatus in the above embodiments of the present invention may be a central processing unit (CPU), a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC). , Field Programmable Gate Array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or perform various exemplary logical functions and modules described in connection with the present disclosure.
  • CPU central processing unit
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA Field Programmable Gate Array
  • Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program or related information from one location to another.
  • a storage medium may be any available media that can be accessed by a general purpose or special purpose computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

通信技术领域中的一种视频业务的传输方法和装置，可以根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上，并根据子流对应的端口号，将子流上的数据映射到与子流对应的承载上进行传输。由于网络能够对不同承载上的数据采用不同的处理方法，因此通过上述视频业务的传输方法和装置能够优先保证重要性高的视频数据帧的可靠传输，从而在传输资源受限场景下提升视频用户的业务体验。

Description

视频业务的传输方法和装置 技术领域
本发明涉及通信技术领域，具体涉及视频业务的传输方法和装置。
背景技术
随着移动通信和互联网行业的快速发展，视频业务正成为主流的多媒体业务。视频业务以视频文件的形式在网络中传输和存储。由于未经压缩的原始视频文件数据量非常大，传输与存储需要巨大的传输带宽和存储空间资源，因此未经压缩的原始视频文件并不适合在网络中传输与存储。为了使得视频文件在网络中能够方便地传输与存储，业界引入了视频压缩编码方法。
H.264是由国际电信联盟电信标准化部门(International Telecommunication Union-Telecommunication Standardization Sector，简称ITU-T)视频编码专家组和国际标准化组织/国际电工委员会(International Organization for Standardization/International Electrotechnical Commission，简称ISO/IEC)动态图像专家组(Moving Picture Experts Group，简称MPEG)联合组成的联合视频组提出的高压缩率的数字视频编解码器标准。
但是，采用现有技术的视频传输方案，会出现在视频业务传输过程中，尤其是传输资源受限时，对重要性高的数据无法提供更高的服务质量(Quality of Service，简称QoS)保证的问题，从而无法优先保证重要性高的数据的可靠传输。
发明内容
本发明实施例提供了一种视频业务的传输方法和装置，可以根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流 上，并根据子流对应的端口号，将子流上的数据映射到与子流对应的承载上进行传输。由于网络能够对不同承载上的数据采用不同的处理方法，因此通过本发明实施例提供的视频业务的传输方法和装置能够优先保证重要性高的视频数据帧的可靠传输，从而在传输资源受限场景下提升视频用户的业务体验。
第一方面，本发明的实施例提供了一种视频业务的传输方法，包括：确定视频数据帧中数据的重要性；根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上；根据子流对应的端口号，将子流上的数据映射到与子流对应的承载上进行传输。可选的，映射到承载上的子流数据可以采用安全传输协议进行传输。
在一个可能的设计中，确定视频数据帧中数据的重要性包括确定视频数据帧的重要性或确定视频数据帧中网络抽象层单元NALU的重要性。
在一个可能的设计中，视频数据帧的重要性可以通过以下方式确定：首先获取视频数据帧的帧类型，然后根据帧类型与帧的重要性之间的映射关系，确定视频数据帧的重要性。具体的，可以通过视频数据帧的帧头中的信息获取视频数据帧的帧类型。
在一个可能的设计中，视频数据帧中NALU的重要性可以通过以下方式确定：获取视频数据帧中的NALU的NALU类型；根据NALU类型与NALU的重要性之间的映射关系，确定NALU的重要性。具体的，可以通过视频数据帧中的NALU的头部信息获取视频数据帧中的NALU的NALU类型。
在一个可能的设计中，根据视频数据帧的重要性与子流的映射关系，以视频数据帧为单位，将数据分流到至少两个子流上。
在一个可能的设计中，根据视频数据帧中NALU的重要性与子流的映射关系，以NALU为单位，将数据分流到至少两个子流上。
在一个可能的设计中，将重要性高的数据映射到通过能满足该数据对 QoS的需求的承载进行传输的子流上，从而能够满足该数据对QoS的需求。当重要性高的数据与重要性低的数据一起在网络中传输的时候，由于重要性高的数据与重要性低的数据是在不同的承载上传输的，网络能够对重要性不同的数据采用不同的处理方法，从而能够优先保证重要性高的数据的可靠传输。
在一个可能的设计中，根据子流的流编号确定与该子流对应的媒体子部件描述；进一步可以确定该媒体子部件描述中的发送端的端口号；进一步通过发送端的端口号确定与此子流对应的承载；然后将子流上的数据映射到与所述子流对应的承载上进行传输。
在一个可能的设计中，不同子流对应的承载可以都采用传输控制协议(Transmission Control Protocol，简称TCP)或都采用用户数据报协议(User Datagram Protocol，简称UDP)或部分承载采用TCP、其余承载采用UDP进行传输。其中TCP是可靠传输机制，可以用于承载重要性高的视频数据，UDP是不可靠传输机制，可以用于承载重要性低的视频数据。
在一个可能的设计中，以视频数据帧为单位对数据进行分流后，子流中的视频数据帧的包头信息中除了包括分流之后的子流中的视频数据帧的子流数据序列号(Data Sequence Number，简称DSN)之外，还可以包括分流之前的视频数据帧的原始DSN。
在一个可能的设计中，对现有的灵活宏块排序(Flexbile Macroblock Ordering，简称FMO)编码方法进行扩展，定义一种新的宏块到条带组的映射模式，该映射模式可以定义哪些类型的宏块映射到相同的条带组中，从而能够将重要性高的宏块映射到一个条带组中，而同一个条带组的数据编码后生成相同类型的NALU，进一步可以将相同类型的NALU映射到同一个子流对应的承载上进行传输，从而可以达到重要性高的宏块优先得到可靠传输的目的。
在一个可能的设计中，以NALU为单位对数据进行分流后，子流数据 帧的包头信息除了包括分流之后的子流DSN之外，还可以包括子流数据帧中每个NALU所对应的原始DSN。
在一个可能的设计中，视频业务发送装置可以支持至少一种分流方案，进一步地，在视频业务发送装置支持多于一种分流方案的场景下，视频业务发送装置可以进一步根据与分流方案相关的配置参数确定具体采用哪种分流方案。
第二方面，本发明的实施例提供了另一种视频业务的传输方法，包括，视频业务接收装置从至少两个承载上接收至少两个子流上的数据，其中，承载是通过接收端的端口号与子流对应的；子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的；视频业务接收装置然后对来自所述至少两个子流上的数据进行汇聚处理。所述方法用于接收上述第一方面视频业务传输方法中视频业务发送装置发出的视频数据，因此也能实现第一方面视频业务传输方法所具备的有益效果。
在一个可能的设计中，对应第一方面中视频业务发送装置采用的不同的数据分流方式，视频业务接收装置对接收到的子流上的数据所做的汇聚处理也会有所不同。如果视频业务发送装置采用的是视频数据帧级别的分流，那么视频业务接收装置可以将各个子流的数据汇聚在一起，并按照分流之前的原始DSN进行排序。如果视频业务发送装置采用的是NALU级别的分流，那么视频业务接收装置首先将各个子流的数据汇聚在一起，根据数据中的NALU所对应的分流之前的原始DSN，把所述NALU组装恢复成分流之前的视频数据帧，然后对生成的视频数据帧按照原始DSN进行排序。
在一个可能的设计中，视频业务接收装置可以支持至少一种分流方案所对应的接收处理。视频业务接收装置在进行汇聚处理之前，确定视频业务发送时所采用的分流方案。具体的，视频业务接收装置可以通过与分流方案相关的信元确定视频业务发送时所采用的分流方案，所述与分流方案相关的信元可以包含在信令消息中或包含在视频数据中由视频业务发送装 置发给视频业务接收装置，视频业务接收装置也可以通过获取视频数据帧的特点确定视频业务发送时所采用的分流方案；对于仅支持一种分流方案的场景，可以约定视频业务接收装置与视频业务发送装置所支持的分流方案。
第三方面，本发明的实施例提供了一种视频业务发送装置。所述装置实现上述第一方面视频业务传输方法中视频业务发送装置的功能，因此也能实现第一方面视频业务传输方法所具备的有益效果。所述功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。所述硬件或软件包括至少一个与上述功能相对应的模块。
在一个可能的设计中，视频业务发送装置包括处理器和收发器。其中处理器用于确定视频数据帧中数据的重要性，并用于根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上，还用于根据子流对应的端口号，将子流上的数据映射到与该子流对应的承载上；收发器用于发送所述承载上的数据。
具体的，处理器确定视频数据帧中数据的重要性的方式和过程，可以参考第一方面方法实施例中的相关描述。处理器根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上的方式和过程，可以参考第一方面方法实施例中的相关描述。
具体的，处理器根据子流对应的端口号，将子流上的数据映射到与所述子流对应的承载上的方式和过程，可以参考上述第一方面方法实施例中的相关描述。处理器还可以对映射到上述承载上的子流数据采用安全传输协议进行加密处理。
在一个可能的设计中，视频业务发送装置还包括视频编码器。视频编码器用于对视频进行编码，得到视频数据帧，并将编码后的视频数据帧发给处理器进行处理。
在一个可能的设计中，视频业务发送装置还可以包括存储器。存储器 用于存储视频编码器，处理器和收发器中相关的程序代码和数据。其中，存储器存储的数据可以包括帧类型与帧的重要性之间的映射关系、NALU类型与NALU的重要性之间的映射关系、宏块到条带组的映射关系以及数据的重要性与子流的映射关系中的至少一种。
在一个可能的设计中，视频业务发送装置为视频服务器，视频会议终端或视频会议管理服务器中的任意一种。
第四方面，本发明的实施例提供了另一种视频业务发送装置。所述装置实现上述第一方面视频业务传输方法中视频业务发送装置行为的功能，因此也能实现第一方面视频业务传输方法所具备的有益效果。所述功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。所述硬件或软件包括至少一个与上述功能相对应的模块。
在一个可能的设计中，视频业务发送装置包括数据分流单元，承载映射单元以及通信单元。数据分流单元用于确定视频数据帧中数据的重要性；并用于根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上。承载映射单元用于根据子流对应的端口号，将子流上的数据映射到与该子流对应的承载上。通信单元用于发送所述承载上的数据。
具体的，数据分流单元确定视频数据帧中数据的重要性的方式和过程，可以参考第一方面方法实施例中的相关描述。数据分流单元根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上的方式和过程，可以参考第一方面方法实施例中的相关描述。
具体的，承载映射单元将子流上的数据映射到与所述子流对应的承载上的方式和过程，可以参考第一方面方法实施例中的相关描述。承载映射单元还可以对映射到上述承载上的子流数据采用安全传输协议进行加密处理。
在一个可能的设计中，视频业务发送装置还包括视频编码单元，用于 对视频进行编码，得到视频数据帧，并将编码后的视频数据帧发给数据分流单元对数据进行分流处理。
在一个可能的设计中，视频业务发送装置还可以包括灵活宏块排序单元，用于完成视频图像中宏块到条带组的映射，并将视频图像的条带组数据发给视频编码单元。
在一个可能的设计中，对于NALU级别的数据分流方案，会存在宏块到NALU的灵活映射，灵活宏块排序单元可以对现有的FMO编码方法进行扩展，定义一种新的宏块到条带组的映射模式，该映射模式可以定义哪些类型的宏块可以映射到相同的条带组中。
在一个可能的设计中，视频业务发送装置还可以包括存储单元，存储单元用于存储灵活宏块排序单元、视频编码单元，数据分流单元，承载映射单元以及通信单元中相关的程序代码和数据。其中，存储单元所存储的数据可以包括帧类型与帧的重要性之间的映射关系、NALU类型与NALU的重要性之间的映射关系、宏块到条带组的映射关系以及数据的重要性与子流的映射关系中的至少一种。
在一个可能的设计中，视频业务发送装置为视频服务器，视频会议终端或视频会议管理服务器中的任意一种。
第五方面，本发明的实施例提供了一种视频业务接收装置。所述装置实现上述第二方面视频业务传输方法中视频业务接收装置的功能，因此也能实现第二方面视频业务传输方法所具备的有益效果。所述功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。所述硬件或软件包括至少一个与上述功能相对应的模块。
在一个可能的设计中，视频业务接收装置包括处理器和收发器。收发器用于从至少两个承载上接收至少两个子流上的数据。其中，承载是通过接收端的端口号与子流对应的；子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的。处理器用于对来自 所述至少两个子流上的数据进行汇聚处理。
在一个可能的设计中，视频业务接收装置还包括视频解码器，用于对所述汇聚处理后的数据进行解码，得到编码前的视频。
具体的，处理器对数据进行汇聚处理的方式和过程，可以参考第二方面方法实施例中的相关描述。
在一个可能的设计中，视频业务接收装置为终端，视频会议终端和视频会议管理服务器中的任意一种。
第六方面，本发明的实施例提供了另一种视频业务接收装置。所述装置实现上述第二方面视频业务传输方法中视频业务接收装置行为的功能，因此也能实现第二方面视频业务传输方法所具备的有益效果。所述功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。所述硬件或软件包括至少一个与上述功能相对应的模块。
在一个可能的设计中，视频业务接收装置包括数据汇聚单元和通信单元。通信单元用于从至少两个承载上接收至少两个子流上的数据。其中，承载是通过接收端的端口号与子流对应的；子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的。数据汇聚单元用于对来自所述至少两个子流上的数据进行汇聚处理。
在一个可能的设计中，视频业务接收装置还包括视频解码单元，用于对所述汇聚处理后的数据进行解码，得到编码前的视频。
具体的，数据汇聚单元对数据进行汇聚处理的方式和过程，可以参考第二方面方法实施例中的相关描述。
在一个可能的设计中，视频业务接收装置为终端，视频会议终端和视频会议管理服务器中的任意一种。
针对上述第一方面到第六方面的实施例，对于有不同服务质量(Quality of Service，简称QoS)要求的无线承载，无线接入网(Radio Access Network，简称RAN)有多种策略优先保证重要性高的无线承载上的数据的可靠传输， 具体的可能的设计如下。
在一个可能的设计中，RAN可以采用不同的网络配置参数，如采用不同的无线链路控制(Radio Link Control Acknowledged Mode，简称RLC)模式，重要性高的无线承载的数据采用RLC确认模式(Acknowledged Mode，简称AM)，重要性低的无线承载的数据采用RLC非确认模式(Unacknowledged Mode，简称UM)；或者配置不同混合自动重传请求(Hybrid Automatic Repeat Request，简称HARQ)的重传次数，对于重要性高的无线承载的数据配置较大的HARQ重传次数，如6次，确保其可靠传输，对于重要性低的无线承载的数据配置较小的HARQ重传次数，如2次。这样在资源有限的情况下，可以优先保证重要性高的数据的可靠传输。
在一个可能的设计中，RAN也可以对不同的无线承载采用不同的调度策略，优先给重要性高的无线承载的数据分配无线资源，这样在资源有限的情况下，可以优先保证重要性高的数据的可靠传输。
在一个可能的设计中，RAN也可以把不同的无线承载映射到不同的载波上进行承载。比如在载波聚合场景下，由于低频点载波的路损比高频点载波的路损小，因此可以将重要性高的无线承载映射到低频点载波上进行传输，而重要性低的无线承载映射到高频点载波上进行传输。
在一个可能的设计中，RAN也可以把不同的无线承载映射到不同的频谱类型上进行承载。授权频谱是运营商可以控制的频谱资源，能有效的进行干扰协调和控制；而非授权频谱则不受运营商控制，其干扰和冲突不可控。在非授权频谱上进行数据传输其带宽和时延都无法保证，但非授权频谱的使用由于成本低廉，也是运营商数据传输的一个有效补充，因此，可以将重要性高的无线承载映射到授权频谱上进行传输，重要性低的无线承载映射到非授权频谱上进行传输。
附图说明
为了更清楚地说明本发明实施例的技术方案，下面将对本发明实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例的一种可能的应用场景示意图；
图2为本发明实施例的一种可能的系统网络架构示意图；
图3为本发明实施例的一种可能的视频业务承载建立的过程示意图；
图4为本发明实施例的一种可能的视频数据帧的帧格式示意图；
图5为本发明实施例的一种可能的视频业务传输方法示意图；
图6为本发明实施例的一种可能的视频数据帧级别的视频数据分流传输示意图；
图7为本发明实施例的一种可能的NALU级别的视频数据分流示意图；
图8为本发明实施例的一种可能的NALU级别的视频数据分流场景下的视频数据汇聚示意图；
图9为本发明实施例的一种可能的视频业务发送装置的结构示意图；
图10为本发明实施例的另一种可能的视频业务发送装置的结构示意图；
图11为本发明实施例的一种可能的视频业务接收装置的结构示意图；
图12为本发明实施例的另一种可能的视频业务接收装置的结构示意图。
具体实施方式
本发明实施例描述了一种视频业务的传输方法和装置，根据视频数据帧中数据的重要性对数据进行分流，以实现对重要性不同的数据采用不同的处理方法，优先保证重要性高的数据的可靠传输。
如图1所示，是本发明实施例的一种可能的应用场景，终端101通过 网络102访问视频服务器103，获得视频服务，如视频广播或视频点播服务。这里的网络102可以包括移动宽带接入网，如长期演进(Long Term Evolution，简称LTE)或通用移动通信系统(Universal Mobile Telecommunications System，简称UMTS)等移动宽带接入网；也可以包括固定宽带接入网，如非对称数字用户线路(Asymmetric Digital Subscriber Line，简称ADSL)或光纤到户(Fiber To The Home，简称FTTH)等固定宽带接入网。在这个场景中，可以将视频服务器103视作视频业务的发送装置，终端101视作视频业务的接收装置。
此外，本发明实施例还可以应用于视频会议管理系统中，即至少两个视频会议终端通过视频会议管理系统进行视频通信。相应地，视频业务的数据传输可能会存在以下情况：视频数据从视频会议终端上传到视频会议管理服务器，此时，可以将视频会议终端视作视频业务的发送装置，视频会议管理服务器视作视频业务的接收装置；视频会议管理服务器对接收到的来自至少两个视频会议终端的视频数据进行合成，将合成后的视频推送到对应的视频会议终端上，此时，可以将视频会议管理服务器视作视频业务发送装置，视频会议终端视作视频业务接收装置。
本发明实施例中涉及的终端，也可以称作用户设备，可以是无线终端，也可以是有线终端。无线终端可以是指向用户提供语音和/或数据连通性的设备，具有无线连接功能的手持式设备、或连接到无线调制解调器的其它处理设备。无线终端可以经无线接入网(例如，RAN，Radio Access Network)与至少一个核心网进行通信。无线终端可以是移动终端，如移动电话(或称为“蜂窝”电话)和带有移动终端的计算机，例如，可以是便携式、袖珍式、手持式、计算机内置的或者车载的移动装置，它们与无线接入网交换语音和/或数据。无线终端也可以称为用户单元(Subscriber Unit)、用户站(Subscriber Station)，移动站(Mobile Station)、移动台(Mobile Station)、远程站(Remote Station)、接入点(Access Point)、远程终端(Remote  Terminal)、接入终端(Access Terminal)、用户终端(User Terminal)、用户代理(User Agent)或用户设备(User Equipment)。有线终端可以是指通过有线连接的方式向用户提供语音和/或数据连通性的设备，如有线视频电话机或带有视频通信终端功能的计算机等。
如图2所示，提供了本发明实施例的一种可能的系统网络架构示意图，主要包括终端201、演进型网络基站(E-UTRAN NodeB，简称eNB)202、移动性管理实体(Mobility Management Entity，简称MME)203、服务网关(Serving Gateway，简称S-GW)204、分组数据网关(Packet Data Network Gateway，简称P-GW)205、策略与计费规则功能单元(Policy and Charging Rules Function，简称PCRF)206和视频服务器207。上述各个网元的功能、相互之间的接口以及信令流程的详细描述可以参考第三代合作伙伴计划(3rd Generation Partnership Project，简称3GPP)协议，例如TS 23.401 v13.4.0。如图3所示，视频服务器通过Rx接口与PCRF进行消息交互；视频服务器207通过SGi接口与P-GW 205进行消息交互；P-GW 205通过S5接口与S-GW 204进行消息交互；P-GW 205通过Gx接口与PCRF 206进行消息交互；S-GW 204通过S11接口与MME 203进行消息交互；S-GW 204通过S1-U接口与eNB 202进行消息交互；MME 203通过S1-MME接口与eNB 202进行消息交互；eNB 202通过Uu接口与终端201进行消息交互。
本发明实施例描述的网络架构以及应用场景是为了更加清楚的说明本发明实施例的技术方案，并不构成对于本发明实施例提供的技术方案的限定，本领域普通技术人员可知，随着网络架构的演变和新应用场景的出现，本发明实施例提供的技术方案对于类似的技术问题，同样适用。
可以理解的是，视频业务的传输是基于承载的，图3是本发明实施例的一种可能的视频业务承载建立的过程示意图。
301，视频服务器收到终端发出的业务请求消息后，通过Rx接口向PCRF发送认证授权请求(authentication authorization request，简称AAR) 消息。
其中，业务请求消息可以是超文本传输协议(Hypertext Transfer Protocol，简称HTTP)获取(GET)请求消息，也可以是其它类似的业务请求消息。
其中，AAR消息中包括用户IP地址、应用标识、媒体描述信息等。媒体描述信息中包括媒体部件编号、媒体类型及至少一个媒体子部件描述信息等。媒体子部件描述中包括媒体子部件的流编号、流对应的端口号、媒体流描述、媒体流状态、媒体子部件上下行带宽申请。其中，流对应的端口号包括发送端的端口号以及接收端的端口号。
视频服务器为了便于网络能够对重要性不同的数据进行不同的传输质量保证，优先保证重要性高的数据的可靠传输，可以根据视频数据帧中数据的重要性与子流的映射关系，将数据分流到至少两个子流上。为了建立子流所对应的承载，视频服务器会在AAR消息中为每个子流提供一个媒体子部件描述。此处，一个视频的数据流被分流到多个承载上进行传输，每个承载上传输的数据流可以称为视频数据子流，简称子流。
这里的数据的重要性与子流的映射关系也就是数据的重要性与承载的映射关系。为了传输具有不同重要性的数据可以分别建立不同的承载，每个承载具有不同的服务质量(Quality of Service，简称QoS)属性，例如不同承载具有不同的上下行带宽申请。例如，为了传输数据重要性分别为高、中、低的三类数据，可以按照如下方法建立数据的重要性与子流的映射关系，将重要性高的数据映射到通过能满足该数据对QoS的需求的承载进行传输的子流上。例如，重要性高的数据对下行的传输带宽需求为10Mbps，为此定义承载B1，该承载的下行带宽申请为10Mbps，该承载上传输的是子流F1上的数据，该子流的流编号为1；重要性中的数据对下行的传输带宽需求为5Mbps，为此定义传输承载B2，该承载的下行带宽申请为5Mbps，该承载上传输的是子流F2上的数据，该子流的流编号为2；重要性低的数 据对下行的传输带宽需求为1Mbps，为此定义传输承载B3，该承载的下行带宽申请为1Mbps，该承载上传输的是子流F3上的数据，该子流的流编号为3。
302，PCRF收到AAR消息后，根据AAR消息里的属性值对(Attribute-Value Pair，简称AVP)匹配用户签约业务以及QoS参数，然后向P-GW发起重认证请求(Re-Authentication Request，简称RAR)消息申请创建至少两个专用承载。
其中，RAR消息中包括PCRF下发给P-GW的策略与计费控制(Policy and Charging Control，简称PCC)规则，PCC规则中包括数据流的QoS参数及其取值。因此PCRF会为每个子流分配不同的PCC规则，并通过RAR消息发送给P-GW。其中，此处的QoS参数可以包括QoS分类识别码(QoS Class Identifier，简称QCI)、分配保持优先级(Allocation and Retention Priority，简称ARP)以及所允许的上下行比特速率。
303，P-GW解析RAR消息中携带的PCC规则，根据PCC规则中的QoS参数及其取值，向S-GW发送至少一条创建承载请求消息，发起建立至少两个专用承载。
其中，创建承载请求消息中包括QoS参数；一条创建承载请求消息可以创建一个专用承载，也可以同时创建多个专用承载。
304，S-GW收到创建承载请求消息后，发送创建承载请求消息至MME，发起建立至少两个专用承载，消息中包括QoS参数及其取值。
305，MME收到创建承载请求消息后，对每个创建承载请求分别分配一个未使用的演进分组系统(Evolved Packet System，简称EPS)承载标识，然后向eNB发送承载建立请求消息发起建立至少两个专用承载，该承载建立请求消息中携带EPS承载标识以及会话管理请求。
其中，MME收到的创建承载请求消息可以包含至少一个创建承载请求；MME向eNB发送的承载建立请求消息中可以包含至少一个承载建立 请求，一个EPS承载标识对应一个EPS承载。在分配EPS承载标识后，MME会创建一个会话管理请求，该请求中包括EPS承载的QoS参数及其取值。基于该会话管理请求，MME会向eNB发起承载建立请求。
306，eNB收到承载建立请求后，将EPS承载的QoS参数映射为无线承载的QoS参数，向终端发送无线资源控制(Radio Resource Control，简称RRC)连接重配置消息，发起建立至少两个专用承载，该消息中包括会话管理请求以及无线承载的QoS参数。
307，终端向eNB发送RRC连接重配置完成消息，用于确认无线承载激活。
308，eNB向MME发送承载建立响应用于确认承载激活。
309，终端的非接入层(Non-Access Stratum，简称NAS)创建一个包括EPS承载标识的会话管理响应，该会话管理响应承载在直传消息中发给eNB。
310，eNB发送会话管理响应消息给MME。
311，MME收到来自eNB反馈的承载建立响应消息和会话管理响应消息后，发送创建承载响应给S-GW，用于向S-GW确认承载激活。
312，S-GW向P-GW发送创建承载响应消息，用于向P-GW确认承载激活。
313，P-GW收到创建承载响应后，向PCRF发送重认证应答(Re-Authentication Answer，简称RAA)消息，指示承载建立成功。
314，PCRF收到RAA消息后，通知视频服务器承载建立完成。
经过上述步骤后，视频服务器与终端之间建立了至少两个端到端的承载用于承载至少两个视频子流的数据传输。所述承载通过301中的媒体子部件描述中的子流的发送端的端口号在发送端标识，通过301中的媒体子部件描述中的子流的接收端的端口号在接收端标识。所述承载上传输的数据子流通过301中所述的媒体子部件描述中的流编号来标识。不同的承载 可以有不同的QoS参数取值，从而能够对该承载上传输的子流上的数据进行不同的传输质量保证，进而能够优先保证重要性高的数据的可靠传输。
上述流程中可以一次建立至少两个承载，可以理解的是，也可以一次建立一个承载，其中，建立一个承载的流程与301-314的流程类似，那么，进一步可以通过至少两次流程建立至少两个承载。
图3描述的视频业务承载建立的过程是基于图1所示的应用场景的。可以理解的是，本发明实施例也可以应用于其它应用场景，对应的也有类似的视频业务承载建立的过程，例如，如前所述的至少两个视频会议终端通过视频会议管理系统进行视频通信的应用场景。对应的视频业务承载建立的过程，是本领域技术人员能够理解和所熟知的，在此不再赘述。
图3描述的视频业务承载建立的过程是基于图2所示的系统网络架构的。可以理解的是，本发明实施例也可以采用其它系统网络架构，对应的也有类似的视频业务承载建立的过程。
为了方便说明和更容易理解，上面描述应用场景、网络架构以及承载建立过程的时候是以具体的视频业务发送装置和视频业务接收装置来进行描述的。例如，视频业务发送装置可以是视频服务器、视频会议终端或视频会议管理服务器；视频业务接收装置可以是终端、视频会议终端或视频会议管理服务器。下面将直接使用视频业务发送装置和视频业务接收装置这两个术语来描述视频业务的传输方法。
如前所述，视频业务发送装置对视频业务进行编码，得到视频数据帧。其中，对视频进行编码的方法可以采用H.264，也可以采用其它的编码方法。下面以H.264编码方法为例进行描述。
一个视频是由多幅图像构成的。一幅图像可以分割成至少一个条带(Slice)进行编码，生成一个视频数据帧。图4给出了本发明实施例的一种可能的视频数据帧的帧格式示意图。如图4所示，一个条带由至少一个宏块(macro block)组成，宏块是视频编码处理的基本单元。一个条带编 码之后的数据被封装到至少一个网络抽象层单元(Network Abstraction Layer Unit，简称NALU)中。NALU是视频业务传输的基本单位。
由于宏块可以采用帧内预测、帧间预测等不同的预测编码方式，因此不同宏块的大小和重要性也会有所不同。H.264中定义了四种类型的宏块，I宏块、SI宏块(一种特殊的帧内编码宏块)、P宏块、B宏块，其中，I宏块和SI宏块采用帧内预测；P宏块和B宏块采用帧间预测。不同宏块的重要性依次为：I宏块>SI宏块>P宏块>B宏块。
H.264编码之后的视频数据帧可以根据编码方式不同分为三种：帧内编码I帧，前向预测编码P帧和双向预测编码B帧。I帧是对编码之前的原始数据帧直接进行帧内编码，不参考其它原始数据帧的信息。I帧可以仅用自身的数据就能独立还原编码之前的数据帧。P帧用最近的I帧或P帧作为比较基准进行运动预测，记录这帧数据与基准帧数据之间的差异。P帧的编码效率较高，但需要参考基准帧数据才能还原出编码之前的数据帧。B帧同时用相邻的前面的数据帧和后面的数据帧作为参考进行双向预测编码。这三种数据帧中，最重要的是I帧，其次是P帧，最后是B帧。
上面所述的宏块和视频数据帧的分类以及宏块和视频数据帧的重要性排序都是基于当前H.264视频编码标准中定义的来描述的，这些只是本发明的实施例的一个具体示例。可以理解的是，本发明实施例并不限定宏块和视频数据帧的分类以及重要性排序关系。
视频业务的承载建立完成后，视频业务发送装置可以在建好的承载上将视频业务传输给视频业务接收装置。图5给出了本发明实施例的一种可能的视频业务的传输方法示意图。
501，确定视频数据帧中数据的重要性。
此处，视频数据帧中的数据可以是指视频数据帧本身，也可以是视频数据帧中的数据单元，例如NALU。
具体的，视频数据帧的重要性可以通过以下方式确定：获取视频数据 帧的帧类型；根据帧类型与帧的重要性之间的映射关系，确定视频数据帧的重要性。具体的，可以通过视频数据帧的帧头中的信息获取视频数据帧的帧类型。
具体的，视频数据帧中NALU的重要性可以通过以下方式确定：获取视频数据帧中的NALU的NALU类型；根据NALU类型与NALU的重要性之间的映射关系，确定NALU的重要性。具体的，可以通过视频数据帧中的NALU的头部信息获取视频数据帧中的NALU的NALU类型。
502，视频业务发送装置根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上。
其中，数据的重要性与子流的映射关系的描述可以参考前面实施例的相关描述。
可以理解的是，数据的重要性与子流的映射关系可以根据不同的视频业务进行不同的配置，例如，高清视频业务的视频数据分高中低三类重要性进行映射，而标清视频业务的视频数据则只分高和中两类重要性进行映射；还可以根据不同的用户类型选择不同的映射关系，例如对金牌用户的视频数据分高中低三类重要性进行映射，而对银牌用户的视频数据则只分高和中两类重要性进行映射。
503：视频业务发送装置根据子流对应的端口号，将子流上的数据映射到与所述子流对应的承载上进行传输。
其中，所述端口号可以是发送端的端口号。
可选地，映射到承载上的子流数据可以采用安全传输协议进行传输，从而可以给业务提供安全以及数据完整性的保障。安全套接层(Secure Socket Layer，简称SSL)是当前应用比较广泛的一种安全传输协议。
如图6所示，子流1上的数据映射到承载1上进行传输；子流2上的数据映射到承载2上进行传输；子流3上的数据映射到承载3上进行传输。
在301中，每个子流对应一个承载，每个承载对应一个媒体子部件描 述，媒体子部件描述中包括流编号以及流的发送端的端口号和接收端的端口号。因此可以根据子流的流编号确定与该子流对应的媒体子部件描述；进一步可以确定该媒体子部件描述中的发送端的端口号；进一步通过发送端的端口号确定与此子流对应的承载，完成子流与承载的映射；然后将子流上的数据映射到与所述子流对应的承载上进行传输。
由于具有不同QoS需求的子流上的数据是在不同的承载上进行传输的，因此网络可以对这些具有不同QoS需求的子流数据分别进行控制，优先保证重要性高的视频数据的可靠传输。
进一步地，与至少两个子流所对应的承载可以都采用传输控制协议(Transmission Control Protocol，简称TCP)或都采用用户数据报协议(User Datagram Protocol，简称UDP)或部分承载采用TCP、其余承载采用UDP进行传输。例如，可以承载1，承载2，承载3都采用TCP进行传输；也可以承载1、承载2、承载3都采用UDP进行传输；也可以承载1采用TCP进行传输，承载2和承载3采用UDP进行传输。其中TCP是可靠传输机制，可以用于承载重要性高的视频数据。UDP是不可靠传输机制，可以用于承载重要性低的视频数据。
下面对501中描述的帧类型与帧的重要性之间的映射关系以及NALU类型与NALU的重要性之间的映射关系进行进一步的描述。
帧类型与帧的重要性之间的映射关系，可以是一对一的，也可以是多对一的。一对一的映射关系是指一种帧类型对应一种帧的重要性；而多对一的映射关系是指至少两种帧类型对应同一种帧的重要性。例如，可以将帧的重要性定义成高、中、低三个级别，对应的可以将I帧映射到重要性高的级别中，将P帧映射到重要性中的级别中，将B帧映射到重要性低的级别中。或者，也可以将I帧映射到重要性高的级别中，将P帧和B帧都映射到重要性中的级别中。
可以理解的是，帧类型与帧的重要性之间的映射关系可以预先确定， 并存储在视频业务发送装置中，进一步地，帧类型与帧的重要性之间的映射关系可能是唯一的一种，也可能是多于一种，在帧类型与帧的重要性之间的映射关系是多于一种的场景下，视频业务发送装置可以进一步根据与映射关系相关的配置参数确定具体采用哪种映射关系。
在H.264标准中，NALU类型取值为3时，表示NALU中的数据类型是编码条带数据分割块B，主要包括I宏块和SI宏块的信息；NALU类型取值为4时，表示NALU中的数据类型是编码条带数据分割块C，主要包括P宏块和B宏块的信息。
为了更灵活的定义NALU中包含的数据类型，可以对NALU类型取值进行扩展，例如，定义NALU类型取值为24时，表示NALU中主要包括I宏块的信息，定义NALU类型取值为25是，表示NALU中主要包括SI宏块的信息，定义NALU类型取值为26时，表示NALU中主要包括P宏块的信息，定义NALU类型取值为27时，表示NALU中主要包括B宏块的信息。
NALU类型与NALU的重要性之间的映射关系可以是一对一的，也可以是多对一的。其中，一对一的映射关系是指一种NALU类型对应一种NALU的重要性；而多对一的映射关系是指至少两种NALU类型对应同一种NALU的重要性。例如，可以将NALU的重要性定义成高、中、低三个级别，对应的可以将类型为24的NALU映射到重要性高的级别中，将类型为25的NALU映射到重要性中的级别中，将类型为4，26和27的NALU映射到重要性低的级别中。或者，也可以将类型为3，24和25的NALU映射到重要性高的级别中，将类型为4，26和27的NALU映射到重要性中的级别中。以上是以扩展后的NALU类型取值为例对NALU类型与NALU的重要性之间的映射关系进行举例说明，可以理解的是，NALU类型与NALU的重要性之间的映射也可以基于现有的NALU类型取值，此处不再详细举例。
可以理解的是，NALU类型与NALU的重要性之间的映射关系可以预先确定，并存储在视频业务发送装置中，进一步地，NALU类型与NALU的重要性之间的映射关系可能是唯一的一种，也可能是多于一种，在NALU类型与NALU的重要性之间的映射关系是多于一种的场景下，视频业务发送装置可以进一步根据与映射关系相关的配置参数确定具体采用哪种映射关系。
上述对NALU类型取值的扩展，可以在宏块到NALU的灵活映射场景下实现。灵活映射可以通过对现有的灵活宏块排序(Flexbile Macroblock Ordering，简称FMO)编码方法进行扩展获得。FMO是H.264标准为了提高视频业务传输的抗误码性能而提供的一个功能，该功能支持通过配置不同的映射模式将宏块映射到不同的条带组中，该功能是在视频编码之前完成的。条带组包括同一幅图像中的至少一个条带。条带是一个独立的预测编码单元，一个条带的宏块不能参考另一个条带的宏块来进行预测。当一个条带出现问题时，另一个条带还可以独立解码，这样就不会导致误差扩散。
在H.264标准中，定义了七种宏块到条带组的映射模式，依次为交织(Interleave)模式、分散(Dispersed)模式、前景和背景(Foreground and Background)模式、留孔(Box-out)模式、光栅扫描(Raster Scan)模式、手绢(Wipe)模式、显式控制(Explicit)模式，其中前六种是标准规定的，第七种是用户自定义的。关于FMO的详细描述可以参考《H.264 and MPEG-4 video compression》。
如图4所示，一个NALU对应一个条带，一个条带数据中可能包括不同类型的宏块。对现有的FMO编码方法进行扩展可以通过如下方式实现：
定义一种新的宏块到条带组的映射模式，该映射模式可以定义哪些类型的宏块映射到相同的条带组中。例如，可以将I宏块映射到条带组1中，SI宏块映射到条带组2中，P宏块映射到条带组3中，B宏块映射到条带组 4中；或者，将I宏块和SI宏块映射到条带组1中，P宏块映射到条带组2中，B宏块映射到条带组3中；或者，将I宏块和SI宏块映射到条带组1中，P宏块和B宏块都映射到条带组2中。视频业务发送装置可以根据与宏块到条带组映射相关的配置参数确定具体哪些类型的宏块映射到相同的条带组中。
上述502部分中根据数据的重要性与子流的映射关系，将数据分流到至少两个子流上，可能有不同的分流方案。例如具体可以为：
一、视频数据帧级别的分流
视频数据帧级别的分流为：根据视频数据帧的重要性与子流的映射关系，以视频数据帧为单位，将数据分流到至少两个子流上。
图6是本发明实施例的一种可能的视频数据帧级别的视频数据分流传输示意图。如图6所示，将I帧分流到子流1上、B帧分流到子流2上、P帧分流到子流3上分别进行传输。
进一步地，以视频数据帧为单位对数据进行分流后，子流中的视频数据帧的包头信息除了包括分流之后的子流中的视频数据帧的子流数据序列号(Data Sequence Number，简称DSN)之外，还可以包括分流之前的视频数据帧的原始DSN。以图6为例，分流之前，I1、B1、P1、I2、B2、P2的原始DSN分别为1、2、3、4、5、6；分流之后，I1、I2在子流1中的子流DSN为1、2；B1、B2在子流2中的子流DSN为1、2；P1、P2在子流3中的子流DSN为1、2。
二、NALU级别的分流
NALU级别的分流为：根据视频数据帧中NALU的重要性与子流的映射关系，以NALU为单位，将数据分流到至少两个子流上。
图7为本发明实施例的一种可能的NALU级别的视频数据分流示意图。如图7所示，数据帧1由NALU1、NALU2和NALU3组成，数据帧2由NALU4、NALU5和NALU6组成，数据帧3由NALU7、NALU8和NALU9 组成。其中NALU1、NALU4和NALU7中包括的宏块类型是I宏块和SI宏块，NALU2、NALU5和NALU8中包括的宏块类型是P宏块，NALU3、NALU6和NALU9中包括的宏块类型是B宏块。按照NALU的重要性经过分流处理之后，NALU1、NALU4和NALU7被分流到子流1，NALU2、NALU5和NALU8被分流到子流2，NALU3、NALU6和NALU9被分流到子流3。
进一步地，以NALU为单位对数据进行分流后，子流中的视频数据帧的包头信息除了包括分流之后的子流DSN之外，还可以包括所述子流数据帧中每个NALU所对应的原始DSN。以图7为例，分流之后NALU1、NALU4、NALU7在子流1中组成数据帧1，所对应的子流DSN为1，NALU2、NALU5、NALU8在子流2中组成数据帧1，所对应的子流DSN为1，NALU3、NALU6、NALU9在子流3中组成数据帧1，所对应的子流DSN为1；分流之前，NALU1、NALU2、NALU3的原始DSN为1，NALU4、NALU5、NALU6的原始DSN为2，NALU7、NALU8、NALU9的原始DSN3。
可以理解的是，视频业务发送装置可以支持至少一种分流方案，进一步地，在视频业务发送装置支持多于一种分流方案的场景下，视频业务发送装置可以进一步根据与分流方案相关的配置参数确定具体采用哪种分流方案。
上面从视频业务发送装置的角度对视频业务的传输方法进行了介绍，下面将从视频业务接收装置的角度对视频业务的传输方法进行描述。
504：视频业务接收装置从至少两个承载上接收至少两个子流上的数据。
其中，承载是通过接收端的端口号与子流对应的；子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的。
505：视频业务接收装置对来自至少两个子流上的数据进行汇聚处理。
具体的，对应502中采用的不同的数据分流方式，在视频业务接收装 置对接收到子流上的数据所做的汇聚处理也会有所不同。其中，汇聚处理可以理解为是502数据分流过程的逆过程。
例如：
如果502中采用的是视频数据帧级别的分流，那么视频业务接收装置可以将各个子流的数据汇聚在一起，并按照分流之前的原始DSN进行排序，这里的数据是以视频数据帧的形式存在的。如图6所示，视频业务接收装置将子流1上的视频数据帧I1、I2，子流2上的视频数据帧B1、B2，子流3上的视频数据帧P1、P2汇聚在一起，并按照分流之前I1、I2、B1、B2、P1、P2的原始DSN进行排序，排序结果为I1、B1、P1、I2、B2、P2。
如果502中采用的是NALU级别的分流，那么视频业务接收装置首先将各个子流的数据汇聚在一起，根据数据中的NALU所对应的分流之前的原始DSN，把所述NALU组装恢复成分流之前的视频数据帧，然后对生成的视频数据帧按照原始DSN进行排序。
图8为本发明实施例的一种可能的NALU级别的视频数据分流场景下的视频数据汇聚示意图。如图8所示，NALU1、NALU2、NALU3的原始DSN都是1，视频业务接收装置会将子流1上的NALU1、子流2上的NALU2和子流3上的NALU3重新组合生成视频数据帧1；NALU4、NALU5、NALU6的原始DSN都是2，视频业务接收装置会将子流1上的NALU4、子流2上的NALU5和子流3上的NALU6重新组合生成视频数据帧2；NALU7、NALU8、NALU9的原始DSN都是3，视频业务接收装置会将子流1上的NALU7、子流2上的NALU8和子流3上的NALU9重新组合生成视频数据帧3。然后对重新组合生成的视频数据帧按照原始DSN进行排序。
可以理解的是，视频业务接收装置可以支持至少一种分流方案所对应的汇聚处理。视频业务接收装置在进行汇聚处理之前，确定视频业务发送时所采用的分流方案。具体的，视频业务接收装置可以通过与分流方案相关的信元确定视频业务发送时所采用的分流方案，所述与分流方案相关的 信元可以包含在信令消息中或包含在视频数据中由视频业务发送装置发给视频业务接收装置；视频业务接收装置也可以通过获取视频数据帧的特点确定视频业务发送时所采用的分流方案，例如，对于采用NALU级别的分流方案，其分流后的视频数据帧中包含的NALU是同一种类型，而采用视频数据帧级别的分流方案，其分流后的视频数据帧中包含各种类型的NALU；对于仅支持一种分流方案的场景，可以约定视频业务接收装置与视频业务发送装置所支持的分流方案。
汇聚处理后的视频业务数据经过解码处理，得到编码前的视频。
对于有不同QoS要求的无线承载，无线接入网(Radio Access Network，简称RAN)有多种策略优先保证重要性高的无线承载上的数据的可靠传输。
RAN可以采用不同的网络配置参数，如采用不同的无线链路控制(Radio Link Control Acknowledged Mode，简称RLC)模式，重要性高的无线承载的数据采用RLC确认模式(Acknowledged Mode，简称AM)，重要性低的无线承载的数据采用RLC非确认模式(Unacknowledged Mode，简称UM)；或者配置不同混合自动重传请求(Hybrid Automatic Repeat Request，简称HARQ)的重传次数，对于重要性高的无线承载的数据配置较大的HARQ重传次数，如6次，确保其可靠传输，对于重要性低的无线承载的数据配置较小的HARQ重传次数，如2次。这样在资源有限的情况下，可以优先保证重要性高的数据的可靠传输。
RAN也可以对不同的无线承载采用不同的调度策略，优先给重要性高的无线承载的数据分配无线资源，这样在资源有限的情况下，可以优先保证重要性高的数据的可靠传输。
RAN也可以把不同的无线承载映射到不同的载波上进行承载。比如在载波聚合场景下，由于低频点载波的路损比高频点载波的路损小，因此可以将重要性高的无线承载映射到低频点载波上进行传输，而重要性低的无线承载映射到高频点载波上进行传输。
RAN也可以把不同的无线承载映射到不同的频谱类型上进行承载。授权频谱是运营商可以控制的频谱资源，能有效的进行干扰协调和控制；而非授权频谱则不受运营商控制，其干扰和冲突不可控。在非授权频谱上进行数据传输其带宽和时延都无法保证，但非授权频谱的使用由于成本低廉，也是运营商数据传输的一个有效补充。因此，可以将重要性高的无线承载映射到授权频谱上进行传输，重要性低的无线承载映射到非授权频谱上进行传输。
上述主要从各个网元之间交互的角度对本发明实施例提供的方案进行了介绍。可以理解的是，各个网元，例如终端,视频会议终端，eNB，MME，S-GW，P-GW，PCRF，视频服务器，视频会议管理服务器以及视频业务发送装置和视频业务接收装置等为了实现上述功能，其包括了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及方案步骤，本发明能够以计算机软件或硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件、计算机软件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。
图9为本发明实施例的一种可能的视频业务发送装置的结构示意图。所述装置实现图5所述的视频业务传输方法中视频业务发送装置的功能，因此也能实现所述视频业务传输方法所具备的有益效果。所述视频业务发送装置包括处理器902和收发器903。
处理器902用于确定视频数据帧中数据的重要性，并用于根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上，还用于根据子流对应的端口号，将子流上的数据映射到与该子流对应的承载上。
收发器903用于发送所述承载上的数据。
视频业务发送装置还可以包括视频编码器901。视频编码器901用于对视频进行编码，得到视频数据帧，并将编码后的视频数据帧发给处理器902进行处理。
视频业务发送装置还可以包括存储器904。存储器904用于存储视频编码器901、处理器902和收发器903中相关的程序代码和数据。其中，存储器904存储的数据可以包括帧类型与帧的重要性之间的映射关系、NALU类型与NALU的重要性之间的映射关系、宏块到条带组的映射关系以及数据的重要性与子流的映射关系中的至少一种。
具体的，处理器902确定视频数据帧中数据的重要性的方式和过程，可以参考上述方法实施例中501部分的相关描述。处理器902根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上的方式和过程，可以参考上述方法实施例中502部分的相关描述。
处理器902将视频图像中的宏块映射到条带组，并将视频图像的条带组数据发给视频编码器901，具体的宏块到条带组的映射方式和过程可以参考上述方法实施例中501部分的相关描述。
具体的，处理器902根据子流对应的端口号，将子流上的数据映射到与该子流对应的承载上的方式和过程，可以参考上述方法实施例中503部分的相关描述。
处理器902还可以对映射到上述承载上的子流数据采用安全传输协议进行加密处理。
本发明实施例的视频业务发送装置实现上述方法实施例中视频业务发送装置所执行的方法的各个步骤/行为，其各个部件的功能可根据上述方法实施例中的方法具体实现，其具体实现过程可参照上述方法实施例中的相关描述。
可以理解的是，图9仅仅示出了视频业务发送装置的一种设计。在实 际应用中，视频业务发送装置可以包括任意数量的视频编码器，处理器，收发器和存储器，而所有可以实现本发明实施例的视频业务发送装置都在本发明的保护范围之内。
图10为本发明实施例的另一种可能的视频业务发送装置的结构示意图。所述装置实现图5所述的视频业务传输方法中视频业务发送装置的功能，因此也能实现所述视频业务传输方法所具备的有益效果。视频业务发送装置包括数据分流单元1003，承载映射单元1004以及通信单元1005。
数据分流单元1003用于确定视频数据帧中数据的重要性，并用于根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上。
承载映射单元1004用于根据子流对应的端口号，将子流上的数据映射到与该子流对应的承载上。通信单元1005用于发送所述承载上的数据。
具体的，数据分流单元1003确定视频数据帧中数据的重要性的方式和过程，可以参考上述方法实施例中501部分的相关描述。数据分流单元1003根据数据的重要性与子流的映射关系，将视频数据帧中的数据分流到至少两个子流上的方式和过程，可以参考上述方法实施例中502部分的相关描述。
具体的，承载映射单元1004根据子流对应的端口号，将子流上的数据映射到与该子流对应的承载上的方式和过程，可以参考上述方法实施例中503部分的相关描述。承载映射单元1004还可以对映射到上述承载上的子流数据采用安全传输协议进行加密处理。
视频业务发送装置还可以包括视频编码单元1002，用于对视频进行编码，得到视频数据帧，并将编码后的视频数据帧发给数据分流单元1003对数据进行分流处理。
视频业务发送装置还可以包括灵活宏块排序单元1001，用于完成视频图像中宏块到条带组的映射，并将视频图像的条带组数据发给视频编码单 元1002。
具体的，对于NALU级别的数据分流方案，会存在宏块到NALU的灵活映射，灵活宏块排序单元1001可以对现有的FMO编码方法进行扩展，定义一种新的宏块到条带组的映射模式，该映射模式可以定义哪些类型的宏块可以映射到相同的条带组中。
视频业务发送装置还可以包括存储单元1006，存储单元1006用于存储灵活宏块排序单元1001、视频编码单元1002，数据分流单元1003，承载映射单元1004以及通信单元1005中相关的程序代码和数据。其中，存储单元1006所存储的数据可以至少包括帧类型与帧的重要性之间的映射关系，NALU类型与NALU的重要性之间的映射关系，宏块到条带组的映射关系以及数据的重要性与子流的映射关系。
本发明实施例的视频业务发送装置实现上述方法实施例中视频业务发送装置所执行的方法的各个步骤/行为，其各个部件的功能可根据上述方法实施例中的方法具体实现，其具体实现过程可参照上述方法实施例中的相关描述。
图11为本发明实施例的一种可能的视频业务接收装置的结构示意图。所述装置实现图5所述的视频业务传输方法中视频业务接收装置的功能，因此也能实现所述视频业务传输方法所具备的有益效果。视频业务接收装置包括处理器1102和收发器1103。
收发器1103用于从至少两个承载上接收至少两个子流上的数据。其中，承载是通过接收端的端口号与子流对应的；子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的。处理器1102用于对来自所述至少两个子流上的数据进行汇聚处理。
可以理解的是，视频业务接收装置还可以包括视频解码器1101，用于对所述汇聚处理后的数据进行解码，得到编码前的视频。
具体的，处理器1102对数据进行汇聚处理的方式和过程，可以参考上 述方法实施例中505部分。
可以理解的是，图11仅仅示出了视频业务接收装置的一种设计。在实际应用中，视频业务接收装置可以包括任意数量的视频解码器，处理器和收发器，而所有可以实现本发明的视频业务接收装置都在本发明的保护范围之内。
图12为本发明实施例的另一种可能的视频业务接收装置的结构示意图。所述装置实现图5所述的视频业务传输方法中视频业务接收装置的功能，因此也能实现所述视频业务传输方法所具备的有益效果。视频业务接收装置包括数据汇聚单元1202和通信单元1203。
通信单元1203用于从至少两个承载上接收至少两个子流上的数据。其中，承载是通过接收端的端口号与子流对应的；子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的。
数据汇聚单元1202用于对来自所述至少两个子流上的数据进行汇聚处理。
视频业务接收装置还可以包括视频解码单元1201，用于对所述汇聚处理后的数据进行解码，得到编码前的视频。
具体的，数据汇聚单元1202对数据进行汇聚处理的方式和过程，可以参考上述方法实施例中505部分。
用于执行上述本发明实施例中视频业务发送装置和视频业务接收装置的功能的处理器可以是中央处理器(CPU)，通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)，现场可编程门阵列(FPGA)或者其他可编程逻辑器件、晶体管逻辑器件，硬件部件或者其任意组合。其可以实现或执行结合本发明公开内容所描述的各种示例性的逻辑功能和模块。
本领域技术人员应该可以意识到，在上述一个或多个示例中，本发明所描述的功能可以用硬件、软件、固件或它们的任意组合来实现。当使用软件实现时，可以将这些功能存储在计算机可读介质中或者作为计算机可 读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质，其中通信介质包括便于从一个地方向另一个地方传送计算机程序或相关信息的任何介质。存储介质可以是通用或专用计算机能够存取的任何可用介质。
以上所述的具体实施方式，对本发明的目的、技术方案和有益效果进行了进一步详细说明，所应理解的是，以上所述仅为本发明的具体实施方式而已，并不用于限定本发明的保护范围，凡在本发明的技术方案的基础之上，所做的任何修改、等同替换、改进等，均应包括在本发明的保护范围之内。

Claims (25)

  1. 一种视频业务的传输方法，其特征在于，所述方法包括：
    确定视频数据帧中数据的重要性；
    根据数据的重要性与子流的映射关系，将所述视频数据帧中的数据分流到至少两个子流上；
    根据所述子流对应的端口号，将所述子流上的数据映射到与所述子流对应的承载上进行传输。
  2. 如权利要求1所述的视频业务的传输方法，其特征在于，所述确定视频数据帧中数据的重要性包括：确定所述视频数据帧的重要性或确定所述视频数据帧中网络抽象层单元NALU的重要性。
  3. 如权利要求2所述的视频业务的传输方法，其特征在于，所述确定所述视频数据帧的重要性包括：
    获取所述视频数据帧的帧类型；
    根据帧类型与帧的重要性之间的映射关系，确定所述视频数据帧的重要性。
  4. 如权利要求2所述的视频业务的传输方法，其特征在于，所述确定所述视频数据帧中NALU的重要性包括：
    获取所述视频数据帧中的NALU的NALU类型；
    根据NALU类型与NALU的重要性之间的映射关系，确定NALU的重要性。
  5. 如权利要求1-4任一项所述的视频业务的传输方法，其特征在于，所述根据数据的重要性与子流的映射关系，将所述视频数据帧中的数据分流到至少两个所述子流上，包括：
    根据视频数据帧的重要性与子流的映射关系，以视频数据帧为单位，将所述数据分流到至少两个子流上；或者
    根据视频数据帧中NALU的重要性与子流的映射关系，以NALU为单位，将所述数据分流到至少两个子流上。
  6. 如权利要求1-5任一项所述的视频业务的传输方法，其特征在于，所述根据所述子流对应的端口号，将所述子流上的数据映射到与所述子流对应的承载上进行传输，包括：
    根据所述子流的流编号确定与所述子流对应的媒体子部件描述；
    确定所述媒体子部件描述中的发送端的端口号；
    通过所述发送端的端口号确定与所述子流对应的承载；
    将所述子流上的数据映射到与所述子流对应的所述承载上进行传输。
  7. 如权利要求1-6任一项所述的视频业务的传输方法，其特征在于，所述子流对应的所述承载，都采用传输控制协议TCP进行传输；或都采用用户数据报协议UDP进行传输；或部分承载采用TCP、其余承载采用UDP进行传输。
  8. 如权利要求1-7任一项所述的视频业务的传输方法，其特征在于，所述将所述子流上的数据映射到与所述子流对应的承载上进行传输还包括：对映射到所述承载上的所述子流数据采用安全传输协议进行传输。
  9. 一种视频业务的传输方法，所述方法包括：
    从至少两个承载上接收至少两个子流上的数据，所述承载是通过接收端的端口号与所述子流对应的，所述子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的；
    对来自所述至少两个子流上的数据进行汇聚处理。
  10. 如权利要求9所述的视频业务的传输方法，其特征在于，所述对来自所述至少两个子流上的数据进行汇聚处理之前，通过与分流方案相关的信元确定视频业务发送时所采用的分流方案。
  11. 如权利要求9或10所述的视频业务的传输方法，其特征在于，所述对来自所述至少两个子流上的数据进行汇聚处理，包括：
    将所述至少两个子流上的数据汇聚在一起，根据分流之前的原始数据序列号DSN对所述汇聚后的数据进行排序；或者
    将所述至少两个子流上的数据汇聚在一起，根据所述数据中的网络抽象层单元NALU所对应的分流之前的原始DSN，把所述NALU组装恢复成分流之前的视频数据帧，然后对所述视频数据帧按照所述原始DSN进行排序。
  12. 一种视频业务发送装置，包括：
    处理器，用于确定视频数据帧中数据的重要性，并用于根据数据的重要性与子流的映射关系，将所述视频数据帧中的数据分流到至少两个子流上，还用于根据所述子流对应的端口号，将所述子流上的数据映射到与所述子流对应的承载上；
    收发器，用于发送所述承载上的数据。
  13. 如权利要求12所述的视频业务发送装置，其特征在于，所述处理器具体用于确定所述视频数据帧的重要性或确定所述视频数据帧中网络抽象层单元NALU的重要性。
  14. 如权利要求13所述的视频业务发送装置，其特征在于，所述处理器进一步用于：
    获取所述视频数据帧的帧类型；
    根据帧类型与帧的重要性之间的映射关系，确定所述视频数据帧的重要性。
  15. 如权利要求13所述的视频业务发送装置，其特征在于，所述处理器进一步用于：
    获取所述视频数据帧的NALU的NALU类型；
    根据NALU类型与NALU的重要性之间的映射关系，确定NALU的重要性。
  16. 如权利要求12-15任一项所述的视频业务发送装置，其特征在于， 所述处理器还进一步用于：
    根据视频数据帧的重要性与子流的映射关系，以视频数据帧为单位，将所述数据分流到至少两个子流上；或者
    根据视频数据帧中NALU的重要性与子流的映射关系，以NALU为单位，将所述数据分流到至少两个子流上。
  17. 如权利要求12-16任一项所述的视频业务发送装置，其特征在于，还包括存储器，用于存储帧类型与帧的重要性之间的映射关系、NALU类型与NALU的重要性之间的映射关系、宏块到条带组的映射关系以及数据的重要性与子流的映射关系中的至少一种。
  18. 如权利要求12-17任一项所述的视频业务发送装置，其特征在于：
    所述处理器用于根据所述子流的流编号确定与所述子流对应的媒体子部件描述，确定所述媒体子部件描述中的发送端的端口号，通过所述发送端的端口号确定与所述子流对应的承载，以及将所述子流上的数据映射到与所述子流对应的所述承载上。
  19. 如权利要求12-18任一项所述的视频业务发送装置，其特征在于，所述子流所对应的承载，都采用传输控制协议TCP进行传输；或都采用用户数据报协议UDP进行传输；或部分承载采用TCP、其余承载采用UDP进行传输。
  20. 如权利要求12-19任一项所述的视频业务发送装置，其特征在于，所述处理器进一步用于，将映射到所述承载上的所述子流数据采用安全传输协议进行加密处理。
  21. 如权利要求12-20任一项所述的视频业务发送装置，其特征在于，所述视频业务发送装置为视频服务器，视频会议终端或视频会议管理服务器中的任意一种。
  22. 一种视频业务接收装置，包括：
    收发器，用于从至少两个承载上接收至少两个子流上的数据，所述承 载是通过接收端的端口号与所述子流对应的，所述子流上的数据是根据视频数据帧中数据的重要性与子流的映射关系对视频数据进行分流得到的；
    处理器，用于对来自所述至少两个子流上的数据进行汇聚处理。
  23. 如权利要求22所述的视频业务接收装置，其特征在于，所述处理器进一步用于通过与分流方案相关的信元确定视频业务发送时所采用的分流方案。
  24. 如权利要求22或23所述的视频业务接收装置，其特征在于，所述处理器进一步用于：
    将所述至少两个子流上的数据汇聚在一起，根据分流之前的原始数据序列号DSN对所述汇聚后的数据进行排序；或者
    将所述至少两个子流上的数据汇聚在一起，根据所述数据中的网络抽象层单元NALU所对应的分流之前的原始DSN，把所述NALU组装恢复成分流之前的视频数据帧，然后对所述视频数据帧按照所述原始DSN进行排序。
  25. 如权利要求22-24任一项所述的视频业务接收装置，其特征在于，所述视频业务接收装置为终端，视频会议终端和视频会议管理服务器中的任意一种。
PCT/CN2016/081174 2016-05-05 2016-05-05 视频业务的传输方法和装置 Ceased WO2017190329A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201680085347.8A CN109076260A (zh) 2016-05-05 2016-05-05 视频业务的传输方法和装置
PCT/CN2016/081174 WO2017190329A1 (zh) 2016-05-05 2016-05-05 视频业务的传输方法和装置
EP16900851.3A EP3445059B1 (en) 2016-05-05 2016-05-05 Video service transmission method and device
US16/179,815 US10939127B2 (en) 2016-05-05 2018-11-02 Method and apparatus for transmission of substreams of video data of different importance using different bearers

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/081174 WO2017190329A1 (zh) 2016-05-05 2016-05-05 视频业务的传输方法和装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/179,815 Continuation US10939127B2 (en) 2016-05-05 2018-11-02 Method and apparatus for transmission of substreams of video data of different importance using different bearers

Publications (1)

Publication Number Publication Date
WO2017190329A1 true WO2017190329A1 (zh) 2017-11-09

Family

ID=60202641

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/081174 Ceased WO2017190329A1 (zh) 2016-05-05 2016-05-05 视频业务的传输方法和装置

Country Status (4)

Country Link
US (1) US10939127B2 (zh)
EP (1) EP3445059B1 (zh)
CN (1) CN109076260A (zh)
WO (1) WO2017190329A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112350979A (zh) * 2019-08-09 2021-02-09 华为技术有限公司 数据传输方法、装置以及系统
KR20210039446A (ko) * 2018-11-16 2021-04-09 텐센트 테크놀로지(센젠) 컴퍼니 리미티드 서비스 데이터 전송 방법 및 장치, 컴퓨터 디바이스 및 컴퓨터가 판독 가능한 저장 매체
WO2021209034A1 (zh) * 2020-04-16 2021-10-21 华为技术有限公司 一种数据传输的方法及通信装置
WO2022161162A1 (zh) * 2021-02-01 2022-08-04 大唐移动通信设备有限公司 视频传输方法、装置和存储介质
WO2023284551A1 (zh) * 2021-07-13 2023-01-19 华为技术有限公司 通信方法、装置和系统

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113973341B (zh) * 2020-07-22 2025-09-05 华为技术有限公司 通信方法及装置
CN115474239B (zh) * 2021-06-10 2025-11-18 维沃移动通信有限公司 数据控制方法、装置、通信设备及可读存储介质
CN113709585B (zh) * 2021-08-25 2023-09-19 三星电子（中国）研发中心 流媒体播放方法和装置
US11824653B2 (en) 2021-12-17 2023-11-21 Lenovo (Singapore) Pte. Ltd. Radio access network configuration for video approximate semantic communications
US11917206B2 (en) 2021-12-17 2024-02-27 Lenovo (Singapore) Pte. Ltd. Video codec aware radio access network configuration and unequal error protection coding
US12363316B2 (en) * 2021-12-17 2025-07-15 Lenovo (Singapore) Pte. Ltd. Video codec importance indication and radio access network awareness configuration
EP4492851A4 (en) * 2022-03-11 2025-11-05 Vivo Mobile Communication Co Ltd METHOD AND APPARATUS FOR SERVICE PROCESSING, COMMUNICATION DEVICE AND READABLE STORAGE MEDIA

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1414195A2 (en) * 2002-10-25 2004-04-28 Alcatel Hierarchical scheduler architecture for use with an access node
CN102665109A (zh) * 2012-04-19 2012-09-12 中兴通讯股份有限公司 一种多媒体视频数据的发送、接收方法及对应装置
CN103442391A (zh) * 2013-09-12 2013-12-11 华为终端有限公司 一种数据传输的方法及用户终端、系统
CN104506959A (zh) * 2014-12-15 2015-04-08 广东威创视讯科技股份有限公司 一种h264码流分包传输方法及系统
CN105392068A (zh) * 2015-11-04 2016-03-09 合一网络技术(北京)有限公司 分布式多传输信道网络直播视频并行分发方法及系统

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3766259B2 (ja) * 2000-06-01 2006-04-12 株式会社日立製作所 パケット転送装置
US7123658B2 (en) * 2001-06-08 2006-10-17 Koninklijke Philips Electronics N.V. System and method for creating multi-priority streams
US20050013249A1 (en) * 2003-07-14 2005-01-20 Hao-Song Kong Redundant packets for streaming video protection
CN100362782C (zh) * 2004-08-24 2008-01-16 华为技术有限公司 对丢失数据单元进行恢复的方法
KR100651486B1 (ko) * 2004-12-07 2006-11-29 삼성전자주식회사 네트워크를 통해 멀티미디어 컨텐츠를 전송하는 장치 및방법
US8300575B2 (en) * 2004-12-29 2012-10-30 Telefonaktiebolaget L M Ericsson (Publ) Priority bearers in a mobile telecommunication network
US7684430B2 (en) * 2006-09-06 2010-03-23 Hitachi, Ltd. Frame-based aggregation and prioritized channel access for traffic over wireless local area networks
WO2008066257A1 (en) * 2006-11-30 2008-06-05 Electronics And Telecommunications Research Institute Apparatus and method for hierarchical modulation transmission and reception of scalable video bitstream
EP1994721A4 (en) * 2007-01-12 2013-09-25 Univ Kyung Hee Univ Ind Coop Group PACKAGE FORMAT OF A NETWORK ABSTRACTION LAYER UNIT, ALGORITHM AND DEVICE FOR VIDEO ENCODING AND DECODING USING THIS FORMAT, ALGORITHM FOR SERVICE PROTECTION AND DEVICE FOR IPv6 LABEL BASED TRANSMISSION USING THIS FORMAT
US7911956B2 (en) * 2007-07-27 2011-03-22 Silicon Image, Inc. Packet level prioritization in interconnection networks
US8472315B2 (en) * 2008-02-07 2013-06-25 Belair Networks Inc. Method and system for controlling link saturation of synchronous data across packet networks
US20100049865A1 (en) * 2008-04-16 2010-02-25 Nokia Corporation Decoding Order Recovery in Session Multiplexing
US20110038386A1 (en) * 2008-04-29 2011-02-17 France Telecom Transmission of a video stream coded by hierarchical coding
US8345545B2 (en) * 2009-01-28 2013-01-01 Nec Laboratories America, Inc. Methods and systems for rate matching and rate shaping in a wireless network
US8531961B2 (en) * 2009-06-12 2013-09-10 Cygnus Broadband, Inc. Systems and methods for prioritization of data for intelligent discard in a communication network
US8462797B2 (en) * 2009-11-30 2013-06-11 Alcatel Lucent Method of priority based transmission of wireless video
US20120030723A1 (en) * 2010-07-27 2012-02-02 Motorola, Inc. Method and apparatus for streaming video
KR101744355B1 (ko) * 2011-01-19 2017-06-08 삼성전자주식회사 상호 계층 최적화를 이용한 멀티미디어 데이터 패킷을 송신하는 방법 및 장치
CN103733580B (zh) * 2011-08-18 2016-08-17 Vid拓展公司 用于分组差别化的方法和系统
US20140036999A1 (en) * 2012-06-29 2014-02-06 Vid Scale Inc. Frame prioritization based on prediction information
US10536708B2 (en) * 2017-09-21 2020-01-14 Intel Corporation Efficient frame loss recovery and reconstruction in dyadic hierarchy based coding

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1414195A2 (en) * 2002-10-25 2004-04-28 Alcatel Hierarchical scheduler architecture for use with an access node
CN102665109A (zh) * 2012-04-19 2012-09-12 中兴通讯股份有限公司 一种多媒体视频数据的发送、接收方法及对应装置
CN103442391A (zh) * 2013-09-12 2013-12-11 华为终端有限公司 一种数据传输的方法及用户终端、系统
CN104506959A (zh) * 2014-12-15 2015-04-08 广东威创视讯科技股份有限公司 一种h264码流分包传输方法及系统
CN105392068A (zh) * 2015-11-04 2016-03-09 合一网络技术(北京)有限公司 分布式多传输信道网络直播视频并行分发方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3445059A4 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210039446A (ko) * 2018-11-16 2021-04-09 텐센트 테크놀로지(센젠) 컴퍼니 리미티드 서비스 데이터 전송 방법 및 장치, 컴퓨터 디바이스 및 컴퓨터가 판독 가능한 저장 매체
KR102526925B1 (ko) * 2018-11-16 2023-04-27 텐센트 테크놀로지(센젠) 컴퍼니 리미티드 서비스 데이터 전송 방법 및 장치, 컴퓨터 디바이스 및 컴퓨터가 판독 가능한 저장 매체
CN112350979A (zh) * 2019-08-09 2021-02-09 华为技术有限公司 数据传输方法、装置以及系统
CN112350979B (zh) * 2019-08-09 2023-03-24 华为技术有限公司 数据传输方法和设备
WO2021209034A1 (zh) * 2020-04-16 2021-10-21 华为技术有限公司 一种数据传输的方法及通信装置
CN113543230A (zh) * 2020-04-16 2021-10-22 华为技术有限公司 一种数据传输的方法及通信装置
US12432153B2 (en) 2020-04-16 2025-09-30 Huawei Technologies Co., Ltd. Data transmission method and communication apparatus
WO2022161162A1 (zh) * 2021-02-01 2022-08-04 大唐移动通信设备有限公司 视频传输方法、装置和存储介质
CN114928554A (zh) * 2021-02-01 2022-08-19 大唐移动通信设备有限公司 视频传输方法、装置和存储介质
CN114928554B (zh) * 2021-02-01 2024-04-02 大唐移动通信设备有限公司 视频传输方法、装置和存储介质
US12610273B2 (en) 2021-02-01 2026-04-21 Datang Mobile Communications Equipment Co., Ltd. Method and device for video transmission, and storage medium
WO2023284551A1 (zh) * 2021-07-13 2023-01-19 华为技术有限公司 通信方法、装置和系统

Also Published As

Publication number Publication date
US10939127B2 (en) 2021-03-02
CN109076260A (zh) 2018-12-21
EP3445059A4 (en) 2019-02-20
EP3445059A1 (en) 2019-02-20
EP3445059B1 (en) 2025-09-24
US20190075308A1 (en) 2019-03-07

Similar Documents

Publication Publication Date Title
US10939127B2 (en) Method and apparatus for transmission of substreams of video data of different importance using different bearers
CN103262630B (zh) 多媒体已知无线电和网络自适应的信令技术
JP7063985B2 (ja) 上りリンクストリーミング向けのネットワーク支援
CN117082038A (zh) 用于传输媒体流的数据包的方法和通信装置
JP2020509663A (ja) データ伝送方法、通信デバイス、端末、および基地局
TW201306529A (zh) 視訊感知頻寬聚合及/或管理方法及裝置
US12284389B2 (en) Video codec aware radio access network configuration and unequal error protection coding
CN118985112A (zh) 无线通信的方法及装置
WO2009086771A1 (zh) 在无线通信系统中实现视频业务的方法及网元设备
WO2023112007A1 (en) Video codec importance indication and radio access network awareness configuration
CN114928554B (zh) 视频传输方法、装置和存储介质
CN116887341A (zh) 通信方法、通信装置和通信系统
WO2025109581A1 (en) Buffer status reporting for data packet sets
WO2025114996A1 (en) Counter mechanism for discarding data packet sets
WO2024067374A1 (zh) 一种通信方法及装置
WO2024055692A1 (zh) 通信方法、通信装置和通信系统
WO2022262294A1 (zh) 视频流传输方法以及相关通信装置
CN118592031A (zh) 一种数据传输方法及装置、通信设备
Hama Amin Video QoS/QoE over IEEE802. 11n/ac: A Contemporary Survey
Payette et al. Enabling reliable and efficient wireless video uplink
ELHACHI STUDY AND IMPROVEMENT OF THE QUALITY OF SERVICE OF A VIDEO STREAMING BY THE HEVC CODEC IN AD-HOC NETWORKS.
Amin Video QoS/QoE over IEEE802. 11n/ac: A Contemporary Survey
EP4612911A1 (en) Controlling the sending of at least one picture over a communication network
CN119946701A (zh) 通信方法及装置
CN121753396A (zh) 无线通信系统中丢弃分组数据单元集合

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2016900851

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2016900851

Country of ref document: EP

Effective date: 20181115

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16900851

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 2016900851

Country of ref document: EP