WO2013063958A1 - 一种视频处理方法及系统、相关设备 - Google Patents

一种视频处理方法及系统、相关设备 Download PDF

Info

Publication number
WO2013063958A1
WO2013063958A1 PCT/CN2012/078913 CN2012078913W WO2013063958A1 WO 2013063958 A1 WO2013063958 A1 WO 2013063958A1 CN 2012078913 W CN2012078913 W CN 2012078913W WO 2013063958 A1 WO2013063958 A1 WO 2013063958A1
Authority
WO
WIPO (PCT)
Prior art keywords
video image
pixel value
compressed
encoder
decoder
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2012/078913
Other languages
English (en)
French (fr)
Inventor
王浦林
覃永宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP20120845031 priority Critical patent/EP2688299A4/en
Publication of WO2013063958A1 publication Critical patent/WO2013063958A1/zh
Priority to US14/080,085 priority patent/US9083954B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Definitions

  • the invention relates to a Chinese patent application filed on November 2, 2011 by the Chinese Patent Office, the application number is 201110342292.3, and the invention name is "a video processing method and system, related equipment". Priority is hereby incorporated by reference in its entirety.
  • the present invention relates to the field of video processing technologies, and in particular, to a video processing method and system, and related devices.
  • the degree of compression of the video image is closely related to the bandwidth of the transmission channel of the video image.
  • the code rate of the compressed code stream cannot exceed the bandwidth of the transmission channel. Otherwise, There is a possibility that the stream data is lost, resulting in poor quality of the video image decoded by the decoder. Therefore, the encoder usually encodes the video image by using a certain encoding method to ensure that the obtained code stream has a code rate that does not exceed the transmission channel bandwidth.
  • H.264 is a video codec standard developed by the International Telecommunication Union Telecommunication Standards Department. Currently, almost all video devices support the H.264 codec standard. Among them, under the high transmission channel bandwidth, the video image quality encoded by the encoder H.264 can be better guaranteed, and the compression damage of the video image is not obvious. Under the low transmission channel bandwidth, the video image encoded by the encoder H.264 will be compressed to a higher degree, and accordingly the compression damage of the video image will be larger, resulting in lower quality of the video image decoded by the decoder. .
  • the encoder In practical applications, in the low transmission channel bandwidth, in order to ensure that the code rate of the compressed code stream after H.264 encoding does not exceed the transmission channel bandwidth, the encoder generally increases the QP value of the H.264 coding quantization parameter, and the QP value is larger.
  • the smaller the code rate of the compressed code stream after H.264 encoding the more the compression damage of the video image will be, the worse the quality of the video image decoded by the decoder will be, such as the image block effect is obvious. , sports tailing is serious, there are pockmarks, fake edges, color distortion, and so on. Therefore, how to improve the quality of video image compression under low transmission channel bandwidth is an important research direction. Summary of the invention
  • a video processing method and system, and related equipment provided by the embodiments of the present invention are used to improve video image compression quality under a low transmission channel bandwidth.
  • a video processing method including:
  • the encoder transmits the pixel value compression mode of the video image to the decoder, the pixel value compression mode including a mapping relationship between the pixel value before the video image is compressed and the pixel value of the video image being compressed;
  • the encoder compresses the pixel values of the video image according to the pixel value compression manner of the video image to obtain a video image to be encoded;
  • the encoder encodes the video image to be encoded to obtain a video image encoded code stream; the encoder transmits the video image encoded code stream to the decoder, so that the decoder receives and decodes After the video image encodes the code stream to obtain the decoded video image, the pixel value of the decoded video image is inversely compressed according to the pixel value compression manner of the video image, thereby restoring the decoded video. The pixel value of the image.
  • a video processing method including:
  • the decoder receives and records the pixel value compression mode of the video image sent by the encoder, and the pixel value compression mode of the video image includes a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed;
  • the decoder receives the video image encoded code stream sent by the encoder, where the video image encoded code stream is that the encoder compresses the pixel value of the video image according to the pixel value compression manner of the video image. Obtaining a video image to be encoded, and encoding the video image to be encoded and transmitting the image;
  • An encoder comprising: a notification unit, configured to send a pixel value compression manner of the video image to the decoder, where the pixel value compression manner includes a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed;
  • a compression unit configured to compress a pixel value of the video image according to a pixel value compression manner of the video image to obtain a video image to be encoded
  • a coding unit configured to encode the video image to be encoded to obtain a video image coded code stream
  • a sending unit configured to send the video image encoded code stream to the decoder, so that the decoder receives and decodes the video image encoded code stream to obtain a decoded video image, according to the video image
  • the pixel value compression method inversely compresses the pixel value of the decoded video image, thereby restoring the pixel value of the decoded video image.
  • a decoder comprising:
  • a recording unit configured to receive and record a pixel value compression manner of a video image sent by the encoder, where the pixel value compression manner of the video image includes a mapping relationship between a pixel value before the video image is compressed and a pixel value after the video image is compressed.
  • the receiving unit is further configured to receive a video image encoded code stream sent by the encoder, where the video image encoded code stream is that the encoder performs pixel value of the video image according to a pixel value compression manner of the video image. Compressing to obtain a video image to be encoded, and encoding the video image to be encoded and transmitting the image;
  • a decoding unit configured to decode the video image encoded code stream to obtain a decoded video image
  • a restoring unit configured to perform inverse compression processing on the pixel values of the decoded video image according to a pixel value compression manner of the video image, thereby restoring pixel values of the decoded video image.
  • a video processing system including an encoder and a decoder
  • the encoder is configured to send a pixel value compression manner of the video image to the decoder, and perform compression processing on the pixel value of the video image according to the pixel value compression manner of the video image to obtain a video image to be encoded, and Encoding the video image to be encoded to obtain a video image encoded code stream; and transmitting the video image encoded code stream to the decoder;
  • the pixel value compression method includes a mapping relationship between a pixel value before the video image is compressed and a pixel value after the video image is compressed;
  • the decoder is configured to receive and record a pixel value compression manner of a video image sent by the encoder, and receive a video image encoded code stream sent by the encoder, and decode the video image encoded code stream, Obtaining a decoded video image, and performing inverse compression processing on the pixel values of the decoded video image according to a pixel value compression manner of the video image, thereby restoring pixel values of the decoded video image.
  • the encoder firstly sends the pixel value compression mode of the video image to the decoder, and then compresses the pixel value of the video image according to the pixel value compression manner to obtain a video image to be encoded, and then
  • the video image to be encoded is encoded to obtain a video image encoded code stream, and the video image encoded code stream is sent to the decoder; and the decoder can first receive and record the pixel value compression mode of the video image sent by the encoder, and then Receiving a video image encoded code stream sent by the encoder, and decoding the video image encoded code stream, obtaining the decoded video image, and further converting the pixel of the decoded video image according to the pixel value compression manner of the stored video image.
  • the value is subjected to inverse compression processing so that the pixel value of the decoded video image can be restored.
  • the encoder compresses the pixel values of the video image according to the pixel value compression method of the video image, obtains the video image to be encoded, and then performs encoding, which can reduce the encoding of the video image to be encoded by the encoder under the low transmission channel bandwidth.
  • the compression damage caused by the time can improve the video image compression quality under the low transmission channel bandwidth.
  • FIG. 1 is a flowchart of a video processing method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of another video processing method according to an embodiment of the present invention.
  • FIG. 3 is a diagram showing pixel values and video images before a video image is compressed according to an embodiment of the present invention. a mapping diagram between the compressed pixel values;
  • FIG. 4 is a schematic diagram of a process of compressing pixel values and restoring pixel values of a video image according to an embodiment of the present invention
  • FIG. 5 is a structural diagram of an encoder according to an embodiment of the present invention.
  • FIG. 6 is a structural diagram of a decoder according to an embodiment of the present invention.
  • Figure ⁇ is a structural diagram of a video processing system according to an embodiment of the present invention.
  • a video processing method and system and related device provided by the embodiments of the present invention can improve video image compression quality under a low transmission channel bandwidth.
  • the following description will be made by way of specific examples.
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • FIG. 1 is a flowchart of a video processing method according to an embodiment of the present invention. As shown in FIG. 1, the video processing method may include the following steps:
  • the encoder sends the pixel value compression mode of the video image to the decoder.
  • the pixel value compression manner of the video image may include a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • the pixel value compression method of the video image according to the embodiment of the present invention will be described in detail later through specific embodiments.
  • the pixel value of the video image may be represented by a certain length of the bit (such as 1 1 1 1 1 1 1 1 ), and may also be represented by a decimal value (such as 256), which is not limited by the embodiment of the present invention. .
  • the encoder can transmit the pixel value of the video image to the decoder by using a transmission channel of the video image, or a network channel, or other dedicated channel, which is not limited in the embodiment of the present invention.
  • the encoder compresses the pixel value of the video image according to the pixel value compression manner of the video image to obtain a video image to be encoded.
  • the encoder performs video image according to the pixel value compression manner of the video image.
  • the pixel value of the image is compressed, and the purpose is to reduce the range of pixel values of the video image, so that the video image to be encoded has a higher probability of occurrence of 0 coefficient in the encoding coefficient in the subsequent encoding quantization process, thereby reducing the video image in The damage caused by the quantization process of the code.
  • the encoder encodes the video image to be encoded to obtain a video image encoded code stream.
  • the encoder may perform H.264 encoding on the video image to be encoded to obtain a video image encoded code stream; or, the encoder may encode the video image to be encoded by using other encoding methods to obtain
  • the video image coded stream is not limited in the embodiment of the present invention.
  • the encoder sends the video image encoded code stream to the decoder, so that the decoder receives and decodes the video image encoded code stream to obtain a decoded video image, and then performs decoding according to the pixel value compression manner of the video image.
  • the pixel values of the video image are inversely compressed to restore the pixel values of the decoded video image.
  • the embodiment of the present invention may pre-configure the pixel value compression mode of one or several video images on the encoder and the decoder, and imply the pixel value compression mode of each video image.
  • An identifier ID wherein the identifier IDs of the pixel values of each video image are different from each other, so that the encoder and the decoder can identify the pixel value compression mode of the corresponding video image by using the identifier ID.
  • the pixel value before the video image is compressed is A. If the pixel image to which the A image is mapped is different, the pixel value compression mode of different video images can be considered.
  • the encoder may select the identifier ID of the pixel value compression mode of any video image, and send the selected identifier ID to the decoder, thereby implementing the pixel value compression method of the video image to the decoder. .
  • the decoder may determine a pixel value compression mode of the video image corresponding to the identifier ID, and after the decoder receives the video image encoded code stream sent by the encoder, the decoder may Decoding the encoded code stream to obtain the decoded video image, and performing inverse compression processing on the pixel value of the decoded video image according to the pixel value compression manner of the video image corresponding to the identifier ID, thereby restoring the decoded video image. Pixel values.
  • the encoder does not need to image the entire video image
  • the content of the prime value compression method is sent to the decoder, and only the identifier ID of the pixel value compression mode of the video image (the ID may be 1, 2, 3, ..., etc.) is sent to the decoder. Therefore, the amount of data transmission for representing the pixel value compression mode of the video image transmitted between the encoder and the decoder can be greatly reduced, thereby achieving the purpose of reducing the data loss rate and increasing the data transmission speed.
  • the pixel value compression mode of the video image stored on the encoder can also be sent by the decoder to the encoder for storage.
  • the decoder can compress the pixel value of one or several video images that are pre-configured.
  • the identifier ID is sent to the encoder for storage, which is not limited in the embodiment of the present invention.
  • the encoder sends the pixel value compression manner of the video image to the decoder, which may also be implemented in the following manner, that is,
  • the encoder can encapsulate the pixel value compression method of the video image into the payload Payload data field of the Supplemental Enhancement Information (SEI) packet of the H.264 standard;
  • SEI Supplemental Enhancement Information
  • the encoder sends the SEI packet of the pixel value compression method encapsulating the video image to the decoder.
  • the embodiment of the present invention further describes an implementation manner of the pixel value compression method for transmitting a video image by using the SEI packet of the H.264 standard.
  • the encoder firstly sends the pixel value compression mode of the video image to the decoder, and then compresses the pixel value of the video image according to the pixel value compression manner to obtain the video image to be encoded, and then
  • the video image to be encoded is encoded to obtain a video image encoded code stream, and the video image encoded code stream is sent to the decoder, so that the decoder can first receive and store the pixel value compression mode of the video image sent by the encoder.
  • the video image encoded code stream sent by the encoder is received, and the encoded image stream of the video image is decoded, and the decoded video image is obtained, and then the decoded video image is further compressed according to the pixel value of the stored video image.
  • the pixel values are inversely compressed so that the pixel values of the decoded video image can be restored. Since the encoder compresses the pixel values of the video image according to the pixel value compression method of the video image, and obtains the video image to be encoded and then encodes, the encoder can reduce the encoding of the video image to be encoded under the low transmission channel bandwidth. The resulting compression damage can improve the quality of video image compression at low transmission channel bandwidths.
  • Embodiment 2
  • FIG. 2 is a flowchart of a video processing method according to an embodiment of the present invention.
  • the video processing method provided by the embodiment of the present invention is introduced from the perspective of the encoder in the first embodiment, and the video processing method provided in the embodiment of the present invention is introduced from the perspective of the decoder.
  • the video processing method may include the following steps:
  • the decoder receives and records a pixel value compression manner of the video image sent by the encoder.
  • the decoder may receive the pixel value compression mode of the video image sent by the encoder through a transmission channel of the video image, or a network channel, or other dedicated channel, which is not limited by the embodiment of the present invention.
  • the encoder can send the identifier ID of the pixel value compression mode of the video image to the decoder, so as to transmit the pixel value compression mode of the video image to the decoder.
  • the decoder can receive the identification ID sent by the encoder and record it. Further, the decoder may determine the pixel value compression mode of the corresponding video image according to the identifier ID sent by the encoder.
  • the encoder can transmit the pixel value compression mode of the video image to the decoder through the SEI packet of the H.264 standard.
  • the decoder can receive the SEI packet of the H.264 standard sent by the encoder, and then parse the pixel value compression mode of the video image from the SEI packet, and then record the pixel value compression mode of the video image.
  • the pixel value compression manner of the video image sent by the encoder may include a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • the decoder receives the video image encoded code stream sent by the encoder.
  • the video image encoded code stream is an encoder that compresses the pixel value of the video image according to the pixel value compression manner of the video image to obtain a video to be encoded.
  • An image, and the encoded video image is encoded and transmitted.
  • the decoder decodes the video image encoded code stream to obtain a decoded video image.
  • the decoder may perform H.264 decoding on the video image encoded code stream to obtain the decoded video image.
  • the decoder may also decode the video image encoded code stream by other decoding methods.
  • the embodiment of the present invention is not limited as long as the decoded video image is obtained, as long as the decoding mode adopted by the decoder is the inverse processing mode of the encoding mode adopted by the encoder.
  • the decoder performs inverse compression processing on the pixel value of the decoded video image according to the pixel value compression manner of the video image, thereby restoring the pixel value of the decoded video image.
  • the decoder may first receive and record the pixel value compression mode of the video image sent by the encoder, and then receive the video image encoded code stream sent by the encoder, and decode the video image encoded code stream. After obtaining the decoded video image, the pixel value of the decoded video image is further inversely compressed according to the pixel value compression method of the stored video image, so that the pixel value of the decoded video image can be restored. Since the video image encoded code stream received by the decoder is compressed by the encoder according to the pixel value compression method of the video image, and then encoded, the encoder can be reduced in the low transmission channel bandwidth. The compression damage caused by the encoded video image is encoded, thereby improving the quality of video image compression under low transmission channel bandwidth.
  • Embodiment 3 is a diagrammatic representation of Embodiment 3
  • Embodiment 3 of the present invention exemplifies a pixel value compression method of a video image.
  • the pixel value compression method of the video image may include a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • the pixel values of the general video image are represented by 8 bits, that is, the value range is 0-255. Therefore, the encoder can take a shift to the right or a division to establish a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • the encoder may shift the pixel value before the video image is compressed to the right by at least one bit to obtain a pixel value before the video image is compressed, or the encoder may multiply the pixel value before the video image is compressed by 1 /n times the pixel value before the video image is compressed, n is a natural number; thus, the mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed can be established.
  • the mapping relationship of the subsequent pixel value 64 128 ⁇ 64.
  • the encoder can multiply the pixel value before the video image is compressed to the right by 2 bits. Bit, the pixel value of the video image is compressed. For example, if the video image is compressed before the pixel value
  • the pixel value compression method of the video image includes the pixel value 220 before the video image is compressed and the pixel after the video image is compressed.
  • the encoder sends the pixel value compression method of the video image including the mapping relationship between the pixel value before compression and the pixel value of the video image after compression, such as 128 ⁇ 64, 220 ⁇ 55, to the decoder.
  • the decoder may first record the pixel value compression mode of the video image.
  • the pixel value of the decoded video image may be inversely compressed according to the pixel value compression mode of the recorded video image, so that the pixel value of the decoded video image can be restored.
  • the pixel value of the compressed video image is mapped to the video image according to the mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • the mapping relationship of the pixel values before compression, and the pixel value of the decoded video image is restored to the pixel before the video image is compressed according to the mapping relationship between the compressed pixel value of the video image and the pixel value before the video image is compressed. value.
  • the decoder can compress the pixel value before the video image is compressed according to the recorded video image.
  • Pixel value mapping relationship ie, pixel image compression mode of video image
  • 128 ⁇ 64 Calculate the mapping relationship between the compressed pixel value of the video image and the pixel value before the video image is compressed 64 ⁇ 128, and the decoded video
  • the pixel value 64 of the image i.e., the pixel value 64 after the video image is compressed
  • the pixel value 128 of the video image i.e., the pixel value 128 before the video image is compressed.
  • the decoder may compress the pixel value before the video image is compressed according to the recorded video image.
  • the mapping relationship of the pixel values (ie, the pixel value compression mode of the video image) 220 ⁇ 55 calculates the mapping relationship between the compressed pixel value of the video image and the pixel value before the video image is compressed, 55 ⁇ 220, and the decoded
  • the pixel value 55 of the video image ie, the compressed pixel value of the video image 55
  • the value is 220).
  • the encoder compresses the pixel value of the video image to cause a certain degree of compression damage to the video image quality, but experiments prove that the pixel value of the video image is compressed under the low transmission channel bandwidth.
  • the compression damage caused by the quality of the video image is relatively better than the quality of the video image obtained by doing so, which far outweighs the disadvantages, that is, at the expense of a little effect, a greater benefit can be obtained.
  • Embodiment 4 is a diagrammatic representation of Embodiment 4:
  • Embodiment 4 of the present invention exemplifies a pixel value compression method of another video image.
  • the mapping relationship between the pixel value before compression of the video image and the pixel value of the video image after being compressed may specifically include:
  • the compressed pixel values are mapped to a mapping relationship of pixel values before the video image is compressed.
  • the compressed pixel value of the video image may be obtained by the encoder shifting the pixel value before the video image is compressed to the right by at least one bit; or, the compressed pixel value of the video image may be obtained by the encoder.
  • the video image is multiplied by 1/n times the pixel value before compression, and n is a natural number; thus, a mapping relationship from the pixel value of the compressed video image to the pixel value before the video image is compressed can be established.
  • the encoder can multiply the pixel value before the video image is compressed to the right by 2 bits to obtain the compressed pixel value of the video image.
  • the pixel value becomes 55 (binary 00110111), that is, the pixel value compression mode of the video image may specifically include:
  • the compressed pixel value 55 is mapped to the mapping relationship 55 ⁇ 220 of the pixel value 220 before the video image is compressed.
  • the encoder includes pixels of a video image including 42 ⁇ 128, 55 ⁇ 220, and the like, from the pixel values of the compressed video image to the pixel values of the video image before being compressed.
  • the decoder may first record the pixel value compression mode of the video image, and when the decoder receives the video image coded stream sent by the encoder, and decodes the video image coded stream, After the decoded video image, the pixel value of the decoded video image may be directly inversely compressed according to the pixel value compression mode of the recorded video image.
  • the decoder can be mapped according to the recorded pixel value from the compressed video image to the video image.
  • the mapping relationship of the previous pixel values (ie, the pixel value compression mode of the video image) 42 ⁇ 128 directly restores the pixel value of the decoded video image to 42 to the pixel value of the video image 128 (ie, the pixel value before the video image is compressed) 128).
  • the decoder can map the compressed pixel value from the video image to the video image.
  • the mapping relationship of the pixel values before compression ie, the pixel value compression mode of the video image
  • 55 ⁇ 220 directly restores the pixel value of the decoded video image to 55 to the pixel value 220 of the video image (ie, the pixel before the video image is compressed)
  • the value is 220).
  • the pixel value compression mode of the video image enables the decoder to directly restore the mapping relationship from the pixel value after the video image is compressed to the pixel value before the video image is compressed.
  • the pixel value of the decoded video image can reduce the pixel value restoration processing operation of the decoder, shortening the time for the decoder to restore the pixel value of the video image, thereby improving the efficiency of the decoder for restoring the pixel value of the video image.
  • Embodiment 5 is a diagrammatic representation of Embodiment 5:
  • Embodiment 5 of the present invention exemplifies a pixel value compression method of another video image.
  • the mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed may be as shown in FIG. 3 .
  • the video image is compressed to 0 in the range of pixel values [0, 63] and [192, 255] before compression (ie, the pixel value of the video image after compression is 0), and the remaining video images are compressed before
  • the pixel value is compressed according to the curve shown in FIG. 3, thereby establishing a pixel value compression method of the video image including the mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • FIG. 4 shows that the video image with the pixel value range of [0, 255] passes through the encoder.
  • the encoder compresses the pixel value of the video image having the pixel value range [0, 255] to [64, 191] according to the pixel value compression method of the video image shown in FIG. 3;
  • the device performs inverse compression processing on the pixel value range [64, 191] of the decoded video image according to the pixel value compression method of the video image shown in FIG. 3, thereby restoring the pixel value range of the decoded video image [0, 255] ].
  • Compressing the pixel values of the video image by using the pixel value compression method of the above video image can reduce the compression damage caused by the encoder encoding the video image to be encoded under the low transmission channel bandwidth, thereby improving the bandwidth in the low transmission channel.
  • the quality of the video image under compression can reduce the compression damage caused by the encoder encoding the video image to be encoded under the low transmission channel bandwidth, thereby improving the bandwidth in the low transmission channel.
  • Embodiment 6 of the present invention exemplifies a method for transmitting a pixel value compression mode of a video image.
  • the encoder may send the decoder to the decoder according to a certain manner after determining the pixel value compression mode of the video image.
  • the encoder can use the H.264 standard SEI packet to transmit the pixel value compression of the video image to the decoder. This method is completely standard and versatile.
  • the SEI package is an auxiliary enhancement packet of the H.264 standard, which plays a supporting role in decoding, display or other processes.
  • the SEI packet can be used to transmit some auxiliary information, or the SEI packet can be used to transmit some private information.
  • the encapsulation format of the SEI packet of the H.264 standard can be as shown in Table 1:
  • Rtp header Indicates the header of RTP, which is 12 bytes.
  • n-type indicates the NALU header byte of the RTP packet, which is 1 byte, and is divided into three bit fields of F, NRI, and Type, where F is 0; NRI represents the network abstraction layer (Network Abstraction Layer , NAL) priority, the value is 0 ⁇ 3; Type indicates the type of NAL, and the value is 6.
  • SEI PT indicates the payload type value of the SEI packet.
  • the length of the byte occupied by it is one. The value is the same as the PT size below. The minimum is 1 byte, and the maximum is unlimited.
  • the specific definition value of the SEI PT is 0 ⁇ 35, while other values are undefined, and 1 byte value is used. The maximum can represent 255, so the SEI PT can use a value greater than 35, such as 112, when the SEI packet transmits the pixel value compression mode of the video image.
  • PT size indicates the length of the payload data byte of the SEI packet, excluding its own length, and does not include the length of the rbsp_trailing-bit.
  • the byte length occupied by it is a variable value, the smallest byte. , the maximum is no limit.
  • Each byte represents a maximum of 255, and the value of the last byte must be a value less than 255. For example, if the payload data of none of the SEI packets is 500 bytes, then the PT size will occupy 2 bytes, the first byte is 255 ( OxFF ) and the second byte is 245 ( 0xF5 ).
  • Payload data The payload data of the SEI packet, that is, the custom data, the pixel value compression method of the video image can be sealed in the Payload data of the SEI package.
  • R-trail Indicates rbsp_ trailing-bits of RBSP, which can be filled with 0x80.
  • the embodiment of the present invention can use a value greater than 35, such as 112, as the SEI PT value when transmitting the pixel value compression mode of the video image, where the pixel value of the video image
  • the compression mode is encapsulated in the Payload data field of the SEI packet.
  • the format of the Payload data field is as shown in Table 2:
  • the number of each byte is mapped to a pixel value before the video image is compressed, and the pixel value before the video image is compressed is also stored in a byte of the corresponding serial number in the Payload data field. For example, if the pixel value of the video image is 100 after compression and the pixel value of the video image is 80, then in the Payload data field of the SEI packet, the value stored in the byte encoded with 80 is The pixel value is 100 before the video image is compressed, and so on.
  • the pixel value compression mode of the video image can be adjusted in real time according to needs. Since the real environment is variable, the video image content is also variable, and different video image pixels can be enabled according to different video images. Value compression method.
  • the pixel value compression mode of the video image may also be enabled or disabled.
  • the pixel value compression mode of several kinds of video images can be determined, and the encoder can use the SEI packet to send the pixel value compression methods of several video images to the decoder.
  • the new one to be enabled is first used by the SEI packet.
  • the pixel value of the video image is compressed to the decoder, and then the encoder side compresses the pixel value of the video image using the pixel value compression method of the new video image.
  • the decoder end After receiving the pixel value compression mode of the new video image and parsing, the decoder end records the pixel value compression mode of the new video image, and the subsequent decoded video image can use the pixel value compression mode of the new video image to perform the pixel value. reduction.
  • the encoder can notify the decoder of the shutdown processing information through the SEI packet before stopping the operation, and then the encoder side turns off the pixel value compression mode of the video image, according to the normal H.
  • the .264 encoding standard is encoded. After receiving the shutdown processing information, the decoder end closes the restoration processing of the pixel values of the decoded video image.
  • the encoder determines the pixel value compression mode of the video image to be enabled before starting the work, and then can notify the decoder side to start the pixel value restoration process through the SEI packet, and the encoder re
  • the pixel values of the video image are compressed according to the currently determined pixel value compression mode of the video image, and then encoded.
  • the decoder side can restore the pixel values of the decoded video image according to the pixel value compression mode of the enabled video image.
  • the pixel image compression processing is performed on the video image before encoding, and the pixel value compression method of the video image is sent to the decoder, and then the compressed video image is encoded; the decoder performs decoding on the video image.
  • the pixel values are restored.
  • the embodiment of the invention can effectively improve the video image compression quality under the low transmission channel bandwidth.
  • the pixel value compression method of the video image can be conveniently transmitted by using the SEI packet of the H.264 standard.
  • the embodiment of the invention only It is necessary to add a simple processing to the encoder and the decoder to obtain a good video image compression quality improvement effect.
  • the encoder can use the connection-oriented reliable transmission service mode provided by the Transmission Control Protocol (TCP) to encapsulate the SEI packet of the H.264 standard for compressing the pixel value of the video image. Send to the decoder, and wait for the acknowledgment SEI packet returned by the decoder to successfully receive the response message.
  • TCP Transmission Control Protocol
  • the encoder If the encoder receives the acknowledgment SEI packet returned by the decoder and successfully receives the response message, the encoder does not need to resend the SEI packet; otherwise, if the encoder If the acknowledgment SEI packet returned by the decoder is not successfully received, the encoder considers that the SEI packet is lost during transmission, and the encoder needs to resend the SEI packet to the decoder until the encoder receives the acknowledgment SEI returned by the decoder. The packet successfully receives the response message; thereby ensuring that the decoder receives the pixel value compression mode of the video image sent by the encoder.
  • the encoder may send the compressed code stream packet to the decoder by using a connection-oriented reliable transmission service provided by the TCP, and wait for the acknowledgment response message returned by the decoder, if the encoder receives the decoding.
  • the acknowledgment response message returned by the encoder the encoder does not need to resend the previously transmitted compressed code stream packet; conversely, if the encoder does not receive the acknowledgment response message returned by the decoder, the encoder considers the previously transmitted compressed code stream packet If a loss occurs during transmission, the encoder needs to retransmit the previously transmitted compressed code stream packet to the decoder until the encoder receives the acknowledgment response message returned by the decoder; thus ensuring that the decoder receives every transmission sent by the encoder.
  • a compressed stream packet A compressed stream packet.
  • FIG. 5 is a structural diagram of an encoder according to an embodiment of the present invention.
  • the encoder 500 can include:
  • the notification unit 501 is configured to send a pixel value compression manner of the video image to the decoder.
  • the pixel value compression manner of the video image may include mapping the pixel value before the video image is compressed with the pixel value after the video image is compressed.
  • the compressed pixel value of the video image is obtained by shifting the pixel value before the video image is compressed to at least one bit to the right; or, the pixel value of the compressed video image is compressed by the pixel before the video image is compressed.
  • the value is multiplied by 1/n times, where n is a natural number.
  • the compressing unit 502 is configured to perform compression processing on the pixel values of the video image according to the pixel value compression manner to obtain a video image to be encoded.
  • the encoding unit 503 is configured to encode the video image to be encoded to obtain a video image coded stream.
  • the sending unit 504 is configured to send the video image encoded code stream to the decoder, so that the decoder receives and decodes the video image encoded code stream to obtain the decoded video image, and performs pixel value compression according to the video image.
  • the pixel value of the decoded video image is inversely compressed to restore the pixel value of the decoded video image.
  • the notification unit 501 may be specifically configured to encapsulate a pixel value compression manner of the video image into a payload Payload data field of the auxiliary enhancement information SEI packet of the H.264 standard, and encapsulate the video image.
  • the SEI packet of the pixel value compression mode is sent to the decoder.
  • the SEI package of the H.264 standard can conveniently realize the transmission of the pixel value compression method of the video image, and has versatility.
  • the notification unit 501 may be specifically configured to send the identifier ID of the pixel value compression mode of the video image to the decoder; wherein, the identifier ID of the pixel value compression mode of each video image is not mutually the same.
  • the encoder does not need to transmit the content of the pixel value compression mode of the entire video image to the decoder, but only needs to transmit the identifier ID of the pixel value compression mode of the video image (the identifier ID can be 1, 2, 3 ...etc.) to the decoder, which can greatly reduce the amount of data transmission between the encoder and the decoder for representing the pixel value compression method of the video image, thereby reducing the data loss rate and Improve the speed of data transmission.
  • the encoding unit 503 is specifically configured to perform H.264 encoding on the video image to be encoded to obtain a video image encoded code stream.
  • the notification unit 501 firstly sends the pixel value compression mode of the video image to the decoder, and then the compression unit 502 compresses the pixel value of the video image according to the pixel value compression manner of the video image to obtain a to-be-processed
  • the encoded video image and further the encoding unit 503 may encode the video image to be encoded to obtain a video image encoded code stream, and then the transmitting unit 504 sends the video image encoded code stream to the decoder, so that the decoder can first Receiving and storing the pixel value compression mode of the video image sent by the encoder, and then receiving the video image coding sent by the encoder a code stream, and decoding the compressed code stream to obtain a decoded video image, and further performing inverse compression processing on the pixel value of the decoded video image according to a pixel value compression manner of the stored video image, thereby performing restoration decoding The pixel value of the video image afterwards.
  • the encoding unit 503 Since the compression unit 502 compresses the pixel values of the video image according to the pixel value compression manner of the video image, the encoding unit 503 performs encoding after obtaining the video image to be encoded, thereby reducing the video to be encoded by the encoder under the low transmission channel bandwidth.
  • the compression damage caused by the image encoding can improve the video image compression quality under the low transmission channel bandwidth.
  • FIG. 6 is a structural diagram of a decoder according to an embodiment of the present invention.
  • the decoder 600 can include:
  • the recording unit 601 is configured to receive and record a pixel value compression mode of the video image sent by the encoder.
  • the pixel value compression manner of the video image may include a mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed.
  • the compressed pixel value of the video image is obtained by shifting the pixel value before the video image is compressed to the right by at least one bit; or, the compressed pixel value of the video image is compressed by the video image.
  • the previous pixel value is multiplied by 1/n times, where n is a natural number.
  • the receiving unit 602 is further configured to receive the video image encoded code stream sent by the encoder, where the video image encoded code stream is an encoder that compresses the pixel value of the video image according to the pixel value compression manner of the video image to obtain a to-be-processed
  • the encoded video image, and the encoded video image is encoded and transmitted.
  • the decoding unit 603 is configured to decode the video image encoded code stream to obtain a decoded video image.
  • the restoring unit 604 is configured to perform inverse compression processing on the pixel values of the decoded video image according to the pixel value compression manner of the video image to restore the pixel value of the decoded video image.
  • the recording unit 601 may be specifically configured to receive an auxiliary enhancement information SEI packet of an H.264 standard sent by an encoder, where a payload value of the video payload is encapsulated in a Payload data field of the SEI packet. And the resolution of the video image from the SEI package The pixel value is compressed and the pixel value compression mode of the video image is recorded.
  • an encoder is utilized
  • the SEI package of the H.264 standard can conveniently realize the transmission of the pixel value compression method of the video image, and has versatility.
  • the recording unit 601 may be specifically configured to receive an identifier ID of a pixel value compression manner of a video image sent by the encoder, and an identifier ID of a pixel value compression manner of the video image; wherein each The identification IDs of the pixel value compression methods of the video images are different from each other.
  • the decoder does not need to receive the content of the pixel value compression mode of the entire video image sent by the encoder, but only needs to receive the identifier ID of the pixel value compression mode of the video image sent by the encoder (the identifier ID can be 1) , 2, 3...etc.), which can greatly reduce the amount of data transmission between the encoder and the pixel to represent the pixel value compression method of the video image, thereby reducing the data loss rate and improving The purpose of data transmission speed.
  • the decoding unit 603 may be specifically configured to perform H.264 decoding on the video image encoded code stream to obtain a decoded video image.
  • the restoring unit 604 may specifically be based on the video image. Calculating a mapping relationship from the pixel value of the compressed video image to the pixel value before the video image is compressed by mapping the pixel value before compression to the mapping relationship of the compressed pixel value of the video image; and according to the image from the video image The pixel value of the compressed pixel value is mapped to the pixel value before the video image is compressed, and the pixel value of the decoded video image is restored to the pixel value before the video image is compressed.
  • the restoration unit 604 can be directly based on the slave video image.
  • the compressed pixel value is mapped to the pixel value of the video image before being compressed to restore the pixel value of the decoded video image without first mapping according to the pixel value before being compressed from the video image to the video image being compressed.
  • the mapping relationship of the pixel values is calculated from the mapping of the compressed pixel values of the video image to the pixel values before the video image is compressed, and then mapped to the video image before being compressed according to the pixel values compressed from the video image.
  • the pixel value restoration processing operation of the decoder can be reduced, and the time for the decoder to restore the pixel value of the video image is shortened, thereby The efficiency of the decoder to restore the pixel values of the video image can be improved.
  • the recording unit 601 may first receive and record the pixel value compression mode of the video image sent by the encoder, and then the receiving unit 602 receives the video image encoded code stream sent by the encoder, and the decoding unit 603 further After the video image coded stream is decoded, and the decoded video image is obtained, the restoring unit 604 further inversely compresses the pixel value of the decoded video image according to the pixel value compression mode of the stored video image, so that the decoded image can be restored. The pixel value of the video image.
  • the encoder can be reduced in the low transmission channel bandwidth.
  • the compression damage caused by encoding the encoded video image can improve the video image compression quality under the low transmission channel bandwidth.
  • FIG. 7 is a structural diagram of a video processing system according to an embodiment of the present invention.
  • the video processing system may include an encoder 500 of the structure shown in Fig. 5 and a decoder 600 of the structure shown in Fig. 6.
  • the encoder 500 is configured to send a pixel value compression manner of the video image to the decoder 600, and perform compression processing on the pixel value of the video image according to the pixel value compression manner to obtain a video image to be encoded, and
  • the video image to be encoded is encoded to obtain a video image encoded code stream; and the video image encoded code stream is sent to the decoder 600;
  • the decoder 600 is configured to receive and record a pixel value compression manner of the video image sent by the encoder 500, and receive the video image encoded code stream sent by the encoder 500, and decode the video image encoded code stream to obtain the decoded image.
  • the video image, and the pixel value of the decoded video image is inversely compressed according to the pixel value compression method of the video image, thereby restoring the pixel value of the decoded video image.
  • the pixel value compression method of the video image may include a mapping relationship between a pixel value before the video image is compressed and a pixel value after the video image is compressed.
  • the mapping relationship between the pixel value before the video image is compressed and the pixel value after the video image is compressed may include: mapping the pixel value before the video image is compressed to the pixel value of the compressed video image, or The mapping relationship from the pixel value after the video image is compressed to the pixel value before the video image is compressed is included.
  • the pixel value after the video image is compressed is obtained by shifting the pixel value before the video image is compressed to the right by at least one bit; or, the compressed pixel value of the video image is compressed before the video image is compressed.
  • the pixel value is multiplied by 1/n times, where n is a natural number.
  • the encoder 500 firstly transmits the pixel value compression mode of the video image to the decoder 600, and then compresses the pixel value of the video image according to the pixel value compression manner to obtain a video image to be encoded, and further Encoding the video image to be encoded, obtaining a video image encoded code stream, and transmitting the video image encoded code stream to the decoder 600; and the decoder 600 may first receive and store the pixel value of the video image sent by the encoder 500.
  • the compression mode and then receiving the video image encoded code stream sent by the encoder 500, and decoding the video image encoded code stream, obtaining the decoded video image, and further compressing the decoded video according to the stored pixel value compression method.
  • the pixel values of the image are inversely compressed so that the pixel values of the decoded video image can be restored.
  • the encoder 500 compresses the pixel value of the video image according to the pixel value compression manner, obtains the video image to be encoded, and then performs encoding, which can reduce the encoding of the video image to be encoded by the encoder under the low transmission channel bandwidth. Compression damage, which can improve the quality of video image compression at low transmission channel bandwidth.
  • the video processing method and system and related devices provided by the embodiments of the present invention are comprehensively and in detail introduced. It has been proved that the edge contour effect of the video image processed by the video processing method and system and the related device provided by the embodiment of the present invention is clearer and more obvious, especially the details in the middle of the video image are more clear and clear. It can be seen that the video processing method and system and related devices provided by the embodiments of the present invention can improve the video image compression quality under the low transmission channel bandwidth.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

一种视频处理方法及系统、相关设备,该方法包括:编码器将视频图像的像素值压缩方式发送给解码器,该像素值压缩方式包括视频图像被压缩前的像素值与视频图像被压缩后的像素值的映射关系;编码器按照该像素值压缩方式对视频图像的像素值进行压缩处理,获得待编码的视频图像;编码器对待编码的视频图像进行编码,获得视频图像编码码流;编码器将视频图像编码码流发送至解码器,以使解码器接收并解码视频图像编码码流以获得解码后的视频图像后,按照上述像素值压缩方式对解码后的视频图像的像素值进行逆压缩处理,从而还原解码后的视频图像的像素值。本发明实施例可以提高在低传输通道带宽下的视频图像压缩质量。

Description

一种视频处理方法及系统、 相关设备 本申请要求于 2011 年 11 月 2 日提交中国专利局、 申请号为 201110342292.3、 发明名称为"一种视频处理方法及系统、 相关设备"的中国专 利申请的优先权, 其全部内容通过引用结合在本申请中。
技术领域
本发明涉及视频处理技术领域, 尤其涉及一种视频处理方法及系统、 相 关设备。
背景技术
在视频通信应用中, 视频图像的压缩程度与视频图像的传输通道带宽有 着密切的关系, 即视频图像经过编码器的编码处理后, 得到的压缩码流的码 率不能超过传输通道带宽, 否则就会出现码流数据丟失的可能, 导致解码器 解码出的视频图像质量较差。 因此, 编码器通常采用一定的编码方法对视频 图像进行编码处理, 以保证得到的压缩码流的码率不超过传输通道带宽。
H.264是国际电信联盟电信标准部制定的一种视频编解码标准, 目前几乎 所有的视频设备都支持 H.264编解码标准。 其中, 在高传输通道带宽下, 经 过编码器 H.264编码后的视频图像质量能有较好的保证, 视频图像的压缩损 伤不是艮明显。 而低传输通道带宽下, 经过编码器 H.264编码的视频图像的 压缩程度就会较高, 相应地视频图像的压缩损伤也就较大, 导致解码器解码 出来的视频图像质量也就越低。 实际应用中, 在低传输通道带宽下, 为了保 证 H.264编码后的压缩码流的码率不超过传输通道带宽, 编码器通常会提高 H.264编码量化参数 QP值, QP值越大经过 H.264编码后的压缩码流的码率 就越小, 但同时带来的视频图像的压缩损伤也会越大, 导致解码器解码出的 视频图像质量也就越差, 如图像方块效应明显、 运动拖尾严重、 有麻点、 有 假边缘、 有颜色失真等等。 因此, 如何改善在低传输通道带宽下的视频图像压缩质量是一个重要的 研 方向。 发明内容
本发明实施例提供的一种视频处理方法及系统、 相关设备, 用于提高在 低传输通道带宽下的视频图像压缩质量。
一种视频处理方法, 包括:
编码器将视频图像的像素值压缩方式发送给解码器, 所述像素值压缩方 式包括视频图像被压缩前的像素值与视频图像被压缩后的像素值的映射关 系;
所述编码器按照所述视频图像的像素值压缩方式对视频图像的像素值进 行压缩处理, 获得待编码的视频图像;
所述编码器对所述待编码的视频图像进行编码, 获得视频图像编码码流; 所述编码器将所述视频图像编码码流发送至所述解码器, 以使所述解码 器接收并解码所述视频图像编码码流以获得解码后的视频图像后, 按照所述 视频图像的像素值压缩方式对所述解码后的视频图像的像素值进行逆压缩处 理, 从而还原所述解码后的视频图像的像素值。
一种视频处理方法, 包括:
解码器接收并记录编码器发送的视频图像的像素值压缩方式, 所述视频 图像的像素值压缩方式包括视频图像被压缩前的像素值与视频图像被压缩后 的像素值的映射关系;
所述解码器接收所述编码器发送的视频图像编码码流; 其中, 所述视频 图像编码码流是所述编码器按照所述视频图像的像素值压缩方式对视频图像 的像素值进行压缩处理以获得待编码的视频图像, 并且对所述待编码的视频 图像进行编码后发送的;
所述解码器对所述视频图像编码码流进行解码, 获得解码后的视频图像; 所述解码器按照所述视频图像的像素值压缩方式对所述解码后的视频图 像的像素值进行逆压缩处理, 从而还原所述解码后的视频图像的像素值。
一种编码器, 包括: 通知单元, 用于将视频图像的像素值压缩方式发送给解码器, 所述像素 值压缩方式包括视频图像被压缩前的像素值与视频图像被压缩后的像素值的 映射关系;
压缩单元, 用于按照所述视频图像的像素值压缩方式对视频图像的像素 值进行压缩处理, 获得待编码的视频图像;
编码单元, 用于对所述待编码的视频图像进行编码, 获得视频图像编码 码流;
发送单元, 用于将所述视频图像编码码流发送至所述解码器, 以使所述 解码器接收并解码所述视频图像编码码流以获得解码后的视频图像后, 按照 所述视频图像的像素值压缩方式对所述解码后的视频图像的像素值进行逆压 缩处理, 从而还原所述解码后的视频图像的像素值。
一种解码器, 包括:
记录单元, 用于接收并记录编码器发送的视频图像的像素值压缩方式, 所述视频图像的像素值压缩方式包括视频图像被压缩前的像素值与视频图像 被压缩后的像素值的映射关系;
接收单元, 还用于接收所述编码器发送的视频图像编码码流; 其中, 所 述视频图像编码码流是所述编码器按照所述视频图像的像素值压缩方式对视 频图像的像素值进行压缩处理以获得待编码的视频图像, 并且对所述待编码 的视频图像进行编码后发送的;
解码单元, 用于对所述视频图像编码码流进行解码, 获得解码后的视频 图像;
还原单元, 用于按照所述视频图像的像素值压缩方式对所述解码后的视 频图像的像素值进行逆压缩处理, 从而还原所述解码后的视频图像的像素值。
一种视频处理系统, 包括编码器和解码器;
所述编码器, 用于将视频图像的像素值压缩方式发送给解码器, 并按照 所述视频图像的像素值压缩方式对视频图像的像素值进行压缩处理, 获得待 编码的视频图像, 以及对所述待编码的视频图像进行编码, 获得视频图像编 码码流; 以及将所述视频图像编码码流发送至所述解码器; 所述视频图像的 像素值压缩方式包括视频图像被压缩前的像素值与视频图像被压缩后的像素 值的映射关系;
所述解码器, 用于接收并记录所述编码器发送的视频图像的像素值压缩 方式, 并接收所述编码器发送的视频图像编码码流, 以及对所述视频图像编 码码流进行解码, 获得解码后的视频图像, 以及按照所述视频图像的像素值 压缩方式对所述解码后的视频图像的像素值进行逆压缩处理, 从而还原所述 解码后的视频图像的像素值。
本发明实施例中, 编码器先将视频图像的像素值压缩方式发送给解码器, 然后再按照该像素值压缩方式对视频图像的像素值进行压缩处理, 获得待编 码的视频图像, 进而对该待编码的视频图像进行编码, 获得视频图像编码码 流, 并将该视频图像编码码流发送至解码器; 而解码器可以先接收并记录编 码器发送的视频图像的像素值压缩方式, 然后再接收编码器发送的视频图像 编码码流, 以及对该视频图像编码码流进行解码, 获得解码后的视频图像后, 再进一步按照存储的视频图像的像素值压缩方式对解码后的视频图像的像素 值进行逆压缩处理, 从而可以还原解码后的视频图像的像素值。 其中, 编码 器按照视频图像的像素值压缩方式对视频图像的像素值进行压缩处理, 获得 待编码的视频图像之后再进行编码, 可以减少编码器在低传输通道带宽下对 待编码的视频图像进行编码时所造成的压缩损伤, 从而可以提高在低传输通 道带宽下的视频图像压缩质量。
附图说明
为了更清楚地说明本发明实施例的技术方案, 下面将对实施例中所需要 使用的附图作简单地介绍, 显而易见地, 下面描述中的附图仅仅是本发明实 施例的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造性劳动的 前提下, 还可以根据这些附图获得其他的附图。
图 1为本发明实施例提供的一种视频处理方法的流程图;
图 2为本发明实施例提供的另一种视频处理方法的流程图;
图 3 为本发明实施例提供的一种视频图像被压缩前的像素值与视频图像 被压缩后的像素值之间映射关系图;
图 4 为本发明实施例提供的一种视频图像经过压缩像素值以及还原像素 值的过程示意图;
图 5为本发明实施例提供的一种编码器的结构图;
图 6为本发明实施例提供的一种解码器的结构图;
图 Ί为本发明实施例提供的一种视频处理系统的结构图。
具体实施方式
下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案进行 清楚、 完整地描述, 显然, 所描述的实施例仅仅是本发明一部分实施例, 而 不是全部的实施例。 基于本发明中的实施例, 本领域普通技术人员在没有作 出创造性劳动前提下所获得的所有其他实施例, 都属于本发明保护的范围。
本发明实施例提供的一种视频处理方法及系统、 相关设备, 能够提高在 低传输通道带宽下的视频图像压缩质量。 下面通过具体实施例进行说明。
实施例一:
请参阅图 1 , 图 1为本发明实施例提供的一种视频处理方法的流程图。 如 图 1所示, 该视频处理方法可以包括以下步骤:
101、 编码器将视频图像的像素值压缩方式发送给解码器。
本发明实施例中, 视频图像的像素值压缩方式可以包括视频图像被压缩 前的像素值与视频图像被压缩后的像素值的映射关系。 关于本发明实施例涉 及的视频图像的像素值压缩方式后续将通过具体实施例进行详细介绍。 本发 明实施例中, 视频图像的像素值可以采用一定长度的比特位(如 1 1 1 1 1 1 1 1 ) 来表示, 也可以采用十进制数值(如 256 )来表示, 本发明实施例不作限定。
其中, 编码器可以利用视频图像的传输通道, 或网络通道, 或其他专用 通道将视频图像的像素值压缩方式发送给解码器, 本发明实施例不作限定。
102、 编码器按照上述视频图像的像素值压缩方式对视频图像的像素值进 行压缩处理, 获得待编码的视频图像。
本发明实施例中, 编码器按照上述视频图像的像素值压缩方式对视频图 像的像素值进行压缩处理, 其目的是缩小视频图像的像素值范围, 使得待编 码的视频图像在后续编码的量化过程中, 编码系数中出现 0系数的几率较高, 从而可以减少视频图像在编码的量化过程中所带来的损伤。
103、编码器对上述待编码的视频图像进行编码,获得视频图像编码码流。 作为一种可选的实施方式, 编码器可以对待编码的视频图像进行 H.264 编码, 以获得视频图像编码码流; 或者, 编码器可以采取其他编码方式对待 编码的视频图像进行编码, 以获得视频图像编码码流, 本发明实施例不作限 定。
104、 编码器将上述视频图像编码码流发送至解码器, 以使解码器接收并 解码上述视频图像编码码流以获得解码后的视频图像后, 按照上述视频图像 的像素值压缩方式对解码后的视频图像的像素值进行逆压缩处理, 从而还原 解码后的视频图像的像素值。
作为一种可选的实施方式, 本发明实施例可以预先在编码器和解码器上 配置好一种或几种视频图像的像素值压缩方式, 并且为每一种视频图像的像 素值压缩方式打上一个标识 ID, 其中, 每一种视频图像的像素值压缩方式的 标识 ID互不相同, 从而使得编码器和解码器通过标识 ID即可识别出对应的 视频图像的像素值压缩方式。
本发明实施例中, 假设视频图像被压缩前的像素值为 A, 如果 A映射到 的视频图像被压缩后的像素值不同, 则可以认为是不同的视频图像的像素值 压缩方式。
在上述实施方式的基础上, 编码器可以选择任一个视频图像的像素值压 缩方式的标识 ID, 并将选择的标识 ID发送给解码器,从而实现将视频图像的 像素值压缩方式发送给解码器。 相应地, 解码器接收到该标识 ID之后, 可以 确定出该标识 ID对应的视频图像的像素值压缩方式, 进而解码器在接收到编 码器发送的视频图像编码码流后, 可以对该视频图像编码码流进行解码, 获 得解码后的视频图像后, 并按照该标识 ID对应的视频图像的像素值压缩方式 对解码后的视频图像的像素值进行逆压缩处理, 从而还原解码后的视频图像 的像素值。 其中, 通过这种实施方式, 使得编码器无需将整个视频图像的像 素值压缩方式的内容发送给解码器, 而仅需发送视频图像的像素值压缩方式 的标识 ID (标识 ID可以是 1、 2、 3... ...等等)给解码器即可, 从而可以大大 减少编码器与解码器之间传输的用于表示视频图像的像素值压缩方式的数据 传输量, 达到减小数据丟失率以及提高数据传输速度的目的。
实际应用中, 编码器上存储的视频图像的像素值压缩方式也可以由解码 器发送给编码器进行存储, 例如, 解码器可以将预先配置好的一种或几种视 频图像的像素值压缩方式的标识 ID发送给编码器进行存储, 本发明实施例不 作限定。
作为一种可选的实施方式, 本发明实施例中编码器将视频图像的像素值 压缩方式发送给解码器也可以采用如下方式来实现, 即:
1、 编码器可以将视频图像的像素值压缩方式封装到 H.264标准的辅助增 强信息 ( Supplemental Enhancement Information, SEI ) 包的有效载荷 Payload data字段中;
2、 编码器将封装有视频图像的像素值压缩方式的 SEI包发送给解码器。 本发明实施例后续将进一步对这种通过 H.264标准的 SEI包来发送视频 图像的像素值压缩方式的实施方式进行详细介绍。
本发明实施例一中, 编码器先将视频图像的像素值压缩方式发送给解码 器, 然后再按照该像素值压缩方式对视频图像的像素值进行压缩处理, 获得 待编码的视频图像, 进而对该待编码的视频图像进行编码, 获得视频图像编 码码流, 并将该视频图像编码码流发送至解码器, 以使解码器可以先接收并 存储编码器发送的视频图像的像素值压缩方式, 然后再接收编码器发送的视 频图像编码码流, 以及对该视频图像编码码流进行解码, 获得解码后的视频 图像后, 再进一步按照存储的视频图像的像素值压缩方式对解码后的视频图 像的像素值进行逆压缩处理, 从而可以还原解码后的视频图像的像素值。 由 于编码器按照视频图像的像素值压缩方式对视频图像的像素值进行压缩处 理, 获得待编码的视频图像之后再进行编码, 可以减少编码器在低传输通道 带宽下对待编码的视频图像进行编码时所造成的压缩损伤, 从而可以改善在 低传输通道带宽下的视频图像压缩质量。 实施例二:
请参阅图 2, 图 2为本发明实施例提供的一种视频处理方法的流程图。 与 实施例一从编码器角度来介绍本发明实施例提供的视频处理方法相对应, 本 实施例二从解码器角度来介绍本发明实施例提供的视频处理方法。 如图 2所 示, 该视频处理方法可以包括以下步骤:
201、 解码器接收并记录编码器发送的视频图像的像素值压缩方式。
本发明实施例中, 其中, 解码器可以通过视频图像的传输通道, 或网络 通道, 或其他专用通道来接收编码器发送的视频图像的像素值压缩方式, 本 发明实施例不作限定。
如前面实施例一所述, 编码器可以通过发送视频图像的像素值压缩方式 的标识 ID给解码器, 从而实现将视频图像的像素值压缩方式发送给解码器。 相应地, 解码器可以接收编码器发送的标识 ID并记录。 进一步地, 解码器可 以根据编码器发送的标识 ID确定出对应的视频图像的像素值压缩方式。
又如前面实施例一所述, 编码器可以通过 H.264标准的 SEI包来发送视 频图像的像素值压缩方式给解码器。 相应地, 解码器可以接收编码器发送的 H.264标准的 SEI包, 然后从 SEI包中解析出视频图像的像素值压缩方式后, 记录该视频图像的像素值压缩方式。
本发明实施例中, 编码器发送的视频图像的像素值压缩方式可以包括视 频图像被压缩前的像素值与视频图像被压缩后的像素值的映射关系。
202、 解码器接收编码器发送的视频图像编码码流; 其中, 该视频图像编 码码流是编码器按照上述视频图像的像素值压缩方式对视频图像的像素值进 行压缩处理以获得待编码的视频图像, 并且对该待编码的视频图像进行编码 后发送的。
203、解码器对上述视频图像编码码流进行解码,获得解码后的视频图像。 作为一种可选的实施方式, 解码器可以对视频图像编码码流进行 H.264 解码, 以获得解码后的视频图像; 或者, 解码器也可以采取其他解码方式对 视频图像编码码流进行解码, 以获得解码后的视频图像, 本发明实施例不作 限, 只要解码器采用的解码方式是编码器采用的编码方式的逆处理方式即可。 204、 解码器按照上述视频图像的像素值压缩方式对解码后的视频图像的 像素值进行逆压缩处理, 从而还原解码后的视频图像的像素值。
本发明实施例二中, 解码器可以先接收并记录编码器发送的视频图像的 像素值压缩方式, 然后再接收编码器发送的视频图像编码码流, 以及对该视 频图像编码码流进行解码, 获得解码后的视频图像后, 再进一步按照存储的 视频图像的像素值压缩方式对解码后的视频图像的像素值进行逆压缩处理, 从而可以还原解码后的视频图像的像素值。 由于解码器接收到的视频图像编 码码流是由编码器按照上述视频图像的像素值压缩方式对视频图像的像素值 进行压缩处理后再编码得到的, 可以减少编码器在低传输通道带宽下对待编 码的视频图像进行编码时所造成的压缩损伤, 从而可以改善在低传输通道带 宽下的视频图像压缩质量。
实施例三:
本发明实施例三举例说明一种视频图像的像素值压缩方式。
正如前面实施例所说的, 视频图像的像素值压缩方式可以包括视频图像 被压缩前的像素值与视频图像被压缩后的像素值的映射关系。 而在实际应用 中, 一般视频图像的像素值都采用 8比特位表示, 即数值范围为 0— 255。 因 此, 编码器可以采取向右移比特位方式或者采取除法方式来建立视频图像被 压缩前的像素值与视频图像被压缩后的像素值的映射关系。 具体来说, 编码 器可以将视频图像被压缩前的像素值向右移至少一个比特位得到视频图像被 压缩前的像素值, 或者, 编码器可以将视频图像被压缩前的像素值乘以 1/n倍 得到视频图像被压缩前的像素值, n为自然数; 从而可以建立视频图像被压缩 前的像素值与视频图像被压缩后的像素值的映射关系。
举例来说,编码器可以通过除法将视频图像被压缩前的像素值乘以 1/2(即 n=2 ) , 得到视频图像被压缩后的像素值。 例如, 若视频图像被压缩前的像素 值为 128, 则 128* ( 1/2 )就变为了 64, 即视频图像的像素值压缩方式包括视 频图像被压缩前的像素值 128与视频图像被压缩后的像素值 64的映射关系: 128→64。
又举例来说, 编码器可以将视频图像被压缩前的像素值乘向右移 2 比特 位, 得到视频图像被压缩后的像素值。 例如, 若视频图像被压缩前的像素值
220(二进制 11011100 ),向右移 2比特位,像素值就变为 55(二进制 00110111 ), 即视频图像的像素值压缩方式包括视频图像被压缩前的像素值 220与视频图 像被压缩后的像素值 55的映射关系: 220→55。
本发明实施例中, 编码器将包括 128→64、 220→55等视频图像被压缩前 的像素值与视频图像被压缩后的像素值的映射关系的视频图像的像素值压缩 方式发送给解码器之后, 解码器可以先记录这个视频图像的像素值压缩方式 , 当解码器接收到编码器发送的视频图像编码码流, 并对该视频图像编码码流 进行解码, 获得解码后的视频图像后, 可以进一步按照记录的视频图像的像 素值压缩方式对解码后的视频图像的像素值进行逆压缩处理, 从而可以还原 解码后的视频图像的像素值。
具体地, 解码器获得解码后的视频图像后可以根据记录视频图像被压缩 前的像素值与视频图像被压缩后的像素值的映射关系计算出视频图像被压缩 后的像素值映射到视频图像被压缩前的像素值的映射关系, 并且根据视频图 像被压缩后的像素值与视频图像被压缩前的像素值的映射关系, 将解码后的 视频图像的像素值还原成视频图像被压缩前的像素值。
举例来说, 如果解码后的视频图像的像素值为 64 (即视频图像被压缩后 的像素值 64 ) , 则解码器可以根据记录的视频图像被压缩前的像素值与视频 图像被压缩后的像素值的映射关系 (即视频图像的像素值压缩方式) 128→64 计算出视频图像被压缩后的像素值与视频图像被压缩前的像素值的映射关系 64→128, 并将解码后的视频图像的像素值 64 (即视频图像被压缩后的像素值 64 )还原成视频图像的像素值 128 (即视频图像被压缩前的像素值 128 ) 。
又举例来说, 如果解码后的视频图像的像素值为 55 (即视频图像被压缩 后的像素值 55 ) , 则解码器可以根据记录的视频图像被压缩前的像素值与视 频图像被压缩后的像素值的映射关系 (即视频图像的像素值压缩方式) 220→55 计算出视频图像被压缩后的像素值与视频图像被压缩前的像素值的 映射关系 55→220, 并将解码后的视频图像的像素值 55 (即视频图像被压缩 后的像素值 55 )还原成视频图像的像素值 220 (即视频图像被压缩前的像素 值 220 ) 。
本发明实施例中, 编码器对视频图像的像素值进行压缩处理会给视频图 像质量带来一定程度的压缩损伤, 但是实验证明, 在低传输通道带宽下, 对 视频图像的像素值进行压缩处理所带来的视频图像质量的压缩损伤, 相对比 这样做而得到的视频图像质量改善, 利远大于弊, 即牺牲一点效果, 能获得 更大的益处。
实施例四:
本发明实施例四举例说明另一种视频图像的像素值压缩方式。
本发明实施例中, 前面实施例中介绍的视频图像被压缩前的像素值与视 频图像被压缩后的像素值的映射关系 (即视频图像的像素值压缩方式)具体 可以包括: 从视频图像被压缩后的像素值映射到视频图像被压缩前的像素值 的映射关系。 与前面实施例相同, 视频图像被压缩后的像素值可以由编码器 将视频图像被压缩前的像素值向右移至少一个比特位得到; 或者, 视频图像 被压缩后的像素值可以由编码器将视频图像被压缩前的像素值乘以 1/n倍得 到, n为自然数; 从而可以建立从视频图像被压缩后的像素值映射到视频图像 被压缩前的像素值的映射关系。
举例来说,编码器可以通过除法将视频图像被压缩前的像素值乘以 1/4(即 n=4 ) , 得到视频图像被压缩后的像素值。 例如, 若视频图像被压缩前的像素 值为 128, 则 128* ( 1/4 )就变为了 42, 即视频图像的像素值压缩方式具体可 以包括: 从视频图像被压缩后的像素值 42映射到视频图像被压缩前的像素值 128的映射关系 42→128。
又举例来说, 编码器可以将视频图像被压缩前的像素值乘向右移 2 比特 位, 得到视频图像被压缩后的像素值。 例如, 若视频图像被压缩前的像素值 220(二进制 11011100 ),向右移 2比特位,像素值就变为 55(二进制 00110111 ), 即视频图像的像素值压缩方式具体可以包括: 从视频图像被压缩后的像素值 55映射到视频图像被压缩前的像素值 220的映射关系 55→220。
本发明实施例中, 编码器将包括 42→128、 55→220等从视频图像被压缩 后的像素值映射到视频图像被压缩前的像素值的映射关系的视频图像的像素 值压缩方式发送给解码器之后, 解码器可以先记录这个视频图像的像素值压 缩方式, 当解码器接收到编码器发送的视频图像编码码流, 并对该视频图像 编码码流进行解码, 获得解码后的视频图像后, 可以按照记录的视频图像的 像素值压缩方式直接对解码后的视频图像的像素值进行逆压缩处理。
举例来说, 如果解码后的视频图像的像素值为 42 (即视频图像被压缩后 的像素值 42 ) , 则解码器可以根据记录的从视频图像被压缩后的像素值映射 到视频图像被压缩前的像素值的映射关系 (即视频图像的像素值压缩方式) 42→128 直接将解码后的视频图像的像素值为 42还原成视频图像的像素值 128 (即视频图像被压缩前的像素值 128 ) 。
又举例来说, 如果解码后的视频图像的像素值为 55 (即视频图像被压缩 后的像素值 55 ) , 则解码器可以根据记录的从视频图像被压缩后的像素值映 射到视频图像被压缩前的像素值的映射关系 (即视频图像的像素值压缩方式) 55→220 直接将解码后的视频图像的像素值为 55 还原成视频图像的像素值 220 (即视频图像被压缩前的像素值 220 ) 。
与实施例三相比, 本实施例四提供的视频图像的像素值压缩方式使得解 码器可以直接根据从视频图像被压缩后的像素值映射到视频图像被压缩前的 像素值的映射关系来还原解码后的视频图像的像素值, 可以减少解码器的像 素值还原处理操作, 缩短了解码器还原视频图像的像素值的时间, 从而可以 提高解码器还原视频图像的像素值的效率。
实施例五:
本发明实施例五举例说明另一种视频图像的像素值压缩方式。
本发明实施例五中, 视频图像的像素值压缩方式包括的视频图像被压缩 前的像素值与视频图像被压缩后的像素值的映射关系可以如图 3所示。 其中, 视频图像被压缩前的像素值 [0, 63]和 [192, 255]范围内的全部压缩为 0 (即视 频图像被压缩后的像素值为 0 ) , 剩余的视频图像被压缩前的像素值按照图 3 所示曲线进行压缩, 从而建立了包括视频图像被压缩前的像素值与视频图像 被压缩后的像素值的映射关系的视频图像的像素值压缩方式。
请一并参阅图 4, 图 4表示像素值范围在 [0, 255]的视频图像经过编码器 压缩像素值以及解码器还原像素值的过程示意图。 在图 4所示过程中, 编码 器按照图 3所示的视频图像的像素值压缩方式对像素值范围在 [0, 255]的视频 图像的像素值进行压缩至 [64, 191]; 而解码器器按照图 3所示的视频图像的 像素值压缩方式对解码后的视频图像的像素值范围 [64, 191]进行逆压缩处理, 从而还原解码后的视频图像的像素值范围 [0 , 255]。
采用上述视频图像的像素值压缩方式对视频图像的像素值进行压缩处理 可以减少编码器在低传输通道带宽下对待编码的视频图像进行编码时所造成 的压缩损伤, 从而可以改善在低传输通道带宽下的视频图像压缩质量。
实施例六:
本发明实施例六举例说明一种视频图像的像素值压缩方式的发送方式。 其中, 编码器在确定出一种视频图像的像素值压缩方式后, 可以根据一定的 方式发送给解码器。 例如, 编码器可以利用 H.264标准的 SEI包将视频图像 的像素值压缩方式发送给解码器, 这种方式完全符合标准, 具有通用性。
其中, SEI包是 H.264标准的辅助增强信息包, 在解码、 显示或其它过程 中起辅助作用。 在编解码过程中, 可以用 SEI 包来传输一些辅助性的信息, 也可以利用 SEI 包来传输一些私有的信息。 本发明实施例中, H.264标准的 SEI包的封装格式可以如表 1所示:
表 1 H.264标准的 SEI包的封装格式
Figure imgf000015_0001
其中, H.264标准的 SEI包中各部分介绍如下:
1、 Rtp header: 表示 RTP的包头, 占 12个 byte。
2、 n-type: 表示 RTP包的 NALU头字节, 占 1个 byte, 又分为 F、 NRI、 Type三个位域,其中, F取值为 0; NRI表示网络抽象层( Network Abstraction Layer, NAL )优先级, 取值为 0〜3; Type表示 NAL的类型, 取值为 6。
3、 SEI PT: 表示 SEI包的 payload type值, 它所占的字节长度是一个可 变值, 和下面的 PT size的一样, 最小 1个 byte, 最大则没有限制 , 目前 H.264 协议中, SEI PT的具体定义值为 0 ~ 35 , 而其他值未定义, 用 1个 byte值最 大能表示 255 , 因此 SEI包发送视频图像的像素值压缩方式时 SEI PT可以使 用一个大于 35的值, 如 112。
4、 PT size: 表示 SEI包的 payload data字节长度, 不包括它本身的长度, 也不包括 rbsp— trailing— bits的长度, 它所占的字节长度是一个可变值, 最小一 个字节, 最大没有限制。 每个字节最大表示一个 255 的值, 最后一个字节的 值必须是小于 255的值。 比如, 没一个 SEI包的 payload data为 500byte, 那么 PT size将占用 2byte长度, 第一个字节为 255 ( OxFF ) , 第二个字节为 245 ( 0xF5 ) 。
5、 Payload data: SEI包的 payload数据, 也就是自定义的数据, 视频图 像的像素值压缩方式就可以封转在 SEI包的 Payload data中。
6、 R-trail: 表示 RBSP的 rbsp— trailing— bits, 填充 0x80即可。
目前, SEI PT值 0 ~ 35已被标准使用, 因此本发明实施例可以使用大于 35的值, 如 112,作为发送视频图像的像素值压缩方式时的 SEI PT值, 其中, 视频图像的像素值压缩方式封装在 SEI包的 Payload data字段中, Payload data 字段格式举例如表 2所示:
表 2 SEI包的 Payload data字段格式
Figure imgf000016_0001
256 byte 由于视频图像的像素值范围是 [0, 255] ,因此,可以在 SEI包的 Payload data 字段中可以利用 256个字节 (byte ) , 每个字节依次编号为 0, 1 , 2, ... ... ,
255 , 每个字节的编号与视频图像被压缩前的像素值建立一种映射关系, 并且 该视频图像被压缩前的像素值还保存在 Payload data字段中对应序号的字节 上。 例如, 视频图像被压缩前的像素值为 100, 视频图像被压缩后的像素值为 80, 那么在 SEI包的 Payload data字段中, 编码为 80的字节中保存的值为即 为视频图像被压缩前的像素值 100, 以此类推。
本发明实施例中, 视频图像的像素值压缩方式可以根据需要实时调整, 由于现实环境是多变的, 所以视频图像内容也是多变的, 可以根据不同的视 频图像, 启用不同的视频图像的像素值压缩方式。
本发明实施例中, 也可以启动或关闭视频图像的像素值压缩方式。 在初 始时, 可以确定若干种的视频图像的像素值压缩方式, 编码器可以用 SEI 包 把若干种视频图像的像素值压缩方式发送到解码器。
在实际编解码过程中, 若编码器需要改变当前使用的视频图像的像素值 压缩方式, 则在编码器启用新的视频图像的像素值压缩方式前, 先通过 SEI 包把新的, 要启用的视频图像的像素值压缩方式发送到解码器, 然后编码器 端使用新的视频图像的像素值压缩方式对视频图像的像素值进行压缩处理。 解码器端接收到新的视频图像的像素值压缩方式并解析后, 记录新的视频图 像的像素值压缩方式, 后续对解码后的视频图像可以利用新的视频图像的像 素值压缩方式进行像素值还原。
如果需要关闭视频图像的像素值压缩方式, 则编码器可以在停止工作前, 先通过 SEI 包把关闭处理信息通知到解码器, 然后编码器端关闭视频图像的 像素值压缩方式, 按正常的 H.264编码标准进行编码。 解码器端接收到关闭 处理信息后, 关闭对解码后的视频图像的像素值的还原处理。
如果需要重新启动视频图像的像素值压缩方式, 则编码器在启动工作前, 确定需要启用的视频图像的像素值压缩方式, 然后可通过 SEI 包通知解码器 端启动像素值还原处理, 编码器再根据当前确定的视频图像的像素值压缩方 式对视频图像的像素值进行压缩处理, 然后再编码。 解码器端可以根据启用 的视频图像的像素值压缩方式对解码后的视频图像的像素值进行还原。
本发明实施例利用对编码前的视频图像进行像素值压缩处理, 并把视频 图像的像素值压缩方式发送给解码器, 然后对压缩后的视频图像进行编码; 解码器对解码后的视频图像的像素值进行还原。 本发明实施例可以能有效提 升在低传输通道带宽下的视频图像压缩质量。 其中, 通过利用 H.264标准的 SEI包可以很方便地实现视频图像的像素值压缩方式的发送。本发明实施例只 需在编码器和解码器上增加简单的处理, 就可以得到艮好的视频图像压缩质 量的改善效果。
进一步地,本发明实施例中,编码器可以采用传输控制协议(Transmission Control Protocol, TCP )提供的面向连接的可靠传输服务方式将封装有视频图 像的像素值压缩方式的 H.264标准的 SEI包发送给解码器, 并等待解码器返 回的确认 SEI包成功接收响应消息,如果编码器接收到解码器返回的确认 SEI 包成功接收响应消息, 则编码器无需重新发送 SEI 包; 反之, 如果编码器没 有接收到解码器返回的确认 SEI包成功接收响应消息, 则编码器认为 SEI包 在发送过程中发生丟失, 编码器需要重新发送 SEI 包给解码器, 直到编码器 接收到解码器返回的确认 SEI 包成功接收响应消息为止; 从而可以确保解码 器收到编码器发送的视频图像的像素值压缩方式。
进一步地, 本发明实施例中, 编码器可以采用 TCP提供的面向连接的可 靠传输服务方式将压缩码流包发送给解码器, 并等待解码器返回的确认性应 答消息, 如果编码器接收到解码器返回的确认性应答消息, 则编码器无需重 发之前发送的压缩码流包; 反之, 如果编码器没有接收到解码器返回的确认 性应答消息, 则编码器认为之前发送的压缩码流包在发送过程中发生丟失, 编码器需要重发之前发送的压缩码流包给解码器, 直到编码器接收到解码器 返回的确认性应答消息为止; 从而可以确保解码器收到编码器发送的每一个 压缩码流包。
实施例七:
请参阅图 5, 图 5为本发明实施例提供的一种编码器的结构图。 如图 5所 示, 该编码器 500可以包括:
通知单元 501 , 用于将视频图像的像素值压缩方式发送给解码器。
本发明实施例中, 视频图像的像素值压缩方式可以包括视频图像被压缩 前的像素值与视频图像被压缩后的像素值映射关系。
本发明实施例中, 视频图像被压缩后的像素值由视频图像被压缩前的像 素值向右移至少一个比特位得到; 或者, 视频图像被压缩后的像素值由视频 图像被压缩前的像素值乘以 1/n倍得到, 其中, n为自然数。 压缩单元 502,用于按照上述像素值压缩方式对视频图像的像素值进行压 缩处理, 获得待编码的视频图像。
编码单元 503 , 用于对上述待编码的视频图像进行编码, 获得视频图像编 码码流。
发送单元 504, 用于将上述视频图像编码码流发送至解码器, 以使解码器 接收并解码上述视频图像编码码流以获得解码后的视频图像后, 按照上述视 频图像的像素值压缩方式对解码后的视频图像的像素值进行逆压缩处理, 从 而还原解码后的视频图像的像素值。
作为一种可选的实施方式, 通知单元 501 具体可以用于将视频图像的像 素值压缩方式封装到 H.264标准的辅助增强信息 SEI 包的有效载荷 Payload data字段中, 以及将封装有视频图像的像素值压缩方式的 SEI 包发送给解码 器。 其中, 利用 H.264标准的 SEI包可以很方便地实现视频图像的像素值压 缩方式的发送, 具有通用性。
作为另一种可选的实施方式, 通知单元 501 具体可以用于将视频图像的 像素值压缩方式的标识 ID发送给解码器; 其中, 每一种视频图像的像素值压 缩方式的标识 ID互不相同。 通过这种实施方式, 使得编码器无需将整个视频 图像的像素值压缩方式的内容发送给解码器, 而仅需发送视频图像的像素值 压缩方式的标识 ID (标识 ID可以是 1、 2、 3... ...等等)给解码器即可, 从而 可以大大减少编码器与解码器之间传输的用于表示视频图像的像素值压缩方 式的数据传输量, 达到减小数据丟失率以及提高数据传输速度的目的。
作为另一种可选的实施方式, 编码单元 503 具体用于对待编码的视频图 像进行 H.264编码, 获得视频图像编码码流。
本发明实施例七中, 通知单元 501 先将视频图像的像素值压缩方式发送 给解码器, 然后压缩单元 502再按照该视频图像的像素值压缩方式对视频图 像的像素值进行压缩处理, 获得待编码的视频图像, 进而编码单元 503 可以 对该待编码的视频图像进行编码, 获得视频图像编码码流, 再由发送单元 504 将该视频图像编码码流发送至解码器, 以使解码器可以先接收并存储编码器 发送的视频图像的像素值压缩方式, 然后再接收编码器发送的视频图像编码 码流, 以及对该压缩码流进行解码, 获得解码后的视频图像后, 再进一步按 照存储的视频图像的像素值压缩方式对解码后的视频图像的像素值进行逆压 缩处理, 从而可以还原解码后的视频图像的像素值。 由于压缩单元 502按照 视频图像的像素值压缩方式对视频图像的像素值进行压缩处理, 获得待编码 的视频图像之后编码单元 503 再进行编码, 可以减少编码器在低传输通道带 宽下对待编码的视频图像进行编码时所造成的压缩损伤, 从而可以改善在低 传输通道带宽下的视频图像压缩质量。
实施例八:
请参阅图 6, 图 6为本发明实施例提供的一种解码器的结构图。 如图 6所 示, 该解码器 600可以包括:
记录单元 601 , 用于接收并记录编码器发送的视频图像的像素值压缩方 式。
本发明实施例中, 视频图像的像素值压缩方式可以包括视频图像被压缩 前的像素值与视频图像被压缩后的像素值的映射关系。
本发明实施例中, 视频图像被压缩后的像素值是由视频图像被压缩前的 像素值向右移至少一个比特位得到的; 或者, 视频图像被压缩后的像素值是 由视频图像被压缩前的像素值乘以 1/n倍得到的, 其中, n为自然数。
接收单元 602, 还用于接收编码器发送的视频图像编码码流; 其中, 该视 频图像编码码流是编码器按照上述视频图像的像素值压缩方式对视频图像的 像素值进行压缩处理以获得待编码的视频图像, 并且对待编码的视频图像进 行编码后发送的。
解码单元 603 , 用于对上述视频图像编码码流进行解码, 获得解码后的视 频图像。
还原单元 604,用于按照上述视频图像的像素值压缩方式对上述解码后的 视频图像的像素值进行逆压缩处理, 从而还原解码后的视频图像的像素值。
作为一种可选的实施方式, 记录单元 601 具体可以用于接收编码器发送 的 H.264标准的辅助增强信息 SEI包, 该 SEI包的有效载荷 Payload data字段 中封装有视频图像的像素值压缩方式; 以及从该 SEI 包中解析出视频图像的 像素值压缩方式并记录该视频图像的像素值压缩方式。 其中, 编码器利用
H.264标准的 SEI包可以很方便地实现视频图像的像素值压缩方式的发送,具 有通用性。
作为一种可选的实施方式, 记录单元 601 具体可以用于接收编码器发送 的视频图像的像素值压缩方式的标识 ID, 以及记录该视频图像的像素值压缩 方式的标识 ID;其中,每一种视频图像的像素值压缩方式的标识 ID互不相同。 通过这种实施方式, 使得解码器无需接收编码器发送的整个视频图像的像素 值压缩方式的内容, 而仅需接收编码器发送的视频图像的像素值压缩方式的 标识 ID (标识 ID可以是 1、 2、 3... ...等等) 即可, 从而可以大大减少与编码 器之间传输的用于表示视频图像的像素值压缩方式的数据传输量, 达到减小 数据丟失率以及提高数据传输速度的目的。
作为一种可选的实施方式, 解码单元 603 具体可以用于对上述视频图像 编码码流进行 H.264解码, 获得解码后的视频图像。
本发明实施例中, 若上述的视频图像的像素值压缩方式包括从视频图像 被压缩前的像素值映射到视频图像被压缩后的像素值的映射关系, 则还原单 元 604具体可以根据从视频图像被压缩前的像素值映射到视频图像被压缩后 的像素值的映射关系计算出从视频图像被压缩后的像素值映射到视频图像被 压缩前的像素值的映射关系; 以及根据从视频图像被压缩后的像素值映射到 视频图像被压缩前的像素值的映射关系将解码后的视频图像的像素值还原成 视频图像被压缩前的像素值。
相比之下, 如果上述的视频图像的像素值压缩方式包括从视频图像被压 缩后的像素值映射到视频图像被压缩前的像素值的映射关系,则还原单元 604 可以直接根据从视频图像被压缩后的像素值映射到视频图像被压缩前的像素 值的映射关系来还原解码后的视频图像的像素值, 而不需要先根据从视频图 像被压缩前的像素值映射到视频图像被压缩后的像素值的映射关系计算出从 视频图像被压缩后的像素值映射到视频图像被压缩前的像素值的映射关系, 再根据从视频图像被压缩后的像素值映射到视频图像被压缩前的像素值的映 射关系来还原解码后的视频图像的像素值。 也即是说, 如果像素值压缩方式 包括从视频图像被压缩后的像素值映射到视频图像被压缩前的像素值的映射 关系, 那么将可以减少解码器的像素值还原处理操作, 缩短解码器还原视频 图像的像素值的时间, 从而可以提高解码器还原视频图像的像素值的效率。
本发明实施例八中, 记录单元 601 可以先接收并记录编码器发送的视频 图像的像素值压缩方式, 然后接收单元 602再接收编码器发送的视频图像编 码码流, 以及解码单元 603 再对该视频图像编码码流进行解码, 获得解码后 的视频图像后, 还原单元 604再进一步按照存储的视频图像的像素值压缩方 式对解码后的视频图像的像素值进行逆压缩处理, 从而可以还原解码后的视 频图像的像素值。 由于接收单元 602接收到的视频图像编码码流是由编码器 按照上述视频图像的像素值压缩方式对视频图像的像素值进行压缩处理后再 编码得到的, 可以减少编码器在低传输通道带宽下对待编码的视频图像进行 编码时所造成的压缩损伤, 从而可以改善在低传输通道带宽下的视频图像压 缩质量。
实施例九:
请参阅图 7 , 图 7为本发明实施例提供的一种视频处理系统的结构图。 如 图 Ί所示, 该视频处理系统可以包括图 5所示结构的编码器 500以及图 6所 示结构的解码器 600。
其中, 编码器 500用于将视频图像的像素值压缩方式发送给解码器 600 , 并按照所述像素值压缩方式对视频图像的像素值进行压缩处理, 获得待编码 的视频图像, 以及对所述待编码的视频图像进行编码, 获得视频图像编码码 流; 以及将所述视频图像编码码流发送至所述解码器 600;
其中, 解码器 600用于接收并记录编码器 500发送的视频图像的像素值 压缩方式, 并接收编码器 500发送的视频图像编码码流, 以及对视频图像编 码码流进行解码, 获得解码后的视频图像, 以及按照上述视频图像的像素值 压缩方式对解码后的视频图像的像素值进行逆压缩处理, 从而还原解码后的 视频图像的像素值。
其中, 上述的视频图像的像素值压缩方式可以包括视频图像被压缩前的 像素值与视频图像被压缩后的像素值的映射关系。 其中, 视频图像被压缩前的像素值与视频图像被压缩后的像素值的映射 关系具体可以包括: 从视频图像被压缩前的像素值映射到视频图像被压缩后 的像素值的映射关系, 或者包括从视频图像被压缩后的像素值映射到视频图 像被压缩前的像素值的映射关系。
其中, 上述视频图像被压缩后的像素值是由视频图像被压缩前的像素值 向右移至少一个比特位得到的; 或者, 上述视频图像被压缩后的像素值是由 视频图像被压缩前的像素值乘以 1/n倍得到的, 其中, n为自然数。
本发明实施例九, 编码器 500先将视频图像的像素值压缩方式发送给解 码器 600, 然后再按照该像素值压缩方式对视频图像的像素值进行压缩处理, 获得待编码的视频图像, 进而对该待编码的视频图像进行编码, 获得视频图 像编码码流, 并将该视频图像编码码流发送至解码器 600; 而解码器 600可以 先接收并存储编码器 500发送的视频图像的像素值压缩方式, 然后再接收编 码器 500发送的视频图像编码码流, 以及对该视频图像编码码流进行解码, 获得解码后的视频图像后, 再进一步按照存储的像素值压缩方式对解码后的 视频图像的像素值进行逆压缩处理, 从而可以还原解码后的视频图像的像素 值。 其中, 编码器 500按照像素值压缩方式对视频图像的像素值进行压缩, 获得待编码的视频图像之后再进行编码, 可以减少编码器在低传输通道带宽 下对待编码的视频图像进行编码时所造成的压缩损伤, 从而可以改善在低传 输通道带宽下的视频图像压缩质量。
以上对本发明实施例提供的视频处理方法及系统、 相关设备进行了全面、 详细的介绍。 实践证明, 采用本发明实施例提供的视频处理方法及系统、 相 关设备进行处理的视频图像的边缘轮廓效果更加清晰、 明显, 特别是视频图 像中部的细节更加清晰明了。 可见, 采用本发明实施例提供的视频处理方法 及系统、 相关设备可以改善在低传输通道带宽下的视频图像压缩质量。
本领域普通技术人员可以理解: 实现上述方法实施例的全部或部分步骤 可以通过程序指令相关的硬件来完成, 前述的程序可以存储于一计算机可读 取存储介质中, 该程序在执行时, 执行包括上述方法实施例的步骤; 而前述 的存储介质包括: 只读存储器( Read-Only Memory, ROM ) 、 随机存取存储 2Sr ( Random Access Memory, RAM ) 、 磁碟或者光盘等各种可以存储程序代 码的介质。
以上对本发明实施例提供的一种视频处理方法及系统、 相关设备进行了 以上实施例的说明只是用于帮助理解本发明的方法及其核心思想; 同时, 对 于本领域的一般技术人员, 依据本发明的思想, 在具体实施方式及应用范围 上均会有改变之处, 综上所述, 本说明书内容不应理解为对本发明的限制。

Claims

权利 要求 书
1、 一种视频处理方法, 其特征在于, 包括:
编码器将视频图像的像素值压缩方式发送给解码器, 所述像素值压缩方式 包括视频图像被压缩前的像素值与视频图像被压缩后的像素值的映射关系; 所述编码器按照所述视频图像的像素值压缩方式对视频图像的像素值进行 压缩处理, 获得待编码的视频图像;
所述编码器对所述待编码的视频图像进行编码, 获得视频图像编码码流; 所述编码器将所述视频图像编码码流发送至所述解码器, 以使所述解码器 接收并解码所述视频图像编码码流以获得解码后的视频图像后, 按照所述视频 图像的像素值压缩方式对所述解码后的视频图像的像素值进行逆压缩处理, 从 而还原所述解码后的视频图像的像素值。
2、 根据权利要求 1所述的方法, 其特征在于, 所述视频图像被压缩后的像 素值由所述视频图像被压缩前的像素值向右移至少一个比特位得到; 或者, 所 述视频图像被压缩后的像素值由所述视频图像被压缩前的像素值乘以 1/n倍得 到, 所述 n为自然数。
3、 根据权利要求 1-2任一所述的方法, 其特征在于, 所述编码器将视频图 像的像素值压缩方式发送给解码器包括:
编码器将视频图像的像素值压缩方式封装到 H.264标准的辅助增强信息 SEI 包的有效载荷 Payload data字段中;
所述编码器将封装有所述像素值压缩方式的 SEI包发送给解码器。
4、 根据权利要求 1-2任一所述的方法, 其特征在于, 所述编码器将视频图 像的像素值压缩方式发送给解码器包括:
所述编码器将视频图像的像素值压缩方式的标识 ID发送给解码器; 其中, 每一种视频图像的像素值压缩方式的标识 ID互不相同。
5、 根据权利要求 1-2任一所述的方法, 其特征在于, 所述编码器对所述待 编码的视频图像进行编码, 获得视频图像编码码流包括:
所述编码器对所述待编码的视频图像进行 H.264编码, 获得视频图像编码 码流。
6、 一种视频处理方法, 其特征在于, 包括:
解码器接收并记录编码器发送的视频图像的像素值压缩方式, 所述视频图 像的像素值压缩方式包括视频图像被压缩前的像素值与视频图像被压缩后的像 素值的映射关系;
所述解码器接收所述编码器发送的视频图像编码码流; 其中, 所述视频图 像编码码流是所述编码器按照所述视频图像的像素值压缩方式对视频图像的像 素值进行压缩处理以获得待编码的视频图像, 并且对所述待编码的视频图像进 行编码后发送的;
所述解码器对所述视频图像编码码流进行解码, 获得解码后的视频图像; 所述解码器按照所述视频图像的像素值压缩方式对所述解码后的视频图像 的像素值进行逆压缩处理, 从而还原所述解码后的视频图像的像素值。
7、 根据权利要求 6所述的方法, 其特征在于, 所述视频图像被压缩后的像 素值由所述视频图像被压缩前的像素值向右移至少一个比特位得到; 或者, 所 述视频图像被压缩后的像素值由所述视频图像被压缩前的像素值乘以 1/n倍得 到, 所述 n为自然数。
8、 根据权利要求 6-7任一所述的方法, 其特征在于, 所述解码器接收并存 储编码器发送的视频图像的像素值压缩方式包括:
所述解码器接收编码器发送的 H.264标准的辅助增强信息 SEI包,所述 SEI 包的有效载荷 Payload data字段中封装有视频图像的像素值压缩方式;
所述解码器从所述 SEI包中解析出所述视频图像的像素值压缩方式并存储。
9、 根据权利要求 6-7任一所述的方法, 其特征在于, 所述解码器接收并存 储编码器发送的视频图像的像素值压缩方式包括:
所述解码器接收编码器发送的视频图像的像素值压缩方式的标识 ID;其中, 每一种视频图像的像素值压缩方式的标识 ID互不相同;
所述解码器存储所述视频图像的像素值压缩方式的标识 ID。
10、根据权利要求 6-7任一所述的方法, 其特征在于, 所述解码器对所述视 频图像编码码流进行解码, 获得解码后的视频图像包括:
所述解码器对所述视频图像编码码流进行 H.264解码, 获得解码后的视频 图像。
11、 一种编码器, 其特征在于, 包括:
通知单元, 用于将视频图像的像素值压缩方式发送给解码器, 所述像素值 压缩方式包括视频图像被压缩前的像素值与视频图像被压缩后的像素值的映射 关系;
压缩单元, 用于按照所述视频图像的像素值压缩方式对视频图像的像素值 进行压缩处理, 获得待编码的视频图像;
编码单元, 用于对所述待编码的视频图像进行编码, 获得视频图像编码码 流;
发送单元, 用于将所述视频图像编码码流发送至所述解码器, 以使所述解 码器接收并解码所述视频图像编码码流以获得解码后的视频图像后, 按照所述 视频图像的像素值压缩方式对所述解码后的视频图像的像素值进行逆压缩处 理, 从而还原所述解码后的视频图像的像素值。
12、 根据权利要求 11所述的编码器, 其特征在于, 所述视频图像被压缩后 的像素值由所述视频图像被压缩前的像素值向右移至少一个比特位得到; 或者, 所述视频图像被压缩后的像素值由所述视频图像被压缩前的像素值乘以 1/n倍 得到, 所述 n为自然数。
13、 根据权利要求 11-12任一所述的编码器, 其特征在于, 所述通知单元具 体用于将视频图像的像素值压缩方式封装到 H.264标准的辅助增强信息 SEI包 的有效载荷 Payload data字段中, 以及将封装有所述像素值压缩方式的 SEI包发 送给解码器。
14、 根据权利要求 11-12任一所述的编码器, 其特征在于, 所述通知单元具 体用于将视频图像的像素值压缩方式的标识 ID发送给解码器; 其中, 每一种视 频图像的像素值压缩方式的标识 ID互不相同。
15、 根据权利要求 11-12任一所述的编码器, 其特征在于, 所述编码单元具 体用于对所述待编码的视频图像进行 H.264编码, 获得视频图像编码码流。
16、 一种解码器, 其特征在于, 包括:
记录单元, 用于接收并记录编码器发送的视频图像的像素值压缩方式, 所 述视频图像的像素值压缩方式包括视频图像被压缩前的像素值与视频图像被压 缩后的像素值的映射关系;
接收单元, 还用于接收所述编码器发送的视频图像编码码流; 其中, 所述 视频图像编码码流是所述编码器按照所述视频图像的像素值压缩方式对视频图 像的像素值进行压缩处理以获得待编码的视频图像, 并且对所述待编码的视频 图像进行编码后发送的;
解码单元, 用于对所述视频图像编码码流进行解码, 获得解码后的视频图 像;
还原单元, 用于按照所述视频图像的像素值压缩方式对所述解码后的视频 图像的像素值进行逆压缩处理, 从而还原所述解码后的视频图像的像素值。
17、 根据权利要求 16所述的解码器, 其特征在于, 所述视频图像被压缩后 的像素值由所述视频图像被压缩前的像素值向右移至少一个比特位得到; 或者, 所述视频图像被压缩后的像素值由所述视频图像被压缩前的像素值乘以 1/n倍 得到, 所述 n为自然数。
18、根据权利要求 16-17任一所述的解码器, 其特征在于, 所述记录单元具 体用于接收编码器发送的 H.264标准的辅助增强信息 SEI包, 所述 SEI包的有 效载荷 Payload data字段中封装有视频图像的像素值压缩方式; 以及从所述 SEI 包中解析出所述视频图像的像素值压缩方式并记录所述视频图像的像素值压缩 方式。
19、根据权利要求 16-17任一所述的解码器, 其特征在于, 所述记录单元具 体用于接收编码器发送的视频图像的像素值压缩方式的标识 ID, 以及记录所述 视频图像的像素值压缩方式的标识 ID; 其中, 每一种视频图像的像素值压缩方 式的标识 ID互不相同。
20、根据权利要求 16-17任一所述的解码器, 其特征在于, 所述解码单元具 体用于对所述视频图像编码码流进行 H.264解码, 获得解码后的视频图像。
21、 一种视频处理系统, 其特征在于, 包括编码器和解码器;
所述编码器, 用于将视频图像的像素值压缩方式发送给解码器, 并按照所 述视频图像的像素值压缩方式对视频图像的像素值进行压缩处理, 获得待编码 的视频图像, 以及对所述待编码的视频图像进行编码, 获得视频图像编码码流; 以及将所述视频图像编码码流发送至所述解码器; 所述视频图像的像素值压缩 方式包括视频图像被压缩前的像素值与视频图像被压缩后的像素值的映射关 系;
所述解码器, 用于接收并记录所述编码器发送的视频图像的像素值压缩方 式, 并接收所述编码器发送的视频图像编码码流, 以及对所述视频图像编码码 流进行解码, 获得解码后的视频图像, 以及按照所述视频图像的像素值压缩方 式对所述解码后的视频图像的像素值进行逆压缩处理, 从而还原所述解码后的 视频图像的像素值。
22、 根据权利要求 21所述的视频处理系统, 其特征在于, 所述视频图像被 压缩后的像素值由所述视频图像被压缩前的像素值向右移至少一个比特位得 到; 或者, 所述视频图像被压缩后的像素值由所述视频图像被压缩前的像素值 乘以 1/n倍得到, 所述 n为自然数。
PCT/CN2012/078913 2011-11-02 2012-07-20 一种视频处理方法及系统、相关设备 Ceased WO2013063958A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20120845031 EP2688299A4 (en) 2011-11-02 2012-07-20 METHOD AND SYSTEM FOR PROCESSING VIDEO IMAGES, AND DEVICE THEREOF
US14/080,085 US9083954B2 (en) 2011-11-02 2013-11-14 Video processing method and system and related device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110342292.3 2011-11-02
CN2011103422923A CN103096049A (zh) 2011-11-02 2011-11-02 一种视频处理方法及系统、相关设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/080,085 Continuation US9083954B2 (en) 2011-11-02 2013-11-14 Video processing method and system and related device

Publications (1)

Publication Number Publication Date
WO2013063958A1 true WO2013063958A1 (zh) 2013-05-10

Family

ID=48191282

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/078913 Ceased WO2013063958A1 (zh) 2011-11-02 2012-07-20 一种视频处理方法及系统、相关设备

Country Status (4)

Country Link
US (1) US9083954B2 (zh)
EP (1) EP2688299A4 (zh)
CN (1) CN103096049A (zh)
WO (1) WO2013063958A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109104432B (zh) * 2018-09-26 2020-06-09 深圳竹云科技有限公司 一种基于jwt协议的信息传递安全方法
CN112672132B (zh) * 2018-09-30 2023-12-26 Oppo广东移动通信有限公司 数据处理方法及装置、电子设备及存储介质
US11765311B2 (en) * 2021-07-30 2023-09-19 Cisco Technology, Inc. Transport mechanisms for video stream merging with overlapping video
US11582431B1 (en) * 2021-08-30 2023-02-14 Nvidia Corporation Image signal processing pipelines for high dynamic range sensors
CN116320395A (zh) * 2022-12-27 2023-06-23 维沃移动通信有限公司 图像处理方法、装置、电子设备及可读存储介质
CN116708793B (zh) * 2023-08-09 2024-01-30 腾讯科技(深圳)有限公司 视频的传输方法、装置、设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101193321A (zh) * 2006-11-27 2008-06-04 汤姆森许可贸易公司 编码设备、解码设备、记录设备、音频/视频数据传送系统
CN101218827A (zh) * 2005-07-06 2008-07-09 汤姆森许可贸易公司 对包括图像序列和标识的视频内容进行编码的方法和设备
CN101472182A (zh) * 2007-12-19 2009-07-01 索尼株式会社 视觉无损视频数据压缩
CN101690228A (zh) * 2007-06-29 2010-03-31 汤姆森许可贸易公司 视频编索引方法和视频编索引设备

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5263119A (en) * 1989-06-29 1993-11-16 Fujitsu Limited Gain-shape vector quantization method and apparatus
US5802218A (en) 1994-11-04 1998-09-01 Motorola, Inc. Method, post-processing filter, and video compression system for suppressing mosquito and blocking atrifacts
US5878168A (en) * 1995-06-05 1999-03-02 Sony Corporation Method and apparatus for picture encoding and decoding
US5808683A (en) * 1995-10-26 1998-09-15 Sony Corporation Subband image coding and decoding
US5889891A (en) * 1995-11-21 1999-03-30 Regents Of The University Of California Universal codebook vector quantization with constrained storage
US6608924B2 (en) * 2001-12-05 2003-08-19 New Mexico Technical Research Foundation Neural network model for compressing/decompressing image/acoustic data files
WO2003103178A1 (en) * 2002-05-29 2003-12-11 Pixonics, Inc. Video interpolation coding
CN1301003C (zh) 2004-11-16 2007-02-14 浙江大学 用于压缩16位彩色图像的颜色空间变换的方法
US7747017B2 (en) * 2004-12-01 2010-06-29 Motorola, Inc. Method and apparatus for end-to-end clear transport protocol
KR100634531B1 (ko) * 2004-12-29 2006-10-16 삼성전자주식회사 액정 표시장치의 동적 캐패시턴스 보상장치 및 방법
US7706607B2 (en) * 2005-06-23 2010-04-27 Microsoft Corporation Optimized color image encoding and decoding using color space parameter data
US20070047643A1 (en) * 2005-08-31 2007-03-01 Erlandson Erik E Video data compression
US20070171981A1 (en) * 2006-01-25 2007-07-26 Yingyong Qi Projection based techniques and apparatus that generate motion vectors used for video stabilization and encoding
US8014597B1 (en) * 2006-03-22 2011-09-06 Woodman Labs Method for efficient compression and decoding of single sensor color image data
US7778472B2 (en) * 2006-03-27 2010-08-17 Qualcomm Incorporated Methods and systems for significance coefficient coding in video compression
JP2010503254A (ja) * 2006-08-30 2010-01-28 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ データ信号を符号化する装置及び方法、並びにデータ信号を復号化する装置及び方法
US8494049B2 (en) * 2007-04-09 2013-07-23 Cisco Technology, Inc. Long term reference frame management with error video feedback for compressed video communication
US8537234B2 (en) * 2007-05-07 2013-09-17 DigitalOptics Corporation International Image restoration with enhanced filtering
CN101335902B (zh) 2007-06-25 2010-06-02 华为技术有限公司 视频编解码中的加权预测方法和装置
TWI382766B (zh) * 2008-12-23 2013-01-11 Nat Univ Tsing Hua 一種用於超高解析度之顯示框壓縮系統及方法
CN101494788B (zh) * 2009-01-23 2011-07-27 炬才微电子(深圳)有限公司 视频图像的压缩/解压缩方法与装置
US9626769B2 (en) * 2009-09-04 2017-04-18 Stmicroelectronics International N.V. Digital video encoder system, method, and non-transitory computer-readable medium for tracking object regions
US10178396B2 (en) * 2009-09-04 2019-01-08 Stmicroelectronics International N.V. Object tracking
US8457155B2 (en) * 2009-09-11 2013-06-04 Nokia Corporation Encoding and decoding a multi-view video signal
CN101668196B (zh) 2009-09-25 2012-02-08 西安电子科技大学 基于下采样和插值的低码率图像压缩方法
US8588309B2 (en) * 2010-04-07 2013-11-19 Apple Inc. Skin tone and feature detection for video conferencing compression
US20110299604A1 (en) * 2010-06-04 2011-12-08 Apple Inc. Method and apparatus for adaptive video sharpening
US9042599B2 (en) * 2010-07-02 2015-05-26 Intel Corporation Techniques for face detection and tracking
US8977542B2 (en) * 2010-07-16 2015-03-10 Telefonaktiebolaget L M Ericsson (Publ) Audio encoder and decoder and methods for encoding and decoding an audio signal
US8548062B2 (en) * 2010-07-16 2013-10-01 Sharp Laboratories Of America, Inc. System for low resolution power reduction with deblocking flag
US9131033B2 (en) * 2010-07-20 2015-09-08 Qualcomm Incoporated Providing sequence data sets for streaming video data
US9462280B2 (en) * 2010-12-21 2016-10-04 Intel Corporation Content adaptive quality restoration filtering for high efficiency video coding
US20120183039A1 (en) * 2011-01-13 2012-07-19 Qualcomm Incorporated Coding static video data with a baseline encoder
WO2012121543A2 (ko) * 2011-03-07 2012-09-13 엘지전자 주식회사 디지털 방송 신호 송/수신 방법 및 장치
US10034018B2 (en) * 2011-09-23 2018-07-24 Velos Media, Llc Decoded picture buffer management
US9363510B2 (en) * 2012-03-02 2016-06-07 Qualcomm Incorporated Scan-based sliding window in context derivation for transform coefficient coding
US9736476B2 (en) * 2012-04-27 2017-08-15 Qualcomm Incorporated Full random access from clean random access pictures in video coding
US20140301477A1 (en) * 2013-04-07 2014-10-09 Sharp Laboratories Of America, Inc. Signaling dpb parameters in vps extension and dpb operation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101218827A (zh) * 2005-07-06 2008-07-09 汤姆森许可贸易公司 对包括图像序列和标识的视频内容进行编码的方法和设备
CN101193321A (zh) * 2006-11-27 2008-06-04 汤姆森许可贸易公司 编码设备、解码设备、记录设备、音频/视频数据传送系统
CN101690228A (zh) * 2007-06-29 2010-03-31 汤姆森许可贸易公司 视频编索引方法和视频编索引设备
CN101472182A (zh) * 2007-12-19 2009-07-01 索尼株式会社 视觉无损视频数据压缩

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2688299A4 *

Also Published As

Publication number Publication date
EP2688299A4 (en) 2014-06-11
US9083954B2 (en) 2015-07-14
EP2688299A1 (en) 2014-01-22
US20140072051A1 (en) 2014-03-13
CN103096049A (zh) 2013-05-08

Similar Documents

Publication Publication Date Title
US7720096B2 (en) RTP payload format for VC-1
US9762939B2 (en) Enhanced user experience for miracast devices
US10187662B2 (en) Signaling parameters in video parameter set extension and decoder picture buffer operation
JP6472449B2 (ja) ビデオシーケンスを復号するための方法
KR101835340B1 (ko) 방송 신호 송신 장치, 방송 신호 수신 장치, 방송 신호 송신 방법, 및 방송 신호 수신 방법
JP2005176352A (ja) 移動通信端末機の動画像ストリーミングサービスのための無線動画像ストリーミングファイル、サービス方法及びシステム
CN102223201B (zh) 一种编解码器能力协商方法及终端
WO2013063958A1 (zh) 一种视频处理方法及系统、相关设备
CN106899380B (zh) 一种volte视频电话传输方法及其系统
US10536708B2 (en) Efficient frame loss recovery and reconstruction in dyadic hierarchy based coding
CN106131580A (zh) 使用环形缓冲区的视频数据处理
CN104270594A (zh) 数据包发送与接收的方法及设备
CN113364508B (zh) 一种语音数据的传输控制方法、系统及设备
CN109862400B (zh) 一种流媒体传输方法、装置及其系统
KR101953580B1 (ko) 영상회의 시스템에서 데이터 송수신 장치 및 방법
US11778219B2 (en) Method and system for live video streaming with integrated encoding and transmission semantics
JP5488694B2 (ja) リモート型携帯通信システム、サーバ装置及びリモート型携帯通信システム制御方法
CN102438151B (zh) 一种嵌入数字水印的视频流媒体传输信道的差错控制方法
JP2011172153A (ja) メディア符号化伝送装置
US20140369424A1 (en) Video codec system and video stream transmission method
GB2469281A (en) Asynchronous live video transmission based on client side requests for individual frames
CN106101702B (zh) 带反向信道消息管理的视频编码及解码
CN115665443A (zh) 一种视频流传输方法、系统、电子设备及存储介质
CN107592534A (zh) 一种基于嵌入式Linux的地铁车载高清视频播放系统
Lee et al. Error-resilient scalable video over the internet

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12845031

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012845031

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE