TW462184B - Block motion video coding and decoding - Google Patents

Block motion video coding and decoding Download PDF

Info

Publication number
TW462184B
TW462184B TW88116755A TW88116755A TW462184B TW 462184 B TW462184 B TW 462184B TW 88116755 A TW88116755 A TW 88116755A TW 88116755 A TW88116755 A TW 88116755A TW 462184 B TW462184 B TW 462184B
Authority
TW
Taiwan
Prior art keywords
data
block
conversion
motion
video
Prior art date
Application number
TW88116755A
Other languages
Chinese (zh)
Inventor
Robert Norman Hurst
Original Assignee
Sarnoff Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sarnoff Corp filed Critical Sarnoff Corp
Application granted granted Critical
Publication of TW462184B publication Critical patent/TW462184B/en

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

During transform-based video compression processing, motion vectors, which are identified during motion estimation and then used during motion-compensated inter-frame differencing, are constrained to coincide with block boundaries in the reference data. Block-based motion vectors have components that correspond to integer multiples of block dimensions. For example, for (8x8) blocks, allowable motion vector components are (..., -16, -8, 0, +8, +16, ...). Constraining motion vectors in this way enables the resulting encoded video bitstream to be further processed in the transform domain without having to apply inverse and forward transforms. In particular, an existing input bitstream is partially decoded to recover the motion vectors and prediction error (i.e., dequantized transform coefficients). Because the motion vectors coincide with block boundaries in the corresponding reference data, motion-compensated inter-frame addition can then performed in the transform domain to generate transform data for subsequent processing (which may ultimately involve re-encoding the transform data into another encoded video bitstream). Because motion compensation can be performed in the transform domain, the bitstream data can be further processed in the transform domain and without having to apply expensive and lossy inverse and forward transforms.

Description

五、發明說明(1) 發明背景 發明領域 本發明係關於視訊壓縮與解壓縮之演算法。 相關應用之相互參照 本發明申請下述專利申請案之專利:美國專利申請案號 6 0 / 1 0 2, 2 1 4,1 9 9 8年9月29日申請,檔案號碼:SAR 1 2 5 8 5P ;美國專利申請案號:60/1 21,531 ,1 9 9 9年2月25 日申請,檔案號碼SAR 1 2 9 9 0P。 相關技藝說明 在一個典型的以轉換為基礎的視訊壓縮演算法中,例如 一個符合移動圖形專家群(MPEG )演算法家族之演算法, 一個以區塊為基礎的轉換,例如一分離餘弦轉換(D C T )被 應用於對應於像素值或如依據一移動補償框際差異所產生 的像素差異的影像資料區塊中。之後,每個區塊所產生的 轉換係數便以一般方式予以量化用於後續之編碼(例如: 變動長度编碼之前的運行長度編碼)以產生一個編碼視訊 -ί立元流。 根據特別的視訊壓縮演算法,影像可被指定用在下列不 同類形之資料框的壓縮處理申: ◦僅使用資料框内部壓縮技術而加以編碼的一個内部 (I )資料框, ◦依據一個對應於先前I或Ρ資料框的參考資料框而使用 資料框際壓縮技術而加以編碼之預測資料框(Ρ ),而該資 料框本身亦可被用於產生一個參考資料框以編碼一個以上V. Description of the invention (1) Background of the invention Field of the invention The present invention relates to algorithms for video compression and decompression. Cross Reference to Related Applications The present invention is filed for the following patent applications: US Patent Application No. 6 0/1 0 2, 2 1 4, 1 9 98 Application, File No .: SAR 1 2 5 8 5P; US patent application number: 60/1 21,531, filed February 25, 1999, file number SAR 1 299 0P. Related techniques are described in a typical transformation-based video compression algorithm, such as an algorithm that conforms to the Moving Picture Experts Group (MPEG) algorithm family, a block-based transformation, such as a separated cosine transformation ( DCT) is applied to the image data block corresponding to the pixel value or the pixel difference generated according to a motion compensation frame difference. After that, the conversion coefficients generated by each block are quantized in a general manner for subsequent encoding (for example: run-length encoding before variable length encoding) to produce an encoded video stream. According to a special video compression algorithm, images can be specified for compression processing of the following different types of data frames: ◦ An internal (I) data frame that is encoded using only the internal compression technology of the data frame, ◦ based on a correspondence Prediction data frame (P) that was coded using the data frame compression technique on the reference data frame of the previous I or P data frame, and the data frame itself can also be used to generate a reference data frame to encode more than one

6 2 18 4 五、發明說明(2) 的其他資料框 〇依據(i ) 用資料框際壓 測分別來自(i P資料框,或( 於對其他資料 /主意:在p和B 可使用資料框 在任何情況 解碼,特別壓 可被應用至位 解量化過程便 向轉換被應用 資料或者(2 ) 否分別使用(1 定)。如果使 加法便使用移 資料以產生解 期間編碼至位 框資料可被視 則可被視為該 步驟對應於預 在許多應用 仍必須應用額 ,以及 前向, 縮技術 )一個 i i i )- 框力口以 資料框 内部壓 下,為 縮過程 元流' 產生將 至解量 像素差 )資料 用移動 動補償 碼像素 元流的 為解碼 預測之 測之修 中,在 外處理 (H )逆向,或(lil )雙向預測而使 編碼之雙向(B )資料框,前述三種預 先前I或P資料框,(ii ) 一個後續工或 一者之組合,而資料框本身並不可用 編碼之用。 中 個或一個以上的影像資料區 縮技術加以編碼。 求對於所造成的編碼視訊位元流加以 被逆轉及倒轉。例如,變動長度解碼 ^,並跟隨著運行長度解碼,其後的 解星化轉換係數區塊。之後,一個逆 化轉換係數區塊以產生(丨)解碼像素 異資料(依據對應的影像資料原先是 =内部或者(2 )資料框際壓縮技術而 補償資料框際壓縮技術,貝,jf料框際 ς考貧料框貧料而被應用至像素差異 ΐ Ϊ 6 ί中之移動補償量由壓縮過裎 里所決定。移動補償參考資料 ^賢料的一個預測而像素差異資料 ^。β因此,移動補償資料框際加法 ::編碼視訊位元流已經產生之後, 傳統上,編碼視訊位元流先前已由6 2 18 4 V. Other information boxes of the description of the invention (2) 〇 Based on (i) the data frame pressure test comes from (i P data frame, or (for other data / idea: data can be used in p and B) The frame is decoded in any case, and the special pressure can be applied to the bit dequantization process to convert the applied data or (2) whether to use (1 set) separately. If addition is used, the shift data is used to generate the coded bit frame data during the solution. It can be seen that this step corresponds to the pre-application must be applied in many applications, as well as the forward and contraction technology) a iii)-the frame force mouth is pressed down inside the data frame to generate a flow of elements for the contraction process' To the solution pixel difference) The data is used for the motion compensation code pixel stream for decoding prediction. In the process of (H) reverse, or (lil) bidirectional prediction, the bidirectional (B) data frame is encoded. Three types of pre-I or P data frames, (ii) a successor or a combination, and the data frame itself cannot be used for coding. One or more image data reduction techniques are used for encoding. The resulting encoded video bit stream is reversed and inverted. For example, variable-length decoding ^, followed by run-length decoding, followed by destaring the transform coefficient block. After that, an inverse conversion coefficient block is used to generate (丨) decoded pixel heterogeneous data (based on the corresponding image data originally = internal or (2) data frame compression technology to compensate the data frame compression technology. The amount of motion compensation used in the analysis of the poor material frame is applied to the pixel difference. Ϊ 6 The amount of motion compensation in ί is determined by the compression process. Motion compensation reference material ^ a prediction of the material and pixel difference data ^. Β Therefore, Inter-frame addition of motion compensation data :: After the encoded video bit stream has been generated, traditionally, the encoded video bit stream has been previously

第?頁 4 6 2 18 4 五、發明說明(3) 另一個(可能是遠端的)處理器所產生,並被視為一個輸 入以用於預期的額外處理。例如,吾人可能期望執行"轉 碼"功能,其中一個現存的編碼視訊位元流(遵循一種視訊 壓縮/解壓縮演算法之位元流)被轉換至一個相對應的編 碼視訊位元流(遵循另一種不同的視訊壓縮/解壓縮演算法 之位元流)。一個用於實現此種轉碼作業的"猛暴"方法用 於將輸入位元流完全解碼至解碼像素領域(依據第一視訊 壓縮/解壓縮演算法)並將所造成之解碼像素資料完全編 碼至輸出位元流(依據第二視訊壓縮/解壓縮演算法)。 另一種可能的應用則為將一個水印插入一個現存的編碼 視訊位元流。同樣地,在此對於水印插入的一個猛暴力量 方法被用於將輸入位元流完全解碼至解碼像素頜域,並實 現像素領域的解碼像素之處理以便插入所期望的水印,之 後並將修正後之像素資料完全重新編碼以產生所期望之處 理後輸出編碼視訊位元流。 在一個傳統的以轉換為基礎的視訊壓縮/解壓縮演算法 中,前向與逆向轉換步驟以編碼複雜度以及處理時間而言 可能相當昂貴。另外,對於漏失性轉換而言,逆向轉換之 應用以及其後對於前向轉換(在現存的編碼視訊位元流之 猛暴力量的處理期間)之再應用一般將造成包含在輸入位 元流的資訊漏失,並將導致解碼影像品質(再處理過的位 元流之影像品質)之降級。因此,吾人期待得以對一個輸 入位元流執行特定處理作業(例如,關於轉碼或水印插入 )而不需首先將位元流完全解碼。如果這種處理作業可於No? Page 4 6 2 18 4 V. Description of the invention (3) Generated by another (possibly remote) processor and considered as an input for the intended additional processing. For example, we may expect to perform the "transcoding" function, in which an existing encoded video bitstream (a bitstream that follows a video compression / decompression algorithm) is converted to a corresponding encoded video bitstream (Following a different stream of video compression / decompression algorithms). A "violent" method for implementing such transcoding operations is used to completely decode the input bit stream into the field of decoded pixels (based on the first video compression / decompression algorithm) and decode the resulting pixel data Fully encoded into the output bitstream (based on the second video compression / decompression algorithm). Another possible application is to insert a watermark into an existing encoded video bitstream. Similarly, a brute force method for watermark insertion is used to completely decode the input bit stream into the decoded pixel jaw field, and implement the decoded pixel processing in the pixel field to insert the desired watermark, and then modify it The subsequent pixel data is completely re-encoded to produce the desired processed output encoded video bit stream. In a traditional conversion-based video compression / decompression algorithm, the forward and reverse conversion steps can be quite expensive in terms of coding complexity and processing time. In addition, for missing conversions, the application of reverse conversion and subsequent re-application of forward conversion (during the processing of the violent volume of existing encoded video bitstreams) will generally result in Loss of information will result in degradation of decoded image quality (image quality of the reprocessed bitstream). Therefore, we look forward to being able to perform specific processing operations on an input bitstream (for example, with regard to transcoding or watermark insertion) without first having to fully decode the bitstream. If such processing is available at

4 6 2 18 4 五、發明說明(4) 轉換領域中執行且不至於造成大量的資訊漏失,便可避免 昂貴且具有漏失性之逆向與前向轉換步驟。 發明總紬 本發明被應用至視訊壓縮與解壓縮技術,該技術得以對 一個現存的編蝎視訊位元流執行進一步處理而不需首先將 輸入位元流完全解碼。特別言之,本發明使部分解碼之視 訊資料得以在轉換領域處理而不產生大量(或者甚至可能 任何)包含在輸入位元流的資訊漏失。因此,本發明可避 免必須將昂貴以及漏失性之逆向以及前向轉換步驟應用於 現存的輸入位元流之處理期間。 依據本發明,任何用於產生輸入編碼視訊位元流之移動 補彳員貨料框際視訊壓縮技術被限制於根據與區塊界限相一 致之移動向量。例如,在一個根據一個(8X 8 ) DCT轉換之 站P E G視现壓縮演算法中’移動向量元件被限制於8的整數 七(’、中之整數可以為正,負,或零)。因此,處理作業 可f應用至轉換領域中的部份解碼視訊資料而不至於產生 大量t或可能任何的)的資訊漏失。對於一個傳統的mpeg 視Λ,縮/解壓縮演算法而言,輸入編碼視訊位元流可以 11變動長度解碼,運行長度解碼方式加以解碼,並且被 解里化以產生DCT係數資料。因為移動向量被限制於與區 1界限相—致,之後,移動補償資料框際加法便可於DCT 轉換領域内執行而不需首先應用一個逆向DCT轉換。 後,发邮、屯丄、 々 /、所造成之移動補償轉換資料則可sub jected至轉換 領域中特別的期望處理作業(例如,轉碼作業,水印插4 6 2 18 4 V. Description of the invention (4) Performed in the field of transformation without causing a large amount of information leakage, can avoid expensive and leaky reverse and forward conversion steps. Summary of the Invention The present invention is applied to video compression and decompression technology, which can perform further processing on an existing scorpion video bitstream without first completely decoding the input bitstream. In particular, the present invention enables partially decoded video data to be processed in the field of conversion without generating a large (or possibly even any) loss of information contained in the input bit stream. Thus, the present invention avoids the need to apply expensive and leaky reverse and forward conversion steps to the processing of existing input bit streams. In accordance with the present invention, any mobile patcher video compression technique used to generate input coded video bitstreams is limited to motion vectors that are consistent with block boundaries. For example, in a station PEEG visual compression algorithm based on a (8X 8) DCT conversion, the 'movement vector element' is limited to an integer of eight seven (', the integer in can be positive, negative, or zero). Therefore, the processing operation can be applied to part of the decoded video data in the conversion field without generating a large amount of information loss (or possibly any). For a traditional mpeg video Λ, reduction / decompression algorithm, the input encoded video bit stream can be decoded with varying lengths, decoded by running length decoding, and decomposed to generate DCT coefficient data. Because the motion vector is limited to match the boundary of zone 1, afterwards, the interframe addition of motion compensation data can be performed in the DCT transformation field without first applying an inverse DCT transformation. After that, the movement compensation conversion data caused by mailing, registration, and / or conversion can be sub-jected to the special desired processing operation in the conversion field (for example, transcoding operation, watermark insertion

4 6 2 18 4 五、發明說明(5) 入)。之後,依據該應用,其所造成的處理DCT係數資料可 被到至少某些移動估計,移動補償資料框際減法,再量 化,運行長度再編碼,以及變動長度再編碼以產生所預期 之處理輸出編碼視訊位元流,而不須實現分離的逆向以及 前向D C T轉換步驟。 依據一種具體實施例,本發明係一種壓縮視訊資料之方 法,該方法包含下列步驟:(a )在一個視訊資料的資料框 内依據相對應的參考資料執行移動估計以便為資料框識別 一組移動向量,其中之移動估計被限制於僅識別與參考資 料中之區塊界限相一致的以區塊為基礎的移動向量而且至 少以區塊為基礎的移動向量其中之一是一個非零的移動向 量;(b )將移動補償資料框際差異依據參考資料以及以區 塊為基礎的移動向量而應用至視訊資料以產生資料框際差 異資料;以及(c )將一個或更多的額外視訊壓縮步驟應用 至資料框際差異資料以便為一個對應至視訊資料的編碼視 訊位元流產生编碼貢料。 依據另一項具體實施例而言,本發明係一種用於處理一 個現存的輸入編碼視訊位元流之方法,該方法包含下列步 驟:(a )將一個或更多個解碼步驟應用至輸入位元流以回 復在一個轉換領域以及相對應之以區塊為基礎的移動向量 中的轉換係數資料,其中之以區塊為基礎的移動向量被限 制於與對應之參考資料中的區塊界限相一致;(b )在轉換 領域之中執行移動補償資料框際加法,依據以區塊為基礎 的移動向量以及參考向量以產生預測誤差修正(PEC )轉換4 6 2 18 4 V. Description of the invention (5) Enter). After that, according to the application, the processed DCT coefficient data can be processed to at least some motion estimation, motion compensation data frame subtraction, requantization, run length recoding, and variable length recoding to produce the expected processing output. Encode the video bit stream without the need to implement separate reverse and forward DCT conversion steps. According to a specific embodiment, the present invention is a method for compressing video data. The method includes the following steps: (a) performing a motion estimation based on corresponding reference data in a data frame of a video data in order to identify a group of movements for the data frame Vector, where motion estimation is limited to identifying only block-based motion vectors that are consistent with the block boundaries in the reference and at least one of the block-based motion vectors is a non-zero motion vector (B) applying the inter-frame difference of the motion compensation data to the reference data and the block-based motion vector to the video data to generate the inter-frame difference data; and (c) one or more additional video compression steps It is applied to the data frame difference data to generate coding data for a coded video bit stream corresponding to the video data. According to another specific embodiment, the present invention is a method for processing an existing input encoded video bit stream. The method includes the following steps: (a) applying one or more decoding steps to the input bit Metastream responds to the conversion coefficient data in a transformation field and the corresponding block-based motion vector. The block-based motion vector is limited to the block boundary in the corresponding reference data. Consistent; (b) Performing an inter-frame addition of motion compensation data in the transformation field, generating prediction error correction (PEC) transformations based on block-based motion vectors and reference vectors

第10頁 4 6 2 18 4 五、發明說5月(6) 係數資料;以及(c )對轉換領域中的PEC轉換係數資料執 行後續處理。 再根據另一種具體實施例而言,本發明係一種用於壓縮 視訊資料之方法,包含下列步驟:(a )在一個視訊資料之 資料框執行移動估計,根據相對應的參考資料以便為資料 框識別一組移動補償,其中之移動估計被限制於僅識別以 區塊為基礎的移動向量(與參考資料中的區塊界限相一致 的移動向ΐ且所有的以區塊為基礎的移動向量為零移動向 量);(b )將移動補償資料框際差異應用至視訊資料,根 據差異資料以及以區塊為基礎的移動向量以產生資料框際 差異資料以便為一個對應至視訊資料的編碼視訊位元流產 生編碼資料1其中之編碼視訊位元流遵循一種Μ P E G 壓縮/ 解壓縮演算法。 圖示簡述 本發明之其他方面,特性,以及優點將由下列詳述,附 錄之申請專利範圍,以及所附之說明圖而得以完全說明, 其中: 圖1顯示依據本發明之一項具體實施例而得之移動補償 資料框際視訊壓縮處理之方塊圖; 圖2與3 說明傳統移動估計處理(圖2 )以及本發明用於 影像實訊的(8 X 8 )方塊之移動估計處理(圖3 )二者之間的 差異; 圖4顯示移動補償資料框際視訊壓縮處理的一個方塊 圖,依據本發明的交替具體實施例;以及Page 10 4 6 2 18 4 V. Inventory May (6) coefficient data; and (c) follow-up processing of PEC conversion coefficient data in the conversion field. According to another specific embodiment, the present invention is a method for compressing video data, including the following steps: (a) performing a motion estimation in a data frame of a video data, and according to the corresponding reference data to form a data frame Identify a set of motion compensations, where the motion estimation is limited to identifying only block-based motion vectors (movement directions consistent with the block boundaries in the reference and all block-based motion vectors are (Zero motion vector); (b) applying the frame-to-frame difference of the motion compensation data to the video data, and generating the frame-to-frame difference data based on the difference data and the block-based motion vector so as to encode a video bit corresponding to the video data Metastream generates encoded data1 The encoded video bitstream follows a MPEG compression / decompression algorithm. The diagram briefly describes other aspects, features, and advantages of the present invention, which will be fully explained by the following detailed description, the patent application scope of the appendix, and the accompanying explanatory drawings, wherein: FIG. 1 shows a specific embodiment according to the present invention The obtained block diagram of the motion compensation data frame video compression processing; Figures 2 and 3 illustrate the traditional motion estimation processing (Figure 2) and the motion estimation processing of the (8 X 8) block of the present invention for image information (Figure 3) ) The difference between the two; FIG. 4 shows a block diagram of an in-frame video compression process for motion compensation data, according to an alternate embodiment of the present invention; and

第11頁 4 6 2 18 4 五、發明說玥(7) 圖5 顯示部分解碼處理的一個方塊圖,依據本發明的一 項具體實施例。 圖示之詳述 圖1顯示移動補償資料框際視訊壓縮處理的一個方塊 圖,依據本發明的一種具體實施例。依據該具體實施例, 移動向量被限制與區塊界限相一致。 特別言之’以區塊為基礎的移動估計1 0 2被貫現在與適 當參考資料相關的輸入影像資料。根據資料框際視訊壓縮 處理是否係依據(i )前向預測,(i i )後向預測,或者 (i 1 1 )雙向預測,參考資料將分別依據下列資料而產生: (1 ) 一個先前資料框,(i 1 )—個後續資料框,或者(1 1 i ) 二者的組合(例如:先前與後續資料框的平均)。在任何 情況下,移動估計處理嘗試識別參考資料(依據某些相似 性測量,例如:絕對像素差異(S A D )而與目前之影像資料 區塊幾乎相符合)的一個區塊。依據本發明,使用於移動 估計處理期間的參考資料之區塊集合被限制於對應至區塊 界限的區塊。在傳統的移動估計處理中並不存在這種限 制,而可用於移動估計處理的參考資料區塊在一個特定的 搜尋範圍之内對應至任何像素(或者甚至是次像素)位 置。 圖2與3說明傳統移動估計處理(圖2 )以及本發明用於 (8 X 8 )影像資料區塊的移動估計處理(圖3 )二者之間的差 異。圖2與3顯示對一個特別(8x8 )影像資料區塊之參考資 料的搜呼區域’該影像貰料在餐考資料的對應位置以一個Page 11 4 6 2 18 4 V. Invention (7) Fig. 5 shows a block diagram of a part of the decoding process, according to a specific embodiment of the present invention. DETAILED DESCRIPTION OF THE DRAWINGS FIG. 1 shows a block diagram of inter-frame video compression processing of motion compensation data, according to a specific embodiment of the present invention. According to this specific embodiment, the motion vector is restricted to coincide with the block boundary. In particular, the block-based motion estimation 102 is performed on input image data related to appropriate reference data. According to whether the data frame video compression processing is based on (i) forward prediction, (ii) backward prediction, or (i 1 1) bidirectional prediction, the reference data will be generated based on the following data: (1) a previous data frame , (I 1) —a subsequent data frame, or (1 1 i) a combination of the two (eg, the average of the previous and subsequent data frames). In any case, the motion estimation process attempts to identify a block of reference material (based on some similarity measures, such as: absolute pixel difference (S A D) that almost matches the current block of image data). According to the present invention, the block set of reference data used during the motion estimation process is limited to the block corresponding to the block limit. This limitation does not exist in traditional motion estimation processing, and the reference data blocks that can be used for motion estimation processing correspond to any pixel (or even sub-pixel) location within a specific search range. Figures 2 and 3 illustrate the difference between the traditional motion estimation process (Figure 2) and the motion estimation process (Figure 3) for (8 X 8) image data blocks of the present invention. Figures 2 and 3 show the search area of reference data for a special (8x8) image data block. The image data is displayed in a

第12頁 462184 五、發明說明(8) j ( 8 X 8 )區塊(具有—個對應於區塊中心㈢,〇 )的移動向 置^的f式而顯示在圖中。圖2與3的搜尋區域係依據移動 向里而叱,其中之移動向量的每個成分之大小皆限制於3 像素(亦即,移動向量成分可各別在_ 8到+ 8之間變勤)。 囷2之所示在傳統以整數像素為基礎的移動估計處 理之下,有28 9種不同的可用(8χ8 ) #考資料方塊對應於 2 8 9種不同的以整數為基礎的移動向量,該移動向量係根 據17種不同整數成分數值(自_8至+ 8 )之組合。在依據" 斷像素"之移動估計方案中,甚至可得更多的參考資料方 塊。 另一方面,如圖3之所示,對於本發明的此項以區塊 基礎的移動估計處理的特殊案例而言,可用的參考資料 塊被限制於對應至區塊界限的9個區塊(亦即,具有依據 種不同成分值(-8 ’ 〇 ’以及+ 8 )之組合而得的9個移動向 量其中之一)。由此種以區塊為基礎的移動估計方案所告 .成的傳統預測將較傳統以像素為基礎的移動估計方案更。 精確,但對於5午多應用而言,以區塊為基礎的預測之精 度已可接受。 由於可用的參考資料區塊之數目對於一個特定的搜尋範 圍而言已大幅降低(例如,在圖2與3的範例中之範圍為由& 2 8 9至9) ’本發明這種以區塊為基礎的移動估計處理得以 更快執行。再者’搜尋範圍可被大幅廷伸 > 並可降低相關 於傳統以像素為基礎的移動估計方案的移動姑計所需之= 理時間。例如,將搜尋範圍延伸至± 24而非± 8仍將留下^Page 12 462184 V. Description of the invention (8) j (8 X 8) block (having a movement direction corresponding to the block center ㈢, 0) is shown in the figure f. The search areas in Figures 2 and 3 are based on moving inward. The size of each component of the motion vector is limited to 3 pixels (that is, the components of the motion vector can be varied between _ 8 and + 8 respectively. ). As shown in 囷 2, under the traditional integer-pixel-based motion estimation process, there are 28 9 different types available (8χ8). #The data box corresponds to 2 8 9 different integer-based motion vectors. The Motion vectors are based on a combination of 17 different integer component values (from _8 to +8). In the motion estimation scheme based on " broken pixels ", even more reference blocks are available. On the other hand, as shown in FIG. 3, for this particular case of the block-based motion estimation process of the present invention, the available reference data blocks are limited to 9 blocks corresponding to the block boundaries ( That is, it has one of 9 motion vectors obtained based on a combination of different component values (-8 ′ 0 ′ and +8). The traditional prediction based on this block-based motion estimation scheme will be more than the traditional pixel-based motion estimation scheme. Accurate, but the accuracy of block-based prediction is acceptable for multi-day applications. Since the number of available reference blocks has been significantly reduced for a specific search range (for example, the range in the example of Figures 2 and 3 is given by & 2 8 9 to 9) Block-based motion estimation processing is performed faster. Furthermore, the search range can be extended significantly > and it can reduce the processing time required for the traditional pixel-based motion estimation scheme. For example, extending the search range to ± 24 instead of ± 8 will still leave ^

第13頁 案號 88116755Page 13 Case No. 88116755

4 6 2 Ί 8 4 修正 五、發明說明(9) 僅4 9個(8 X 8 )用於處理的參考資料區塊。事實上,搜尋範 圍可被延伸至±64,在相同數目的參考區塊(亦即,289) 可用於以像素為基礎的移動估計(其搜尋範圍被限制在± 8 )之前。 根據特別視訊壓縮演算法並根據資料框之形態(例如,Ρ 或Β),區塊的移動估計1 0 2處理可識別出三種不同以區塊 為基礎的的移動向量(用於每個影像資料區塊):一個依 據前向預測,另一個依據後向預測,最後一個則依據雙向 預測。模式控制1 0 4處理在移動估計之後執行以決定如何 對目前的影像資料區塊加以編碼,包括使用資料框内部編 碼技術加以編碼之可能性。根據該編碼模式控制之結果, 之後,可對影像資料使用對應的移動補償參考資料而執行 資料框際差異1 0 6以產生區塊移動補償資料框際像素差異 資料。 在任何情況下,一個轉換1 08,例如一個(8x8) DCΤ轉 換,被應用於像素領域資料區塊以產生一個轉換係數之區 塊,之後該區塊經由量化1 1 0,運行長度1 1 2,以及變動長 度編碼1 1 4的處理而產生編碼視訊位元流的一部分。雖然 並未顯示於圖1 ,在適當時機,用於將影像資料區塊編碼 之移動向量也被編碼至位元流。 由於運行長度編碼1 1 2以及變動長度編碼1 1 4 一般皆為較 少漏失之編碼步驟,圖1的壓縮演算法之.一部分的解碼處 理(例如,圖1的上方路徑)之開始可以是由量化區塊11 0 所產生的量化係數資料,且不至於產生影響視訊壓縮/解4 6 2 Ί 8 4 Amendment V. Description of the invention (9) Only 4 9 (8 X 8) reference blocks for processing. In fact, the search range can be extended to ± 64, before the same number of reference blocks (ie, 289) can be used for pixel-based motion estimation (the search range is limited to ± 8). According to the special video compression algorithm and the shape of the data frame (for example, P or B), the block motion estimation process can identify three different block-based motion vectors (for each image data) Block): one based on forward prediction, another based on backward prediction, and the last based on bidirectional prediction. The mode control 104 process is performed after motion estimation to determine how to encode the current image data block, including the possibility of encoding using data frame internal coding techniques. According to the result of the control of the encoding mode, the corresponding motion compensation reference data may be used for the image data to execute the inter-frame difference 1 06 to generate block motion compensation data and the inter-frame pixel difference data. In any case, a transformation 1 08, such as an (8x8) DCT transformation, is applied to the pixel field data block to generate a block of conversion coefficients, and then the block is quantized 1 1 0 and run length 1 1 2 , And the processing of variable length coding 1 1 4 to generate a part of the coded video bit stream. Although not shown in Figure 1, at the appropriate time, the motion vectors used to encode the image data blocks are also encoded into the bitstream. Since the running length encoding 1 1 2 and the variable length encoding 1 1 4 are generally less missing encoding steps, one of the compression algorithms in FIG. 1. The decoding process (for example, the upper path in FIG. 1) can be started by The quantization coefficient data generated by the quantization block 11 0 will not affect the video compression / decompression

0:\60\60523.ptc 第14頁 2001.07.06.014 4 6 2 18 4 五、發明說明(10) ' 一.— 壓縮演算法可靠度之危險。特別地,來自 轉換係數被解量化丨丨6以及逆向轉換u 8 ’ 2 / 的量化 移動補償資料框際加法丨2 0被應用於產生表^曰日^機’ 考資料或許可用於對另一組影像資料蝙碼/貝;斗,该茶 精通此技藝之人將瞭解:除了本發明 移動估計之外,圖i的處理步驟之其餘部八:鬼為基礎的 視訊壓縮技術(例如遵循一種⑽^標準:2來傳統的 行。 」敁鈿技術)而執 圖4顯示一個移動補償資料框際視訊 圖,依據本發明的另_種交具體^處理的方塊 體實施例所示,移動向量被限制於與區:二;,1的具 前的Γ美4〇1被應用在位於移動估言HOk 式控侧Si移:此,區塊—制約式移動估計4。2,模 之内執行,而//補償f料框際差異4Q6都在轉換領域 内執行。由:t同圖1的具體實施例一般在像素領域之 生在編瑪哭间Ϊ動估計以及補償在轉換領域之内執行’發 .. Ζ 貝路徑的移動補償資料框際加法4 20之步驟 ::於π換領域之内執行。因此,在編碼過程中完全不需 行逆向轉換。量化步驟4 1 0,運行長度編碼4 1 2 ,變動長 又爲馬 以及解量化4 1 6可與圖1的具體實施例的類似 步驟相同8 圖5示二卩分解碼處理的—個方塊圖’依據本發明的一 ,具姐二%例°圖5的部分解碼處理被設計用於在現存的 、扁碼視汛位元凌(使用圖1的以區塊為基礎的移動補償資料0: \ 60 \ 60523.ptc Page 14 2001.07.06.014 4 6 2 18 4 V. Description of the invention (10) 'I. — The danger of the reliability of the compression algorithm. In particular, the inter-frame addition of quantized motion compensation data from the conversion coefficients dequantized 6 and inverse transformation u 8 '2 / is used to generate the table ^ 日 日 ^ 机' test data or permission for another Group of video data bats / shells; people who are proficient in this skill will understand: In addition to the motion estimation of the present invention, the rest of the processing steps of Figure i: Ghost-based video compression technology ^ Standard: 2 to the traditional line. "敁 钿 Technology" and Figure 4 shows an inter-frame video diagram of motion compensation data. According to another embodiment of the present invention, the motion vector is shown in Figure 4. Restricted to AND region: two ;, the previous Γ 美 401 is applied to the motion estimation HOk-style controlled-side Si shift: this, block-constrained motion estimation 4.2, performed within the mode, And // compensation 4Q6 of the inter-frame difference is performed in the conversion field. From: t The specific embodiment of FIG. 1 is generally born in the pixel field. In the field of motion estimation and compensation is performed within the conversion field. The motion compensation data of the Z-beam path is added in the frame. 4 20 steps :: Execute within the π swap field. Therefore, no reverse conversion is required during the encoding process. The quantization step 4 1 0, the run length encoding 4 1 2, the variation length is again horse and the dequantization 4 1 6 can be the same as the similar steps of the specific embodiment of FIG. 8. FIG. 5 shows a block diagram of the binary division processing. 'According to the first aspect of the present invention, there are 2% of cases. The part of the decoding process of FIG. 5 is designed to view the current data in the existing, flat code (using the block-based motion compensation data of FIG. 1).

第15頁 五、發明說明“1) ------ =際視訊壓縮演算法而產生)之中操作。特別地,部分解 j處理接收—個輸入位元流並將之部分解碼以產釭 里化轉換資料…’額外的處理步驟(例如:㈣於株 :::水印插入且並未顯示在圖5中的步驟)可在轉換:員 3 ”:到解量化轉換資料以產生-個處理後的轉換資、 二“巧U玄貢料可進一步編碼而產生一個預期的處理過 的娜碼視訊位元流。 度地軍、移動向量解碼5 0 2 ’模式解碼5 04,以及變動長 :八仃長度解碼/解量化5 06被應用至輸入Page 15 V. Invention description "1) ------ = generated by the video compression algorithm). In particular, the partial solution j processes and receives an input bit stream and decodes it to produce a part. Transforming the conversion data ... 'Additional processing steps (for example: the step of inserting a watermark ::: watermark that is inserted and not shown in Figure 5) can be converted in: member 3 ”: to dequantize the conversion data to generate one After processing the conversion data, the two Qiao U Xuan Gong materials can be further encoded to generate an expected processed stream of Na-code video bits. Du Dijun, motion vector decoding 5 0 2 'mode decoding 5 04, and variable length : Hachiman length decoding / dequantization 5 06 is applied to the input

貢訊(亦即,不办尸掄3 ^ “〕松式控市J 即:内插十、:,疋否依據河向,後向,或者雙向(亦 加以編石M ., a , 0 ,貝了十^邛技蚵或貧料框際技術 應於轉二域==?轉換(例如,)係數(對 A j- Θ 右疋可得,記憶體A 5 0 8保留對庫於__诒砝_ , 轉換領域參考資料(例如:解量二:)…料框的 ^1 ^ ^ t ,4 „ # ,ΓΛ Λ-Λ1'116 ,參考資料(來自記憶體。對應 加以平;= = = =別得出)區塊由平均節點川 四位測的内插參考資料。 料所=器514的狀態由來自區塊5 04的解碼模式爾 二V; n:ated)。如果Ϊ式控制資料指出| = 即,〆動刀、為514被切換至钟以自記憶體A將適杏的(亦 、動補償)後續資料框參考資料館入加二 462184 五、發明說明(12) 位置。如杲模式控制資料指出"前向預測,”則切換器5 i 4 被切換至得以自記憶體B將適當的先前資料框參考資料饋 入加總節點5 1 6的位置。如果模式控制資料指出"雙向預 測,”則切換器5〗4被切換至得以自平均節點5 1 2將適當的 内插茶考資料饋入加總節點5 1 6的位置。最後,如果模式 控制資料顯示"内部-編碼",則切換器514被置於地面以 便將零饋入加總節點5 1 6。 曰在任何,種情況下,在加總節點5 1 6 ’來自區塊5 〇 6的解 量=D、CT係數由切換器514而被加入所選定的轉換-領域參 考資料藉以使用預測誤差修正預測值。在適當的情況下 (亦即,如旲曰a :欠„ 田j I月/几· r 節點51 6的轉換“料’:框:個1或?貝料框)’來自加總 個戍更多Λ 皮回饋入記憶體Α Μ ’以便用於將- 訊資料框加以編碼的參考資料。 如DCT的轉換是里線\限制於與&塊界限相一致,並且由於諸 加法可於轉換領试的,加總、節點5 1 6的移動補償資料框際 換。因此’除了 1之内執仃亚且不須首先應用一個逆向轉 516所造成的移里化漏失以及相似漏失之外,在加總節點 麻® & 動補償轉換資料對應於可因A亩i m k u 未:影像資料而造成的轉換資料。之 :驟未顯示於圖 :後,額外處理 處理後的碥碼視 T ;又肟^ s而要用於產生預期的 包含轉換領蜮,再運在=:下1外處理步驟可 下,轉換領計以及移動補償。在適當; 中的移動估計以及/或者移動補償步驟可ΥGongxun (that is, do not do corpse 3 ^ "] pine-style control city J namely: interpolated ten,:, whether it is based on the river direction, backward, or both (also edited by M., A, 0, For example, the technique or the frame-space technique should be converted to the second domain ==? Conversion (for example,) coefficients (for A j- Θ, right is available, memory A 5 0 8 is reserved for the library in __诒 重 _, Conversion field reference material (for example: solution two:) ... ^ 1 ^ ^ t, 4 „#, ΓΛ Λ-Λ1'116 of the material frame, reference material (from memory. Flatten correspondingly; = = = = Don't get it) The interpolation reference data of the block measured by the average node and the four digits. It is expected that the state of the device 514 is determined by the decoding mode from block 504 (2; n: ated). If the type control The data pointed out | = That is, the automatic knife, 514 was switched to the clock to self-memory A will be suitable for apricot (also, motion compensation) follow-up data frame reference library into the plus 2 462184 V. Description of the invention (12).杲 The mode control data states "forward prediction," then the switch 5 i 4 is switched to a position where it can feed the appropriate previous data frame reference from memory B to the summing node 5 1 6. If The control data indicates "two-way prediction," then the switcher 5 is switched to a position where it can feed the appropriate interpolated tea test data from the average node 5 1 2 to the summing node 5 1 6. Finally, if the mode is controlled The data shows "internal-encoding", then the switcher 514 is placed on the ground to feed zero into the summing node 5 1 6. In any case, in the summing node 5 1 6 'from block 5 〇6's solution amount = D, CT coefficients are added by the switch 514 to the selected transformation-domain reference material to use the prediction error to correct the predicted value. Where appropriate (ie, as in 旲 a: 欠 田j I month / day · r node 51 6 conversion "material": box: 1 or? shell material box) 'from a total of 戍 more Λ skin feedback into memory Α Μ' for use in Reference materials that are encoded in boxes. For example, the DCT conversion is inside the line \ Limited to be consistent with the & block limit, and because the additions can be tested in the conversion, the total, node 5 1 6 motion compensation data is exchanged between frames. . Therefore 'except for the execution of 仃 within 1 without first applying a reverse turn 516 In addition to the migrating leakage and similar leakage, the conversion data of the total node hemp® & dynamic compensation corresponds to the conversion data that can be caused by Amu imku: image data. The: step is not shown in the figure: later, The additional code after processing is regarded as T; and oxime ^ s is used to generate the expected conversion collar, which is then transported to the next step: = 1. The external processing step can be performed, conversion collar calculation and motion compensation. In the appropriate; Motion estimation and / or motion compensation steps

第17頁 462184 五 '發明說明(13) ' -*-*- f略。例如,%杲來自輸入位元流的移動向量被再次使 二移動估計可被忽$ ,如果輸出位元流的產生並無移 動補乜,則移動估計以及移動補償二者皆可被忽略。 你訊壓縮/解壓縮演算法之外,本發明亦可用 Μ田L的現訊壓縮/解壓縮演算,包括根據除了( 8x8 ) 及供叙具之二之轉換的演算法以及/或者不包括運行長度以 及-交動長度編碼步驟以及/ $去冬古# 碼步驟的演算法 3有其他額外的後量化編 本發明可採用雷路虚 在一诗置,, 之方式加以實現,包括可能將之 如 腦 所將瞭解的是:電路元件上2 —位精通此技勢之人 現成為一個軟趙箱4 +=不同功忐也可在數位領域中實 如,-個數位μ;理!^理步驟。該軟體可被用於’例 取m也戚處理為,與扯㈤ 认&币j為’ 5乂者一般用途的電 本I明可以數種方法以 加以具鹘卟 ,^ 久用於貝現該方法的裝置等形式 式〜内嵌於有形媒介的程式碼之形 硬碟機,沒去杠/ * %媒體之例為軟碟機,CD-ROM, A嘗任何其他可由 當程式碼由一部應装r彳I由杈裔瀆取之儲存媒介,其中’ 機器便成為麻‘:如,電腦)載入並執行之時,該 x两貝現本發明的一絲狀突 人 (例如)~種儲存媒介的P 4種哀置。本發明亦可以儲存於 機器由-部機器載入並/ : $碼的形式而加以具體化’該 在某些傳輪:彳γ或者經由光纖電瘦,或 或纜線連接) #杀”或載具(例如過量電氣接線 上傳輸,“當程式碼由一部機器(例如—P.17 462184 Five 'Explanation of the invention (13)'-*-*-f omitted. For example, the motion vector from the input bit stream is again used to make the second motion estimation impossible. If the output bit stream is generated without motion compensation, both motion estimation and motion compensation can be ignored. In addition to your compression / decompression algorithms, the present invention can also use the compression / decompression algorithms of M Field L, including algorithms based on conversions other than (8x8) and available for interpretation, and / or excluding operation. Length and the -crossing length encoding step and / $ 去 冬 古 # encoding step algorithm 3 has other additional post-quantitative editing. The present invention can be implemented in the way of Lei Luxiu, including including possible As the brain will understand: 2 people on the circuit element who are proficient in this skill are now a soft Zhao box 4 + = different functions can also be true in the digital field,-digital μ; 理! ^ 理step. This software can be used to 'exemplify m' as well as to deal with the problem of recognition & coin j as '5'. General-purpose electronic notebooks can be used in several ways to be used, have been used for many years. The present method of the device and other forms ~ a hard disk drive with a code embedded in the tangible medium, without removing the bar / *% The example of the medium is a floppy disk drive, CD-ROM, A try any other A storage medium that should contain r 渎 I taken from a fork, where 'the machine becomes hemp': eg, a computer) When it is loaded and executed, the two x-rays appear as a filamentous protrusion of the present invention (for example) ~ 4 kinds of storage media lament. The present invention can also be stored in a machine loaded by-machine and embodied in the form of: $ code 'should be used in some transmission wheels: 彳 γ or thin through fiber optic cable, or connected by cable) # 杀 "or Vehicles (such as excessive electrical wiring, "when the code is

第18頁Page 18

案號 88116755 修正 4 6 2 18 4 五、發明說明(14) 部電腦)載入並執行之時,該機器便成為實現本發明的一 種裝置。若在一部一般用途的處理器執行之時,程式碼區 段便與處理器組合以提供一種獨一無二的裝置(其操作與 特定邏輯電路相似)。 吾人尚可瞭解:關於上述用以解釋本發明之本質的描述 以及說明的細節,材料,以及安排亦可由精通此技藝之人 在不違背下列關於本發明的專利申請事項的原則與範圍之 情況下加入各種變化。 元件符號說明 102 區 塊 移 動 估 計 104 模 式 控 制 106 資 料 框 架 差 異 108 轉 換 110 量 化 1 12 運 行 長 度 114 變 動 長 度 編 碼 116 解 量 化 118 逆 向 轉 換 120 移 動 補 償 資 料 框 際 加 法 40 1 轉 換 402 區 塊 制 約 式 移 動 估 計 404 模 式 控 制 406 移 動 補 償 資 料 框 際 差 異 410 量 化 412 運 行 長 度 編 碼 414 變 動 長 度 編 石馬 416 解 量 化 420 移 動 補 償 資 料框際加法 502 移 動 向 量 解 碼 504 模 式 解 碼 506 變 動 長 度 解 碼/ /運行長度 解 碼 / 解 量 化 5 08 解 量 化 轉 換 係套 〔記憶體A 5 10 解 量 化 轉 換 係彰 l記憶體B 5 12 平 均 hfz 即 點 5 14 四 位 切 換 器 516 加 i'k 即 點Case No. 88116755 Amendment 4 6 2 18 4 5. When the invention description (14 computers) is loaded and executed, the machine becomes a device for implementing the present invention. When executed on a general-purpose processor, the code section is combined with the processor to provide a unique device (which operates similarly to a specific logic circuit). I can still understand: the details, materials, and arrangements about the above descriptions and explanations to explain the essence of the present invention can also be made by those skilled in the art without departing from the following principles and scope of the patent application matters concerning the present invention Add various changes. Component symbol description 102 Block movement estimation 104 Mode control 106 Data frame difference 108 Transformation 110 Quantization 1 12 Run length 114 Variable length coding 116 Dequantization 118 Inverse transformation 120 Motion compensation data inter-frame addition 40 1 Transformation 402 Block-constrained motion estimation 404 mode control 406 inter-frame difference of motion compensation data 410 quantization 412 run length coding 414 variable length coding Shima 416 dequantization 420 motion compensation data inter-frame addition 502 motion vector decoding 504 pattern decoding 506 variable length decoding // run length decoding / solution Quantization 5 08 dequantization conversion system [memory A 5 10 dequantization conversion system memory 1 memory B 5 12 average hfz point 5 14 four-position switcher 516 plus i'k point

0:\60\60523.ptc 第19頁 2001.07. 06.0190: \ 60 \ 60523.ptc Page 19 2001.07. 06.019

Claims (1)

案號 881 16755 六、申請專利範圍 |cy^年"7耳祀卻 ! "ΤΤΤΤ^ζ^Γ 修正 i. 一種用於壓縮視訊資料的方法,包含下列步驟: Ca) 依據對應的參考資料執行該視訊資料t 一個資料 框的移動估計,以便為該資料框識別一組移動向量,其中 該移動估計被限制於僅識別以區塊為基礎的移動向量,該 移動向量與參考資料的區塊界限一致,且至少一個以區塊 為基礎的移動向量是一個非零的移動向量; (b ) 依據該參考資料及該等以區塊為基礎的移動向 量,將移動補償資料框際差異應用於該視訊資料上以便產 生資料框際差異資料:以及 (c ) 將一個或多個額外視訊壓縮步驟應用至該資料框 際差異資料,以便為一個對應於視訊資料的編碼視訊位元 流產生編碼資料。 2 .如申請專利範圍第1項的方法,其中步驟(a )與(b )在 一個像素領域内執行而步驟(c )則包含下列步驟: (1 ) 將一種轉換應用到該資料框際差異資料,以便在 一轉換領域内產生轉換係數資料;以及 (2 ) 將轉換係數資料量化以產生量化轉換係數資料。 3 .如申請專利範圍第2項的方法,其中編碼視訊位元流 遵循一 Μ P E G壓縮/解壓縮演算法,而該種轉換則是一種分 離餘弦轉換(DCT )。 4.如申請專利範圍第1項的方法,其尹步驟(a )尚包含 應用一轉換至像素資料1以產生一轉換資料中轉換係數資 料的步驟,其中該移動估計依據該轉換領域中的參考資料 被應用到轉換係數資料。Case No. 881 16755 6. Scope of patent application | cy ^ year " 7 ear worship! &Quot; ΤΤΤΤ ^ ζ ^ Γ correction i. A method for compressing video data, including the following steps: Ca) According to the corresponding reference materials Execute the video data t motion estimation of a data frame to identify a set of motion vectors for the data frame, where the motion estimation is limited to identifying only block-based motion vectors, which are related to blocks of reference data Consistent boundaries, and at least one block-based motion vector is a non-zero motion vector; (b) applying the reference frame and the block-based motion vectors to apply the inter-frame difference of the motion compensation data to The video data to generate data frame difference data: and (c) apply one or more additional video compression steps to the data frame difference data to generate coded data for a coded video bit stream corresponding to the video data . 2. The method according to item 1 of the scope of patent application, wherein steps (a) and (b) are performed in a pixel field and step (c) includes the following steps: (1) applying a transformation to the data frame difference Data to generate conversion coefficient data in a conversion field; and (2) quantize the conversion coefficient data to generate quantized conversion coefficient data. 3. The method according to item 2 of the patent application, wherein the encoded video bit stream follows an MPPEG compression / decompression algorithm, and the conversion is a discrete cosine transform (DCT). 4. The method according to item 1 of the patent application scope, wherein the Yin step (a) further includes the step of applying a conversion to the pixel data 1 to generate a conversion coefficient data in the conversion data, wherein the motion estimation is based on a reference in the conversion field. The data is applied to the conversion coefficient data. 6052J.p[c 第1頁 2001.09. 05.022 4 6 2 1 8 4 案號 88116755 ----------------------- -------------- # κ「修正 修正 六' 申請專利範圍 yu丨 5 . 一 種 機 器 可 讀 取 的 媒 介 其 上具 有 已 編 碼 的 程 式 碼 1 其 中 1 當 該 程 式 碼 由 一 部 機 器 執 行時 該 機 器 執 行 下 列 步 驟 ; (a ) 在 j— 個 視 訊 料 框 中 依據對應 的 參 考 資 料 執 行 該 移 動 估 計 以 便 為 該 資 料 框 識 別 一組 移 動 向 量 其 中 該 移 動 估 計 被 限 制 於 僅 識 別 與 該 參 考 資料 中 的 區 塊 界 限 相 一 致 的 以 區 塊 為 基 礎 的 移 動 向 量 且 至少 有 — 以 區 塊 為 基 礎 的 移 動 向 量 是 一 個 非 零 的 移 動 向 量 > (b ) 將 移 動 補 償 資 料 框 際 差 異依據該參考 資 料 及 以 塊 為 基 礎 的 移 動 向 量 應 用 到 該 視 訊貧料 以 使. 產 生 資 料 框 際 差 異 資 料 以 及 (c ) 將 一 個 或 多 個 額 外 視 訊 壓縮 步 驟 應 用 到 該 資 料 框 際 差 異 資 料 ϊ 以 便 為 一 個 對 應 該 視訊 t 料 的 已 編 碼 視 訊 位 元 流 產 生 編 碼 資 料 0 6 種 用 以 處 理 一 現 有 輸 入 '編 碼視訊 位 元 流 的 方 法 該 方 法 包 含 下 列 步驟 (a ) 將 -^ 個 或 多 個 解碼步驟應用 到 該 輸 入 位 元 流 以 便 在 ^ 個 轉 換 領 域 及 對 應 的 以 區 塊為基 礎 之 移 動 向 量 中 回 復 轉 換 係 數 資 料 其 中 該 以 區塊為基礎的移動向 量 被 限 制 於與對應的參考資料 中 區 塊 界 限相 — 致 (b ) 在 該 轉 換 領 域 中依據 以 區塊 為 基 礎 的 移 動 向 量 以 及該參考資料執行移動補償資料框際加 法 > 以 便 產 生 預 測 誤 差 修 正 (EPC ) 轉招 ΐ係 c資料; 以及 (c ) 在 該 轉 換 領 域 中 於E PC轉換係數資料上執行後6052J.p [c Page 1 2001.09. 05.022 4 6 2 1 8 4 Case No. 88116755 ----------------------- ------- ------- # κ "Revision 6" Application for patent scope yu 丨 5. A machine-readable medium has encoded code 1 on it 1 of which 1 when the code is executed by a machine The machine performs the following steps; (a) performs the motion estimation based on the corresponding reference data in the j-video frames to identify a set of motion vectors for the data frame, where the motion estimation is limited to identifying only the Block-based motion vectors with consistent block boundaries and at least—the block-based motion vector is a non-zero motion vector> (b) The inter-frame differences in motion compensation data are based on the reference and Block-based motion vectors are applied to the video material to make Generate data frame difference data and (c) apply one or more additional video compression steps to the data frame difference data ϊ in order to generate coded data for an encoded video bit stream corresponding to the video material 0 6 types Method for processing an existing input 'encoded video bitstream The method includes the following steps (a) Applying-^ or more decoding steps to the input bitstream in order to transform fields and corresponding blocks in The conversion coefficient data is returned in the motion vector based on which the block-based motion vector is limited to correspond to the block limit in the corresponding reference material-so (b) in the conversion field based on the block-based The motion vector and the reference data are used to perform an inter-frame addition of the motion compensation data > to generate a prediction error correction (EPC). Data; and (c) after implementation on the EPC conversion coefficient data in the conversion domain 60523 -ρΐ c 第2頁 2001.09.05. 023 4 6 2 18 4 修正 案號 881 16755 六,申請專利範圍 續處理。 7 .如申請專利範圍第6項之方法,其中至少一個以區塊 為基礎的移動向量是一個非零之移動向量。 8 .如申請專利範圍第6項之方法,其十該編碼視訊位元 流符合一 Μ P E G編解碼演算法,而該轉換領域則對應到一個 D C Τ轉換領域。 9 .如申請專利範圍第6項之方法,其中步驟(c )包含應 用一個或多個視訊壓縮步驟以產生一個處理後的輸出編碼 視訊位元流。 1 0 .如申請專利範圍第9項之方法,其令一個或多個視訊 壓縮步驟包含在轉換領域中將移動補償資料框際差異應用 到處理後的轉換係數,以產生轉換係數差異資料。 1 1 . 一種機器可讀取的媒介,其上具有已編碼程式碼, 其中,當該程式碼由一部機器所執行時,該機器完成下列 步驟: (a ) 將一個或多個解碼步驟應用到一個現有的輸入視 訊位元流1以回復在一個轉換領域及相對應的以區塊為基 礎的移動向量中的轉換係數資料,其中該以區塊為基礎的 移動向量被限制於與相對應的參考資料中的區塊界限一 致; (b) 在該轉換領域中依據該等以區塊為基礎的移動向 量及該參考資料執行移動補償資料框際加法,以便產生預 測誤差修正(P E C )轉換係數資料;以及 (c ) 在該轉換領域中,於P EC轉換係數資料上執行後60523 -ρΐ c Page 2 2001.09.05. 023 4 6 2 18 4 Amendment No. 881 16755 VI. Scope of Patent Application Continued processing. 7. The method of claim 6 in which at least one block-based motion vector is a non-zero motion vector. 8. If the method according to item 6 of the patent application is applied, the coded video bit stream conforms to a MPEG encoding and decoding algorithm, and the conversion field corresponds to a DC conversion field. 9. The method according to item 6 of the patent application, wherein step (c) comprises applying one or more video compression steps to generate a processed output encoded video bit stream. 10. The method according to item 9 of the scope of patent application, which causes one or more video compression steps to include the motion compensation data frame difference to the processed conversion coefficients in the conversion field to generate conversion coefficient difference data. 1 1. A machine-readable medium having encoded code thereon, wherein when the code is executed by a machine, the machine completes the following steps: (a) applying one or more decoding steps To an existing input video bit stream 1 to restore the conversion coefficient data in a conversion field and the corresponding block-based motion vector, where the block-based motion vector is limited to the corresponding The block boundaries in the reference material are consistent; (b) In the conversion field, an inter-frame addition of motion compensation data is performed based on the block-based motion vectors and the reference material to generate a prediction error correction (PEC) conversion. Coefficient data; and (c) in this conversion area, after implementation on P EC conversion coefficient data 6052j.ptc 第3頁 2001.09.05.024 案婼 88116755 申請專利範圍 續處理。 12. 一 (a ) 動估計1 移動向量 而所有以 以區塊為 框際差異(c ) 差異資料 流產生已 解碼演算 種壓 依據 其中 ,該 區塊 將移 基礎 資料 將一 ,以 編碼 法。 縮視訊資 對應參考 該移動估 移動向量 為基礎的 動補償資 的移動向 ;以及 個或多個 修正 料的方法,包含下列步驟: 資料,於一個視訊資料框上執行移 計被限制於僅識別以區塊為基礎的 與參考資料中的區塊界限相一致, 移動向量均為零移動向量; 料框際差異依據該參考資料及該等 量應用到該視訊資料,以產生資料 額外視訊壓縮步驟應用到資料框際 便為一個對應該視訊資料的已編碼視訊位元 資料,其中該編碼視訊位元流符合一 Μ P E G編6052j.ptc Page 3 2001.09.05.024 Case 婼 88116755 Scope of Patent Application Continued processing. 12. One (a) motion estimation 1 motion vector, and all block-based inter-frame difference (c) difference data stream generated decoded algorithm based on which, the block will shift the basic data will be one, using the encoding method. The video information corresponds to the movement direction of the motion compensation data based on the motion estimation motion vector; and the method of one or more correction materials, including the following steps: Data, the execution of the movement meter on a video data frame is limited to identifying only The block-based basis is consistent with the block boundaries in the reference material, and the motion vectors are all zero motion vectors. The inter-frame difference is based on the reference material and the amount is applied to the video data to generate additional video compression steps. When applied to the data frame, it is an encoded video bit data corresponding to the video data, where the encoded video bit stream conforms to a MPEG coding 6052J.ptc 第4頁 2001.09.05.0256052J.ptc Page 4 2001.09.05.025
TW88116755A 1998-09-29 1999-09-29 Block motion video coding and decoding TW462184B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10221498P 1998-09-29 1998-09-29
US12153199P 1999-02-25 1999-02-25

Publications (1)

Publication Number Publication Date
TW462184B true TW462184B (en) 2001-11-01

Family

ID=26799139

Family Applications (1)

Application Number Title Priority Date Filing Date
TW88116755A TW462184B (en) 1998-09-29 1999-09-29 Block motion video coding and decoding

Country Status (1)

Country Link
TW (1) TW462184B (en)

Similar Documents

Publication Publication Date Title
JP5385414B2 (en) Variable precision inter-picture timing designation method and apparatus in digital video encoding processing
US8467442B2 (en) Image searching device and method, program and program recording medium
JP4226172B2 (en) Video compression encoding apparatus and decoding apparatus using adaptive conversion method and method thereof
US8285064B2 (en) Method for processing images and the corresponding electronic device
JPH11275592A (en) Moving image code stream converter and its method
EP1110179B1 (en) Subband coding/decoding
CN100456836C (en) Encoding device and method
TW200836130A (en) Bitrate reduction method by requantization
EP1601204A1 (en) Apparatus for scalable encoding/decoding of moving image and method thereof
CN101164336B (en) Image information recording device and image information recording method
CN111034198B (en) Image encoding and decoding methods, encoding and decoding equipment and corresponding computer programs
CN100428800C (en) Moving image decoding device and method
CN108605131B (en) Method and apparatus for encoding and decoding data, and corresponding recording medium
TW462184B (en) Block motion video coding and decoding
JP2010268505A (en) Block motion video coding and decoding
JP3691725B2 (en) Encoded image editing apparatus, encoded image editing method, and encoded image editing program recording medium
US20090198757A1 (en) Method and device for avoiding rounding errors after performing an inverse discrete cosine transformation
JP2005507620A (en) compression
JP2000013791A (en) Image encoding device and image encoding method, image decoding device and image decoding method, and providing medium
JP3263902B2 (en) Video encoding apparatus and method, and video decoding apparatus and method
JP4390009B2 (en) Encoding apparatus and method, and image processing system
JPH09187001A (en) Arithmetic unit and arithmetic method
JPH05183894A (en) Image coding / decoding device
Hwang et al. Conformance test of MPEG-4 shape decoding
JPH07154802A (en) Image coding method and image coding apparatus

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent
MM4A Annulment or lapse of patent due to non-payment of fees