WO2003017676A2 - Motion-adaptive noise reduction pre-processing for digital video signal - Google Patents

Motion-adaptive noise reduction pre-processing for digital video signal Download PDF

Info

Publication number
WO2003017676A2
WO2003017676A2 PCT/US2002/024867 US0224867W WO03017676A2 WO 2003017676 A2 WO2003017676 A2 WO 2003017676A2 US 0224867 W US0224867 W US 0224867W WO 03017676 A2 WO03017676 A2 WO 03017676A2
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
frame
amplitude
current frame
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2002/024867
Other languages
French (fr)
Other versions
WO2003017676A3 (en
Inventor
Siu-Wai Wu
Jing Yang Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arris Technology Inc
Original Assignee
General Instrument Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Instrument Corp filed Critical General Instrument Corp
Priority to EP02794854.6A priority Critical patent/EP1438862B1/en
Priority to MXPA04001375A priority patent/MXPA04001375A/en
Priority to CA2456252A priority patent/CA2456252C/en
Priority to EP06076414.9A priority patent/EP1711019B1/en
Priority to KR1020047002223A priority patent/KR100960742B1/en
Priority to AU2002356069A priority patent/AU2002356069A1/en
Publication of WO2003017676A2 publication Critical patent/WO2003017676A2/en
Publication of WO2003017676A3 publication Critical patent/WO2003017676A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/142Detection of scene cut or scene change
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/15Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/192Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
    • H04N19/194Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive involving only two passes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H04N19/615Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding using motion compensated temporal filtering [MCTF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20182Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20192Edge enhancement; Edge preservation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream

Definitions

  • the present invention relates to an apparatus and method for reducing noise in a video system by applying motion compensated temporal filtering using previously generated motion vectors and adaptive spatial filtering at scene change frames.
  • Digital television offers viewers high quality video entertainment with features such as pay-per-view, electronic program guides, video-on-demand, weather and stock information, as well as Internet access.
  • the video images, packaged in an information stream are transmitted to the user via a broadband communication network over a satellite, cable, or terrestrial transmission medium. Due to bandwidth and power limitations, efficient transmission of film and video demands that compression and formatting techniques be extensively used. Protocols such as MPEG1 and MPEG2 maximize bandwidth utilization for film and video information transmission by adding a temporal component to a spatial compression algorithm.
  • Each individual image in a sequence of images on film or video is referred to as a frame.
  • Each frame is made up of a large number of picture elements (pixels) that define the image.
  • redundant pixels describe like parts of a scene, e.g. a blue sky.
  • Various types of compression algorithms have been used to remove redundant spatial elements thereby decreasing the bandwidth requirements for image transmission.
  • Sequences of frames on film or video often contain pixels that are very similar or identical as well.
  • compression and motion compensation protocols such as MPEG, are typically used to minimize these redundant pixels between adjacent frames.
  • Frames referenced by an encoder for the purpose of predicting motion of images within adjacent frames are called anchor frames.
  • anchor frames can be of type Intra-frame (I- frame) or Predicted-frame (P-frame). Groups of pixels (macroblocks) that are mapped without reference to other frames make up I- frames, while P-frames contain references to previously encoded frames within a sequence of frames.
  • a third type of frame referred to as a Bi-directional (B-frame) contains macroblocks referred from previously encountered anchor frames and macroblocks from anchor frames that follow the frame being currently analyzed. Both B- frame and P-frame encoding reduce duplication of pixels by calculating motion vectors associated with macroblocks in a reference frame, resulting in reduced bandwidth requirements. The choice of encoding type for a particular frame is dependent upon the complexity of that image.
  • a motion vector directs the video processor where to obtain the macroblock in a referenced frame.
  • motion compensation can also be exploited to help reduce the effect of noise in encoded video images.
  • noise can be introduced into video prior to compression and transmission.
  • Artifacts from the imaging and recording equipment, from terrestrial or orbital transmission equipment, from communication channels, and from encoding and decoding equipment are well known.
  • Noise introduced prior to image compression is problematic because it interferes with the performance of subsequent compression systems by monopolizing data bandwidth while decreasing video quality.
  • quantizing in the Discrete Cosine Transform (DCT) domain tends to magnify the effects of noise leading to increased signal degradation. While filtering reduces noise in a video image, it can, consequently, reduce the resolution (e.g. sharpness) of the image, leading to imprecise edge transitions, thereby reducing apparent focus.
  • DCT Discrete Cosine Transform
  • An edge is defined as an abrupt change in pixel amplitude such as a color difference and/or luminance amplitude change between sets of pixels. These abrupt changes are typically oriented in a vertical or horizontal direction, such as an edge between a blue sky and a black building. Accordingly, there is a need for an improved noise filtering system that would reduce many of the disadvantageous effects found with contemporary digital image filters.
  • the present invention provides a solution for solving these problems while simultaneously providing enhanced throughput of film or video frame encoding.
  • the present invention relates to an apparatus and method for reducing noise in a video system by applying a motion compensated temporal filtering algorithm using previously generated motion vectors, and adaptive spatial filtering at scene change frames.
  • a motion compensated temporal and adaptive spatial filtering sub-system for pre-compressed video image data is described.
  • the buffered frames include a current frame, a first anchor frame that precedes the frame currently being encoded, and a second anchor frame that follows the current frame.
  • the images on each of these frames are represented by a plurality of pixels, where each pixel exhibits a signal amplitude. Many of the images on the current frame are repeated on the first (preceding) and second (following) frames in the Group of Pictures (GOP).
  • GOP Group of Pictures
  • the frame is processed using P-frame or B-frame encoding.
  • P-frame encoding a forward prediction stage is implemented, whereby an absolute value of the difference between the amplitude of a pixel in the current frame and the amplitude of a pixel in the first frame is determined. This value is used to evaluate a non-linear filter coefficient, ⁇ (forward), for an Infinite Impulse Response (IIR) filter using a lookup table implementation.
  • ⁇ (forward) for an Infinite Impulse Response (IIR) filter
  • a proportional value for the amplitude of the previous anchor frame pixel is determined, and is multiplied by the filter coefficient ⁇ (forward). The result is added to the proportional value of the selected pixel amplitude in the current frame, multiplied by (l- ⁇ (forward)).
  • ⁇ (forward) the filter coefficient
  • l- ⁇ (forward) the filter coefficient
  • a current frame pixel amplitude is calculated.
  • the temporal filtering process is divided into two stages. The first stage, forward prediction, behaves identically to the P-frame encoding scheme described above.
  • the pixel data for the current frame, as filtered by the forward prediction process of the first stage, is thereafter sent to a second stage where the backward prediction process filters the frame once again.
  • An absolute value difference between the amplitude of a pixel located in a current frame and the amplitude of a pixel located in a second (following) frame is calculated.
  • the second frame pixel location is offset from the current frame pixel location by a previously calculated motion vector.
  • a non-linear IIR filter coefficient, ⁇ (backward) is determined from a lookup table, with values between 0 and 1, corresponding to the calculated absolute value difference.
  • the location of the pixel in the second frame is specified by a location in the current frame, but offset by an amount described by a previously calculated motion vector.
  • the product of ⁇ (backward) and the motion compensated second frame pixel value yields a proportion of the second anchor frame pixel value that is represented within the current frame pixel value.
  • the product of (l- ⁇ (backward)) and the current frame pixel value results in a proportion of the current anchor frame pixel value that should contribute to the final current frame pixel value.
  • the sum of these two partial frame pixel values represents the current frame pixel value.
  • the results of these temporally filtered pixel amplitude values are further processed by spatial filtering and other system elements in a pipeline architecture.
  • Delay elements are also introduced to provide a degree of look-ahead for providing statistical multiplexing rate control.
  • the motion vectors herein described can be calculated by a first-pass encoder or alternatively using transcoding. This, in effect eliminates the need for regeneration of the motion vectors during subsequent filtering steps.
  • each output frame pixel value equals a weighted mean value that is a composite of neighboring pixels amplitude values.
  • the weight of a neighboring pixel is determined by a predetermined reference table, and is inversely proportional to the distance of each pixel from the subject pixel.
  • Each non-linear filter has associated with it, a filter coefficient that adapts to the absolute value difference between the input pixel amplitude and the weighted sum of the neighboring pixel amplitudes.
  • FIG. 1 illustrates an example system processing architecture block diagram in accordance with the present invention.
  • FIG. 2 illustrates the processing pipeline associated with the noise-reduction processor and the first pass encoder.
  • FIG. 3 illustrates an adaptation of the filter coefficient indicating multiple filter intensities.
  • FIG. 4 illustrates the two stage adaptive filtering pipeline for B-frame pixels.
  • FIG. 1 illustrates a block diagram of an example processing architecture of the video frame encoding sub-system in accordance with the present invention.
  • the subsystem is one part of a larger digital video encoding system.
  • the sub-system is composed of the following elements: a first-pass encoder 100; a noise reduction preprocessor 102; a second pass encoder 104; a master compression controller (MCC) 106; a packet processor 108; and a video FIFO queue and packet creator 110.
  • MCC master compression controller
  • the first-pass encoder 100, noise reduction preprocessor 102 and second pass encoder 104 act in concert to estimate the complexity of incoming video frames, filter the incoming video for noise, and are responsible for compressing the incoming video images.
  • the second pass encoder prepares need parameters, and provides this information to a rate control processor (not shown), which in turn provides a corresponding encoding bit rate allocation to the second pass encoder.
  • the cascade of first and second pass encoders encodes a single channel of input data and performs data compression that includes motion compensation (for P- and B-frames), discrete cosine transform (DCT) and quantization.
  • the encoders may provide feedback information to the rate control processor regarding the actual encoding bit rate.
  • a master compression controller (MCC) 106 controls the compression of the data for the encoders via a peripheral component interconnect (PCI) bus.
  • the encoded data is provided to a packet creator 110 that works in connection with a packet processor 108 to provide a multiplexed bitstream of video data.
  • a video first- in, first-out (FIFO) buffer 110 temporarily stores the compressed data, and a packet processor 108 forms packets of the compressed data with appropriate header information, e.g., according to the MPEG-2 or other video standard. Thereafter, the data is sent to a transmitter for transmission of the output stream across a channel.
  • a receiver, a buffer, and a demultiplexer are provided to output a decoded video signal, e.g., for display on a television.
  • the noise reduction preprocessor 102 applies spatial and temporal filtering to incoming video frames to reduce the effects of video noise.
  • the temporal filter uses motion vectors supplied by the first-pass encoder to accurately apply noise filtering to moving objects within a succession of video frames, while simultaneously reducing system resource usage.
  • transcoding can be used to obtain the requisite motion vectors. Transcoding allows previously calculated motion vectors to be sent to the temporal filter within the bit-stream sent along the channel.
  • FIG. 2 A data flow diagram for a general noise-reduction preprocessing pipeline is shown in FIG. 2. As indicated, video capture, horizontal decimation and detelecine are performed on the video frames by the first-pass encoder 100 prior to noise reduction preprocessing.
  • These frames are sent to the video capture module 112 of the noise reduction preprocessor and delayed by a conventional delay element 114.
  • Type encoding, and motion vector synthesis are also performed by the first-pass encoder and sent to a circular buffer 116, then on to the temporal and spatial 118 filter modules within the noise reduction preprocessor.
  • the noise reduction preprocessor, and the temporal filter uses this information to perform an adaptive infinite impulse response (IIR) filtering on successively received frames. Thereafter, filtered video frames are sent to a series of delay elements 120 and finally sent to a video output driver 122 to be transmitted to the second pass encoder 104 for further processing.
  • IIR adaptive infinite impulse response
  • the noise reduction preprocessor performs adaptive spatial filtering and motion compensated temporal filtering to reduce the effects of video source noise before compression. It also delays the video to provide a look-ahead for statistical multiplexing rate control and for special event processing.
  • the motion compensated temporal filter is an IIR filter.
  • the motion vectors generated by the first-pass encoding are used to trace motion of objects within frames.
  • the filter For P frames, the filter generates the following output for every pixel pOut at coordinate (x,y):
  • pin [x, y] is the input pixel at address [x,y] of the current P frame.
  • prevPOut [x, y] is the pixel value at address [x, y] of the previous output P frame
  • [MNx, MNy] is the field motion vector, half pel value truncated. MNy is scaled to the frame coordinate according to the field select bit in the motion vector.
  • FIG. 3 An example of the adaptive characteristic of the temporal filter coefficient is shown in FIG. 3. Multiple lookup tables are used to describe this adaptive characteristic. For the pixels on the edges, the filter coefficient ⁇ tends toward zero, which implies that no filtering is applied.
  • the motion compensated temporal filter is implemented in two stages, as shown in Fig. 4.
  • the first stage as shown in the outlined box 126, performs forward prediction by implementing the temporal filter with the preceding P frame to generate an intermediate result for every pixel bOutl at coordinate [x,y] using the forward motion vectors [MVxfwd , MNyf W d]:
  • bin [x, y] is the input pixel at address [x,y] of the current B frame
  • pOutfwd [x, y] is the pixel value at address [x, y] of the P frame used for forward prediction.
  • the frame is stored in the multiple frame delay 130 shown in FIG. 4, and fed to the Motion Compensator 128 as needed.
  • [MNX w , MNy fwd ] is the forward field motion vector, rounded to an integer value, and scaled to the frame coordinate according to the field select bit in the forward motion vector.
  • pOutfwd [x- MNXfw , y- MVyfwd] is performed in the motion compensator section 128 by combining the Forward motion vectors with the pixel information, pOut fWd [x,y] supplied by the multiple frame delay 130.
  • ⁇ fwd is a nonlinear function of the absolute difference between bln[x, y] and pOutfwd [x- MNXfwd, y- MNyf w d].
  • the operation is performed by the absolute difference calculator 132 shown in Fig. 4. followed by a search for a filter function, ⁇ W , from a lookup table 134.
  • a selector 138 examines the result of a scene change detector 140. If the selector 138 receives a scene change notification, then the selector chooses the result of the adaptive spatial filter 152 to be sent to a delay stage 130 and outputs to a second pass encoder.
  • the intermediate result bOutl[x, y] is sent to a delay stage 130 and then on to the second stage of the temporal filter 142.
  • the following P frame is also chosen by the selector 138 to be sent to the second stage filter where the final filtered output bOut at coordinate [x,y] is generated using the backward motion vectors [MVx b w d , MVy bwd ]:
  • pOut b wd[x, y] is the pixel value at address [x, y] of the P frame used for backward prediction.
  • This frame is input to the second stage filter through the multiple frame delay 130.
  • [MNXbwd, MVybwd] is the backward field motion vector, rounded to an integer value, and scaled to the frame coordinate according to the field select bit in the motion vector.
  • pOutbwd[x- Vxbwd, y- MVybwd] is determined by the motion compensator 144 by using the backward motion vectors.
  • ⁇ bWd - ⁇ b w d is a nonlinear function of the absolute difference between bOutl [x, y] and pOutbwd[x,y], offset by the relevant motion vectors and implemented by the combination of the absolute difference calculator 146, and a lookup table 148.
  • weighting table is used to calculate the weighted me
  • the weighting table is designed such that the pixels closer to the center of the 5x5 window have a higher weight. Such weighting helps to preserve texture in the image.
  • the filter coefficient ⁇ adapts to the absolute value difference between f[x,y] and ⁇ . Look up tables are used to select the coefficient value. An assortment of look up tables are established that allow users to select from the various intensity levels of the filter. As with the temporal filter, the faster ⁇ rolls off the coefficient adaptation curve, the weaker the filter is. The filter coefficient takes the values from zero to one. For the pixels with intensities close to the mean, the filter coefficient ⁇ tends toward one, and the filter becomes an average filter, which implies the strong filtering.
  • the present invention provides an improved apparatus and method for reducing the presence of noise in a video system by applying motion compensated temporal filtering using motion vectors previously generated by a first-pass encoder.
  • adaptive spatial filtering combined with a weighting table provides varying degrees of filtering based on pixel location relative to one another and edges. This operation preserves textures within images.
  • accuracy and processing throughput are enhanced.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Picture Signal Circuits (AREA)

Abstract

Noise is reduced in a video system by applying motion compensated temporal filtering using previously generated motion vectors and adaptive spatial filtering at scene change frames. In addition to improvements made to FIR spatial filtering, the present invention improves on previous filtering techniques by using Infinite Impulse Response (IIR) temporal filtering to reduce noise while maintaining edge definition. It also uses motion vectors previously calculated as part of the first-pass image encoding or alternatively by trans coding to reduce computational complexity for P-frame and B-frame image preprocessing. Single stage P-frame temporal noise filtering and double stage B-frame temporal noise filtering are presented.

Description

NOISE REDUCTION PRE-PROCESSOR FOR DIGITAL VIDEO USING PREVIOUSLY GENERATED MOTION VECTORS AND ADAPTIVE
SPATIAL FILTERING
BACKGROUND OF THE INVENTION
The present invention relates to an apparatus and method for reducing noise in a video system by applying motion compensated temporal filtering using previously generated motion vectors and adaptive spatial filtering at scene change frames.
Digital television offers viewers high quality video entertainment with features such as pay-per-view, electronic program guides, video-on-demand, weather and stock information, as well as Internet access. The video images, packaged in an information stream, are transmitted to the user via a broadband communication network over a satellite, cable, or terrestrial transmission medium. Due to bandwidth and power limitations, efficient transmission of film and video demands that compression and formatting techniques be extensively used. Protocols such as MPEG1 and MPEG2 maximize bandwidth utilization for film and video information transmission by adding a temporal component to a spatial compression algorithm.
Each individual image in a sequence of images on film or video is referred to as a frame. Each frame is made up of a large number of picture elements (pixels) that define the image. Within each frame, redundant pixels describe like parts of a scene, e.g. a blue sky. Various types of compression algorithms have been used to remove redundant spatial elements thereby decreasing the bandwidth requirements for image transmission. Sequences of frames on film or video often contain pixels that are very similar or identical as well. In order to maximize bandwidth utilization, compression and motion compensation protocols, such as MPEG, are typically used to minimize these redundant pixels between adjacent frames. Frames referenced by an encoder for the purpose of predicting motion of images within adjacent frames are called anchor frames. These anchor frames can be of type Intra-frame (I- frame) or Predicted-frame (P-frame). Groups of pixels (macroblocks) that are mapped without reference to other frames make up I- frames, while P-frames contain references to previously encoded frames within a sequence of frames. A third type of frame referred to as a Bi-directional (B-frame) contains macroblocks referred from previously encountered anchor frames and macroblocks from anchor frames that follow the frame being currently analyzed. Both B- frame and P-frame encoding reduce duplication of pixels by calculating motion vectors associated with macroblocks in a reference frame, resulting in reduced bandwidth requirements. The choice of encoding type for a particular frame is dependent upon the complexity of that image. For images that pan, pixels that describe moving objects are largely the same, in that they are only spatially displaced. Instead of repeatedly specifying these pixels in consecutive frames, it is often advantageous to reference groups of them, i.e. macroblocks, in previous (or forthcoming) frames. A motion vector directs the video processor where to obtain the macroblock in a referenced frame. The use of motion vectors for this purpose is referred to as motion compensation. Motion compensation can also be exploited to help reduce the effect of noise in encoded video images.
Various types of noise can be introduced into video prior to compression and transmission. Artifacts from the imaging and recording equipment, from terrestrial or orbital transmission equipment, from communication channels, and from encoding and decoding equipment are well known. Noise introduced prior to image compression is problematic because it interferes with the performance of subsequent compression systems by monopolizing data bandwidth while decreasing video quality. Additionally, quantizing in the Discrete Cosine Transform (DCT) domain tends to magnify the effects of noise leading to increased signal degradation. While filtering reduces noise in a video image, it can, consequently, reduce the resolution (e.g. sharpness) of the image, leading to imprecise edge transitions, thereby reducing apparent focus. An edge is defined as an abrupt change in pixel amplitude such as a color difference and/or luminance amplitude change between sets of pixels. These abrupt changes are typically oriented in a vertical or horizontal direction, such as an edge between a blue sky and a black building. Accordingly, there is a need for an improved noise filtering system that would reduce many of the disadvantageous effects found with contemporary digital image filters. The present invention provides a solution for solving these problems while simultaneously providing enhanced throughput of film or video frame encoding.
SUMMARY OF THE INVENTION
The present invention relates to an apparatus and method for reducing noise in a video system by applying a motion compensated temporal filtering algorithm using previously generated motion vectors, and adaptive spatial filtering at scene change frames.
In a two-pass video compression and encoding system, a motion compensated temporal and adaptive spatial filtering sub-system for pre-compressed video image data is described. By using a storage element that provides a frame buffer for storing at least three consecutive video frames, a noise reduction scheme can be implemented for input video frames. The buffered frames include a current frame, a first anchor frame that precedes the frame currently being encoded, and a second anchor frame that follows the current frame. The images on each of these frames are represented by a plurality of pixels, where each pixel exhibits a signal amplitude. Many of the images on the current frame are repeated on the first (preceding) and second (following) frames in the Group of Pictures (GOP). If the current frame is not determined to be a scene change frame, then the frame is processed using P-frame or B-frame encoding. For P-frame encoding, a forward prediction stage is implemented, whereby an absolute value of the difference between the amplitude of a pixel in the current frame and the amplitude of a pixel in the first frame is determined. This value is used to evaluate a non-linear filter coefficient, β(forward), for an Infinite Impulse Response (IIR) filter using a lookup table implementation. As a result of the panning of objects within the images, the first frame pixel location is offset from the current frame pixel location as described by a previously calculated motion vector. Using these motion vectors, a proportional value for the amplitude of the previous anchor frame pixel is determined, and is multiplied by the filter coefficient β(forward). The result is added to the proportional value of the selected pixel amplitude in the current frame, multiplied by (l-β(forward)). Applying an arithmetic manipulation of their respective amplitude values along with the numerical values of β(forward), (l-( β(forward)), and the motion vectors associated with the previous anchor frame, a current frame pixel amplitude is calculated. For B-frame encoding, the temporal filtering process is divided into two stages. The first stage, forward prediction, behaves identically to the P-frame encoding scheme described above. The pixel data for the current frame, as filtered by the forward prediction process of the first stage, is thereafter sent to a second stage where the backward prediction process filters the frame once again. An absolute value difference between the amplitude of a pixel located in a current frame and the amplitude of a pixel located in a second (following) frame is calculated. The second frame pixel location is offset from the current frame pixel location by a previously calculated motion vector. A non-linear IIR filter coefficient, β(backward), is determined from a lookup table, with values between 0 and 1, corresponding to the calculated absolute value difference. The location of the pixel in the second frame is specified by a location in the current frame, but offset by an amount described by a previously calculated motion vector. The product of β(backward) and the motion compensated second frame pixel value yields a proportion of the second anchor frame pixel value that is represented within the current frame pixel value. The product of (l-β(backward)) and the current frame pixel value results in a proportion of the current anchor frame pixel value that should contribute to the final current frame pixel value. The sum of these two partial frame pixel values represents the current frame pixel value.
The results of these temporally filtered pixel amplitude values are further processed by spatial filtering and other system elements in a pipeline architecture. Delay elements are also introduced to provide a degree of look-ahead for providing statistical multiplexing rate control. The motion vectors herein described can be calculated by a first-pass encoder or alternatively using transcoding. This, in effect eliminates the need for regeneration of the motion vectors during subsequent filtering steps.
When a scene change frame is detected, the output from a non-linear adaptive spatial filter is selected in lieu of the motion compensated temporal filtered output. For adaptive spatial filtering, each output frame pixel value equals a weighted mean value that is a composite of neighboring pixels amplitude values. The weight of a neighboring pixel is determined by a predetermined reference table, and is inversely proportional to the distance of each pixel from the subject pixel. Each non-linear filter has associated with it, a filter coefficient that adapts to the absolute value difference between the input pixel amplitude and the weighted sum of the neighboring pixel amplitudes.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates an example system processing architecture block diagram in accordance with the present invention.
FIG. 2 illustrates the processing pipeline associated with the noise-reduction processor and the first pass encoder.
FIG. 3 illustrates an adaptation of the filter coefficient indicating multiple filter intensities.
FIG. 4 illustrates the two stage adaptive filtering pipeline for B-frame pixels.
DETAILED DESCRIPTION OF THE INVENTION
The present invention relates to an apparatus and method for reducing the presence of noise in a video system by applying motion compensated temporal filtering using previously generated motion vectors, in addition to adaptive spatial filtering. FIG. 1 illustrates a block diagram of an example processing architecture of the video frame encoding sub-system in accordance with the present invention. The subsystem is one part of a larger digital video encoding system.
The sub-system is composed of the following elements: a first-pass encoder 100; a noise reduction preprocessor 102; a second pass encoder 104; a master compression controller (MCC) 106; a packet processor 108; and a video FIFO queue and packet creator 110.
System Overview
The first-pass encoder 100, noise reduction preprocessor 102 and second pass encoder 104 act in concert to estimate the complexity of incoming video frames, filter the incoming video for noise, and are responsible for compressing the incoming video images. The second pass encoder prepares need parameters, and provides this information to a rate control processor (not shown), which in turn provides a corresponding encoding bit rate allocation to the second pass encoder. In effect, the cascade of first and second pass encoders encodes a single channel of input data and performs data compression that includes motion compensation (for P- and B-frames), discrete cosine transform (DCT) and quantization. The encoders may provide feedback information to the rate control processor regarding the actual encoding bit rate. A master compression controller (MCC) 106 controls the compression of the data for the encoders via a peripheral component interconnect (PCI) bus. The encoded data is provided to a packet creator 110 that works in connection with a packet processor 108 to provide a multiplexed bitstream of video data. A video first- in, first-out (FIFO) buffer 110 temporarily stores the compressed data, and a packet processor 108 forms packets of the compressed data with appropriate header information, e.g., according to the MPEG-2 or other video standard. Thereafter, the data is sent to a transmitter for transmission of the output stream across a channel. At a decoding side, a receiver, a buffer, and a demultiplexer are provided to output a decoded video signal, e.g., for display on a television.
The noise reduction preprocessor 102 applies spatial and temporal filtering to incoming video frames to reduce the effects of video noise. The temporal filter uses motion vectors supplied by the first-pass encoder to accurately apply noise filtering to moving objects within a succession of video frames, while simultaneously reducing system resource usage. Alternatively, transcoding can be used to obtain the requisite motion vectors. Transcoding allows previously calculated motion vectors to be sent to the temporal filter within the bit-stream sent along the channel. A data flow diagram for a general noise-reduction preprocessing pipeline is shown in FIG. 2. As indicated, video capture, horizontal decimation and detelecine are performed on the video frames by the first-pass encoder 100 prior to noise reduction preprocessing. These frames are sent to the video capture module 112 of the noise reduction preprocessor and delayed by a conventional delay element 114. Type encoding, and motion vector synthesis are also performed by the first-pass encoder and sent to a circular buffer 116, then on to the temporal and spatial 118 filter modules within the noise reduction preprocessor. The noise reduction preprocessor, and the temporal filter in particular, uses this information to perform an adaptive infinite impulse response (IIR) filtering on successively received frames. Thereafter, filtered video frames are sent to a series of delay elements 120 and finally sent to a video output driver 122 to be transmitted to the second pass encoder 104 for further processing.
Noise Reduction
The noise reduction preprocessor performs adaptive spatial filtering and motion compensated temporal filtering to reduce the effects of video source noise before compression. It also delays the video to provide a look-ahead for statistical multiplexing rate control and for special event processing.
Adaptive Temporal Filtering
The motion compensated temporal filter is an IIR filter. The motion vectors generated by the first-pass encoding are used to trace motion of objects within frames. For P frames, the filter generates the following output for every pixel pOut at coordinate (x,y):
pOut [x, y] - (1 - βfwd) * pin [x, y] + βfwd * prevPOut [ x - MVx , y - MNy ] where: pin [x, y] is the input pixel at address [x,y] of the current P frame.
prevPOut [x, y] is the pixel value at address [x, y] of the previous output P frame;
[MNx, MNy] is the field motion vector, half pel value truncated. MNy is scaled to the frame coordinate according to the field select bit in the motion vector.
βfwd is a nonlinear function of the absolute difference between pln[x, y] and prevPOut[x,y] , implemented by a lookup table, (i.e., βfW = Lookup-table ( I pln[x,y] - prevPOut [ x - MNx , y - MNy] | ).
An example of the adaptive characteristic of the temporal filter coefficient is shown in FIG. 3. Multiple lookup tables are used to describe this adaptive characteristic. For the pixels on the edges, the filter coefficient β tends toward zero, which implies that no filtering is applied.
For B frames, the motion compensated temporal filter is implemented in two stages, as shown in Fig. 4. The first stage, as shown in the outlined box 126, performs forward prediction by implementing the temporal filter with the preceding P frame to generate an intermediate result for every pixel bOutl at coordinate [x,y] using the forward motion vectors [MVxfwd , MNyfWd]:
bOutl[x, y] = (1 - βfWd) * bin [x, y] + β fwd * pOutfwd[ x -MNxfwd , y-MNywd ]
where: bin [x, y] is the input pixel at address [x,y] of the current B frame; pOutfwd [x, y] is the pixel value at address [x, y] of the P frame used for forward prediction. The frame is stored in the multiple frame delay 130 shown in FIG. 4, and fed to the Motion Compensator 128 as needed. [MNX w , MNyfwd] is the forward field motion vector, rounded to an integer value, and scaled to the frame coordinate according to the field select bit in the forward motion vector. pOutfwd [x- MNXfw , y- MVyfwd] is performed in the motion compensator section 128 by combining the Forward motion vectors with the pixel information, pOutfWd[x,y] supplied by the multiple frame delay 130. βfwd is a nonlinear function of the absolute difference between bln[x, y] and pOutfwd [x- MNXfwd, y- MNyfwd]. The operation is performed by the absolute difference calculator 132 shown in Fig. 4. followed by a search for a filter function, β W , from a lookup table 134. An example of the resulting filter function is shown in FIG. 3. i.e. βfwd = Look-up-table( | bln[x, y] - [ x -MNXfWd , y -MVyfWd ] | )
The product of the filter function, βfWd, and the motion compensated pixel value at address [x, y] of the P frame used for forward prediction, pOutfWd [x- MVxfwd, y- MVyfwd], is summed with the product of the input pixels, bin [x, y], and (1- βfwd), to give an intermediate value for the pixel value, bOutl [x, y] that is sent to the selector 138 for further evaluation.
A selector 138 examines the result of a scene change detector 140. If the selector 138 receives a scene change notification, then the selector chooses the result of the adaptive spatial filter 152 to be sent to a delay stage 130 and outputs to a second pass encoder.
If the analyzed frame is not the first P-frame after a scene change in a Group of Pictures (GOP), then the intermediate result bOutl[x, y] is sent to a delay stage 130 and then on to the second stage of the temporal filter 142. The following P frame is also chosen by the selector 138 to be sent to the second stage filter where the final filtered output bOut at coordinate [x,y] is generated using the backward motion vectors [MVxbwd, MVybwd]:
bOut [x, y] = (1 - β bwd) * bOutl[x,y] + β bwd * pOutbwd [ x -MVxbwd, y -MNybwd]
, where pOutbwd[x, y] is the pixel value at address [x, y] of the P frame used for backward prediction. This frame is input to the second stage filter through the multiple frame delay 130. [MNXbwd, MVybwd] is the backward field motion vector, rounded to an integer value, and scaled to the frame coordinate according to the field select bit in the motion vector. pOutbwd[x- Vxbwd, y- MVybwd] is determined by the motion compensator 144 by using the backward motion vectors. The result is passed to the absolute difference calculator 146 to determine βbWd- βbwd is a nonlinear function of the absolute difference between bOutl [x, y] and pOutbwd[x,y], offset by the relevant motion vectors and implemented by the combination of the absolute difference calculator 146, and a lookup table 148. A characteristic curve of the nonlinear function is shown in FIG. 3. i.e. β wd = Look-up-table ( | bOutl[x, y] - Poutbwd [ x -MVxbwd, y -
MVybwd]| ) The product of the filter function, βbwd, and the motion compensated pixel value at address [x, y] of the P frame used for backward prediction, pOutbw [x- MNXbwd, y- Mvybwd], is summed with the product of the intermediate pixel value, bOutl[x,y], and the difference of the forward filter coefficient from unity,(l- βfwd) 150, to give a resulting output for the pixel value, bOutfx, y].
If βfwd is 0, only backward motion will be used to generate the result. Similarly, if βbwd is 0, only forward motion will be used. Furthermore, different look-up-tables are established to allow the users to select the intensities of the filter. The faster β rolls off the coefficient adaptation curve, the weaker the filter is. The filter coefficient takes the values from zero to one. For the pixels with intensities close to the mean, the filter coefficient β tends toward one, and the filter becomes an average filter, which implies the strong filtering.
Adaptive Spatial Filtering
The adaptive spatial filter is defined as g [x,y] = ( 1- α ) * f [x, y] + α * μ
where f [x,y] and g [x, y] are respectively the input pixel value and the output pixel value at location [x, y]. μ is the local weighted mean value of a 5x5 neighborhood surrounding the pixel f[x ,y], defined as μ = (weight sum of all pixels in the 5x5 neighborhood surrounding f[x,y] excluding f[x,y]) / ( 52 -l)
The following ; weighting table is used to calculate the weighted me
0.0125 0.025 0.05 0.025 0.0125
0.025 0.05 0.1 0.05 0.025
0.025 0.05 0.1 0.05 0.025
0.025 0.05 0.1 0.05 0.025
0.0125 0.025 0.05 0.025 0.0125 The weighting table is designed such that the pixels closer to the center of the 5x5 window have a higher weight. Such weighting helps to preserve texture in the image. The filter coefficient α adapts to the absolute value difference between f[x,y] and μ. Look up tables are used to select the coefficient value. An assortment of look up tables are established that allow users to select from the various intensity levels of the filter. As with the temporal filter, the faster α rolls off the coefficient adaptation curve, the weaker the filter is. The filter coefficient takes the values from zero to one. For the pixels with intensities close to the mean, the filter coefficient α tends toward one, and the filter becomes an average filter, which implies the strong filtering. For the pixels on the edges, the filter coefficient α tends toward zero, which implies that no filtering is applied. Accordingly, it can be seen that the present invention provides an improved apparatus and method for reducing the presence of noise in a video system by applying motion compensated temporal filtering using motion vectors previously generated by a first-pass encoder. At scene change frames, adaptive spatial filtering, combined with a weighting table provides varying degrees of filtering based on pixel location relative to one another and edges. This operation preserves textures within images. As a result of the improved temporal filtering response and the reduced computational complexity; accuracy and processing throughput are enhanced.
Although the invention has been described in connection with the preferred embodiment, it should be appreciated that various modifications and adaptations may be made thereto without departing from the scope of the invention as set forth in the claims.

Claims

What is claimed is:
1. A method for reducing noise in a video distribution system comprising:
applying motion compensated temporal filtering to compressed image data using motion vectors previously generated during compression of the image data,
wherein:
said filtering is adapted to reduce noise in said compressed image data,
the need for regeneration of said motion vectors during said filtering step is eliminated, and
adaptive spatial filtering is applied to compressed image data.
2. A motion compensated temporal filtering method for pre-compressed video image data, comprising at least three successive video frames to reduce the presence of noise in said data, including a current frame, a first anchor frame that precedes said current frame, and a second anchor frame that follows said current frame, wherein each of said frames has a plurality of pixels, each of said pixels has an associated amplitude, and a current pixel of said current frame is intermediate and matched to a first pixel in said first anchor frame and to a second pixel in said second anchor frame, comprising the steps of:
for P-frame and B-frame encoding,
a forward prediction stage comprising:
determining an absolute value difference between the amplitude of a pixel located in said current frame and the amplitude of a pixel located in said first frame, the first frame pixel location being offset from the current frame pixel location by a previously calculated motion vector;
determining a filter coefficient, β(forward) from said absolute value difference,
calculating a proportional value for the previous anchor frame pixel and the current frame pixel, to assign to a calculated current frame pixel value by applying an arithmetic manipulation of their respective amplitude values along with numerical values of β(forward), (1- β(forward)), and motion vectors associated therewith,
summing the resulting proportional value of the respective anchor frame pixels with the proportional value of the current frame pixel to obtain a single calculated pixel amplitude value;
additionally for B-frame encoding:
a backward prediction stage comprising:
receiving from the first forward prediction stage temporally filtered, current frame pixel amplitude values,
determining an absolute value difference between the amplitude of a pixel located in said current frame and the amplitude of a pixel located in said second frame, the second frame pixel location being offset from the current frame pixel location by a previously calculated motion vector,
determining a filter coefficient, β(backward), corresponding to said absolute value difference,
calculating a proportional value for the following anchor frame pixel value and the current frame pixel value to assign to the calculated current frame pixel value, by applying an arithmetic manipulation of their respective amplitude values along with the numerical values of β(backward), (l-β(backward)), and the amplitude of said pixel located within said second frame offset by the representative motion vectors, and
summing the resulting proportional value of the respective anchor frame pixels with the proportional value of the current frame pixel to obtain a single calculated pixel amplitude value.
3. The method of claim 1 further comprising a lookup table for determining values for β(backward) and β(forward), corresponding to values between 0 and 1, based on a difference of pixel amplitudes.
4. The method of claim 1 further comprising a pipeline architecture whereby motion compensated temporal filtering is combined with spatial filtering and delay elements, to provide a look-ahead scheme for a statistical multiplexer rate control system.
5. The method of claim 1 further comprising selection of one of either transcoding or first-pass encoding for calculating said motion vectors.
6. An adaptive spatial filtering method comprising an arithmetic manipulation of input and output pixel values within a current frame, a weighted mean value for a group of pixels on said frame, and a filter coefficient, .
1. The method of claim 6 wherein said weighted mean value is determined from a table comprising pixel amplitude values of a number of specified pixels within a predetermined region.
8. The method of claim 7 wherein said pixel amplitude values comprising said predetermined region are inversely proportional to the distance of the pixel from a central pixel within said region.
. The method of claim 1 comprising a scene change detection process for determining whether said current frame qualifies as a scene change frame.
10. The method of claim 9 wherein said process selects one of either said first stage temporal filter output or said adaptive spatial filter output.
11. Apparatus for reducing noise in a video distribution system, comprising:
a motion compensated temporal filter adapted to filter compressed image data using motion vectors previously generated during compression of the image data, wherein:
said filtering is adapted to reduce noise in said compressed image data, the need for regeneration of said motion vectors during said filtering step is eliminated, and adaptive spatial filtering is applied to the compressed image data.
12. A motion compensated temporal filtering apparatus for pre-compressed video image data comprising at least three successive video frames to reduce the presence of noise in said data, including a current frame, a first anchor frame that precedes said cuπent frame, and a second anchor frame that follows said current frame, wherein each of said frames has a plurality of pixels, each of said pixels has an associated amplitude, and a current pixel of said current frame is intermediate and matched to a first pixel in said first anchor frame and to a second pixel in said second anchor frame, comprising:
for P-frame and B-frame encoding:
a first stage comprising: a subtracter for determining an absolute value difference between the amplitude of a pixel located in said current frame and the amplitude of a pixel located in said first frame, the first frame pixel location being offset from the current frame pixel location by a previously calculated motion vector;
a comparator for comparing absolute value pixel differences with a table of β(forward) values stored in a tabular format,
a calculator for determining proportional values for the previous anchor frame pixel and the cuπent frame pixel to assign to a calculated current frame pixel value by applying an arithmetic manipulation of their respective amplitude values along with the numerical values of β(forward), (1- β(forward)), and the motion vectors associated with the previous anchor frame,
a calculator for summing the resulting proportional value of the applicable anchor frame pixels with the proportional value of the current frame pixel to obtain a single calculated pixel amplitude value; and
a storage element for storing encoded frames whereby pixels between frames can be compared; and
additionally for B-frame encoding:
a second stage comprising:
a subtracter for determining an absolute value difference between the amplitude of said cuπent pixel and the amplitude of said second pixel, said second pixel location being specified by a location and an offset described by a previously calculated motion vector;
a table of filter coefficient values, β(backward), associated with said absolute value difference, a calculator for determining proportional values for the second anchor frame pixel values to assign to calculated current frame pixel values by applying an arithmetic manipulation of their respective amplitude values along with the numerical values of β(backward), 1- β(backward), and the motion vectors associated with the second anchor frame;
a calculator for summing the resulting proportional value of the applicable anchor frame pixels with the proportional value of the current frame pixel to obtain a single calculated pixel amplitude value; and
a storage element for storing encoded frames whereby pixels between frames can be compared.
PCT/US2002/024867 2001-08-14 2002-08-07 Motion-adaptive noise reduction pre-processing for digital video signal Ceased WO2003017676A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
EP02794854.6A EP1438862B1 (en) 2001-08-14 2002-08-07 Motion-adaptive noise reduction pre-processing for digital video signal
MXPA04001375A MXPA04001375A (en) 2001-08-14 2002-08-07 Motion-adaptive noise reduction pre-processing for digital video signal.
CA2456252A CA2456252C (en) 2001-08-14 2002-08-07 Motion-adaptive noise reduction pre-processing for digital video signal
EP06076414.9A EP1711019B1 (en) 2001-08-14 2002-08-07 Motion compensated temporal filtering for noise reduction pre-processing of digital video data
KR1020047002223A KR100960742B1 (en) 2001-08-14 2002-08-07 Noise reduction pre-processor for digital video using previously generated motion vectors and adaptive spatial filtering
AU2002356069A AU2002356069A1 (en) 2001-08-14 2002-08-07 Motion-adaptive noise reduction pre-processing for digital video signal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/929,553 2001-08-14
US09/929,553 US7110455B2 (en) 2001-08-14 2001-08-14 Noise reduction pre-processor for digital video using previously generated motion vectors and adaptive spatial filtering

Publications (2)

Publication Number Publication Date
WO2003017676A2 true WO2003017676A2 (en) 2003-02-27
WO2003017676A3 WO2003017676A3 (en) 2003-12-11

Family

ID=25458046

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/024867 Ceased WO2003017676A2 (en) 2001-08-14 2002-08-07 Motion-adaptive noise reduction pre-processing for digital video signal

Country Status (8)

Country Link
US (1) US7110455B2 (en)
EP (2) EP1711019B1 (en)
KR (1) KR100960742B1 (en)
CN (1) CN1541482A (en)
AU (1) AU2002356069A1 (en)
CA (1) CA2456252C (en)
MX (1) MXPA04001375A (en)
WO (1) WO2003017676A2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006122413A1 (en) * 2005-05-17 2006-11-23 Université de Montréal Continuous extension of discrete transform for data processing
US7215380B2 (en) 2003-04-15 2007-05-08 Silicon Integrated Systems Corp. Method for detecting video frame types with median filtering
CN100334874C (en) * 2003-07-02 2007-08-29 矽统科技股份有限公司 Frame Type Detection Method with Noise Filtering Step
CN100364338C (en) * 2004-06-16 2008-01-23 三星电子株式会社 Method and device for estimating image noise and method for removing noise
WO2008083253A1 (en) * 2006-12-27 2008-07-10 Intel Corporation Method and apparatus for content adaptive spatial-temporal motion adaptive noise reduction
CN100493191C (en) * 2003-07-09 2009-05-27 汤姆森许可贸易公司 Video encoder and video encoding method with low-complexity noise reduction
EP2080363A4 (en) * 2006-10-31 2011-09-14 Motorola Solutions Inc Method and apparatus for adaptive noise filtering of pixel data
EP1991005A3 (en) * 2007-05-11 2016-10-12 Sony Corporation Apparatus, method, and program for temporal filtering of a video signal before video signal processing
WO2017107442A1 (en) * 2015-12-22 2017-06-29 乐视控股(北京)有限公司 Video transcoding method and device
CN109791689A (en) * 2016-09-30 2019-05-21 哈德利公司 Image-signal processor bias compensation noise reduction system and method

Families Citing this family (102)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2851111B1 (en) * 2003-02-10 2005-07-22 Nextream France DEVICE FOR ENCODING A VIDEO DATA STREAM
US8218624B2 (en) 2003-07-18 2012-07-10 Microsoft Corporation Fractional quantization step sizes for high bit rates
US7580584B2 (en) 2003-07-18 2009-08-25 Microsoft Corporation Adaptive multiple quantization
US7738554B2 (en) 2003-07-18 2010-06-15 Microsoft Corporation DC coefficient signaling at small quantization step sizes
US7602851B2 (en) 2003-07-18 2009-10-13 Microsoft Corporation Intelligent differential quantization of video coding
US10554985B2 (en) 2003-07-18 2020-02-04 Microsoft Technology Licensing, Llc DC coefficient signaling at small quantization step sizes
US7606391B2 (en) * 2003-07-25 2009-10-20 Sony Corporation Video content scene change determination
US8243093B2 (en) 2003-08-22 2012-08-14 Sharp Laboratories Of America, Inc. Systems and methods for dither structure creation and application for reducing the visibility of contouring artifacts in still and video images
US7359565B2 (en) * 2004-05-03 2008-04-15 International Business Machines Corporation Method of filtering pixels in a video encoding process
KR100624421B1 (en) 2004-05-04 2006-09-19 삼성전자주식회사 Digital video signal filtering device and method
US7801383B2 (en) 2004-05-15 2010-09-21 Microsoft Corporation Embedded scalar quantizers with arbitrary dead-zone ratios
US7199838B2 (en) * 2004-06-17 2007-04-03 Samsung Electronics Co., Ltd. Motion adaptive noise reduction apparatus and method for video signals
US20100272182A1 (en) * 2004-06-23 2010-10-28 Quanta International Limited Image flow knowledge assisted latency-free in-loop temporal filter
US20050286638A1 (en) * 2004-06-23 2005-12-29 Qpixel Technology International, Inc. Image flow knowledge assisted latency-free in-loop temporal filter
US7512182B2 (en) * 2004-08-30 2009-03-31 General Instrument Corporation Method and apparatus for performing motion compensated temporal filtering in video encoding
KR20060043051A (en) * 2004-09-23 2006-05-15 엘지전자 주식회사 Method of encoding and decoding video signal
KR100677748B1 (en) * 2004-12-23 2007-02-02 삼성전자주식회사 Noise reduction device and method
US7535517B2 (en) * 2005-04-14 2009-05-19 Samsung Electronics Co., Ltd. Method of motion compensated temporal noise reduction
US7554611B2 (en) * 2005-04-19 2009-06-30 Samsung Electronics Co., Ltd. Method and apparatus of bidirectional temporal noise reduction
US8422546B2 (en) 2005-05-25 2013-04-16 Microsoft Corporation Adaptive video encoding using a perceptual model
CA2610262A1 (en) * 2005-06-07 2006-12-14 Thomson Licensing Content-based gaussian noise reduction for still image, video and film
US8005308B2 (en) * 2005-09-16 2011-08-23 Sony Corporation Adaptive motion estimation for temporal prediction filter over irregular motion vector samples
US7894527B2 (en) * 2005-09-16 2011-02-22 Sony Corporation Multi-stage linked process for adaptive motion vector sampling in video compression
US8107748B2 (en) * 2005-09-16 2012-01-31 Sony Corporation Adaptive motion search range
KR100772405B1 (en) * 2005-09-27 2007-11-01 삼성전자주식회사 Adaptive Noise Reduction Method and Image Processing System Based on Global Motion Estimation
US7640000B2 (en) * 2005-12-10 2009-12-29 Electronics And Telecommunications Research Institute Apparatus and method for cancellation of partially overlapped crosstalk signals
KR100823569B1 (en) * 2005-12-10 2008-04-21 한국전자통신연구원 Apparatus and method for removing interference signal due to partial overlap of frequency band
US8040437B2 (en) * 2005-12-20 2011-10-18 Broadcom Corporation Method and system for analog video noise detection
US7639309B2 (en) * 2005-12-20 2009-12-29 Broadcom Corporation Method and system for analog video noise reduction by blending FIR and IIR filtering
US8514332B2 (en) * 2005-12-20 2013-08-20 Broadcom Corporation Method and system for non-linear blending in motion-based video processing
US7974340B2 (en) 2006-04-07 2011-07-05 Microsoft Corporation Adaptive B-picture quantization control
US7995649B2 (en) 2006-04-07 2011-08-09 Microsoft Corporation Quantization adjustment based on texture level
US8059721B2 (en) 2006-04-07 2011-11-15 Microsoft Corporation Estimating sample-domain distortion in the transform domain with rounding compensation
US8503536B2 (en) 2006-04-07 2013-08-06 Microsoft Corporation Quantization adjustments for DC shift artifacts
US8130828B2 (en) 2006-04-07 2012-03-06 Microsoft Corporation Adjusting quantization to preserve non-zero AC coefficients
US8711925B2 (en) 2006-05-05 2014-04-29 Microsoft Corporation Flexible quantization
US8369417B2 (en) * 2006-05-19 2013-02-05 The Hong Kong University Of Science And Technology Optimal denoising for video coding
US8831111B2 (en) * 2006-05-19 2014-09-09 The Hong Kong University Of Science And Technology Decoding with embedded denoising
US8542736B2 (en) * 2006-10-18 2013-09-24 Thomson Licensing Method and apparatus for video coding using prediction data refinement
MX2009006404A (en) 2006-12-18 2009-06-23 Koninkl Philips Electronics Nv Image compression and decompression.
JP4850689B2 (en) * 2006-12-22 2012-01-11 キヤノン株式会社 Image processing apparatus, image processing method, image processing program, and storage medium
US8238424B2 (en) 2007-02-09 2012-08-07 Microsoft Corporation Complexity-based adaptive preprocessing for multiple-pass video compression
US8498335B2 (en) 2007-03-26 2013-07-30 Microsoft Corporation Adaptive deadzone size adjustment in quantization
US8243797B2 (en) 2007-03-30 2012-08-14 Microsoft Corporation Regions of interest for quality adjustments
US8442337B2 (en) 2007-04-18 2013-05-14 Microsoft Corporation Encoding adjustments for animation content
US8331438B2 (en) 2007-06-05 2012-12-11 Microsoft Corporation Adaptive selection of picture-level quantization parameters for predicted video pictures
US8837849B2 (en) 2007-06-26 2014-09-16 Google Inc. Method for noise-robust color changes in digital images
US20090010339A1 (en) * 2007-07-05 2009-01-08 Faraday Technology Corp. Image compensation circuit, method thereof, and lcd device using the same
US8145970B2 (en) * 2007-09-06 2012-03-27 Broadcom Corporation Data puncturing ensuring orthogonality within communication systems
KR20090095316A (en) * 2008-03-05 2009-09-09 삼성전자주식회사 Image intra prediction method and apparatus
US8189933B2 (en) 2008-03-31 2012-05-29 Microsoft Corporation Classifying and controlling encoding quality for textured, dark smooth and smooth video content
US8897359B2 (en) 2008-06-03 2014-11-25 Microsoft Corporation Adaptive quantization for enhancement layer video coding
CN102067610B (en) * 2008-06-16 2013-07-10 杜比实验室特许公司 Rate control model adaptation based on slice dependencies for video coding
US8326075B2 (en) 2008-09-11 2012-12-04 Google Inc. System and method for video encoding using adaptive loop filter
US8792564B2 (en) * 2008-10-28 2014-07-29 Sony Corporation Adaptive preprocessing method using feature-extracted video maps
KR101573400B1 (en) 2009-02-18 2015-12-02 삼성디스플레이 주식회사 Liquid crystal display and driving method thereof
US8767127B2 (en) * 2009-04-17 2014-07-01 General Instrument Corporation System for reducing noise in video processing
TWI398825B (en) * 2009-10-07 2013-06-11 Altek Corp Method of suppressing noise by using multiple digital images
KR101379189B1 (en) * 2009-10-19 2014-04-10 에스케이 텔레콤주식회사 Video Coding Method and Apparatus by Using Filtering Motion Compensation Frame
US8593483B2 (en) * 2009-10-20 2013-11-26 Apple Inc. Temporal filtering techniques for image signal processing
SG10201408613UA (en) 2009-10-30 2015-02-27 Agency Science Tech & Res Methods, Devices, And Computer Readable Mediums For Processing A Digital Picture
US8503528B2 (en) * 2010-09-15 2013-08-06 Google Inc. System and method for encoding video using temporal filter
US9036695B2 (en) 2010-11-02 2015-05-19 Sharp Laboratories Of America, Inc. Motion-compensated temporal filtering based on variable filter parameters
US8755438B2 (en) * 2010-11-29 2014-06-17 Ecole De Technologie Superieure Method and system for selectively performing multiple video transcoding operations
US9462280B2 (en) 2010-12-21 2016-10-04 Intel Corporation Content adaptive quality restoration filtering for high efficiency video coding
US9807424B2 (en) * 2011-01-10 2017-10-31 Qualcomm Incorporated Adaptive selection of region size for identification of samples in a transition zone for overlapped block motion compensation
US8780971B1 (en) 2011-04-07 2014-07-15 Google, Inc. System and method of encoding using selectable loop filters
US8780996B2 (en) 2011-04-07 2014-07-15 Google, Inc. System and method for encoding and decoding video data
US8781004B1 (en) 2011-04-07 2014-07-15 Google Inc. System and method for encoding video using variable loop filter
JP2013059016A (en) * 2011-08-12 2013-03-28 Sony Corp Image processing device, method, and program
US8885706B2 (en) 2011-09-16 2014-11-11 Google Inc. Apparatus and methodology for a video codec system with noise reduction capability
WO2013049412A2 (en) 2011-09-29 2013-04-04 Dolby Laboratories Licensing Corporation Reduced complexity motion compensated temporal processing
US8818125B2 (en) * 2011-10-07 2014-08-26 Texas Instruments Incorporated Scene adaptive filter design for improved stereo matching
US9906815B2 (en) * 2011-11-08 2018-02-27 Texas Instruments Incorporated Delayed duplicate I-picture for video coding
TWI510076B (en) * 2011-12-05 2015-11-21 Realtek Semiconductor Corp Image processing method and associated image processing apparatus
CN110234012B (en) * 2012-01-17 2021-12-31 华为技术有限公司 Apparatus for in-loop filtering of lossless coding modes in high performance video coding
US9131073B1 (en) * 2012-03-02 2015-09-08 Google Inc. Motion estimation aided noise reduction
US9326008B2 (en) 2012-04-10 2016-04-26 Google Inc. Noise reduction for image sequences
US9344729B1 (en) 2012-07-11 2016-05-17 Google Inc. Selective prediction signal filtering
US9041834B2 (en) 2012-09-19 2015-05-26 Ziilabs Inc., Ltd. Systems and methods for reducing noise in video streams
CN102968763A (en) * 2012-10-20 2013-03-13 江南大学 Image filtering method based on self-adaptive neural fuzzy inference systems
US20150063469A1 (en) * 2013-08-30 2015-03-05 Arris Enterprises, Inc. Multipass encoder with heterogeneous codecs
US9294766B2 (en) 2013-09-09 2016-03-22 Apple Inc. Chroma quantization in video coding
JP2015149554A (en) * 2014-02-05 2015-08-20 キヤノン株式会社 Image processing apparatus, image processing method, and imaging apparatus
MX2016017324A (en) * 2014-06-25 2017-05-12 Arris Entpr Llc A method for using a decoder or look-ahead encoder to control an adaptive pre-filter.
US10102613B2 (en) 2014-09-25 2018-10-16 Google Llc Frequency-domain denoising
US10021396B1 (en) 2014-12-30 2018-07-10 Ambarella, Inc. Motion detection based on observing several pictures
US10049436B1 (en) 2015-09-30 2018-08-14 Google Llc Adaptive denoising for real-time video on mobile devices
KR101780444B1 (en) 2015-10-29 2017-09-21 삼성에스디에스 주식회사 Method for reducing noise of video signal
US11017504B2 (en) * 2016-01-29 2021-05-25 Intuitive Surgical Operations, Inc. Light level adaptive filter and method
US10453187B2 (en) * 2017-07-21 2019-10-22 The Boeing Company Suppression of background clutter in video imagery
CN111009219B (en) * 2018-10-08 2021-09-21 奇景光电股份有限公司 Local dimming system suitable for display backlight
US11252440B2 (en) * 2019-11-07 2022-02-15 Comcast Cable Communications, Llc Pixel filtering for content
CN110933334B (en) * 2019-12-12 2021-08-03 腾讯科技(深圳)有限公司 Video noise reduction method, device, terminal and storage medium
CN113055669B (en) * 2021-01-15 2023-01-17 北京博雅慧视智能技术研究院有限公司 Image filtering method and device before coding
CN113259662B (en) * 2021-04-16 2022-07-05 西安邮电大学 Code rate control method based on three-dimensional wavelet video coding
EP4297397B1 (en) * 2021-04-26 2026-02-25 Huawei Technologies Co., Ltd. Electronic apparatus, and image processing method of electronic apparatus
CN113438488B (en) * 2021-06-18 2023-01-31 北京锐马视讯科技有限公司 Low-bit-rate video optimization coding method, device, equipment and storage medium
CN113674316B (en) * 2021-08-04 2024-12-10 浙江大华技术股份有限公司 Video noise reduction method, device and equipment
CN113726311B (en) * 2021-08-23 2022-05-06 北京智源人工智能研究院 Pulse signal filter circuit and electronic equipment
CN115604463B (en) * 2022-09-07 2024-10-18 天津市国瑞数码安全系统股份有限公司 Video compression method and system for self-adaptive perception sampling
US12610087B2 (en) * 2024-03-27 2026-04-21 Nvidia Corporation Coding tree-based adaptive quantization

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4942466A (en) * 1985-12-24 1990-07-17 British Broadcasting Corporation Bandwidth compression for television signals
US5367629A (en) * 1992-12-18 1994-11-22 Sharevision Technology, Inc. Digital video compression system utilizing vector adaptive transform
KR960012932B1 (en) * 1993-09-17 1996-09-25 대우전자 주식회사 Time-base Band Limiting Method Using Two-dimensional Spatial Filtering
JPH07177464A (en) * 1993-12-16 1995-07-14 Pioneer Video Corp Real time picture compression processing unit
EP0772365A3 (en) * 1995-11-02 1999-05-12 Matsushita Electric Industrial Co., Ltd. Method and device for filtering a picture signal, and encoding/decoding using the same
US5686963A (en) * 1995-12-26 1997-11-11 C-Cube Microsystems Method for performing rate control in a video encoder which provides a bit budget for each frame while employing virtual buffers and virtual buffer verifiers
WO1997030545A1 (en) * 1996-02-19 1997-08-21 Philips Electronics N.V. Method and arrangement for encoding a video signal
US6100931A (en) * 1996-03-19 2000-08-08 Sony Corporation Method and apparatus for controlling a target amount of code and for compressing video data
US6005626A (en) * 1997-01-09 1999-12-21 Sun Microsystems, Inc. Digital video signal encoder and encoding method
US6178205B1 (en) * 1997-12-12 2001-01-23 Vtel Corporation Video postfiltering with motion-compensated temporal filtering and/or spatial-adaptive filtering
US6385489B1 (en) 1998-09-25 2002-05-07 Ep Medsystems, Inc. Triple array defibrillation catheter and method of using the same
US6310915B1 (en) * 1998-11-20 2001-10-30 Harmonic Inc. Video transcoder with bitstream look ahead for rate control and statistical multiplexing
US7145607B1 (en) * 1999-11-11 2006-12-05 Stmicroelectronics Asia Pacific Pte. Ltd. Spatio-temporal video noise reduction system
EP1100260A1 (en) * 1999-11-12 2001-05-16 STMicroelectronics S.r.l. Spatio-temporal filtering method for noise reduction during pre-processing of picture sequences in video encoders

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7215380B2 (en) 2003-04-15 2007-05-08 Silicon Integrated Systems Corp. Method for detecting video frame types with median filtering
CN100334874C (en) * 2003-07-02 2007-08-29 矽统科技股份有限公司 Frame Type Detection Method with Noise Filtering Step
CN100493191C (en) * 2003-07-09 2009-05-27 汤姆森许可贸易公司 Video encoder and video encoding method with low-complexity noise reduction
CN100364338C (en) * 2004-06-16 2008-01-23 三星电子株式会社 Method and device for estimating image noise and method for removing noise
US7787754B2 (en) 2005-05-17 2010-08-31 Université de Montréal Continuous extension of discrete transform for data processing
WO2006122413A1 (en) * 2005-05-17 2006-11-23 Université de Montréal Continuous extension of discrete transform for data processing
EP2080363A4 (en) * 2006-10-31 2011-09-14 Motorola Solutions Inc Method and apparatus for adaptive noise filtering of pixel data
AU2007313905B2 (en) * 2006-10-31 2011-12-15 Motorola Solutions, Inc. Method and apparatus for adaptive noise filtering of pixel data
WO2008083253A1 (en) * 2006-12-27 2008-07-10 Intel Corporation Method and apparatus for content adaptive spatial-temporal motion adaptive noise reduction
US7952646B2 (en) 2006-12-27 2011-05-31 Intel Corporation Method and apparatus for content adaptive spatial-temporal motion adaptive noise reduction
US8872977B2 (en) 2006-12-27 2014-10-28 Intel Corporation Method and apparatus for content adaptive spatial-temporal motion adaptive noise reduction
EP1991005A3 (en) * 2007-05-11 2016-10-12 Sony Corporation Apparatus, method, and program for temporal filtering of a video signal before video signal processing
WO2017107442A1 (en) * 2015-12-22 2017-06-29 乐视控股(北京)有限公司 Video transcoding method and device
CN109791689A (en) * 2016-09-30 2019-05-21 哈德利公司 Image-signal processor bias compensation noise reduction system and method

Also Published As

Publication number Publication date
AU2002356069A1 (en) 2003-03-03
EP1711019A3 (en) 2011-11-30
EP1711019A2 (en) 2006-10-11
EP1438862B1 (en) 2019-03-27
EP1711019B1 (en) 2018-10-03
MXPA04001375A (en) 2004-06-03
KR20040030096A (en) 2004-04-08
CN1541482A (en) 2004-10-27
KR100960742B1 (en) 2010-06-01
CA2456252A1 (en) 2003-02-27
US20030039310A1 (en) 2003-02-27
CA2456252C (en) 2012-11-27
EP1438862A2 (en) 2004-07-21
US7110455B2 (en) 2006-09-19
WO2003017676A3 (en) 2003-12-11

Similar Documents

Publication Publication Date Title
CA2456252C (en) Motion-adaptive noise reduction pre-processing for digital video signal
US5438374A (en) System and method for filtering video signals
US6037986A (en) Video preprocessing method and apparatus with selective filtering based on motion detection
US6804301B2 (en) First pass encoding of I and P-frame complexity for compressed digital video
US6040861A (en) Adaptive real-time encoding of video sequence employing image statistics
US7177358B2 (en) Picture coding apparatus, and picture coding method
JP3510495B2 (en) Method and apparatus for real-time encoding of a video sequence using two encoders and statistical analysis
KR100425640B1 (en) Noise estimation and reduction apparatus for video signal processing
US5731850A (en) Hybrid hierarchial/full-search MPEG encoder motion estimation
US7920628B2 (en) Noise filter for video compression
US6574276B2 (en) Video coding method and corresponding video coder
US6415055B1 (en) Moving image encoding method and apparatus, and moving image decoding method and apparatus
EP0615386B1 (en) A motion vector processor for compressing video signal
US20070199011A1 (en) System and method for high quality AVC encoding
JP2000078588A (en) Moving picture encoding device
KR100497398B1 (en) Method and apparatus of video noise reduction
EP0680217B1 (en) Video signal decoding apparatus capable of reducing blocking effects
KR100229796B1 (en) Image decoding system with compensation function for degraded image
US7787541B2 (en) Dynamic pre-filter control with subjective noise detector for video compression
US6040875A (en) Method to compensate for a fade in a digital video input sequence
US6480544B1 (en) Encoding apparatus and encoding method
JP2000069479A (en) Image encoding apparatus and image encoding method
KR19990086117A (en) Motion Compensation Video Compression Method Using Filter
JPH0738899A (en) Image coding device
JP2001145108A (en) Image information conversion apparatus and method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ OM PH PL PT RU SD SE SG SI SK SL TJ TM TN TR TZ UA UG US UZ VN YU ZA ZM

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZM ZW AM AZ BY KG KZ RU TJ TM AT BE BG CH CY CZ DK EE ES FI FR GB GR IE IT LU MC PT SE SK TR BF BJ CF CG CI GA GN GQ GW ML MR NE SN TD TG

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2002794854

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2456252

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: PA/a/2004/001375

Country of ref document: MX

Ref document number: 2002815861X

Country of ref document: CN

Ref document number: 1020047002223

Country of ref document: KR

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2002794854

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Ref document number: JP