WO1998002000A1 - Codeur et decodeur d'image - Google Patents

Codeur et decodeur d'image Download PDF

Info

Publication number
WO1998002000A1
WO1998002000A1 PCT/JP1997/001448 JP9701448W WO9802000A1 WO 1998002000 A1 WO1998002000 A1 WO 1998002000A1 JP 9701448 W JP9701448 W JP 9701448W WO 9802000 A1 WO9802000 A1 WO 9802000A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
shape
area
region
deformed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP1997/001448
Other languages
English (en)
Japanese (ja)
Inventor
Norio Ito
Shuichi Watanabe
Hiroyuki Katata
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Publication of WO1998002000A1 publication Critical patent/WO1998002000A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/537—Motion estimation other than block-based
    • H04N19/543—Motion estimation other than block-based using regions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding

Definitions

  • the present invention belongs to the field of digital image processing, and relates to an image encoding device that encodes image data with high efficiency, and an image decoding device that decodes encoded data created by the image encoding device.
  • IS OZ IEC MP EG 4 International standardization of moving picture coding method
  • the coding device and the decoding device having a hierarchical structure as shown in Fig. 8 use input information and shape information indicating the shape of the region of interest. Encoding, decoding, and combining of multiple component images represented by are considered.
  • the part image is an image obtained by cutting out a person or an object in a moving image as a part.
  • a normal moving image itself is also treated as a kind of component image.
  • the first component image encoding unit 801, the second component image encoding unit 802, and the third component image encoding unit 803 include pixel value data of input images 1, 2, and 3, and shape information 1, 2, and 3. Are respectively encoded, and the multiplexing unit 804 multiplexes a plurality of component image encoded data, and transmits or accumulates them.
  • the coded data is separated into a plurality of component image coded data by the demultiplexing unit 805, and the first component image decoding unit 806, the second component image decoding unit 807, and the third component image decoding unit 808
  • each of the plurality of component image encoded data is decoded
  • the component image synthesizing unit 809 the decoded images 1, 2, and 3 and the shape information 1, 2, and 3 are each synthesized and output as a synthesized video output, which is displayed on a display (not shown) or the like.
  • the combination position information is information indicating a position when each component is displayed on the display at the time of combination.
  • Fig. 9 schematically shows the component images and how they are combined.
  • the part image 1 in FIG. 9 (a) is a normal moving image representing the background
  • the part image 2 in FIG. 9 (b) is a moving image obtained by cutting out only a person.
  • part image 3 in Fig. 9 (c) is a moving image cut out of only the car.
  • Fig. 9 (a) If only the component image 1 of the encoded data is decoded, an image with only the same background as in Fig. 9 (a) can be obtained. If the component image 1 and the component image 2 are decoded and combined, Fig. 9 (d) An image like is played. Furthermore, if component image 3 is decoded and the three component images are combined, an image as shown in Fig. 9 (e) is reproduced.
  • the component image is represented by a set of an image information area 501 and a shape information area 502 indicating its shape. At this time, it is assumed that the corresponding image information exists inside the shape information area.
  • the shape information area in the image information area 601 in FIG. 6 is deformed as shown in FIG. 6, the data area in the image information area that is beyond the original image information area is assumed. There will be an area 6 03 where does not exist. Therefore, there is no image information corresponding to the region 603, and if it is handled as if it exists, the image quality may be degraded.
  • An object of the present invention is to solve the problems of the prior art, and to avoid the inconvenience that occurs when the original shape information region extends over the inside and outside of the image information region by the lossless encoding of the shape information as described above.
  • An object of the present invention is to provide a component image encoding method. Disclosure of the invention
  • the present invention has been made to achieve the above object, and the gist thereof is as follows.
  • a first gist of the present invention is to provide a moving image encoding apparatus that cuts out an arbitrary shape region of interest from an image frame and encodes data in the cut region.
  • Image coding characterized in that, when performing lossless encoding, if the area shape deformed due to high-efficiency compression protrudes from the image information area, the deformed area shape is deformed according to the shape of the image information area. In the device.
  • a second gist of the present invention is to provide a moving image encoding apparatus that cuts out an arbitrary shape region of interest from an image frame and encodes data in the cut out region.
  • An image coding apparatus characterized in that when irreversible coding is performed, the coding process is controlled so that the area shape deformed for high efficiency compression does not protrude from the image information area.
  • a third gist of the present invention resides in a moving picture encoding apparatus that cuts out an arbitrary shape region of interest from an image frame and encodes data in the cut region, wherein the shape information representing the region is not encoded.
  • a moving picture encoding apparatus that cuts out an arbitrary shape region of interest from an image frame and encodes data in the cut region, wherein the shape information representing the region is not encoded.
  • a fourth gist of the present invention is a moving image decoding apparatus that decodes an image region that is an arbitrary-shaped region. As a result of decoding the shape information representing the region, the region shape deformed for high-efficiency compression is transformed into an image.
  • An image decoding apparatus characterized in that, when the image is outside the information area, the shape of the deformed area is deformed in accordance with the shape of the image information area.
  • FIG. 1 is a block diagram showing a first embodiment of the present invention.
  • FIG. 2 is a block diagram showing a second embodiment of the present invention.
  • FIG. 3 is a block diagram showing a third embodiment of the present invention.
  • FIG. 4 is a block diagram showing a fourth embodiment of the present invention.
  • FIG. 5 is a diagram for explaining a conventional technique.
  • FIG. 6 is a diagram for explaining a problem of the conventional technique.
  • FIG. 7 is a diagram illustrating an embodiment of the present invention.
  • FIG. 8 is a block diagram illustrating a conventional technique.
  • FIG. 9 is a diagram schematically showing a component image and a state of the combination.
  • FIG. 1 is a block diagram showing a first embodiment of the present invention. This solves the problem of the prior art by deforming the shape information deformed by non-reversible coding according to the size of the image shape area.
  • the coding method of the image signal (texture) by the image coding unit 105 is not described, but it is for coding an arbitrary shape area defined by the shape information area.
  • the input shape information is coded using the coding parameters determined by the shape coding unit 101.
  • the inside / outside determination unit 103 determines whether or not the shape information area decoded by the shape decoding unit 102 is inside the image information area. If it is inside, the image signal is encoded by the image encoding unit 105 using the decoding area shape.
  • the decoded shape area is deformed by the shape deforming unit 104 according to the shape of the image frame, and then the image is again encoded by the image coding unit 105.
  • the coded area shape and image information are multiplexed by the multiplexing unit 106 to become coded data of one arbitrarily shaped area.
  • the shape deformation processing corresponds to, for example, deleting an area 603 where no data exists in the image information area as shown in FIG. As a result, all the image information in the shape information area is obtained from the data in the image information area.
  • FIG. 2 is a block diagram showing a second embodiment of the present invention. This solves the problem of the prior art by adjusting the parameters so that the shape information area obtained by decoding when performing non-reversible coding always exists inside the image information area. is there.
  • the shape information encoded by the shape encoding unit 201 is decoded by the shape decoding unit 202, it is determined whether or not the result exists in the image information area by the inside / outside determination unit. Judge at 203. If it extends over the outside, the two switches 206 and 207 are turned off, and the coding parameter change unit 205 changes the parameters.
  • the image encoding unit 204 performs encoding using the shape information area thus obtained.
  • a method of selecting parameters for example, a part that can greatly deform the shape is represented by a simple shape by reducing the amount of noise, and conversely, a part with a small amount is used to approach the original shape by spending the amount of code.
  • FIG. 3 is a block diagram showing a third embodiment of the present invention. This is a method in which an image information area is created in advance using extrapolation so that corresponding image information always exists inside a shape information area deformed by non-reversible coding.
  • the area extension unit 3 is adjusted to the size of the area shape. 03 Additional regions are created by extrapolation.
  • the additional area refers to an area 703 indicated by a hatched portion in FIG.
  • the image information area By encoding this as a new image information area in the image encoding unit 304 in FIG. 3, the image information area always exists inside the shape information area 720 in FIG. The problem of the conventional technology can be solved.
  • the image information area 602 and the area 603 where no data exists in the image information area are the same as those in FIG.
  • the coded region shape and image information are multiplexed by the multiplexing unit 106 in FIG. You.
  • FIG. 4 is a block diagram showing a fourth embodiment of the present invention. This is because, when the decoded shape information area is irreversibly encoded on the encoding side and straddles the inside and outside of the image information area, it is deformed according to the size of the image information, thereby causing a problem in the conventional technology. Is to solve.
  • the decoded shape information area is the same as that obtained in the irreversible process at the time of encoding, and the inside / outside determination unit 403 determines whether or not this crosses the image information area. If it is determined that this straddles the outside of the image information area, the shape is deformed by the shape deforming section 404 so as not to straddle the outside. Otherwise, the original component image is decoded and reproduced by the image decoding unit 405 using the decoding result as it is.
  • image quality degradation due to external data reference due to changes in the area shape due to lossy coding of the area shape information is adjusted to match the image information area when the shape information area extends inside and outside the image information area. Deformation can suppress image quality degradation.
  • image quality degradation due to data reference outside the image information area due to changes in the area shape due to lossy coding of the area shape information is explained by the loss of shape due to lossy coding when the shape information area extends over the inside and outside of the frame.
  • the image information area extends outside and inside, the image information area can be interpolated with a certain appropriate value so as to include the shape information area, so that the deterioration of image quality can be suppressed. Furthermore, when the shape information area in which the area shape information is decoded extends over the inside and outside of the image information area, the quality of the decoded image can be prevented from lowering by deforming it in accordance with the image information area.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

Codeur et décodeur d'image pouvant éliminer la détérioration de la qualité d'une image au moment du codage de cette image en déformant une zone d'information de forme s'étendant au-dessus de l'intérieur et de l'extérieur d'une image en fonction de la forme de la zone d'information de forme au cours du processus de codage irréversible d'une image de forme ou en dilatant la circonférence de la zone d'information d'image par interpolation, de façon à inclure toutes les zones précédentes d'information d'image dans la circonférence avant le traitement.
PCT/JP1997/001448 1996-07-04 1997-04-25 Codeur et decodeur d'image Ceased WO1998002000A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP8/174449 1996-07-04
JP17444996A JP3474707B2 (ja) 1996-07-04 1996-07-04 画像符号化装置及び画像復号装置

Publications (1)

Publication Number Publication Date
WO1998002000A1 true WO1998002000A1 (fr) 1998-01-15

Family

ID=15978698

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP1997/001448 Ceased WO1998002000A1 (fr) 1996-07-04 1997-04-25 Codeur et decodeur d'image

Country Status (2)

Country Link
JP (1) JP3474707B2 (fr)
WO (1) WO1998002000A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01181280A (ja) * 1988-01-13 1989-07-19 Nippon Telegr & Teleph Corp <Ntt> 画像信号の符号化方式
JPH04195686A (ja) * 1990-11-28 1992-07-15 Matsushita Electric Ind Co Ltd 領域分割装置
JPH07177516A (ja) * 1993-10-15 1995-07-14 At & T Corp 任意形状の画像のブロック変換符号化方法
JPH07262384A (ja) * 1994-03-23 1995-10-13 Nippon Telegr & Teleph Corp <Ntt> 画像領域分割方法及び装置
EP0707427A2 (fr) * 1994-10-13 1996-04-17 AT&T Corp. Méthode et appareil pour le codage basé sur des régions d'une séquence d'images vidéo
JPH08161505A (ja) * 1994-11-30 1996-06-21 Sony Corp 動画像処理装置、動画像符号化装置および動画像復号装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01181280A (ja) * 1988-01-13 1989-07-19 Nippon Telegr & Teleph Corp <Ntt> 画像信号の符号化方式
JPH04195686A (ja) * 1990-11-28 1992-07-15 Matsushita Electric Ind Co Ltd 領域分割装置
JPH07177516A (ja) * 1993-10-15 1995-07-14 At & T Corp 任意形状の画像のブロック変換符号化方法
JPH07262384A (ja) * 1994-03-23 1995-10-13 Nippon Telegr & Teleph Corp <Ntt> 画像領域分割方法及び装置
EP0707427A2 (fr) * 1994-10-13 1996-04-17 AT&T Corp. Méthode et appareil pour le codage basé sur des régions d'une séquence d'images vidéo
JPH08161505A (ja) * 1994-11-30 1996-06-21 Sony Corp 動画像処理装置、動画像符号化装置および動画像復号装置

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
SIGNAL PROCESSING: IMAGE COMMUNICATION, Vol. 1, No. 2, (October 1989), H.G. MUSMANN et al., "Object-Oriented Analysis-Synthesis Coding of Moving Images", p. 117-138. *
SIGNAL PROCESSING: IMAGE COMMUNICATION, Vol. 1, No. 2, (October 1989), M. GILGE et al., "Coding of Arbitrarily Shaped Image Segments Based on a Generalized Orthogonal Transform" p. 153-180. *
SIGNAL PROCESSING: IMAGE COMMUNICATION, Vol. 2, No. 4, (December 1990), M. HOETTER, "Object-Oriented Analysis-Synthesis Coding Based on Moving Two-Dimensional Objects", p. 409-428. *
TECHNICAL RESEARCH REPORT OF IEICE, Vol. 95, No. 436, December 1995 (TOKYO), YOSHIAKI SHIKAKURA, "Examination of Coding of Arbitrary Shape Using Region Support DCT (In Japanese)", p. 61-66. *
TECHNICAL RESEARCH REPORT OF IEICE, Vol. 95, No. 469, January 1996, (TOKYO), MINORU EIDOU, "Trend in the Movement MPEG-4 of Standardization of Moving Picture Encoding (In Japanese)", p. 55-60. *
TELECOMMUNICATIONS, Vol. 57, No. 572, August 1994, (TOKYO), MINORU EIDOU, "Coding Ultra-Low Bitrate Dynamic Image -MPEG4- (In Japanese)", p. 62-66. *

Also Published As

Publication number Publication date
JP3474707B2 (ja) 2003-12-08
JPH1023400A (ja) 1998-01-23

Similar Documents

Publication Publication Date Title
CA2024135A1 (fr) Interpolation conditionnelle a correction des effets dus au mouvement dans les signaux video numeriques
EP1813119B1 (fr) Insertion de message sei (information d&#39;amelioration complementaire) de grain de film pour simulation precise au bit dans un systeme video
KR100964526B1 (ko) 전환 효과를 위한 멀티미디어 코딩 기술
JPH06224776A (ja) 復号装置
EP1061749B1 (fr) Decodeur d&#39;images en mouvement
JPWO2005081515A1 (ja) 画像圧縮法、画像圧縮装置、画像伝送システム、データ圧縮前処理装置及びコンピュータプログラム
JP2003116053A (ja) 特殊効果データ符号化方法及び特殊効果表示方法及び特殊効果データ編集方法
JP2911114B2 (ja) 輪郭線復号化装置
JP4888919B2 (ja) 動画像符号化装置および動画像復号装置
CN100442852C (zh) 使用平均直方图差值的视频编码器及其控制方法
JP3158064B2 (ja) 動画像符号化装置及び動画像復号装置
WO1998002000A1 (fr) Codeur et decodeur d&#39;image
JP3427505B2 (ja) 画像符号化方法と編集装置
JP3280546B2 (ja) 画像編集・符号化装置および画像復号装置
JP2000032458A (ja) 画像圧縮法
JP4136403B2 (ja) 画像処理装置、画像処理方法、プログラム、記憶媒体
JP2005236723A (ja) 動画像符号化装置、動画像符号化方法、動画像復号化装置及び動画像復号化方法
JP3233186B2 (ja) 動画像符号化・復号方法および装置
JP3102323B2 (ja) 画像符号化装置
JPH1023433A (ja) 目標符号量計算装置及び符号量制御装置
JPH11122580A (ja) 画像信号の編集装置、符号化装置及び復号装置
WO2003039163A1 (fr) Procede de compression d&#39;information d&#39;images mobiles et systeme associe
US20040001698A1 (en) Moving image reproducing apparatus
JPH07123412A (ja) 動画像圧縮符号化方法
JP3563837B2 (ja) 画像符号化装置及び画像復号装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA CN KR US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA