WO2012086912A1 - Procédé destiné à convertir une image bidimensionnelle en une image stéréo - Google Patents

Procédé destiné à convertir une image bidimensionnelle en une image stéréo Download PDF

Info

Publication number
WO2012086912A1
WO2012086912A1 PCT/KR2011/008184 KR2011008184W WO2012086912A1 WO 2012086912 A1 WO2012086912 A1 WO 2012086912A1 KR 2011008184 W KR2011008184 W KR 2011008184W WO 2012086912 A1 WO2012086912 A1 WO 2012086912A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
map
depth map
edge
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2011/008184
Other languages
English (en)
Korean (ko)
Inventor
유기령
이광호
김만배
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2012086912A1 publication Critical patent/WO2012086912A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects

Definitions

  • the present invention relates to a method for converting a 2D image into a stereo image. More specifically, an object depth map and a background depth map are separately generated and merged to generate a final depth map, and use the generated final depth map.
  • the present invention relates to a stereo image.
  • 3D video (Stereoscopic Video)
  • 3D imaging can be implemented using these characteristics of humans. For example, by distinguishing a particular subject into a left eye image seen through the viewer's left eye and a right eye image seen through the viewer's right eye, the viewer simultaneously displays the left eye image and the right eye image, thereby allowing the viewer to view the 3D image as a 3D image. I can make it visible.
  • the 3D image may be implemented by producing a binocular image divided into a left eye image and a right eye image and displaying the same.
  • An object of the present invention is to create an object depth map and a background depth map separately from the two-dimensional image and merge them to create a final depth map, and to create a two-dimensional image to generate a more natural stereo image using the generated final depth map SUMMARY OF THE INVENTION
  • An object of the present invention is to separately generate an object depth map and a background depth map from a two-dimensional image, merge them together to generate a final depth map, and use the generated final depth map. To provide a method of converting a two-dimensional image to a stereo image to create a more natural stereo image.
  • An object of the present invention is a method for converting a two-dimensional RGB image to a stereo image, a first step of converting a two-dimensional RGB image to a two-dimensional YUV image, and a second step of generating an edge map from the two-dimensional YUV image And a third step of generating an object depth map and a background depth map by using an edge map, and then integrating an object depth map and a background depth map to generate a final depth map, and using the final depth map. And a fifth step of filling the empty hole pixels generated in the fourth step and the fourth step of acquiring the left-eye image and the right-eye image by moving the RGB image in the horizontal direction, using the surrounding pixel values. Achievable by a method of converting a dimensional image into a stereo image.
  • the object depth map and the background depth map are separately generated from the two-dimensional image, and the final depth map is generated by merging them, and a more natural stereo image can be generated and provided using the generated final depth map.
  • FIG. 1 is a flow chart illustrating a flow of converting a two-dimensional image to a stereo image according to the present invention.
  • FIG. 2 is a diagram illustrating a method of generating a left and right background depth map in an edge map image having a size W ⁇ H.
  • FIG. 3 is a view for explaining a method of allocating depth to left and right background depth maps in an edge map image having a size W ⁇ H.
  • FIG. 3 is a view for explaining a method of allocating depth to left and right background depth maps in an edge map image having a size W ⁇ H.
  • FIG. 4 is a view for explaining a method of generating a vertical background depth map in an edge map image of size W x H.
  • FIG. 5 is a diagram for explaining a method of allocating depth to a vertical background depth map in an edge map image having a size W ⁇ H.
  • FIG. 5 is a diagram for explaining a method of allocating depth to a vertical background depth map in an edge map image having a size W ⁇ H.
  • FIG. 6 is an explanatory diagram for explaining a method of filling a hole pixel generated according to left and right movement of an image
  • FIG. 7 is a flowchart for explaining a method of filling a hole pixel when a hole pixel occurs.
  • FIG. 1 is an example of a flowchart illustrating a flow of converting a 2D image into a stereo image according to the present invention.
  • an input RGB image is converted into a YUV color model (ST100), and an edge map is generated by extracting an edge from the converted YUV color model (ST110).
  • an object depth map is generated using an edge map (ST120), and a left and right background depth map and an up and down background depth map are calculated using the same edge map (ST130 and ST140), and the calculated left and right background depth map and up and down are calculated.
  • the background depth map is generated by integrating the background depth map (ST150).
  • the final depth map is generated by integrating the generated object depth map and the background depth map (ST160), and the variation of pixels is obtained using the final depth map, and the left and right images are generated by moving the RGB image left and right by the variation (ST170). ). Next, by filling the empty hole pixels generated by the shift by the shift (ST180), it is possible to generate the final stereo image (I R , I L ) (ST190).
  • FIG. 1 The processing flow described in FIG. 1 can be processed in hardware or software, as well as the processing techniques of the present invention in various devices.
  • An example of a device to which the conversion technology of the present invention is applied is a device for converting a stereoscopic image into a stereo image in a television receiver receiving a 2D image and providing the same to a viewer.
  • the television receiver receives a compressed two-dimensional image, decodes it, generates a two-dimensional RGB image, stores it in a memory, and performs the steps ST100 to ST180 of FIG. 1 using a processing processor. It generates a video for providing a video signal.
  • a YUV color image is represented by Y (luminance) brightness, U is blue-brightness, V is red-brightness, and has color difference information unlike an RGB image.
  • edge information must be obtained, and since the information obtained from a single data is uncertain, the edge data is obtained from the composite data.
  • Edge information is applied to Y, U, and V, respectively, and the edge is extracted according to the following equation.
  • the deviation of the pixels in the U and V data is calculated as in Equation 3, Equation 4, Equation 5 and Equation 6 below.
  • the maximum value of the pixel can be obtained in addition to the average value.
  • Equation 9 the sum of the weighted products may be obtained as shown in Equation 9.
  • edges include various edge detection methods such as Sobel edge operation and Canny edge operation.
  • An average filter and an edge filter are combined to predict depth from a 2D image.
  • the filter M satisfying this used the following equation (10).
  • Equation 11 is a result obtained by convolving the image I with the filter M.
  • the edge map is represented by the absolute value of F (i, j) as shown in Equation 12.
  • the edge map obtained in Equation 13 is used as the depth map of the object, satisfactory depth cannot be obtained due to the loss of edge information and the strength difference between edge intensities between neighboring pixels. In this case, when viewing the left and right stereoscopic images, stereoscopic hearing deterioration such as eye fatigue occurs. To solve this problem, the edge map is processed as follows.
  • the edge map is converted to a normalized value with [0, 255].
  • the transformation uses a linear transformation as shown in equation (14).
  • the maximum value of the EdgeMap The edge strength value E is equal to [0, 255]. Convert to a value.
  • Determining the overall background composition plays an important role in conveying three-dimensional appearance. In a given image, it is necessary to determine whether the left side and the right side are in front and behind, and have different depths, which are determined by the left and right background depth maps.
  • a background depth map is made using the edge map obtained in Equation 13.
  • FIG. 2 is a diagram for describing a method of generating left and right background depth maps in an edge map image having a size W ⁇ H.
  • the edge strength on the right side is calculated in the following equation (19).
  • the minimum and maximum depth values are calculated as follows. Maximum depth value In this case, the minimum depth value is determined by the following equation (20).
  • ratio Is calculated as in Equation 21 below.
  • the proposed method has an advantage of assigning an appropriate depth value according to the image content. At the same time, it stores information about which side is far or near.
  • FIG. 3 is a diagram for describing a method of allocating depth to left and right background depth maps in an edge map image having a size W ⁇ H.
  • FIG. 4 is a diagram for describing a method of generating a vertical background depth map in an edge map image having a size W ⁇ H.
  • the edge strength at the bottom is calculated in the following equation (24).
  • the depth values of the upper and lower background depth maps are calculated as follows.
  • Maximum depth value In this case, the minimum depth value is determined by the following equation (25).
  • FIG. 5 is a diagram illustrating a method of allocating depth to upper and lower background depth maps in an edge map image having a size W ⁇ H.
  • the depth map is obtained from the sum of the background depth map and the object depth map.
  • the left eye image and the right eye image are calculated as in Equation 30 below.
  • the disparity of the pixels is obtained and the image is moved horizontally to the left and the right to make a left eye image and a right eye image, respectively.
  • I L and I R are the left eye image and the right eye image, respectively, and the variation d is calculated from D in Equation 29 using Equation 31 below.
  • ⁇ is the maximum stereo parallax.
  • the range of D in the depth map is typically [0, 255]. This is transformed into a variation d. Each pixel moves to the left in the left image and to the right in the right image according to the corresponding d value. Therefore, the maximum parallax that can occur in the left and right images is 2d.
  • FIG. 6 is an explanatory diagram for explaining a method of filling a hole pixel generated according to left and right movement of an image. Hole filling generally uses an average value of neighboring pixels, but an improved image quality can be obtained by using an interpolation technique.
  • FIG. 7 is a flowchart illustrating a method of filling a hall pixel when the hall pixel is generated.
  • L Hall pixels are generated (ST700)
  • deviations of the pixels are continuously calculated in a direction in which the pixel having a large disparity value exists (ST710).
  • Search until the deviation value is less than or equal to the threshold P.
  • Searched pixels If the number of is N, L pixels Fill them with interpolation. First, a scaling factor is obtained as shown in Equation 32.
  • the hole filling is completed, and then converted into Top-bottom, Side by Side, Vertical Interleaving, and Interlaced formats for transmission format of 3D display.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention se rapporte à un procédé destiné à convertir une image bidimensionnelle en une image stéréo. La présente invention se rapporte à un procédé destiné à convertir une image RVB bidimensionnelle en une image stéréo, qui comprend : une première étape consistant à convertir une image RVB bidimensionnelle en une image YUV bidimensionnelle; une deuxième étape consistant à générer une carte de bord à partir de l'image YUV bidimensionnelle; une troisième étape consistant à générer une carte de profondeur d'objet et une carte de profondeur d'arrière-plan à l'aide de la carte de bord et à générer une carte de profondeur finale en combinant la carte de profondeur d'objet et la carte de profondeur d'arrière-plan; une quatrième étape consistant à acquérir une image d'œil gauche et une image d'œil droit en déplaçant de manière horizontale l'image RVB bidimensionnelle à l'aide de la carte de profondeur finale; et une cinquième étape consistant à remplir un pixel de trou vide, qui est généré dans la quatrième étape, à l'aide des pixels qui entourent celui-ci.
PCT/KR2011/008184 2010-12-24 2011-10-31 Procédé destiné à convertir une image bidimensionnelle en une image stéréo Ceased WO2012086912A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2010-0134675 2010-12-24
KR1020100134675A KR101207862B1 (ko) 2010-12-24 2010-12-24 2차원 영상을 스테레오 영상으로 변환하는 방법

Publications (1)

Publication Number Publication Date
WO2012086912A1 true WO2012086912A1 (fr) 2012-06-28

Family

ID=46314152

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/008184 Ceased WO2012086912A1 (fr) 2010-12-24 2011-10-31 Procédé destiné à convertir une image bidimensionnelle en une image stéréo

Country Status (2)

Country Link
KR (1) KR101207862B1 (fr)
WO (1) WO2012086912A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4546270A4 (fr) * 2022-06-23 2025-08-27 Future Tech Xiang Yang Co Ltd Procédé et appareil de génération d'image 3d et dispositif informatique

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101364860B1 (ko) * 2012-09-03 2014-02-20 강원대학교산학협력단 입체 영상의 입체감 향상을 위한 입체 영상 변환 방법 및 이를 기록한 기록매체
CN108076338B (zh) 2016-11-14 2022-04-08 北京三星通信技术研究有限公司 图像视觉处理方法、装置及设备
KR20220146900A (ko) 2021-04-26 2022-11-02 삼성전자주식회사 휘도 데이터를 이용하여 심도 정보를 생성하는 처리 회로를 포함하는 전자 장치, 및 심도 정보 생성 방법
KR20220155840A (ko) 2021-05-17 2022-11-24 삼성전자주식회사 관심 영역의 심도 정보를 생성하는 전자 장치 및 이의 동작 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19990057668A (ko) * 1997-12-30 1999-07-15 윤종용 운동 시차의 수평 시차로의 변환을 이용한 2차원 연속 영상의 3차원 영상 변환장치 및 방법
KR20080052309A (ko) * 2006-12-05 2008-06-11 한국전자통신연구원 다시점 영상 생성 장치 및 그 방법
KR20100034789A (ko) * 2008-09-25 2010-04-02 삼성전자주식회사 2차원 영상의 3차원 영상 변환을 위한 깊이 맵 생성 방법 및 장치

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19990057668A (ko) * 1997-12-30 1999-07-15 윤종용 운동 시차의 수평 시차로의 변환을 이용한 2차원 연속 영상의 3차원 영상 변환장치 및 방법
KR20080052309A (ko) * 2006-12-05 2008-06-11 한국전자통신연구원 다시점 영상 생성 장치 및 그 방법
KR20100034789A (ko) * 2008-09-25 2010-04-02 삼성전자주식회사 2차원 영상의 3차원 영상 변환을 위한 깊이 맵 생성 방법 및 장치

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4546270A4 (fr) * 2022-06-23 2025-08-27 Future Tech Xiang Yang Co Ltd Procédé et appareil de génération d'image 3d et dispositif informatique

Also Published As

Publication number Publication date
KR20120072786A (ko) 2012-07-04
KR101207862B1 (ko) 2012-12-04

Similar Documents

Publication Publication Date Title
WO2013081435A1 (fr) Dispositif et procédé d'affichage d'image en 3d
WO2009125988A2 (fr) Appareil et procédé de synthèse d'image tridimensionnelle à multiples vues rapide
WO2013081429A1 (fr) Appareil de traitement d'image et procédé d'affichage sous-pixellaire
WO2017065517A1 (fr) Appareil d'affichage en 3d et procédé de commande de ce dernier
WO2010107227A2 (fr) Procédé d'affichage de données d'image en trois dimensions et appareil de traitement de données d'image en trois dimensions
WO2011004963A2 (fr) Procédé d'affichage d'une interface utilisateur en trois dimensions
WO2016021925A1 (fr) Appareil d'affichage d'images multivues et son procédé de commande
CA2302199A1 (fr) Appareil et procede de traitement d'image
WO2012086912A1 (fr) Procédé destiné à convertir une image bidimensionnelle en une image stéréo
WO2010085074A2 (fr) Procédé d'affichage de sous-titres tridimensionnels et dispositif d'affichage tridimensionnel pour mettre en œuvre ledit procédé
WO2011084021A2 (fr) Récepteur de diffusion et procédé d'affichage d'images 3d
WO2010071291A1 (fr) Procédé pour le traitement de signal d'image en trois dimensions et écran d'affichage d'image pour la mise en oeuvre du procédé
WO2011155697A2 (fr) Procédé et dispositif pour la conversion d'image tridimensionnelle mettant en œuvre une information de carte de profondeur
WO2011005056A2 (fr) Procédé de présentation d'image pour un dispositif d'affichage qui présente des contenus tridimensionnels et dispositif d'affichage faisant appel audit procédé
WO2009151292A2 (fr) Appareil et procédé de conversion d'image
WO2014014263A2 (fr) Procédé de mise à l'échelle de données d'image et appareil d'affichage d'image
WO2014107014A1 (fr) Dispositif d'affichage et appareil d'affichage
WO2013105720A1 (fr) Dispositif et procédé pour analyser la qualité d'une image stéréoscopique en trois dimensions
WO2011129488A1 (fr) Caméra stéréoscopique à axe parallèle
WO2012102522A2 (fr) Procédé et appareil d'émission/réception de signal de radiodiffusion numérique
WO2012091273A1 (fr) Procédé de conversion d'une image à deux dimensions en une image stéréoscopique
WO2014065635A1 (fr) Procédé et appareil de traitement de phénomène de violation de bord dans un service 3dtv à affichage multiple
WO2012157887A2 (fr) Appareil et procédé permettant de délivrer un contenu 3d
WO2010050691A2 (fr) Procédés et appareil permettant de traiter et d'afficher une image
WO2012169698A1 (fr) Dispositif et procédé permettant de générer une image de réalité augmentée stéréoscopique au moyen d'une image 3d stéréoscopique et d'une gpu

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11850593

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11850593

Country of ref document: EP

Kind code of ref document: A1