JPH07182533A - Method for making two-dimensional image into three-dimensional image - Google Patents
Method for making two-dimensional image into three-dimensional imageInfo
- Publication number
- JPH07182533A JPH07182533A JP5324246A JP32424693A JPH07182533A JP H07182533 A JPH07182533 A JP H07182533A JP 5324246 A JP5324246 A JP 5324246A JP 32424693 A JP32424693 A JP 32424693A JP H07182533 A JPH07182533 A JP H07182533A
- Authority
- JP
- Japan
- Prior art keywords
- image
- dimensional
- dimensional image
- eye
- background
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 3
- 241000282414 Homo sapiens Species 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 3
- 241000282412 Homo Species 0.000 description 2
- 230000004308 accommodation Effects 0.000 description 2
- 210000004720 cerebrum Anatomy 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000004040 coloring Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000010287 polarization Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Landscapes
- Image Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
【０００１】[0001]
【産業上の利用分野】本発明は、映画、ＶＴＲ(Video T
ape Recorder) 、ＬＤ(Laser Disc)、ＣＡＴＶ(Cable T
elevision)、テレビ電話、テレビ会議システム、及びビ
デオカメラの撮像信号等の２次元画像を３次元化する方
法に関する。The present invention relates to a movie, a VTR (Video T
ape Recorder), LD (Laser Disc), CATV (Cable T)
elevision), a videophone, a videoconference system, and a method of converting a two-dimensional image such as an image pickup signal of a video camera into a three-dimensional image.
【０００２】[0002]
【従来の技術】３次元画像は歴史的にかなり古くから存
在し、以来さまざまな方式が提案されてきたが、これま
での技術では十分な満足度が得られていないのが現状で
ある。2. Description of the Related Art Three-dimensional images have existed for quite a long time historically, and various methods have been proposed since then, but the current technology has not achieved sufficient satisfaction.
【０００３】一般に人の目で認識できる画像は３次元画
像であるが、それを記録しようとすると絵画や写真のよ
うに２次元画像に置き換えることになる。また３次元画
像としての記録では彫刻等が古くからあるが、背景まで
実像に近いものを含めることは基本的にできていない。Generally, an image that can be recognized by human eyes is a three-dimensional image, but when it is recorded, it is replaced with a two-dimensional image like a picture or a photograph. In addition, although engraving and the like have long been recorded in recording as a three-dimensional image, it is basically not possible to include a background close to a real image.
【０００４】このため人の目と同じ３次元で記録表示さ
せたいということが人が持つ自然な欲求の一つであり続
けているのが現状である。Therefore, it is the present situation that one of the natural desires of human beings is to want to record and display in the same three-dimensional manner as human eyes.
【０００５】ところで近年アミューズメント施設等で見
受けられるようになってきつつある３次元映像には表示
装置等において偏光あるいは色付け等の加工を施された
映像をスクリーンに映し出し、偏光あるいは色付けの眼
鏡を人が着用して実現し得るものが多くある。これらの
表示装置は元々左目映像と右目映像のソースがあり、そ
れを偏光あるいは色付け等の加工により同一のスクリー
ン上に映し出した後、眼鏡によって左目映像と右目映像
とを分離するものである。By the way, in recent years, three-dimensional images which are becoming to be seen in amusement facilities and the like are displayed on a screen as images which have been subjected to polarization or coloring in a display device, etc. There are many things that can be achieved by wearing them. These display devices originally have a source for the left-eye image and a source for the right-eye image, and after displaying them on the same screen by processing such as polarization or coloring, the left-eye image and the right-eye image are separated by glasses.
【０００６】また最近眼鏡なしの３次元映像表示装置が
実用化されたが、左目映像と右目映像が光学的に見てい
る人の夫々左目、右目に像を結ぶようになっており、元
々左目映像と右目映像のソースが準備されていることに
変わりはない。Recently, a three-dimensional image display device without glasses has been put into practical use, but the left-eye image and the right-eye image are connected to the left eye and the right eye of the person who is optically looking, respectively, and originally the left eye. The source of the image and the right-eye image is still prepared.
【０００７】そして実用化されている３次元画像表示装
置の殆どは、人の目が立体を知覚する時のさまざまな機
能、両眼視差、運動視差、輻奏、単眼の調節機能などの
内の、両眼視差を応用している。Most of the three-dimensional image display devices that have been put into practical use include various functions when the human eye perceives a three-dimensional object, binocular parallax, motion parallax, radiation, and monocular accommodation function. , Applying binocular parallax.
【０００８】ここで左右の目が離れていることによって
左目画像と右目画像において像のずれがあり、目と物体
との距離によって異なるずれの大小を大脳の視覚中枢で
遠近感として知覚しているのが両眼視差の機能である。Here, since the left and right eyes are separated, there is a shift in the image between the left-eye image and the right-eye image, and the magnitude of the shift depending on the distance between the eye and the object is perceived as a perspective by the visual center of the cerebrum. Is the function of binocular parallax.
【０００９】左目映像と右目映像のソースを作るには、
実写の場合、人間の左右の目の感覚距離だけ離して２台
のカメラを設置し撮影することで簡単に行える。その他
のアニメーション等の場合、両眼視差を応用して左目か
ら見た映像、右目から見た映像を作り出す。To make a source for the left-eye image and the right-eye image,
In the case of a live-action image, it can be easily done by installing two cameras and taking a photograph with the sense distance between the left and right eyes of the human being. In the case of other animations, binocular parallax is applied to create an image viewed from the left eye and an image viewed from the right eye.
【００１０】最近のコンピュータグラフィックス技術の
進歩によりコンピュータに計算させてアニメーションの
左目映像、右目映像を比較的速く生成させることができ
るようになってきた。Due to recent advances in computer graphics technology, it has become possible to cause a computer to generate a left-eye video image and a right-eye video image of animation relatively quickly.
【００１１】前述のような人間の目で見える実像に近い
３次元画像でなくても実現し得る３次元画像のほぼ全て
が人間の両眼視差を応用しており、手前の画像が背景画
像に対し左目画像と右目画像とで左右にずれていること
から、例えば特開平2-293733号公報では平面的な背景画
像と手前画像夫々を別々に用意して、重ね合わせ合成を
行うことにより簡便に３次元画像を得られる方法が提案
されている。Almost all of the three-dimensional images that can be realized even if they are not the three-dimensional images that are close to the real images visible to human eyes as described above apply the binocular parallax of humans, and the image in front is the background image. On the other hand, since the left-eye image and the right-eye image are shifted to the left and right, for example, in Japanese Patent Laid-Open No. 2-293733, for example, a flat background image and a foreground image are separately prepared, and it is possible to easily perform superimposing synthesis. A method for obtaining a three-dimensional image has been proposed.
【００１２】このように新しく３次元映像を作り出すこ
とは比較的簡単にできるようになってきたが、既にある
２次元映像から３次元映像に変換することはあまり行わ
れてない。映画やＴＶ、ビデオ、写真などの２次元映像
文化の歴史は長くその間に蓄えられた２次元映像は膨大
な量に上る。As described above, it has become relatively easy to create a new three-dimensional image, but conversion of an existing two-dimensional image into a three-dimensional image is not often performed. The history of 2D image culture such as movies, TV, videos, and photographs is long, and the amount of 2D images accumulated during that period is enormous.
【００１３】またこれらの２次元映像の制作にかかった
費用や時間も莫大なものである。人類が持つこのような
２次元の文化財産をこれからの３次元映像表示装置、延
ては３次元映像文化に活用していくことが３次元映像産
業の発展、さらには生活やビジネスの文化の発展に寄与
していくものと考えられる。Further, the cost and time required for producing these two-dimensional images are enormous. Utilizing such two-dimensional cultural assets possessed by humankind in future three-dimensional image display devices, and ultimately in three-dimensional image culture, the development of the three-dimensional image industry, and further the development of life and business culture It is thought that it will contribute to.
【００１４】そこで２次元画像ソースから３次元画像に
変換するため例えば特開平2-39690号公報の発明では撮
像した２次元画像から人物像を抽出し、この人物像と別
途用意した背景画像とを３次元手法的に異なる位置に表
示するよう表示装置を構成することにより、人物像を３
次元空間中に実像として表示できるように提案してい
る。Therefore, in order to convert a two-dimensional image source into a three-dimensional image, for example, in the invention disclosed in Japanese Patent Laid-Open No. 2-39690, a human image is extracted from the captured two-dimensional image, and this human image and a background image prepared separately are extracted. By configuring the display device to display at different positions in a three-dimensional manner, the image of the person can be displayed in 3D.
It is proposed that it can be displayed as a real image in the dimensional space.
【００１５】しかし、当該公報の技術では背景画像を元
々の人物像を含んだ２次元画像から取り出すのではなく
別途用意する必要があった。However, in the technique of the above publication, it is necessary to prepare a background image separately rather than extracting it from a two-dimensional image containing the original human image.
【００１６】[0016]
【発明が解決しようとする課題】ところで２次元画像ソ
ースを３次元画像の左目画像及び右目画像に変換するた
めには２次元画像中から背景より手前にある人物像の画
像を抽出し、両眼視差と遠近感に応じて手前画像を左右
にずらし、背景画像と重ね、左目画像及び右目画像がで
きる。By the way, in order to convert a two-dimensional image source into a left-eye image and a right-eye image of a three-dimensional image, an image of a person image in front of the background is extracted from the two-dimensional image, and the binocular image is extracted. It is possible to shift the front image to the left or right according to the parallax and the perspective, and superimpose it on the background image to form a left-eye image and a right-eye image.
【００１７】しかし、手前画像が元々在った領域には背
景画像情報がないことから、図４に示す通り、手前画像
がずれることによって画像情報のない領域ができてしま
うことになる。However, since the background image information does not exist in the area where the foreground image originally existed, as shown in FIG. 4, the area where the foreground image shifts creates an area with no image information.
【００１８】この画像情報のない領域を背景画像あるい
は手前画像が左右に延長された画像として補填するには
コンピュータグラフィックスを主とするアニメーション
で作り出す方法も考えられるが、画像を類推して作り出
すことは大変な手間や労力がかかることを否めない。In order to fill the area without image information as an image in which the background image or the foreground image is extended left and right, a method of making it by an animation mainly of computer graphics can be considered, but making by analogy with the image Is undeniably labor-intensive and labor-intensive.
【００１９】その上既存の２次元画像ソースとして映画
やＴＶ、ビデオ、写真等殆どのものは実写であり、実写
画像の一部にアニメーション画像が含まれることは画像
の質感が異なることから補填部分が際立って目について
しまい、違和感のある３次元画像になってしまう問題点
が生じる。Moreover, most existing two-dimensional image sources, such as movies, TVs, videos, and photographs, are live-action images, and the fact that an animation image is included in a part of the live-action image results in a different texture of the image, so the supplemented portion. Is conspicuously noticeable, resulting in a problem that a three-dimensional image having a feeling of strangeness is formed.
【００２０】一方、背景画像を別途用意し、既存の手前
画像と合成する方式では、画像情報のない領域ができて
しまう問題点は克服できるものの、画像が別のものにな
ってしまうという問題点が生じる。On the other hand, in the method of preparing the background image separately and synthesizing it with the existing foreground image, the problem that an area without image information is formed can be overcome, but the image becomes another problem. Occurs.
【００２１】そこで本発明は既存の２次元画像の情報の
みからでも違和感の少ない３次元画像化を実現できる方
式を提供することを目的とする。Therefore, an object of the present invention is to provide a method capable of realizing a three-dimensional image with less discomfort even from the information of the existing two-dimensional image.
【００２２】[0022]
【課題を解決するための手段】本発明は、２次元画像か
ら３次元画像用の左目画像あるいは右目画像を作成する
２次元画像の３次元化方法であって、背景画像やそれよ
り手前の人物像等からなる手前画像からなる２次元画像
から該手前画像を抽出するステップと、視差や遠近感に
応じて前記手前画像を水平方向に移動させるステップ
と、前記手前画像の移動によって生じる無画像情報領域
を補填するように移動後の前記手前画像を拡大するステ
ップと、前記手前画像と背景画像とを合成するステップ
とよりなる。The present invention is a three-dimensional method of a two-dimensional image for creating a left-eye image or a right-eye image for a three-dimensional image from a two-dimensional image, which is a background image or a person in front of it. A step of extracting the foreground image from a two-dimensional image composed of a foreground image composed of images, a step of horizontally moving the foreground image according to parallax or perspective, and no-image information generated by the movement of the foreground image The method includes a step of enlarging the front image after the movement so as to fill the area, and a step of combining the front image and the background image.
【００２３】[0023]
【作用】上記構成において、手前画像を拡大せずにその
まま視差や遠近感に応じて左右にずらすこと等により生
ずる画像情報のない領域に画像情報を補填し、３次元表
示装置に供給できる左目画像及び右目画像を生成する。In the above structure, a left-eye image that can be supplied to a three-dimensional display device by filling image information in a region without image information generated by shifting the foreground image to the left or right according to parallax or perspective without enlarging it And generate a right-eye image.
【００２４】[0024]
【実施例】以下本発明の２次元画像の３次元化方法の実
施例として、変換後の３次元用片目（右目）画像を生成
する方法を挙げて図面に基づき詳細に説明する。DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A method of generating a converted three-dimensional one-eye (right-eye) image will be described below as an embodiment of a two-dimensional image three-dimensionalization method of the present invention in detail with reference to the drawings.
【００２５】図１（ａ）は本方法を解り易く説明するた
めの背景より手前にある画像の輪郭線が元々の２次元画
像に対しどのように変わったかを示す概念図を示してい
る。同図において、元々の２次元画像上の手前画像１
（図中黒塗りで示す）は拡大することと、視差や遠近感
に応じて背景に対し左右にずらすことの両方を少なくと
も行わせることにより手前画像２となる。FIG. 1 (a) is a conceptual diagram showing how the contour line of the image in front of the background changes with respect to the original two-dimensional image in order to easily understand the method. In the figure, the front image 1 on the original two-dimensional image 1
The foreground image 2 is obtained by at least performing both enlargement (shifted in black in the figure) and shifting to the left or right with respect to the background according to parallax or perspective.
【００２６】また図１（ｂ）は前述のずらしの結果の３
次元片目（右目）画像を示す。同図において従来左右に
手前画像がずれることによって生じる画像情報のない領
域は以下に述べる方法によって補填され、違和感の少な
い画像が生成されている。Further, FIG. 1 (b) shows the result of the above-mentioned shift of 3
A one-dimensional (right eye) image is shown. In the same figure, a region without image information, which is conventionally generated by shifting the front image to the left and right, is compensated by the method described below, and an image with less discomfort is generated.
【００２７】ここで３次元用の左目画像と右目画像と
は、左右へのずれ方が異なるだけで同様の方法にて生成
される。そしてこれらの画像はＴＶや映画の動画ソース
であっても良いし、写真や印刷物等の静止画ソースであ
っても構わない。Here, the three-dimensional left-eye image and right-eye image are generated by the same method except that the left and right images are different from each other. These images may be moving image sources of TV or movies, or still image sources such as photographs and printed materials.
【００２８】次に図２の本発明方法を説明するブロック
構成図について説明する。まずステップＳ１においてビ
デオカメラの撮影等の２次元画像の入力装置によって得
られた２次元画像ソースＳ２は左目画像・右目画像の夫
々の生成ブロックの流れに分岐される。Next, a block diagram for explaining the method of the present invention shown in FIG. 2 will be described. First, in step S1, a two-dimensional image source S2 obtained by a two-dimensional image input device, such as a video camera, is branched into a flow of left-eye image and right-eye image generation blocks.
【００２９】そして２次元画像ソースＳ２のデータから
夫々のブロック毎に手前画像を周知の輪郭検知の画像処
理技術等を用いて抽出する（ステップＬＳ３、ＲＳ
３）。このときの手前画像抽出の過程は左目画像と右目
画像とで同一であるので当該ステップＬＳ３、ＲＳ３は
共通化しても構わない。Then, the front image is extracted from the data of the two-dimensional image source S2 for each block by using a known image processing technique of contour detection or the like (steps LS3, RS).
3). Since the process of extracting the front image at this time is the same for the left-eye image and the right-eye image, the steps LS3 and RS3 may be shared.
【００３０】次にステップＬＳ４、ＲＳ４において視差
と遠近感に応じて手前画像を少なくとも左右に移動させ
る。このとき移動させた手前画像と背景画像との合成画
像には先に述べたように画像情報のない領域（無画像情
報領域）が生じる。Next, in steps LS4 and RS4, the front image is moved at least left and right according to the parallax and perspective. At this time, in the composite image of the front image and the background image moved, as described above, an area without image information (non-image information area) occurs.
【００３１】そこでステップＬＳ５、ＲＳ５において前
記無画像情報領域を補填するように移動させた手前画像
を拡大させる。Therefore, in steps LS5 and RS5, the front image moved so as to fill the non-image information area is enlarged.
【００３２】そしてステップＬＳ４、ＲＳ４で移動、ス
テップＬＳ５、ＲＳ５で拡大を済ませた手前画像と、元
々の背景画像とをステップＬＳ６、ＲＳ６において手前
画像を優先して選択することにより合成する。これは背
景画像と拡大された手前画像とで重なることを防止する
ためである。Then, the front image that has been moved in steps LS4 and RS4 and enlarged in steps LS5 and RS5 and the original background image are combined by preferentially selecting the front image in steps LS6 and RS6. This is to prevent the background image and the enlarged front image from overlapping.
【００３３】こうして生成された３次元画像ソースとな
る３次元左目画像ＬＳ７と３次元右目画像ＲＳ７は視差
による左右のずれが確保されているため、ステップ８に
おいて偏光方式の３次元表示装置による映写等の３次元
画像表示装置・手段により表示され、人の目に３次元の
映像として認知される。Since the three-dimensional left-eye image LS7 and the three-dimensional right-eye image RS7, which are the three-dimensional image sources generated in this way, have a left-right shift due to parallax, at step 8, projection by a polarization-type three-dimensional display device, etc. It is displayed by the 3D image display device / means and is recognized as a 3D image by human eyes.
【００３４】このように上記実施例の方法によれば手間
や労力が少なくて済む簡便な方法で２次元画像から違和
感の少ない３次元画像を得ることが可能となる。As described above, according to the method of the above-described embodiment, it is possible to obtain a three-dimensional image with less discomfort from a two-dimensional image by a simple method that requires less labor and labor.
【００３５】尚、上記の３次元画像への変換の過程で、
画像はビデオ信号の電気信号で処理されても構わない
し、電気信号で処理されなくても構わない。また撮影装
置等の２次元画像入力装置が無く、ビデオテープやビデ
オ信号等により２次元画像ソースを入手しても構わない
し、あるいは３次元画像表示装置が無くビデオテープや
ビデオ信号等の３次元画像ソースとして他の装置に出力
しても構わない。In the process of conversion into the above three-dimensional image,
The image may or may not be processed with the electric signal of the video signal. Further, there is no need for a two-dimensional image input device such as a photographing device and a two-dimensional image source may be obtained from a video tape or a video signal, or there is no three-dimensional image display device and a three-dimensional image such as a video tape or a video signal. It may be output to another device as a source.
【００３６】さて前述したような手前画像を拡大させる
方法としては重心などのある点を中心にした拡大でも良
いし、あるいは左右方向だけ又は上下方向だけを拡大し
ても構わない。また中心線（直線）を基線として拡大を
行っても良いし、直線ではなく曲線を基線としても構わ
ない。As a method of enlarging the foreground image as described above, it is possible to enlarge around a certain point such as the center of gravity, or to enlarge only in the horizontal direction or in the vertical direction. Further, the center line (straight line) may be used as the base line for expansion, or a curved line may be used as the base line instead of the straight line.
【００３７】拡大のための基線を決める一例として次の
ようなものがある。The following is an example of determining the base line for enlargement.
【００３８】（１）輪郭線から内側に該輪郭線と平行な
曲線（直線群）を作り、その曲線に対しさらに内側の曲
線（直線群）を作るというように曲線（直線群）で囲ま
れた領域を各部分同じ割合（速さ）で次第に小さくして
いく。そうすると領域における境界線と対面の境界線が
くっつく。(1) A curve (straight line group) parallel to the contour line is formed inside the contour line, and a curve (straight line group) further inside the curve is formed. The area is gradually reduced at the same rate (speed) in each part. Then, the boundary line of the area and the boundary line of the meeting face each other.
【００３９】このようにくっついたところの曲線（直線
群）を残していくようにすると、最終的に枝わかれして
いることが多く、且つ内部面積を持たない曲線（直線
群）ができる。例えば図３（ａ）に示すような外形をし
た図形の場合、内部に図のような基線を規定することが
できる。By leaving the curves (straight line groups) where they are stuck together in this way, a curve (straight line group) that is often branched at the end and has no internal area is formed. For example, in the case of a figure having an outer shape as shown in FIG. 3A, a base line as shown in the figure can be defined inside.
【００４０】（２）基線のでき始めについては図３
（ｂ）に示すように勾配が不連続となる点（頂点）が直
線の線分で囲まれている場合、勾配が不連続となる点
（頂点）がいくつかあり、各頂点間の線分（辺）が短い
もの（短辺）と長いもの（長辺）があり、領域を次第に
小さくしていくと短辺と長辺共に短くなっていき、短辺
の長さが無くなる時がある。この時から基線ができ始め
るものとする。(2) Figure 3 shows the beginning of the baseline.
When the point (vertex) where the gradient is discontinuous is surrounded by a straight line segment as shown in (b), there are several points (vertices) where the gradient is discontinuous, and the line segment between each vertex. There are short sides (short sides) and long sides (long sides). When the area is made smaller, both the short sides and the long sides become shorter, and the length of the short sides may disappear. It is assumed that the baseline starts at this time.
【００４１】（３）一方直線の線分で囲まれていても、
図３（ｃ）に示すように短辺のみの長さがなくならず、
長さがなくなったときは、基線は点（点群）になってい
る場合もある。(3) Even if it is surrounded by a straight line segment,
As shown in FIG. 3C, the length of only the short side is not lost,
When the length is gone, the base line may be a point (point cloud).
【００４２】（４）曲線の線分で囲まれている場合も、
前記（１）〜（３）の条件に準じる。不連続点（頂点）
がいくつかある場合、辺の長さがなくなるときは必ず基
線ができる。(4) Even when surrounded by a curved line segment,
The conditions of (1) to (3) above are applied. Discontinuity (vertex)
If there are several, there will always be a baseline when the sides run out.
【００４３】不連続点（頂点）がなくとも図３（ｄ）に
示すように領域における境界線と対面との境界線が１８
０°の関係でくっつく場合、その接点（接点群）から基
線ができ始める。Even if there is no discontinuity point (vertex), the boundary line between the boundary and the facing surface in the area is 18 as shown in FIG. 3 (d).
When they stick together due to 0 °, a base line starts to form from the contact (contact group).
【００４４】さらに図３（ｅ）に示すような外形をした
曲線図形の場合、内部に図示のごとき基線を規定するこ
とができる。Further, in the case of a curved figure having an outer shape as shown in FIG. 3E, a base line as shown in the drawing can be defined inside.
【００４５】そして上記（１）〜（４）の方法で規定さ
れた基線を基に、領域を小さくするのと逆に輪郭線を大
きくするようにして、手前画像の拡大は実現可能とな
る。Then, on the basis of the base line defined by the above methods (1) to (4), the contour line is made larger, while the area is made smaller, so that the front image can be enlarged.
【００４６】[0046]
【発明の効果】現在実用化されている３次元表示装置の
殆どは人の目が立体を知覚する時のさまざまな機能、両
眼視差、運動視差、輻奏、単眼の調節機能などのうちの
両眼視差を応用している。Most of the three-dimensional display devices that have been put into practical use out of various functions when the human eye perceives a three-dimensional object, binocular parallax, motion parallax, radiation, monocular accommodation function, and the like. Binocular parallax is applied.
【００４７】左右の目が離れていることによって左目画
像と右目画像において像のずれがあり、目と物体の距離
によって異なるずれの大小を大脳の視覚中枢で遠近感と
して知覚しているのが両眼視差の機能である。Since the left and right eyes are distant from each other, the left eye image and the right eye image are displaced from each other, and the visual center of the cerebrum perceives a difference in magnitude depending on the distance between the eye and the object as a perspective. It is a function of visual parallax.
【００４８】２次元画像ソースから左目画像と右目画像
を作り出すには背景画像に対して手前画像を左右にずれ
させると良いのであるが、ただずれさせただけでは手前
画像が元々あって、ずれさせた後は手前画像が無くなっ
たところに画像情報を持たない部分が発生するため、新
たに画像情報を作る等の補正方法をとる必要があった。In order to create a left-eye image and a right-eye image from a two-dimensional image source, it is good to shift the foreground image to the left and right with respect to the background image. After that, a part without image information occurs where the previous image disappears, so it is necessary to take a correction method such as newly creating image information.
【００４９】また、新たに画像情報を作ることは大変な
手間と労力がかかる上、補正した画像部分は質感が異な
ること等から補正部分が目立ち、違和感のある左目画像
や右目画像しか得られなかった。Further, creating new image information requires a great deal of time and labor, and the corrected image portion has a different texture, and therefore the corrected portion is conspicuous, so that only a left-eye image and a right-eye image having a sense of discomfort can be obtained. It was
【００５０】しかしながら本発明の方法によれば手前画
像を効果的に拡大、移動させることにより新たに画像情
報を作ることのない比較的簡便な方法で、且つ元々の画
像情報を活用することから比較的違和感の無い方法で２
次元画像ソースから３次元画像ソースを作り出すことが
できる。However, according to the method of the present invention, the original image information is utilized by a relatively simple method in which new image information is not created by effectively enlarging and moving the foreground image. 2 in a way that doesn't feel strange
A 3D image source can be created from a 3D image source.
【００５１】従って人がこれまで作り出し蓄えてきた映
画、ＴＶ記録ビデオ、写真等の２次元画像による膨大な
文化財産は３次元画像として変換して有効に活用するこ
とができ、また２次元の撮影機器等の画像入力装置も引
き続き活用できる効果が期待できる。Therefore, a huge amount of cultural assets made up of two-dimensional images such as movies, TV recording videos, and photographs that humans have created and stored so far can be converted into a three-dimensional image for effective use, and two-dimensional photography. It can be expected that the image input device such as a device can be continuously used.
【図１】（ａ）は本発明の２次元画像の３次元化方法の
一実施例である右目画像を示す図、（ｂ）は結果として
得られた３次元画像用右目画像を示す図である。FIG. 1A is a diagram showing a right-eye image which is an embodiment of a method for three-dimensionalizing a two-dimensional image according to the present invention, and FIG. 1B is a diagram showing a resultant right-eye image for a three-dimensional image. is there.
【図２】本発明方法を説明するブロックで表された流れ
図である。FIG. 2 is a flow chart represented by blocks illustrating a method of the present invention.
【図３】（ａ）〜（ｅ）は画像の拡大のさまざまな基線
の規定方法を説明する図である。3A to 3E are diagrams illustrating a method of defining various base lines for image enlargement.
【図４】従来の方法による３次元画像用右目画像を示す
図である。FIG. 4 is a diagram showing a three-dimensional image right-eye image according to a conventional method.
１ 元々の手前画像 ２ ３次元化された手前画像 1 Original front image 2 3D front image
Claims (1)
あるいは右目画像を作成する２次元画像の３次元化方法
であって、背景画像やそれより手前の人物像等からなる
手前画像からなる２次元画像から該手前画像を抽出する
ステップと、視差や遠近感に応じて前記手前画像を水平
方向に移動させるステップと、前記手前画像の移動によ
って生じる無画像情報領域を補填するように移動後の前
記手前画像を拡大するステップと、前記手前画像と背景
画像とを合成するステップとよりなる２次元画像の３次
元化方法。1. A three-dimensional method of a two-dimensional image for creating a left-eye image or a right-eye image for a three-dimensional image from a two-dimensional image, which is composed of a front image including a background image and a person image in front of the background image. After extracting the foreground image from the two-dimensional image, moving the foreground image in the horizontal direction according to parallax or perspective, and moving the image so as to fill the no-image information area generated by the movement of the foreground image. (3) A method for three-dimensionalizing a two-dimensional image, which comprises the step of enlarging the foreground image and the step of synthesizing the foreground image and the background image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP05324246A JP3086577B2 (en) | 1993-12-22 | 1993-12-22 | 3D image conversion method for 2D images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP05324246A JP3086577B2 (en) | 1993-12-22 | 1993-12-22 | 3D image conversion method for 2D images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH07182533A true JPH07182533A (en) | 1995-07-21 |
| JP3086577B2 JP3086577B2 (en) | 2000-09-11 |
Family
ID=18163666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP05324246A Expired - Fee Related JP3086577B2 (en) | 1993-12-22 | 1993-12-22 | 3D image conversion method for 2D images |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3086577B2 (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1997015150A1 (en) * | 1995-10-19 | 1997-04-24 | Sony Corporation | Method and device for forming three-dimensional image |
| WO1998004087A1 (en) * | 1996-07-18 | 1998-01-29 | Sanyo Electric Co., Ltd. | Device and method for converting two-dimensional video into three-dimensional video |
| JPH1074269A (en) * | 1996-06-26 | 1998-03-17 | Matsushita Electric Ind Co Ltd | Stereoscopic cg moving image generator |
| FR2754611A1 (en) * | 1996-10-15 | 1998-04-17 | Atelier Publi 3 | Method of three dimensional viewing of articles |
| EP1379063A1 (en) * | 2002-07-03 | 2004-01-07 | Sharp Kabushiki Kaisha | Mobile device for capturing, generating and displaying three-dimensional images using a single camera |
| US7031384B2 (en) | 1999-01-22 | 2006-04-18 | Sony Corporation | Apparatus for generating motion control signal from image signal |
| US7271803B2 (en) | 1999-01-08 | 2007-09-18 | Ricoh Company, Ltd. | Method and system for simulating stereographic vision |
| JP2007272318A (en) * | 2006-03-30 | 2007-10-18 | Rozefu Technol:Kk | Processing method of personal photographic image |
| KR100915039B1 (en) * | 2007-10-11 | 2009-09-02 | 최명렬 | Method and Device for Transformation from Multi Focused 2D Image to 3D Image, and Recording Media |
| JP2011181090A (en) * | 2011-04-28 | 2011-09-15 | Nippon Telegr & Teleph Corp <Ntt> | Method, device and program for animation of still image |
| JP2012015610A (en) * | 2010-06-29 | 2012-01-19 | Fujitsu Semiconductor Ltd | Processing device |
| JP2012256297A (en) * | 2011-06-10 | 2012-12-27 | Toshiba Corp | Image processing apparatus, method and program |
| JP2013178749A (en) * | 2012-02-08 | 2013-09-09 | Jvc Kenwood Corp | Image processing device, image processing method, and image processing program |
| US9596455B2 (en) | 2012-03-28 | 2017-03-14 | Fujifilm Corporation | Image processing device and method, and imaging device |
| US12108014B2 (en) | 2020-01-28 | 2024-10-01 | Japan Display Inc. | Image processing device and head-up display |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6307213B2 (en) | 2012-05-14 | 2018-04-04 | サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ | Image processing apparatus, image processing method, and program |
| JP2013239833A (en) | 2012-05-14 | 2013-11-28 | Sony Corp | Image processing apparatus, image processing method, and program |
-
1993
- 1993-12-22 JP JP05324246A patent/JP3086577B2/en not_active Expired - Fee Related
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1997015150A1 (en) * | 1995-10-19 | 1997-04-24 | Sony Corporation | Method and device for forming three-dimensional image |
| GB2309847A (en) * | 1995-10-19 | 1997-08-06 | Sony Corp | Method and device for forming three-dimensional image |
| GB2309847B (en) * | 1995-10-19 | 1999-09-15 | Sony Corp | Stereoscopic image generation method and apparatus thereof |
| US5959663A (en) * | 1995-10-19 | 1999-09-28 | Sony Corporation | Stereoscopic image generation method and apparatus thereof |
| JPH1074269A (en) * | 1996-06-26 | 1998-03-17 | Matsushita Electric Ind Co Ltd | Stereoscopic cg moving image generator |
| WO1998004087A1 (en) * | 1996-07-18 | 1998-01-29 | Sanyo Electric Co., Ltd. | Device and method for converting two-dimensional video into three-dimensional video |
| US6445833B1 (en) | 1996-07-18 | 2002-09-03 | Sanyo Electric Co., Ltd | Device and method for converting two-dimensional video into three-dimensional video |
| FR2754611A1 (en) * | 1996-10-15 | 1998-04-17 | Atelier Publi 3 | Method of three dimensional viewing of articles |
| US7271803B2 (en) | 1999-01-08 | 2007-09-18 | Ricoh Company, Ltd. | Method and system for simulating stereographic vision |
| US7382830B2 (en) | 1999-01-22 | 2008-06-03 | Sony Corporation | Apparatus for generating motion control signal from image signal |
| US7031384B2 (en) | 1999-01-22 | 2006-04-18 | Sony Corporation | Apparatus for generating motion control signal from image signal |
| EP1379063A1 (en) * | 2002-07-03 | 2004-01-07 | Sharp Kabushiki Kaisha | Mobile device for capturing, generating and displaying three-dimensional images using a single camera |
| US7889192B2 (en) | 2002-07-03 | 2011-02-15 | Sharp Kabushiki Kaisha | Mobile equipment with three dimensional display function |
| JP2007272318A (en) * | 2006-03-30 | 2007-10-18 | Rozefu Technol:Kk | Processing method of personal photographic image |
| KR100915039B1 (en) * | 2007-10-11 | 2009-09-02 | 최명렬 | Method and Device for Transformation from Multi Focused 2D Image to 3D Image, and Recording Media |
| US8885025B2 (en) | 2010-06-29 | 2014-11-11 | Fujitsu Semiconductor Limited | Processor |
| JP2012015610A (en) * | 2010-06-29 | 2012-01-19 | Fujitsu Semiconductor Ltd | Processing device |
| JP2011181090A (en) * | 2011-04-28 | 2011-09-15 | Nippon Telegr & Teleph Corp <Ntt> | Method, device and program for animation of still image |
| JP2012256297A (en) * | 2011-06-10 | 2012-12-27 | Toshiba Corp | Image processing apparatus, method and program |
| JP2013178749A (en) * | 2012-02-08 | 2013-09-09 | Jvc Kenwood Corp | Image processing device, image processing method, and image processing program |
| US9596455B2 (en) | 2012-03-28 | 2017-03-14 | Fujifilm Corporation | Image processing device and method, and imaging device |
| US12108014B2 (en) | 2020-01-28 | 2024-10-01 | Japan Display Inc. | Image processing device and head-up display |
Also Published As
| Publication number | Publication date |
|---|---|
| JP3086577B2 (en) | 2000-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6496598B1 (en) | Image processing method and apparatus | |
| EP2188672B1 (en) | Generation of three-dimensional movies with improved depth control | |
| JP3086577B2 (en) | 3D image conversion method for 2D images | |
| US4925294A (en) | Method to convert two dimensional motion pictures for three-dimensional systems | |
| JP5449162B2 (en) | Video encoding apparatus, video encoding method, video reproduction apparatus, and video reproduction method | |
| KR101633627B1 (en) | Method and system for processing an input three dimensional video signal | |
| US6747610B1 (en) | Stereoscopic image display apparatus capable of selectively displaying desired stereoscopic image | |
| US6466205B2 (en) | System and method for creating 3D models from 2D sequential image data | |
| Muller et al. | Reliability-based generation and view synthesis in layered depth video | |
| MX2011000785A (en) | 3d display handling of subtitles. | |
| JP2022533754A (en) | Method, apparatus, and computer program product for volumetric video encoding and decoding | |
| JP2002174866A (en) | Diagonal lenticular picture system | |
| JP3524147B2 (en) | 3D image display device | |
| KR20110093828A (en) | Method and system for encoding 3D image signal, encoded 3D image signal, method and system for decoding 3D image signal | |
| CN101189643A (en) | 3D image generation and display system | |
| Satoh et al. | 3D image display with motion parallax by camera matrix stereo | |
| KR20110082531A (en) | Image processing apparatus and method, image reproducing apparatus and method, and program | |
| JP3091644B2 (en) | 3D image conversion method for 2D images | |
| CN102612837B (en) | Method and device for generating partial views and/or a stereoscopic image master from a 2d-view for stereoscopic playback | |
| JP7011728B2 (en) | Image data output device, content creation device, content playback device, image data output method, content creation method, and content playback method | |
| JP2004530218A (en) | Visual communication signal | |
| JPH0965374A (en) | 3D video recording device and 3D video playback device | |
| JP2008167310A (en) | Naked eye stereoscopic vision image processing method, device, and recording medium recording operation program | |
| JPH07254073A (en) | Method for conversion from two-dimensional image to three-dimensional image | |
| Jung et al. | Three-dimensional animation display using integral photography with variable image planes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20080707 Year of fee payment: 8 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20080707 Year of fee payment: 8 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20090707 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20100707 Year of fee payment: 10 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20110707 Year of fee payment: 11 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120707 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120707 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130707 Year of fee payment: 13 |
|
| LAPS | Cancellation because of no payment of annual fees |