KR20140077772A - Apparatus and method for providing multi-view video - Google Patents

Abstract

Disclosed is a multi-view image providing apparatus using a two-dimensional display. Wherein the multi-view image providing apparatus selects a multi-view image file to be output through the two-dimensional display, selects at least one of a time and a viewpoint to output from the selected multi-view image file, Point image file, the multi-view synthesis is performed on the selected multi-view image file, and the multi-view synthesis is performed based on at least one of the time and the viewpoint, And a real-time multi-point composition unit for providing the multi-dimensional display.

Description

[0001] APPARATUS AND METHOD FOR PROVIDING MULTI-VIEW VIDEO [0002]

The present invention relates to multi-view images, and more particularly, to an apparatus and method for providing multi-view images in a two-dimensional display.

A multi-view image means a three-dimensional image by displaying a slightly different image corresponding to a geometric corresponding to the position of an eye of a viewer. In general, multi-view images are provided to the multi-view display device at the same time, and multi-view effects are obtained by displaying different images according to viewing angles on the multi-view display device.

However, the multi-view display device does not have satisfactory performance because crosstalk between the viewpoint and the viewpoint may occur. In addition, even if the crosstalk is small, the spatial region in which the multi-point effect can be obtained is limited, and when the region is out of such a region, there is a problem of severe crosstalk or inversion of the right and left visual fields. Therefore, when a multi-view image is synthesized, it is difficult to display the synthesized multi-view image properly on a multi-view display device. For example, it is difficult to confirm whether the multi-view image is properly synthesized in the multi-view display device, and when the multi-view image is to be displayed to viewers, the multi-view display device itself has problems such as motion parallax There is a problem that is hard to show the effect.

Accordingly, there is a need for a technique capable of providing a multi-view image using a two-dimensional display device instead of a multi-view display device having the above-described problems. By using such a two-dimensional display device, it is possible to confirm the synthesis result of the multi-view image more accurately, and it is possible to make the motion parallax feel to ordinary viewers.

The present invention provides an apparatus and method for identifying a multi-view image synthesized using a two-dimensional display.

The present invention provides an apparatus and method for enabling a multi-view image input in real time to be confirmed through a two-dimensional display.

The present invention provides an apparatus and method for receiving a multi-viewpoint file or a real-time signal and providing an image at a desired time or viewpoint using two-dimensional, three-dimensional or multi-view display.

According to an aspect of the present invention, there is provided a multi-view image providing apparatus using a two-dimensional display. The apparatus includes a selection unit for selecting a multi-view image file to be output through the two-dimensional display, selecting at least one of a time and a viewpoint to be output from the selected multi-view image file, and outputting the selected multi- Point combination of the multi-view image file is required, multi-point synthesis is performed on the selected multi-view image file, and multi-point synthesis is performed based on at least one of the time and the view point to provide the multi- And a real-time multipoint synthesis unit.

It is possible to examine or view multi-point content using a two-dimensional display such as a computer or a TV, and can view images at a desired time while controlling a desired time using a device such as a mouse, a keyboard, and a remote controller. In addition to the two-dimensional display, it is also possible to select and view a desired viewpoint or time from the multi-view content even in a display supporting three-dimensional and multi-viewpoints.

1 is a block diagram schematically illustrating an apparatus for providing multi-view images in a two-dimensional display according to an embodiment of the present invention.
2 is a flowchart illustrating a method of providing a multi-view image in a two-dimensional display according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. Further, the present invention is not limited to the embodiments described below, but can be applied in various different forms within the scope of the technical idea of the present invention.

The components described in this specification may include components other than those described below as needed, and a detailed description of parts that are not directly related to the present invention will be omitted. In addition, the arrangement of each component described in this specification can be adjusted as necessary, and one component may be included in another component, and one component may be divided into two or more components.

A multi-view is an image that provides three-dimensional visual information. The multi-view is an image that includes three or more images captured by one or more cameras and geometric information about the images at the various viewpoints, And may be generated by performing a view synthesis using a depth image including depth information or the like.

1 is a block diagram schematically illustrating an apparatus for providing multi-view images in a two-dimensional display according to an embodiment of the present invention.

Referring to FIG. 1, an apparatus 100 for providing a multi-view image includes a storage unit 110, a selection unit 120, a real-time multi-view synthesis unit 130, And a display unit 140.

The storage unit 110 is a component for storing files for multi-view images. The storage unit 110 stores a file composed of already-synthesized multi-view images or a file to be subjected to multi-point synthesis through additional processing. For example, if the files stored in the storage unit 110 exist as a 2D image file and a depth image file, a decoding process and an image synthesis process are required to generate a multi-view image.

For example, the file for the multi-view image stored in the storage unit 110 may be a plurality of YUV files that represent the viewpoint by the file name, that is, exist for each viewpoint. Alternatively, the file may be composed of files containing temporally compressed files obtained by compressing difference information between a file obtained by compressing an image at a reference time and a reference time.

The selection unit 120 allows the user to select a multi-view image to be output to the display unit 140. [ For example, the display unit 140 may display a list of files for the multi-view image stored in the storage unit 110. When the user selects one of the files for the multi-view image, A multi-view image file can be opened using a file handle or a pointer.

If the files for the multi-view image stored in the storage unit 110 are composed of a plurality of YUV files existing for each viewpoint as described above, or if the difference information between the viewpoints is compressed and arranged in chronological order, The user can select a desired time and / or point-in-time through the selection unit 120. Then, a file corresponding to the selected time and / or time point is read and a multi-view image can be output through the display unit 140. At this time, the user may arbitrarily and continuously select a specific time and / or a specific time through the selection unit 120, or a specific time and / or a specific time may be selected according to preset conditions. Alternatively, it may be outputted from the multi-view image through the display unit 140 without selecting the time and the viewpoint.

For example, the selection unit 120 may allow a user to select a specific time and / or a specific time point by using a GUI (Graphic User Interface) such as a slide control, a track bar, . Alternatively, a specific time and / or a specific time point may be selected using a control device such as a mouse, a keyboard, a remote controller, or the like.

If the file for the multi-view image selected by the selection unit 120 is a file composed of the already fully synthesized multi-view images, it can be transferred to the display unit 140 and output. If the file is not a fully synthesized multi- (For example, in the case of a file composed of a two-dimensional image and a depth map), it can be transmitted to the real-time multi-point synthesizer 130.

The real-time multi-point synthesis unit 130 performs multi-point synthesis based on the multi-view image file selected by the selection unit 120 and the time / view information. At this time, only necessary time points can be synthesized according to the time point selected by the selection unit 120. [ Or multi-point synthesis in real time so as to be outputted through the display unit 140 in the case of a multi-view image input in real time.

In addition, the real-time multi-point synthesis unit 130 may perform multiplexing to rearrange the viewpoint-specific images selected by the user according to the pixel arrangement of the display unit 140. [ If the display unit 140 supports three-dimensional or multi-viewpoints, the real-time multi-point synthesis unit 130 may synthesize the images at the required time points and multiplex them to fit the three-dimensional or multi- have.

The display unit 140 outputs the synthesized multi-view image input from the selection unit 120 or the real-time multi-view synthesis unit 130 through the screen. At this time, the display unit 140 is a two-dimensional display, but the multi-view image providing apparatus 100 according to the embodiment of the present invention is also applicable to a three-dimensional display and a multi-view display.

2 is a flowchart illustrating a method of providing a multi-view image in a two-dimensional display according to an exemplary embodiment of the present invention. This method can be performed by the multi-view image providing apparatus 100 of FIG.

Referring to FIG. 2, the multi-view image providing apparatus receives a multi-view image (S200). In this case, the multi-view image may be a selected one of the multi-view image files stored in the multi-view image providing apparatus, or may be a multi-view image signal input in real time. Alternatively, it may be a file composed of a specific time and / or a specific time.

The multi-view image providing apparatus determines whether multi-point synthesis is to be performed based on the input multi-view image (S210).

If the inputted multi-view image is a file composed of fully multi-view images, the multi-view image providing apparatus outputs the multi-view image input through the two-dimensional display without performing the point synthesis (S230).

On the other hand, if the input multi-view image is a file to be subjected to multi-view synthesis through additional processing, the multi-view image providing apparatus performs multi-point synthesis (S220). For example, it is possible to perform multi-point synthesis when the inputted multi-view image is a file composed of a two-dimensional image and a depth image, or a file having a specific time and / or a specific time. At this time, it is possible to perform multi-point synthesis using a point in time and / or a point in time according to a specific time.

Then, the multi-view image providing apparatus outputs the multi-view image synthesized in step S220 through the two-dimensional display (S230).

In the above-described embodiments, the methods are described on the basis of a flowchart as a series of steps or blocks, but the present invention is not limited to the order of the steps, and some steps may occur in different orders or simultaneously . It will also be understood by those skilled in the art that the steps depicted in the flowchart illustrations are not exclusive, that other steps may be included, or that one or more steps in the flowchart may be deleted without affecting the scope of the present invention. You will understand.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the claims, and all technical ideas within the scope of the claims should be construed as being included in the scope of the present invention.

Claims (1)

In a multi-view image providing apparatus using a two-dimensional display,
A selection unit for selecting a multi-view image file to be output through the two-dimensional display, selecting at least one of a time and a viewpoint to output from the selected multi-view image file, and outputting the selected image to the two-dimensional display; And
Wherein the multi-view synthesis is performed on the selected multi-view image file when multi-view synthesis of the selected multi-view image file is required, and multi-view synthesis is performed based on at least one of the time and the view point, And a real-time multi-point composition unit for providing the multi-view image to the multi-view image providing unit.

Images