WO2009157714A2 - Method and apparatus for processing three dimensional video data - Google Patents

Method and apparatus for processing three dimensional video data Download PDF

Info

Publication number
WO2009157714A2
WO2009157714A2 PCT/KR2009/003406 KR2009003406W WO2009157714A2 WO 2009157714 A2 WO2009157714 A2 WO 2009157714A2 KR 2009003406 W KR2009003406 W KR 2009003406W WO 2009157714 A2 WO2009157714 A2 WO 2009157714A2
Authority
WO
WIPO (PCT)
Prior art keywords
brightness
current frame
video processing
video data
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2009/003406
Other languages
French (fr)
Other versions
WO2009157714A3 (en
Inventor
Kil-Soo Jung
Hyun-Kwon Chung
Dae-Jong Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to EP09770386.2A priority Critical patent/EP2289248A4/en
Priority to CN200980123638.1A priority patent/CN102067614B/en
Priority to JP2011514504A priority patent/JP2011525746A/en
Publication of WO2009157714A2 publication Critical patent/WO2009157714A2/en
Publication of WO2009157714A3 publication Critical patent/WO2009157714A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/133—Equalising the characteristics of different image components, e.g. their average brightness or colour balance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/158—Switching image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/339—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spatial multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
    • H04N13/359—Switching between monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • H04N5/145—Movement estimation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/005—Aspects relating to the "3D+depth" image format

Definitions

  • aspects of the present invention relate to a method and an apparatus to process three-dimensional video images, and more particularly, to a method and apparatus to output brightness-adjusted three-dimensional video images.
  • Three-dimensional video technologies are being developed widely nowadays.
  • Three-dimensional video technology provides depth information to two-dimensional images to display realistic three-dimensional images.
  • three-dimensional video technology is being applied to various fields such as communications, medicine, and broadcasting.
  • Three-dimensional video technology can be classified into a technology to generate three-dimensional video data from scratch, and a technology to convert two-dimensional video data into three-dimensional video data. Research for these two technologies is being conducted together.
  • aspects of the present invention provide a method and apparatus to output brightness-adjusted three-dimensional video images.
  • the brightness of video images is adjusted before outputting three-dimensional video.
  • problems caused by dark video images when a viewer watches three-dimensional video using shutter glasses can be overcome.
  • FIG. 1 is a diagram of a three-dimensional video system including a video processing apparatus according to an embodiment of the present invention
  • FIGs. 2A and 2B are diagrams of a left eye image and a right eye image, which are viewed through shutter glasses illustrated in FIG. 1;
  • FIGs. 3A and 3B are block diagrams of video processing apparatuses according to embodiments of the present invention.
  • FIGs. 4A through 6B are frequency distribution tables illustrating a brightness of an image frame adjusted by a brightness adjuster.
  • FIG. 7 is a flowchart illustrating a video processing method according to an embodiment of the present invention.
  • a video processing method including: decoding a current frame of two-dimensional video data; adjusting a brightness of the decoded current frame; converting the brightness-adjusted two-dimensional video data into three-dimensional video data; and displaying the three-dimensional video data.
  • the adjusting of the brightness may include: adjusting a brightness distribution in a frequency distribution table of a current frame, in which the brightness is divided into 256 grades, from 0 to 255, and a number of pixels for each of the grades constitutes a frequency.
  • the adjusting of the brightness distribution may include adjusting the brightness distribution by increasing brightness levels of all of the pixels of the current frame by as much as, or less than, a difference between the brightness level of the pixel having the highest brightness among pixels of the current frame and 255.
  • the adjusting of brightness distribution may include adjusting the brightness distribution so that the brightness level of the pixel having the lowest brightness is N and the brightness level of the pixel having the highest brightness is 255.
  • the adjusting of the brightness distribution may include: adjusting the brightness distribution so that distances between grades between N and the grade 255 are equal.
  • the adjusting of the brightness distribution may include adjusting the brightness distribution so that a distance between grades between N and K is smaller than a distance between grades between K and M.
  • a video processing method including: decoding a current frame of two-dimensional video data; converting the current frame into three-dimensional video data; adjusting the brightness of the three-dimensional video data; and displaying the brightness-adjusted three-dimensional video data.
  • a video processing method including: receiving video data; recognizing that the received video data is converted from two-dimensional video data to three-dimensional video data; adjusting a brightness of a current frame of the received video data; and outputting the brightness-adjusted video data.
  • a video processing apparatus including: a video data decoder to decode a current frame of two-dimensional video data; a brightness adjuster to adjust the brightness of the current frame; a three-dimensional video converter to convert the current frame to three-dimensional video data; and an output unit to display the three-dimensional video data.
  • a video processing system including: a video processing apparatus including: a video data decoder to decode a current frame of two-dimensional video data, a brightness adjuster to adjust a brightness of the current frame, a three-dimensional video converter to convert the current frame to three-dimensional video data comprising a left-eye image frame and a right-eye image frame corresponding to the current frame, and an output unit to display the three-dimensional video data and to output a shutter control signal; and shutter glasses including a left-eye lens to receive the left-eye image, a right-eye lens to receive the right-eye image, and a signal receiver to receive the shutter control signal, wherein the left-eye lens closes according to the received shutter control signal when the right-eye lens receives the right-eye image, and the right-eye lens closes according to the received shutter control signal when the left-eye lens receives the left-eye image.
  • a video processing method of a video processing apparatus including: decoding, by the video processing apparatus, a current frame of two-dimensional video data; adjusting, by the video processing apparatus, a brightness of the decoded current frame; and displaying the brightness-adjusted current frame as three-dimensional video data.
  • FIG. 1 is a diagram of a three-dimensional video system using a video processing apparatus 110 according to an embodiment of the present invention
  • FIGs. 2A and 2B are diagrams of a left eye image and a right eye image displayed respectively on shutter glasses 130 shown in FIG. 1.
  • the three-dimensional video system will be described in more detail with reference to FIGs. 1, 2A, and 2B.
  • the three-dimensional video system includes a video processing apparatus 110 including an infrared ray (IR) transmission unit 120 and shutter glasses 130 including an IR receiving unit 140.
  • the video processing apparatus 110 includes a display unit and a video decoder.
  • the video decoder can be a separate set top box and/or reproducing apparatus and connected to the display unit.
  • the video processing apparatus 110 Since the human left eye and right eye are separated from each other in a transverse direction, two-dimensional images seen from the left eye and the right eye are different from each other.
  • the video processing apparatus 110 alternately outputs left eye images and right eye images that are not the same as each other onto a screen using the above principle.
  • the human eye recognizes images as continuous video when the images are seen at a frame rate of 60 Hz or greater. Three-dimensional video is generated by combining images input through the left eye and right eye.
  • the video processing apparatus 110 outputs the images at a frame rate of at least 120 Hz. For example, when the video processing apparatus 110 outputs left eye images and right eye images alternately every 1/120 second, the brain of the viewer combines the different two-dimensional images to generate realistic three-dimensional images having perspective and reality.
  • the left eye image and the right eye image overlap with each other.
  • the viewer wears the shutter glasses 130.
  • the shutter glasses 130 opens a left lens and closes a right lens, and closes the left lens and opens the right lens alternately in synchronization with the left and right eye images output by the video processing apparatus 110.
  • the IR transmission unit 120 included in the video processing apparatus 110 transmits infrared ray signals to the shutter glasses 130 for the synchronization.
  • the IR receiving unit 140 included in the shutter glasses 130 senses the infrared ray signals transmitted from the IR transmission unit 120, such that the shutter glasses 130 operates in synchronization with the video processing apparatus 110. While described as being infrared, it is understood that the communication between the transmission unit 120 and the glasses 130 can be using other light, radio, or energy frequencies, or can also be done using wired communications.
  • the shutter glasses 130 alternately blocks the left eye images and right eye images.
  • the images irradiated to the eyes of the viewer through the shutter glasses 130 are darker than the images that are continuously input into the eyes of the viewer without blocking.
  • the shutter glasses 130 are dark, the images irradiated to the eyes of the viewer through the shutter glasses 130 are darker than the images output from the video processing apparatus 110.
  • the video processing apparatus 110 adjusts the brightness of the images before outputting the three-dimensional video images onto the screen.
  • the shutter glasses 130 When the video processing apparatus 110 outputs a left eye image, the shutter glasses 130 opens the left lens and closes the right lens so that the image is irradiated to the eye of the viewer through the left lens.
  • FIG. 2A shows that the shutter glasses 130 opens the left lens 130L and closes the right lens 130R.
  • the shutter glasses 130 When the video processing apparatus 110 outputs a right eye image, the shutter glasses 130 opens the right lens 130R and closes the left lens 130L to block the image from being transmitted through the left lens.
  • FIG. 2B shows that the shutter glasses 130 opens the right lens 130R and closes the left lens 130L.
  • the shutter glasses 130 alternately opens the left lens 130L and the right lens 130R, the left eye and the right eye of the viewer respectively view left eye images and right eye images every 1/120 second.
  • the video processing apparatus 110 adjusts the brightness of the images before outputting the images in order to compensate for the reduction of brightness while the images pass through the shutter glasses 130, the images irradiated to the eyes of the viewer through the shutter glasses 130 are brighter than the original images, the brightness of which is not adjusted.
  • FIG. 3A is a block diagram of a video processing apparatus 300 according to an embodiment of the present invention.
  • the video processing apparatus 300 includes a video data decoder 310, a brightness adjuster 320, a three-dimensional image converter 330, and an output unit 340. While not required, each of the units 310, 320, 330, and 340 can be one or more processors or processing elements on one or more chips or integrated circuits.
  • the video data decoder 310 reads the video data from the loaded disk and decodes the read video data.
  • the image processing apparatus 300 can include a drive to read the disc directly, or can be connected to a separate drive.
  • the video processing apparatus 300 may further include a communication unit (not shown) to communicate with an external server or an external terminal through a communication network and/or any wired/wireless connection (such as universal serial bus, infrared, Bluetooth, etc.).
  • the video processing apparatus 300 downloads the video data from the external server or the external terminal onto a local storage device (not shown) through the communication unit, and then reads the video data stored in the local storage device and decodes the read video data.
  • a local storage device not shown
  • aspects of the present invention are not limited to storing the video data in the local storage.
  • the video processing apparatus 300 may decode the video data transmitted from the external server or the external terminal through the communication unit by using a real-time streaming method.
  • the video processing apparatus 300 may read the video data from any external storage device (such as a flash memory).
  • the video data can be movies, television shows, video games, software interfaces, etc.
  • the video data decoder 310 extracts brightness components (or luminance components) Y and chrominance components Cr and Cb from pixels in image frames.
  • the brightness adjuster 320 adjusts a brightness of the image frames using the brightness components Y extracted by the video data decoder 310.
  • the brightness adjuster 320 adjusts the brightness of the image frames by controlling a brightness distribution in a frequency distribution table regarding distribution of luminance components.
  • the frequency distribution table with respect to the brightness components is a histogram showing the brightness on a variance side of a horizontal axis, and the number of pixels in each brightness level on a frequency side of a vertical axis.
  • the brightness is divided into 256 grades from 0 to 255, and the number of pixels corresponding to each level of brightness is denoted as the frequency.
  • Embodiments in which the brightness adjuster 320 adjusts the brightness of the image frame by adjusting the brightness distribution of the frequency distribution table will be described in detail with reference to FIGs. 4A through 6B.
  • the video data input into the video data decoder 310 may be two-dimensional video data or three-dimensional video data.
  • the brightness adjuster 320 adjusts the brightness of the three-dimensional video data and transmits the brightness-adjusted three-dimensional video data to the output unit 340.
  • the brightness adjuster 320 adjusts the brightness of the two-dimensional video data and transmits the brightness-adjusted two-dimensional video data to the three-dimensional video converter 330. While shown as having both, it is understood that the apparatus 200 need not have both the capability of converting two dimensional video data to three dimensional video data as well as receiving three-dimensional data as shown.
  • the three-dimensional video converter 330 generates three-dimensional video data by providing depth to the two-dimensional video data.
  • the three-dimensional video converter 330 divides an image frame in the two-dimensional video data into blocks of predetermined sizes, and selects a block, which is the most similar to a predetermined block of the current frame, among blocks of a previous frame. Then, the three-dimensional video converter 330 calculates a motion vector for each of the divided blocks in the current frame, and generates a new frame by combining the selected blocks.
  • aspects of the present invention are not limited to the above example.
  • the three-dimensional video converter 330 may generate a depth map using composition information of the image frames and generate a new frame in order to provide depth to the two-dimensional video.
  • the three-dimensional video converter 330 determines one of the new image frame and the current image frame as the left eye image and the other of the new image frame and the current image frame as the right eye image. Alternatively, the three-dimensional video converter 330 may generate a new left eye image and/or a new right eye image using the new image frame and the current image frame.
  • the three-dimensional video converter 330 generates a three-dimensional format image frame, which includes both the left eye image and the right eye image in a frame, and transmits the generated three-dimensional format image frame to the output unit 340.
  • the output unit 230 outputs the left and right eye images, which are included in the brightness-compensated frame, alternately at least every 1/120 second.
  • FIG. 3B is a block diagram of a video processing apparatus 350 according to another embodiment of the present invention.
  • the video processing apparatus 350 includes a video data decoder 360, a three-dimensional video converter 370, a brightness adjuster 380, and an output unit 390. While not required, each of the units 350, 360, 370, 380, and 390 can be one or more processors or processing elements on one or more chips or integrated circuits.
  • the brightness adjusters 320 and 380 of the video processing apparatuses 300 and 350 of FIGs. 3A and 3B, respectively, are located in different positions. Referring to FIG.
  • the video data decoder 360 decodes the input video and transmits the decoded video to the three-dimensional video converter 370.
  • the video data decoder 360 decodes the input video and transmits the decoded video to the brightness adjuster 380.
  • the three-dimensional video converter 370 converts the received two-dimensional video to three-dimensional video, and transmits the converted video to the brightness adjuster 380.
  • the brightness adjuster 380 adjusts brightness of the image frames in the three-dimensional video received from the video data decoder 360 or the three-dimensional video converter 370.
  • the output unit 390 then outputs the brightness-adjusted three-dimensional video.
  • both of the video processing apparatuses 300 and 350 illustrated in FIGs. 3A and 3B adjust the brightness of the video before outputting the three-dimensional video onto the screen (not shown) through the output units 340 and 390.
  • FIGs. 4A through 6B are frequency distribution tables illustrating a brightness conversion using the brightness adjusters 320 and 380 of the video processing apparatuses 300 and 350 illustrated in FIGs. 3A and 3B.
  • FIGs. 4A and 4B are histograms illustrating a brightness conversion of an image frame by the brightness adjuster 320 or 380 according to an embodiment of the present invention.
  • FIG. 4A is a histogram of the brightness before being adjusted by the brightness adjuster 320 or 380. Referring to FIG. 4A, the brightness level of a pixel that has the highest brightness from among the pixels in the current image frame is not higher than the grade 255.
  • FIG. 4A the brightness level of a pixel that has the highest brightness from among the pixels in the current image frame is not higher than the grade 255.
  • FIG. 4A is a difference between the brightness level of the pixel having the highest brightness among the pixels in the current image frame and the grade 255.
  • the brightness adjuster 320 or 380 may adjust the frequency distribution of the histogram so that the brightness level of the pixel having the highest brightness from among the pixels in the current image frame has the grade 255. That is, the brightness adjuster 320 or 380 adjusts the frequency distribution so that the brightness of all of the pixels can be brighter by as much as (1) or less.
  • FIG. 4B is a histogram showing the brightness of the frame when the brightness levels of all of the pixels in the frame are increased by as much as (1) or (2) that is less than (1) but is greater than zero.
  • FIGs. 5A and 5B are histograms illustrating a brightness conversion of an image frame by the brightness adjuster 320 or 380 according to another embodiment of the present invention.
  • FIG. 5A is a histogram of the brightness of the frame before being adjusted by the brightness adjuster 320 or 380.
  • the brightness level of a pixel that has the highest brightness among the pixels in the current image frame is not higher than the grade 255 (as in FIG. 4A).
  • the brightness level of the pixel having the highest brightness from among the pixels of the current image frame is M and the brightness level of the pixel having the lowest brightness is N in FIG.
  • the brightness adjuster 320 or 380 adjusts the frequency distribution of the histogram so that the brightness level of the pixel having the lowest brightness is N and the brightness level of the pixel having the highest brightness is grade 255, as shown in FIG. 5B.
  • the section between the lowest brightness level and the highest brightness level is divided into grades of constant sizes.
  • the section between the lowest brightness level of the frame and the highest brightness level of the frame is divided into the number of grades that is obtained by subtracting N from M.
  • FIGs. 6A and 6B are histograms illustrating the brightness conversion of the image frame by the brightness adjuster 320 or 380 according to the other embodiment of the present invention.
  • FIG. 6A is a histogram of the brightness of the frame before being adjusted by the brightness adjuster 320 or 380.
  • the brightness adjuster 320 or 380 adjusts the brightness distribution in the histogram using a predetermined reference grade K that is greater than N and less than M.
  • the brightness adjuster 320 or 380 may adjust the grades so that the reference grade K can be moved in the left direction of the histogram (i.e., towards N).
  • the section between the grade N and the grade K is denoted as (3) and the section between the grade K and the grade M is denoted as (4).
  • the distances of grades in section (3) and section (4) are the same as each other.
  • section (3) is reduced and section (4) is increased.
  • a distance between the grades in section (4) is greater than a distance between the grades in section (3). That is, since the brightness of the dark section is finely defined, the brightness of the frame is improved.
  • FIG. 7 is a flowchart illustrating a video processing method using the video processing apparatus 300 of FIG. 3A, according to an embodiment of the present invention.
  • the video data decoder 310 decodes input video data in operation 710, and the brightness adjuster 320 adjusts the brightness of the decoded video data in operation 720.
  • the video processing apparatus 300 determines whether the brightness-adjusted video data is two-dimensional video data or three-dimensional video data in operation 730.
  • the three-dimensional video converter 370 converts the two-dimensional video data into three-dimensional video data in operation 740, and the output unit 340 outputs the converted video data in operation 750.
  • the output unit 340 outputs the three-dimensional video data in operation 750 without performing the conversion operation (operation 740).
  • the brightness of video images is adjusted before outputting three-dimensional video.
  • problems caused by dark video images when a viewer watches three-dimensional video using shutter glasses can be overcome.
  • aspects of the present invention can also be embodied as computer-readable code on a computer-readable recording medium.
  • the computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.
  • the computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion.
  • aspects of the present invention may also be realized as a data signal embodied in a carrier wave and comprising a program readable by a computer and transmittable over the Internet.
  • one or more units of the video processing apparatus 300 or 350 can include a processor or microprocessor executing a computer program stored in a computer-readable medium, such as a local storage.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Image Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

A video processing method and apparatus, the video processing method including: decoding two-dimensional video data; adjusting a brightness of the decoded two-dimensional video data; converting the brightness-adjusted two-dimensional video data into three-dimensional video data; and displaying the three-dimensional video data.

Description

METHOD AND APPARATUS FOR PROCESSING THREE DIMENSIONAL VIDEO DATA Technical Field
Aspects of the present invention relate to a method and an apparatus to process three-dimensional video images, and more particularly, to a method and apparatus to output brightness-adjusted three-dimensional video images.
Background Art
Three-dimensional video technologies are being developed widely nowadays. Three-dimensional video technology provides depth information to two-dimensional images to display realistic three-dimensional images. Thus, three-dimensional video technology is being applied to various fields such as communications, medicine, and broadcasting.
Three-dimensional video technology can be classified into a technology to generate three-dimensional video data from scratch, and a technology to convert two-dimensional video data into three-dimensional video data. Research for these two technologies is being conducted together.
 Technical Solution
Aspects of the present invention provide a method and apparatus to output brightness-adjusted three-dimensional video images.
Advantageous Effects
As described above, according to aspects of the present invention, the brightness of video images is adjusted before outputting three-dimensional video. Thus, problems caused by dark video images when a viewer watches three-dimensional video using shutter glasses can be overcome.
Description of Drawings
FIG. 1 is a diagram of a three-dimensional video system including a video processing apparatus according to an embodiment of the present invention;
FIGs. 2A and 2B are diagrams of a left eye image and a right eye image, which are viewed through shutter glasses illustrated in FIG. 1;
FIGs. 3A and 3B are block diagrams of video processing apparatuses according to embodiments of the present invention;
FIGs. 4A through 6B are frequency distribution tables illustrating a brightness of an image frame adjusted by a brightness adjuster; and
FIG. 7 is a flowchart illustrating a video processing method according to an embodiment of the present invention.
 Best Mode
According to an aspect of the present invention, there is provided a video processing method including: decoding a current frame of two-dimensional video data; adjusting a brightness of the decoded current frame; converting the brightness-adjusted two-dimensional video data into three-dimensional video data; and displaying the three-dimensional video data.
According to an aspect of the present invention, the adjusting of the brightness may include: adjusting a brightness distribution in a frequency distribution table of a current frame, in which the brightness is divided into 256 grades, from 0 to 255, and a number of pixels for each of the grades constitutes a frequency.
According to an aspect of the present invention, when a brightness level of a pixel having a highest brightness among pixels of the current frame is lower than 255, the adjusting of the brightness distribution may include adjusting the brightness distribution by increasing brightness levels of all of the pixels of the current frame by as much as, or less than, a difference between the brightness level of the pixel having the highest brightness among pixels of the current frame and 255.
According to an aspect of the present invention, when a brightness level of a pixel having a lowest brightness from among pixels of the current frame is N, a brightness level of a pixel having a highest brightness from among the pixels of the current frame is M, and M is less than 255, the adjusting of brightness distribution may include adjusting the brightness distribution so that the brightness level of the pixel having the lowest brightness is N and the brightness level of the pixel having the highest brightness is 255.
According to an aspect of the present invention, the adjusting of the brightness distribution may include: adjusting the brightness distribution so that distances between grades between N and the grade 255 are equal.
According to an aspect of the present invention, when a brightness level of a pixel having a lowest brightness from among pixels of the current frame is N, a brightness level of a pixel having a highest brightness from among pixels of the current frame is M, and K is greater than N and less than M, the adjusting of the brightness distribution may include adjusting the brightness distribution so that a distance between grades between N and K is smaller than a distance between grades between K and M.
According to another aspect of the present invention, there is provided a video processing method including: decoding a current frame of two-dimensional video data; converting the current frame into three-dimensional video data; adjusting the brightness of the three-dimensional video data; and displaying the brightness-adjusted three-dimensional video data.
According to another aspect of the present invention, there is provided a video processing method including: receiving video data; recognizing that the received video data is converted from two-dimensional video data to three-dimensional video data; adjusting a brightness of a current frame of the received video data; and outputting the brightness-adjusted video data.
According to another aspect of the present invention, there is provided a video processing apparatus including: a video data decoder to decode a current frame of two-dimensional video data; a brightness adjuster to adjust the brightness of the current frame; a three-dimensional video converter to convert the current frame to three-dimensional video data; and an output unit to display the three-dimensional video data.
According to still another aspect of the present invention, there is provided a video processing system, including: a video processing apparatus including: a video data decoder to decode a current frame of two-dimensional video data, a brightness adjuster to adjust a brightness of the current frame, a three-dimensional video converter to convert the current frame to three-dimensional video data comprising a left-eye image frame and a right-eye image frame corresponding to the current frame, and an output unit to display the three-dimensional video data and to output a shutter control signal; and shutter glasses including a left-eye lens to receive the left-eye image, a right-eye lens to receive the right-eye image, and a signal receiver to receive the shutter control signal, wherein the left-eye lens closes according to the received shutter control signal when the right-eye lens receives the right-eye image, and the right-eye lens closes according to the received shutter control signal when the left-eye lens receives the left-eye image.
According to yet another aspect of the present invention, there is provided a video processing method of a video processing apparatus, the video processing method including: decoding, by the video processing apparatus, a current frame of two-dimensional video data; adjusting, by the video processing apparatus, a brightness of the decoded current frame; and displaying the brightness-adjusted current frame as three-dimensional video data.
Additional aspects and/or advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
 Mode for Invention
This application claims the benefit of U.S. provisional application No. 61/075,184, filed on June 24, 2008 in the U.S. Patent and Trademark Office and the benefit of Korean Patent Application No. 10-2008-0093371, filed on September 23, 2008 in the Korean Intellectual Property Office, the disclosures of which are incorporated herein in their entirety by reference.
Reference will now be made in detail to the present embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present invention by referring to the figures.
FIG. 1 is a diagram of a three-dimensional video system using a video processing apparatus 110 according to an embodiment of the present invention, and FIGs. 2A and 2B are diagrams of a left eye image and a right eye image displayed respectively on shutter glasses 130 shown in FIG. 1. The three-dimensional video system will be described in more detail with reference to FIGs. 1, 2A, and 2B. Referring to FIG. 1, the three-dimensional video system includes a video processing apparatus 110 including an infrared ray (IR) transmission unit 120 and shutter glasses 130 including an IR receiving unit 140. As shown, the video processing apparatus 110 includes a display unit and a video decoder. However, it is understood that the video decoder can be a separate set top box and/or reproducing apparatus and connected to the display unit.
Since the human left eye and right eye are separated from each other in a transverse direction, two-dimensional images seen from the left eye and the right eye are different from each other. The video processing apparatus 110 alternately outputs left eye images and right eye images that are not the same as each other onto a screen using the above principle. The human eye recognizes images as continuous video when the images are seen at a frame rate of 60 Hz or greater. Three-dimensional video is generated by combining images input through the left eye and right eye. Thus, in order for the human eye to recognize the three-dimensional images as continuous video without stopping, the video processing apparatus 110 outputs the images at a frame rate of at least 120 Hz. For example, when the video processing apparatus 110 outputs left eye images and right eye images alternately every 1/120 second, the brain of the viewer combines the different two-dimensional images to generate realistic three-dimensional images having perspective and reality.
When the viewer views the images outputted from the video processing apparatus 110 without any special equipment, the left eye image and the right eye image overlap with each other. To prevent the left eye image and the right eye image from overlapping, the viewer wears the shutter glasses 130. The shutter glasses 130 opens a left lens and closes a right lens, and closes the left lens and opens the right lens alternately in synchronization with the left and right eye images output by the video processing apparatus 110. The IR transmission unit 120 included in the video processing apparatus 110 transmits infrared ray signals to the shutter glasses 130 for the synchronization. The IR receiving unit 140 included in the shutter glasses 130 senses the infrared ray signals transmitted from the IR transmission unit 120, such that the shutter glasses 130 operates in synchronization with the video processing apparatus 110. While described as being infrared, it is understood that the communication between the transmission unit 120 and the glasses 130 can be using other light, radio, or energy frequencies, or can also be done using wired communications.
As described above, the shutter glasses 130 alternately blocks the left eye images and right eye images. However, as a result, the images irradiated to the eyes of the viewer through the shutter glasses 130 are darker than the images that are continuously input into the eyes of the viewer without blocking. In addition, since the shutter glasses 130 are dark, the images irradiated to the eyes of the viewer through the shutter glasses 130 are darker than the images output from the video processing apparatus 110. To prevent this, the video processing apparatus 110 adjusts the brightness of the images before outputting the three-dimensional video images onto the screen.
When the video processing apparatus 110 outputs a left eye image, the shutter glasses 130 opens the left lens and closes the right lens so that the image is irradiated to the eye of the viewer through the left lens. FIG. 2A shows that the shutter glasses 130 opens the left lens 130L and closes the right lens 130R. When the video processing apparatus 110 outputs a right eye image, the shutter glasses 130 opens the right lens 130R and closes the left lens 130L to block the image from being transmitted through the left lens. FIG. 2B shows that the shutter glasses 130 opens the right lens 130R and closes the left lens 130L.
Since the shutter glasses 130 alternately opens the left lens 130L and the right lens 130R, the left eye and the right eye of the viewer respectively view left eye images and right eye images every 1/120 second. In the shown embodiment, since the video processing apparatus 110 adjusts the brightness of the images before outputting the images in order to compensate for the reduction of brightness while the images pass through the shutter glasses 130, the images irradiated to the eyes of the viewer through the shutter glasses 130 are brighter than the original images, the brightness of which is not adjusted.
FIG. 3A is a block diagram of a video processing apparatus 300 according to an embodiment of the present invention. Referring to FIG. 3A, the video processing apparatus 300 includes a video data decoder 310, a brightness adjuster 320, a three-dimensional image converter 330, and an output unit 340. While not required, each of the units 310, 320, 330, and 340 can be one or more processors or processing elements on one or more chips or integrated circuits.
In a case where video data is recorded on a disk (such as a DVD, Blu-ray disc, etc.), when the disk is loaded into the video processing apparatus 300, the video data decoder 310 reads the video data from the loaded disk and decodes the read video data. While not required, the image processing apparatus 300 can include a drive to read the disc directly, or can be connected to a separate drive. Moreover, while not required in all embodiments, the video processing apparatus 300 may further include a communication unit (not shown) to communicate with an external server or an external terminal through a communication network and/or any wired/wireless connection (such as universal serial bus, infrared, Bluetooth, etc.). In this case, the video processing apparatus 300 downloads the video data from the external server or the external terminal onto a local storage device (not shown) through the communication unit, and then reads the video data stored in the local storage device and decodes the read video data. However, it is understood that aspects of the present invention are not limited to storing the video data in the local storage. For example, in other aspects, the video processing apparatus 300 may decode the video data transmitted from the external server or the external terminal through the communication unit by using a real-time streaming method. Furthermore, the video processing apparatus 300 may read the video data from any external storage device (such as a flash memory). The video data can be movies, television shows, video games, software interfaces, etc.
In the decoding of the video data, the video data decoder 310 extracts brightness components (or luminance components) Y and chrominance components Cr and Cb from pixels in image frames. The brightness adjuster 320 adjusts a brightness of the image frames using the brightness components Y extracted by the video data decoder 310. The brightness adjuster 320 adjusts the brightness of the image frames by controlling a brightness distribution in a frequency distribution table regarding distribution of luminance components. The frequency distribution table with respect to the brightness components is a histogram showing the brightness on a variance side of a horizontal axis, and the number of pixels in each brightness level on a frequency side of a vertical axis. The brightness is divided into 256 grades from 0 to 255, and the number of pixels corresponding to each level of brightness is denoted as the frequency. Embodiments in which the brightness adjuster 320 adjusts the brightness of the image frame by adjusting the brightness distribution of the frequency distribution table will be described in detail with reference to FIGs. 4A through 6B.
The video data input into the video data decoder 310 may be two-dimensional video data or three-dimensional video data. When the video data input into the video data decoder 310 is three-dimensional video data, the brightness adjuster 320 adjusts the brightness of the three-dimensional video data and transmits the brightness-adjusted three-dimensional video data to the output unit 340. When the video data input into the video data decoder 310 is two-dimensional video data, the brightness adjuster 320 adjusts the brightness of the two-dimensional video data and transmits the brightness-adjusted two-dimensional video data to the three-dimensional video converter 330. While shown as having both, it is understood that the apparatus 200 need not have both the capability of converting two dimensional video data to three dimensional video data as well as receiving three-dimensional data as shown.
The three-dimensional video converter 330 generates three-dimensional video data by providing depth to the two-dimensional video data. In this regard, the three-dimensional video converter 330 divides an image frame in the two-dimensional video data into blocks of predetermined sizes, and selects a block, which is the most similar to a predetermined block of the current frame, among blocks of a previous frame. Then, the three-dimensional video converter 330 calculates a motion vector for each of the divided blocks in the current frame, and generates a new frame by combining the selected blocks. However, aspects of the present invention are not limited to the above example. For example, in other aspects, the three-dimensional video converter 330 may generate a depth map using composition information of the image frames and generate a new frame in order to provide depth to the two-dimensional video.
The three-dimensional video converter 330 determines one of the new image frame and the current image frame as the left eye image and the other of the new image frame and the current image frame as the right eye image. Alternatively, the three-dimensional video converter 330 may generate a new left eye image and/or a new right eye image using the new image frame and the current image frame. The three-dimensional video converter 330 generates a three-dimensional format image frame, which includes both the left eye image and the right eye image in a frame, and transmits the generated three-dimensional format image frame to the output unit 340. The output unit 230 outputs the left and right eye images, which are included in the brightness-compensated frame, alternately at least every 1/120 second.
FIG. 3B is a block diagram of a video processing apparatus 350 according to another embodiment of the present invention. Referring to FIG. 3B, the video processing apparatus 350 includes a video data decoder 360, a three-dimensional video converter 370, a brightness adjuster 380, and an output unit 390. While not required, each of the units 350, 360, 370, 380, and 390 can be one or more processors or processing elements on one or more chips or integrated circuits. The brightness adjusters 320 and 380 of the video processing apparatuses 300 and 350 of FIGs. 3A and 3B, respectively, are located in different positions. Referring to FIG. 3B, when the input video is two-dimensional video, the video data decoder 360 decodes the input video and transmits the decoded video to the three-dimensional video converter 370. When the input video is three-dimensional video, the video data decoder 360 decodes the input video and transmits the decoded video to the brightness adjuster 380. The three-dimensional video converter 370 converts the received two-dimensional video to three-dimensional video, and transmits the converted video to the brightness adjuster 380. The brightness adjuster 380 adjusts brightness of the image frames in the three-dimensional video received from the video data decoder 360 or the three-dimensional video converter 370. The output unit 390 then outputs the brightness-adjusted three-dimensional video. As described above, both of the video processing apparatuses 300 and 350 illustrated in FIGs. 3A and 3B adjust the brightness of the video before outputting the three-dimensional video onto the screen (not shown) through the output units 340 and 390.
FIGs. 4A through 6B are frequency distribution tables illustrating a brightness conversion using the brightness adjusters 320 and 380 of the video processing apparatuses 300 and 350 illustrated in FIGs. 3A and 3B. Specifically, FIGs. 4A and 4B are histograms illustrating a brightness conversion of an image frame by the brightness adjuster 320 or 380 according to an embodiment of the present invention. FIG. 4A is a histogram of the brightness before being adjusted by the brightness adjuster 320 or 380. Referring to FIG. 4A, the brightness level of a pixel that has the highest brightness from among the pixels in the current image frame is not higher than the grade 255. In FIG. 4A, a difference between the brightness level of the pixel having the highest brightness among the pixels in the current image frame and the grade 255 is denoted as (1). In this case, the brightness adjuster 320 or 380 may adjust the frequency distribution of the histogram so that the brightness level of the pixel having the highest brightness from among the pixels in the current image frame has the grade 255. That is, the brightness adjuster 320 or 380 adjusts the frequency distribution so that the brightness of all of the pixels can be brighter by as much as (1) or less. FIG. 4B is a histogram showing the brightness of the frame when the brightness levels of all of the pixels in the frame are increased by as much as (1) or (2) that is less than (1) but is greater than zero.
FIGs. 5A and 5B are histograms illustrating a brightness conversion of an image frame by the brightness adjuster 320 or 380 according to another embodiment of the present invention. FIG. 5A is a histogram of the brightness of the frame before being adjusted by the brightness adjuster 320 or 380. Referring to FIG. 5A, the brightness level of a pixel that has the highest brightness among the pixels in the current image frame is not higher than the grade 255 (as in FIG. 4A). When it is assumed that the brightness level of the pixel having the highest brightness from among the pixels of the current image frame is M and the brightness level of the pixel having the lowest brightness is N in FIG. 5A, the brightness adjuster 320 or 380 adjusts the frequency distribution of the histogram so that the brightness level of the pixel having the lowest brightness is N and the brightness level of the pixel having the highest brightness is grade 255, as shown in FIG. 5B. The section between the lowest brightness level and the highest brightness level is divided into grades of constant sizes. Before adjusting the frequency distribution, the section between the lowest brightness level of the frame and the highest brightness level of the frame is divided into the number of grades that is obtained by subtracting N from M. However, after adjusting the frequency distribution, the section between the lowest brightness level of the frame and the highest brightness level of the frame is divided into the number of grades obtained by subtracting N from 255. In this case, pixels having brightness levels between the grade 255 and M are generated, and the brightness of the frame can be increased. While shown as N=0, it is understood that N can be greater than 0 in other circumstances.
FIGs. 6A and 6B are histograms illustrating the brightness conversion of the image frame by the brightness adjuster 320 or 380 according to the other embodiment of the present invention. FIG. 6A is a histogram of the brightness of the frame before being adjusted by the brightness adjuster 320 or 380. Referring to FIG. 6A, when it is assumed that the brightness level of the pixel having the highest brightness among the pixels of the current image frame is M and the brightness level of the pixel having the lowest brightness is N, the brightness adjuster 320 or 380 adjusts the brightness distribution in the histogram using a predetermined reference grade K that is greater than N and less than M. The brightness adjuster 320 or 380 may adjust the grades so that the reference grade K can be moved in the left direction of the histogram (i.e., towards N).
In FIG. 6A, the section between the grade N and the grade K is denoted as (3) and the section between the grade K and the grade M is denoted as (4). Before adjusting the brightness, the distances of grades in section (3) and section (4) are the same as each other. However, when the brightness adjuster 320 or 380 moves the grade K toward the grade 0 as shown in FIG. 6B, section (3) is reduced and section (4) is increased. This means that a distance between the grades in section (4) is greater than a distance between the grades in section (3). That is, since the brightness of the dark section is finely defined, the brightness of the frame is improved.
FIG. 7 is a flowchart illustrating a video processing method using the video processing apparatus 300 of FIG. 3A, according to an embodiment of the present invention. Referring to FIG. 7, the video data decoder 310 decodes input video data in operation 710, and the brightness adjuster 320 adjusts the brightness of the decoded video data in operation 720. The video processing apparatus 300 determines whether the brightness-adjusted video data is two-dimensional video data or three-dimensional video data in operation 730. When the video data is determined to be two-dimensional video data (operation 730), the three-dimensional video converter 370 converts the two-dimensional video data into three-dimensional video data in operation 740, and the output unit 340 outputs the converted video data in operation 750. When the video data is determined to be three-dimensional video data (operation 730), the output unit 340 outputs the three-dimensional video data in operation 750 without performing the conversion operation (operation 740).
As described above, according to aspects of the present invention, the brightness of video images is adjusted before outputting three-dimensional video. Thus, problems caused by dark video images when a viewer watches three-dimensional video using shutter glasses can be overcome.
While not restricted thereto, aspects of the present invention can also be embodied as computer-readable code on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Aspects of the present invention may also be realized as a data signal embodied in a carrier wave and comprising a program readable by a computer and transmittable over the Internet. Moreover, while not required in all aspects, one or more units of the video processing apparatus 300 or 350 can include a processor or microprocessor executing a computer program stored in a computer-readable medium, such as a local storage.
Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in this embodiment without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims (15)

1. A video processing method of a video processing apparatus, the video processing method comprising:
decoding, by the video processing apparatus, a current frame of two-dimensional video data;
adjusting, by the video processing apparatus, a brightness of the decoded current frame;
converting the brightness-adjusted current frame into three-dimensional video data; and
displaying the converted three-dimensional video data.
2. The video processing method as claimed in claim 1, wherein the adjusting of the brightness comprises:
adjusting a brightness distribution in a frequency distribution table of the current frame, in which the brightness is divided into 256 grades, from 0 to 255, and a number of pixels of the current frame for each of the grades constitutes a frequency.
3. The video processing method as claimed in claim 2, wherein, when a brightness level of a pixel of the current frame having a highest brightness from among pixels of the current frame is lower than 255, the adjusting of the brightness distribution comprises adjusting the brightness distribution by increasing brightness levels of all of the pixels of the current frame by as much as, or less than, a difference between the brightness level of the pixel having the highest brightness from among the pixels of the current frame and 255 so as to change the brightness of the current frame.
4. The video processing method as claimed in claim 2, wherein, when a brightness level of a pixel having a lowest brightness from among pixels of the current frame is N, a brightness level of a pixel having a highest brightness from among the pixels of the current frame is M, and M is less than 255, the adjusting of the brightness distribution comprises adjusting the brightness distribution so that the brightness level of the pixel having the lowest brightness is N and the brightness level of the pixel having the highest brightness is 255.
5. The video processing method as claimed in claim 4, wherein the adjusting of the brightness distribution so that the brightness level of the pixel having the lower brightness is N and the brightness level of the pixel having the highest brightness is 255 comprises:
adjusting the brightness distribution so that distances between grades between N and 255 are equal.
6. The video processing method as claimed in claim 2, wherein, when a brightness level of a pixel having a lowest brightness from among pixels of the current frame is N, a brightness level of a pixel having a highest brightness from among the pixels of the current frame is M, and K is greater than N and less than M, the adjusting of the brightness distribution comprises adjusting the brightness distribution so that a distance between grades between N and K is less than a distance between grades between K and M.
7. A video processing method of a video processing apparatus, the video processing method comprising:
decoding, by the video processing apparatus, a current frame of two-dimensional video data;
converting, by the video processing apparatus, the current frame of the two-dimensional video data into three-dimensional video data; and
adjusting a brightness of the converted three-dimensional video data; and
displaying the brightness-adjusted three-dimensional video data.
8. A video processing method of a video processing apparatus, the video processing method comprising:
receiving, by the video processing apparatus, video data;
recognizing that a current frame of the received video data is converted from two-dimensional video data to three-dimensional video data;
adjusting, by the video processing apparatus, a brightness of the current frame of the received video data; and
outputting the brightness-adjusted current frame.
9. A video processing apparatus comprising:
a video data decoder to decode a current frame of two-dimensional video data;
a brightness adjuster to adjust a brightness of the decoded current frame;
a three-dimensional video converter to convert the decoded current frame to three-dimensional video data; and
an output unit to output the converted three-dimensional video data having the brightness adjusted current frame to a display.
10. The video processing apparatus as claimed in claim 9, wherein the brightness adjuster adjusts a brightness distribution in a frequency distribution table of the current frame, in which the brightness is divided into 256 grades, from 0 to 255, and a number of pixels of the current frame for each of the grades constitutes a frequency.
11. The video processing apparatus as claimed in claim 10, wherein, when a brightness level of a pixel of the current frame having a highest brightness from among pixels of the current frame is lower than 255, the brightness adjuster adjusts the brightness distribution by increasing brightness levels of all of the pixels of the current frame by as much as, or less than, a difference between the brightness level of the pixel having the highest brightness from among the pixels of the current frame and 255 so as to change the brightness of the current frame.
12. The video processing apparatus as claimed in claim 10, wherein, when a brightness level of a pixel having a lowest brightness from among pixels of the current frame is N, a brightness level of a pixel having a highest brightness from among the pixels of the current frame is M, and M is less than 255, the brightness adjuster adjusts the brightness distribution so that the brightness level of the pixel having the lowest brightness is N and the brightness level of the pixel having the highest brightness is 255.
13. The video processing apparatus as claimed in claim 12, wherein the brightness adjuster adjusts the brightness distribution so that distances between grades between N and 255 are equal.
14. The video processing apparatus as claimed in claim 10, wherein, when a brightness level of a pixel having a lowest brightness from among pixels of the current frame is N, a brightness level of a pixel having a highest brightness from among pixels of the current frame is M, and K is greater than N and less than M, the brightness adjuster adjusts the brightness distribution so that a distance between grades between N and K is less than a distance between grades between K and M.
15. A video processing method of a video processing apparatus, the video processing method comprising:
decoding, by the video processing apparatus, a current frame of video data;
adjusting, by the video processing apparatus, a brightness of the decoded current frame; and
displaying the brightness-adjusted current frame as three-dimensional video data.
PCT/KR2009/003406 2008-06-24 2009-06-24 Method and apparatus for processing three dimensional video data Ceased WO2009157714A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP09770386.2A EP2289248A4 (en) 2008-06-24 2009-06-24 METHOD AND APPARATUS FOR PROCESSING THREE-DIMENSIONAL VIDEO DATA
CN200980123638.1A CN102067614B (en) 2008-06-24 2009-06-24 Method and device for processing three-dimensional video data
JP2011514504A JP2011525746A (en) 2008-06-24 2009-06-24 3D video image processing method and apparatus

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US7518408P 2008-06-24 2008-06-24
US61/075,184 2008-06-24
KR1020080093371A KR20100002035A (en) 2008-06-24 2008-09-23 Method and apparatus for processing 3d video image
KR10-2008-0093371 2008-09-23

Publications (2)

Publication Number Publication Date
WO2009157714A2 true WO2009157714A2 (en) 2009-12-30
WO2009157714A3 WO2009157714A3 (en) 2010-03-25

Family

ID=41812276

Family Applications (4)

Application Number Title Priority Date Filing Date
PCT/KR2009/003235 Ceased WO2009157668A2 (en) 2008-06-24 2009-06-17 Method and apparatus for outputting and displaying image data
PCT/KR2009/003406 Ceased WO2009157714A2 (en) 2008-06-24 2009-06-24 Method and apparatus for processing three dimensional video data
PCT/KR2009/003399 Ceased WO2009157708A2 (en) 2008-06-24 2009-06-24 Method and apparatus for processing 3d video image
PCT/KR2009/003383 Ceased WO2009157701A2 (en) 2008-06-24 2009-06-24 Image generating method and apparatus and image processing method and apparatus

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/KR2009/003235 Ceased WO2009157668A2 (en) 2008-06-24 2009-06-17 Method and apparatus for outputting and displaying image data

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/KR2009/003399 Ceased WO2009157708A2 (en) 2008-06-24 2009-06-24 Method and apparatus for processing 3d video image
PCT/KR2009/003383 Ceased WO2009157701A2 (en) 2008-06-24 2009-06-24 Image generating method and apparatus and image processing method and apparatus

Country Status (7)

Country Link
US (6) US20090315884A1 (en)
EP (4) EP2292019A4 (en)
JP (4) JP2011525743A (en)
KR (9) KR101539935B1 (en)
CN (4) CN102077600A (en)
MY (1) MY159672A (en)
WO (4) WO2009157668A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011239673A (en) * 2010-05-11 2011-11-24 Samsung Electronics Co Ltd Wirelessly chargeable three-dimensional glasses and wireless power transmitting system
CN102271267A (en) * 2010-06-03 2011-12-07 乐金显示有限公司 Three-dimensional liquid crystal display device and driving method thereof

Families Citing this family (215)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4336447B1 (en) 2008-05-20 2025-05-07 Adeia Imaging LLC Capturing and processing of images using monolithic camera array with heterogeneous imagers
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US8520979B2 (en) 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US20100045779A1 (en) * 2008-08-20 2010-02-25 Samsung Electronics Co., Ltd. Three-dimensional video apparatus and method of providing on screen display applied thereto
JP2010062695A (en) * 2008-09-02 2010-03-18 Sony Corp Image processing apparatus, image processing method, and program
JP2010088092A (en) * 2008-09-02 2010-04-15 Panasonic Corp Three-dimensional video transmission system, video display device and video output device
WO2010028107A1 (en) * 2008-09-07 2010-03-11 Dolby Laboratories Licensing Corporation Conversion of interleaved data sets, including chroma correction and/or correction of checkerboard interleaved formatted 3d images
JP5859309B2 (en) * 2008-11-24 2016-02-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． Combination of 3D video and auxiliary data
KR101659026B1 (en) * 2008-12-02 2016-09-23 엘지전자 주식회사 Method of displaying 3-dimensional caption and 3d display apparatus for implementing the same
RU2537800C2 (en) * 2008-12-19 2015-01-10 Конинклейке Филипс Электроникс Н.В. Method and device for overlaying three-dimensional graphics on three-dimensional video
US9269154B2 (en) 2009-01-13 2016-02-23 Futurewei Technologies, Inc. Method and system for image processing to classify an object in an image
KR20100112940A (en) * 2009-04-10 2010-10-20 엘지전자 주식회사 A method for processing data and a receiving system
TW201119353A (en) 2009-06-24 2011-06-01 Dolby Lab Licensing Corp Perceptual depth placement for 3D objects
US9215435B2 (en) 2009-06-24 2015-12-15 Dolby Laboratories Licensing Corp. Method for embedding subtitles and/or graphic overlays in a 3D or multi-view video data
WO2011006104A1 (en) * 2009-07-10 2011-01-13 Dolby Laboratories Licensing Corporation Modifying images for a 3-dimensional display mode
JP2011029849A (en) * 2009-07-23 2011-02-10 Sony Corp Receiving device, communication system, method of combining caption with stereoscopic image, program, and data structure
EP2460360A1 (en) * 2009-07-27 2012-06-06 Koninklijke Philips Electronics N.V. Combining 3d video and auxiliary data
KR101056281B1 (en) * 2009-08-03 2011-08-11 삼성모바일디스플레이주식회사 Organic electroluminescent display and driving method thereof
KR20110013693A (en) * 2009-08-03 2011-02-10 삼성모바일디스플레이주식회사 Organic electroluminescent display and driving method thereof
JP5444955B2 (en) 2009-08-31 2014-03-19 ソニー株式会社 Stereoscopic image display system, parallax conversion device, parallax conversion method, and program
US8614737B2 (en) * 2009-09-11 2013-12-24 Disney Enterprises, Inc. System and method for three-dimensional video capture workflow for dynamic rendering
US20110063298A1 (en) * 2009-09-15 2011-03-17 Samir Hulyalkar Method and system for rendering 3d graphics based on 3d display capabilities
US8988495B2 (en) * 2009-11-03 2015-03-24 Lg Eletronics Inc. Image display apparatus, method for controlling the image display apparatus, and image display system
JP2011109398A (en) * 2009-11-17 2011-06-02 Sony Corp Image transmission method, image receiving method, image transmission device, image receiving device, and image transmission system
WO2011063347A2 (en) 2009-11-20 2011-05-26 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
JP5502436B2 (en) * 2009-11-27 2014-05-28 パナソニック株式会社 Video signal processing device
US9137513B2 (en) * 2009-12-08 2015-09-15 Broadcom Corporation Method and system for mixing video and graphics
TWI491243B (en) * 2009-12-21 2015-07-01 Chunghwa Picture Tubes Ltd Image processing method
JP2011139261A (en) * 2009-12-28 2011-07-14 Sony Corp Image processing device, image processing method, and program
JP2013517677A (en) * 2010-01-13 2013-05-16 トムソン ライセンシング System and method for compositing 3D text with 3D content
JPWO2011086653A1 (en) * 2010-01-14 2013-05-16 パナソニック株式会社 Video output device, video display system
US20110175988A1 (en) * 2010-01-21 2011-07-21 General Instrument Corporation 3d video graphics overlay
JP5894537B2 (en) * 2010-02-09 2016-03-30 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 3D video format detection
US9025933B2 (en) * 2010-02-12 2015-05-05 Sony Corporation Information processing device, information processing method, playback device, playback method, program and recording medium
JP2011166666A (en) * 2010-02-15 2011-08-25 Sony Corp Image processor, image processing method, and program
KR101445777B1 (en) * 2010-02-19 2014-11-04 삼성전자 주식회사 Reproducing apparatus and control method thereof
JP5873813B2 (en) * 2010-02-19 2016-03-01 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ Stereo logo insertion
KR20130008569A (en) * 2010-02-24 2013-01-22 톰슨 라이센싱 Caption display for stereoscopic video
KR20110098420A (en) * 2010-02-26 2011-09-01 삼성전자주식회사 Display device and driving method
US20110216083A1 (en) * 2010-03-03 2011-09-08 Vizio, Inc. System, method and apparatus for controlling brightness of a device
CN102783160A (en) * 2010-03-05 2012-11-14 通用仪表公司 Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content
US9426441B2 (en) * 2010-03-08 2016-08-23 Dolby Laboratories Licensing Corporation Methods for carrying and transmitting 3D z-norm attributes in digital TV closed captioning
US8830300B2 (en) * 2010-03-11 2014-09-09 Dolby Laboratories Licensing Corporation Multiscalar stereo video format conversion
US8730301B2 (en) * 2010-03-12 2014-05-20 Sony Corporation Service linkage to caption disparity data transport
JP2011199388A (en) * 2010-03-17 2011-10-06 Sony Corp Reproducing device, reproduction control method, and program
JP2011217361A (en) * 2010-03-18 2011-10-27 Panasonic Corp Device and method of reproducing stereoscopic image and integrated circuit
JP5390016B2 (en) * 2010-03-24 2014-01-15 パナソニック株式会社 Video processing device
KR20110107151A (en) * 2010-03-24 2011-09-30 삼성전자주식회사 Stereo image processing method and apparatus for mobile terminal
JP5526929B2 (en) * 2010-03-30 2014-06-18 ソニー株式会社 Image processing apparatus, image processing method, and program
AU2011241415A1 (en) * 2010-04-12 2012-11-22 Fortem Solutions Inc. Camera projection meshes
EP2547101A4 (en) * 2010-04-14 2013-12-18 Samsung Electronics Co Ltd METHOD AND APPARATUS FOR GENERATING A DIFFUSION BIT STREAM FOR DIGITAL BROADCAST WITH SUBTITLES, AND METHOD AND APPARATUS FOR RECEIVING DIFFUSION BINARY STREAM FOR DIGITAL BROADCAST WITH SUBTITLES
US9237366B2 (en) 2010-04-16 2016-01-12 Google Technology Holdings LLC Method and apparatus for distribution of 3D television program materials
US20110255003A1 (en) * 2010-04-16 2011-10-20 The Directv Group, Inc. Method and apparatus for presenting on-screen graphics in a frame-compatible 3d format
KR101697184B1 (en) 2010-04-20 2017-01-17 삼성전자주식회사 Apparatus and Method for generating mesh, and apparatus and method for processing image
US9414042B2 (en) * 2010-05-05 2016-08-09 Google Technology Holdings LLC Program guide graphics and video in window for 3DTV
US20120012748A1 (en) 2010-05-12 2012-01-19 Pelican Imaging Corporation Architectures for imager arrays and array cameras
KR101082234B1 (en) * 2010-05-13 2011-11-09 삼성모바일디스플레이주식회사 Organic light emitting display device and driving method thereof
JP2011249895A (en) * 2010-05-24 2011-12-08 Panasonic Corp Signal processing system and signal processing apparatus
US20110292038A1 (en) * 2010-05-27 2011-12-01 Sony Computer Entertainment America, LLC 3d video conversion
US9030536B2 (en) 2010-06-04 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
JP5682149B2 (en) * 2010-06-10 2015-03-11 ソニー株式会社 Stereo image data transmitting apparatus, stereo image data transmitting method, stereo image data receiving apparatus, and stereo image data receiving method
US8402502B2 (en) * 2010-06-16 2013-03-19 At&T Intellectual Property I, L.P. Method and apparatus for presenting media content
US9053562B1 (en) 2010-06-24 2015-06-09 Gregory S. Rabin Two dimensional to three dimensional moving image converter
US9787974B2 (en) 2010-06-30 2017-10-10 At&T Intellectual Property I, L.P. Method and apparatus for delivering media content
US8593574B2 (en) 2010-06-30 2013-11-26 At&T Intellectual Property I, L.P. Apparatus and method for providing dimensional media content based on detected display capability
US8640182B2 (en) 2010-06-30 2014-01-28 At&T Intellectual Property I, L.P. Method for detecting a viewing apparatus
US8918831B2 (en) * 2010-07-06 2014-12-23 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
KR101645404B1 (en) 2010-07-06 2016-08-04 삼성디스플레이 주식회사 Organic Light Emitting Display
US9049426B2 (en) 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
JP5609336B2 (en) * 2010-07-07 2014-10-22 ソニー株式会社 Image data transmitting apparatus, image data transmitting method, image data receiving apparatus, image data receiving method, and image data transmitting / receiving system
KR101279660B1 (en) * 2010-07-07 2013-06-27 엘지디스플레이 주식회사 3d image display device and driving method thereof
US8848038B2 (en) * 2010-07-09 2014-09-30 Lg Electronics Inc. Method and device for converting 3D images
US9032470B2 (en) 2010-07-20 2015-05-12 At&T Intellectual Property I, Lp Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
US9560406B2 (en) 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US9232274B2 (en) 2010-07-20 2016-01-05 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
IT1401367B1 (en) * 2010-07-28 2013-07-18 Sisvel Technology Srl METHOD TO COMBINE REFERENCE IMAGES TO A THREE-DIMENSIONAL CONTENT.
US8994716B2 (en) 2010-08-02 2015-03-31 At&T Intellectual Property I, Lp Apparatus and method for providing media content
JPWO2012017687A1 (en) * 2010-08-05 2013-10-03 パナソニック株式会社 Video playback device
KR101674688B1 (en) * 2010-08-12 2016-11-09 엘지전자 주식회사 A method for displaying a stereoscopic image and stereoscopic image playing device
JP2012044625A (en) * 2010-08-23 2012-03-01 Sony Corp Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device and stereoscopic image data reception method
US8438502B2 (en) 2010-08-25 2013-05-07 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
KR101218815B1 (en) * 2010-08-26 2013-01-21 주식회사 티스마트 3D user interface processing method and set-top box using the same
US8994792B2 (en) * 2010-08-27 2015-03-31 Broadcom Corporation Method and system for creating a 3D video from a monoscopic 2D video and corresponding depth information
JP5058316B2 (en) * 2010-09-03 2012-10-24 株式会社東芝 Electronic device, image processing method, and image processing program
EP2426931A1 (en) * 2010-09-06 2012-03-07 Advanced Digital Broadcast S.A. A method and a system for determining a video frame type
CN103262544A (en) * 2010-09-10 2013-08-21 青岛海信电器股份有限公司 Display method and device for 3D TV interface
JP2012094111A (en) * 2010-09-29 2012-05-17 Sony Corp Image processing device, image processing method and program
WO2012044272A1 (en) * 2010-09-29 2012-04-05 Thomson Licensing Automatically switching between three dimensional and two dimensional contents for display
US8947511B2 (en) 2010-10-01 2015-02-03 At&T Intellectual Property I, L.P. Apparatus and method for presenting three-dimensional media content
US8941724B2 (en) * 2010-10-01 2015-01-27 Hitachi Maxell Ltd. Receiver
JP5543892B2 (en) * 2010-10-01 2014-07-09 日立コンシューマエレクトロニクス株式会社 REPRODUCTION DEVICE, REPRODUCTION METHOD, DISPLAY DEVICE, AND DISPLAY METHOD
TWI420151B (en) * 2010-10-07 2013-12-21 Innolux Corp Display method
KR101232086B1 (en) * 2010-10-08 2013-02-08 엘지디스플레이 주식회사 Liquid crystal display and local dimming control method of thereof
US20120092327A1 (en) * 2010-10-14 2012-04-19 Sony Corporation Overlaying graphical assets onto viewing plane of 3d glasses per metadata accompanying 3d image
JP5550520B2 (en) * 2010-10-20 2014-07-16 日立コンシューマエレクトロニクス株式会社 Playback apparatus and playback method
KR20120047055A (en) * 2010-11-03 2012-05-11 삼성전자주식회사 Display apparatus and method for providing graphic image
CN102469319A (en) * 2010-11-10 2012-05-23 康佳集团股份有限公司 Three-dimensional menu generation method and three-dimensional display device
JP5789960B2 (en) * 2010-11-18 2015-10-07 セイコーエプソン株式会社 Display device, display device control method, and program
JP5786315B2 (en) * 2010-11-24 2015-09-30 セイコーエプソン株式会社 Display device, display device control method, and program
CN101980545B (en) * 2010-11-29 2012-08-01 深圳市九洲电器有限公司 Method for automatically detecting 3DTV video program format
CN101984671B (en) * 2010-11-29 2013-04-17 深圳市九洲电器有限公司 Method for synthesizing video images and interface graphs by 3DTV receiving system
US8878950B2 (en) 2010-12-14 2014-11-04 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using super-resolution processes
JP2012129845A (en) * 2010-12-16 2012-07-05 Jvc Kenwood Corp Image processing device
JP5611807B2 (en) * 2010-12-27 2014-10-22 Ｎｅｃパーソナルコンピュータ株式会社 Video display device
US8600151B2 (en) 2011-01-03 2013-12-03 Apple Inc. Producing stereoscopic image
KR101814798B1 (en) * 2011-01-26 2018-01-04 삼성전자주식회사 Apparatus for processing three dimension image and method for the same
CN102137298B (en) * 2011-03-02 2015-12-09 华为技术有限公司 Method and device for acquiring 3D format description information
CN102157012B (en) * 2011-03-23 2012-11-28 深圳超多维光电子有限公司 Method for three-dimensionally rendering scene, graphic image treatment device, equipment and system
US9519994B2 (en) 2011-04-15 2016-12-13 Dolby Laboratories Licensing Corporation Systems and methods for rendering 3D image independent of display size and viewing distance
KR101801141B1 (en) * 2011-04-19 2017-11-24 엘지전자 주식회사 Apparatus for displaying image and method for operating the same
KR20120119173A (en) * 2011-04-20 2012-10-30 삼성전자주식회사 3d image processing apparatus and method for adjusting three-dimensional effect thereof
JP2012231254A (en) * 2011-04-25 2012-11-22 Toshiba Corp Stereoscopic image generating apparatus and stereoscopic image generating method
EP2708019B1 (en) 2011-05-11 2019-10-16 FotoNation Limited Systems and methods for transmitting and receiving array camera image data
US9445046B2 (en) 2011-06-24 2016-09-13 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US9602766B2 (en) 2011-06-24 2017-03-21 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US8947497B2 (en) 2011-06-24 2015-02-03 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US9030522B2 (en) 2011-06-24 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for providing media content
CN102231829B (en) * 2011-06-27 2014-12-17 深圳超多维光电子有限公司 Display format identification method and device of video file as well as video player
US9294752B2 (en) * 2011-07-13 2016-03-22 Google Technology Holdings LLC Dual mode user interface system and method for 3D video
US8587635B2 (en) 2011-07-15 2013-11-19 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
WO2013023325A1 (en) * 2011-08-18 2013-02-21 北京世纪高蓝科技有限公司 Method for converting 2d into 3d based on image motion information
CN103002297A (en) * 2011-09-16 2013-03-27 联咏科技股份有限公司 Method and device for generating dynamic depth value
WO2013043751A1 (en) 2011-09-19 2013-03-28 Pelican Imaging Corporation Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US8952996B2 (en) * 2011-09-27 2015-02-10 Delta Electronics, Inc. Image display system
JP6140709B2 (en) 2011-09-28 2017-05-31 ペリカン イメージング コーポレイション System and method for encoding and decoding bright-field image files
US8813109B2 (en) 2011-10-21 2014-08-19 The Nielsen Company (Us), Llc Methods and apparatus to identify exposure to 3D media presentations
US8687470B2 (en) 2011-10-24 2014-04-01 Lsi Corporation Optical disk playback device with three-dimensional playback functionality
JP5289538B2 (en) * 2011-11-11 2013-09-11 株式会社東芝 Electronic device, display control method and program
CN102413350B (en) * 2011-11-30 2014-04-16 四川长虹电器股份有限公司 Method for processing blue-light 3D (three-dimensional) video
FR2983673A1 (en) * 2011-12-02 2013-06-07 Binocle CORRECTION METHOD FOR ALTERNATE PROJECTION OF STEREOSCOPIC IMAGES
WO2013126578A1 (en) 2012-02-21 2013-08-29 Pelican Imaging Corporation Systems and methods for the manipulation of captured light field image data
US8479226B1 (en) * 2012-02-21 2013-07-02 The Nielsen Company (Us), Llc Methods and apparatus to identify exposure to 3D media presentations
US8713590B2 (en) 2012-02-21 2014-04-29 The Nielsen Company (Us), Llc Methods and apparatus to identify exposure to 3D media presentations
US10445398B2 (en) * 2012-03-01 2019-10-15 Sony Corporation Asset management during production of media
US9315997B2 (en) 2012-04-10 2016-04-19 Dirtt Environmental Solutions, Ltd Tamper evident wall cladding system
KR20130121058A (en) * 2012-04-26 2013-11-05 한국전자통신연구원 Video reproduction apparatus for 3dtv and method for processing by video reproduction apparatus
EP2873028A4 (en) 2012-06-28 2016-05-25 Pelican Imaging Corp SYSTEMS AND METHODS FOR DETECTING CAMERA NETWORKS, OPTICAL NETWORKS AND DEFECTIVE SENSORS
US20140002674A1 (en) 2012-06-30 2014-01-02 Pelican Imaging Corporation Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors
EP3869797B1 (en) 2012-08-21 2023-07-19 Adeia Imaging LLC Method for depth detection in images captured using array cameras
US20140055632A1 (en) 2012-08-23 2014-02-27 Pelican Imaging Corporation Feature based high resolution motion estimation from low resolution images captured using an array source
KR20140039649A (en) 2012-09-24 2014-04-02 삼성전자주식회사 Multi view image generating method and multi view image display apparatus
KR20140049834A (en) * 2012-10-18 2014-04-28 삼성전자주식회사 Broadcast receiving apparatus and method of controlling the same, and user terminal device and method of providing the screen.
WO2014078443A1 (en) 2012-11-13 2014-05-22 Pelican Imaging Corporation Systems and methods for array camera focal plane control
US20150296198A1 (en) * 2012-11-27 2015-10-15 Intellectual Discovery Co., Ltd. Method for encoding and decoding image using depth information, and device and image system using same
KR101430985B1 (en) * 2013-02-20 2014-09-18 주식회사 카몬 System and Method on Providing Multi-Dimensional Content
WO2014130849A1 (en) 2013-02-21 2014-08-28 Pelican Imaging Corporation Generating compressed light field representation data
WO2014133974A1 (en) 2013-02-24 2014-09-04 Pelican Imaging Corporation Thin form computational and modular array cameras
WO2014138695A1 (en) 2013-03-08 2014-09-12 Pelican Imaging Corporation Systems and methods for measuring scene information while capturing images using array cameras
US8866912B2 (en) 2013-03-10 2014-10-21 Pelican Imaging Corporation System and methods for calibration of an array camera using a single captured image
WO2014164909A1 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation Array camera architecture implementing quantum film sensors
WO2014164550A2 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation System and methods for calibration of an array camera
WO2014159779A1 (en) 2013-03-14 2014-10-02 Pelican Imaging Corporation Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
WO2014153098A1 (en) 2013-03-14 2014-09-25 Pelican Imaging Corporation Photmetric normalization in array cameras
US9992021B1 (en) 2013-03-14 2018-06-05 GoTenna, Inc. System and method for private and point-to-point communication between computing devices
EP4604059A3 (en) 2013-03-15 2025-09-17 Adeia Imaging LLC Systems and methods for stereo imaging with camera arrays
US9497429B2 (en) 2013-03-15 2016-11-15 Pelican Imaging Corporation Extended color processing on pelican array cameras
US9445003B1 (en) 2013-03-15 2016-09-13 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
CN104079941B (en) * 2013-03-27 2017-08-25 中兴通讯股份有限公司 A kind of depth information decoding method, device and Video processing playback equipment
CN104469338B (en) * 2013-09-25 2016-08-17 联想(北京)有限公司 A kind of control method and device
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US10491916B2 (en) * 2013-10-01 2019-11-26 Advanced Micro Devices, Inc. Exploiting camera depth information for video encoding
CN103543953B (en) * 2013-11-08 2017-01-04 深圳市汉普电子技术开发有限公司 The method of the 3D film source that broadcasting identifies without 3D and touch apparatus
JP2015119464A (en) * 2013-11-12 2015-06-25 セイコーエプソン株式会社 Display device and display device control method
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
EP3075140B1 (en) 2013-11-26 2018-06-13 FotoNation Cayman Limited Array camera configurations incorporating multiple constituent array cameras
WO2015134996A1 (en) 2014-03-07 2015-09-11 Pelican Imaging Corporation System and methods for depth regularization and semiautomatic interactive matting using rgb-d images
CN104143308B (en) 2014-07-24 2016-09-07 京东方科技集团股份有限公司 The display methods of a kind of 3-D view and device
US10228751B2 (en) 2014-08-06 2019-03-12 Apple Inc. Low power mode
US9647489B2 (en) 2014-08-26 2017-05-09 Apple Inc. Brownout avoidance
JP2017531976A (en) 2014-09-29 2017-10-26 フォトネイション ケイマン リミテッド System and method for dynamically calibrating an array camera
US10231033B1 (en) * 2014-09-30 2019-03-12 Apple Inc. Synchronizing out-of-band content with a media stream
US10708391B1 (en) 2014-09-30 2020-07-07 Apple Inc. Delivery of apps in a media stream
CN105095895B (en) * 2015-04-23 2018-09-25 广州广电运通金融电子股份有限公司 Valuable file identification device self-correction recognition methods
CN105376546A (en) * 2015-11-09 2016-03-02 中科创达软件股份有限公司 2D-to-3D method, device and mobile terminal
CN105472374A (en) * 2015-11-19 2016-04-06 广州华多网络科技有限公司 3D live video realization method, apparatus, and system
US20170150138A1 (en) * 2015-11-25 2017-05-25 Atheer, Inc. Method and apparatus for selective mono/stereo visual display
US20170150137A1 (en) * 2015-11-25 2017-05-25 Atheer, Inc. Method and apparatus for selective mono/stereo visual display
CN105872519B (en) * 2016-04-13 2018-03-27 万云数码媒体有限公司 2D deepening 3D image transverse storage method based on RGB compression
US10433025B2 (en) 2016-05-10 2019-10-01 Jaunt Inc. Virtual reality resource scheduling of process in a cloud-based virtual reality processing system
CN106101681A (en) * 2016-06-21 2016-11-09 青岛海信电器股份有限公司 3-D view display processing method, signal input device and television terminal
CN106982367A (en) * 2017-03-31 2017-07-25 联想(北京)有限公司 Video transmission method and its device
US10038500B1 (en) * 2017-05-11 2018-07-31 Qualcomm Incorporated Visible light communication
US10735707B2 (en) * 2017-08-15 2020-08-04 International Business Machines Corporation Generating three-dimensional imagery
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
CN107589989A (en) * 2017-09-14 2018-01-16 晨星半导体股份有限公司 Display device based on android platform and image display method thereof
US11363133B1 (en) 2017-12-20 2022-06-14 Apple Inc. Battery health-based power management
US10817307B1 (en) 2017-12-20 2020-10-27 Apple Inc. API behavior modification based on power source health
EP3644604A1 (en) * 2018-10-23 2020-04-29 Koninklijke Philips N.V. Image generating apparatus and method therefor
CN109257585B (en) * 2018-10-25 2021-04-06 京东方科技集团股份有限公司 A brightness correction device and method, display device, display system and method
CN109274949A (en) * 2018-10-30 2019-01-25 京东方科技集团股份有限公司 Video image processing method and device thereof, display device
CN112188181B (en) * 2019-07-02 2023-07-04 中强光电股份有限公司 Image display device, stereoscopic image processing circuit and synchronization signal correction method thereof
CA3109406C (en) 2019-09-17 2023-01-10 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
EP4042366A4 (en) 2019-10-07 2023-11-15 Boston Polarimetrics, Inc. SYSTEMS AND METHODS FOR EXPANSION OF SENSOR SYSTEMS AND IMAGING SYSTEMS WITH POLARIZATION
KR102558903B1 (en) 2019-11-30 2023-07-24 보스턴 폴라리메트릭스, 인크. System and Method for Segmenting Transparent Objects Using Polarized Signals
KR102241615B1 (en) * 2020-01-15 2021-04-19 한국과학기술원 Method to identify and video titles using metadata in video webpage source code, and apparatuses performing the same
CN115552486A (en) 2020-01-29 2022-12-30 因思创新有限责任公司 Systems and methods for characterizing object pose detection and measurement systems
CN115428028B (en) 2020-01-30 2026-05-19 因思创新有限责任公司 Systems and methods for synthesizing data for training models in different imaging modalities
WO2021243088A1 (en) 2020-05-27 2021-12-02 Boston Polarimetrics, Inc. Multi-aperture polarization optical systems using beam splitters
CN112004162B (en) * 2020-09-08 2022-06-21 宁波视睿迪光电有限公司 Online 3D content playing system and method
US12020455B2 (en) 2021-03-10 2024-06-25 Intrinsic Innovation Llc Systems and methods for high dynamic range image reconstruction
US12069227B2 (en) 2021-03-10 2024-08-20 Intrinsic Innovation Llc Multi-modal and multi-spectral stereo camera arrays
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US12067746B2 (en) 2021-05-07 2024-08-20 Intrinsic Innovation Llc Systems and methods for using computer vision to pick up small objects
US12175741B2 (en) 2021-06-22 2024-12-24 Intrinsic Innovation Llc Systems and methods for a vision guided end effector
US12340538B2 (en) 2021-06-25 2025-06-24 Intrinsic Innovation Llc Systems and methods for generating and using visual datasets for training computer vision models
US12172310B2 (en) 2021-06-29 2024-12-24 Intrinsic Innovation Llc Systems and methods for picking objects using 3-D geometry and segmentation
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US12293535B2 (en) 2021-08-03 2025-05-06 Intrinsic Innovation Llc Systems and methods for training pose estimators in computer vision
TWI806376B (en) * 2022-01-22 2023-06-21 宏碁股份有限公司 Stereoscopic image generation box, stereoscopic image display method and stereoscopic image display system
CN116567193A (en) * 2022-01-27 2023-08-08 宏碁股份有限公司 Stereoscopic image generation box, stereoscopic image display method and stereoscopic image display system
US11770513B1 (en) * 2022-07-13 2023-09-26 Rovi Guides, Inc. Systems and methods for reducing a number of focal planes used to display three-dimensional objects
WO2025045506A1 (en) * 2023-08-25 2025-03-06 Thomson Licensing System and method of composing graphics for 3d video on 2d capable media devices

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0703716A2 (en) 1994-09-22 1996-03-27 Sanyo Electric Co. Ltd Method of converting two-dimensional images into three-dimensional images
WO2006004342A1 (en) 2004-06-30 2006-01-12 Samsung Sdi Co., Ltd. Stereoscopic display device and driving method
KR20080093371A (en) 2007-04-16 2008-10-21 후지쯔 가부시끼가이샤 Display device, display program storage medium and display method
US7518408B2 (en) 2006-09-13 2009-04-14 Stmicroelectronics Sa Synchronizing modules in an integrated circuit

Family Cites Families (119)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4523226A (en) * 1982-01-27 1985-06-11 Stereographics Corporation Stereoscopic television system
US4667228A (en) * 1983-10-14 1987-05-19 Canon Kabushiki Kaisha Image signal processing apparatus
JPS63116593A (en) * 1986-11-04 1988-05-20 Matsushita Electric Ind Co Ltd Stereoscopic picture reproducing device
US5262879A (en) * 1988-07-18 1993-11-16 Dimensional Arts. Inc. Holographic image conversion method for making a controlled holographic grating
US5058992A (en) * 1988-09-07 1991-10-22 Toppan Printing Co., Ltd. Method for producing a display with a diffraction grating pattern and a display produced by the method
JP2508387B2 (en) * 1989-10-16 1996-06-19 凸版印刷株式会社 Method of manufacturing display having diffraction grating pattern
US5291317A (en) * 1990-07-12 1994-03-01 Applied Holographics Corporation Holographic diffraction grating patterns and methods for creating the same
JP3081675B2 (en) * 1991-07-24 2000-08-28 オリンパス光学工業株式会社 Image recording device and image reproducing device
US5740274A (en) * 1991-09-12 1998-04-14 Fuji Photo Film Co., Ltd. Method for recognizing object images and learning method for neural networks
US6011581A (en) * 1992-11-16 2000-01-04 Reveo, Inc. Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments
US6084978A (en) * 1993-12-16 2000-07-04 Eastman Kodak Company Hierarchical storage and display of digital images used in constructing three-dimensional image hard copy
CN1113320C (en) * 1994-02-01 2003-07-02 三洋电机株式会社 Method of converting two-dimensional images into three-dimensional images
US5739844A (en) * 1994-02-04 1998-04-14 Sanyo Electric Co. Ltd. Method of converting two-dimensional image into three-dimensional image
US5684890A (en) * 1994-02-28 1997-11-04 Nec Corporation Three-dimensional reference image segmenting method and apparatus
US6104828A (en) * 1994-03-24 2000-08-15 Kabushiki Kaisha Topcon Ophthalmologic image processor
JP2846840B2 (en) * 1994-07-14 1999-01-13 三洋電機株式会社 Method for generating 3D image from 2D image
US6985168B2 (en) * 1994-11-14 2006-01-10 Reveo, Inc. Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments
JPH09116931A (en) * 1995-10-18 1997-05-02 Sanyo Electric Co Ltd Left-right video identification method for time-division stereoscopic video signals
US5917940A (en) * 1996-01-23 1999-06-29 Nec Corporation Three dimensional reference image segmenting method and device and object discrimination system
JPH09322199A (en) * 1996-05-29 1997-12-12 Olympus Optical Co Ltd Stereoscopic display device
US5986781A (en) * 1996-10-28 1999-11-16 Pacific Holographics, Inc. Apparatus and method for generating diffractive element using liquid crystal display
JPH10224822A (en) * 1997-01-31 1998-08-21 Sony Corp Image display method and display device
JPH10313417A (en) * 1997-03-12 1998-11-24 Seiko Epson Corp Digital gamma correction circuit, liquid crystal display device and electronic apparatus using the same
DE19806547C2 (en) * 1997-04-30 2001-01-25 Hewlett Packard Co System and method for generating stereoscopic display signals from a single computer graphics pipeline
JPH11113028A (en) * 1997-09-30 1999-04-23 Toshiba Corp 3D video display
JP4698831B2 (en) * 1997-12-05 2011-06-08 ダイナミック ディジタル デプス リサーチ プロプライエタリー リミテッド Image conversion and coding technology
US6850631B1 (en) * 1998-02-20 2005-02-01 Oki Electric Industry Co., Ltd. Photographing device, iris input device and iris image input method
JP4149037B2 (en) * 1998-06-04 2008-09-10 オリンパス株式会社 Video system
US6704042B2 (en) * 1998-12-10 2004-03-09 Canon Kabushiki Kaisha Video processing apparatus, control method therefor, and storage medium
JP2000298246A (en) * 1999-02-12 2000-10-24 Canon Inc Display device, display method, and storage medium
JP2000275575A (en) * 1999-03-24 2000-10-06 Sharp Corp 3D image display device
KR100334722B1 (en) * 1999-06-05 2002-05-04 강호석 Method and the apparatus for generating stereoscopic image using MPEG data
JP2001012946A (en) * 1999-06-30 2001-01-19 Toshiba Corp Moving image processing apparatus and method
US6839663B1 (en) * 1999-09-30 2005-01-04 Texas Tech University Haptic rendering of volumetric soft-bodies objects
EP2362659B1 (en) * 1999-12-14 2014-11-26 Scientific-Atlanta, LLC System and method for adaptive decoding of a video signal with coordinated resource allocation
US6968568B1 (en) * 1999-12-20 2005-11-22 International Business Machines Corporation Methods and apparatus of disseminating broadcast information to a handheld device
US20020009137A1 (en) * 2000-02-01 2002-01-24 Nelson John E. Three-dimensional video broadcasting system
US7215809B2 (en) * 2000-04-04 2007-05-08 Sony Corporation Three-dimensional image producing method and apparatus therefor
JP2001320693A (en) * 2000-05-12 2001-11-16 Sony Corp Service providing device and method, receiving terminal device and method, service providing system
AU2001266862A1 (en) * 2000-06-12 2001-12-24 Vrex, Inc. Electronic stereoscopic media delivery system
JP3667620B2 (en) * 2000-10-16 2005-07-06 株式会社アイ・オー・データ機器 Stereo image capturing adapter, stereo image capturing camera, and stereo image processing apparatus
US6762755B2 (en) 2000-10-16 2004-07-13 Pixel Science, Inc. Method and apparatus for creating and displaying interactive three dimensional computer images
GB0100563D0 (en) * 2001-01-09 2001-02-21 Pace Micro Tech Plc Dynamic adjustment of on-screen displays to cope with different widescreen signalling types
US6678323B2 (en) * 2001-01-24 2004-01-13 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry Through Communications Research Centre Bandwidth reduction for stereoscopic imagery and video signals
KR20020096203A (en) * 2001-06-18 2002-12-31 (주)디지털국영 The Method for Enlarging or Reducing Stereoscopic Images
JP2003157292A (en) * 2001-11-20 2003-05-30 Nec Corp Product layout management method and management method
KR100397511B1 (en) * 2001-11-21 2003-09-13 한국전자통신연구원 The processing system and it's method for the stereoscopic/multiview Video
GB0129992D0 (en) * 2001-12-14 2002-02-06 Ocuity Ltd Control of optical switching apparatus
US20040218269A1 (en) * 2002-01-14 2004-11-04 Divelbiss Adam W. General purpose stereoscopic 3D format conversion system and method
US7319720B2 (en) * 2002-01-28 2008-01-15 Microsoft Corporation Stereoscopic video
JP2003284099A (en) * 2002-03-22 2003-10-03 Olympus Optical Co Ltd Video information signal recording medium and video display device
US6771274B2 (en) * 2002-03-27 2004-08-03 Sony Corporation Graphics and video integration with alpha and video blending
CA2380105A1 (en) * 2002-04-09 2003-10-09 Nicholas Routhier Process and system for encoding and playback of stereoscopic video sequences
EP2202648A1 (en) * 2002-04-12 2010-06-30 Mitsubishi Denki Kabushiki Kaisha Hint information describing method for manipulating metadata
JP4652389B2 (en) * 2002-04-12 2011-03-16 三菱電機株式会社 Metadata processing method
US20050248561A1 (en) * 2002-04-25 2005-11-10 Norio Ito Multimedia information generation method and multimedia information reproduction device
JP4154569B2 (en) * 2002-07-10 2008-09-24 日本電気株式会社 Image compression / decompression device
CN1682539A (en) * 2002-07-16 2005-10-12 韩国电子通信研究院 Apparatus and method for adapting 2D and 3D stereoscopic video signals
KR100488804B1 (en) * 2002-10-07 2005-05-12 한국전자통신연구원 System for data processing of 2-view 3dimention moving picture being based on MPEG-4 and method thereof
JP2004186863A (en) * 2002-12-02 2004-07-02 Amita Technology Kk Stereophoscopic vision display unit and stereophoscopic vision signal processing circuit
JP4183499B2 (en) * 2002-12-16 2008-11-19 三洋電機株式会社 Video file processing method and video processing method
JP2004246066A (en) * 2003-02-13 2004-09-02 Fujitsu Ltd How to create a virtual environment
JP2004274125A (en) * 2003-03-05 2004-09-30 Sony Corp Image processing apparatus and method
JP4677175B2 (en) * 2003-03-24 2011-04-27 シャープ株式会社 Image processing apparatus, image pickup system, image display system, image pickup display system, image processing program, and computer-readable recording medium recording image processing program
JP2004309868A (en) * 2003-04-08 2004-11-04 Sony Corp Imaging device and stereoscopic video generation device
CN101841728B (en) * 2003-04-17 2012-08-08 夏普株式会社 Three-dimensional image processing apparatus
KR100556826B1 (en) * 2003-04-17 2006-03-10 한국전자통신연구원 Internet broadcasting system and method therefor for serving MBP-4 based binocular 3D video
JP2004357156A (en) * 2003-05-30 2004-12-16 Sharp Corp Video receiving device and video reproducing device
JP2005026800A (en) * 2003-06-30 2005-01-27 Konica Minolta Photo Imaging Inc Image processing method, imaging apparatus, image processing apparatus, and image recording apparatus
ITRM20030345A1 (en) * 2003-07-15 2005-01-16 St Microelectronics Srl METHOD TO FIND A DEPTH MAP
US7411611B2 (en) * 2003-08-25 2008-08-12 Barco N. V. Device and method for performing multiple view imaging by means of a plurality of video processing devices
EP1510940A1 (en) * 2003-08-29 2005-03-02 Sap Ag A method of providing a visualisation graph on a computer and a computer for providing a visualisation graph
WO2005055607A1 (en) * 2003-12-08 2005-06-16 Electronics And Telecommunications Research Institute System and method for encoding and decoding an image using bitstream map and recording medium thereof
JP2005175997A (en) * 2003-12-12 2005-06-30 Sony Corp Decoding device, electronic device, computer, decoding method, program, and recording medium
KR100544677B1 (en) * 2003-12-26 2006-01-23 한국전자통신연구원 3D object tracking device and method using multiview image and depth information
JP3746506B2 (en) * 2004-03-08 2006-02-15 一成 江良 Stereoscopic parameter embedding device and stereoscopic image reproducing device
JP4230959B2 (en) * 2004-05-19 2009-02-25 株式会社東芝 Media data playback device, media data playback system, media data playback program, and remote operation program
JP4227076B2 (en) * 2004-05-24 2009-02-18 株式会社東芝 Display device for displaying stereoscopic image and display method for displaying stereoscopic image
KR100543219B1 (en) * 2004-05-24 2006-01-20 한국과학기술연구원 Haptic vector field generation method and 2D height information extraction method in 2D image
JP2006041811A (en) * 2004-07-26 2006-02-09 Kddi Corp Free viewpoint image streaming method
KR20040077596A (en) * 2004-07-28 2004-09-04 손귀연 Stereoscopic Image Display Device Based on Flat Panel Display
EP1804112B1 (en) * 2004-09-08 2016-11-30 Nippon Telegraph And Telephone Corporation Three-dimensional display method, apparatus and program
KR100694069B1 (en) * 2004-11-29 2007-03-12 삼성전자주식회사 A storage device including a plurality of data blocks having different sizes, a file management method using the same, and a printing device including the same
KR100656575B1 (en) 2004-12-31 2006-12-11 광운대학교 산학협력단 3D stereoscopic video display device
TWI261099B (en) * 2005-02-17 2006-09-01 Au Optronics Corp Backlight modules
KR20060122672A (en) * 2005-05-26 2006-11-30 삼성전자주식회사 Information storage medium including an application for acquiring metadata, apparatus and method for acquiring metadata
KR100828358B1 (en) * 2005-06-14 2008-05-08 삼성전자주식회사 Computer-readable recording medium recording method, apparatus, and program for executing the method
US7404645B2 (en) * 2005-06-20 2008-07-29 Digital Display Innovations, Llc Image and light source modulation for a digital display system
KR100813977B1 (en) * 2005-07-08 2008-03-14 삼성전자주식회사 High resolution 2D-3D switchable autostereoscopic display apparatus
US8384763B2 (en) * 2005-07-26 2013-02-26 Her Majesty the Queen in right of Canada as represented by the Minster of Industry, Through the Communications Research Centre Canada Generating a depth map from a two-dimensional source image for stereoscopic and multiview imaging
JP4717728B2 (en) * 2005-08-29 2011-07-06 キヤノン株式会社 Stereo display device and control method thereof
US9113147B2 (en) * 2005-09-27 2015-08-18 Qualcomm Incorporated Scalability techniques based on content information
US9131247B2 (en) * 2005-10-19 2015-09-08 Thomson Licensing Multi-view video coding using scalable video coding
KR100739764B1 (en) * 2005-11-28 2007-07-13 삼성전자주식회사 Stereo image signal processing apparatus and method
KR100793750B1 (en) * 2006-02-14 2008-01-10 엘지전자 주식회사 Imaging device for storing various setting information and control method
KR100780701B1 (en) 2006-03-28 2007-11-30 (주)오픈브이알 Automatic 3D image generating device and method
KR20070098364A (en) * 2006-03-31 2007-10-05 (주)엔브이엘소프트 Apparatus and method for encoding and storing 3D image data
JP2007304325A (en) * 2006-05-11 2007-11-22 Ｎｅｃディスプレイソリューションズ株式会社 Liquid crystal display device and liquid crystal panel driving method
KR101137347B1 (en) * 2006-05-11 2012-04-19 엘지전자 주식회사 apparatus for mobile telecommunication and method for displaying an image using the apparatus
US7953315B2 (en) * 2006-05-22 2011-05-31 Broadcom Corporation Adaptive video processing circuitry and player using sub-frame metadata
US20070294737A1 (en) * 2006-06-16 2007-12-20 Sbc Knowledge Ventures, L.P. Internet Protocol Television (IPTV) stream management within a home viewing network
CA2653815C (en) * 2006-06-23 2016-10-04 Imax Corporation Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition
KR100761022B1 (en) * 2006-08-14 2007-09-21 광주과학기술원 Haptic rendering method and device based on depth image, and tactile broadcasting system using same
KR100716142B1 (en) * 2006-09-04 2007-05-11 주식회사 이시티 How to send stereoscopic video data
CN101523924B (en) * 2006-09-28 2011-07-06 皇家飞利浦电子股份有限公司 3D menu display
KR101377736B1 (en) * 2006-10-11 2014-03-24 코닌클리케 필립스 엔.브이. Creating three dimensional graphics data
JP4755565B2 (en) * 2006-10-17 2011-08-24 シャープ株式会社 Stereoscopic image processing device
KR101362941B1 (en) * 2006-11-01 2014-02-17 한국전자통신연구원 Method and Apparatus for decoding metadata used for playing stereoscopic contents
TWI324477B (en) * 2006-11-03 2010-05-01 Quanta Comp Inc Stereoscopic image format transformation method applied to display system
JP5008677B2 (en) * 2006-11-29 2012-08-22 パナソニック株式会社 Video / audio device network and signal reproduction method
KR100786468B1 (en) * 2007-01-02 2007-12-17 삼성에스디아이 주식회사 2D and 3D image selectable display device
US8213711B2 (en) * 2007-04-03 2012-07-03 Her Majesty The Queen In Right Of Canada As Represented By The Minister Of Industry, Through The Communications Research Centre Canada Method and graphical user interface for modifying depth maps
CA2627999C (en) * 2007-04-03 2011-11-15 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry Through The Communications Research Centre Canada Generation of a depth map from a monoscopic color image for rendering stereoscopic still and video images
KR100839429B1 (en) * 2007-04-17 2008-06-19 삼성에스디아이 주식회사 Electronic imaging equipment and its driving method
WO2008140190A1 (en) * 2007-05-14 2008-11-20 Samsung Electronics Co, . Ltd. Method and apparatus for encoding and decoding multi-view image
JP4462288B2 (en) * 2007-05-16 2010-05-12 株式会社日立製作所 Video display device and three-dimensional video display device using the same
CN101897193A (en) * 2007-10-10 2010-11-24 韩国电子通信研究院 Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using the same
WO2009157707A2 (en) * 2008-06-24 2009-12-30 Samsung Electronics Co,. Ltd. Image processing method and apparatus
WO2010048632A1 (en) * 2008-10-24 2010-04-29 Real D Stereoscopic image format with depth information

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0703716A2 (en) 1994-09-22 1996-03-27 Sanyo Electric Co. Ltd Method of converting two-dimensional images into three-dimensional images
WO2006004342A1 (en) 2004-06-30 2006-01-12 Samsung Sdi Co., Ltd. Stereoscopic display device and driving method
US7518408B2 (en) 2006-09-13 2009-04-14 Stmicroelectronics Sa Synchronizing modules in an integrated circuit
KR20080093371A (en) 2007-04-16 2008-10-21 후지쯔 가부시끼가이샤 Display device, display program storage medium and display method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2289248A4

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011239673A (en) * 2010-05-11 2011-11-24 Samsung Electronics Co Ltd Wirelessly chargeable three-dimensional glasses and wireless power transmitting system
CN102271267A (en) * 2010-06-03 2011-12-07 乐金显示有限公司 Three-dimensional liquid crystal display device and driving method thereof
KR20110132827A (en) * 2010-06-03 2011-12-09 엘지디스플레이 주식회사 3D liquid crystal display and driving method
US9030538B2 (en) 2010-06-03 2015-05-12 Lg Display Co., Ltd. Three dimensional liquid crystal display device and method for driving the same
CN105280148A (en) * 2010-06-03 2016-01-27 乐金显示有限公司 Three dimensional liquid crystal display device and method for driving the same

Also Published As

Publication number Publication date
CN102067615A (en) 2011-05-18
EP2279625A4 (en) 2013-07-03
KR20100002037A (en) 2010-01-06
CN102067615B (en) 2015-02-25
EP2289248A4 (en) 2014-07-02
KR20100002038A (en) 2010-01-06
KR101539935B1 (en) 2015-07-28
US8488869B2 (en) 2013-07-16
EP2279625A2 (en) 2011-02-02
JP2011526103A (en) 2011-09-29
CN102067614B (en) 2014-06-11
KR20100002036A (en) 2010-01-06
KR20100002049A (en) 2010-01-06
EP2289248A2 (en) 2011-03-02
EP2292019A2 (en) 2011-03-09
MY159672A (en) 2017-01-13
JP2011525743A (en) 2011-09-22
US20090315977A1 (en) 2009-12-24
KR20100002032A (en) 2010-01-06
KR20100002033A (en) 2010-01-06
US20100103168A1 (en) 2010-04-29
US20090315884A1 (en) 2009-12-24
WO2009157668A2 (en) 2009-12-30
US20090317061A1 (en) 2009-12-24
CN102067613B (en) 2016-04-13
EP2289247A2 (en) 2011-03-02
WO2009157701A2 (en) 2009-12-30
WO2009157668A3 (en) 2010-03-25
WO2009157708A3 (en) 2010-04-15
EP2289247A4 (en) 2014-05-28
JP5547725B2 (en) 2014-07-16
WO2009157714A3 (en) 2010-03-25
CN102067614A (en) 2011-05-18
US20100104219A1 (en) 2010-04-29
KR20100002035A (en) 2010-01-06
WO2009157701A3 (en) 2010-04-15
WO2009157708A2 (en) 2009-12-30
KR20100002031A (en) 2010-01-06
US20090315979A1 (en) 2009-12-24
CN102067613A (en) 2011-05-18
EP2292019A4 (en) 2014-04-30
JP2011525746A (en) 2011-09-22
KR20100002048A (en) 2010-01-06
CN102077600A (en) 2011-05-25
JP2011525745A (en) 2011-09-22

Similar Documents

Publication Publication Date Title
EP2289248A2 (en) Method and apparatus for processing three dimensional video data
CN101738742B (en) Method and means for continuously adjustable 3D filter glasses to optimize stereo viewing and control thereof
US20110298795A1 (en) Transferring of 3d viewer metadata
KR101487182B1 (en) Method and apparatus for making intelligent use of active space in frame packing format
CN102918859B (en) Three-dimensional image reproduction method and three-dimensional image reproduction device
US20130050423A1 (en) Method and system for response time compensation for 3d video processing
US20110221874A1 (en) Method for adjusting 3d image quality, 3d display apparatus, 3d glasses, and system for providing 3d image
US8994797B2 (en) Display system, display device and display assistance device
JP4937369B2 (en) Electronic device, video output system, and video output method
JP5390016B2 (en) Video processing device
US9030525B2 (en) Method and apparatus for optimal motion reproduction in stereoscopic digital cinema
US20130016196A1 (en) Display apparatus and method for displaying 3d image thereof
JP5390017B2 (en) Video processing device
US9124883B2 (en) 3D shutter glasses synchronization signal through stereo headphone wires
JP5127967B1 (en) Video processing apparatus and video processing method
JP2019083504A (en) Hardware system for inputting stereoscopic image in flat panel
WO2011162474A2 (en) Method for configuring stereoscopic moving picture file
JPH07226958A (en) 3D image display system
US20120050469A1 (en) Image processing device, image processing method and image processing system
CN121888019A (en) Television signal VR viewing realization system and method based on 2D-3D processing
KR101112085B1 (en) Demultiplexer and method for 3D TV
JP2013055675A (en) Image processing apparatus and image processing method
JPH07222203A (en) 3D video software conversion method
PT-LC55U Editing Desk
WO2013151291A1 (en) Multi-view image displaying apparatus for improving picture quality and a method thereof

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980123638.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09770386

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2009770386

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2009770386

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2011514504

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE