WO2012140919A1 - Dispositif de génération d'image stéréo et procédé de génération d'image stéréo - Google Patents

Dispositif de génération d'image stéréo et procédé de génération d'image stéréo Download PDF

Info

Publication number
WO2012140919A1
WO2012140919A1 PCT/JP2012/002602 JP2012002602W WO2012140919A1 WO 2012140919 A1 WO2012140919 A1 WO 2012140919A1 JP 2012002602 W JP2012002602 W JP 2012002602W WO 2012140919 A1 WO2012140919 A1 WO 2012140919A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
unit
captured image
pixels
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2012/002602
Other languages
English (en)
Japanese (ja)
Inventor
孝幸 有馬
仁麿 東郷
和之 田中
康治 井村
剛 中村
郁雄 渕上
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Original Assignee
Panasonic Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2011090396A external-priority patent/JP2014132701A/ja
Priority claimed from JP2011090395A external-priority patent/JP2014132700A/ja
Application filed by Panasonic Corp filed Critical Panasonic Corp
Publication of WO2012140919A1 publication Critical patent/WO2012140919A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/25—Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/443—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading pixels from selected two-dimensional [2D] regions of the array, e.g. for windowing or digital zooming

Definitions

  • the present invention relates to a stereo image generating apparatus and a stereo image generating method suitable for use in a compound-eye camera for capturing a stereo image that captures a stereo image.
  • the compound-eye camera described in Patent Document 1 includes a plurality of imaging means (i.e., cameras) having a maximum number of pixels that can be photographed and an angle of view, and one camera has an angle of view compared to the other camera. Is narrow, and the maximum number of pixels that can be shot is small.
  • the image captured by a camera with a high number of pixels is reduced or cut out according to the number of pixels of the image captured with a camera with a low number of pixels and the angle of view.
  • the number of pixels of the image and the angle of view are combined to generate a stereo image.
  • one of the cameras with a large number of pixels is used to reduce the number of pixels of an image captured by a camera with a large number of pixels.
  • the number of pixels of a stereo image that can be photographed is limited to the number of pixels of a camera with a low number of pixels.
  • the present invention has been made in view of the above circumstances, and a stereo image of high pixels can be taken without using two high pixel number imaging means, and a stereo image that can be sufficiently stereoscopically viewed.
  • An object of the present invention is to provide a generating device and a stereo image generating method.
  • a stereo image generating device has a first number of pixels, has an optical zoom function, and has a first imaging unit for picking up a first captured image, and a second smaller than the first number of pixels.
  • a second imaging unit configured to capture a second captured image having the number of pixels and having an electronic zoom function, and a resolution adjustment unit configured to adjust a difference in resolution between right and left based on a zoom magnification designated in stereo image shooting; Equipped with
  • two imaging units with different resolutions pick up two images, and adjust the left and right resolution differences based on the specified zoom magnification, so two imaging units with high pixels can be used. Therefore, the cost can be reduced and the mounting area can be reduced.
  • the first imaging unit performs an optical zoom operation based on the zoom magnification specified in stereo image shooting
  • the second imaging unit performs an electronic zoom operation
  • the zoom magnification is a predetermined magnification.
  • the first and second captured images are converted to the third pixel number and the predetermined magnification is exceeded, the first and second captured images are processed.
  • An image resizing unit configured to convert the image data into a fourth pixel number smaller than the third pixel number; an image encoding unit configured to encode the first captured image and the second captured image converted by the image resizing unit; A stereo image file for converting the first captured image and the second captured image encoded by the image encoding unit into a stereo image format to generate a stereo image And Tsu door conversion unit, equipped with.
  • the first imaging unit having high pixels and the second imaging unit having pixels lower than the first imaging unit are provided, and when the optical zoom magnification is equal to or less than the predetermined magnification, the first imaging unit is
  • the first captured image captured by the imaging unit and the second captured image captured by the second imaging unit have a third pixel count, specifically, a pixel count higher than the pixel count of the second imaging unit.
  • the first captured image and the enlarged second captured image are encoded, and the encoded first and second captured images are converted into a stereo image format to generate a stereo image.
  • the first captured image captured by the first imaging unit and the second captured image captured by the second imaging unit are used as the third pixel count.
  • the resized and resized first captured image and second captured image to a smaller fourth pixel number, and the encoded first captured image and second captured image are converted to a stereo image format Generate a stereo image.
  • the optical zoom magnification is equal to or less than the predetermined magnification
  • the number of pixels of the captured image of the low pixel imaging unit is higher than that of the low pixel imaging unit without using two high pixel imaging units. It becomes possible to capture a stereo image.
  • the number of pixels of the stereo image generated when the optical zoom magnification is equal to or less than the predetermined magnification is smaller than the first captured image and the second While suppressing the resolution of the captured image to a certain ratio or less, it is possible to capture a stereo image that has a pixel size higher than the number of pixels of the captured image of the low pixel imaging unit and that is easy to view stereoscopically.
  • the conversion of the first captured image and the conversion of the second captured image, which are performed by the image resizing unit, are enlargement, reduction, or equal-scale conversion.
  • the configuration it is possible to match the number of pixels of the first captured image captured by the first imaging unit with the number of pixels of the second captured image captured by the second imaging unit.
  • the image processing apparatus further includes a zoom magnification threshold storage unit configured to hold a predetermined magnification of the optical zoom magnification as a zoom magnification threshold, and the image resizing section includes the first captured image and the second imaged image based on the zoom magnification threshold. Resize the captured image of.
  • the difference in resolution between the first captured image and the second captured image can be limited to within a certain fixed value.
  • the third number of pixels is the first number of pixels.
  • the first imaging unit includes a first angle of view
  • the second imaging unit includes a second angle of view narrower than the first angle of view
  • the first imaging is performed.
  • An angle of view correction unit that trims the first or second captured image according to the optical zoom magnification of the unit; the image encoding unit is trimmed by the angle of view correction unit; and the image resizing unit The first captured image in which the number of pixels is converted and the second captured image in which the number of pixels is converted in the image resizing unit are encoded.
  • the angle of view correction unit by providing the angle of view correction unit, the first captured image can be made smaller.
  • the image capturing apparatus further includes an angle of view information holding unit that holds angle of view correction information for each optical zoom magnification of the first imaging unit, and the angle of view correction unit trims based on the angle of view correction information.
  • a position correction unit that corrects at least one of vertical shift, horizontal shift, rotational shift, or size shift with respect to either the first captured image or the second captured image.
  • the image encoding unit is corrected by the position correction unit, and the first resized image is converted by the image resizing unit to the predetermined number of pixels, and the image correction unit is corrected by the position correction unit. And encode the second captured image converted into the predetermined number of pixels.
  • the position correction unit corrects at least one of vertical deviation, horizontal deviation, rotational deviation, or size deviation with respect to either the first captured image or the second captured image.
  • the position correction unit corrects at least one of vertical deviation, horizontal deviation, rotational deviation, or size deviation with respect to either the first captured image or the second captured image.
  • the image pickup apparatus further includes a position correction information holding unit that holds position correction information for each optical zoom magnification of the first imaging unit, and the position correction unit is vertically offset, horizontal offset, or rotational offset based on the position correction information. Or correct at least one of the size deviations.
  • a color for performing color correction on the first captured image and / or the second captured image with respect to the difference in color between the first captured image and the second captured image is provided, and the image encoding unit encodes the first captured image whose color is corrected by the color correction unit and the second captured image.
  • color correction of the first captured image and / or the second captured image can be performed by providing the color correction unit.
  • an image filter unit that performs averaging processing on peripheral portions of respective images of the first captured image and the second captured image
  • the image encoding unit includes pixels in the image resizing unit. After the number conversion is performed, the first captured image subjected to the averaging process by the image filter unit and the pixel number conversion performed by the image resizing unit are averaged by the image filter unit. And encoding the second captured image subjected to the processing.
  • the image filter unit by providing the image filter unit, it is possible to blur the periphery of each of the first captured image and the second captured image, and between the first and second imaging units. It is possible to reduce the deterioration of the image quality of the stereo image due to the difference in lens distortion.
  • the magnitude relationship between the first pixel number, the third pixel number, and the fourth pixel number is: first pixel number ⁇ third pixel number> fourth pixel number.
  • a stereo image generating method includes a first imaging step of capturing a first captured image with a first number of pixels in a first imaging unit having an optical zoom function, and a second imaging step having an electronic zoom function.
  • An image resizing step for converting the number of pixels to a fourth number of pixels smaller than the number of pixels; an image encoding step for encoding the first captured image and the second captured image converted in the image resizing step; Enko And stereo image format conversion step of generating a stereo image by converting the first captured image and the second captured image encoded in de step to the stereo image format, with a.
  • the first imaging unit with high pixels and the second imaging unit with pixels lower than the first imaging unit using the first imaging unit with high pixels and the second imaging unit with pixels lower than the first imaging unit, the first imaged image imaged by the first imaging unit To a predetermined number of pixels, and the second picked-up image picked up by the second image pickup unit to a predetermined number of pixels, and thus the resized first picked-up image and the second picked-up image are encoded And convert the encoded first and second captured images into a stereo image format to generate a stereo image, so that a high-pixel stereo image is captured without using two high-pixel imaging means. It is possible to
  • the number of pixels of the stereo image generated when the optical zoom magnification is equal to or less than the predetermined magnification is smaller than the number of pixels of the stereo image. While suppressing the resolution of the image to a certain ratio or less, it is possible to capture a stereo image that is higher in pixels than the number of pixels of the captured image of the low pixel imaging unit and that is easy to view stereoscopically.
  • the first imaging unit has both an optical zoom function and an electronic zoom function, and in stereo image shooting, the first imaging unit performs an optical zoom operation and an electronic operation based on a zoom magnification designated.
  • the zoom operation is performed, the second imaging unit performs the electronic zoom operation, and the first imaging unit performs the optical zoom operation when the zoom magnification is equal to or less than a predetermined magnification smaller than the upper limit magnification of the optical zoom function.
  • the second imaging unit performs the electronic zoom operation, and when the predetermined magnification is exceeded, the subsequent zoom operations perform the electronic zoom operation with the first imaging unit and the second imaging unit.
  • Image pickup control unit for controlling the image pickup control unit, an image resizing unit for converting the first picked-up image and the second picked-up image into a predetermined number of pixels, and the first picked-up image converted by the image resizing unit.
  • An image encoding unit encoding the image and the second captured image; and converting the first captured image and the second captured image encoded by the image encoding unit into a stereo image format to generate a stereo image And a stereo image format converter.
  • the first imaging unit having high pixels and the second imaging unit having pixels lower than the first imaging unit are provided, and the zoom magnification is a predetermined magnification smaller than the upper limit magnification of the optical zoom function.
  • the first captured image captured by the first imaging unit by the optical zoom and the second captured image captured by the electronic zoom by the second imaging unit have a predetermined number of pixels.
  • the resized and encoded first captured image and the enlarged second captured image are converted, and the encoded first and second captured images are converted to a stereo image format to generate a stereo image.
  • the first imaging unit optically zooms to a predetermined magnification, and the zoom magnification thereafter is imaged by the electronic zoom Resizing the first captured image and the second captured image captured by the electronic zoom in the second imaging unit to a predetermined number of pixels, and encoding the resized first captured image and the second captured image;
  • the encoded first and second captured images are converted into a stereo image format to generate a stereo image.
  • the imaging of the low pixel imaging portion is performed without using two high pixel imaging means. It is possible to capture a stereo image with a pixel higher than the number of pixels of the image.
  • the resolution of the first captured image and the second captured image can be suppressed to a certain ratio or less, and a stereoscopic image which is easy to view stereoscopically is captured. be able to.
  • the conversion of the first captured image and the conversion of the second captured image, which are performed by the image resizing unit, are enlargement, reduction, or equal-scale conversion.
  • the configuration it is possible to match the number of pixels of the first captured image captured by the first imaging unit with the number of pixels of the second captured image captured by the second imaging unit.
  • the zoom magnification threshold storage unit stores the switching magnification of the zoom magnification as a zoom magnification threshold
  • the imaging control unit is configured to capture the first imaging unit and the second imaging based on the zoom magnification threshold. Switch control of the zoom operation of the unit.
  • the imaging control unit performs switching control of the zoom operation of the first imaging unit and the second imaging unit based on the zoom magnification threshold value, whereby the first imaging image and the second imaging image are displayed.
  • the difference in resolution can be limited within a certain value.
  • the predetermined number of pixels is the first number of pixels.
  • the first imaging unit includes a first angle of view
  • the second imaging unit includes a second angle of view narrower than the first angle of view
  • the first imaging is performed.
  • the image encoding unit includes the first captured image that has been trimmed by the angle of view correction unit and has the number of pixels converted by the image resizing unit, and the image resizing unit. And encoding the second captured image in which the number of pixels has been converted.
  • the angle of view correction unit by providing the angle of view correction unit, the first captured image can be made smaller.
  • the image capturing apparatus further includes an angle of view information holding unit that holds angle of view correction information for each optical zoom magnification of the first imaging unit, and the angle of view correction unit trims based on the angle of view correction information.
  • a position correction unit that corrects at least one of vertical shift, horizontal shift, rotational shift, or size shift with respect to either the first captured image or the second captured image.
  • the image encoding unit is corrected by the position correction unit, and the first resized image is converted by the image resizing unit to the predetermined number of pixels, and the image correction unit is corrected by the position correction unit. And encode the second captured image converted into a predetermined number of pixels.
  • the position correction unit corrects at least one of vertical deviation, horizontal deviation, rotational deviation, or size deviation with respect to either the first captured image or the second captured image.
  • the position correction unit corrects at least one of vertical deviation, horizontal deviation, rotational deviation, or size deviation with respect to either the first captured image or the second captured image.
  • the image pickup apparatus further includes a position correction information holding unit that holds position correction information for each optical zoom magnification of the first imaging unit, and the position correction unit is vertically offset, horizontal offset, or rotational offset based on the position correction information. Or correct at least one of the size deviations.
  • color correction is performed to correct the color of the first captured image and / or the second captured image with respect to the difference in color between the first captured image and the second captured image.
  • the image encoding unit encodes the first captured image whose color is corrected by the color correction unit and the second captured image.
  • color correction of the first captured image and / or the second captured image can be performed by providing the color correction unit.
  • an image filter unit that performs averaging processing on peripheral portions of respective images of the first captured image and the second captured image
  • the image encoding unit includes pixels in the image resizing unit.
  • the peripheral portion of each of the first captured image and the second captured image can be blurred, and a lens between the first and second imaging units It is possible to reduce the deterioration of the image quality of the stereo image due to the difference in distortion.
  • a stereo image generating method comprises: a first imaging step of imaging a first captured image with a first number of pixels in a first imaging unit having an optical zoom function and an electronic zoom function; A second imaging step for imaging a second captured image with a second number of pixels smaller than the first number of pixels in a second imaging unit having an electronic zoom function;
  • the magnification is smaller than the upper limit magnification of the zoom function
  • the first imaging unit performs the optical zoom operation
  • the second imaging unit performs the electronic zoom operation.
  • the magnification exceeds the predetermined magnification
  • the first image pickup unit and the second image pickup unit perform a zoom control step to perform electronic zoom operation, the first image pickup image, and the second image pickup image.
  • the first imaging unit with high pixels and the second imaging unit with pixels lower than the first imaging unit using the first imaging unit with high pixels and the second imaging unit with pixels lower than the first imaging unit, the first imaged image imaged by the first imaging unit To a predetermined number of pixels, and the second captured image captured by the second imaging unit to a predetermined number of pixels, and thus the resized first captured image and the second captured image are encoded. Since the encoded first captured image and the second captured image are converted to a stereo image format to generate a stereo image, a high pixel stereo image is captured without using two high pixel imaging means. It becomes possible.
  • zoom magnification exceeds a predetermined magnification, by suppressing the resolution of the first captured image and the second captured image to a certain ratio or less, a high-pixel stereo image that is easy to view stereoscopically is captured. And zoom operation is also possible.
  • the present invention since two images are captured by two imaging means having different resolutions and the left-right resolution difference is adjusted based on the designated zoom magnification, two high-pixel imaging means are used. Therefore, the cost can be reduced and the mounting area can be reduced.
  • Block diagram showing a schematic configuration of a stereo image generating apparatus according to Embodiment 1 of the present invention A flowchart showing the entire photographing process of the stereo image generating apparatus of FIG. 1 The flowchart which shows the photographing processing of optical zoom magnification below predetermined magnification of the stereo image generation device of Drawing 1 The figure which shows the process result in each step of step S30-step S32 of imaging processing of FIG. 3, and step S34.
  • a flowchart showing photographing processing when the optical zoom magnification exceeds a predetermined magnification in the stereo image generation device of FIG. 1 The figure which shows the processing result in each step of step S30-step S32 of imaging processing of FIG. 5, and step S40.
  • FIG. 8 Block diagram showing a schematic configuration of a stereo image generating apparatus according to Embodiment 2 of the present invention
  • FIG. 1 is a block diagram showing a schematic configuration of a stereo image generating apparatus according to Embodiment 1 of the present invention.
  • the stereo image generating device 1 according to the first embodiment includes a high pixel imaging unit 10-1 having an optical zoom function, a low pixel imaging unit 10-2 having an electronic zoom function, and zoom control.
  • the imaging units 10-1 and 10-2 each include an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and output an imaging signal.
  • an image obtained by imaging by the imaging unit 10-1 is taken as a first captured image
  • an image obtained by imaging by the imaging unit 10-2 is taken as a second captured image.
  • the imaging unit 10-1 has a first angle of view
  • the imaging unit 10-2 has a second image narrower than the first angle of view of the imaging unit 10-1. It has a horn.
  • the imaging unit 10-1 also has an optical zoom function.
  • the imaging unit 10-1 may further include an electronic zoom function.
  • the imaging unit 10-2 does not have an optical zoom function, but only an electronic zoom function.
  • the zoom control unit 11 performs zoom control of the imaging units 10-1 and 10-2.
  • the autofocus control unit 12 performs autofocus control of the imaging units 10-1 and 10-2.
  • the shutter control unit 13 performs shutter control of the imaging units 10-1 and 10-2.
  • the exposure control unit 14 performs exposure control of the imaging units 10-1 and 10-2.
  • the white balance control unit 15 performs white balance control of the imaging units 10-1 and 10-2.
  • the camera operation unit 16 is for operating the stereo image generating device 1, and a signal at the time of operation such as a zoom magnification designated by the operator is input to the control unit 17.
  • the control unit 17 outputs an operation signal corresponding to the operation in the camera operation unit 16 to the imaging units 10-1 and 10-2.
  • the camera signal processing unit 18-1 resizes the first captured image captured by the imaging unit 10-1 to the size of the display unit 32 in the preview processing.
  • the camera signal processing unit 18-2 resizes the second captured image captured by the imaging unit 10-2 to the size of the display unit 32 in the preview processing.
  • the camera signal processing unit 18-1 outputs a first captured image (L: left image) of 9.7 megapixels, and the camera signal processing unit 18-2 outputs It is assumed that a second captured image (R: right image) of 2 megapixels is output.
  • the view angle correction unit 19 reduces the view angle of the first captured image captured by the imaging unit 10-1 based on the view angle correction information stored in the view angle information storage unit 20.
  • the field angle is 5.7 megapixels.
  • the angle of view of the second captured image captured by the imaging unit 10-2 may be corrected.
  • the position correction unit 21 corrects the position of the first captured image captured by the imaging unit 10-1 based on the position correction information stored in the position correction information storage unit 22. In this case, at least one of “vertical shift”, “horizontal shift”, “rotational shift”, or “size shift” is performed as the position correction.
  • the position correction may be performed on the second captured image captured by the imaging unit 10-2. That is, even if the position correction unit 21 performs position correction on either the first captured image captured by the imaging unit 10-1 or the second captured image captured by the imaging unit 10-2. Good.
  • the color correction unit 23 performs the first color difference between the second captured image captured by the imaging unit 10-2 and the first captured image captured by the imaging unit 10-1 after position correction. Color correction is performed on the captured image and the second captured image (the first captured image or the second captured image).
  • the image resizing unit 24 converts the first captured image captured by the imaging unit 10-1 into a predetermined number of pixels, and converts the second captured image captured by the imaging unit 10-2. The number of pixels is the same as that of the first captured image.
  • the image resizing unit 24 converts the first captured image captured by the imaging unit 10-1 into a predetermined number of pixels based on the zoom magnification threshold stored in the zoom magnification threshold storage unit 41, and captures an image.
  • the second captured image captured by the unit 10-2 is also converted into a predetermined number of pixels. Specifically, when the zoom magnification is equal to or less than a predetermined magnification, the first captured image and the second captured image are converted into a third number of pixels, and the predetermined magnification is exceeded. The first captured image and the second captured image are converted into a fourth pixel number. Note that the conversion of the first captured image and the conversion of the second captured image performed by the image resizing unit 24 include “equal magnification” in addition to “enlargement” and “reduction”.
  • the super-resolution processing unit 25 When the conversion of the second captured image is enlargement conversion, the super-resolution processing unit 25 performs enlargement processing by super-resolution processing without performing enlargement processing in the image resizing unit 24. It is possible to select whether to perform enlargement processing by the resize unit 24 or enlargement by super resolution processing.
  • the super-resolution processing is processing for enhancing the sharpness of the blurred portion by enlarging the image (that is, processing for achieving high image quality).
  • the image filter unit 26 reduces the pixel shift of the left and right images due to the difference in lens distortion of the two imaging units 10-1 and 10-2 so that the images of the first and second captured images are not displayed. Perform averaging processing to blur the periphery. By providing the image filter unit 26, it is possible to reduce the deterioration of the image quality of the stereo image due to the difference in lens distortion between the two imaging units 10-1 and 10-2.
  • the image encoding unit 27 conversion of the number of pixels is performed by the image resizing unit 24, and the first captured image subjected to averaging processing by the image filter unit 26 and conversion of the number of pixels by the image resizing unit 24 are performed. Furthermore, the second captured image subjected to the averaging process in the image filter unit 26 is encoded (compressed). In this case, for example, compression is performed in JPEG (Joint Photographic Experts Group) format.
  • the stereo image format conversion unit 28 converts the first captured image and the second captured image encoded by the image encoding unit 27 into a stereo image format to generate a stereo image. In this case, for example, the JPEG format is converted to an MPO (Multi-Picture Format) format.
  • the image storage unit 29 has a flash memory (SD memory or the like), and stores the stereo image generated by the stereo image format conversion unit 28.
  • the format conversion unit 30 converts the first captured image and the second captured image converted into the number of pixels matching the display unit 32 by the image resizing unit 24 into a format for displaying on the display unit 32.
  • the display control unit 31 controls the display unit 32 to display the first captured image and the second captured image converted to a format (for example, pixel by pixel) to be displayed on the display unit 32 by the format conversion unit 30. I do.
  • the display unit 32 is, for example, a liquid crystal display.
  • the user instructs activation of the imaging units 10-1 and 10-2 from the camera operation unit 16 (step S10).
  • the control unit 17 Based on this user instruction, the control unit 17 outputs an instruction to activate the imaging units 10-1 and 10-2 to the imaging control unit 40 (step S11).
  • the control unit 17 sets the optical zoom magnification of the imaging unit 10-1 to 1 ⁇ for the imaging control unit 40 (step S12).
  • steps S14 to S21 are repeated until the user instructs the camera operation unit 16 to end shooting.
  • the determination for repeating the process of step S14 to step S21 is performed in step S13 and step S22.
  • the control unit 17 detects whether the user has performed control of the camera by the camera operation unit 16 (step S14). If not detected, the processes of steps S13, S14 and S22 are repeated. On the other hand, when it is detected, the control unit 17 determines whether it is a photographing instruction (step S15). If it is the shooting instruction, the control unit 17 determines whether the current optical zoom magnification is equal to or less than the zoom magnification threshold read from the zoom magnification threshold storage unit 41 (step S16). If the determination in step S16 is "Yes", the first photographing process is performed (step S18). The details of the shooting process No. 1 will be described later. On the other hand, if the determination in step S16 is "No", the second photographing process is performed (step S19). The details of the shooting process 2 will be described later.
  • step S17 determines whether a zoom magnification change instruction has been issued (step S17). If it is the zoom magnification change instruction (that is, if the determination in step S17 is "Yes"), the control unit 17 instructs the imaging control unit 40 to change the zoom magnification, and the imaging control unit 40 receives the imaging unit 10 An instruction to change the optical zoom magnification is issued to -1 (step S20). On the other hand, the imaging control unit 40 designates the trimming position of the image according to the zoom magnification to the camera signal processing unit 18-2. The trimming here is the electronic zoom function. If it is an instruction other than the zoom magnification change (that is, if the determination in step S17 is "No"), control according to that is performed (step S21). For example, the process of changing the size of a captured image is performed.
  • step S22 the control unit 17 stops the operation of each of the imaging units 10-1 and 10-2 (step S23), and then the present process ends.
  • step S18 the first photographing processing of step S18 when the zoom magnification is equal to or less than the zoom magnification threshold will be described.
  • the zoom magnification threshold is 1.8.
  • the case where the optical zoom magnification at the time of shooting of the imaging unit 10-1 is 1.5 will be described as an example.
  • FIG. 3 is a flowchart for explaining the photographing process 1 in FIG.
  • the camera signal processing unit 18-1 resizes the first captured image captured by the imaging unit 10-1 to the image size set by the user, while the camera signal processing unit 18-2 resizes the imaging unit.
  • the second captured image captured by 10-2 is trimmed in accordance with the user-set electronic zoom magnification, and resized in accordance with the user-set image size (step S30).
  • the field angle correction unit 19 reads out the field angle correction information from the field angle information holding unit 20, and trims the first captured image captured by the imaging unit 10-1 (step S31).
  • the position correction unit 21 reads out the position correction information from the position correction information holding unit 22, and the “vertical shift”, “horizontal shift”, “rotation” with respect to the first captured image captured by the imaging unit 10-1 At least one of the deviations "or the size deviation” is corrected (step S32).
  • the color correction unit 23 corrects the difference in color of the left and right images (step S33). That is, the difference in color between the second captured image captured by the imaging unit 10-2 and the first captured image captured by the imaging unit 10-1 after position correction is corrected.
  • the control unit 17 compares the current optical zoom magnification with the zoom magnification threshold stored in the zoom magnification threshold storage unit 41, and the current zoom magnification is equal to or less than the zoom magnification threshold.
  • the size of the first captured image after the angle of view correction is indicated as the third number of pixels, which is the number of pixels after resizing, and the image resizing unit 24 is adjusted to the size of the first captured image after the angle of view correction.
  • the second captured image captured by the imaging unit 10-2 is enlarged (step S34).
  • the image encoding unit 27 encodes the left and right images (for example, compresses them into the JPEG format). That is, the second captured image captured by the imaging unit 10-2 and the first captured image captured by the imaging unit 10-1 after position correction are encoded (step S35).
  • the stereo image format conversion unit 28 converts the left and right images encoded by the image encoding unit 27, that is, the first captured image and the second captured image into a stereo image format (step S36). This process ends when the left and right images are converted to the stereo image format.
  • FIG. 4 is a diagram showing the processing result in each of steps S30 to S32 and step S34 when the specifications of the imaging units 10-1 and 10-2 are determined as follows.
  • Imaging unit 10-1 13 megapixel camera, focal length 27 mm equivalent (35 mm film equivalent), 3 ⁇ optical zoom function, captured image size 9.7 megapixel (aspect ratio 16: 9)
  • Imaging unit 10-2 3 megapixel camera, 35 mm focal length equivalent (35 mm film equivalent), electronic zoom function, 2 megapixel captured image size (aspect ratio 16: 9)
  • the case where the optical zoom magnification of the imaging unit 10-1 at the time of shooting is 1.5 times will be described as an example.
  • the first captured image is H2336 pixels and W4160 pixels.
  • the second captured image is H1080 pixels and W1920 pixels.
  • the first captured image is approximately H1796 pixels and approximately W3200 pixels.
  • the number of pixels becomes about 1 / 1.3.
  • the image size after trimming varies because of variations in the angle of view.
  • the first captured image is trimmed to match the angle of view of the second captured image, but the pixel is higher than the trimming size according to the zoom magnification of the second captured image.
  • the second captured image remains H1080 pixels and W1920 pixels.
  • the first captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels.
  • the second captured image remains H1080 pixels and W1920 pixels.
  • the first captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels.
  • the second captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels, and has the same number of pixels as the first captured image.
  • the meanings of ⁇ and ⁇ are reduced by correcting the shift of the optical axis when the two cameras are arranged in the stereo image generating device, the shift of the angle of view of each camera itself, and the shift of the optical axis. It shows the number of pixels.
  • FIGS. 7A to 7G show the optical axis deviation that occurs when two cameras are arranged in the stereo image generating device 1.
  • FIG. 7A to 7G show the optical axis deviation that occurs when two cameras are arranged in the stereo image generating device 1.
  • step S19 Next, the second photographing process of step S19 when the zoom magnification is larger than the zoom magnification threshold will be described.
  • the case where the optical zoom magnification of the imaging unit 10-1 at the time of shooting is doubled will be described as an example.
  • FIG. 5 is a flowchart for explaining the photographing process 2 in FIG.
  • steps S30 to S33 are the same processes as the photographing process 1 described above.
  • the control unit 17 compares the current optical zoom magnification with the zoom magnification threshold, and the current optical zoom magnification is twice and larger than the zoom magnification threshold 1.8 times, so resizing with respect to the image resizing unit 24
  • the image resizing unit 24 resizes the first captured image to the third number of pixels and resizes the second captured image to the third number of pixels by indicating the third number of pixels, which is the number of subsequent pixels (see FIG. Step S40).
  • the third number of pixels is set so that the ratio of the number of pixels during trimming by the electronic zoom in step S30 and the number of pixels after resizing in step S40 is equal to or less than a certain ratio. decide.
  • the ratio of the number of pixels is set to 6.25 times (2.5 times each in the horizontal and vertical length ratios of the image) or less. The number of pixels of was determined.
  • Horizontal pixel count ratio 2400/960 2.5 ...
  • 2400 The number of pixels in the horizontal direction 1350 of the second captured image in step S40: The number of pixels in the vertical direction of the second captured image in step S40 960: With respect to the second captured image in step S30 Pixels in the horizontal direction of the image to be trimmed by the electronic zoom 540: the number of pixels in the vertical direction of the image to be trimmed by the electronic zoom with respect to the second captured image in step S30
  • the reason for resizing in step S40 so that the ratio of the number of pixels is equal to or less than a certain ratio is that when the number of pixels of the first captured image and the second captured image are trimmed by electronic zoom
  • the ratio to the number of pixels of the image is increased, the difference in resolution between the left and right images of the generated stereo image is increased, resulting in a stereo image which is difficult to view stereoscopically.
  • the resolution is the fineness of the image.
  • steps S35 and S36 the same processing as the photographing processing 1 described above is performed, a stereo image is generated, and the present processing ends.
  • FIG. 6 is a diagram showing the processing result in each of steps S30 to S32 and step S40 when the specifications of the imaging units 10-1 and 10-2 are determined as follows.
  • Imaging unit 10-1 13 megapixel camera, focal length 27 mm equivalent (35 mm film equivalent), 3 ⁇ optical zoom function, captured image size 9.7 megapixel (aspect ratio 16: 9)
  • Imaging unit 10-2 3 megapixel camera, 35 mm focal length equivalent (35 mm film equivalent), electronic zoom function, 2 megapixel captured image size (aspect ratio 16: 9)
  • the first captured image is H2336 pixels and W4160 pixels.
  • the second captured image is H1080 pixels and W1920 pixels.
  • the first captured image is approximately H1796 pixels and approximately W3200 pixels.
  • the number of pixels becomes about 1 / 1.3.
  • the image size after trimming varies because of variations in the angle of view.
  • the first captured image is trimmed to match the angle of view of the second captured image, but the area is wider than the trimming size according to the zoom magnification of the second captured image.
  • step S31 the second captured image remains H1080 pixels and W1920 pixels.
  • step S32 the first captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels.
  • the second captured image remains H1080 pixels and W1920 pixels.
  • step S40 the first captured image is H1530 pixels and W2400 pixels.
  • the second captured image has H1530 pixels and W2400 pixels, and has the same number of pixels as the first captured image.
  • the meanings of ⁇ and ⁇ are reduced by correcting the shift of the optical axis when the two cameras are arranged in the stereo image generating device, the shift of the angle of view of each camera itself, and the shift of the optical axis. It shows the number of pixels.
  • the first imaging unit 10-1 having high optical zoom function and pixels lower than the first imaging unit 10-1 are provided.
  • the second imaging unit 10-2 having the electronic zoom function, the zoom magnification threshold storage unit 41 for storing the zoom magnification threshold, the zoom magnification threshold and the optical zoom magnification at the time of shooting are compared, and the optical zoom magnification is
  • the first captured image and the second captured image are converted to the third pixel number when the magnification is smaller than a predetermined magnification, and the first captured image and the second imaging are extracted when the predetermined magnification is exceeded.
  • FIG. 8 is a block diagram showing a schematic configuration of a stereo image generating apparatus according to Embodiment 2 of the present invention.
  • a stereo image generating apparatus 1B according to the second embodiment includes an imaging unit 10-1B of high pixel having an optical zoom function and an electronic zoom function, and an imaging unit 10 of low pixel having an electronic zoom function.
  • the imaging units 10-1B and 10-2B each include an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and output an imaging signal.
  • an image obtained by imaging by the imaging unit 10-1B is taken as a first captured image
  • an image obtained by imaging by the imaging unit 10-2B is taken as a second captured image.
  • the imaging unit 10-1B has a first angle of view
  • the imaging unit 10-2B has a second image narrower than the first angle of view of the imaging unit 10-1B. It has a horn.
  • the imaging unit 10-1B also has an optical zoom function and an electronic zoom function.
  • the imaging unit 10-2B does not have an optical zoom function, but only an electronic zoom function.
  • the zoom control unit 11 performs zoom control of the imaging units 10-1B and 10-2B.
  • the autofocus control unit 12 performs autofocus control of the imaging units 10-1B and 10-2B.
  • the shutter control unit 13 performs shutter control of the imaging units 10-1B and 10-2B.
  • the exposure control unit 14 performs exposure control of the imaging units 10-1B and 10-2B.
  • the white balance control unit 15 performs white balance control of the imaging units 10-1B and 10-2B.
  • the camera operation unit 16 is for operating the stereo image generating device 1, and a signal at the time of operation such as a zoom magnification designated by the operator is input to the control unit 17.
  • the control unit 17 outputs an operation signal corresponding to the operation in the camera operation unit 16 to the imaging units 10-1B and 10-2B.
  • the camera signal processing unit 18-1 resizes the first captured image captured by the imaging unit 10-1B to the size of the display unit 32 in the preview processing.
  • the camera signal processing unit 18-2 resizes the second captured image captured by the imaging unit 10-2B to the size of the display unit 32 in the preview processing.
  • the camera signal processing unit 18-1 outputs a first captured image (L: left image) of 9.7 megapixels, and the camera signal processing unit 18-2 outputs It is assumed that a second captured image (R: right image) of 2 megapixels is output.
  • the view angle correction unit 19 reduces the view angle of the first captured image captured by the imaging unit 10-1B based on the view angle correction information stored in the view angle information storage unit 20.
  • the field angle is 5.7 megapixels.
  • the angle of view of the second captured image captured by the imaging unit 10-2B may be corrected.
  • the position correction unit 21 performs position correction on the first captured image captured by the imaging unit 10-1B based on the position correction information stored in the position correction information storage unit 22. In this case, at least one of “vertical shift”, “horizontal shift”, “rotational shift”, or “size shift” is performed as the position correction.
  • the position correction may be performed on the second captured image captured by the imaging unit 10-2B. That is, even if the position correction unit 21 performs position correction on either the first captured image captured by the imaging unit 10-1B or the second captured image captured by the imaging unit 10-2B. Good.
  • the color correction unit 23 performs the first color difference between the second captured image captured by the imaging unit 10-2B and the first captured image captured by the imaging unit 10-1B after position correction. Color correction is performed on the captured image and the second captured image (the first captured image or the second captured image).
  • the image resizing unit 24 converts the first captured image captured by the imaging unit 10-1B into a predetermined number of pixels, and converts the second captured image captured by the imaging unit 10-2B, The number of pixels is the same as that of the first captured image.
  • the image resizing unit 24 converts the first captured image captured by the imaging unit 10-1B into a predetermined number of pixels, and the second captured image captured by the imaging unit 10-2B is also a predetermined pixel. Convert to a number. Specifically, the number of pixels of the second captured image is resized in accordance with the number of pixels of the first captured image. Note that the conversion of the first captured image and the conversion of the second captured image performed by the image resizing unit 24 include “equal magnification” in addition to “enlargement” and “reduction”.
  • the super-resolution processing unit 25 When the conversion of the second captured image is enlargement conversion, the super-resolution processing unit 25 performs enlargement processing by super-resolution processing without performing enlargement processing in the image resizing unit 24. It is possible to select whether to perform enlargement processing by the resize unit 24 or enlargement by super resolution processing.
  • the super-resolution processing is processing for enhancing the sharpness of the blurred portion by enlarging the image (that is, processing for achieving high image quality).
  • the image filter unit 26 makes each image of the first captured image and the second captured image Perform averaging processing to blur the periphery. By providing this image filter unit 26, it is possible to reduce the deterioration of the image quality of the stereo image due to the difference in lens distortion between the two imaging units 10-1B and 10-2B.
  • the image encoding unit 27 conversion of the number of pixels is performed by the image resizing unit 24, and the first captured image subjected to averaging processing by the image filter unit 26 and conversion of the number of pixels by the image resizing unit 24 are performed. Furthermore, the second captured image subjected to the averaging process in the image filter unit 26 is encoded (compressed). In this case, for example, compression is performed in JPEG (Joint Photographic Experts Group) format.
  • the stereo image format conversion unit 28 converts the first captured image and the second captured image encoded by the image encoding unit 27 into a stereo image format to generate a stereo image. In this case, for example, the JPEG format is converted to an MPO (Multi-Picture Format) format.
  • the image storage unit 29 has a flash memory (SD memory or the like), and stores the stereo image generated by the stereo image format conversion unit 28.
  • the format conversion unit 30 converts the first captured image and the second captured image converted into the number of pixels matching the display unit 32 by the image resizing unit 24 into a format for displaying on the display unit 32.
  • the display control unit 31 controls the display unit 32 to display the first captured image and the second captured image converted to a format (for example, pixel by pixel) to be displayed on the display unit 32 by the format conversion unit 30. I do.
  • the display unit 32 is, for example, a liquid crystal display.
  • FIGS. 9 and 10 The variables used in FIGS. 9 and 10 are described below.
  • Current zoom factor Z_now User-set zoom factor:
  • Z_next Zoom switching threshold Z_th Digital zoom ratio setting for the image captured by the imaging unit 10-1B: Z_e1 Digital zoom ratio setting for the image captured by the imaging unit 10-2B: Z_e2
  • the user instructs activation of the imaging units 10-1B and 10-2B through the camera operation unit 16 (step S50).
  • the control unit 17 outputs an instruction to activate the imaging units 10-1B and 10-2B to the imaging control unit 40 (step S51).
  • the control unit 17 sets the optical zoom magnification of the imaging unit 10-1B to 1 ⁇ for the imaging control unit 40, and sets the zoom switching threshold Z_th read from the zoom magnification threshold storage unit 41 in the imaging control unit 40 (see Step S52).
  • steps S 54 to S 69 are repeated until the user instructs the end of shooting using the camera operation unit 16.
  • the determination for repeating the process of steps S54 to S69 is performed in steps S53 and S70.
  • the control unit 17 detects whether the user has performed control of the camera by the camera operation unit 16 (step S54). If not detected, the processes of steps S53, S54 and S70 are repeated. If it is detected, the control unit 17 determines whether it is a photographing instruction (step S55).
  • step S56 If it is a photographing instruction, the photographing process is performed (step S56). Details of the imaging process will be described later. If the determination in step S55 is "No", the control unit 17 determines whether a zoom magnification change instruction has been issued (step S57). When it is the zoom magnification change instruction (that is, when the determination in step S57 is "Yes"), the control unit 17 passes the information Z_next of the zoom magnification set by the user to the imaging control unit 40, and the imaging control unit 40 The current zoom magnification Z_now is compared with the zoom switching threshold Z_th (step S58).
  • FIG. 11 is a flow chart for explaining the photographing process in FIG. 9 and FIG.
  • the camera signal processing unit 18-1 resizes the first captured image captured by the imaging unit 10-1B to the image size set by the user, and trims it to the electronic zoom magnification Z_e1.
  • the camera signal processing unit 18-2 resizes the second captured image captured by the imaging unit 10-2B according to the image size set by the user, and performs trimming processing according to the electronic zoom magnification Z_e2 (step S80).
  • the field angle correction unit 19 reads out the field angle correction information from the field angle information holding unit 20, and trims the first captured image captured by the imaging unit 10-1B (step S81).
  • the position correction unit 21 reads the position correction information from the position correction information holding unit 22, and the “vertical shift”, “horizontal shift”, “rotation” with respect to the first captured image captured by the imaging unit 10-1B. At least one of the "deviation” or "magnitude deviation” is corrected (step S82).
  • the color correction unit 23 corrects the difference in color of the left and right images (step S83). That is, the color difference between the second captured image captured by the imaging unit 10-2B and the first captured image captured by the imaging unit 10-1B after position correction is corrected.
  • the image resizing unit 24 enlarges the second captured image captured by the imaging unit 10-2B according to the size of the first captured image after the angle of view correction (step S84).
  • the image encoding unit 27 encodes the left and right images (for example, compresses them into the JPEG format). That is, the second captured image captured by the imaging unit 10-2B and the first captured image captured by the imaging unit 10-1B after position correction are encoded (step S85).
  • the stereo image format conversion unit 28 converts the left and right images encoded by the image encoding unit 27, that is, the first captured image and the second captured image into a stereo image format (step S86). This process ends when the left and right images are converted to the stereo image format.
  • FIG. 12 is a diagram showing processing results in each step of steps S80 to S82 and step S84 when the specifications of the imaging units 10-1B and 10-2B are determined as follows.
  • Imaging unit 10-1B 13 mega pixel camera, focal length 27 mm equivalent (35 mm film equivalent), 3 ⁇ optical zoom function, captured image size 9.7 mega pixel (aspect ratio 16: 9)
  • Imaging unit 10-2B 3 megapixel camera, 35 mm focal length equivalent (35 mm film equivalent), electronic zoom function, 2 megapixel captured image size (aspect ratio 16: 9)
  • FIG. 12 illustrates the case where the zoom magnification set by the user at the time of shooting is 1.5.
  • the first captured image is H2336 pixels and W4160 pixels.
  • the second captured image is H1080 pixels and W1920 pixels. Since the zoom magnification is 1.5 times, it is necessary to perform electronic zoom on the imaging unit 10-2B side. Of the captured image on the imaging unit 10-2B side, H 720 pixels and W 1280 pixels in the central part of the image are trimmed and resized to H 1080 pixels and W 1920 pixels.
  • the first captured image is approximately H1796 pixels and approximately W3200 pixels.
  • the angle of view of the focal lengths of 35 mm and 27 mm due to the difference in the angle of view of the focal lengths of 35 mm and 27 mm, it is possible to shoot at a wide angle of about 1.3 times in both the vertical and horizontal directions when shooting with a 27 mm camera. Therefore, when the camera image of 27 mm is trimmed by the angle of view correction unit 19, the number of pixels becomes about 1 / 1.3. However, even with a camera with the same number of pixels, the image size after trimming varies because of variations in the angle of view.
  • the first captured image is trimmed to match the angle of view of the second captured image, but the pixel is higher than the trimming size according to the zoom magnification of the second captured image.
  • step S81 the second captured image remains at H1080 pixels and W1920 pixels.
  • step S82 the first captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels.
  • the second captured image remains H1080 pixels and W1920 pixels.
  • step S84 the first captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels.
  • the second captured image is H (1796- ⁇ ) pixels and W (3200- ⁇ ) pixels, and has the same number of pixels as the first captured image.
  • the meanings of ⁇ and ⁇ are reduced by correcting the shift of the optical axis when the two cameras are arranged in the stereo image generating device, the shift of the angle of view of each camera itself, and the shift of the optical axis. It shows the number of pixels.
  • FIGS. 7A to 7G described above show the optical axis deviation that occurs when two cameras are arranged in the stereo image generating device 1B.
  • FIG. 13 is a diagram showing processing results in each step of steps S80 to S82 and step S84 when the specifications of the imaging units 10-1B and 10-2B are determined as follows.
  • Imaging unit 10-1B 13 mega pixel camera, focal length 27 mm equivalent (35 mm film equivalent), 3 ⁇ optical zoom function, captured image size 9.7 mega pixel (aspect ratio 16: 9)
  • Imaging unit 10-2B 3 megapixel camera, 35 mm focal length equivalent (35 mm film equivalent), electronic zoom function, 2 megapixel captured image size (aspect ratio 16: 9)
  • the first captured image is H2336 pixels and W4160 pixels.
  • the second captured image is H1080 pixels and W1920 pixels.
  • the zoom magnification threshold is 1.5 times and the zoom magnification specified by the user is 2 times
  • the zoom operation by the optical zoom is performed up to 1.5 times, and the zoom operation from there is the electronic zoom
  • the following is performed.
  • the electronic zoom operation is performed by trimming an image of H1557 pixels and W2773 pixels with respect to the image center of the first captured image.
  • the trimmed image of H1557 pixels and W2773 pixels may be enlarged to H2336 pixels and W4160 pixels.
  • the case of not enlarging will be described.
  • an image of H540 pixels and W960 pixels is trimmed with respect to the image center of the second captured image, and this is H1080 pixels, Resize to W 1920 pixels.
  • the first captured image is approximately H1196 pixels and approximately W2130 pixels.
  • the first captured image is trimmed to match the angle of view of the second captured image, but the area is wider than the trimming size according to the zoom magnification of the second captured image.
  • step S81 the second captured image remains at H1080 pixels and W1920 pixels.
  • step S82 the first captured image is H (1196- ⁇ ) pixels and W (2130- ⁇ ) pixels.
  • the second captured image remains H1080 pixels and W1920 pixels.
  • step S84 the first captured image is H (1196- ⁇ ) pixels and W (2130- ⁇ ) pixels.
  • the second captured image is H (1196- ⁇ ) pixels and W (2130- ⁇ ) pixels, and has the same number of pixels as the first captured image.
  • the meanings of ⁇ and ⁇ are reduced by correcting the shift of the optical axis when the two cameras are arranged in the stereo image generating device, the shift of the angle of view of each camera itself, and the shift of the optical axis. It shows the number of pixels.
  • the first imaging unit 10-1B of high pixel having the optical zoom function and the electronic zoom function and the first imaging unit 10-1B.
  • An imaging control unit 40 that controls the first imaging unit 10-1B and the second imaging unit 10-2B to perform electronic zoom operations, a first captured image and a second captured image with a predetermined number of pixels Image resize to convert to 24, an image encoding unit 27 encoding the first captured image and the second captured image converted by the image resizing unit 24, and a first captured image and a second captured image encoded by the image encoding unit 27
  • the stereo image format conversion unit 28 that generates a stereo image by converting the image data into the stereo image format, so that high-pixel stereo images can be captured without using two high-pixel imaging means.
  • the imaging unit 10-1B changes from optical zoom to electronic zoom By switching, it is possible to generate a high-pixel stereo image that is easy to view stereoscopically.
  • the resolution is the fineness of the image.
  • the upper limit magnification of the optical zoom function here is the maximum magnification on the specifications of the optical module to be used.
  • the magnification is in a state where the zoom magnification is moved to the limit in the direction in which the zoom magnification is increased.
  • the present invention can capture a high-pixel stereo image without using two high-pixel imaging means, and also has a difference in resolution between the first and second captured images when zooming. It has an effect that it is possible to generate a stereo image easy to view stereoscopically, within a fixed value, and it is possible to apply to a compound eye camera or the like for capturing a stereo image that captures a stereo image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)

Abstract

Selon l'invention, une première unité de capture d'image (10-1) comprend une fonction de zoom optique et délivre une première image capturée à grand nombre de pixels. Une seconde unité de capture d'image (10-2) comprend une fonction de zoom électronique et délivre une seconde image capturée qui comporte moins de pixels que la première unité de capture d'image (10-1). Lorsqu'un grossissement de zoom est inférieur ou égal à un grossissement prescrit, une unité de redimensionnement d'image (24) convertit les première et seconde images capturées en un troisième nombre de pixels, et lorsque le grossissement de zoom dépasse le grossissement prescrit, l'unité de redimensionnement d'image (24) convertit les première et seconde images capturées en un quatrième nombre de pixels. Une unité de codage d'image (27) code chacune des première et seconde images capturées respectives qui sont converties par l'unité de redimensionnement d'image (24). Une unité de conversion en format d'image stéréo (28) convertit chacune des première et seconde images capturées respectives qui ont été codées par l'unité de codage d'image (27) en un format d'image stéréo et génère une image stéréo.
PCT/JP2012/002602 2011-04-14 2012-04-13 Dispositif de génération d'image stéréo et procédé de génération d'image stéréo Ceased WO2012140919A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2011090396A JP2014132701A (ja) 2011-04-14 2011-04-14 ステレオ画像生成装置およびステレオ画像生成方法
JP2011090395A JP2014132700A (ja) 2011-04-14 2011-04-14 ステレオ画像生成装置およびステレオ画像生成方法
JP2011-090395 2011-04-14
JP2011-090396 2011-04-14

Publications (1)

Publication Number Publication Date
WO2012140919A1 true WO2012140919A1 (fr) 2012-10-18

Family

ID=47009108

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/002602 Ceased WO2012140919A1 (fr) 2011-04-14 2012-04-13 Dispositif de génération d'image stéréo et procédé de génération d'image stéréo

Country Status (1)

Country Link
WO (1) WO2012140919A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107636692A (zh) * 2015-07-07 2018-01-26 三星电子株式会社 图像捕获设备及操作其的方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0937302A (ja) * 1995-07-18 1997-02-07 Olympus Optical Co Ltd 立体撮像装置
JP2000102040A (ja) * 1998-09-28 2000-04-07 Olympus Optical Co Ltd 電子ステレオカメラ
JP2005020606A (ja) * 2003-06-27 2005-01-20 Sharp Corp デジタルカメラ
JP2005045328A (ja) * 2003-07-22 2005-02-17 Sharp Corp ３次元画像撮像装置
JP2005210217A (ja) * 2004-01-20 2005-08-04 Olympus Corp ステレオカメラ
JP2006251683A (ja) * 2005-03-14 2006-09-21 Fujinon Corp 立体画像撮影システム
JP2010154310A (ja) * 2008-12-25 2010-07-08 Fujifilm Corp 複眼カメラ及び撮影方法
JP2010252186A (ja) * 2009-04-17 2010-11-04 Nec Casio Mobile Communications Ltd 端末装置及びプログラム

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0937302A (ja) * 1995-07-18 1997-02-07 Olympus Optical Co Ltd 立体撮像装置
JP2000102040A (ja) * 1998-09-28 2000-04-07 Olympus Optical Co Ltd 電子ステレオカメラ
JP2005020606A (ja) * 2003-06-27 2005-01-20 Sharp Corp デジタルカメラ
JP2005045328A (ja) * 2003-07-22 2005-02-17 Sharp Corp ３次元画像撮像装置
JP2005210217A (ja) * 2004-01-20 2005-08-04 Olympus Corp ステレオカメラ
JP2006251683A (ja) * 2005-03-14 2006-09-21 Fujinon Corp 立体画像撮影システム
JP2010154310A (ja) * 2008-12-25 2010-07-08 Fujifilm Corp 複眼カメラ及び撮影方法
JP2010252186A (ja) * 2009-04-17 2010-11-04 Nec Casio Mobile Communications Ltd 端末装置及びプログラム

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107636692A (zh) * 2015-07-07 2018-01-26 三星电子株式会社 图像捕获设备及操作其的方法
EP3320676A4 (fr) * 2015-07-07 2018-05-16 Samsung Electronics Co., Ltd. Appareil de capture d'image et son procédé de fonctionnement
US10410061B2 (en) 2015-07-07 2019-09-10 Samsung Electronics Co., Ltd. Image capturing apparatus and method of operating the same
CN107636692B (zh) * 2015-07-07 2021-12-28 三星电子株式会社 图像捕获设备及操作其的方法

Similar Documents

Publication Publication Date Title
JP5192096B2 (ja) 立体撮像装置
KR101391042B1 (ko) 광각 화상을 생성 가능한 화상 처리 장치
JP5722975B2 (ja) 撮像装置、撮像装置用シェーディング補正方法及び撮像装置用プログラム
JP5243666B2 (ja) 撮像装置、撮像装置本体およびシェーディング補正方法
US9241109B2 (en) Image capturing apparatus, control method, and recording medium for moving image generation
JP4528235B2 (ja) デジタルカメラ
JP5665013B2 (ja) 画像処理装置、画像処理方法、及びプログラム
JP2004354581A (ja) 撮像装置
CN108769497A (zh) 双孔径变焦数字摄影机
JP5216640B2 (ja) 撮像装置および方法
JP7289055B2 (ja) 撮像装置
JP6539075B2 (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
US7593635B2 (en) Digital imaging apparatus capable of creating panorama image and a creating method thereof
JP5378283B2 (ja) 撮像装置およびその制御方法
JP6706167B2 (ja) 撮像装置、画像合成方法、およびプログラム
JP2004297332A (ja) 撮像装置
JP5510105B2 (ja) ディジタルカメラ
WO2012140919A1 (fr) Dispositif de génération d'image stéréo et procédé de génération d'image stéréo
JP5641352B2 (ja) 画像処理装置、画像処理方法、及びプログラム
JP7769519B2 (ja) 画像処理装置及び方法、及び撮像装置
JP5664440B2 (ja) 撮像装置
WO2014136703A1 (fr) Dispositif de capture d'image et procédé d'affichage d'image
JP2019106725A (ja) 撮像装置
JP2014132701A (ja) ステレオ画像生成装置およびステレオ画像生成方法
JP2014132700A (ja) ステレオ画像生成装置およびステレオ画像生成方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12771421

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12771421

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP