WO2018018927A1 - 多帧图像合成方法和装置 - Google Patents

多帧图像合成方法和装置 Download PDF

Info

Publication number
WO2018018927A1
WO2018018927A1 PCT/CN2017/079381 CN2017079381W WO2018018927A1 WO 2018018927 A1 WO2018018927 A1 WO 2018018927A1 CN 2017079381 W CN2017079381 W CN 2017079381W WO 2018018927 A1 WO2018018927 A1 WO 2018018927A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame image
pixel
current
image sensor
exposure time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/079381
Other languages
English (en)
French (fr)
Inventor
吴磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to US16/311,722 priority Critical patent/US10728465B2/en
Priority to EP17833233.4A priority patent/EP3493521B1/en
Publication of WO2018018927A1 publication Critical patent/WO2018018927A1/zh
Anticipated expiration legal-status Critical
Priority to US16/436,664 priority patent/US10686997B2/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/684—Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time
    • H04N23/6845—Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time by combination of a plurality of images sequentially taken
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/685—Vibration or motion blur correction performed by mechanical compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/685—Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687—Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/48—Increasing resolution by shifting the sensor relative to the scene
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20216—Image averaging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention relates to the field of mobile terminal technologies, and in particular, to a multi-frame image synthesis method and apparatus.
  • multi-frame shooting synthesis is a more complicated shooting technique compared to single-frame shooting. It is used in panoramic shooting, HDR synthesis, and long exposure electronic aperture.
  • the difficulty of these shooting techniques is how to perform image synthesis.
  • handheld mobile devices for shooting are prone to jitter in mobile devices, resulting in pixel misalignment during image synthesis.
  • the user in order to improve the quality of the synthesized image, the user can fix the mobile device through a fixed device such as a tripod.
  • the fixed device is carried at any time, which affects the user's shooting convenience and the user's shooting experience.
  • the object of the present invention is to solve at least one of the above technical problems to some extent.
  • the first object of the present invention is to provide a multi-frame image synthesis method, which reduces the jitter during shooting by controlling the movement of the image sensor by MEMS, thereby improving the quality of each frame image captured. Thereby, the imaging quality of the photos after multi-frame image synthesis is improved.
  • a second object of the present invention is to provide a multi-frame image synthesizing apparatus.
  • a third object of the present invention is to provide a mobile terminal.
  • a fourth object of the present invention is to provide a mobile terminal.
  • a fifth object of the present invention is to provide a non-volatile computer storage medium.
  • a multi-frame image synthesis method includes: acquiring a first exposure time t required for current photographing, and dividing the first exposure time t into N shares, wherein, N 4 is the power of M, Wherein, M is a positive integer; the MEMS controlled image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to expose at a second exposure time t/N after each preset pixel is moved.
  • N 4 is the power of M, Wherein, M is a positive integer
  • the MEMS controlled image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to expose at a second exposure time t/N after each preset pixel is moved.
  • synthesizing the N-frame image to obtain a synthesized photo.
  • the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then controlled by MEMS.
  • the image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image and perform N frame images.
  • Synthetic processing to obtain a synthesized photograph thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of each frame image captured, thereby improving the multi-frame image synthesis.
  • the image quality of the photo is a synthetic processing to obtain a synthesized photograph, thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of each frame image captured, thereby improving the multi-frame image synthesis.
  • the synthesizing the image of the N frames to obtain a synthesized photo includes:
  • the content of the N frame image for the current pixel is compared, and pixel synthesis is performed according to the comparison result.
  • the comparing the content of the N-frame image for the current pixel, and performing pixel synthesis according to the comparison result includes:
  • the method further comprises:
  • the degree of mismatch between the contents of the N current pixels exceeds a preset threshold, determining a first current pixel that has the largest difference from the other current pixels among the N current pixels, and replacing the current pixel by the other current pixels
  • the first current pixel is superimposed according to the other current pixel and the replaced first current pixel.
  • the preset pixel is 1 pixel.
  • the N is pre-set according to pixel requirements required for current photographing.
  • the synthesizing the N frames of images to obtain a synthesized photo comprises: synthesizing the N frames of images by using a principle of multi-frame image synthesis to obtain a synthesized image. photo.
  • a multi-frame image synthesizing apparatus includes: an acquiring module, configured to acquire a first exposure time t required for current photographing, and divide the first exposure time t into N Wherein, N is a power of M of 4, wherein M is a positive integer; a processing module for controlling the image sensor to move clockwise or counterclockwise according to a preset pixel step by the MEMS, and controlling the image sensor at each After the preset pixel is moved, the second exposure time t/N is performed to obtain an N frame image; and the synthesis module is configured to perform the synthesis processing on the N frame image. To get a synthesized photo.
  • the multi-frame image synthesizing apparatus of the embodiment of the present invention when multi-frame shooting image synthesis is required, the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then, controlled by MEMS.
  • the image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image and perform N frame images.
  • Synthetic processing to obtain a synthesized photograph thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of each frame image captured, thereby improving the multi-frame image synthesis.
  • the image quality of the photo when multi-frame shooting image synthesis is required, the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then, controlled by MEMS.
  • the image sensor moves clockwise or counterclockwise according
  • the synthesizing module comprises:
  • An aligning unit configured to determine an alignment rule of the N frame image according to a movement rule of the MEMS control image sensor, and align the N frame image according to an alignment rule
  • a synthesizing unit configured to compare content of the N-frame image for the current pixel for each pixel in the aligned N-frame image, and perform pixel synthesis according to the comparison result.
  • the synthesizing unit is specifically configured to:
  • the synthesizing module further includes:
  • a processing unit configured to determine, when the matching degree unevenness between the contents of the N current pixels exceeds a preset threshold, determine the first current pixel that has the largest difference from the other current pixels among the N current pixels, and pass the other The current pixel replaces the first current pixel and is superimposed according to the other current pixel and the replaced first current pixel.
  • the preset pixel is 1 pixel.
  • the N is pre-set according to pixel requirements required for current photographing.
  • the synthesizing module is specifically configured to: synthesize the N frames of images by using a principle of multi-frame image synthesis to obtain a synthesized photo.
  • a mobile terminal includes the multi-frame image synthesizing apparatus of the second aspect of the present invention.
  • the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then the image sensor is controlled by the MEMS.
  • the pixel step is moved clockwise or counterclockwise, and the image sensor is controlled to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image, and synthesize the N frame image to The synthesized photograph is obtained, thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of the image taken per frame, thereby improving the image quality of the photograph after the multi-frame image synthesis.
  • the mobile terminal includes a housing and a a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, the processor and the memory are disposed on the circuit board; Means for powering respective circuits or devices of the mobile terminal; the memory for storing executable program code; the processor running with the executable program by reading executable program code stored in the memory a program corresponding to the code for performing the following steps: obtaining a first exposure time t required for the current photographing, and dividing the first exposure time t into N parts, wherein N is a power of M of 4, wherein M is a positive integer; the MEMS controlled image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel, Obtaining an N frame image; synthesizing
  • the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then the image sensor is controlled by the MEMS.
  • the pixel step is moved clockwise or counterclockwise, and the image sensor is controlled to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image, and synthesize the N frame image to The synthesized photograph is obtained, thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of the image taken per frame, thereby improving the image quality of the photograph after the multi-frame image synthesis.
  • a fifth aspect of the present invention provides a nonvolatile computer storage medium storing one or more programs, when the one or more programs are executed by one device, causing the device to execute according to the present
  • the first aspect of the invention implements the multi-frame image synthesis method provided.
  • FIG. 1 is a flow chart of a multi-frame image synthesis method according to an embodiment of the present invention
  • FIG. 2 is a diagram showing an example of movement of a MEMS-controlled image sensor
  • FIG. 3 is a flow chart of a multi-frame image synthesis method according to another embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a multi-frame image synthesizing apparatus according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a multi-frame image synthesizing apparatus according to another embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a mobile terminal 60 according to an embodiment of the present invention.
  • MEMS micro electro mechanical system
  • the imaging module includes a lens, a MEMS, an image sensor (Sensor), etc., and the MEMS can drive the image sensor to move in different directions in the same plane.
  • FIG. 1 is a flow chart of a multi-frame image synthesis method in accordance with one embodiment of the present invention. It should be noted that the multi-frame image synthesis method can be applied to a mobile terminal having an imaging module, where the mobile terminal can be, for example, a hardware device having various operating systems, such as a mobile phone or a tablet computer.
  • the multi-frame image synthesis method includes the following steps:
  • S11 Acquire a first exposure time t required for the current photographing, and divide the first exposure time t into N shares.
  • N is a power of M of 4, where M is a positive integer.
  • N is a value set in advance according to the pixel requirement.
  • the pixel of the camera in the smart phone is 4 million pixels, and when it is necessary to provide a 16 million pixel, at this time, N is 4, corresponding to M is 1.
  • N can be set according to specific application scenarios. For example, N can be 16.
  • the MEMS controlled image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to obtain an N frame image.
  • the MEMS is movable.
  • the MEMS is connected to the driving circuit and is driven by the driving voltage outputted by the driving circuit.
  • the preset pixel is preset.
  • the preset pixel may be 1 pixel, that is, the MEMS controls the image sensor to move clockwise or counterclockwise in steps of 1 pixel.
  • the number of times the MEMS controls the image sensor to move is related to N.
  • the movement of the MEMS control image sensor will be described below with reference to FIG. 2 taking a pixel as an example. It is assumed that N is 4, that is, the first exposure time t is divided by 4, and the corresponding second exposure time is t/4.
  • the MEMS controls the image sensor initial position 1 the image sensor performs one exposure with a second exposure time t/4 to obtain a first frame image.
  • the MEMS control image sensor is moved one pixel to the right to bring the image sensor to position 2, at which time the image sensor performs another exposure with the second exposure time t/4 to obtain a second frame image.
  • the MEMS control image sensor moves down one pixel from position 2 to place the image sensor in position 3, at which time the image sensor performs another exposure at a second exposure time t/4 to obtain a third frame image. Then, the MEMS control image sensor moves from position 3 to the left One pixel, so that the image sensor is in position 4, the image sensor performs another exposure at the second exposure time t/4 to obtain a fourth frame image.
  • the MEMS control image sensor moves up one pixel from position 4, the image sensor will be in the initial position 1 at this time.
  • the multi-frame image can be synthesized by the principle of multi-frame image synthesis, so as to provide the user with the synthesized high-quality photos to meet the user's quality requirements for the photo.
  • the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then controlled by MEMS.
  • the image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image and perform N frame images.
  • Synthetic processing to obtain a synthesized photograph thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of each frame image captured, thereby improving the multi-frame image synthesis.
  • the image quality of the photo is a synthetic processing to obtain a synthesized photograph, thereby controlling the movement of the image sensor by the MEMS, thereby reducing the jitter during the shooting, thereby improving the quality of each frame image captured, thereby improving the multi-frame image synthesis.
  • FIG. 3 is a flow chart of a multi-frame image synthesis method in accordance with another embodiment of the present invention. It should be noted that the multi-frame image synthesis method can be applied to a mobile terminal having an imaging module, where the mobile terminal can be, for example, a hardware device having various operating systems, such as a mobile phone or a tablet computer.
  • the multi-frame image synthesis method includes the following steps:
  • N is a power of M of 4, where M is a positive integer.
  • N is a value set in advance according to the pixel requirement.
  • the pixel of the camera in the smart phone is 4 million pixels, and when it is necessary to provide a 16 million pixel, at this time, N is 4, corresponding to M is 1.
  • N can be set according to specific application scenarios. For example, N can be 16.
  • the MEMS controlled image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to obtain an N frame image.
  • the MEMS is movable.
  • the MEMS is connected to the driving circuit and is driven by the driving voltage outputted by the driving circuit.
  • the preset pixel is preset.
  • the preset pixel may be 1 pixel, that is, the MEMS controls the image sensor to move clockwise or counterclockwise in steps of 1 pixel.
  • the number of times the MEMS controls the image sensor to move is related to N.
  • the MEMS control image sensor movement will be described below with reference to FIG. 2, assuming that N is 4, that is, the first exposure time t is divided by 4, and the corresponding second exposure time is t/4.
  • N 4
  • the MEMS controls the image sensor initial position 1 the image sensor performs one exposure with a second exposure time t/4 to obtain a first frame image.
  • MEMS controls image sensing The device moves one pixel to the right to place the image sensor in position 2. At this time, the image sensor performs another exposure with the second exposure time t/4 to obtain a second frame image.
  • the MEMS control image sensor moves down one pixel from position 2 to place the image sensor in position 3, at which time the image sensor performs another exposure at a second exposure time t/4 to obtain a third frame image.
  • the MEMS control image sensor is moved one pixel to the left from position 3 so that the image sensor is at position 4, and the image sensor performs another exposure at the second exposure time t/4 to obtain a fourth frame image.
  • the MEMS control image sensor moves up one pixel from position 4, the image sensor will be in the initial position 1 at this time.
  • the movement rule of the MEMS control image sensor determines an alignment rule of the N frame image.
  • the first frame image, the second frame image, and the third frame image are obtained.
  • the first frame image is shifted to the left by one pixel, so that the alignment of the first frame image and the second frame image is achieved;
  • the third frame image is moved up by one pixel and moved one pixel to the left to achieve alignment of the first frame image and the third frame image;
  • the fourth frame image is moved up by one pixel to achieve alignment of the first frame image and the fourth frame image.
  • the N current pixels are Make a superposition.
  • the contents of the N current pixels are compared, and when it is determined that the content difference of the N current pixels is not large, the N current pixels are directly superimposed to One pixel is synthesized by N current pixels.
  • the present invention if it is determined that the degree of mismatch between the contents of the N current pixels exceeds a preset threshold, determining a first current pixel that has the largest difference from the other current pixels among the N current pixels. And replacing the first current pixel with other current pixels, and superimposing according to the other current pixel and the replaced first current pixel. Thereby, the influence of the content difference in the same pixel position in the same process on the image quality of the synthesized pixel can be removed.
  • the pixels are replaced with other pixels, and superimposed by other pixels and the replaced pixels.
  • the embodiment determines the alignment rule of the N frames by the movement rule of the MEMS control image sensor, and aligns the N frames according to the alignment rule, and Pixel synthesis is performed based on the aligned N frame images to generate a synthesized photo.
  • the calculation amount in the N-frame image synthesis process is greatly reduced, and the time required for synthesizing the N-frame image is reduced, thereby improving the efficiency of N-frame image synthesis.
  • the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then controlled by MEMS.
  • the image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each preset pixel is moved to acquire an N frame image, and the image sensor is controlled according to the MEMS.
  • the moving rule determines the alignment rule of the N frame image, and aligns the N frames of images according to the alignment rule, compares the contents of the N frames of images for the current pixel for each pixel in the aligned N frames of images, and Pixel synthesis is performed based on the comparison result to obtain a synthesized photograph.
  • the movement of the image sensor is controlled by the MEMS, the jitter during the shooting is reduced, and when the image is synthesized by the N-frame image, the alignment rule of the N-frame image can be quickly determined according to the movement rule of the MEMS-controlled image sensor, and the reduction rule is reduced.
  • the time required to synthesize the N-frame image improves the efficiency of N-frame image synthesis and improves the image quality of the multi-frame image synthesized photo.
  • the present invention also proposes a multi-frame image synthesizing apparatus according to an embodiment of the present invention.
  • FIG. 4 is a block diagram showing the structure of a multi-frame image synthesizing apparatus according to an embodiment of the present invention.
  • the multi-frame image synthesizing apparatus of the embodiment of the present invention may include an obtaining module 110, a processing module 120, and a synthesizing module 130, where:
  • the obtaining module 110 is configured to acquire a first exposure time t required for the current photographing, and divide the first exposure time t into N shares.
  • N is a power of M of 4, where M is a positive integer.
  • the processing module 120 is configured to move the image sensor clockwise or counterclockwise according to a preset pixel step by the MEMS, and control the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to obtain N. Frame image.
  • the preset pixel is preset according to the scene requirement.
  • the preset pixel may be 1 pixel.
  • the synthesizing module 130 is configured to synthesize N frames of images to obtain a synthesized photo.
  • the multi-frame image synthesizing apparatus of the embodiment of the present invention when multi-frame shooting image synthesis is required, the first exposure time t required for the current photographing is taken, and the first exposure time t is divided into N parts, and then, controlled by MEMS.
  • the image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to move the preset pixel each time
  • the second exposure time t/N is exposed to acquire an N-frame image, and the N-frame image is synthesized to obtain a synthesized photo, thereby controlling the movement of the image sensor by the MEMS, thereby reducing jitter during shooting.
  • the quality of each frame of the image captured can be improved, thereby improving the imaging quality of the photo after the multi-frame image synthesis.
  • the synthesizing module 130 may include an aligning unit 131 and a synthesizing unit 132, where:
  • the aligning unit 131 is configured to determine an alignment rule of the N-frame image according to the movement rule of the MEMS-controlled image sensor, and align the N-frame image according to the alignment rule.
  • the synthesizing unit 132 is configured to compare the content of the N-frame image for the current pixel for each pixel in the aligned N-frame image, and perform pixel synthesis according to the comparison result.
  • the synthesizing unit 132 is specifically configured to: determine whether the matching degree between the contents of the N current pixels exceeds a preset threshold, and if both exceed the first preset threshold, the N current pixels are Make a superposition.
  • the synthesizing module 130 may further include a processing unit 133, where:
  • the processing unit 133 is configured to determine, when the matching degree unevenness between the contents of the N current pixels exceeds a preset threshold, the first current pixel that has the largest difference from the other current pixels among the N current pixels, and pass the other The current pixel replaces the first current pixel and is superimposed according to the other current pixel and the replaced first current pixel.
  • the embodiment determines the alignment rule of the N frames by the movement rule of the MEMS control image sensor, and aligns the N frames according to the alignment rule, and Pixel synthesis is performed based on the aligned N frame images to generate a synthesized photo.
  • the calculation amount in the N-frame image synthesis process is greatly reduced, and the time required for synthesizing the N-frame image is reduced, thereby improving the efficiency of N-frame image synthesis.
  • the present invention also proposes a mobile terminal.
  • a mobile terminal comprising the multi-frame image synthesizing device of the second aspect of the present invention.
  • the image sensor is controlled by the MEMS.
  • the preset pixel step moves clockwise or counterclockwise, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image and synthesize the N frame image.
  • the jitter during the shooting process is reduced, thereby improving the quality of each frame image captured, thereby improving the imaging of the multi-frame image synthesized image. quality.
  • the present invention also proposes a mobile terminal.
  • FIG. 6 is a schematic structural diagram of a mobile terminal 60 according to an embodiment of the present invention.
  • the mobile terminal 60 includes a housing 601, a processor 602, a memory 603, a circuit board 604, and a power supply circuit 605, wherein the circuit board 604 is disposed inside the space enclosed by the housing 601, and the processor 602 and The memory 603 is disposed on the circuit board 604; the power supply circuit 605 is configured to supply power to the various circuits or devices of the mobile terminal 60; the memory 603 is used to store executable program code; and the processor 602 reads the executable program stored in the memory 603 by reading The code runs a program corresponding to the executable program code for performing the following steps:
  • N is a power of M of 4, where M is a positive integer.
  • N is a value set in advance according to the pixel requirement.
  • the pixel of the camera in the smart phone is 4 million pixels, and when it is necessary to provide a 16 million pixel, at this time, N is 4, corresponding to M is 1.
  • N can be set according to specific application scenarios. For example, N can be 16.
  • the MEMS controlled image sensor moves clockwise or counterclockwise according to a preset pixel step, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to obtain an N frame image.
  • the MEMS is movable.
  • the MEMS is connected to the driving circuit and is driven by the driving voltage outputted by the driving circuit.
  • the preset pixel is preset.
  • the preset pixel may be 1 pixel, that is, the MEMS controls the image sensor to move clockwise or counterclockwise in steps of 1 pixel.
  • the number of times the MEMS controls the image sensor to move is related to N.
  • the MEMS control image sensor movement will be described below with reference to FIG. 2, assuming that N is 4, that is, the first exposure time t is divided by 4, and the corresponding second exposure time is t/4.
  • N 4
  • the MEMS control image sensor When the MEMS controls the image sensor initial position 1, the image sensor performs one exposure with a second exposure time t/4 to obtain a first frame image. Then, the MEMS control image sensor is moved one pixel to the right to bring the image sensor to position 2, at which time the image sensor performs another exposure with the second exposure time t/4 to obtain a second frame image. Thereafter, the MEMS control image sensor moves down one pixel from position 2 to place the image sensor in position 3, at which time the image sensor performs another exposure at a second exposure time t/4 to obtain a third frame image.
  • the MEMS control image sensor is moved one pixel to the left from position 3 so that the image sensor is at position 4, and the image sensor performs another exposure at the second exposure time t/4 to obtain a fourth frame image.
  • the MEMS control image sensor moves up one pixel from position 4, the image sensor will be in the initial position 1 at this time.
  • the multi-frame image can be synthesized by the principle of multi-frame image synthesis, so as to provide the user with the synthesized high-quality photos to meet the user's quality requirements for the photo.
  • the image sensor is controlled by the MEMS.
  • the pixel step moves clockwise or counterclockwise, and controls the image sensor to perform exposure at a second exposure time t/N after each movement of the preset pixel to acquire an N frame image, and synthesize the N frame image to obtain The synthesized photograph, thereby controlling the movement of the image sensor by the MEMS, reduces the jitter during the shooting, and further improves the quality of each frame image captured, thereby improving the image quality of the multi-frame image synthesized photograph.
  • first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
  • features defining “first” or “second” may include at least one of the features, either explicitly or implicitly.
  • the meaning of "a plurality” is at least two, such as two, three, etc., unless specifically defined otherwise.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable Method to process the program electronically and then to Stored in computer memory.
  • portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
  • the above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

本发明公开了一种多帧图像合成方法和装置，该方法包括：获取当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，其中，N为4的M次幂，其中，M为正整数；通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；对N帧图像进行合成处理，以得到合成后的照片。本发明实施例提供的多帧图像合成方法，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。

Description

多帧图像合成方法和装置
相关申请的交叉引用
本申请要求广东欧珀移动通信有限公司于2016年07月29日提交的、发明名称为“多帧图像合成方法和装置”的、中国专利申请号“201610616329.X”的优先权。
技术领域
本发明涉及移动终端技术领域，尤其涉及一种多帧图像合成方法和装置。
背景技术
随着移动拍照设备的普及，现有技术中已经出现了很多不同的拍摄技术。其中，多帧拍摄合成是一种相较于单帧拍摄更为复杂的拍摄技术，其在全景拍摄、HDR合成、长曝光电子光圈中均有应用，这些拍摄技术的难点是如何进行图像合成。
一般而言，手持移动设备进行拍摄，容易出现移动设备抖动，从而造成图像合成时出现像素错位。相关技术中，为了提高所合成的图像质量，用户可通过固定设备例如三角架对移动设备进行固定，然而，随时携带固定设备，影响了用户拍摄便利性和用户的拍摄体验。
因此，如何提高移动设备多帧拍摄图像合成时的像素偏差，就成为一个需要解决的技术问题。
发明内容
本发明的目的旨在至少在一定程度上解决上述的技术问题之一。
为此，本发明的第一个目的在于提出一种多帧图像合成方法，该方法通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
本发明的第二个目的在于提出一种多帧图像合成装置。
本发明的第三个目的在于提出一种移动终端。
本发明的第四个目的在于提出一种移动终端。
本发明的第五个目的在于提出一种非易失性计算机存储介质。
为了实现上述目的，本发明第一方面实施例的多帧图像合成方法，包括：获取当前拍照所需的第一曝光时间t，并将所述第一曝光时间t分为N份，其中，N为4的M次幂， 其中，M为正整数；通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制所述图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；对所述N帧图像进行合成处理，以得到合成后的照片。
根据本发明实施例的多帧图像合成方法，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
根据本发明的一个实施例，所述对所述N帧图像进行合成处理，以得到合成后的照片，包括：
根据所述MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对所述N帧图像进行对齐；
针对对齐后的N帧图像中的每个像素，将所述N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成。
根据本发明的一个实施例，所述将所述N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成，包括：
判断N个当前像素的内容之间的匹配度是否均超过预设阈值，若均超过第一预设阈值，则将N个当前像素进行叠加。
根据本发明的一个实施例，所述方法还包括：
若判断出N个当前像素的内容之间的匹配度不均是超过预设阈值，则确定出N个当前像素中与其他当前像素差异最大的第一当前像素，并通过其他当前像素替换所述第一当前像素，并根据其他当前像素和替换后的第一当前像素进行叠加。
根据本发明的一个实施例，所述预设像素为1个像素。
根据本发明的一个实施例，所述N是根据当前拍照所需的像素要求预先设置的。
根据本发明的一个实施例，所述对所述N帧图像进行合成处理，以得到合成后的照片，包括：通过多帧图像合成的原理对所述N帧图像进行合成，以得到合成后的照片。
为了实现上述目的，本发明第二方面实施例的多帧图像合成装置，包括：获取模块，用于获取当前拍照所需的第一曝光时间t，并将所述第一曝光时间t分为N份，其中，N为4的M次幂，其中，M为正整数；处理模块，用于通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制所述图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；合成模块，用于对所述N帧图像进行合成处理， 以得到合成后的照片。
根据本发明实施例的多帧图像合成装置，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
根据本发明的一个实施例，所述合成模块，包括：
对齐单元，用于根据所述MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对所述N帧图像进行对齐；
合成单元，用于针对对齐后的N帧图像中的每个像素，将所述N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成。
根据本发明的一个实施例，所述合成单元，具体用于：
判断N个当前像素的内容之间的匹配度是否均超过预设阈值，若均超过第一预设阈值，则将N个当前像素进行叠加。
根据本发明的一个实施例，所述合成模块还包括：
处理单元，用于在判断出N个当前像素的内容之间的匹配度不均是超过预设阈值时，确定出N个当前像素中与其他当前像素差异最大的第一当前像素，并通过其他当前像素替换所述第一当前像素，并根据其他当前像素和替换后的第一当前像素进行叠加。
根据本发明的一个实施例，所述预设像素为1个像素。
根据本发明的一个实施例，所述N是根据当前拍照所需的像素要求预先设置的。
根据本发明的一个实施例，所述合成模块，具体用于：通过多帧图像合成的原理对所述N帧图像进行合成，以得到合成后的照片。
为了实现上述目的，本发明第三方面实施例的移动终端，包括本发明第二方面实施例的多帧图像合成装置。
根据本发明实施例移动终端，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
为了实现上述目的，本发明第四方面实施例的移动终端，所述移动终端包括壳体、处 理器、存储器、电路板和电源电路，其中，所述电路板安置在所述壳体围成的空间内部，所述处理器和所述存储器设置在所述电路板上；所述电源电路，用于为所述移动终端的各个电路或器件供电；所述存储器用于存储可执行程序代码；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于执行以下步骤：获取当前拍照所需的第一曝光时间t，并将所述第一曝光时间t分为N份，其中，N为4的M次幂，其中，M为正整数；通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制所述图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；对所述N帧图像进行合成处理，以得到合成后的照片。
根据本发明实施例移动终端，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
本发明第五方面提供一种非易失性计算机存储介质，所述计算机存储介质存储有一个或者多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备执行根据本发明第一方面实施提供的多帧图像合成方法。
本发明附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本发明的实践了解到。
附图说明
本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中，
图1是根据本发明一个实施例的多帧图像合成方法的流程图；
图2是MEMS控制图像传感器进行移动的示例图；
图3是根据本发明另一个实施例的多帧图像合成方法的流程图；
图4是根据本发明一个实施例的多帧图像合成装置的结构示意图；
图5是根据本发明另一个实施例的多帧图像合成装置的结构示意图；
图6是根据本发明一个实施例的移动终端60的结构示意图。
附图标记：
获取模块110、处理模块120、合成模块130、对齐单元131、合成单元132、处理单元133、移动终端60、壳体601、处理器602、存储器603、电路板604和电源电路605。
具体实施方式
下面详细描述本发明的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，旨在用于解释本发明，而不能理解为对本发明的限制。
随着移动终端的发展，移动终端内的硬件也在不断升级，比如，在移动终端内采用了微机电系统(Micro Electro Mechanical System，MEMS)。具体的，MEMS可以应用在多种模组中，比如应用在成像模组中。成像模组包括镜头、MEMS、图像传感器(Sensor)等，MEMS能够带动图像传感器在同一个平面内沿不同方向移动。
图1是根据本发明一个实施例的多帧图像合成方法的流程图。其中，需要说明的是，该多帧图像合成方法可以应用于具有成像模组的移动终端中，其中，移动终端可以例如是手机、平板电脑等具有各种操作系统的硬件设备。
如图1所示，该多帧图像合成方法包括以下步骤：
S11，获取当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份。
其中，N为4的M次幂，其中，M为正整数。
其中，需要说明的是，N是根据像素要求预先设置的值，例如，智能手机中的摄像头的像素为400万像素，在需要提供一张1600万像素时，此时，N为4，对应的M为1。
其中，需要理解的是，可根据具体应用场景需求对N进行设置，例如，N可以为16。
S12，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像。
其中，需要理解的是，MEMS是可移动的，例如，MEMS与驱动电路连接，在驱动电路输出的驱动电压的驱动下进行移动。
其中，预设像素是预设设置的，例如，预设像素可以为1个像素，也就是说，MEMS以1个像素为步长顺时针或者逆时针控制图像传感器进行移动。
其中，需要理解的是，MEMS控制图像传感器移动的次数与N有关。
下面结合图2以一个像素为例对MEMS控制图像传感器移动进行描述，假设N为4，即将第一曝光时间t划分4，对应的第二曝光时间为t/4。在MEMS控制图像传感器初始位置1时，图像传感器以第二曝光时间t/4进行一次曝光，以获得第一帧图像。然后，MEMS控制图像传感器向右移动一个像素，以使图像传感器处于位置2，此时，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第二帧图像。之后，MEMS控制图像传感器从位置2向下移动一个像素，以使图像传感器处于位置3，此时，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第三帧图像。然后，MEMS控制图像传感器从位置3向左移动 一个像素，以使图像传感器处于位置4，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第四帧图像。另外，需要理解的是，如果MEMS控制图像传感器从位置4向上移动一个像素，此时，图像传感器将重新处于初始位置1。
S13，对N帧图像进行合成处理，以得到合成后的照片。
在获得N帧图像后，可再通过多帧图像合成的原理对多帧图像进行合成，以为用户提供合成后的质量高的照片，满足用户对照片的质量需求。
根据本发明实施例的多帧图像合成方法，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
图3是根据本发明另一个实施例的多帧图像合成方法的流程图。其中，需要说明的是，该多帧图像合成方法可以应用于具有成像模组的移动终端中，其中，移动终端可以例如是手机、平板电脑等具有各种操作系统的硬件设备。
如图3所示，该多帧图像合成方法包括以下步骤：
S31，获取当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份。
其中，N为4的M次幂，其中，M为正整数。
其中，需要说明的是，N是根据像素要求预先设置的值，例如，智能手机中的摄像头的像素为400万像素，在需要提供一张1600万像素时，此时，N为4，对应的M为1。
其中，需要理解的是，可根据具体应用场景需求对N进行设置，例如，N可以为16。
S32，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像。
其中，需要理解的是，MEMS是可移动的，例如，MEMS与驱动电路连接，在驱动电路输出的驱动电压的驱动下进行移动。
其中，预设像素是预设设置的，例如，预设像素可以为1个像素，也就是说，MEMS以1个像素为步长顺时针或者逆时针控制图像传感器进行移动。
其中，需要理解的是，MEMS控制图像传感器移动的次数与N有关。
下面结合图2对MEMS控制图像传感器移动进行描述，假设N为4，即将第一曝光时间t划分4，对应的第二曝光时间为t/4。在MEMS控制图像传感器初始位置1时，图像传感器以第二曝光时间t/4进行一次曝光，以获得第一帧图像。然后，MEMS控制图像传感 器向右移动一个像素，以使图像传感器处于位置2，此时，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第二帧图像。之后，MEMS控制图像传感器从位置2向下移动一个像素，以使图像传感器处于位置3，此时，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第三帧图像。然后，MEMS控制图像传感器从位置3向左移动一个像素，以使图像传感器处于位置4，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第四帧图像。另外，需要理解的是，如果MEMS控制图像传感器从位置4向上移动一个像素，此时，图像传感器将重新处于初始位置1。
S33，根据MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对N帧图像进行对齐。
具体地，在获取到N帧图像后，可MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则。
举例而言，对于N为4的情况，再MEMS以图2所示的移动规则控制图像传感器进行移动后，获得四帧图像后，在对第一帧图像、第二帧图像、第三帧图像和第四帧图像进行合成时，对于第一帧图像和第二帧图像来说，第一帧图像向左移动一个像素，即可实现第一帧图像和第二帧图像的对齐；对于第一帧图像和第三帧图像来说，第三帧图像向上移动一个像素，并向左移动一个像素，即可实现第一帧图像和第三帧图像的对齐；对于第一帧图像和第四帧图像来说，第四帧图像向上移动一个像素，即可实现第一帧图像和第四帧图像的对齐。
S34，针对对齐后的N帧图像中的每个像素，将N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成，以生成合成后的照片。
具体地，对于对齐后的N帧图像中的每个像素，判断N个当前像素的内容之间的匹配度是否均超过预设阈值，若均超过第一预设阈值，则将N个当前像素进行叠加。
也就是说，针对四帧图像中的当前像素，将这N个当前像素的内容进行比较，当判断出这N个当前像素的内容差异不大时，直接将这N个当前像素进行叠加，以通过N个当前像素合成一个像素。
在本发明的一个实施例中，若判断出N个当前像素的内容之间的匹配度不均是超过预设阈值，则确定出N个当前像素中与其他当前像素差异最大的第一当前像素，并通过其他当前像素替换第一当前像素，并根据其他当前像素和替换后的第一当前像素进行叠加。由此，可去除过程中相同像素位置中内容差异较大的，对合成后的该像素的成像质量的影响。
也就是说，针对N个当前像素来说，如果其中有像素与其他像素差异较大，则用其他像素替换该像素，并通过其他像素和替换后的像素进行叠加。
其中，需要说明的是，对于N帧图像中的每个像素的合成过程均与前述对当前像素的 合成的过程相同，此处不再赘述。
综上可以看出，该实施例在对N帧图像进行合成的过程中，通过MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据该对齐规则对N帧图像进行对齐，并根据对齐后的N帧图像进行像素合成，以生成合成后的照片。相对于通过计算方式确定对齐模型的方式来说，大大减少了N帧图像合成过程中的计算量，减少了合成N帧图像所需要的时间，进而可提高N帧图像合成的效率。
根据本发明实施例的多帧图像合成方法，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，根据MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对N帧图像进行对齐，针对对齐后的N帧图像中的每个像素，将N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成，以获得合成后的照片。由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，并且在通过N帧图像合成图像时，根据MEMS控制图像传感器的移动规则可快速确定出N帧图像的对齐规则，减少了合成N帧图像所需要的时间，提高了N帧图像合成的效率，并且提高了多帧图像合成后的照片的成像质量。
为了实现上述实施例，本发明还提出了一种本发明实施例的多帧图像合成装置。
图4是根据本发明一个实施例的多帧图像合成装置的结构示意图。
如图4所示，该本发明实施例的多帧图像合成装置可以包括获取模块110、处理模块120和合成模块130，其中：
获取模块110用于获取当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份。
其中，N为4的M次幂，其中，M为正整数。
处理模块120用于通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像。
其中，预设像素是根据场景需求预设的，例如，预设像素可以为1个像素。
合成模块130用于对N帧图像进行合成处理，以得到合成后的照片。
其中，需要说明的是，前述对多帧图像合成方法实施例的解释说明也适用于该实施例的多帧图像合成装置，其实现原理类似，此处不再赘述。
根据本发明实施例的多帧图像合成装置，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以 第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
在本发明的一个实施例中，基于图4所示的实施例的基础上，如图5所示，上述合成模块130可以包括对齐单元131和合成单元132，其中：
对齐单元131用于根据MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对N帧图像进行对齐。
合成单元132用于针对对齐后的N帧图像中的每个像素，将N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成。
在本发明的一个实施例中，合成单元132具体用于：判断N个当前像素的内容之间的匹配度是否均超过预设阈值，若均超过第一预设阈值，则将N个当前像素进行叠加。
在本发明的一个实施例中，如图5所示，上述合成模块130还可以包括处理单元133，其中：
处理单元133用于在判断出N个当前像素的内容之间的匹配度不均是超过预设阈值时，确定出N个当前像素中与其他当前像素差异最大的第一当前像素，并通过其他当前像素替换第一当前像素，并根据其他当前像素和替换后的第一当前像素进行叠加。
综上可以看出，该实施例在对N帧图像进行合成的过程中，通过MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据该对齐规则对N帧图像进行对齐，并根据对齐后的N帧图像进行像素合成，以生成合成后的照片。相对于通过计算方式确定对齐模型的方式来说，大大减少了N帧图像合成过程中的计算量，减少了合成N帧图像所需要的时间，进而可提高N帧图像合成的效率。
为了实现上述实施例，本发明还提出一种移动终端。
一种移动终端，包括本发明第二方面实施例的多帧图像合成装置。
根据本发明实施例的移动终端，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
为了实现上述实施例，本发明还提出一种移动终端。
图6是根据本发明一个实施例的移动终端60的结构示意图。
如图6所示，该移动终端60包括壳体601、处理器602、存储器603、电路板604和电源电路605，其中，电路板604安置在壳体601围成的空间内部，处理器602和存储器603设置在电路板604上；电源电路605，用于为移动终端60的各个电路或器件供电；存储器603用于存储可执行程序代码；处理器602通过读取存储器603中存储的可执行程序代码来运行与可执行程序代码对应的程序，以用于执行以下步骤：
S11'，获取当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份。
其中，N为4的M次幂，其中，M为正整数。
其中，需要说明的是，N是根据像素要求预先设置的值，例如，智能手机中的摄像头的像素为400万像素，在需要提供一张1600万像素时，此时，N为4，对应的M为1。
其中，需要理解的是，可根据具体应用场景需求对N进行设置，例如，N可以为16。
S12'，通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像。
其中，需要理解的是，其中，MEMS是可移动的，例如，MEMS与驱动电路连接，在驱动电路输出的驱动电压的驱动下进行移动。
其中，预设像素是预设设置的，例如，预设像素可以为1个像素，也就是说，MEMS以1个像素为步长顺时针或者逆时针控制图像传感器进行移动。
其中，需要理解的是，MEMS控制图像传感器移动的次数与N有关。
下面结合图2对MEMS控制图像传感器移动进行描述，假设N为4，即将第一曝光时间t划分4，对应的第二曝光时间为t/4。在MEMS控制图像传感器初始位置1时，图像传感器以第二曝光时间t/4进行一次曝光，以获得第一帧图像。然后，MEMS控制图像传感器向右移动一个像素，以使图像传感器处于位置2，此时，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第二帧图像。之后，MEMS控制图像传感器从位置2向下移动一个像素，以使图像传感器处于位置3，此时，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第三帧图像。然后，MEMS控制图像传感器从位置3向左移动一个像素，以使图像传感器处于位置4，图像传感器以第二曝光时间t/4再进行一次曝光，以获得第四帧图像。另外，需要理解的是，如果MEMS控制图像传感器从位置4向上移动一个像素，此时，图像传感器将重新处于初始位置1。
S13'，对N帧图像进行合成处理，以得到合成后的照片。
在获得N帧图像后，可再通过多帧图像合成的原理对多帧图像进行合成，以为用户提供合成后的质量高的照片，满足用户对照片的质量需求。
根据本发明实施例的移动终端，在需要多帧拍摄图像合成时，将当前拍照所需的第一曝光时间t，并将第一曝光时间t分为N份，然后，通过MEMS控制图像传感器按照预设 像素步长顺时针或者逆时针移动，并控制图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像，对N帧图像进行合成处理，以得到合成后的照片，由此，通过MEMS控制图像传感器的移动，减少了拍摄过程中的抖动，进而可提高所拍摄的每帧图像的质量，从而提高了多帧图像合成后的照片的成像质量。
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中，“多个”的含义是至少两个，例如两个，三个等，除非另有明确具体的限定。
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本发明的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本发明的实施例所属技术领域的技术人员所理解。
在流程图中表示或在此以其他方式描述的逻辑和/或步骤，例如，可以被认为是用于实现逻辑功能的可执行指令的定序列表，可以具体实现在任何计算机可读介质中，以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用，或结合这些指令执行系统、装置或设备而使用。就本说明书而言，"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下：具有一个或多个布线的电连接部(电子装置)，便携式计算机盘盒(磁装置)，随机存取存储器(RAM)，只读存储器(ROM)，可擦除可编辑只读存储器(EPROM或闪速存储器)，光纤装置，以及便携式光盘只读存储器(CDROM)。另外，计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质，因为可以例如通过对纸或其他介质进行光学扫描，接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序，然后将其 存储在计算机存储器中。
应当理解，本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如，如果用硬件来实现，和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，该程序在执行时，包括方法实施例的步骤之一或其组合。
此外，在本发明各个实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。
上述提到的存储介质可以是只读存储器，磁盘或光盘等。尽管上面已经示出和描述了本发明的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本发明的限制，本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。

Claims (16)

  1. 一种多帧图像合成方法，其特征在于，包括以下步骤：
    获取当前拍照所需的第一曝光时间t，并将所述第一曝光时间t分为N份，其中，N为4的M次幂，其中，M为正整数；
    通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制所述图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；
    对所述N帧图像进行合成处理，以得到合成后的照片。
  2. 如权利要求1所述的多帧图像合成方法，其特征在于，所述对所述N帧图像进行合成处理，以得到合成后的照片，包括：
    根据所述MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对所述N帧图像进行对齐；
    针对对齐后的N帧图像中的每个像素，将所述N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成。
  3. 如权利要求1或2所述的多帧图像合成方法，其特征在于，所述将所述N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成，包括：
    判断N个当前像素的内容之间的匹配度是否均超过预设阈值，若均超过第一预设阈值，则将N个当前像素进行叠加。
  4. 如权利要求3所述的多帧图像合成方法，其特征在于，所述方法还包括：
    若判断出N个当前像素的内容之间的匹配度不均是超过预设阈值，则确定出N个当前像素中与其他当前像素差异最大的第一当前像素，并通过其他当前像素替换所述第一当前像素，并根据其他当前像素和替换后的第一当前像素进行叠加。
  5. 如权利要求1-4中任一项所述的多帧图像合成方法，其特征在于，所述预设像素为1个像素。
  6. 如权利要求1-5中任一项所述的多帧图像合成方法，其特征在于，所述N是根据当前拍照所需的像素要求预先设置的。
  7. 如权利要求1-5中任一项所述的多帧图像合成方法，其特征在于，所述对所述N帧图像进行合成处理，以得到合成后的照片，包括：
    通过多帧图像合成的原理对所述N帧图像进行合成，以得到合成后的照片。
  8. 一种多帧图像合成装置，其特征在于，包括：
    获取模块，用于获取当前拍照所需的第一曝光时间t，并将所述第一曝光时间t分为N份，其中，N为4的M次幂，其中，M为正整数；
    处理模块，用于通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制所述图像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；
    合成模块，用于对所述N帧图像进行合成处理，以得到合成后的照片。
  9. 如权利要求8所述的多帧图像合成装置，其特征在于，所述合成模块，包括：
    对齐单元，用于根据所述MEMS控制图像传感器的移动规则确定出N帧图像的对齐规则，并根据对齐规则对所述N帧图像进行对齐；
    合成单元，用于针对对齐后的N帧图像中的每个像素，将所述N帧图像中针对当前像素的内容进行比较，并根据比较结果进行像素合成。
  10. 如权利要求8或9所述的多帧图像合成装置，其特征在于，所述合成单元，具体用于：
    判断N个当前像素的内容之间的匹配度是否均超过预设阈值，若均超过第一预设阈值，则将N个当前像素进行叠加。
  11. 如权利要求10所述的多帧图像合成装置，其特征在于，所述合成模块还包括：
    处理单元，用于在判断出N个当前像素的内容之间的匹配度不均是超过预设阈值时，确定出N个当前像素中与其他当前像素差异最大的第一当前像素，并通过其他当前像素替换所述第一当前像素，并根据其他当前像素和替换后的第一当前像素进行叠加。
  12. 如权利要求8-11中任一项所述的多帧图像合成装置，其特征在于，所述预设像素为1个像素。
  13. 如权利要求8-12中任一项所述的多帧图像合成装置，其特征在于，所述N是根据当前拍照所需的像素要求预先设置的。
  14. 如权利要求8-13中任一项所述的多帧图像合成装置，其特征在于，所述合成模块，具体用于：
    通过多帧图像合成的原理对所述N帧图像进行合成，以得到合成后的照片。
  15. 一种移动终端，其特征在于，所述移动终端包括壳体、处理器、存储器、电路板和电源电路，其中，所述电路板安置在所述壳体围成的空间内部，所述处理器和所述存储器设置在所述电路板上；所述电源电路，用于为所述移动终端的各个电路或器件供电；所述存储器用于存储可执行程序代码；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于执行以下步骤：
    获取当前拍照所需的第一曝光时间t，并将所述第一曝光时间t分为N份，其中，N为4的M次幂，其中，M为正整数；
    通过MEMS控制图像传感器按照预设像素步长顺时针或者逆时针移动，并控制所述图 像传感器在每次移动预设像素后，以第二曝光时间t/N进行曝光，以获取N帧图像；
    对所述N帧图像进行合成处理，以得到合成后的照片。
  16. 一种非易失性计算机存储介质，其特征在于，所述计算机存储介质存储有一个或者多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备执行如权利要求1-7任一项所述多帧图像合成方法。
PCT/CN2017/079381 2016-07-29 2017-04-01 多帧图像合成方法和装置 Ceased WO2018018927A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US16/311,722 US10728465B2 (en) 2016-07-29 2017-04-01 Method and device for compositing a plurality of images
EP17833233.4A EP3493521B1 (en) 2016-07-29 2017-04-01 Method and device for synthesizing multiple frames of images
US16/436,664 US10686997B2 (en) 2016-07-29 2019-06-10 Method and device for compositing a plurality of images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610616329.XA CN106254772B (zh) 2016-07-29 2016-07-29 多帧图像合成方法和装置
CN201610616329.X 2016-07-29

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US16/311,722 A-371-Of-International US10728465B2 (en) 2016-07-29 2017-04-01 Method and device for compositing a plurality of images
US16/436,664 Continuation US10686997B2 (en) 2016-07-29 2019-06-10 Method and device for compositing a plurality of images

Publications (1)

Publication Number Publication Date
WO2018018927A1 true WO2018018927A1 (zh) 2018-02-01

Family

ID=57605661

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/079381 Ceased WO2018018927A1 (zh) 2016-07-29 2017-04-01 多帧图像合成方法和装置

Country Status (4)

Country Link
US (2) US10728465B2 (zh)
EP (1) EP3493521B1 (zh)
CN (2) CN107483839B (zh)
WO (1) WO2018018927A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10686997B2 (en) 2016-07-29 2020-06-16 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for compositing a plurality of images

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108540728A (zh) * 2017-03-06 2018-09-14 中兴通讯股份有限公司 长曝光拍照方法及装置
US10715727B2 (en) * 2017-05-16 2020-07-14 Apple Inc. Synthetic long exposure image with optional enhancement using a guide image
CN109005355B (zh) * 2018-09-28 2020-10-09 维沃移动通信有限公司 一种拍摄方法及移动终端
CN111787244B (zh) * 2020-07-15 2021-06-29 吉林大学 一种航天tdi沿轨推扫像移混叠抑制方法
CN111923599B (zh) * 2020-09-18 2021-02-26 季华实验室 喷头模组步长计算方法、设备、存储介质和喷墨打印机
CN112543261A (zh) 2020-12-08 2021-03-23 浙江大华技术股份有限公司 一种图像质量提升方法、装置以及计算机可读存储介质
CN221043019U (zh) * 2021-01-27 2024-05-28 高途乐公司 图像捕获设备
CN113034201A (zh) * 2021-04-19 2021-06-25 广州欢网科技有限责任公司 一种基于广告投放过程的实时预警方法、系统及计算机
CN113596294A (zh) * 2021-07-08 2021-11-02 维沃移动通信（杭州）有限公司 拍摄方法、装置和电子设备
CN117710223A (zh) * 2022-09-08 2024-03-15 广州印芯半导体技术有限公司 图像融合方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101035206A (zh) * 2006-03-10 2007-09-12 奥林巴斯映像株式会社 电子抖动校正装置以及电子抖动校正方法
CN104769934A (zh) * 2012-11-08 2015-07-08 苹果公司 基于光学图像稳定的超分辨率
US20160098852A1 (en) * 2013-05-29 2016-04-07 Nec Corporation Multocular imaging system, synthesis process method of acquired images, and program
CN105611181A (zh) * 2016-03-30 2016-05-25 努比亚技术有限公司 多帧拍摄图像合成装置和方法
CN106254772A (zh) * 2016-07-29 2016-12-21 广东欧珀移动通信有限公司 多帧图像合成方法和装置

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2635917B2 (ja) 1992-09-11 1997-07-30 株式会社東芝 電子スチルカメラ
EP1538562A4 (en) 2003-04-17 2005-08-10 Seiko Epson Corp GENERATING A STILL IMAGE FROM MULTIPLE INDIVIDUAL IMAGES
US9049396B2 (en) * 2004-09-29 2015-06-02 Hewlett-Packard Development Company, L.P. Creating composite images based on image capture device poses corresponding to captured images
CN100464572C (zh) 2007-07-25 2009-02-25 北京中星微电子有限公司 一种图像合成方法和装置
KR20100060140A (ko) * 2008-11-27 2010-06-07 삼성전자주식회사 영상 처리 장치에서의 광역 역광 보정 영상 획득 장치 및 방법
US8471915B2 (en) * 2009-04-16 2013-06-25 Raytheon Company Self-correcting adaptive long-stare electro-optical system
JP5412953B2 (ja) 2009-05-20 2014-02-12 リコーイメージング株式会社 撮像装置
TWI445396B (zh) * 2010-11-22 2014-07-11 Altek Corp 電子裝置、影像擷取裝置及其方法
US9088714B2 (en) * 2011-05-17 2015-07-21 Apple Inc. Intelligent image blending for panoramic photography
JP6045254B2 (ja) * 2012-08-20 2016-12-14 キヤノン株式会社 画像処理装置、その制御方法、および制御プログラム
US9692975B2 (en) 2013-04-10 2017-06-27 Microsoft Technology Licensing, Llc Motion blur-free capture of low light high dynamic range images
TWI604413B (zh) * 2013-12-16 2017-11-01 華碩電腦股份有限公司 影像處理方法及影像處理裝置
JP5847228B2 (ja) * 2014-04-16 2016-01-20 オリンパス株式会社 画像処理装置、画像処理方法及び画像処理プログラム
CN105472357A (zh) 2014-08-18 2016-04-06 比亚迪股份有限公司 成像方法、成像装置和拍摄系统
US9426362B2 (en) * 2015-01-16 2016-08-23 Mems Drive, Inc. Three-axis OIS for super-resolution imaging

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101035206A (zh) * 2006-03-10 2007-09-12 奥林巴斯映像株式会社 电子抖动校正装置以及电子抖动校正方法
CN104769934A (zh) * 2012-11-08 2015-07-08 苹果公司 基于光学图像稳定的超分辨率
US20160098852A1 (en) * 2013-05-29 2016-04-07 Nec Corporation Multocular imaging system, synthesis process method of acquired images, and program
CN105611181A (zh) * 2016-03-30 2016-05-25 努比亚技术有限公司 多帧拍摄图像合成装置和方法
CN106254772A (zh) * 2016-07-29 2016-12-21 广东欧珀移动通信有限公司 多帧图像合成方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3493521A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10686997B2 (en) 2016-07-29 2020-06-16 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for compositing a plurality of images
US10728465B2 (en) 2016-07-29 2020-07-28 Guangdong Oppo Mobile Telecommuications Corp., Ltd. Method and device for compositing a plurality of images

Also Published As

Publication number Publication date
CN106254772A (zh) 2016-12-21
EP3493521A4 (en) 2019-07-31
EP3493521A1 (en) 2019-06-05
CN107483839B (zh) 2020-08-07
CN106254772B (zh) 2017-11-07
EP3493521B1 (en) 2025-06-18
CN107483839A (zh) 2017-12-15
US10686997B2 (en) 2020-06-16
US20190208103A1 (en) 2019-07-04
US20190297244A1 (en) 2019-09-26
US10728465B2 (en) 2020-07-28

Similar Documents

Publication Publication Date Title
WO2018018927A1 (zh) 多帧图像合成方法和装置
CN110248103B (zh) 拍照方法、装置及电子设备
CN103795924B (zh) 全景拍照装置及方法
JP5932045B2 (ja) 立体視画像ペアの条件付き表示のための方法及び装置
WO2015180510A1 (zh) 一种图像获取终端和图像获取方法
CN103067656B (zh) 摄像装置以及摄像方法
CN106416224A (zh) 全景拍摄方法、终端、旋转组件及全景拍摄装置
CN105592262A (zh) 摄像装置
JP5843525B2 (ja) 撮像装置及びその制御方法
JP6432038B2 (ja) 撮像装置
CN102263894B (zh) 拍摄装置
WO2018019013A1 (zh) 拍照控制方法和装置
CN105681665A (zh) 控制方法、控制装置及电子装置
JP2012194487A (ja) 撮像装置、撮像方法及びプログラム
JP7002050B2 (ja) 撮像装置
CN102387304A (zh) 摄像装置
CN106101556B (zh) 移动终端的图像合成方法、装置及移动终端
US11368622B2 (en) Photographing method, photographing device and mobile terminal for shifting a lens
WO2013069279A1 (ja) 撮像装置
CN105282428A (zh) 一种移动终端拍摄的方法及移动终端
JP2015233211A (ja) 撮像装置およびその制御方法ならびにプログラム
JP5892211B2 (ja) 撮像装置、及びプログラム
CN110248049A (zh) 移动终端及其调整方法、拍摄控制方法和装置
CN105681670B (zh) 控制方法、控制装置及电子装置
JP6278798B2 (ja) 撮像装置、その制御方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17833233

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017833233

Country of ref document: EP

Effective date: 20190228

WWG Wipo information: grant in national office

Ref document number: 2017833233

Country of ref document: EP