WO2017166057A1 - Procédé de traitement d'image, appareil de traitement d'image, dispositif multifonction portable, et support de stockage lisible par ordinateur - Google Patents

Procédé de traitement d'image, appareil de traitement d'image, dispositif multifonction portable, et support de stockage lisible par ordinateur Download PDF

Info

Publication number
WO2017166057A1
WO2017166057A1 PCT/CN2016/077687 CN2016077687W WO2017166057A1 WO 2017166057 A1 WO2017166057 A1 WO 2017166057A1 CN 2016077687 W CN2016077687 W CN 2016077687W WO 2017166057 A1 WO2017166057 A1 WO 2017166057A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
camera
processors
color sensor
specific
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/077687
Other languages
English (en)
Inventor
Hajime Numata
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201680084256.2A priority Critical patent/CN108886563B/zh
Priority to PCT/CN2016/077687 priority patent/WO2017166057A1/fr
Publication of WO2017166057A1 publication Critical patent/WO2017166057A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2625—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10152—Varying illumination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Definitions

  • the present invention relates to the field of image processing, and in particular, to an image processing method, an image processing apparatus, a portable multifunction device, and a computer readable storage medium.
  • Some cameras have an image processing capability to beautify a human face, for example, to remove spots or freckles using a smoothing filter or a de-noise filter.
  • a smoothing filter or a de-noise filter By using a smoothing filter or a de-noise filter, some spots or freckles can be smoothed or removed.
  • an edge-preserving filter is applied. When an edge-preserving filter is applied, all of the edges in an image are preserved.
  • FIG. 1 shows an original image and a smoothed image according to the prior art.
  • FIG. 1 (A) there are edges at spots or freckles in the original image.
  • a smoothing filter or a de-noise filter is applied together with an edge-preserving filter, the edges at the spots or freckles are enhanced and big pockmarks or deep colored spots remain at the edges of the spots or freckles as shown in FIG. 1 (B) .
  • an edge-preserving filter When an edge-preserving filter is used, it is difficult to determine which portions are contours or outlines of face parts to be preserved and which portions are spots or freckles to be smoothed. Thus, for the edges of the spots or freckles, a smoothing filter or a de-noise filter does not work well.
  • Embodiments of the present invention provide an image processing method, an image processing apparatus, a portable multifunction device, and a computer readable storage medium to improve beautification of a human skin in an image captured by a camera.
  • an image processing method including: at a portable multifunction device with an LED (light emitting diode) flash, including at least two LEDs, a camera, including a color sensor, and one or more processors, obtaining, by the camera, a first image, when the LED flash emits first light or when the LED flash does not emit light; obtaining, by the camera, a second image, when the LED flash emits second light, wherein the second light has a specific wavelength; and combining, by the one or more processors, the first image and the second image to generate a third image.
  • an LED light emitting diode
  • a first image is obtained when the LED flash emits first light or when the LED flash does not emit light
  • a second image is obtained when the LED flash emits second light
  • the second light has a specific wavelength
  • the first image and the second image are combined to generate a third image.
  • the specific wavelength the first aspect improves beautification of a human skin in an image captured by a camera.
  • the LED flash including a red LED, a green LED, and a blue LED, a first image and a second image can be easily obtained without modifying hardware components of a camera.
  • an image processing method including: at a portable multifunction device with a first camera, including a color sensor, a second camera, including a color sensor and a specific color filter which passes specific color and is placed in front of the color sensor, and one or more processors, obtaining, by the first camera, a first image; obtaining, by the second camera, a second image; and combining, by the one or more processors, the first image and the second image to generate a third image.
  • a first image is obtained by a first camera including a color sensor
  • a second image is obtained by a second camera including a color sensor and a specific color filter which passes specific color
  • the first image and the second image are combined to generate a third image.
  • the specific color filter which passes specific color improves beautification of a human skin in an image captured by cameras.
  • the first image and the second image can be obtained at the same time.
  • an image processing method including: at a portable multifunction device with a camera, including a color sensor and a specific color filter which passes specific color, and one or more processors, obtaining, by the camera, a first image, when the specific color filter is not applied; obtaining, by the camera, a second image, when the specific color filter is applied; and combining, by the one or more processors, the first image and the second image to generate a third image.
  • a first image is obtained when a specific color filter which passes specific color is not applied
  • a second image is obtained when a specific color filter which passes specific color is applied
  • the first image and the second image are combined to generate a third image.
  • an image processing method including: at a portable multifunction device with a camera, including a first color sensor and a second color sensor which detects specific color, and one or more processors, obtaining, by the camera, a first image using the first color sensor; obtaining, by the camera, a second image using the second color sensor; and combining, by the one or more processors, the first image and the second image to generate a third image.
  • a first image is obtained using a first color sensor
  • a second image is obtained using a second color sensor which detects specific color
  • the first image and the second image are combined to generate a third image.
  • the fourth aspect improves beautification of a human skin in an image captured by a camera.
  • the first color sensor and the second color sensor which detects specific color the first image and the second image can be obtained at the same time.
  • combining, by the one or more processors, the first image and the second image to generate the third image includes: obtaining a first luminance component from the first image; obtaining a second luminance component from the second image; and combining a low frequency component of the first luminance component and a high frequency component of the second luminance component.
  • the third image is generated by combining a low frequency component of the first luminance component and a high frequency component of the second luminance component. Since light with a specific wavelength reaches a deeper layer of a human skin, spots or freckles can be smoothed by using the high frequency component of the second luminance component. At the same time, contours or outlines of face parts can be preserved by using the low frequency component of the first luminance component.
  • combining, by the one or more processors, the first image and the second image to generate the third image includes: obtaining a first chroma component from the first image; obtaining a second chroma component from the second image; and combining a low frequency component of the first chroma component and a high frequency component of the second chroma component.
  • the third image is generated by combining a low frequency component of the first chroma component and a high frequency component of the second chroma component. Colored spots or freckles can be smoothed by using the high frequency component of the second chroma component. At the same time, contours or outlines of face parts can be preserved by using the low frequency component of the first chroma component.
  • the specific wavelength is a wavelength over which reflectance by hemoglobin is higher than reflectance by melanin.
  • the specific wavelength is a wavelength within a red wavelength region.
  • the specific color has a wavelength over which reflectance by hemoglobin is higher than reflectance by melanin.
  • the specific color is red.
  • an image processing apparatus including: a first obtainment unit configured to obtain a first image, when an LED (light emitting diode) flash, including at least two LEDs, emits first light or when the LED flash does not emit light; a second obtainment unit configured to obtain a second image, when the LED flash emits second light, wherein the second light has a specific wavelength; and a combination unit configured to combine the first image and the second image to generate a third image.
  • a first obtainment unit configured to obtain a first image, when an LED (light emitting diode) flash, including at least two LEDs, emits first light or when the LED flash does not emit light
  • a second obtainment unit configured to obtain a second image, when the LED flash emits second light, wherein the second light has a specific wavelength
  • a combination unit configured to combine the first image and the second image to generate a third image.
  • an image processing apparatus including: a first obtainment unit configured to obtain a first image using a first camera including a color sensor; a second obtainment unit configured to obtain a second image using a second camera including a color sensor and a specific color filter which passes specific color and is placed in front of the color sensor; and a combination unit configured to combine the first image and the second image to generate a third image.
  • an image processing apparatus including: a first obtainment unit configured to obtain a first image using a camera including aa color sensor and a specific color filter which passes specific color, when the specific color filter is not applied; a second obtainment unit configured to obtain a second image using the camera, when the specific color filter is applied; and a combination unit configured to combine the first image and the second image to generate a third image.
  • an image processing apparatus including: a first obtainment unit configured to obtain a first image using a first color sensor in a camera; a second obtainment unit configured to obtain a second image using a second color sensor which detects specific color; and a combination unit configured to combine the first image and the second image to generate a third image.
  • the combination unit is configured to: obtain a first luminance component from the first image; obtain a second luminance component from the second image; and combine a low frequency component of the first luminance component and a high frequency component of the second luminance component.
  • the combination unit is configured to: obtain a first chroma component from the first image; obtain a second chroma component from the second image; and combine a low frequency component of the first chroma component and a high frequency component of the second chroma component.
  • the specific wavelength is a wavelength over which reflectance by hemoglobin is higher than reflectance by melanin.
  • the specific wavelength is a wavelength within a red wavelength region.
  • the specific color has a wavelength over which reflectance by hemoglobin is higher than reflectance by melanin.
  • the specific color is red.
  • a portable multifunction device including: an LED (light emitting diode) flash, including at least two LEDs; a camera, including a color sensor; and one or more processors; wherein the camera captures a first image, when the LED flash emits first light or when the LED flash does not emit light; the camera captures a second image, when the LED flash emits second light, wherein the second light has a specific wavelength; and the one or more processors combine the first image and the second image to generate a third image.
  • an LED light emitting diode
  • a camera including a color sensor
  • one or more processors wherein the camera captures a first image, when the LED flash emits first light or when the LED flash does not emit light; the camera captures a second image, when the LED flash emits second light, wherein the second light has a specific wavelength; and the one or more processors combine the first image and the second image to generate a third image.
  • a portable multifunction device including: a first camera, including a color sensor; a second camera, including a color sensor and a specific color filter which passes specific color and is placed in front of the color sensor; and one or more processors; wherein the first camera captures a first image; the second camera captures a second image; and the one or more processors combine the first image and the second image to generate a third image.
  • a portable multifunction device including: a camera, including a color sensor and a specific color filter which passes specific color; and one or more processors; wherein the camera captures a first image, when the specific color filter is not applied; the camera captures a second image, when the specific color filter is applied; and the one or more processors combine the first image and the second image to generate a third image.
  • a portable multifunction device including: a camera, including a first color sensor and a second color sensor which detects specific color; and one or more processors; wherein the camera captures a first image using the first color sensor; the camera captures a second image using the second color sensor; and the one or more processors combine the first image and the second image to generate a third image.
  • a portable multifunction device including: one or more processors; and a memory; wherein one or more programs stored in the memory, when executed by the one or more processors, cause the one or more processors to perform the method according to any one of the first to fourth aspects.
  • a computer-readable storage medium storing one or more programs which, when executed by a portable multifunction device, cause the portable multifunction device to perform the method according to any one of the first to fourth aspects.
  • a first image and a second image which are obtained using different light emissions, different cameras, a selectively-applicable color filter, or different sensors, are combined to generate a third image, thereby improving beautification of a human skin in an image captured by a camera.
  • FIG. 1 shows an original image and a smoothed image according to the prior art
  • FIG. 2 is a graph of reflectance by a human skin
  • FIG. 3 is a schematic diagram of a relationship between a wavelength of light and a depth of a skin which reflects the light;
  • FIG. 4 is a flowchart of an image processing method according to an embodiment of the present invention.
  • FIG. 5 is an exemplary LED flash for use in an embodiment of the present invention.
  • FIG. 6 is an exemplary dual camera for use in an embodiment of the present invention.
  • FIG. 7 is an exemplary color sensor for use in an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of an image processing method according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention.
  • FIG. 11 shows an original image, a smoothed image according to the prior art, and an image processed according to an embodiment of the present invention.
  • an image processing apparatus uses a specific wavelength to improve beautification of a human skin in an image captured by a camera.
  • the specific wavelength is a wavelength within a red wavelength region (for example, more than 620 nm and less than 650 nm) . Since red light with more than 620 nm and less than 650 nm wavelengths reaches a deeper layer of a human skin as described below with reference to FIG. 2 and FIG. 3, an image obtained using the specific wavelength can smooth spots or freckles in the captured image.
  • an image obtained using the specific wavelength is used together with an original image (i.e., an image obtained using red, green, and blue wavelengths) to beautify a human skin.
  • FIG. 2 is a graph of reflectance by a human skin.
  • the horizontal axis of the graph is a wavelength and the vertical axis of the graph is a reflectance.
  • a relationship between a reflectance by hemoglobin and a wavelength and a relationship between a reflectance by melanin and a wavelength are plotted on the graph.
  • the reflectance by hemoglobin is higher than the reflectance by melanin.
  • the reflectance by melanin affects an appearance of a human skin.
  • using a specific wavelength within the red wavelength region to capture an image of a human skin some spots or freckles become invisible.
  • FIG. 3 is a schematic diagram of a relationship between a wavelength of light and a depth of a skin which reflects the light.
  • visible light has wavelengths ranging from 380 nm to 750 nm.
  • blue light has wavelengths around 450 nm
  • green light has wavelengths around 550 nm
  • red light has wavelengths around 650 nm.
  • the upper portion of FIG. 3 shows an original image obtained using white light, an image obtained using blue light, an image obtained using green light, and an image obtained using red light.
  • the lower portion of FIG. 3 shows that blue light is reflected near a surface of a human skin, green light reaches a deeper layer than blue light, and red light reaches a deeper layer than green light. It is also understood from FIG. 3 that some spots or freckles become invisible using a specific wavelength within the red wavelength region to capture an image of a human skin.
  • an embodiment of the present invention can improve beautification of a human skin in an image captured by a camera.
  • FIG. 4 is a flowchart of an image processing method according to an embodiment of the present invention.
  • the image processing method may be performed by an image processing apparatus.
  • the image processing apparatus may be a portable multifunction device or a computer including one or more processors and a memory.
  • the portable multifunction device may also include an LED (light emitting diode) flash and/or a camera.
  • the one or more processors may read computer-readable program code stored in the memory, so that the one or more processors can perform the following steps of the image processing method.
  • An image processing apparatus obtains a first image.
  • the image processing apparatus obtains a second image.
  • the first image is an image (hereinafter, also referred to as an “RGB (red, green, and blue) image” ) obtained using red, green, and blue wavelengths.
  • the second image is an image (hereinafter, also referred to as a “specific wavelength image” ) obtained using a specific wavelength.
  • a typical camera can obtain an RGB image.
  • an LED flash which can emit light with a specific wavelength
  • a specific color filter which passes specific color, that is, a specific color filter which passes wavelengths within a predetermined wavelength region including the specific wavelength, or a color sensor which detects specific color, that is, a color sensor which detects the specific wavelength
  • a color sensor which detects the specific wavelength may be used.
  • the number of specific wavelengths is not limited to one, but a plurality of specific wavelengths may be used. It should be also noted that the number of specific wavelength images is not limited to one, but a plurality of specific wavelength images may be obtained. The combination of the number of specific wavelengths and the number of specific wavelength images may be arbitrarily determined. For example, one specific wavelength image may be obtained with a wavelength of 620 nm, where reflectance by hemoglobin is higher than reflectance by melanin, and another specific wavelength image may be obtained with a wavelength of 500 nm, where reflectance by hemoglobin is also higher than reflectance by melanin.
  • one specific wavelength image may be obtained using a wavelength of 620 nm
  • another specific wavelength image may be obtained using a wavelength of 500 nm
  • still another specific wavelength image may be obtained using wavelengths of 620 nm and 500 nm.
  • an RGB image may be obtained by the camera when the LED flash emits first light or when the LED flash does not emit light.
  • a specific wavelength image may be obtained by the camera when the LED flash emits second light with the specific wavelength.
  • the color sensor may be an RGB color sensor which includes an RGB color filter or a complementary color sensor which includes a Ye/Cy/Mg/G color filter.
  • another light source may be used such as an electro-luminescence (EL) device, a light bulb, or the like.
  • FIG. 5 is an exemplary LED flash for use in an embodiment of the present invention.
  • the LED flash includes a red LED 101, a green LED 102, and a blue LED 103.
  • the red LED 101 may emit light with a wavelength within a red wavelength region
  • the green LED 102 may emit light with a wavelength within a green wavelength region
  • the blue LED 103 may emit light with a wavelength within a blue wavelength region.
  • the red LED 101 may emit light with a wavelength of 632 nm
  • the green LED 102 may emit light with a wavelength of 523 nm
  • the blue LED 103 may emit light with a wavelength of 465 nm.
  • an RGB image and a specific wavelength image may be sequentially obtained.
  • An RGB image may be obtained at a first frame timing, and then a specific wavelength image may be obtained at a second frame timing. Alternatively, a specific wavelength image may be obtained at a first frame timing, and then an RGB image may be obtained at a second frame timing.
  • An RGB image can be obtained using a camera by turning the red LED 101 on, the green LED 102 on, and the blue LED 103 on. Alternatively, an RGB image can be obtained using a camera by turning the red LED 101 off, the green LED 102 off, and the blue LED 103 off.
  • a specific wavelength image may be obtained using a camera by turning the red LED 101 on, the green LED 102 off, and the blue LED 103 off.
  • a specific wavelength image may be also obtained by flashing the red LED 101 strongly.
  • the camera can capture a reddish image, that is, a specific wavelength image.
  • a reddish image that is, a specific wavelength image.
  • an RGB image may be obtained by the first camera.
  • a specific wavelength image may be obtained by the second camera.
  • an RGB image and a specific image may be obtained by a dual camera including two cameras, one of which includes a specific color filter which passes specific color.
  • an RGB image and a specific image may be obtained by a single camera by selectively applying a specific color filter which passes specific color.
  • an RGB image may be obtained by the camera when the specific color filter is not applied.
  • a specific wavelength image may be obtained by the camera when the specific color filter is applied.
  • the specific color filter passes wavelengths within a predetermined wavelength region including the specific wavelength and rejects wavelengths other than the predetermined wavelength region. For example, when the specific wavelength is 620 nm, the specific color filter may pass wavelengths ranging from 600 nm to 650 nm or wavelengths more than 600 nm.
  • FIG. 6 is an exemplary dual camera for use in an embodiment of the present invention.
  • the dual camera may include a first camera 201 configured to capture an RGB image and a second camera 202 configured to capture a specific wavelength image.
  • the second camera 202 includes a specific color filter 203 which passes wavelengths within a predetermined wavelength region including the specific wavelength and rejects wavelengths other than the predetermined wavelength region.
  • an RGB image and a specific wavelength image may be sequentially or simultaneously obtained.
  • An RGB image may be obtained by the first camera 201 at a first timing, and then a specific wavelength image may be obtained by the second camera 202 at a second timing.
  • a specific wavelength image may be obtained by the second camera 202 at a first timing, and then an RGB image may be obtained by the first camera 201 at a second timing.
  • an RGB image and a specific wavelength image may be obtained at the same time by using both the first camera 201 and the second camera 202.
  • an RGB image may be obtained by the camera using the first color sensor.
  • the first color sensor can detect the red, green, and blue wavelengths.
  • a specific wavelength image may be obtained by the camera using the second color sensor which detects specific color.
  • the first color sensor or the second color sensor which detects specific color may include a charge-coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.
  • CCD charge-coupled device
  • CMOS complementary metal oxide semiconductor
  • a typical color sensor includes a sensor element which detects red light, a sensor element which detects green light, and a sensor element which detects blue light.
  • the specific wavelength image may be obtained using only a sensor element which detects red light.
  • the first color sensor and the second color sensor which detects specific color may be separately placed in a camera or may be integrated into a single sensor in a camera.
  • some sensor elements detect a red wavelength, some detect a green wavelength, some detect a blue wavelength, and some detect the specific wavelength.
  • FIG. 7 is an exemplary color sensor for use in an embodiment of the present invention.
  • the color sensor includes a plurality of sensor elements. Some sensor elements 301 (denoted “R” in FIG. 7) detect a red wavelength, some sensor elements 302 (denoted as “G” in FIG. 7) detect a green wavelength, some sensor elements 303 (denoted as “B” in FIG. 7) detect a blue wavelength, and some sensor elements 304 (denoted as “S” in FIG. 7) detect the specific wavelength.
  • the arrangement of sensor elements may be arbitrarily determined.
  • an RGB image and a specific wavelength image may be sequentially or simultaneously obtained.
  • An RGB image may be obtained at a first timing, and then a specific wavelength image may be obtained at a second timing.
  • a specific wavelength image may be obtained at a first timing, and then an RGB image may be obtained at a second timing.
  • an RGB image and a specific wavelength image may be obtained at the same time.
  • the image processing apparatus combines the first image and the second image to generate a third image.
  • the first image is an RGB image obtained using the red, green, and blue wavelengths and the second image is a specific wavelength image using the specific wavelength.
  • the image processing apparatus combines the RGB image and the specific wavelength image to generate a third image.
  • the third image is output from the image processing device and displayed on a screen.
  • the specific procedure to generate the third image is described below with reference to FIG. 8.
  • FIG. 8 is a schematic diagram of an image processing method according to an embodiment of the present invention.
  • an RGB image is obtained at a first frame timing using the LED flash shown in FIG. 5, the dual camera shown in FIG. 6, or the color sensor shown in FIG. 7, and a specific wavelength image is obtained at a second frame timing using the LED flash shown in FIG. 5, the dual camera shown in FIG. 6, or the color sensor shown in FIG. 7.
  • a specific wavelength image is obtained at a second frame timing using the LED flash shown in FIG. 5, the dual camera shown in FIG. 6, or the color sensor shown in FIG. 7.
  • the specific wavelength image is used for image portions corresponding to spots or freckles.
  • the RGB image is used for image portions corresponding to contours or outlines of face parts such as eyes, a mouth, a nose, or the like.
  • a first luminance component and a first chroma component are obtained from the RGB image.
  • a second luminance component and a second chroma component are obtained from the specific wavelength image.
  • the third image may be generated by combining a low frequency component of the first luminance component and a high frequency component of the second luminance component.
  • the third image may be generated from the RGB image and the specific wavelength image by replacing a high frequency component of the first luminance component with a high frequency component of the second luminance component.
  • luminance levels of the first luminance component and the second luminance component may be adjusted.
  • spots or freckles can be smoothed by using the high frequency component of the second luminance component.
  • contours or outlines of face parts can be preserved by using the low frequency component of the first luminance component.
  • the third image may be generated by combining a low frequency component of the first chroma component and a high frequency component of the second chroma component.
  • the third image may be generated from the RGB image and the specific wavelength image by replacing a high frequency component of the first chroma component with a high frequency component of the second chroma component.
  • chroma levels of the first chroma component and the second chroma component may be adjusted. Colored spots or freckles can be smoothed by using the high frequency component of the second chroma component.
  • contours or outlines of face parts can be preserved by using the low frequency component of the first chroma component.
  • the image processing apparatus obtains a first image and a second image using different light emissions, different cameras, a selectively-applicable color filter, or different sensors, and combines the first image and the second image to generate a third image, thereby improving beautification of a human skin in an image captured by a camera.
  • FIG. 9 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • the image processing apparatus includes a first obtainment unit 401, a second obtainment unit 402, and a combination unit 403.
  • the first obtainment unit 401 is configured to obtain a first image.
  • the first obtainment unit 401 is configured to obtain a first image.
  • step S101 in the method embodiment shown in FIG. 4 and no repeated description is given here.
  • the second obtainment unit 402 is configured to obtain a second image.
  • the second obtainment unit 402 is configured to obtain a second image. For more specific functions and operations in the second obtainment unit 402, reference may be made to the step S102 in the method embodiment shown in FIG. 4, and no repeated description is given here.
  • the first obtainment unit 401 may be configured to obtain a first image, when an LED flash, including at least two LEDs, emits first light or when the LED flash does not emit light.
  • the second obtainment unit 402 may be configured to obtain a second image, when the LED flash emits second light, wherein the second light has a specific wavelength.
  • the first obtainment unit 401 may be configured to obtain a first image using a first camera including an a color sensor.
  • the second obtainment unit 402 may be configured to obtain a second image using a second camera including a color sensor and a specific color filter which passes specific color and is placed in front of the color sensor.
  • the first obtainment unit 401 may be configured to obtain a first image using a camera including a color sensor and a specific color filter which passes specific color, when the specific color filter is not applied.
  • the second obtainment unit 402 may be configured to obtain a second image using the camera, when the specific color filter is applied.
  • the first obtainment unit 401 may be configured to obtain a first image using a first color sensor in a camera.
  • the second obtainment unit 402 may be configured to obtain a second image using a second color sensor which detects specific color.
  • the combination unit 403 is configured to combine the first image and the second image to generate a third image.
  • the combination unit 403 reference may be made to the step S103 in the method embodiment shown in FIG. 4, and no repeated description is given here.
  • the combination unit 403 may be configured to obtain a first luminance component from the first image; obtain a second luminance component from the second image; and combine a low frequency component of the first luminance component and a high frequency component of the second luminance component.
  • the combination unit 403 may be configured to obtain a first chroma component from the first image; obtain a second chroma component from the second image; and combine a low frequency component of the first chroma component and a high frequency component of the second chroma component.
  • the specific wavelength may be a wavelength over which reflectance by hemoglobin is higher than reflectance by melanin.
  • the specific wavelength is a wavelength within a red wavelength region.
  • the specific color has a wavelength over which reflectance by hemoglobin is higher than reflectance by melanin.
  • the specific color is red.
  • the image processing apparatus obtains a first image and a second image using different light emissions, different cameras, a selectively-applicable color filter, or different sensors, and combines the first image and the second image to generate a third image, thereby improving beautification of a human skin in an image captured by a camera.
  • FIG. 10 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention.
  • the image processing apparatus may be a portable multifunction device including a camera 501, a processor 502, a memory 503, and an input/output (I/O) interface 504.
  • the camera 501, the processor 502, the memory 503, and the I/O interface 504 may be coupled to a bus 505.
  • the image processing apparatus also includes an LED flash.
  • the camera 501 is configured to obtain a first image.
  • the camera 501 is also configured to obtain a second image.
  • For more specific functions and operations in the camera 501 reference may be made to the steps S101 and S102 in the method embodiment shown in FIG. 4, and no repeated description is given here.
  • the camera 501 may include a color sensor and may be configured to capture a first image, when the LED flash emits first light or when the LED flash does not emit light, and the camera 501 may be configured to capture a second image when the LED flash emits second light, wherein the second light has a specific wavelength.
  • the camera 501 may be a dual camera including a first camera, including a color sensor, and a second camera, including a color sensor and a specific color filter which passes specific color and is placed in front of the color sensor.
  • the first camera may be configured to capture a first image
  • the second camera may be configured to capture a second image.
  • the camera 501 may include a color sensor and a specific color filter which passes specific color.
  • the camera 501 may be configured to capture a first image, when the specific color filter is not applied, and the camera 501 may be configured to capture a second image, when the specific color filter is applied.
  • the camera 501 may include a first color sensor and a second color sensor which detects specific color.
  • the camera 501 may be configured to capture a first image using the first color sensor, and may be configured to capture a second image using the second color sensor.
  • the processor 502 may read a computer-readable program code stored in a memory 503 and may be configured to combine the first image and the second image to generate a third image.
  • a computer-readable program code stored in a memory 503 and may be configured to combine the first image and the second image to generate a third image.
  • the processor 502 may be configured to generate a first luminance component from the first image; generate a second luminance component from the second image; and combine a low frequency component of the first luminance component and a high frequency component of the second luminance component.
  • the processor 502 may be configured to generate a first chroma component from the first image; generate a second chroma component from the second image; and combine a low frequency component of the first chroma component and a high frequency component of the second chroma component.
  • the I/O interface 504 may be connected to a display so as to display the third image on a screen.
  • the image processing apparatus obtains a first image and a second image using different light emissions, different cameras, a selectively-applicable color filter, or different sensors, and combines the first image and the second image to generate a third image, thereby improving beautification of a human skin in an image captured by a camera.
  • FIG. 11 shows an original image, a smoothed image according to the prior art, and an image processed according to an embodiment of the present invention.
  • FIG. 11 (A) there are spots or freckles in the original image.
  • a smoothing filter or a de-noise filter as shown in FIG. 11 (B) , some of the spots or freckles are smoothed, but some of the spots or freckles cannot be removed and big pockmarks or deep colored spots remain.
  • FIG. 11 (C) some of the spots or freckles which cannot be removed according to the prior art can be removed.
  • the present invention can improve beautification of a human skin in an image captured by a camera.
  • each aspect of the present invention or a possible implementation manner of each aspect may be specifically implemented as a device, a method, or a computer program product. Therefore, each aspect of the present invention or a possible implementation manner of each aspect may use forms of hardware only embodiments, software only embodiments (including firmware, resident software, and the like) , or embodiments with a combination of software and hardware. In addition, each aspect of the present invention or a possible implementation manner of each aspect may take a form of a computer program product, where the computer program product refers to a computer-readable program code stored in a computer-readable medium.
  • the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium.
  • the computer-readable storage medium includes but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semi-conductive system, device, or apparatus, or any appropriate combination thereof, such as a random access memory (RAM) , a read-only memory (ROM) , an erasable programmable read only memory (EPROM or flash memory) , an optical fiber, and a compact disc read-only memory (CD-ROM) .
  • a processor in a computer reads computer-readable program code stored in a computer-readable medium, so that the processor can perform a function and an action specified in each step or a combination of steps in a flowchart; and an apparatus is generated to implement a function and an action specified in each block or a combination of blocks in a block diagram.
  • each step in the flowcharts or functions specified in each block in the block diagrams may not occur in the illustrated order.
  • two steps or two blocks illustrated consecutively may in fact be executed substantially at the same time, or these blocks may sometimes be executed in reverse order.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

La présente invention concerne un procédé de traitement d'image, un appareil de traitement d'image, un dispositif multifonction portable et un support de stockage lisible par ordinateur. Le procédé de traitement d'image consiste, au niveau d'un dispositif multifonction portable ayant un flash à diodes électroluminescentes (DEL), comprenant au moins deux DEL, une caméra, comprenant un capteur de couleur, et un ou plusieurs processeurs, à obtenir, par la caméra, une première image lorsque le flash à DEL émet une première lumière ou lorsque le flash à DEL n'émet pas de lumière; à obtenir, par la caméra, une deuxième image lorsque le flash à DEL émet une seconde lumière, la seconde lumière ayant une longueur d'onde spécifique; et à combiner, par le ou les processeurs, la première image et la deuxième image pour générer une troisième image. Par utilisation de la longueur d'onde spécifique, le premier aspect améliore l'embellissement d'une peau humaine dans une image capturée par une caméra.
PCT/CN2016/077687 2016-03-29 2016-03-29 Procédé de traitement d'image, appareil de traitement d'image, dispositif multifonction portable, et support de stockage lisible par ordinateur Ceased WO2017166057A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680084256.2A CN108886563B (zh) 2016-03-29 2016-03-29 图像处理方法、图像处理装置、便携式多功能设备
PCT/CN2016/077687 WO2017166057A1 (fr) 2016-03-29 2016-03-29 Procédé de traitement d'image, appareil de traitement d'image, dispositif multifonction portable, et support de stockage lisible par ordinateur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/077687 WO2017166057A1 (fr) 2016-03-29 2016-03-29 Procédé de traitement d'image, appareil de traitement d'image, dispositif multifonction portable, et support de stockage lisible par ordinateur

Publications (1)

Publication Number Publication Date
WO2017166057A1 true WO2017166057A1 (fr) 2017-10-05

Family

ID=59962497

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/077687 Ceased WO2017166057A1 (fr) 2016-03-29 2016-03-29 Procédé de traitement d'image, appareil de traitement d'image, dispositif multifonction portable, et support de stockage lisible par ordinateur

Country Status (2)

Country Link
CN (1) CN108886563B (fr)
WO (1) WO2017166057A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107862653A (zh) * 2017-11-30 2018-03-30 广东欧珀移动通信有限公司 图像显示方法、装置、存储介质和电子设备

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110926343B (zh) * 2019-11-28 2025-01-28 西安联创兴科测控科技有限公司 一种裂缝动态变化参数的绝对测量装置及测量方法
CN111479075B (zh) * 2020-04-02 2022-07-19 青岛海信移动通信技术股份有限公司 拍照终端及其图像处理方法
WO2023028768A1 (fr) * 2021-08-30 2023-03-09 Oppo广东移动通信有限公司 Réseau de filtres optiques, procédé, capteur d'images, dispositif et appareil électronique
CN117561721A (zh) * 2021-08-30 2024-02-13 Oppo广东移动通信有限公司 滤光器阵列、方法、图像传感器、装置及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006115316A (ja) * 2004-10-15 2006-04-27 Matsushita Electric Ind Co Ltd 撮像装置及び携帯機器
WO2008062967A1 (fr) * 2006-11-22 2008-05-29 Chang-Hwan Kim Appareil de mesure d'état de la peau intégré dans un pda
CN102244789A (zh) * 2010-05-12 2011-11-16 索尼公司 成像设备
CN104125442A (zh) * 2013-04-26 2014-10-29 索尼公司 图像处理方法、装置以及电子设备
CN105187726A (zh) * 2015-06-17 2015-12-23 广州市巽腾信息科技有限公司 一种多功能移动图像处理装置、处理方法及用途

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI220505B (en) * 2001-08-13 2004-08-21 Ulead Systems Inc Image enhancement method
TWI314720B (en) * 2005-05-31 2009-09-11 Himax Tech Inc 2d yc separation device and yc separation system
KR101329133B1 (ko) * 2007-11-29 2013-11-14 삼성전자주식회사 임장감 향상을 위한 질감 재현 시스템 및 방법 그리고 채도보정 시스템 및 방법
CN101425179B (zh) * 2008-11-18 2012-03-28 清华大学 一种人脸图像重光照的方法及装置
US20140321739A1 (en) * 2013-04-26 2014-10-30 Sony Corporation Image processing method and apparatus and electronic device
CN104267933A (zh) * 2014-08-21 2015-01-07 深圳市金立通信设备有限公司 一种闪光灯调节方法
CN105303545A (zh) * 2015-11-25 2016-02-03 中国矿业大学(北京) 一种多光谱影像和全色卫星影像融合方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006115316A (ja) * 2004-10-15 2006-04-27 Matsushita Electric Ind Co Ltd 撮像装置及び携帯機器
WO2008062967A1 (fr) * 2006-11-22 2008-05-29 Chang-Hwan Kim Appareil de mesure d'état de la peau intégré dans un pda
CN102244789A (zh) * 2010-05-12 2011-11-16 索尼公司 成像设备
CN104125442A (zh) * 2013-04-26 2014-10-29 索尼公司 图像处理方法、装置以及电子设备
CN105187726A (zh) * 2015-06-17 2015-12-23 广州市巽腾信息科技有限公司 一种多功能移动图像处理装置、处理方法及用途

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107862653A (zh) * 2017-11-30 2018-03-30 广东欧珀移动通信有限公司 图像显示方法、装置、存储介质和电子设备
CN107862653B (zh) * 2017-11-30 2021-08-17 Oppo广东移动通信有限公司 图像显示方法、装置、存储介质和电子设备

Also Published As

Publication number Publication date
CN108886563A (zh) 2018-11-23
CN108886563B (zh) 2020-09-11

Similar Documents

Publication Publication Date Title
CN108886563B (zh) 图像处理方法、图像处理装置、便携式多功能设备
JP6312714B2 (ja) 陰影検出および減衰のためのマルチスペクトル撮像システム
US20180069996A1 (en) Method and electronic device for producing composite image
CN105744248B (zh) 摄像方法
JP2016535654A5 (fr)
US10939799B2 (en) Image processing apparatus, endoscope system, image processing method, image processing program, and recording medium
CN104125442A (zh) 图像处理方法、装置以及电子设备
US20140321739A1 (en) Image processing method and apparatus and electronic device
US11146760B2 (en) Imaging apparatus, imaging method, and computer readable recording medium
CN111343898A (zh) 内窥镜系统及其工作方法
US9600735B2 (en) Image processing device, image processing method, program recording medium
CN105813538A (zh) 活体观察系统
JP2020077165A5 (fr)
US10565687B2 (en) Image processing apparatus, imaging apparatus, image processing method, image processing program, and recording medium
CN110769738A (zh) 图像处理装置、内窥镜装置、图像处理装置的工作方法及图像处理程序
CN105513017B (zh) 图像去雾处理方法、装置及摄像设备
JP6550827B2 (ja) 画像処理装置、画像処理方法及びプログラム
JPWO2019155816A1 (ja) 内視鏡システム
JP2016193107A (ja) 画像処理装置
CN111343899A (zh) 内窥镜系统及其工作方法
JP2020130636A (ja) 血中酸素飽和度計測装置、血中酸素飽和度計測方法、及び、プログラム
JP2016178600A5 (fr)
CN112004455B (zh) 医疗图像处理系统
CN104954658A (zh) 一种电子设备及数据处理方法
JP2014178146A (ja) 画像処理装置及び方法

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16895838

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16895838

Country of ref document: EP

Kind code of ref document: A1