JP2017194855A - Image processing apparatus, image processing method, image processing program, and image processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve three-dimensional visibility on a two-dimensional medium of two-dimensional image data acquired from data including three-dimensional coordinates.SOLUTION: An image forming apparatus 100 is an image processing apparatus that performs image processing on two-dimensional image data obtained by observing a three-dimensional model present in a three-dimensional space from a specific observation point in the three-dimensional space. The image forming apparatus comprises: a shading detection part 201 that acquires shading information (id) indicating the degree of influence of a light source present in the three-dimensional space on pixels constituting the two-dimensional image data on the basis of information on the three-dimensional position of the light source present in the three-dimensional space; and a luminance correction part 203 and a glossiness correction part 204 that perform emphasis processing of improving three-dimensional visibility of the two-dimensional image data on the basis of the shading information acquired by the shading detection part 201.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image processing apparatus, an image processing method, an image processing program, and an image processing system.

In recent years, using a three-dimensional model creation software such as CAD, a three-dimensional model is created in a three-dimensional space represented by xyz coordinate axes, and an overall image is grasped. Then, each part is designed and produced based on the three-dimensional model. It is generalized.
Prior to the advent of 3D printers, a 3D model created in a 3D space could only be confirmed on a 2D medium such as a display. However, with the advent of 3D printers, By creating a simple three-dimensional body, it is possible to grasp the three-dimensional effect, making it easier to image the whole image.

  However, although a 3D printer is suitable for reproducing a three-dimensional structure expressed on a two-dimensional medium, it takes a lot of time to create one three-dimensional body. In addition, a three-dimensional body created by a 3D printer has a significantly lower positional accuracy than an image printed by an image forming apparatus such as a printer, and a three-dimensional model is formed with complex colors. In some cases, 3D printers cannot reproduce colors, and there is a problem that even if a rough three-dimensional structure can be reproduced, the original features cannot be grasped.

  Therefore, a technique for improving stereoscopic visibility so that a three-dimensional subject or a three-dimensional model can be viewed three-dimensionally on a two-dimensional medium is known.

When a human grasps the stereoscopic effect of a three-dimensional structure from an image displayed or printed on a two-dimensional medium, it is performed by unconsciously capturing color information forming an image such as a shadow or gloss.
For shadows, for example, the amount of light hitting the surface of the subject varies depending on the location depending on the position of the light source when the photograph was taken, so that it can be visually recognized as a change in relative color information, and the user appeared in the photograph The 3D structure can be recognized by capturing the shadows unconsciously. In addition, by setting a virtual light source in the same space as the 3D model created by the 3D model creation software, the amount of light irradiated on the surface of the 3D model can be changed relatively, and shadows It is also possible to create it.

For gloss, for example, an image forming apparatus such as a printer overlays a transparent or translucent image forming material such as transparent toner or transparent ink on a chromatic image forming material such as chromatic color toner or chromatic color ink. It is effective when it is desired to enhance the stereoscopic effect of the image. The glossiness depends on the smoothness of the image plane. As shown in FIG. 11A, the surface of the image formed only with the chromatic image forming material has many irregularities, and the reflected light on the surface is irregularly reflected. The glossiness is low.
On the other hand, as shown in FIG. 11B, by applying a transparent or translucent image forming material so that the surface of the image formed with the chromatic image forming material becomes flat, Reflected light is reflected in a uniform direction, and the glossiness is higher than that of a surface with many irregularities.

  As a technique for expressing a three-dimensional effect by adjusting the gloss level, for example, Patent Document 1 discloses that thermal information is printed so that a bright portion is bright and a dark portion is matte with respect to image information to be printed. It is disclosed that a gloss distribution is generated on the surface of a print medium by adjusting a heating temperature by a head, and a stereoscopic effect is imparted to an image.

  Further, in Patent Document 2, in a hard copy such as a photographic print or printed matter, the surface area of a highly glossy object such as metallic or glass is reduced according to the object present in the printed image, It is described that a three-dimensional appearance of an image is suitably expressed by adjusting the surface roughness of each region on which an object is formed so that the surface roughness of a region with low gloss such as wooden or cloth is increased. ing. Furthermore, if a highly glossy object exists in front of the object according to the position of the object, the surface roughness of the area is reduced, the surface roughness of the other area is increased, and conversely the glossiness is low. It is disclosed that when an object is present in front, the surface roughness of the region is increased and the surface roughness of the other region is decreased to suitably express the stereoscopic effect of the image.

A conventional image forming apparatus analyzes image area separation information such as a character area and an image area from two-dimensional image data, performs image processing suitable for each, and determines an application amount of an image forming material to be applied to a print medium. Was done.
However, it is possible to determine whether the color information of the two-dimensional image data is affected by a specific light source, and whether the target pixel is not exposed to light emitted from the specific light source and the specific light source. It was not possible to determine which of the areas directly exposed to the irradiated light was by simply analyzing the two-dimensional image data.
For this reason, image processing that takes into account the degree of influence of the light source cannot be performed, and processing for improving stereoscopic visibility that takes into account the degree of influence of the light source for each pixel cannot be performed.

  Patent Document 1 describes that a stereoscopic effect is imparted by adjusting the glossiness based on the luminance of image information. However, if the subject or the three-dimensional model is affected by a light source, It is not considered whether the luminance of the surface of the three-dimensional model is low or whether the luminance is low due to the low amount of light emitted from the light source. For this reason, accurate processing is not performed on the shadow, which is one of the elements for recognizing the three-dimensional structure of the object, and it is insufficient for expressing the three-dimensional structure.

  Patent Document 2 discloses that the stereoscopic effect is suitably expressed by adjusting the glossiness based on the glossiness or positional relationship of the object present in the printed image, but improves the reproducibility of the object itself. Only the process is performed, and the process for further improving the stereoscopic visibility by focusing on the shadow is not performed.

  The present invention has been made in view of the above, and its purpose is to perform processing based on the degree of influence of a light source on two-dimensional image data obtained by observing a three-dimensional model in a three-dimensional space from a specific observation point. This is to improve the stereoscopic visibility of the two-dimensional image data.

  In order to solve the above-described problems, the present invention provides image processing for performing image processing on two-dimensional image data obtained by observing a three-dimensional model existing in a three-dimensional space from a specific observation point in the three-dimensional space. Shadow information acquisition that is a device and acquires shadow information indicating the degree of influence of a light source existing in a three-dimensional space in a pixel constituting two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space. And a correction unit that performs an enhancement process that increases the stereoscopic visibility of the two-dimensional image data based on the shadow information acquired by the shadow information acquisition unit.

  ADVANTAGE OF THE INVENTION According to this invention, the process which improves the stereoscopic visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

1 is a diagram illustrating a hardware configuration example of an image forming apparatus and an information processing terminal according to an embodiment of the present invention. 1 is a diagram illustrating a configuration example of an image engine of an image forming apparatus according to an embodiment of the present invention. 1 is a diagram illustrating an example of a functional configuration of an image forming apparatus according to an embodiment of the present invention. (A) and (b) are figures which show an example of the extraction method of the two-dimensional image data based on one Embodiment of this invention. It is a figure which shows the specific example of the shadow information in the three-dimensional data which concerns on one Embodiment of this invention. (A)-(c) is a figure which shows the specific example of the identification method of the area | region used as the shadow which concerns on one Embodiment of this invention. (A)-(c) is a figure which shows an example of the coating amount determination method of the transparent toner which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the shadow information detection flow by the shadow detection part which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the luminance adjustment flow by the luminance correction part which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the gloss correction flow by the gloss correction part which concerns on one Embodiment of this invention. (A) (b) is a side view for demonstrating glossiness.

  A specific embodiment of a transparent toner coating amount determination method in an image forming apparatus according to the present invention will be described below with reference to the accompanying drawings. The embodiment described below shows a method for determining the application amount of transparent toner in an electrophotographic image forming apparatus using transparent toner, but the image forming material that expresses gloss is not limited to transparent toner. For example, transparent ink Even that is possible. Further, the apparatus for calculating the application amount of the image forming material that expresses gloss is not limited to the image forming apparatus, and may be an information processing terminal such as a PC or a smartphone.

<Image forming apparatus>
FIG. 1 is a diagram illustrating a hardware configuration of an image forming apparatus 100 and an information processing terminal 110 that function as an image processing apparatus according to an embodiment of the present invention.
The image forming apparatus 100 is an apparatus having a function of forming an image using an image forming material on a print medium such as an MFP or a printer. The information processing terminal 110 is, for example, a PC or a smartphone, and has a display and an operation unit for a user to operate, and is a terminal for performing various processes.
As shown in FIG. 1, an image forming apparatus 100 according to this embodiment includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, an image engine 104, a network I / F. (Interface) 105, HDD (Hard Disk Drive) 106, and operation I / F 107 are connected via a bus 108.
In the information processing terminal 110 according to the present embodiment, a CPU 111, a RAM 112, a ROM 113, a network I / F 114, an HDD 115, an operation I / F 116, and a display 117 are connected via a bus 118. The image forming apparatus 100 and the information processing terminal 110 are connected via a network such as a LAN.

  The CPU 101 is an arithmetic processing unit in the image forming apparatus 100 and controls the overall operation of the image forming apparatus 100 based on a control program. The RAM 102 is a volatile storage medium for reading and writing information at high speed, and functions as a work area when the CPU 101 executes a control program. The ROM 103 is a read-only nonvolatile storage medium in which a control program is stored. The image engine 104 is a mechanism that executes image formation on a print medium.

  The network I / F 105 is a communication interface that connects to a network such as a LAN. In this embodiment, the network I / F 105 is connected to a terminal such as a 3D scanner, a PC, or a smartphone. The HDD 106 is a large-capacity nonvolatile storage medium that can read and write information, and stores a control program, an application, and the like. The HDD 106 may be another type of storage device such as an SSD (Solid State Drive).

  The operation I / F 107 is an interface that accepts input from the user through a keyboard, a touch panel, or the like. Information from the operation I / F 107 is output to the CPU 101. The CPU 101 can execute various programs stored in the ROM 103 and the HDD 106 and can communicate with the information processing terminal 110 via the operation I / F 107 and the network I / F 105.

  The CPU 111 is an arithmetic processing unit in the information processing terminal 110, and controls the overall operation of the information processing terminal 110 based on a control program. The RAM 112 is a volatile storage medium for reading and writing information at high speed, and functions as a work area when the CPU 111 executes a control program. The ROM 113 is a read-only nonvolatile storage medium in which a control program is stored.

  The network I / F 114 is a communication interface connected to a network such as a LAN, and is connected to the image forming apparatus 100 in the present embodiment. The HDD 115 is a large-capacity nonvolatile storage medium that can read and write information, and stores a control program, an application, and the like. The HDD 115 may be another type of storage device such as an SSD.

  The operation I / F 116 is an interface that accepts an input from a user through a keyboard, a touch panel, or the like. Information from the operation I / F 116 is output to the CPU 111. The CPU 111 can execute various programs stored in the ROM 113 and the HDD 115 and can communicate with the image forming apparatus 100 via the operation I / F 116 and the network I / F 114. A display 117 is a liquid crystal panel having a display function, and displays an operation reflecting a user operation via the operation I / F.

<Image engine>
FIG. 2 is a diagram for explaining a configuration example of the image engine 104 according to an embodiment of the present invention.
As shown in FIG. 2, developing units 11K, 11C, 11M, 11Y, and 11T for each color are arranged along the transfer belt 12. The developing units 11K, 11C, 11M, 11Y, and 11T are units for forming a toner image on the transfer belt 12.
In forming an image, the outer peripheral surface of the photoreceptor 1K is uniformly charged by the charger 2K in the dark, and then an electrostatic latent image is formed on the photoreceptor 1K by the exposure beam 3K from the exposure unit. The developing device 4K visualizes the electrostatic latent image with toner, thereby forming a toner image on the photoreceptor 1K.
This toner image is primarily transferred onto the transfer belt 12 by the action of the primary transfer charger 5K at the position where the photoreceptor 1K and the transfer belt 12 are in contact with each other. A toner image is formed on the transfer belt 12 by the primary transfer. After the primary transfer of the toner image has been completed, the photoreceptor 1K waits for the next image formation after the unnecessary toner remaining on the outer peripheral surface is wiped off by the cleaning blade 6K.

The toner image formed on the transfer belt 12 by the developing unit 11K is conveyed to the developing unit 11C.
In the developing unit 11 </ b> C, a toner image formed by the same process as the image forming process in the developing unit 11 </ b> K is superimposed and superimposed on the toner image formed on the transfer belt 12. The toner image on the transfer belt 12 is further conveyed to the next developing units 11M and 11Y, and is superposed on the transfer belt 12 and primarily transferred by the same operation. Thus, a full color toner image is formed on the transfer belt 12.

The full-color toner image formed on the transfer belt 12 by the developing units 11K, 11C, 11M, and 11Y is conveyed to the developing unit 11T.
The developing unit 11T is a unit for primary transfer of transparent toner. In the developing unit 11T, a toner image created by a process similar to the image forming process in the developing unit 11K is primary-transferred superimposed on the toner image formed on the transfer belt 12. Thus, a toner image in which the transparent toner is superimposed on the full-color toner image is formed on the transfer belt 12. The toner image on which the transparent toner is superimposed is conveyed to the position of the secondary transfer roller 13 and is secondarily transferred to the sheet 15 conveyed at a timing described later.

  The paper 15 stored in the paper feed tray 16 is a printing medium, and is sequentially sent to the transport roller pair 18 by the paper feed roller 17 in accordance with image formation. The sheets 15 sent out to the conveying roller pair 18 are sequentially sent out to the registration roller pair 19. The driving of the registration roller pair 19 is started at a timing such that the toner image conveyed by the transfer belt 12 and the secondary transfer roller 13 overlap the toner image and the paper 15 at an appropriate position. The sheet 15 sent out by the registration roller pair 19 is secondarily transferred with the toner image on the transfer belt 12 by the secondary transfer roller 13, and then the toner image is fixed by the fixing device 20. Paper is discharged to the outside.

<Information processing terminal and image forming apparatus>
FIG. 3 is a diagram showing a functional configuration of the information processing terminal 110 and the image forming apparatus 100 according to an embodiment of the present invention.
Note that the functions of the image data extraction unit 200, the shadow detection unit 201, the color correction unit 202, the luminance correction unit 203, the gloss correction unit 204, and the halftone processing unit 205 described in the present embodiment are the CPU 101 of the image forming apparatus 100. Is realized.
In the present embodiment, data used for processing stored in the ROM 103 is stored in the HDD 115 or the like except for printing processing on a printing medium by the image engine 104, so that some or all of the processing can be performed. It may be performed by the CPU 111 of the information processing terminal 110.

  The information processing terminal 110 is a dfx format file that is data including coordinates, color information, surface information, light source coordinates, etc. of a three-dimensional model in a three-dimensional space represented by an xyz coordinate system in response to an input from a user. Create 3D data such as formats.

The image data extraction unit 200 extracts two-dimensional image data when a three-dimensional model is captured from a specific observation point based on the received three-dimensional data.
Specifically, the image data extraction unit 200 extracts two-dimensional image data having pixel values of color information of coordinates at which a straight line passing through the observation point first intersects with the three-dimensional model or the background surface.
<Extraction of 2D image data>
FIG. 4A and FIG. 4B are diagrams illustrating a specific example of extracting 2D image data from 3D data. 4A is a diagram in which a three-dimensional model existing in a three-dimensional space is captured from a specific observation point A. FIG. Here, when the color information of the coordinates at which the straight line passing through the observation point A first intersects the three-dimensional model, the background surface, and the bottom surface is acquired, two-dimensional image data as shown in FIG. 4B is obtained. The number of color information of coordinates to be acquired depends on the resolution of the two-dimensional image data to be created. The three-dimensional data used here may be obtained through a recording medium such as a USB memory in addition to being received from the information processing terminal 110 via a network.

The shadow detection unit 201 constitutes a shadow information acquisition unit, and sets shadow information (id) for each coordinate of the two-dimensional image data extracted by the image data extraction unit 200 based on the three-dimensional data.
The shadow information refers to a region (id = 1), a shaded region (id = 2), a shaded region (id = 3), and other regions (id = 0) where light from a light source directly shines in a three-dimensional space. ). The shaded area (id = 2) and the shadowed area (id = 3) are areas where light from the light source does not shine directly.

<Shadow information>
FIG. 5 is a diagram for specifically explaining the shadow information in the three-dimensional data.
A light source is a point of coordinates in a three-dimensional space, and is a point that irradiates light in all directions. The F plane is a bottom surface portion representing the plane on which the three-dimensional model is placed, and the coordinates constituting the F plane correspond to other regions (id = 0).
The area where the light is directly irradiated (id = 1) corresponds to the coordinates constituting the A surface and the C surface where the light from the light source is directly irradiated. The shaded area (id = 2) indicates coordinates at which the light from the light source does not directly shine on the surface side of the three-dimensional model, and corresponds to coordinates constituting the B, D, and E planes. The shadowed area (id = 3) indicates coordinates where light from the light source is not directly irradiated by light being blocked by the three-dimensional model, and coordinates forming part of the C plane and coordinates forming the F plane. Part of this applies.

Next, a method for discriminating between a region (id = 1) in which light directly shines and a region (id = 2) that is shaded will be described.
The shadow detection unit 201 determines the direction in which the light beam linearly emitted from the light source penetrates the surface constituting the three-dimensional model. When the light ray penetrates from the front side to the back side with respect to the surface constituting the three-dimensional model, it is set to a region (id = 1) where the light is directly irradiated with respect to the coordinates constituting the surface.
When the light ray penetrates from the back side to the front side with respect to the surface constituting the three-dimensional model, it is set to a region (id = 2) which is shaded with respect to the coordinates constituting the surface.
Here, the front side means the surface of the 3D model that faces the outside of the 3D model, and the back side means the 3D model of the 3D model. It means the surface facing inward. The direction in which the light beam penetrates is determined by vector calculation.

<Identification method of shadow area (id = 3)>
Next, with reference to FIG. 6A to FIG. 6C, a method for identifying a shadow area (id = 3) will be described.
FIG. 6 shows an example in which light rays from the light source are irradiated in parallel to the x-axis direction, and the z-axis coordinates of the light source and the three-dimensional model are substantially equal.
The shadow detection unit 201 calculates the coordinates of the point at which the light beam irradiated from the light source and passed through the coordinates constituting the surface of the three-dimensional model first intersects either the xz plane of the background part or the three-dimensional model. It is determined that the area becomes a shadow (id = 3).
FIG. 6A shows an example in which a light beam that has passed through the coordinates constituting the surface of the three-dimensional model first intersects with the coordinates that constitute the xz plane of the background portion. In FIG. 6 (a), the light beam passing through the coordinate P constituting the G plane first intersects with the coordinate Q constituting the xz plane of the background portion, and the coordinate Q at this time is a shadow area (id = 3). ).
FIG. 6B shows an example in which a light beam that has passed through the coordinates constituting the surface of the three-dimensional model first intersects with the coordinates that constitute the three-dimensional model. In FIG. 6B, the light beam that has passed through the coordinate P that constitutes the G plane first intersects with the coordinate Q that constitutes the three-dimensional model, and the coordinate Q at this time is a shadowed area (id = 3). to decide.
FIG. 6C shows another example in the case where the light beam that has passed through the coordinates constituting the surface of the three-dimensional model first intersects with the coordinates that constitute the three-dimensional model. In FIG. 6C, the light beam that has passed through the coordinate P that constitutes the G plane first intersects with the coordinate Q that constitutes the three-dimensional model, and the coordinate Q at this time is a shadowed area (id = 3). to decide.

  The shadow detection unit 201 sets shadow information (id) for each coordinate constituting the background part and the three-dimensional model in the three-dimensional data. However, the shadow directing area (id = 1) and the shadowing area (id = The id of the shadow area (id = 3) is set in the coordinates of the area where 3) overlaps. Also, the shadow detection unit 201 sets the id of the shadow area (id = 2) to the coordinates of the area where the shadow area (id = 2) and the shadow area (id = 3) overlap. .

  The shadow detection unit 201 sets the shadow information (id) for the coordinates constituting the three-dimensional data, and then applies the same shadow information (id) to the pixels of the two-dimensional image data corresponding to the coordinates of the three-dimensional space. Set. With this processing, it is possible to obtain two-dimensional image data in which shadow information (id) is set for each pixel.

  The color correction unit 202 refers to the two-dimensional image data (RGB data) having RGB gradation values developed in the RAM 102 with reference to the color conversion table stored in the ROM 103 and having CMYK gradation values. Convert to image data (CMYK data). The CMYK data is data indicating a coating amount for forming a C plate using C toner, an M plate using M toner, a Y plate using Y toner, and a K plate using K toner, and takes values from 0 to 255. And

The brightness correction unit 203 constitutes a correction unit, and the brightness of each pixel in the CMYK data corresponds to each shadow information (id) stored in the ROM 103 based on the shadow information determined by the shadow detection unit 201. Adjust with reference to the γ curve.
The γ curve corresponding to the region (id = 1) where light is directly irradiated is set so that the luminance of the pixel after conversion is higher than the luminance of the pixel before conversion.
The γ curves corresponding to the shadowed area (id = 2) and the shadowed area (id = 3) are set so that the luminance of the pixel after conversion is lower than the luminance of the pixel before conversion. .
Further, the γ curve corresponding to the shadowed area (id = 3) has a change amount of the luminance of the pixel before the conversion and the luminance of the pixel after the conversion than the γ curve corresponding to the shadowed area (id = 2). Is set to be large.
The luminance correction unit 203 does not adjust the luminance for pixels for which other regions (id = 0) are set. Thus, the stereoscopic visibility of 2D image data can be improved by performing the process which emphasizes the brightness | luminance of 2D image data for every area | region.

The gloss correction unit 204 constitutes a correction unit, determines the transparent toner amount to be applied based on the shadow information detected by the shadow detection unit 201, and creates CMYKα data by adding the transparent toner application amount data to the CMYK data To do.
<Applied amount of transparent toner>
FIGS. 7A to 7C are diagrams for explaining a method of determining the application amount of the transparent toner in the region to which the respective shadow information (id) is given. The vertical axes CMYK1 to 5 are the pixels 1 to 5, respectively. The amount of CMYK toner applied is shown, and the vertical axes α1 to α5 show the amount of transparent toner applied to the pixels 1 to 5, respectively. Pixels 1 to 5 indicate pixels to which the same continuous shadow information (id) is given.
FIG. 7A is a diagram illustrating the amount of transparent toner applied to a pixel in which a region (id = 1) where light is directly irradiated is set.
The gloss correction unit 204 sets, as a transparent toner application amount, a value obtained by subtracting the application amount of CMYK toner applied to the target pixel from the reference value (id = 1) with respect to an area (id = 1) where light is directly irradiated. To do. For the reference value (id = 1), the gloss correction unit 204 includes a CMYK toner application amount for each pixel in a region where pixels in which a region (id = 1) where light directly shines are set are continuously formed. The maximum value is detected, and a value obtained by adding a certain value to the coating amount may be set as the reference value (id = 1) of the target region, or the region (id = 1) where light is directly irradiated Even if the maximum applied amount of CMYK toner applied for each pixel is detected and a certain value is added to the applied amount, it is set as the reference value (id = 1) in the two-dimensional image data. good.

FIG. 7B illustrates the amount of transparent toner applied to a pixel in which a shaded area (id = 2) is set.
The gloss correction unit 204 sets, as a transparent toner application amount, a value obtained by subtracting the application amount of CMYK toner applied to the target pixel from the reference value (id = 2) for the shaded region (id = 2). . The gloss correction unit 204 is set so that the transparent toner is not applied when the application amount of the CMYK toner exceeds the reference value (id = 2). The gloss correction unit 204 uses the average value of the amount of CMYK toner applied in a region where pixels having a shaded region (id = 2) are set for a reference value (id = 2) as a target region. May be set as the reference value (id = 2), or the average value of the CMYK toner application amount in the area where the shadow area (id = 2) is set is the reference value (id in the two-dimensional image data) = 2).

FIG. 7C illustrates the amount of transparent toner applied to a pixel in which a shadow area (id = 3) is set.
The gloss correction unit 204 sets a value obtained by subtracting the application amount of the CMYK toner applied to the target pixel from the reference value (id = 3) as the application amount of the transparent toner for the shadowed area (id = 3). . The gloss correction unit 204 is set so as not to apply the transparent toner when the application amount of the CMYK toner exceeds the reference value (id = 3). The gloss correction unit 204 applies a value less than the average value of the CMYK toner application amount in a region where pixels having a shadow region (id = 3) are set with respect to the reference value (id = 3). May be set as a reference value (id = 3) for a region to be a two-dimensional image, and a value less than the average value of the amount of CMYK toner applied in a region where a shadowed region (id = 3) is set It may be set as a reference value (id = 3) in the data. As a method of setting a value less than the average value of the application amount of CMYK toner, for example, a method of setting a value that is half of the average value can be mentioned.

  By the processing of the gloss correction unit 204 described above, the smoothness of the image decreases in the order of the area where the light is directly irradiated (id = 1), the shadowed area (id = 2), and the shadowed area (id = 3). Further, since the number of pixels to which the transparent toner is applied is reduced, as a result, an area where light is directly irradiated (id = 1), a shadow area (id = 2), and a shadow area (id = 3) are set. The glossiness decreases in the order of pixels. As described above, the stereoscopic visibility can be improved by performing the enhancement process such that the glossiness of the image printed on the print medium is different for each region.

  The halftone processing unit 205 performs halftone processing such as dither processing and error diffusion processing based on the application amount of each toner, and creates CMYK data and transparent toner data indicating the application amount of each toner for each pixel.

  The image engine 104 forms an image on a print medium based on the CMYK data and the transparent toner data created by the halftone processing unit 205.

<Shadow detection unit>
FIG. 8 is a flowchart showing a processing flow of the shadow detection unit 201 according to the embodiment of the present invention.

First, the shadow detection unit 201 determines whether or not the shadow detection function is ON (S100). Here, ON / OFF setting of the shadow function is performed by operating the operation I / F 107 or the operation I / F 116. If the shadow detection function is set to OFF (S100, No), the process ends.
When the shadow detection function is set to ON (S100, Yes), the shadow detection unit 201 applies a light beam emitted linearly from a light source to a surface forming the three-dimensional model. The penetrating direction is determined (S101), and if penetrating from the front side (S102, Yes), an area (id = 1) where light is directly irradiated is set with respect to the coordinates of the surface constituting the corresponding three-dimensional model. (S103).
On the other hand, when penetrating from the back side (S102, No), the shadow detection unit 201 sets a shadow area (id = 2) with respect to the coordinates of the surface constituting the corresponding three-dimensional model (S104). . It is determined whether or not the above-described processing has been performed on all target surfaces, and if all the surfaces have been processed (S105, Yes), the process proceeds to S106 and there is a surface that has not been processed. If so (S105, No), the process returns to S101.

When all the surfaces have been processed, the shadow detection unit 201 determines whether the light ray passing through the coordinates constituting the surface of the three-dimensional model is one of the background portion and the three-dimensional model constituting the three-dimensional data. The coordinates of the point that first intersects with one are determined to be a shadow area (id = 3) (S106).
Here, the shadow detection unit 201 sets the coordinates (id = 1) and (id = 3) overlapped to (id = 3), and (id = 2) and (id = 3). Coordinates set by overlapping are set to (id = 3) (S107).
Next, the shadow detection unit 201 determines whether or not there is a coordinate of a three-dimensional model or background portion for which no id is set. If there is a coordinate for which no id is set, the corresponding pixel is moved to another region ( id = 0) is set (S108). Next, the shadow detection unit 201 sets the same shadow information (id) for the pixels of the two-dimensional image data corresponding to the coordinates of the three-dimensional data (S109), and ends the process.

<Brightness correction unit>
FIG. 9 is a flowchart showing a processing flow of the luminance correction unit 203 according to the embodiment of the present invention. The processing by the brightness correction unit 203 is performed when the shadow detection function is set to ON.

The luminance correction unit 203 determines whether the id of the target pixel is 0. When the id of the target pixel is 0 (S200, Yes), the process proceeds to S205.
When the id of the target pixel is not 0 (S200, No), the brightness correction unit 203 refers to the id of the target pixel (S201), and if the id of the target pixel is 1, the γ curve corresponding to id = 1 The brightness is adjusted with reference to (S202).
The luminance correcting unit 203 adjusts the luminance with reference to the γ curve corresponding to id = 2 if id = 2 of the target pixel (S203).
The luminance correction unit 203 adjusts the luminance with reference to the γ curve corresponding to id = 3 if id = 3 of the target pixel (S204).
The brightness correction unit 203 determines whether or not the processing has been completed for all the pixels (S205). If there is a pixel that has not been processed (S205, No), the processing from S200 is repeated. If the process has been completed for all the pixels (S205, Yes), the process ends.

<Gloss correction part>
FIG. 10 is a flowchart showing a processing flow of the gloss correction unit 204 according to an embodiment of the present invention. The processing by the gloss correction unit is performed when the shadow detection function is set to ON.

The gloss correction unit 204 extracts a pixel region formed by pixels having the same id (S300).
The gloss correction unit 204 determines whether or not id of the pixel constituting the pixel area is 0. The gloss correction unit 204 proceeds to S306 if id = 0 of the pixel constituting the pixel area (Yes in S301).
If the id of the pixel constituting the corresponding pixel area is not 0 (S301, No), the gloss correction unit 204 refers to the id set for each pixel constituting the pixel area, and what is the id Is determined (S302).
If the id of the pixel constituting the pixel area is 1, the gloss correction unit 204 searches for the pixel in which the most CMYK toner is used in the corresponding area, and calculates a value obtained by adding a predetermined amount to the toner amount. The reference value (id = 1) of the pixels constituting the corresponding area is set (S303).
When id = 2 of the pixels constituting the pixel area, the gloss correction unit 204 calculates the average value of the CMYK toner application amount of the pixels constituting the area as the reference value (id = 2) of the pixels constituting the area. ) Is set (S304).
When id = 3 of the pixels constituting the pixel area, the gloss correction unit 204 sets a value smaller than the average value of the CMYK toner application amounts of the pixels constituting the corresponding area to the pixels constituting the corresponding area. A reference value (id = 3) is set (S305).
Next, the gloss correction unit 204 determines whether or not a reference value has been set for the pixels constituting all the pixel regions (S306). If there is a pixel that has not been set (S306, No), The processing from S301 is repeated for the pixels constituting the set pixel area.
On the other hand, when the reference value has been set for all pixels (S306, Yes), the gloss correction unit 204 subtracts the CMYK toner application amount of the target pixel from the reference value set for each pixel. The application amount of the transparent toner is set (S307).
Next, the gloss correction unit 204 determines whether or not the transparent toner application amount has been set for all the pixels (S308). If there is a pixel that has not been set (S308, No), the gloss correction unit 204 is set. The processing from S307 is repeated for the pixels that are not. If the process has been completed for all the pixels (S308, Yes), the process ends.

  As described above, according to the image forming apparatus 100 according to the present embodiment, the image data extraction unit 200 extracts two-dimensional image data from data having three-dimensional coordinates, and the shadow detection unit 201 performs shadow information for each pixel region. The color correction unit 202 converts the RGB data into CMYK data with reference to the color conversion table, and the luminance correction unit 203 refers to the luminance adjustment table in which the shadow information and the adjustment amount are related to each pixel area. The gloss correction unit 204 sets a transparent toner application amount for each pixel area based on the shadow information, and the halftone processing unit 204 performs halftone processing based on each toner application amount. The engine 104 prints the two-dimensional image data after halftone processing on a print medium, thereby making the influence of the light source of the two-dimensional image data extracted from the data having three-dimensional coordinates more prominent. It is possible to express the three-dimensional visibility on a two-dimensional medium of the extracted two-dimensional image data can be improved.

  In addition, two-dimensional image data with improved stereoscopic visibility after the luminance correction is performed by the luminance correction unit 203 may be displayed on the touch panel of the image forming apparatus 100 or the display 117 of the information processing terminal 110. . In this embodiment, it is not necessary to print on the print medium, so that further cost reduction is expected.

  Alternatively, the brightness correction unit 203 may not perform brightness adjustment, and the gloss correction unit 204 may only set the transparent toner application amount. In this embodiment, since the luminance adjustment by the luminance correction unit 203 is not performed, processing in a shorter time is expected.

  In addition, the gloss correction unit 204 does not set the application amount of the transparent toner according to the shadow information, and only the luminance adjustment according to the shadow information by the luminance correction unit 203 is performed, and the transparent toner is uniformly applied to all pixels. It may be in a form where it is applied or not applied to all pixels. In this embodiment, since the application amount of the transparent toner is not set by the gloss correction unit 204, processing in a shorter time is expected.

  While specific embodiments of the present invention have been described above, the above-described embodiments are examples of the present invention. The present invention is not limited to the above-described embodiments, and can be embodied with various modifications and changes without departing from the scope of the invention in the implementation stage.

<Configuration, operation and effect of exemplary embodiment of the present invention>
<First aspect>
The image forming apparatus 100 (image processing apparatus) of this aspect performs an image process on two-dimensional image data obtained by observing a three-dimensional model existing in a three-dimensional space from a specific observation point in the three-dimensional space. Based on the three-dimensional position information of the light source existing in the three-dimensional space, the processing device obtains shadow information (id) indicating the influence degree of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data. A shadow detection unit 201 (shadow information acquisition unit), a luminance correction unit 203 that performs enhancement processing for enhancing stereoscopic visibility of two-dimensional image data based on the shadow information acquired by the shadow detection unit 201, and a gloss correction unit 204 (correction unit).
According to this aspect, the shadow detection unit 201 shows a shadow indicating the degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space. Get information (id). The brightness correction unit 203 and the gloss correction unit 204 perform enhancement processing for enhancing the stereoscopic visibility of the two-dimensional image data based on the shadow information acquired by the shadow detection unit 201.
Thereby, the process which improves the three-dimensional visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

<Second aspect>
The shade information (id) of this aspect is information indicating either a pixel indicating a region where light from the light source is directly irradiated or a pixel indicating a region where light from the light source is not directly irradiated, and the gloss correction unit 204 (correction unit). Is characterized in that opposite processing is applied to each of a pixel indicating a region where light from a light source is directly irradiated and a pixel indicating a region where light is not directly irradiated.
According to this aspect, the gloss correction unit 204 performs a process that conflicts with each of a pixel indicating a region where light from a light source is directly irradiated and a pixel indicating a region where light is not directly irradiated.
Thereby, the process which improves the three-dimensional visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

<Third aspect>
The luminance correction unit 203 (correction unit) of this aspect performs a process of increasing the luminance for the pixel indicating the area where the light from the light source is directly irradiated, and the process of decreasing the luminance for the pixel indicating the area where the light is not directly irradiated. It is characterized by giving.
According to this aspect, the luminance correction unit 203 performs a process of increasing the luminance on the pixel indicating the area where the light from the light source is directly irradiated, and performs the process of decreasing the luminance on the pixel indicating the area where the light is not directly irradiated. .
Thereby, the process which improves the three-dimensional visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

<4th aspect>
The shade information in this aspect is information indicating either a pixel indicating a region where light from the light source is directly irradiated or a pixel indicating a region where light from the light source is not directly irradiated. The gloss correction unit 204 (correction unit) A process of widening the difference in glossiness between a pixel indicating a region where light from the direct light and a pixel indicating a region where the light is not directly irradiated is performed.
According to this aspect, the gloss correction unit 204 performs processing to widen the difference in glossiness between a pixel indicating a region where light from the light source is directly irradiated and a pixel indicating a region where light is not directly irradiated.
Thereby, the process which improves the three-dimensional visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

<5th aspect>
The gloss correction unit 204 (correction unit) according to this aspect is characterized in that the application amount of a transparent or translucent image forming material is calculated for each pixel based on pixel data and shading information.
According to this aspect, the gloss correction unit 204 calculates the application amount of the transparent or translucent image forming material for each pixel based on the pixel data and the shadow information.
Thereby, the process which improves the three-dimensional visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

<Sixth aspect>
In this embodiment, the pixel indicating the region where the light from the light source is not directly irradiated includes the pixel indicating the region (id = 2) that is the shadow of the light from the light source and the region (id = 3) that is the shadow of the light from the light source. The luminance correction unit 203 or the gloss correction unit 204 (correction unit) includes different pixels, and performs different processing on each pixel.
According to this aspect, the pixel indicating the region where the light from the light source is not directly irradiated includes the pixel indicating the region that is shaded by the light from the light source (id = 2) and the region that is the shadow of the light from the light source (id = 3). The luminance correction unit 203 or the gloss correction unit 204 performs different processing on each pixel.
Thereby, the process which improves the three-dimensional visibility on the two-dimensional medium of the two-dimensional image data acquired from the data which have a three-dimensional coordinate can be performed.

<Seventh aspect>
The image processing method of this aspect is an image processing method for performing image processing on two-dimensional image data obtained by observing a three-dimensional model existing in a three-dimensional space from a specific observation point in the three-dimensional space,
Based on the three-dimensional position information of the light source existing in the three-dimensional space, the shadow information acquisition step for acquiring the shadow information indicating the degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data;
And a correction step of performing an enhancement process for enhancing the stereoscopic visibility of the two-dimensional image data based on the shadow information.
Since the operation and effect of the seventh aspect are the same as those of the first aspect, description thereof is omitted.

<Eighth aspect>
The image processing program of this aspect is an image forming apparatus 100 (image processing) that performs image processing on two-dimensional image data obtained by observing a three-dimensional model existing in a three-dimensional space from a specific observation point in the three-dimensional space. Device) to acquire shadow information indicating the degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space. A shadow information acquisition step (S100 to S109) and a correction step (S202 to S204, S203 to S205) for performing enhancement processing for enhancing the stereoscopic visibility of the two-dimensional image data based on the shadow information are executed.
Since the operation and effect of the eighth aspect are the same as those of the first aspect, description thereof is omitted.

<Ninth aspect>
The image processing system of this aspect is an image processing system that performs image processing on two-dimensional image data obtained by observing a three-dimensional model existing in a three-dimensional space from a specific observation point in the three-dimensional space, Based on the three-dimensional position information of the light source existing in the three-dimensional space, the shadow detection unit 201 (shadow information acquisition) acquires shadow information indicating the degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data. A luminance correction unit 203 that performs enhancement processing for enhancing stereoscopic visibility of the two-dimensional image data based on the shadow information acquired by the shadow detection unit 201, and a gloss correction unit 204 (correction unit). It is characterized by that.
Since the operation and effect of the ninth aspect are the same as those of the first aspect, description thereof will be omitted.

DESCRIPTION OF SYMBOLS 100 ... Image forming apparatus 101, 111 ... CPU, 102, 112 ... RAM, 103, 113 ... ROM, 104 ... Image engine, 105, 114 ... Network I / F, 106, 115 ... HDD, 107, 116 ... Operation I / F, 108, 118 ... bus, 117 ... display, 110 ... information processing terminal, 200 ... image data extraction unit, 201 ... shadow detection unit (shadow information acquisition unit), 202 ... color correction unit, 203 ... luminance correction unit ( Correction unit), 204 ... Gloss correction unit (correction unit), 205 ... Halftone processing unit

JP-A-2005-219388 JP 2005-059592 A

Claims (9)

An image processing apparatus that performs image processing on two-dimensional image data obtained by observing a three-dimensional model existing in the three-dimensional space from a specific observation point in the three-dimensional space,
A shadow information acquisition unit that acquires shadow information indicating a degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space; ,
An image processing apparatus comprising: a correction unit that performs an enhancement process for enhancing stereoscopic visibility of the two-dimensional image data based on the shadow information acquired by the shadow information acquisition unit. The shadow information is information indicating one of a pixel indicating a region where light from the light source is directly irradiated and a pixel indicating a region where light from the light source is not directly irradiated;
The image processing apparatus according to claim 1, wherein the correction unit performs a process that conflicts with each of a pixel indicating a region where the light from the light source is directly irradiated and a pixel indicating a region where the light is not directly irradiated.   The correction unit performs a process of increasing luminance for a pixel indicating a region where light from the light source is directly irradiated, and performs a process of decreasing luminance for a pixel indicating a region where the light is not directly irradiated. Item 3. The image processing apparatus according to Item 2. The shadow information is information indicating one of a pixel indicating a region where light from the light source is directly irradiated and a pixel indicating a region where light from the light source is not directly irradiated;
The image processing apparatus according to claim 1, wherein the correction unit performs a process of widening a difference in glossiness between a pixel indicating a region where the light from the light source is directly irradiated and a pixel indicating a region where the light is not directly irradiated.   The image processing apparatus according to claim 4, wherein the correction unit calculates a coating amount of a transparent or translucent image forming material for each pixel based on pixel data and the shading information. The pixel indicating the region where the light from the light source is not directly irradiated includes a pixel indicating a region that is a shadow of the light from the light source and a pixel indicating a region that is a shadow of the light from the light source,
The image processing apparatus according to claim 2, wherein the correction unit performs different processing on each pixel. An image processing method for performing image processing on two-dimensional image data obtained by observing a three-dimensional model existing in the three-dimensional space from a specific observation point in the three-dimensional space,
A shadow information acquisition step for acquiring shadow information indicating a degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space; ,
An image processing method comprising: performing an enhancement process for enhancing a stereoscopic visibility of the two-dimensional image data based on the shadow information. For a processor of an image processing apparatus that performs image processing on two-dimensional image data obtained by observing a three-dimensional model existing in the three-dimensional space from a specific observation point in the three-dimensional space,
A shadow information acquisition step for acquiring shadow information indicating a degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space; ,
An image processing program that executes a correction step for performing enhancement processing for enhancing stereoscopic visibility of the two-dimensional image data based on the shadow information. An image processing system that performs image processing on two-dimensional image data obtained by observing a three-dimensional model existing in the three-dimensional space from a specific observation point in the three-dimensional space,
A shadow information acquisition unit that acquires shadow information indicating a degree of influence of the light source existing in the three-dimensional space in the pixels constituting the two-dimensional image data based on the three-dimensional position information of the light source existing in the three-dimensional space; ,
An image processing system comprising: a correction unit that performs an enhancement process for enhancing stereoscopic visibility of the two-dimensional image data based on the shadow information acquired by the shadow information acquisition unit.

Images