JP5436367B2 - Graphic arrangement determining method, program thereof, and information processing apparatus - Google Patents

Description

  The present invention relates to creation of a photobook layout using wide-angle images.

  In the invention of Patent Document 1, movement information at the time of photographing with a digital camera measured by various sensors such as a three-dimensional gyroscope, zoom movable unit operation information, and a three-dimensional acceleration measuring unit is added to image data corresponding to each frame. Record to memory card or internal memory. Then, the movement information is extracted from the image data to which the recorded movement information is given by the split means, and the movement direction and the movement distance at the time of photographing of the digital camera are calculated by the calculation means based on the extracted movement information, A panoramic image is created by extracting adjacent subject frames by the processing means.

  In the image layout apparatus of the invention of Patent Document 2, attention area calculation means for calculating the attention area of the image A to be superimposed behind the other image B, and the layout avoiding the attention area of the image A overlapping the image B are arranged. Layout means is provided.

  Patent Documents 3 and 4 are examples of conventional techniques for creating panoramic images from still images and moving images, respectively. As shown in FIG. 15, when a wide-angle panoramic image is arranged in a photo book, a great appeal is created in the photo book as compared with a case where a conventional still image is simply arranged on a page. A panoramic image can be created by joining or superimposing a plurality of images (still images or moving image frames) having subjects at least partially overlapping each other such that overlapping portions of the subjects overlap each other.

JP 2004-128683 A JP 2004-199248 A JP 2005-252739 A JP 2007-267008 A

  In general, as a method for generating a panoramic image, a method of combining a plurality of still images or a method of combining moving image frames is known. However, in any case, since the user performs shooting while moving the camera, in some cases, a panoramic image with no boundary area as shown in FIG. 16 may be generated. In this case, the photographing part is meaningful, but the black non-photographing part is meaningless.

  An object of the present invention is to generate a more attractive photo book by using a non-photographed portion of a wide-angle image with no boundary region.

  According to the present invention, the information processing device acquires shooting area information that is information for specifying a shooting area from wide-angle images and non-shooting area information that is information for specifying a non-shooting area, and is specified by the shooting area information. A step of setting the priority of the partial area based on the attribute of the partial area of a desired position and size included in the captured area, and a wide-angle image based on the non-photographing area information and the priority of the partial area. Determining a layout of one or more accompanying graphics, and providing a graphic layout determining method.

  The information processing apparatus executes a step of extracting one or a plurality of partial regions from the wide-angle image based on the priority.

  The information processing apparatus executes a step of determining the arrangement of the extracted partial region or regions as one or more graphics accompanying the wide-angle image.

  The step of determining the layout of the graphic accompanying the wide-angle image is performed so that the extracted partial area does not overlap the graphic.

  The priority of the partial area is set based on the number of specific types of subjects in the partial area, the shooting area per unit shooting time of the partial area, or the number of overlapping with different partial areas.

  The information processing apparatus executes a step of determining an arrangement of the graphic attached to the wide-angle image so that the shooting area does not overlap the graphic.

  The information processing apparatus executes a step of determining a graphic arrangement associated with the wide-angle image so that a margin of the non-photographing area and the wide-angle image arrangement page overlaps the graphic.

  The information processing apparatus executes a step of determining an upper limit of the aspect ratio of the wide angle image based on the size of the arrangement page of the wide angle image.

  The information processing apparatus executes a step of generating a wide-angle image based on the determined upper limit of the aspect ratio.

  The information processing apparatus executes a step of extracting a partial region from the wide-angle image based on the determined upper limit of the aspect ratio.

  The non-photographing area information includes the position coordinates of the non-photographing area in the wide-angle image or a predetermined color in the wide-angle image.

  The present invention includes a program for an information processing apparatus to execute a graphic arrangement determination method and an information processing apparatus.

  According to the present invention, unlike a case where an arbitrary image is simply arranged in a blank area where no subject exists, a non-photographing area of a wide-angle image can be effectively used as a graphic arrangement area, and a high-value photo book can be provided. .

Block diagram showing schematic configuration of image print creation device Figure showing an example of a panoramic image The figure which shows an example of the panoramic image which has arrange | positioned the predetermined color to the non-photographing area | region The figure which shows the example of the mask image equivalent to a non imaging | photography area | region The figure which shows an example of the text information which shows the coordinate of a non imaging | photography area | region The figure which shows the example of the layout of the graphic arrange | positioned in a non-photographing area The figure which shows the example of the color unified in the blank area and the non-photographing area The figure which shows the example which arrange | positions arbitrary images in the blank area where a panoramic image does not exist The figure which shows the example of the partial cutout area of a panoramic image The figure which shows the example of the cut-out area determined based on the aspect ratio The figure which shows the example of the cut-out area | region determined based on the number of person subjects to include The figure which shows an example of the priority of the rectangular area set based on the magnitude | size of the imaging | photography area per unit time The figure which shows an example of the common area | region of a rectangular area pattern The figure which shows an example of extraction of a common area The figure which shows the example of arrangement | positioning of the cut-out rectangular area The figure which shows the example of the graphic arranged in front of the non-photographing area The figure which shows the example of the position bias of the panorama image arrange | positioned on the page of a photo book Figure showing an example of the image aspect ratio upper limit The figure which illustrates a state that the panorama image according to the image aspect ratio upper limit is arranged in the photo book of the corresponding size Flow chart of layout determination process Diagram showing the relationship between the panorama image that can be created from the order image and the range according to the aspect ratio upper limit Figure showing an example of a photo book with panoramic images The figure which shows an example of the panoramic image where the border area is not arranged

  FIG. 1 is a block diagram showing a schematic configuration of an image print creation apparatus 10 to which the present invention is applied. The image print creation apparatus 10 is, for example, from various recording media such as CDs and DVDs and storage media such as memory cards, from a general-purpose interface for connecting peripheral devices such as USB connected to a camera, or from the Internet or a LAN. Reads images (including still image data, moving image data, and moving image frames that are captured moving images) from the network via the image input unit 2, and uses this as a material for a photo book (display device with layout and design for each page) Alternatively, data for causing the printing apparatus to output an image or a print medium such as paper on which an image is printed with a layout and design for each page is created. As an example, the moving image data corresponds to a compression recording standard such as motion JPEG or MPEG4. As an example, the still image data corresponds to image file formats such as JPEG, TIFF, and EXIF standardized for digital still cameras.

  The system configuration in FIG. 1 is an example, and the present invention can be implemented as long as it is an information terminal (for example, a personal computer, a storefront print terminal, a PDA, or a mobile phone) having a configuration equivalent to this. Further, the individual blocks shown in the figure are not necessarily configured integrally with one electronic device, and each block is a part of the configuration of another electronic device, and they are connected by some communication means such as a network. As long as information transmission / reception between the electronic devices is ensured, the present invention can be implemented and is not performed depending on a specific device configuration.

  The image print creating apparatus 10 is operated by an order receiving unit 1 including various operating devices such as a pointing device and a touch panel that can instruct the movement of a pointer (cursor) such as a mouse, a touch pad, and a trackball. The touch panel is stacked on the display 50, and by pressing a button display part of the display 50, it is possible to input characters corresponding to the part or activate various functions.

  The image print creating apparatus 10 also has an image output unit 8 that prints the instructed still image on a mount composed of a paper medium such as plain paper or photographic paper in a predetermined arrangement determined by the image layout unit 9. It is connected. Alternatively, the still images arranged in a predetermined arrangement can be output as an electronic medium such as “PDF” of Adobe Systems Inc. to a display 50, a recording medium, a personal computer connected via the Internet, or the like.

  In addition to one or a plurality of still image data, moving image frames, and panoramic images, which are the main materials of the image print, the HDD 18 includes decorative image data (graphics) to be combined with these main materials when generating the image print. ) Etc. are stored. The graphic includes still images, character data constituting characters (kanji, katakana, hiragana, alphabets, symbols, pictograms, and other meaningful readable codes or combinations thereof), and the characters to be inserted into the images. Graphic data of objects suitable for placing text boxes, balloons, billboards, bulletin boards and other characters, mask images that cover part or all of unnecessary parts of the target image, frames surrounding the image, illustrations, etc. Includes clip art. These decorative images add color to the photo book by decorating the background of still images that are the main material of the photo book or adding one-point decorations.

  The panoramic image generation unit 7 generates a panoramic image from the still image or the moving image input from the image input unit 2. The specific method can be performed similarly to the prior art. In other words, the panorama image generation unit 7 connects a plurality of still images (a series of images having overlapping portions that can generate a panorama such as continuous shot images) or moving image frames so as to overlap the overlapping regions. Generate an image. A plurality of moving image frames or still images serving as a panoramic image material are a series of images having overlapping portions of a subject that can generate a panorama such as a continuous shot image, and an image capturing method thereof is arbitrary.

  The CPU 12 controls the entire image print creating apparatus 10 by executing a program stored in the HDD 18.

  The image analysis unit 3, the shooting area / non-shooting area extraction unit 4, the aspect ratio upper limit setting unit 6, the panorama image generation unit 7, and the image layout unit 9 are coprocessors, each of which is responsible for specialized processing and processing of the CPU 12 Assist the operation. The area information storage unit 5 is composed of a volatile storage medium such as a RAM.

  The image layout unit 9 determines information related to the design of the image print according to the design designation of the image print from the order receiving unit 1.

  When the panoramic image is synthesized by the panoramic image generation unit 7, the photographing region / non-photographing region extracting unit 4 captures a panoramic image or a photographing region (region where the subject exists) and a non-photographing region (existence of the subject). Information on the non-photographing area (for example, position coordinates and color information) is acquired. Then, the information obtained as a result of the analysis is stored in the region information storage unit 5. For example, if the panorama image generation unit 7 generates a panorama image as shown in FIG. 2, during the generation of this image, the image analysis unit 3 includes a subject portion present in each still image or moving image frame, or a portion obtained by connecting them. (Shooting area) is distinguished from a still image or a moving image frame where a subject does not exist (non-shooting area), and the position coordinate information of the non-shooting area in the panoramic image is stored in the area information storage unit 5.

  Alternatively, as illustrated in FIG. 3, the panoramic image generation unit 7 assigns a predetermined color (for example, red) to a portion (non-shooting area) where no still image or moving image frame exists when the panoramic image is synthesized by the panoramic image generation unit 7. Deploy. The image analysis unit 3 identifies an existing area of a predetermined color from the panoramic image. The predetermined color itself is information for specifying the non-photographing area, and the existence area of the identified color is the non-photographing area. The imaging region / non-imaging region extraction unit 4 is a region information storage unit that uses information that identifies the existence region of the predetermined color identified by the image analysis unit 3, typically the position coordinate information as information that identifies the non-imaging region. 5 can be stored.

  The method of storing the non-imaging area in the area information storage unit 5 by the imaging area / non-imaging area extraction unit 4 is arbitrary. For example, as shown in FIG. 4, the imaging region / non-imaging region extraction unit 4 generates a mask image corresponding to the non-imaging region, and stores this mask image or its compressed image file in the region information storage unit 5. The mask image information (transparent portion) may be attached to the α channel of the panoramic image. Alternatively, text information indicating the coordinates (800,0)-(4500,600) of the non-photographing area as shown in FIG. The coordinates of the shooting area may also be stored in the area information storage unit 5 together.

  The image layout unit 9 determines the layout of the photo book including the panorama image generated by the panorama image generation unit 7 and graphics other than the panorama image stored in the HDD 18 based on the non-photographing region of the region information storage unit 5.

  For example, as shown in FIG. 6, the image layout unit 9 sets one or more graphics having a shape and size suitable for the blank area BL where no panoramic image exists and the non-photographing area N of the area information storage unit 5 as the non-photographing area. Decide which layout to place. Preferably, the image layout unit 9 determines a layout that minimizes the area of a non-photographing region that is partially or wholly covered with a graphic (that is, has an overlap with the graphic). The area of the blank area B is usually greater than 0, but may be 0.

  If the layout of graphics on a page is determined in advance, select a panorama image that minimizes the area of the blank space where these graphics do not exist plus the area of the non-photographing area, and the selected panorama image is Determine the layout to place on the page. Also in this case, the image layout unit 9 preferably determines a layout that minimizes the area of the non-photographing area covered with the graphic.

  As shown in FIG. 7, it is actually preferable to unify the colors of the blank area BL and the non-photographing area N with the same color such as black. Alternatively, the blank area BL may be the same color or a similar color as the color information of the non-photographing area N. For example, if the non-photographing area N is white, the margin area BL is also white.

  This makes it possible to effectively use the non-photographing area of the panoramic image as the graphic arrangement area, unlike the conventional case where an arbitrary image is simply arranged in the blank area where the panoramic image does not exist (see FIG. 8). We can provide high value photo books.

  Alternatively, the non-photographing area N may be transparent, and the background image behind the panoramic image and its color may be output as they are. In this case, it is preferable that the color correction is accepted only in the photographing region so that the color of the background mount is reflected on the print as it is. This is because when the same color correction as that in the shooting area is applied to the non-shooting area, the original color of the background behind the area, for example, white color is changed to another color. It is preferable that no frame be arranged around the panoramic image including the transparent non-photographing area.

  Note that the image analysis unit 3 can determine a rectangular area from which a panoramic image is partially cut out based on the imaging area and the non-imaging area. In FIG. 9, the image analysis unit 3 determines three rectangular partial regions R1 to R3 from the panoramic image I. The image analysis unit 3 cuts out the determined rectangular area and stores it in the HDD 18. The rectangular area stored in the HDD 18 can be arranged in the same photobook as the panorama image to be cut out or in a non-photographing area of another photobook.

  The criteria for cutting out the rectangular area are arbitrary, but in order to extract a rectangular area having the highest importance, the following is preferable.

  For example, the image analysis unit 3 generates a rectangular area pattern having an arbitrary size, an arbitrary aspect ratio, and an arbitrary position that includes only a panoramic image shooting area so as to cover all patterns at random. A pattern having an aspect ratio equal to or greater than a predetermined threshold is determined as a rectangular area to be cut out from the patterns.

  As shown in FIG. 10, among the vertical / horizontal aspect ratios of the rectangular area patterns P1 to P3, the vertical / horizontal aspect ratio of P3 exceeds the threshold value = 1 and is the largest (the vertical size is larger than the horizontal size). large). In this case, P3 is determined as a rectangular area to be cut out.

  Alternatively, the image analysis unit 3 analyzes the following attributes related to each pattern from the patterns generated as described above.

  (A) The number of specific types of subjects included in each pattern. For example, the number of person subjects.

  (B) The size of the subject included in each pattern. Alternatively, a specific part in the subject, for example, the size of the face.

  (C) Time required to capture the image information included in each pattern. This is a time interval from the first shooting time to the last shooting time of the moving image frame or still image frame constituting the image information.

  (D) Aspect ratio of each pattern. Or information derived from the aspect ratio. For example, whether each pattern is portrait or landscape. For example, see FIG. 10 above and related descriptions.

(E) Area of each pattern The image analysis unit 3 sets a priority for each pattern according to the analyzed attribute. For example, the priority is set as follows for the attributes (a) to (e).

  (A) A higher priority is set for a pattern having a larger number of specific types of subjects to be included. For example, in FIG. 11, in the rectangular area patterns Q1 to Q3, the number of human subjects included is 4, 2, and 0, respectively, so the priorities are set in the order of Q1> Q2> Q3.

  (B) A higher priority is set for a pattern in which the size of the subject or the specific part is larger.

  (C) A higher priority is set for a pattern with a longer time taken to capture image information.

  (D) A high priority is set for the vertically long pattern. Or set a high priority for landscape patterns.

  (E) A high priority is set for a pattern having a large area.

  (F) A high priority is set for a pattern with a small shooting area per unit time. For example, as shown in FIG. 12, the priorities are set in the order of T2> T3> T1 from the size of the photographing area per unit time of the patterns T1 to T3. This is because it is considered that the smaller the shooting area per unit time of the pattern, the slower the image information in the pattern is taken over time, and the higher the importance.

  The imaging region / non-imaging region extraction unit 4 cuts out a predetermined number (one or more) of rectangular regions in order from the pattern with the highest priority set by the image analysis unit 3.

  Instead of setting the priority for the pattern itself as described above, the priority may be set for a partial region of the pattern. For example, a higher priority is set for a common area having a larger number of overlapping patterns. In the rectangular area patterns D1 to D3 as shown in FIG. 13, the highest priority is set to R1 that is common to all of D1, D2, and D3.

  The same priority is set for the common area of D1 and D2, the common area of D1 and D3, and the common area of D2 and D3. However, a higher priority may be set in a common area corresponding to a pattern having a higher priority corresponding to the attributes (a) to (f).

  For example, in FIG. 14, it is assumed that V1> V2> V3 is set in descending order as the priorities of the patterns V1 to V3 corresponding to the attributes (a) to (f).

  In this case, the image analysis unit 3 gives the first priority to all the common areas of V1, V2, and V3, the second priority to the common area of V1 and V2, and the third priority to the common area of V2 and V3. Set the degree. The imaging region / non-imaging region extraction unit 4 cuts out a predetermined number or a plurality of rectangular regions in order from the partial region with the highest priority set by the image analysis unit 3. When the area of the partial area with the highest priority does not reach the desired area (or aspect ratio), the imaging area / non-imaging area extraction unit 4 further extracts the partial area with the next priority, An area (or aspect ratio) may be obtained. In FIG. 14, V0 having a desired area composed of the entire V1 and a part of V2 is extracted.

  The cut out rectangular area can be arranged in the same photo book as the panorama image to be cut out or in a non-photographing area of another photo book. FIG. 15 shows an arrangement example of the cut out rectangular regions.

  Alternatively, a rectangular area where a high priority is not set is regarded as a non-photographing area, and the arranged graphic is preferentially output. For example, as shown in FIG. 16, a portion of the panoramic image other than the rectangular region Z having a high priority is regarded as a non-photographing region, and the graphics G1 to G4 are arranged in front of the non-photographing region. Is done.

  The aspect ratio upper limit setting unit 6 determines the panoramic image aspect ratio upper limit from the size of the photobook received from the order receiving unit 1 or its aspect ratio.

  Even with panoramic images with the same aspect ratio, the appearance changes depending on the print size of the photo book or the aspect ratio. For example, as shown in FIG. 17, even if a landscape panorama image is arranged in a landscape photobook PB1, the viewer does not feel uncomfortable. However, if a landscape panorama is arranged in a photobook PB2 that is not landscape, the position of the panorama image is displayed. Gives a sense of incongruity to those who see bias and margins.

  Therefore, the aspect ratio upper limit setting unit 6 sets the upper limit of the panorama image aspect ratio that matches the size of the photobook set from the order receiving unit 1 or the like or the aspect ratio so that the position of the panoramic image is not biased and the appearance is improved. decide. The aspect ratio at which the area of the margin of the page on which the panoramic image is arranged reaches a predetermined upper limit may be determined as the upper limit of the image aspect ratio.

  FIG. 18 shows an example of the determined upper limit of the image aspect ratio. If the photobook size is 3000 × 3000, the aspect ratio upper limit setting unit 6 sets the aspect ratio upper limit corresponding to the size to 1: 8, and if the photobook size is 3000 × 2000, the aspect ratio upper limit corresponds to the size. If the size of the photobook is 1: 6 and 1500 × 3000, the upper limit of the aspect ratio corresponding to the size is determined to be 1: 2.

  For example, the upper limit of the aspect ratio of the panoramic image as shown in FIG. 18A is determined according to the relational expression between the aspect ratio of the print size and the panoramic size as shown in FIG. A relational expression as shown in FIG. 18B is stored in advance in a storage medium such as the HDD 18, and the aspect ratio upper limit setting unit 6 corresponds to the aspect ratio of a desired print size designated via the order receiving unit 1. By specifying the aspect ratio of the panoramic image to be determined from the relational expression, the upper limit aspect ratio of the panoramic image to be generated by the panoramic image generation unit 7 is determined according to the print size.

  The inclination of the graph in FIG. 18B may be set via the order receiving unit 1 by the type of the photo book to be created or by the user who creates the photo book.

  For example, if the inclination set by the user is large, the upper limit of the aspect ratio becomes large. In this case, the balance may be slightly deteriorated or the height of the displayed panoramic image may be reduced, but the entire panoramic image can be used for the photo book.

  Alternatively, if the inclination set by the user is small, the upper limit of the aspect ratio becomes small. In this case, a panoramic image can be arranged in a balanced manner, but there is a possibility that a part of the panoramic image cannot be displayed in accordance with the aspect ratio. Therefore, it is preferable to select the degree of inclination according to the user's preference.

  Further, the formula itself may be set by the user via the order receiving unit 1. The formula shown in FIG. 18B is merely an example, and is not limited to the primary line format.

  FIG. 19 illustrates a state in which panoramic images according to the image aspect ratio upper limit determined as shown in FIG. 18 are arranged in a photobook of a corresponding size. The upper limit of the aspect ratio relates to the arrangement of the panoramic images over the spread pages, but the upper limit of the image aspect ratio with respect to the arrangement of the panoramic images over one of the pages may be determined.

  FIG. 20 is a flowchart of the layout determination process executed by the image print creation apparatus 10. This process is controlled by the CPU 12. A program for causing the CPU 12 to execute this processing is stored in the HDD 18 or other computer-readable storage medium. This process is started when an instruction to create a photo book is input from the order receiving unit 1.

  In S <b> 1, the CPU 12 receives the size of the photo book from the order receiving unit 1.

  In S <b> 2, the CPU 12 controls the aspect ratio upper limit setting unit 6 to determine the panoramic image aspect ratio upper limit from the size of the photobook received from the order receiving unit 1. An example of the determined aspect ratio upper limit is as shown in FIG. The aspect ratio upper limit setting unit 6 may set the value specified by the order receiving unit 1 as the aspect ratio upper limit as it is.

  In S <b> 3, the CPU 12 determines whether all layouts of the order image, which is the image selected from the order receiving unit 1 for use in the photo book among the images input from the image input unit 2, have been determined by the image layout unit 9. Judge whether or not. If it is determined, the process ends. If it is not determined, the process proceeds to S4. It is assumed that the arrangement page of each order image can be arbitrarily designated from the order receiving unit 1.

  In S <b> 4, the CPU 12 instructs the image analysis unit 3 to analyze whether each order image is a moving image or a still image that can be panorama synthesized. As a result of the analysis, the CPU 12 is a moving image or a still image that can be panorama synthesized. If yes, go to S5, otherwise go to S8. The determination of whether or not panorama composition is possible is based on whether or not a plurality of moving image frames or still images constituting the order image have a subject portion that overlaps.

  In S5, the CPU 12 controls the panorama image generation unit 7 so as to generate a panorama image based on the order image. The CPU 12 determines whether or not the aspect ratio of the panoramic image created by the panoramic image generation unit 7 based on the moving image or the still image analyzed in S4 exceeds the aspect ratio upper limit determined in S2. If Yes, the process proceeds to S6. If No, the process proceeds to S7.

  In S6, the CPU 12 controls the panorama image generation unit 7 so as to create a panorama image within a range according to the upper limit of the aspect ratio. At this time, the panorama image generation unit 7 uses the image analysis unit 3 to identify a feature portion of the panorama image (for example, a human face detected by a conventional face detection technique, a structure line detected by a conventional composition analysis technique, or the like). Then, a panoramic image may be created so that the specified feature portion is at a predetermined position (for example, the center). FIG. 21 shows the relationship between the panoramic image RT that can be created from the order image and the range RL according to the aspect ratio upper limit.

  Alternatively, the CPU 12 may extract a range that does not exceed the upper limit of the aspect ratio from the created panoramic image. At this time, the image analysis unit 3 identifies a characteristic part (for example, a human face) of the panoramic image, and exceeds the upper limit of the aspect ratio from the panoramic image created so that the identified characteristic part is at a predetermined position (for example, the center). A non-existing range may be extracted.

  In S <b> 7, the CPU 12 controls the imaging region / non-imaging region extraction unit 4 to store information specifying the non-imaging region in the region information storage unit 5. The information for specifying the non-photographing area includes information exemplified in any of FIGS.

  In S <b> 8, the CPU 12 controls the image analysis unit 3 to determine a rectangular partial area from which a panoramic image is cut out. A desired rectangular partial area is extracted. Examples of this rectangular area are as shown in FIGS. 9, 10, 11, 13, and 14.

  In S <b> 9, the CPU 12 instructs the image layout unit 9 to arrange the panoramic image created by the panoramic image generation unit 7 on a designated page that is a desired page of the photobook designated by the order receiving unit 1. The CPU 12 determines whether or not a non-photographing area corresponding to the arranged panoramic image is stored in the area information storage unit 5. If Yes, the process proceeds to S10. If No, the process proceeds to S11.

  In S <b> 10, the CPU 12 creates a photo book including a panorama image generated by the panorama image generation unit 7 and graphics other than the panorama image stored in the HDD 18 based on the non-photographed area of the area information storage unit 5 and the margin of the designated page. The image layout unit 9 is controlled to determine the layout. The determined layout is as illustrated in FIGS.

  In S <b> 11, the CPU 12 causes the image layout unit 9 to determine the layout of the photobook including the panorama image generated by the panorama image generation unit 7 and graphics other than the panorama image stored in the HDD 18 based on the margin of the designated page. Control. The determined layout is as illustrated in FIG.

  Note that the panoramic image described above does not have to be created by combining a plurality of images by the panoramic image generation unit 7 and may be various images input from the outside. For example, a wide-angle image taken with a special wide-angle lens such as a fisheye lens can be input as a panoramic image as it is. The imaging region / non-imaging region extraction unit 4 distinguishes the imaging region and the non-imaging region from the input panoramic image, and stores the position coordinate information of the non-imaging region in the panoramic image in the region information storage unit 5. You can also. In short, the layout determination process can be applied to any image in which a non-photographing area is generated regardless of the generation method.

  The layout determination process is not limited to graphic arrangement on a photo book, but can also be applied to graphic arrangement on various print products such as one or a plurality of image prints and postcards.

  1: order receiving unit, 2: image input unit, 3: image analysis unit, 4: shooting area / non-shooting area extraction unit, 5: area information storage unit, 6: aspect ratio upper limit setting unit, 7: panoramic image generation unit 8: Image output unit, 9: Image layout unit, 10: Image print creation device

Claims (13)

Information processing device
Acquiring shooting area information that is information for specifying a shooting area from a wide-angle image and non-shooting area information that is information for specifying a non-shooting area;
Setting the priority of the partial area based on the attributes of the partial area of a desired position and size included in the imaging area specified by the imaging area information;
Determining an arrangement of one or more graphics associated with the wide-angle image based on the non-photographing area information and the priority of the partial area;
Graphic placement determination method to execute.   The graphic arrangement determination method according to claim 1, wherein the information processing apparatus executes a step of extracting one or a plurality of partial regions from the wide-angle image based on the priority.   3. The graphic arrangement determining method according to claim 2, wherein the information processing apparatus executes a step of determining an arrangement of the extracted one or more partial areas as one or more graphics attached to the wide-angle image.   3. The graphic arrangement determining method according to claim 2, wherein a step of determining an arrangement of a graphic associated with the wide-angle image is executed so that the extracted partial area does not overlap the graphic.   The priority of the partial area is set based on the number of subjects of a specific type in the partial area, the shooting area per unit shooting time of the partial area, or the number of overlapping with different partial areas. The graphic arrangement | positioning determination method in any one of 1-4.   The graphic arrangement determining method according to claim 1, wherein the information processing apparatus executes a step of determining a graphic arrangement associated with the wide-angle image so that the shooting area does not overlap the graphic.   The information processing apparatus executes a step of determining a layout of a graphic attached to the wide-angle image so that a margin of the non-photographing area and the layout page of the wide-angle image overlaps the graphic. Graphic placement determination method described in 1. Information processing device
The graphic layout determination method according to claim 1, wherein a step of determining an upper limit of an aspect ratio of the wide-angle image based on a dimension of the layout page of the wide-angle image is executed. Information processing device
The graphic layout determination method according to claim 8, wherein the step of generating the wide-angle image based on the determined upper limit of the aspect ratio is executed. Information processing device
The graphic layout determination method according to claim 9, wherein a step of extracting a partial region from the wide-angle image based on the determined upper limit of the aspect ratio is executed.   The graphic arrangement determination method according to claim 1, wherein the non-photographing area information includes position coordinates of the non-photographing area in the wide-angle image or a predetermined color in the wide-angle image.   The program for an information processing apparatus to perform the graphic arrangement | positioning determination method in any one of Claims 1-11.   An information processing apparatus that executes the graphic arrangement determination method according to claim 1.

Images