JP2003199032A - Image identification apparatus, order processing apparatus, and image identification method - Google Patents

Abstract

[57] To enable easy identification of a person as a subject in an image or an image having a specific person as a subject. In a sightseeing spot, a theme park or the like, a photographer 12 takes an image of an arbitrary customer 16 as a subject. The captured image data is stored in the HDD 30 of the order processing device 24 together with the shooting date and time and the shooting location. Location Information Service Center
50 periodically notifies the order processing device 24 of the position of the mobile phone 18 possessed by each customer 16, and the notification information is stored in the HDD 30 as the movement history of each customer together with the date and time.
When an image order is requested by the customer 16 via the order receiving terminal 42 or the like, the order processing device 24 compares the movement history of the corresponding customer with the shooting date and time and shooting location of each captured image data, Extract and display only images
Display the list in 44.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image identifying apparatus, an order processing apparatus and an image identifying method, and more particularly to an image identifying apparatus for identifying a person as a subject in an image or an image of a specific person as a subject. The present invention relates to an order processing device that processes a customer order for an image identified by the image identification device, and an image identification method applicable to the image identification device.

[0002]

2. Description of the Related Art In the case of taking a photo taking means such as a camera to a tourist resort or a theme park and taking a commemorative photo at a major place, even if a tripod or the like is brought along with the camera, the setting is troublesome. For that reason, the number of images taken with the photographer himself as a subject tends to be small. Also, for example, when trying to shoot a scene enjoyed at a particular attraction in a theme park, only the accompanying person as a subject participates in the attraction, the photographer himself does not participate in the attraction, and concentrates on shooting. As described above, it is often difficult to take a picture.

As one method for solving the above-mentioned inconvenience, for example, a participant of a particular attraction in a theme park is automatically photographed, and the photographed image is presented to the participant as a subject at the exit of the particular attraction. Conventionally, if there is an order from a participant, a photographic print is created and delivered to the participant (customer) (see Non-Patent Document 1, for example). In addition, at a tourist spot, a photographer may photograph an unspecified tourist and present a photograph print of the photographed image near the exit of the tourist spot so that the tourist (customer) as a subject can purchase it. It is being appreciated.

[0004]

[Non-Patent Document 1] Fuji Photo Film Co., Ltd., "Jurassic Park The Ride (R) Photo (R)", [onlin
e], [September 20, 2002 Search], Internet <U
RL: http://www.fujifilm.co.jp/usj/check/phtride.
html>

[0005]

However, in the above method, it is necessary for the customer himself to find an image showing the customer as a subject from a plurality of presented images. Therefore, as the number of images presented increases,
There is a drawback in that the burden on the customer for finding a desired image becomes significant, which may lead to a decline in the customer's willingness to purchase.

In relation to the above, the applicant of the present application has found that when the photographer photographs the customer, the PDA (Persona) possessed by the customer
l Digital Assistants) wirelessly communicates customer information to the camera side, and the camera side associates the received customer information with the captured image as attached information of the captured image, and the customer as the subject of the captured image based on the attached information. Has been proposed (Japanese Patent Application No. 2000-320382:
Unknown). However, in the above technology, when the distance between the customer and the camera becomes large, it becomes difficult to transmit the customer information from the PDA to the camera, and the customer needs to have a special PDA having a function of transmitting the customer information. There was a need for further improvement.

The present invention has been made in consideration of the above facts, and an image identification device and an image identification device capable of easily identifying a person as an object in an image or an image of a specific person as an object. The first purpose is to obtain a method.

A second object of the present invention is to obtain an order processing apparatus which allows a customer to easily place an order for an image of a specific person as a subject.

[0009]

In order to achieve the first object, an image identifying apparatus according to the invention of claim 1 obtains a photographing date and time and a photographing place in photographing an unspecified person as a subject. Means, image data storage means for storing image data obtained by the shooting, shooting date and time and shooting location corresponding to the image data stored in the image data storage means, and a movement history of a person shot as a subject By identifying the person as a subject in the image represented by the image data, or the image data of the image of a specific person as a subject.

According to the first aspect of the present invention, the photographing date and time and the photographing place in photographing an unspecified person as a subject are obtained by the obtaining means, and the image data obtained by the photographing are stored in the image data storage means. Note that the photographing date and time and the photographing place are specifically, for example, as described in claim 2, photographing means used for photographing (for example, a camera,
Digital still cameras, digital video cameras, etc.)
It is possible to detect by providing a date and time detecting means for detecting the current date and time and a position detecting means for detecting the current position (for example, means for detecting the current position using the GPS system). The shooting date and time and the shooting location may be acquired online from the shooting means by wireless communication, or may be acquired offline (for example, by reading the shooting date and time and the shooting location once recorded on the recording medium). May be obtained in step 1).

By the way, in an image in which a person is the subject, the person as the subject of the image can be identified by determining the person who is present in the shooting place at the time of shooting the image. Further, the identification of an image of a specific person as a subject can also be performed by determining whether or not the specific person is present at the shooting location when the image to be determined is captured. Then, the above determination (identification) is performed by obtaining the image capturing date and time, the image capturing location of the image, and the person as the subject without acquiring the information for identifying the person as the subject at the time of image capturing like Japanese Patent Application No. 2000-320382. It can be realized by collating the movement history of.

Based on the above, the identifying means according to the invention of claim 1 collates the shooting date and time and the shooting location corresponding to the image data stored in the image data storage means with the movement history of the person photographed as the subject. By doing so, the person as the subject in the image represented by the image data stored in the image data storage unit, or the image data of the image in which a specific person is the subject is identified. Note that the movement history of a person may be, for example, information indicating the position (place) where the person existed in the past and the date and time thereof in a time series at a substantially constant time cycle, or may be the information at the past one time. Information indicating the position (place) where the person was present and the date and time (for example, "○ month x day x
Information such as "I was at location y around the time".

As described above, according to the first aspect of the present invention, by comparing the shooting date and time and the shooting location with the movement history of the person, the image of the person as the subject in the image or the image of the specific person as the subject Since the data is identified, the person as the subject does not have to have a special device having a function of transmitting information for identifying the person, and the person as the subject in the image, or the particular person The image can be easily identified.

According to the first aspect of the present invention, the movement history of the person can be held, for example, on the side of the person as a subject. Specifically, for example, the movement history of the person can be stored in a recording medium carried by the person. The history may be automatically recorded, or the person may simply store the movement history. As described above, when the movement history of the person is held on the person side, for example, as described in claim 3, the image data storage means stores a plurality of image data, and the identification means: By comparing the movement history of a specific person input via the input means with a plurality of shooting dates and times and a plurality of shooting locations corresponding to any of the plurality of image data stored in the image data storage means, It can be configured to identify image data of an image in which a specific person is the subject.

In a mode in which the movement history of a person is automatically recorded on a recording medium, the input means can be constituted by a reading device or the like for reading information from the recording medium.
Further, in a mode in which the person himself / herself stores the movement history,
The input means can be composed of a keyboard or the like for the person himself / herself to input the movement history. According to the third aspect of the invention, it is not necessary to provide the image identifying apparatus according to the present invention with the function of collecting the movement history of each person. Therefore, the configuration of the image identifying apparatus according to the present invention can be simplified. .

Further, in the invention according to claim 1, the movement history of the person can be collected and held by, for example, the side of the image identification apparatus according to the present invention. For example, as described in claim 4, Collecting means for respectively collecting the movement history of the person, and movement history storing means for respectively storing the movement history of the plurality of persons collected by the collecting means, and the identifying means is the photographing date and time corresponding to the image data. By comparing the shooting location with the movement histories of a plurality of persons stored in the movement history storage means, it is possible to identify the person as the subject in the image represented by the image data.

In this case, information relating to the photographed image (image data, photographing date and time, photographing place, etc.) and movement histories of a plurality of persons are centrally managed by the image identifying apparatus according to the present invention.
The image data is stored in the image data storage means in a mode in which a predetermined instruction (for example, an instruction to extract all image data of an image of a specific person as an object) using the identification result of the identification means is given from the outside. For each individual image, the shooting date and time and the shooting location are collated with the movement histories of a plurality of persons, and the identification is performed by the identification means such as identifying each person as a subject in each image. It is also possible to carry out before, and even when a predetermined instruction using the identification result by the identification means is given from the outside, it is possible to respond to the instruction from the outside in a short time.

Further, in the invention according to claim 4, as for collecting the movement histories of a plurality of persons, for example, as described in claim 5, the current position of each person is periodically notified to the collecting means. The collection means stores the current position of each person, which is periodically notified, in the movement history storage means in association with the information for identifying each person and the current date and time. .

Further, in the invention described in claim 5, the current position of each person is, for example, as described in claim 6, a portable communication device (for example, PDA or mobile phone) carried by each person. Etc.) and a base station provided at substantially constant intervals. If the mobile communication device is a mobile phone, the location information service provided by the mobile phone carrier (a service that notifies the current location of the owner of the mobile phone) can It is also possible to notify the position periodically.

Further, the current position of each person is, for example, as described in claim 7, the position detecting means (for example, the current position using the GPS system) provided in the portable device carried by each person. Can also be detected. Note that, as described above, even in a mode in which the movement history of a person is automatically recorded in a recording medium possessed by the person, the invention according to claim 6 or 7 is applied to periodically detect it. By sequentially recording the current position of the person on the recording medium, it is possible to record the movement history of the person.

Further, in the invention described in claim 1, for example, as described in claim 8, the acquisition means also has at least one of a shooting direction and a shooting magnification when shooting an unspecified person as a subject. The acquiring and identifying means uses at least one of the shooting direction and the shooting magnification acquired by the acquiring means to identify a person as a subject in the image represented by the image data stored in the image data storage means, or a specific person. It is preferable to identify the image data of the image.

Since the photographing range is narrowed particularly when photographing at a high photographing magnification, as a result of collating the photographing date and time and the photographing place of a specific image with the movement history of a specific person, a specific person is photographed at the time of photographing a specific image. Even if it is determined that the person is present at the shooting location, there may be a case where the specific person is not actually the subject in the specific image. On the other hand, claim 8
According to the invention described above, since at least one of the shooting direction and the shooting magnification is used to identify a person as a subject or an image in which a particular person is a subject, the accuracy of identifying a person or an image can be improved.

In order to achieve the second object, an order processing device according to the invention of claim 9 is the image identification device according to any one of claims 1 to 8 and the identification means. Display control means for displaying on the display means an image of a designated person as a subject based on the identification result, and performing predetermined processing according to the order from the customer for the image displayed on the display means And processing means.

Since the order processing device according to the invention of claim 9 comprises the image identification device according to any one of claims 1 to 8, like the invention of claim 1,
It is possible to easily identify a person as a subject in an image or an image in which a specific person is a subject. In the invention according to claim 9, the display control means causes the display means to display an image having the designated person as a subject based on the identification result by the identification means, and the processing means displays the image displayed on the display means. Since the predetermined processing is performed according to the order from the target customer, it is possible to meet the order of the target customer with the image displayed on the display means.

As described above, according to the invention of claim 9, when the customer designates a person to be ordered, an image having the designated person as a subject is displayed on the display means, and the displayed image is targeted. Since it is possible to place an order for a specific person, it is possible to easily place an order for an image in which a specific person is the subject.

In order to achieve the second object, the order processing apparatus according to the invention of claim 10 is the image identifying apparatus of any one of claims 1 to 8 and the identifying means. Distribution means for distributing an image of a certain person as a subject to the customer based on the identification result, and processing means for performing a predetermined process according to an order from the customer for the image distributed by the distribution means. , Is included.

The order processing device according to the invention of claim 10 comprises the image identification device according to any one of claims 1 to 8. Therefore, the order processing device according to the invention of claims 1 and 9 Similarly, it is possible to easily identify a person as a subject in an image or an image in which a specific person is a subject. In the invention according to claim 10, based on the identification result by the identifying means, the image having a certain person as a subject is delivered to the customer by the delivering means, and the processing means targets the image delivered by the delivering means. Since the predetermined processing according to the order from is performed, it is possible to meet the customer's order for the delivered image.

The certain person may be the customer himself or a person registered in advance by the customer (for example, the customer's family or the like). In addition, image distribution,
For example, it can be realized by transmitting an image to a computer, a mobile device, or the like owned by the customer. According to the tenth aspect of the present invention, an image of a certain person as a subject is automatically delivered to the customer, and the customer can place an order for the delivered image. The customer can easily place an order for the image.

As the predetermined processing in the invention described in claim 9 or claim 10, for example, as described in claim 11, of the image data stored in the image data storage means, the data is designated by the customer. Examples of the process include a process of creating a print using the image data of the selected image or requesting the creation of the print, and a process of delivering or distributing the image data of the specified image to the customer. It should be noted that predetermined image processing (for example, image processing for enlarging / reducing, trimming, and improving image quality) may be performed when the image data is delivered or distributed to the customer.

Further, in order to achieve the first object, the image identifying method according to the invention of claim 12 obtains a photographing date and time and a photographing place when an unspecified person is photographed as a subject, The image data represented by the image data is obtained by storing the image data obtained by the image capturing in the image data storage unit and comparing the image capturing date and time and the image capturing location corresponding to the image data with the movement history of the person imaged as the subject. Since the person as the subject in the image or the image data of the image in which the particular person is the subject is identified, the person as the subject in the image or the particular person is set as the subject as in the invention according to claim 1. The image can be easily identified.

[0031]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

[First Embodiment] FIG. 1 shows an image ordering system 10 according to the first embodiment. In the first embodiment, the photographer 12 at an arbitrary shooting location such as a tourist spot, a theme park, an event venue, or a park.
As a result, an image is taken with an arbitrary person present at the spot as a subject. In the image ordering system 10 according to the first embodiment, a person (customer 16) photographed as a subject in the above-mentioned photographing orders a photographed image (for details, ordering a photographic print or image data of the photographed image). It is a system that makes it possible to order the delivery of.

That is, the image ordering system 10 includes the order processing device 24 according to the present invention. The order processing device 24 also has a function as an image identification device according to the present invention. The order processing device 24 is composed of a computer such as a workstation, and has a CPU 24A and a ROM 24.
B, a RAM 24C, an input / output port 24D are connected to each other via a bus 24E, and a communication control device (for example, a modem or router) 26, a media driver 28, and a hard disk device (HDD) 30 are connected to the input / output port 24D. Has been done.

The HDD 30 of the order processing device 24 stores the image ordering process (details will be described later) according to the present invention.
An image ordering program to be executed by the CPU 24A of No. 4 is installed in advance, and by the CPU 24A executing the image ordering program, the order processing device 2
The computer constituting 4 functions as the order processing device according to the present invention.

The cameraman 12 who takes an image that can be ordered through the image ordering system 10 is a digital still equipped with a GPS function for detecting the current position using the GPS system and a clock function for detecting the current date and time. The camera 14 (hereinafter, simply referred to as the DSC 14) is possessed, and the DSC 14 is used to take an image. Photographer 1
Every time 2 shoots, the captured image data and other information are
The data is recorded on the recording medium 20 (for example, smart media (R), compact flash (R), memory stick (R), etc.) by the SC 14, and the media driver 28 stores the captured image data and the like from the recording medium 20 brought in by the cameraman 12. Read information.

The DSC 14 corresponds to the photographing means described in claim 2, and the GP mounted on the DSC 14
The S function corresponds to the position detecting means described in claim 2, and the time counting function corresponds to the date detecting means described in claim 2.

The communication control device 2 of the order processing device 24
6 is connected to the communication network 32. This communication network 32 is
A large number of base stations that include a mobile telephone network and a public telephone network, a high-speed and large-capacity dedicated communication network, or a computer network such as the Internet, and that form a part of the mobile telephone network. 34 is connected. Further, in the communication network 32, there are computers (PC) 3 owned by print finishers 36 existing in a large number throughout the country.
8, plural order receiving terminals 42, image ordering system 10
Computer (PC) 48 owned by the customer 16 of
And the location information service center 50 of the mobile phone company are connected to each other.

The print finisher 36 is a digital scanner including a device such as a film scanner for reading an image recorded on photographic film and a digital printer for performing a print finishing process for recording an image represented by image data on a recording material such as photographic paper. Possess a print system 40. The digital print system 40 is connected to the PC 38, and is also capable of performing print finishing processing using image data received by the PC 38 via the communication network 32.

The order receiving terminal 42 is a terminal for receiving an order from a customer, and may be an arbitrary place (a place near the place where the photographer 12 is taking a picture or a place unrelated to the place of taking a picture (for example, a convenience store). Store and D
It may be installed at a PE store, etc.). The order receiving terminal 42 includes a display 44 which is composed of a CRT, LCD or the like and can display images and the like, and an input unit 46 which is composed of a keyboard and the like for the customer to input arbitrary information. It also has a function of communicating with the order processing device 24 via the.

In the first embodiment, each customer of the image ordering system 10 (customer to be photographed by the cameraman 12) owns a mobile phone 18, and subscribes to the location information service provided by the mobile phone company. is doing.
This location information service is provided by a mobile phone 18 carried by a customer (for example, PHS (Personal Handy-phone System)).
The location information service center 50 searches the position of the mobile phone 18 (determines the base station 34 closest to the mobile phone 18) by communication between the mobile phone of FIG. This is a service for periodically notifying the recognized current position to a third party for each individual customer. In the first embodiment, the current position of each individual customer is transmitted from the position information service center 50 to the order processing device. 24 will be notified periodically. Thus, the mobile phone 18 corresponds to the portable communication device according to claim 6.

Next, the operation of the first embodiment will be described. In the first embodiment, the cameraman 12 possesses when the person arrives while staying at a fixed position in the above-mentioned arbitrary shooting place or wandering around the area and waiting for the person as a subject to arrive. The photographing of the person who has arrived using the DSC 14 is repeated. The DSC 14 possessed by the cameraman 12 uses GPS every time an image is taken.
The current position is detected by the function, the current date and time is detected by the time counting function, and the detected current position and current date and time are recorded as shooting location information and shooting position information in association with the shot image data obtained by shooting. Record on the medium 20.

The cameraman 12 sends the recording medium 20 to the management center in which the order processing device 24 is installed at the timing when a certain number of images have been taken or one day of shooting has been completed, and the operator of the management center. Is a photographer 1
The recording medium 20 sent from No. 2 is the order processing device 24
The media driver 28.

In the order processing device 24, when the recording medium 20 is set in the media driver 28 or when some information is received from the outside (such as the position information service center 50 and the order receiving terminal 42), the image order processing shown in FIG. Is activated. In this image ordering process, the type of input information is determined in step 100. When the recording medium 20 is activated by being set in the media driver 28, it is determined that the input information is captured image data, and the process proceeds to step 102.

At step 102, a single photographed image data is read from the recording medium 20, and at the next step 104.
Then, the shooting date / time information and the shooting location information stored in association with the shot image data read in step 102 are read. Note that this step 104 corresponds to the acquisition means of the present invention. Then, in step 106, HD
The photographed image data read in step 102 is stored in the image DB provided in D30 in association with the photographing date / time information and photographing place information read in step 104. In this way, the HDD 30 corresponds to the image data storage means of the present invention.

In the next step 108, the recording medium 2
It is determined whether or not all the captured image data recorded in 0 have been stored in the image DB. If the determination is negative, the process returns to step 102, and steps 102 to 108 are repeated until the determination of step 108 is positive. Then, when the determination in step 108 is affirmative, the image ordering process ends. By performing the above processing each time the recording medium 20 is received from the cameraman 12, as shown in Table 1 below, in the image DB, with respect to all the images captured by the cameraman 12, captured image data and shooting date / time information. And the shooting location information is recorded respectively.

[0046]

[Table 1]

The photographed image data, the photographing date / time information, and the photographing place information are not limited to those obtained via the recording medium 20 as described above, and for example, the mobile phone possessed by the cameraman 12 is provided. For example, every time a shooting is performed, or a predetermined number of shootings are performed by a communication device such as the above, or at the end of one-day shooting, the captured image data, the shooting date / time information, and the shooting location information are stored in the order processing device 2.
It goes without saying that the information may be transmitted to No.

Next, the collection of the movement history of each customer will be described. As described above, each customer of the image ordering system 10 owns the mobile phone 18 and subscribes to the location information service provided by the mobile phone company. The current location of is regularly notified. When notifying the current location of the customer, in addition to the location information indicating the current location of the customer, information for identifying the customer (for example, a customer number uniquely assigned to each customer by the mobile phone company) Will be notified at the same time.

In the order processing device 24, the image ordering process is started even when the information notifying the current position of the customer is received from the position information service center 50. In this case, the process proceeds from step 100 to step 110. Step 11
At 0, the current date and time updated / held by the timing function of the order processing device 24 is read.

Then, in step 112, based on the information for specifying the customer received from the location information service center 50, the customer ID of the customer to be notified (the image ordering system uniquely assigns to each customer). Existing ID). In order to determine the customer ID, for example, a table in which information for identifying the customer transmitted from the location information service center 50 is registered in the HDD 30 in association with the customer ID is received and received. This information can be searched by using this information as a key to search this table. Then, the customer movement information DB provided in the HDD 30
The position information received from the position information service center 50 and the date and time information indicating the current date and time read out in step 110 are stored as movement history information corresponding to the previously determined customer ID, and the image ordering process ends.

Step 112 corresponds to the collecting means described in claim 4 (more specifically, the collecting means described in claim 5), and the HDD 30 also corresponds to the movement history storage means described in claim 4. ing.

By performing the above processing each time the current position of each customer is notified from the position information service center 50, as shown in the following Table 2, the customer movement information DB is set in units of each customer. , A plurality of pieces of movement history information (a set of date and time information indicating a customer's position at a certain date and time and position information) are stored, and by referring to the movement history information group stored in the customer movement information DB, It is possible to judge the movement history of the customer.

[0053]

[Table 2]

Next, a case where the customer 16 orders an image obtained by the photographer 12 will be described. In the first embodiment, an order receiving terminal 42 is installed as a terminal for receiving an order from the customer 16. When ordering an image using the order reception terminal 42,
The customer 16 requests the order processing device 24 to order an image showing the customer 16 himself as a subject by inputting the customer ID via the input unit 46.

In addition, a customer card or the like in which the customer ID of each customer is recorded is distributed to each customer in advance, and
A card reader or the like for reading the customer ID from the customer card is provided in the order reception terminal 42, and when the customer places an order, the customer card possessed by the customer is inserted into the card reader. You may make it input automatically. Further, for example, an IC tag in which information such as customer ID of each customer is recorded is added to a customer card carried by the customer, and an IC tag sensor for reading information from the IC tag is provided in the order receiving terminal 42. Every time a customer arrives at the place where the order receiving terminal 42 is installed, the IC tag sensor is used to read information such as the customer ID from the IC tag attached to the customer card carried by the customer. The incoming customer may be automatically recognized without the customer having to input the customer ID or insert the customer card into the card reader.

In the first embodiment, the customer 16
In addition to using the order reception terminal 42,
It is also possible to use the mobile phone 18 or the PC 48 owned by the customer 16. Mobile phone 18 or P
For ordering using the C48, for example, a predetermined web page prepared in advance for ordering images and stored in a predetermined web server is accessed, and the predetermined web page is displayed on the display unit of the mobile phone 18 or the display of the PC 48. Customer I provided on a predetermined web page
This can be done by inputting the customer ID in the D input field.

When the customer 16 performs an operation for ordering an image as described above, the order reception terminal 42 or the mobile phone 1
8 or the PC 48 sends information requesting an image order together with the customer ID to the order processing device 24. The order processing device 24 starts the image ordering process. In this case, the process proceeds from step 100 to step 114. Step 11
In 4, the customer movement information D is set using the received customer ID as a key.
B is searched and all the movement history information of the customer corresponding to the received customer ID is extracted from the customer movement information DB.

In step 116, a single piece of movement history information (set of position information and date / time information) is extracted from the movement history information group extracted in step 114, and in the next step 118, the movement extracted in step 116. The history information is compared with the shooting date / time information and the shooting location information stored in the image DB in association with the shot image data to determine whether the date / time and the location are substantially the same.
By performing the processing on all the captured image data stored in B, the capturing date and time and the capturing location are determined in step 116.
It is searched whether or not the photographed image data that substantially matches the position and date and time represented by the movement history information extracted in step S1 is stored in the image DB. Then, if photographed image data matching the search condition exists in the image DB, the photographed image data is read from the image DB and temporarily stored in the RAM 24C or the like. This step 118 corresponds to the identification means (specifically, the identification means described in claims 3 and 4) of the present invention.

In the next step 120, step 114
It is determined whether or not the above processing has been performed on all the movement history information extracted in step S6. If the determination is negative, the process returns to step 116, and steps 116 to 120 are repeated until the determination of step 120 is affirmative. As a result, all the captured image data of the image that is highly likely to be the subject of the customer who requests the image order is extracted.

When the determination at step 120 is affirmative, the routine proceeds to step 122, where the image represented by each captured image data is index-displayed (reduced and arranged in a matrix by using the captured image data extracted by the search at step 118). The index image data representing the displayed image is generated, and the generated index image data is used as an order request source device (order reception terminal 42, mobile phone 18 or PC).
48), the index image is displayed on the display unit (the display 44 of the order receiving terminal 42, the display unit of the mobile phone 18, or the display of the PC 48) of the apparatus that issued the order. Note that step 122 corresponds to the display control means described in claim 9.

The order processing device 24 also causes the display unit of the order request source device to display a message requesting the customer 16 to select an image to be ordered together with the above-mentioned index image, and in the next step 124, It is determined whether or not the image to be ordered is selected by the customer 16, and the process waits until the determination is positive. The customer 16 refers to the index image displayed on the display unit of the apparatus that issued the order request. Since each of the individual images displayed as the index image is an image in which the customer 16 is likely to be the subject, the customer 16 can easily find the image to be ordered. Then, the customer 16 uses the input unit (the input unit 46 of the order receiving terminal 42 or the mobile phone 18 of the order request source device).
The operation key of (1) or the keyboard of the PC 48) is operated to select an image to be ordered, and at the same time, an order type (whether to make a photographic print or to deliver image data of a captured image) to the selected image is instructed.

If the order type is "photo print creation", "number of prints" and "print receiving method"
(For example, whether the customer 16 wants to deliver it to his / her home or receives it at the nearest convenience store) is also designated. When the order type is “image data delivery”, information for specifying the transmission destination of the image data to be ordered (for example, the mail address of the customer 16) is also designated.

When the customer 16 selects the image to be ordered, the determination in step 124 is affirmative and step 1
26, and the contents of the order placed by the customer 16 are determined. When the order by the customer 16 is “photograph print creation”, the process proceeds to step 128. In step 128, based on the “print receiving method” received from the order requesting device, the customer's address specified by the customer ID, and the like, it is most suitable for ordering the print order of this time from a large number of print finishers 36. 16 print finishers 36
Captured image data of an image selected as an order target by, information indicating the order content specified by the customer 16,
Print finisher 3 who selected the customer ID of customer 16
By sending the print order to the PC 38 of No. 6, the print order from the customer is placed.

The print finisher 36, which has received the above information by the PC 38 via the communication network 32, is defined by the "print size" of the received information indicating the order content, using the captured image data. Create a number of photographic prints of the size specified in "Number of prints", and send the created photographic prints to the specified destination so that the customer 16 can receive the photo prints by the receiving method specified in "Print receiving method". Deliver to. As a result, the customer 16 can receive the photographic print of the image selected as the order target (the image in which the customer 16 itself is the subject) under the conditions (size, number of sheets, receiving method) that match the specified order details. it can.

When the order by the customer 16 is "delivery of image data", steps 126 to 13 are performed.
The process proceeds to 0, and the captured image data of the image selected by the customer 16 as an order target is transmitted to the destination specified by the customer 16. As a result, the customer 16 uses the captured image data of the image selected as the order target (the image in which the customer 16 itself is the subject) as the PC 48 or the mobile phone 1.
8 can be received. It should be noted that when the captured image data is delivered to the customer 16, predetermined image processing (for example, scaling, trimming, image processing for improving image quality) may be performed. The above steps 126 to 130 correspond to the processing means according to claim 9.

In the first embodiment, the customer ID
Is specified, the case of searching for an image with the customer 16 corresponding to the customer ID as a subject has been described, but the present invention is not limited to this, and the order processing device 24 does not receive information from the outside. At the time of standby or the like, the order processing device 24 collates the photographing date and time and the photographing place stored in the image DB in association with the individual photographed image data with the movement history information of each customer, thereby Identification of a person as a subject in the image represented by the captured image data (any one of the customers 16 having a large number of subjects) may be performed.

Further, in the above-described first embodiment, the case where the movement history of each customer is acquired by using the position information service provided by the mobile phone company has been described, but the present invention is not limited to this. Each customer has a portable device (corresponding to the portable device according to claim 7) equipped with at least a GPS function (position detecting means according to claim 7) for detecting a current position by using a GPS system. Then, the GPS function of the mobile device may acquire the movement history of each customer generated by detecting the current position at regular time intervals. In this aspect, as a method of acquiring the movement history, for example, a method of acquiring the movement history by periodically transmitting the movement history information from the mobile device owned by each customer to the order processing device 24 is adopted. Or, for example, when a customer places an order via the order receiving terminal 42 or the like,
It is also possible to adopt a method of acquiring the movement history by reading the movement history information accumulated and stored in the mobile device by the order receiving terminal 42 or the like.

In addition, the range in which the photographer 12 shoots is set, for example, in a theme park or in a park.
In the case of being limited to a certain area, for example, as in the case of the second embodiment described next, each customer existing in the certain area is allowed to carry a transmitter for transmitting a signal including a predetermined ID (this The transmitter can be embedded in an entrance ticket to a certain area, etc.), and a large number of base stations for receiving signals transmitted from the transmitter are provided in the certain area at substantially regular intervals, and each customer can The movement history of each customer is acquired by repeating the procedure of determining which base station the signal transmitted from is received and detecting the current position of each customer at regular intervals. Good.

Further, in the first embodiment, the case where the shooting location and the shooting date and time are detected by the GPS function and the timekeeping function mounted on the DSC 14 possessed by the cameraman 12 has been described. In the case where the number of base stations is limited to a certain area, a large number of base stations are provided at substantially constant intervals within the certain area as in the second embodiment to be described below to identify individual captured images at the time of capturing. A predetermined signal including the image ID of the image is transmitted from the DSC 14 to the base station, and the order processing device 24 side detects the shooting location by determining which base station received the signal. The shooting date and time is determined by determining the date and time when the image is received, and the image DB is associated with the received image ID.
It may be stored in a storage device such as a computer.

Further, in the first embodiment, the order processing device 2
4 is a customer movement information DB by collecting movement history of individual customers
However, the present invention is not limited to this, and represents the customer's own movement history input based on the customer's memory without collecting the customer's movement history. Information (for example, information such as "I went to △ on xx month x day: This also corresponds to the" movement history of a person "according to the present invention)" is collated with the photographing date and time and the photographing place of each photographed image data. By doing so, an image in which the customer is highly likely to be the subject may be searched.

Further, in the first embodiment, the image in which the customer is highly likely to be the subject is extracted based on only the matching of the date and time, but the corresponding image is also extracted by using other information. You may make it extract. For example, by allowing the customer to input the color of clothes on the day and extracting the image extracted by matching the date and time and place, the area (face area) estimated to correspond to the customer's face is extracted by known face area extraction processing, Based on the extracted position and size of the face area, the area estimated to correspond to the body of the customer (body area) is determined, and the tint of the body area matches or is similar to the color of the clothes input by the customer. By performing the process of determining whether or not there is an image, it is possible to narrow down images that are likely to be the customer.

Further, in the first embodiment, when the customer makes an order request, the photographed image data of the image that is highly likely to be the subject of the customer requesting the image order is extracted, Although the example of displaying on the display unit of the device of the order request source has been described, the present invention is not limited to this, and a certain person (customer himself or a person registered in advance by the customer does not have to wait for an order request from the customer. It is also possible to extract an image of which the object is “) and automatically deliver it to the mobile phone 18 or the PC 48 owned by the customer via a communication network such as the Internet. This aspect corresponds to the invention of claim 10. It is also desirable to attach a program for the customer to order the images at this time.

According to the above aspect, when the customer takes a picture of the customer as a subject when the customer goes to a specific facility such as a tourist resort, a theme park, an event venue, or a park, after that, The image obtained by photographing and the program are attached to, for example, an electronic mail or the like and transmitted (delivered) to the mobile phone 18 or the PC 48 owned by the customer, and the customer who recognizes the arrival of the electronic mail opens the attached file. Then, the image obtained by shooting is displayed on the display unit, and by subsequently executing the program, a message prompting the customer to order is displayed,
It becomes possible for the customer to order the delivered image. In the above aspect, since the image is distributed to the customer's mobile phone 18 or PC 48, the opportunity for the customer to order the image can be increased.

In the above aspect, the image to be distributed is not limited to the index image in which the still image described above is reduced and arranged in a matrix form, but may be edited and distributed in a screen configuration like an album. Alternatively, data such as images, characters, voices, and texts may be combined (for example, an explanation message regarding the shooting date and time or the shooting location, image modification such as border decorations, advertisements, etc.), and special processing (for example, blurring). , Watercolor / oil style, monochrome, etc.), add moving image data,
A plurality of still images may be sequentially reproduced and displayed on the display unit at predetermined time intervals like a slide show. Also, images, characters, voices, etc.
Select texts and moving images to be added to images to be distributed according to the shooting date and time, the shooting location, or the event that was held at the time of shooting (this event can be judged from the shooting date and time and the shooting location) (For example, if the shooting place is in a specific theme park, an image character of the specific theme park is combined, or a moving image promoting the specific theme park is added). Further, the image to be distributed may be a moving image, and when distributing the moving image, it may be edited by a screen configuration such as a memorial movie and then distributed. It is preferable that the data to be displayed is also a moving image), and the like. Further, the customer may be able to select in advance the presence or absence of an example of an image subjected to data synthesis or special processing and the type thereof. By performing the above-described distribution image processing, it is possible to improve the entertainment property of image distribution and increase the customer's motivation to order images.

[Second Embodiment] Next, a second embodiment of the present invention will be described. The same parts as those in the first embodiment are designated by the same reference numerals and the description thereof will be omitted. FIG. 3 shows an image ordering system 11 according to the second embodiment. In the second embodiment, in the stadium 52 where an arbitrary competition (for example, baseball, soccer, athletics, etc.) is held, the photographer 12 photographs the athlete 17 as a subject. The image ordering system 11 according to the second embodiment is a system that allows the customer 16 to order the images obtained by the above-described shooting.

The athletes 17 as subjects in the second embodiment each have a transmitter 19 that constantly emits a predetermined signal including an athlete ID for identifying each athlete 17. The transmitter 19 is embedded in, for example, a uniform, a race number, shoes, or the like so as not to interfere with the competition of the competitor 17. In the basement of the stadium 52, a large number of position sensors 35 that receive signals transmitted from the transmitter 19 are embedded at regular intervals (for example, at intervals of several meters). The multiple position sensors 35 are external to the order processor 24.
Each of them is connected to the / F section 29.

In addition, in the second embodiment, the cameraman 12 has a digital still camera (DSC) 15 having a built-in transmitter for constantly transmitting a predetermined signal including a camera ID, like the transmitter 19. In possession. The position sensor 35 described above also receives the signal transmitted from the DSC 15. The DSC 15 is an external I / O of the order processing unit 24.
It also has a function of wirelessly communicating with the F unit 29, and a function of detecting the azimuth and the shooting magnification at the time of shooting.

Further, the image ordering system 11 according to the second embodiment has the order receiving terminal 42 described in the first embodiment.
Instead of this, an electronic signboard 43 is installed near the entrance of the stadium 52 or the like. This electronic signboard 43 also
A large-screen display 44 capable of displaying images and the like, and an input unit 46 composed of a keyboard or the like for the customer to input arbitrary information are provided, and the order processing device 24 is provided via the communication network 32.
It also has a function to communicate with.

Next, the operation of the second embodiment will be described. When the competition by the athlete 17 is started in the stadium 52, the photographer 12 moves the athlete 1 while moving in the stadium 52.
Shooting is performed with 7 as a subject. During this time, the transmitter 19 possessed by the competitor 17 and the DSC 15 possessed by the cameraman 12 always transmit a predetermined signal, and the transmitted signal exists at the position closest to the current position of the competitor 17 or the photographer 12. Is received by the position sensor 35.

The HDD 30 of the order processing device 24 stores the first
A subject movement information DB is provided in place of the customer movement information DB described in the embodiment, and the order processing device 24 includes a position sensor 35 provided with a large number of signals transmitted from the transmitters 19 of the individual athletes 17. The current position of each athlete 17 is detected by constantly determining which of the received data is received, and the detected current position is associated with date and time information indicating the current date and time, and subject movement information D is used as subject position information.
The storage in B is repeated at a predetermined cycle.

As described above, the transmitter 19 carried by the athlete 17 corresponds to the portable communication device described in claim 6, and the position sensor 35 corresponds to the base station described in claim 6.
The positions of the individual photographers 12 (and the DSC 15) may also be constantly detected and stored as information, as in the above case.

Next, the image ordering process executed by the order processing device 24 according to the second embodiment will be described with reference to the flowchart of FIG. At step 150, it is determined whether or not the competition on the stadium 52 is completed. When the determination is negative, the process proceeds to step 152, and it is determined whether or not the photographing information is received from the DSC 15 of the cameraman 12. If the determination is negative, the process returns to step 150, and steps 150 and 15 are performed until either determination is positive.
Repeat 2.

The DSC 15 according to the second embodiment detects the azimuth at the time of photographing when the photographer 12 performs photographing (photographing with the athlete 17 as a subject), and also detects the photographing magnification, and detects the detected azimuth. The photographing direction information represented and the photographing magnification information indicating the detected photographing magnification are transmitted to the order processing device 24 together with the photographed image data obtained by photographing. When the above information (referred to as shooting information) is received via the external I / F unit 29, the determination at step 152 is affirmative and the process proceeds to step 154. The shooting direction can be detected by using a gyro (any of various types such as mechanical type, optical type, fluid type, and vibration type) or by detecting the geomagnetism.

In step 154, the current position of the cameraman 12 and the DSC 15 is determined based on which of the position sensors 35 receives the predetermined signal transmitted from the DSC 15 which transmitted the photographing information. The (shooting position) is determined, and the current date and time is detected as the shooting date and time. Note that this step 154
Includes an acquisition unit of the present invention, including a process of receiving shooting information from the DSC 15 (specifically, the acquisition unit according to claim 8).
It corresponds to. In the next step 156, step 1
The shooting position information and the shooting date and time information indicating the shooting position and the shooting date and time detected in 54 are stored in the RAM together with the shot image data, the shooting direction information, and the shooting magnification information received from the DSC 15.
It is temporarily stored in 24C or the like.

In the next step 158, step 156
The range of the stadium 52 photographed by the current photographing is determined based on the photographing position information, the photographing direction information, and the photographing magnification information among the information temporarily stored in. Then, in step 160, of the information stored in the subject movement information DB, information indicating the position of each athlete 17 at the shooting date and time is extracted as subject position information, and the subject position information is determined in step 158. By comparing with the information indicating the range and judging whether or not the competitor 17 exists within the photographing range at the time of photographing, it is determined for each competitor 17 that the current photographing (the photographed image represented by the received photographed image data is represented. The player 17 as a subject in () is identified.
This step 160 corresponds to the identification means of the present invention (specifically, the identification means described in claim 8).

Note that in a group competition or the like, a plurality of competitors 17 are often photographed as main subjects, but when another competitor who is not the main subject enters the photographing range, the other competitors photograph the subject. It may be reflected as the background of the image. In identifying a competitor as a subject in such a captured image, if it is desired to avoid recognizing other competitors who are reflected in the background as a subject, it is determined that the competitor was present within the capturing range at the time of capturing, for example. Of the plurality of competitors 17 who did, exclude the competitors whose distance between the shooting position and the shooting location is significantly different from other competitors,
It is only necessary to exclude athletes whose distance between the position at the time of shooting and the shooting place is significantly different from the distance to the subject measured by the AF mechanism at the time of shooting.

In the next step 162, the received photographed image data is stored in the image DB in association with the ID of the athlete 17 determined to be the subject in step 160, and the process returns to step 150. As a result, while the competition is being performed in the stadium 52, steps 154 to 162 are repeated every time the cameraman 12 takes an image, the athlete 17 as a subject is identified, and the ID of the athlete 17 is obtained. Accumulation and storage of captured image data in association with each other is repeated.

When the competition in the stadium 52 is completed (the photographing by the cameraman 12 is completed), the determination at step 150 is affirmed and the routine proceeds to step 164, where the stadium 52 is completed.
The names, facial photographs, etc. of all the athletes 17 who have competed in the competition are displayed as a list on the display 44 of the electronic signboard 43. In the next step 166, it is determined whether or not any player has been selected by the customer 16 who has arrived at the installation position of the electronic signboard 43 (for example, a person who has watched the competition held in the stadium 52). Wait until affirmative.

Customer 1 who has arrived at the installation position of electronic signboard 43
When 6 selects a specific athlete 17 from all the athletes 17 displayed in order to order an image of a specific athlete, the determination at step 166 is affirmative and the process proceeds to step 168. The image DB is searched by using the ID of the specific athlete 17 selected by the customer 16 as a key, and all the captured image data stored in association with the ID of the specific athlete is extracted. Then, in the next step 170, the images represented by the photographed image data extracted by the search are displayed as a list on the display 44. As a result, only the images with the specific athlete 17 as the subject are displayed on the display 44 as a list, so that the customer 16 can easily find the image to be ordered. The step 170 corresponds to the display control means described in claim 9.

The following steps 172 to 178 are
Steps 124 to 13 described in the first embodiment
Since it is substantially the same as 0, it will be briefly described. It is determined whether or not the image to be ordered is selected by the customer 16 (step 172). (Step 1
74), when the order by the customer 16 is “photograph print creation”, in step 176, the print finisher 36 is selected, the photographed image data of the image of the order object, the information indicating the order content designated by the customer 16, Customer 16
PC of the print finisher 36 who selected the customer ID of
By sending to 38, the print order from the customer is placed. If the order by the customer 16 is “delivery of image data”, in step 178, the captured image data of the image to be ordered is transmitted to the destination specified by the customer 16. Steps 174 to 178 also correspond to the processing means according to claim 9.

At the next step 180, it is determined whether or not the processing is to be ended. This step 180 is unconditionally denied for a predetermined time after the competition ends, for example, step 16
Return to 4. Accordingly, the customers 16 who come to the stadium 52 and watch the competition can obtain images in which the desired competitors 17 are the subjects.

In the second embodiment, in order to simplify the explanation, the electronic signboard 43 is used as a device for ordering images.
However, it is needless to say that the image may be ordered by accessing the web page for the customer to order the image, as in the first embodiment.

In the second embodiment, the competitor 17 is caused to carry the transmitter 19, and the position sensor 35 is used to make the competitor 17
However, the number of transmitters is not limited to this, and a large number of transmitters are installed on the stadium 52 side, and a signal including position information indicating the position of each transmitter is transmitted from each transmitter. Each competitor 17 is provided with a receiver having a function of transmitting a signal, receiving a signal from the transmitter, and recording the position information included in the received signal in association with the current date and time at a predetermined cycle. Acquiring the movement history of each athlete by having them possessed, collecting the receiver after the competition in the stadium 52 and reading the recorded information (information indicating the movement history of each athlete 17) You may do it. Further, instead of reading the information from the receiver after the end of the competition, the record information may be periodically transmitted from the receiver.

The method of detecting the shooting location is not limited to the method described in each of the above embodiments, and a large number of signals including location information indicating the installation locations of individual base stations are provided at different locations. From each base station, DS
The shooting location may be detected by receiving this signal on the C side.

Further, the DSC 14 has been described as an example of the photographing means possessed by the cameraman 12 in the above, but the invention is not limited to this, and a normal camera for exposing and recording an image on a photographic film or a digital video camera. Needless to say, may be used as a photographing means.

In particular, when a digital video camera is used as the photographing means, the present invention is applied to the individual images of the moving images obtained by the photographing to discriminate the subject, and to identify the discriminated subject. Information (Subject I
By storing D) in association with each image, it is possible to easily search for a scene in which a specific subject is captured and edit a moving image for each subject.

When a digital video camera is used as the photographing means, a moving image is ordered by the customer. To distribute the moving image, the moving image is recorded on a video tape and sent to the customer. You may go, you may entrust to a cable television (CATV) company, and you may make it distribute a moving image using the internet. Specifically, for example, when a customer orders a moving image of a specific athlete via the electronic signboard 43, a recording means (for example, a video recorder or a PC) possessed by the customer for the ordered moving image.
Etc.) to notify the recording means of information for recording reservation (broadcast channel, broadcast date and time, etc.), and at the same time notify of a key for descrambling a moving image to be scrambled and broadcast. In this case, the recording means
At the notified broadcast date and time, the broadcast of the notified broadcast channel is received, the scramble is canceled using the notified key, and then the recording is performed. This allows the customer to obtain the moving image ordered by the customer.

In the above, the case where the cameraman 12 takes a picture has been described, but the present invention is not limited to this.
A camera that includes a sensor for detecting a person as an object as an image capturing unit and automatically captures the detected person when the person is detected by the sensor (this camera also has an image on a DSC or a photographic film as described above). It is needless to say that any of a normal camera for exposure recording and a digital video camera) may be used.

Further, in the second embodiment, after the photographer 12 has taken a picture, the order processing device 24 has the DSC1.
There is a possibility that a slight time lag will occur until the order processing device 24 recognizes that the image has been captured by receiving the image capturing information from 5, and the above-mentioned time lag may improve the identification accuracy of the subject particularly in a competition with a lot of movement. In the second embodiment, the case where the detected position of the subject (competitor 17) is sequentially stored in the subject movement information DB has been described because it may decrease. However, the subject position detection described in the second embodiment is described. Since the method itself can detect the position of each subject (individual athlete 17 in the example of the second embodiment) in real time, the position of a particular subject can be detected in real time by using this. However, to ensure that the specific subject always exists in the appropriate size within the imaging range (to automatically track the specific subject), Based on the location, shooting orientation, focus position of the photographing means, it is also possible to control the imaging magnification in real time.

As described above, the position of a specific subject is detected in real time, and the shooting direction, the focus position, and the shooting magnification of the shooting means are set so that the specific subject always exists within the shooting range with an appropriate size. The real-time control can be applied, for example, when automatic photographing is performed by the photographing means, but the result of detecting the position of the subject in real time is the result of the photographer (for example, the cameraman 12 or the customer 16 who has come to the stadium 52). Can also be used to support the shooting of a specific subject.

Specifically, for example, when the athlete 17 is photographed as a subject in the stadium 52 as in the second embodiment, information such as the order processing device 24 described in the second embodiment is used. The device that centrally manages (hereinafter, referred to as a management device) is the transmitter 19 described in the second embodiment.
And the position sensor 35 (instead of the transmitter 19, the individual athlete 1
7 and an IC tag sensor embedded in the stadium 52 instead of the position sensor 35).
The position of each competitor 17 as a subject is detected in real time, and the DSC possessed by each photographer
The position of each photographer (and DSC 15) is also detected in real time by a predetermined signal transmitted from 15. It should be noted that instead of a predetermined signal transmitted from the DSC 15, an IC tag possessed by each photographer and an IC tag sensor embedded in the stadium 52 are used to control each photographer (and DSC1).
You may make it detect the position of 5).

Further, the management device adds identification information for identifying each athlete 17 to the position information representing the position of each athlete 17 detected in real time, and each photographer possesses it. Each is periodically transmitted to the DSC 15 (for example, in a cycle of several milliseconds to several seconds), and the DSC of the notification destination
The position information indicating the position of 15 itself (the position of the photographer who owns the DSC 15) is also transmitted. It should be noted that the position information of the competitors 17 is not limited to transmitting the position information of all the competitors 17 to the individual DSCs 15, but the specific competitors notified by the individual photographers as the photographing targets. Only 17 position information is available for each photographer's D
You may make it transmit to SC15.

Further, the DSC 15 executes the shooting support process shown in FIG. 5 every time the position information of the athlete 17 and the position information of the DSC 15 itself are received from the management device. The shooting support process will be described below. Step 20
At 0, based on the position information of the athlete 17 received from the management device, the athlete 17 of the shooting target registered in the DSC 15 in advance is displayed.
The position information of the (target subject) is extracted (extraction of the position information is unnecessary if only the position information of the athlete 17 to be photographed is transmitted from the management device as described above), and the athlete 17 to be photographed is extracted. On the basis of the position information of the DSC 15 and the position information of the DSC 15 itself, the direction of the competitor 17 to be photographed when viewed from the photographer who owns the DSC 15 (the photographing direction for photographing the target subject) is calculated.

The above-mentioned photographing direction may be a photographing direction in a horizontal plane (photographing azimuth angle), but it is desirable to include a photographing direction in a vertical plane (photographing elevation angle) in addition to the azimuth angle. Shooting elevation angle is for competitor 17 (target subject)
If the altitude of the photographer (DSC15) can be detected, calculation can be performed. The target subject and the altitude of the photographer are, for example, GP.
It is possible to detect the target subject and the position of the photographer at the same time by using the S system. Further, if the altitude at each position of the stadium 52 is known, the altitudes of the target subject and the photographer can be detected from the positions of the target subject and the photographer (positions in the horizontal plane).

The DSC 15 has a built-in gyro sensor for detecting the shooting direction. In step 202, the current shooting direction of the DSC 15 is fetched from the gyro sensor.
By comparing the captured current shooting direction with the shooting direction for shooting the target subject calculated in step 200, a shooting image frame in which the target subject represents a predetermined shooting range in the current shooting direction of the DSC 15 It is determined whether it is within.

As an example, as shown in FIG. 6B, when the target subject deviates from the photographed image frame in the current photographing direction, the determination at step 202 is denied and the routine proceeds to step 204. The changing direction (for example, the horizontal direction and the vertical direction) of the shooting direction for fitting the target subject within the shot image frame is calculated. Then, in the next step 206, a direction indicating arrow indicating the changing direction of the shooting direction calculated in step 204 is displayed on the display unit of the DSC 15 such as an LCD, and the process returns to step 202. Therefore, steps 204 and 206 are repeated until it is determined in step 202 that the target subject is within the captured image frame.

FIG. 6B shows an example of a screen image displayed on the display section of the DSC 15 by the processing of step 206 described above. In the example of FIG. 6B, an image corresponding to the current photographing range is displayed in the photographed image frame W, and corresponds to the changing direction of the photographing direction calculated in step 204 outside the photographed image frame W. At the position, a direction indicating arrow D indicating the change direction is displayed. Accordingly, the photographer can change (move) the shooting direction of the DSC 15 so that the DSC 15 is directed in the direction indicated by the direction indicating arrow D, so that the target subject can be contained within the shot image frame W, and the target subject can be set. You can shoot easily and surely. Depending on the deviation between the current shooting direction of the DSC 15 and the shooting direction for shooting the target subject,
The display size of the direction indicating arrow D may be changed.

If it is determined in step 202 that the target subject is within the captured image frame (for example, in the state shown in FIG. 6A), the process proceeds to step 208. At this time, information related to the target subject (for example, information such as the profile of the specific athlete 17 as the target subject) is acquired from the management device or the like, and as an example, FIG.
As shown in (A), the related information I may be displayed on the display unit of the DSC 15. This can improve convenience for the photographer.

At step 208, the DSC 1 is determined based on the position information of the target subject and the position information of the DSC 15 itself.
The distance from 5 to the target object is calculated, and the next step 21
In 0, the target subject is within the captured image frame W based on the distance to the target subject obtained by the calculation, and the size of the target subject in the captured image frame W is set to an appropriate size (for example, the captured image frame W). (Approximately 1/4 in area ratio to W)
To calculate the shooting magnification. Then, in the next step 212, at least one of changing the optical magnification of the zoom lens of the DSC 15 and changing the electronic magnification of the DSC 15 in the electronic zoom of the DSC 15 is performed in accordance with the shooting magnification obtained by the calculation. The magnification is changed, and the shooting support process ends.

From the management device, the position information of the competitor 17 and D
Every time the position information of the SC15 itself is received, the above-described shooting support process is executed by the DSC 15, so that the photographer simply points the DSC 15 in the direction indicated by the direction arrow even when the target subject is lost. Just do
The target subject can be contained within the captured image frame W, and the target subject can be reliably captured.

[0111]

As described above, according to the inventions of claims 1 and 12, the shooting date and time and the shooting place in shooting an unspecified person as a subject are acquired, and the image data obtained by the shooting is stored. Then, by comparing the shooting date and time and the shooting location corresponding to the image data with the movement history of the person photographed as the subject, the person as the subject in the image represented by the image data, or the image of the specific person as the subject Since the image data is identified, there is an excellent effect that it is possible to easily identify a person as a subject in the image or an image in which a particular person is a subject.

According to a third aspect of the present invention, in the first aspect of the present invention, the movement history of a specific person input through the input means is stored in a plurality of image data corresponding to any of a plurality of stored image data. Since the image data of the image in which a specific person is the subject is identified by comparing each with the shooting date and time and a plurality of shooting locations, it is possible to simplify the configuration of the image identification device in addition to the above effects. Have an effect.

According to a fourth aspect of the present invention, in the first aspect of the invention, the movement histories of a plurality of persons are respectively collected, and the movement histories of the plurality of persons are respectively stored in the movement history storage means, and an image is displayed. By comparing the shooting date and time and the shooting location corresponding to the data with the movement history of multiple persons,
Since the person as the subject in the image represented by the image data is identified, in addition to the above effect, even when a predetermined instruction using the identification result by the identification means is given from the outside,
It becomes possible to respond to instructions from the outside in a short time,
Has the effect.

According to an eighth aspect of the invention, in the invention according to the first aspect, at least one of the photographing direction and the photographing magnification is acquired, and the image represented by the image data is obtained by using at least one of the acquired photographing direction and photographing magnification. Since the image data of the person as the subject or the image of the image of the specific person as the subject is identified, in addition to the above effects, there is an effect that the identification accuracy of the person or the image can be improved.

According to a ninth aspect of the present invention, the image identifying apparatus according to any one of the first to eighth aspects is provided, and an image of a designated person as an object is generated based on the identification result by the identifying means. Since it is displayed on the display means and the predetermined processing is performed according to the order from the customer for the displayed image,
This has an excellent effect that the customer can easily place an order for an image of a specific person.

According to a tenth aspect of the present invention, the image identification device according to any one of the first to eighth aspects is provided, and an image of a certain person as a subject is provided to the customer based on the identification result by the identification means. Since the predetermined processing according to the order from the customer for the image delivered to the customer is performed, the customer can easily order the image for the specific person. Have an effect.

[Brief description of drawings]

FIG. 1 is a schematic block diagram of an image ordering system according to a first embodiment.

FIG. 2 is a flowchart showing the contents of image ordering processing according to the first embodiment.

FIG. 3 is a schematic block diagram of an image ordering system according to a second embodiment.

FIG. 4 is a flowchart showing the content of image order processing according to the second embodiment.

FIG. 5 is a flowchart showing the content of a shooting support process executed by the camera based on the result of detecting the position of the subject in real time.

6 is an image diagram showing an example of an image displayed on the display unit of the camera by the shooting support process of FIG.

[Explanation of symbols]

10 Image ordering system 11 Image ordering system 14 Digital still camera 15 Digital still camera 18 mobile phones 19 transmitter 20 recording media 24 Order processor 32 communication network 34 base stations 35 Position sensor 42 Order reception terminal 43 electronic signboard 50 Location Information Service Center

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5B050 AA09 BA10 BA12 CA08 FA12                       GA08                 5C053 FA04 FA07 FA27 HA29 JA22                       KA04 LA01 LA03 LA14                 5C054 AA01 AA05 CA04 CC02 DA07                       DA09 FA00 GA00 GA05 GB05

Claims (12)

[Claims] 1. An acquisition unit for acquiring a photographing date and time and a photographing place in photographing an unspecified person as a subject, an image data storage unit for storing image data obtained by the photographing, and the image data storage unit. By comparing the shooting date and time and the shooting location corresponding to the stored image data with the movement history of the person shot as the subject, the person as the subject in the image represented by the image data or a specific person is set as the subject. An image identification device including identification means for identifying image data of an image. 2. The photographing means used for the photographing is provided with a date and time detecting means for detecting the current date and time and a position detecting means for detecting the current position, and the acquiring means is detected by the date and time detecting means. The image identifying apparatus according to claim 1, wherein the image capturing time and date and the image capturing position detected by the position detecting unit are acquired. 3. The image data storage means stores a plurality of image data, and the identification means stores the movement history of a specific person input via the input means in the image data storage means. 7. The image data of the image of which the specific person is the subject is identified by respectively comparing with a plurality of shooting dates and times and a plurality of shooting locations corresponding to any of the plurality of captured image data. 1. The image identification device according to 1. 4. The identification means further comprises: collection means for collecting movement histories of a plurality of persons, and movement history storage means for storing movement histories of a plurality of persons collected by the collection means, respectively. By identifying the shooting date and time and the shooting location corresponding to the image data with the movement histories of a plurality of persons stored in the movement history storage means, the person as a subject in the image represented by the image data is identified. The image identification device according to claim 1, wherein 5. The current position of each person is periodically notified to the collecting means, and the collecting means is used to identify the current position of each person who is regularly notified to identify each individual person. 5. The image identifying apparatus according to claim 4, wherein the movement histories of a plurality of persons are respectively collected by storing the movement histories in the movement history storage unit in association with the information and the current date and time. 6. The present position of each individual person is detected by communication between a portable communication device carried by each individual person and a base station provided at substantially constant intervals. The image identification device according to claim 5. 7. The image identifying apparatus according to claim 5, wherein the current position of each individual person is detected by a position detecting means provided in a portable device carried by each individual person. 8. The acquisition means also acquires at least one of a shooting direction and a shooting magnification when shooting is performed with an unspecified person as a subject, and the identification means acquires the shooting direction obtained by the acquisition means. Also, at least one of the image pickup magnification is used to identify image data of a person as a subject in the image represented by the image data stored in the image data storage unit, or image data of an image of a specific person as a subject. The image identification device according to claim 1. 9. A display for displaying on a display means an image of a designated person as a subject based on the image identification device according to claim 1 and an identification result by the identification means. An order processing apparatus including: a control unit; and a processing unit that performs a predetermined process according to an order from a customer for an image displayed on the display unit. 10. An image identifying apparatus according to claim 1, and a delivering means for delivering an image of a certain person as a subject to a customer based on an identification result by the identifying means. An order processing apparatus including: a processing unit that performs a predetermined process according to an order from a customer who targets the image distributed by the distribution unit. 11. The processing means, as the predetermined processing, creates a print by using image data of an image designated by a customer among the image data stored in the image data storage means, or 10. The order processing apparatus according to claim 9, wherein any one of a process of requesting a print creation and a process of delivering or distributing the image data of the designated image to a customer is performed. 12. A photographing date and time and a photographing place when photographing is performed with an unspecified person as a subject, image data obtained by the photographing is stored in an image data storage means, and the image data corresponds to the image data. By comparing the shooting date and time and the moving history of the person photographed as the subject, the person as the subject in the image represented by the image data or the image data of the image in which a specific person is the subject is identified. Image identification method.