JPH0470729A - Photographed image retrieval system - Google Patents

Abstract

PURPOSE:To facilitate image retrieval by providing a retrieval means which matches position data and position measurement data and retrieves a photographed image corresponding to position matching measurement data. CONSTITUTION:The image photographed by a camera is recorded on a recording medium 26 such as a film or memory card and position measurement data obtained by a GPS receiver is led to the camera and recorded automatically on the recording medium 26 while making it correspond to the current photographed image. A retrieval device, on the other hand, displays a map by a map display means 26, and when a position on the map is inputted, position data is outputted; and the retrieval means 50 collates the position data with the position measurement data to retrieve the photographed image corresponding to the matching position measurement from a storing content of the recording medium 26. Consequently, a photography place name, etc., need not be inputted manually at the time of photography and on a keyboard, etc., for image retrieval, and image retrieval is set through easy operation and facilitated.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to a camera that records positioning data from a GPS receiver on a recording medium together with a photographed image at the time of photographing, and a search method for the photographed images recorded on the recording medium. The present invention relates to a photographed image retrieval system comprising a retrieval device that performs a search based on position data obtained by inputting a position on a map.

[Conventional technology]

Conventionally, when taking photos with a silver halide camera, the date and time of the photo taken,
It has been proposed that the aperture value AV, shutter speed TV, etc. are stored as photographic information for each frame in a semiconductor memory built into the film container in association with the photographed image (
JP-A-1-289948). In such cameras, it is possible to use the sensor originally built into the camera and store the data obtained from the sensor in correspondence with the captured image, but it is possible to store other data, such as data on the shooting location. The input must be performed manually by the user each time a photograph is taken, and this is not necessarily sufficient in terms of convenience.

On the other hand, a device has been proposed in which images taken with a still camera or the like are stored in a removable memory card (Japanese Unexamined Patent Publication No. 63-274289). Since this memory card stores only photographed images, it is preferable to add search information to facilitate the search for photographed images. That is, the images stored in the memory card obtained as described above are transferred to a filing system (DAT, etc.), and search information such as the shooting location is added at the time of transfer, so that they can be easily searched later on a computer, etc. A system is known.

On the other hand, GPS (Goba
1 Positioning system) is increasingly being used. As is well known, this GPS is a highly accurate system that receives each transmission data from at least four artificial satellites using reception 1 (GPS reception II) on the ground, and determines the three-dimensional position of the receiver from these reception data. In the positioning system, for example, Japanese Patent Application Laid-Open No. 1-312483 describes an example of a configuration of a GPS receiver (aimed at eliminating rocking errors).

(Problem to be Solved by the Invention) However, in the above-mentioned filing system in which search information is added at the time of transfer, the user must input data for search information such as the shooting location manually for each captured image. However, as mentioned above, this method is not necessarily sufficient in terms of convenience.

The present invention has been made in view of the above, and is a photographed image search that automatically records side position data obtained by a GPS receiver as photographing position information together with photographed images, and searches for photographed images using this position data. The purpose is to propose a system.

[Means to solve the problem]

A photographed image search system according to the present invention includes a camera that has a GPS receiver and records positioning data from the GPS receiver on a recording medium together with photographed images, and searches for photographed images recorded on the recording medium. The search machine comprises a map display means for displaying a map, a condition input means for outputting position data when the position on the displayed map is input, and a search machine that displays the position data and the positioning. The apparatus is equipped with a search means for searching for a photographed image corresponding to matching positioning data by comparing the data with the positioning data.

The search machine also includes a suitability storage means in which a membership function indicating the suitability of the positioning data to the position data is stored, and a selection means for selecting a membership function corresponding to the position data inputted by the condition input means. The search means may search the positioning data in descending order of suitability based on the membership function, and may search for a photographed image corresponding to the searched positioning data.

[Effect]

According to the present invention, images taken with a camera are recorded on a recording medium such as film or a memory card, and the images are recorded on a recording medium such as a film or a memory card.
The positioning data obtained by the S receiver is guided to the camera, and is automatically recorded on the recording medium in association with the photographed image at that time. On the other hand, the search machine displays a map, and when a location on this map is input, the location data is output.
The position data and the positioning data are compared, and a captured image corresponding to the matching positioning data (It shadow location) is searched from the storage contents of the recording medium.

In addition, when a membership function indicating the degree of compatibility between positioning data and positioning data is stored, the membership function corresponding to the positional data input by the condition input means is selected, and this selected membership function Based on this, the positioning data are compared in descending order of suitability, and as a result of this matching, a photographed image corresponding to the matching positioning data (photographing location) is retrieved.

〔Example〕

FIG. 1 shows an example of a block diagram of a camera that captures images.

In the figure, a lens 1 to an encoder 8 are configured for photographing images.

2 is an image sensor (
A CCD (hereinafter referred to as a CCD) is used to capture a subject image obtained through a lens 1. The amplifier 3 amplifies the output image signal from the C0D 2 at a predetermined amplification factor and outputs it to the next stage AD converter 4.

The AD converter 4 converts the input analog image signal into a digital image signal. White balance correction circuit 5
The digital image signal is subjected to white balance correction based on color temperature data from a white balance sensor 14, which will be described later, and the γ correction circuit 6 further performs γ correction. Furthermore, the matrix processing circuit 7 performs predetermined gradation correction on the digital image signal. The encoder 8 encodes the input digital image signal into an NTSC signal for reproduction images.
Output the signal to memory card I/F9.

The microphone 10 to the memory 13 are configured for audio input.

A microphone 10 is provided at a suitable location on the camera body and captures the voices of the photographer, the person to be photographed, and the like.

The amplifier 11 amplifies the audio signal from the microphone 10 at a predetermined amplification factor and outputs it to the next stage AD converter 12. The AD converter 12 converts the input analog audio signal into a digital audio signal. The memory 13 is used for voice recording (for speaker recognition), and temporarily stores input digital voice data, and then stores the input digital voice data in the memory card I/O.
Output to F9.

Next, a configuration for importing various other information will be explained.

The white balance sensor 14 detects the color temperature of the subject, and determines from the obtained color temperature data whether the photograph was taken using fluorescent light correction or under sunlight, and determines the appropriate white color. Apply balance. The AF sensor 15 is used to calculate the distance to the subject using a known distance measurement method, and for example, separates the subject image that has passed through the lens 1 into two directions and sends the image to each light receiving section (not shown). It is configured to guide the image of the subject. The subject images obtained by the two light receiving sections are input to the AFCPU 16, and the AFCPU 16 calculates the phase difference from the subject images of the two light receiving sections, and calculates the distance to the subject image from the phase difference. calculate.

Furthermore, the AFCPU 16 drives a lens drive system (not shown) based on the calculated distance data to move the lens 1 to the in-focus position. When the movement to the in-focus position is completed, the focal length data f from the lens 1 and the subject distance data D from the AFCPLJ16 are transferred to the control unit (hereinafter referred to as CPL), which will be described later.
20 (referred to as I).

The temperature sensor 17, the humidity sensor 18, and the atmospheric pressure sensor 19 measure the temperature (air temperature), humidity, and atmospheric pressure, respectively, during imaging. Each measured data is processed by CPU20
Output to. Each of the above-mentioned sensors automatically measures each data during photographing and guides it to the CPU 20.

Reception tuning section 21 and 111 section 22, and GPS receiver 23
is a configuration for obtaining position information. The reception tuning unit 21 receives FM radio waves including a code related to a location (a code indicating a region, a tourist spot, an event, etc., hereinafter referred to as a location code) received through the antenna 21a,
The demodulator 22 reproduces location code data by demodulating the received FM signal and outputs it to the CPjJ 20. Note that details will be explained with reference to FIG. 2. On the other hand, the GPS receiver 23 receives radio waves from a satellite (not shown) with an antenna 23a, calculates the latitude, longitude, and altitude of the current position, and sends the information to the CPU 20.
The details are explained in FIG. 3.

The clock section 24 is for clocking the date and time built into the camera body.

The operation and control system includes the CPU 20 and each operation switch 8.
It is comprised of an operation and display unit 25 that outputs the operation states of S1 to S3 to the CPU 20.

The CPU 20 is a microcomputer that centrally controls the operations of the various parts of the camera described above. The photographing preparation switch S1 starts the operation of each of the sensors. The exposure start switch S2 is a so-called release button that starts the exposure operation of the camera. Preferably, the photography preparation switch S1 is activated when the release button is pressed halfway, and the exposure start switch S2 is activated when the release button is pressed fully. Further, the operation and display section 25 outputs the switching states of the switches 81 to S3 to the CPU 20, and displays various data from the CPU 20 at the time of photographing, such as frame numbers, as necessary.

Further, the memory card I/F 9 is an SRAM or E2 PROM that can be attached to and detached from the camera body to store the image data, audio data, and various shooting information under the control of the CPU 20.
It also outputs the usage status of the memory card 26 (presence or absence of storage area, etc.) to the CPtJ 20.

The photographic information stored in the memory card 26 is used as search information during filing, as will be described later.

Figure 2 explains the location code transmitting and receiving device.
Figure (A) shows a transmitter that is installed in each region, tourist spot, event venue, etc. and transmits a location code.
) indicates a receiver installed in the camera body that receives the location code.

In FIG. <A), a ROM 201 has a location code, for example, a location (event) identification code, a JIS code string of Kanji characters for a location (event) name, or both previously written therein. The DPSK modulation section 202
Differential phase modulation (DPSK) is applied to the carrier wave using the output code data from OM201.
ase 5hift Keyinc+). The FM modulation section 203 applies FMf modulation to the carrier wave based on the input serial data, which is further amplified to a predetermined power by the amplifier 204, and then transmitted from the antenna 205 as an FM radio wave including a location code.

A timing generation circuit 206 controls the timing of each block on the transmitter side, and outputs read address data to the ROM 201 and clock pulses CK to the DPSK modulation section 202 and FM modulation section 203.

Note that the DPSK modulation is performed by the timing generation circuit 20.
6 clock pulses CK are used to extract phase difference data from digital data by AFM in the audible range, MFM in medium waves, PLL method, etc., and convert it into serial data.

Next, in Figure (B), the antenna 21a receives the FM radio wave of the location code transmitted from the antenna 205 on the transmitter side, and the received signal is amplified by the amplifier 207 and input to the FMIIi section 208. . Received signal is FM
A demodulator 208 removes the carrier frequency, and a next-stage DPSK demodulator 209 demodulates the signal to the original code data. The CPU 20 takes in the demodulated code data and stores it in the memory card 26. That is, the CPU
The code data 20 is written in the memory card 26 in association with the writing of the photographed image at that time. The timing generation circuit 210 controls the timing of each block on the receiver side, and outputs a clock pulse CK to the FM demodulation section 208 and the DPSK demodulation section 209 in response to a control signal from the CPU 20.

Therefore, when a camera image is taken at a location where the transmitter is installed, such as a certain area, tourist spot, or event venue, the location code is automatically stored in the memory card.

The ROM 201 may be one that stores only a location code specific to that location, or one that has multiple location codes written in advance and can be switched to output the location code depending on the installation location. But that's fine.

FIG. 3 is a detailed block diagram of the GPS reception 1fi23.

The antenna 23a receives radio waves transmitted from a NAVASTAR satellite (not shown), for example, a quadrifuge 7-he IJ.
It is a quadrifilar heix type. The RF signal received by the antenna 23a is input to the RF signal mixer 230. On the other hand, the modulator 231 transmits the local oscillation signal CK1 from the local oscillator 232 to the PN code generator 2.
33, and the spread modulation signal is input to the mixer 230. As a result, the IF multiplied signal, which is the intermediate frequency of the RF multiplied signal, is converted and inputted to the data demodulation circuit 234.

This data demodulation circuit 234 demodulates data including the time when the satellite transmits the signal from the input signal. The demodulated data is input to a data processing circuit 235 and a delay measurement circuit 236.

The delay measuring circuit 236 first outputs a timing signal to the PN coco generator 233 when demodulated data is input. The PN code generator 233 is always PN by the clock pulse CK2 from the PN code clock generator 237.
A code is generated, and when the timing signal is input, the generated PN code is sent to the delay measurement circuit 236. And data demodulation circuit 234
PN code from and PN from PN coco-generator 233
The code is led to a delay measuring circuit 236, and the delay time of the PN code necessary for correlation between both PN codes is measured. The delay time of this PN code is determined by the measurement clock generator 238.
The counted value is outputted from the delay measuring circuit 236 to the data processing circuit 235 as delay data necessary for correlating both PN codes.

The data processing circuit 235 is composed of a microprocessor and is driven by the clock pulse CK4 from the data processing clock generation circuit 239, and includes transmission time data included in the demodulated data from the data demodulation circuit 234 and a built-in GPS receiver. Determine the radio wave propagation time from the satellite to the GPS receiver (camera) from the reception time data obtained from a cesium and rubidium vapor atomic clock (not shown),
From that time, GPS reception from the satellite is still available! Calculate the distance to (camera). Then, the data processing circuit 235
The positional information regarding the latitude, longitude, and altitude of the camera (imager) is calculated and output from the distance information from each satellite and the positional information of each satellite itself included in the Wa data, and is output to the CPU 20.

As is well known, GPS is a system that covers the entire world using eight NAVASTARs, but currently not all satellites have been launched, and there are areas where reception is not possible or where reception is unavailable depending on the time of day. The CPU 20 enables automatic storage of the location code data from the location code receiver in such areas where reception is not possible.On the other hand, when no location code transmitter is installed and no location code is received,
It receives data from the satellite, takes in the received data as position information, and controls both receivers so that they interrelate with each other.

FIG. 4 is a flowchart explaining the operation of the camera.

In step #1, a power supply (not shown) is turned on, and
When the power is turned on (YES in step #1), the presence or absence of the memory card 26 is determined (step #2). If there is no memory card 26, a message "No card" is displayed and a warning that photographing (recording) is not possible is displayed, and the process returns to step #1 (step #3, step #4). In this case, the camera may have a memory capable of recording a plurality of frames in addition to the memory card 26.

If the memory card 26 is installed, "card present" is displayed (step #5), and then the usage status of the memory card 26, that is, the presence or absence of recordable free space is detected (step #6). ). If there is no free space, YES in step #7, a warning is issued indicating that recording is not possible and the process returns to step #1. Note that, as described above, when a built-in memory for a plurality of frames is provided, whether or not recording is not possible may be determined in consideration of the presence or absence of free space in the built-in memory.

On the other hand, if recording is possible (NO in step #7), it is determined whether or not the photographing preparation switch S1 is on (step #9). If the switch S1 is not on (No in step #9), it is determined that the camera is not taking pictures and the process returns to step #1; if it is on (YES in step #9), the process moves to step #10. In other words, the AF sensor 15 measures the distance to the subject, the WB sensor 14 measures the color temperature of the object, the temperature sensor 17 measures the temperature, and the humidity sensor 18 measures the temperature. F including humidity measurement, atmospheric pressure measurement by the atmospheric pressure sensor 19, positioning by the GPS reception! fi 23, and location code by the location code receiver 21.22.
The M radio waves are received sequentially (step #10 to step #16). In the above steps, all photographic information from each sensor etc. is input, but a switch not shown may be used to select desired photographic information so that only desired photographic information can be input.

When the input operation of shooting information from each of the above sensors etc. is completed,
Next, it is determined whether or not the exposure start switch S2 is on (step #17). Above switch S2
If the switch S1 is not on (NO in step #17>), the process proceeds to step #18 and the state of the switch S1 is checked again.Here, if the switch S1 is on (step #1
If the switch S1 is off (No in step #18), the process returns to step #10 and sensing is performed again using the sensors, etc., in order to obtain more accurate photographic information immediately before the photograph is taken. ), it is determined that photography has been canceled and the process returns to step #1.

If switch $2 is on (YES in step #17)
), the distance measurement data is locked, and then focal length information f from the lens 1 and object distance information from the AFCPU 16 are stored (step #19 and step #20).

Then, the colorimetric data obtained by the WB sensor 14 is locked, and then the voice input operation using the microphone 10 is started (Step #21. Step #22>, and exposure is performed in parallel with this operation. (Step #23) When the exposure is completed (YES in Step #24), predetermined signal processing for capturing the photographed image is started (Step #25).

Next, in step #26, the audio input selector switch S3 is turned on.
It is determined whether or not the switch S3 is on, and if the switch S3 is on (YES in step #26), all audio is captured (step #27), and if it is not on (NO in step #26), For example, audio is captured for one second for recognition (step #28).

After the above operations, the image data, audio data, and search month information (photographing information) obtained from each sensor, etc. are written into the memory card 26 in a corresponding format (see FIG. 27) (step #29), and the memory The empty space information on the card 26 is updated, and the frame number is counted up by 1 (steps #30 and #31) in preparation for the next photograph.

FIG. 5 is a block diagram showing an example of a photographed image playback device equipped with a search function.

This reproducing machine is centrally controlled by a CPU 50. This CPU 50 is programmed in advance to perform various control functions in accordance with the content of each search and reproduction process described later.

The memory card I/F 51 is used to guide recorded images, search information, and data regarding the usage status of the memory card 26 from the memory card 26 to the playback device, and also to guide successive image selection data from the playback device to the memory card 26. This is the interface. The special reproduction processing unit 52 performs special processing on the image read from the memory card 26 as described later, and the image data processed by the special reproduction processing unit 52 is stored in the -H image frame memory 53. .

The combining unit 54 combines image data with a superimposed image, which will be described later, and is switched and controlled by an on-screen display 0N10FF switching control signal from the CPU 50. The combined image signal is sent to the DA converter 55
The signal is converted into an analog signal at , and further amplified at the next-stage amplifier 56 , and then guided to a TV monitor 57 for reproduction and display.

The superimpose memory 58 stores various search information and on-screen display patterns such as scales. The successive clock generation circuit 59 includes the image frame memory 53, the synthesis section 54. It supplies clock pulses for read timing to the DA converter 55 and superimpose memory 58, respectively.

The character generator 60 stores the character font of the Japanese Industrial Standard JIs code string, and outputs the corresponding character code to the CPU 50 when the JIS code string is adopted as the location code. The filing device 61 is composed of a recording medium such as an optical disk and its driving circuit, and is a so-called album that appropriately records recorded images in the memory card 26. This filing device 6
1 is controlled by the CPU 50 for reading and writing, and images;
It records the registration search information and outputs the registration search information and disk management information to the CPU 50.

The keyboard 62 is used for inputting and modifying search information, and also for specifying the position of the search information recorded in the filing device 61, especially maps and place names. It is connected. The voice input section 64 is used to input voice when registering voice for search, and the E2 PROM 65 for speaker data encodes the input voice when registering voice and records it as registered voice.

In addition, the audio data memory 66 is connected to the memory card I/F 51.
It temporarily stores the audio recorded on the memory card 26 that is input via the DA converter 67.
, and is guided to a speaker 69 via an amplifier 68 and reproduced as audio. The speaker recognition unit 70 recognizes the voice data input via the memory card I/F 51 and the E2 PR for the speaker data.
The voice is compared with speaker data registered in the OM 65 to determine whose voice it is. The judgment result for this speaker is C
It is also output to the PU 50 and used as an index during a search.

Note that 71 to 73 are printers, FAXs, and TVIi devices for transmitting and outputting stored images and search images.

In the above configuration, next, the processing on the playback machine side is shown in Figures 6 to 2.
This will be explained using the flowchart shown in FIG.

First, a procedure for registering images in the memory card 26 in the filing device 61 will be explained with reference to FIG.

When the memory card 26 is inserted into the player, <Step #
41), the recorded images in the memory card 26 are sequentially read out (step #42). The recorded image that has been read out is subjected to reproduction processing for multi-screen use in the special reproduction processing section 52, and then
Multi-display is performed on the monitor 57 (step #43). Multi-display is performed by allocating a predetermined number of frames to one frame, or a number of frames set according to the number of recorded images in the memory card 26.

Next, the CPU 50 accepts the selection of an image desired to be registered in the filing device 61 from among the images in the multi-screen,
Next, the frame number of the corresponding image is input using the keyboard 62 or the like to select it (step #44), and the multi-image display is performed again for the selected image (step #44).
Step #45). Next, in step #45, it is determined whether the search information input on the camera side is to be modified or added. Examples of such corrections and additions include correcting a person's name when the result of speaker identification is displayed incorrectly, correcting position information, and adding comments.

If there is no modification of the search information (N in step #46)
o) By performing a registration operation on the keyboard 62, the image and search information are recorded in the filing device 61, and the recorded image and search information are erased from the memory card 26 (step #47). Step #48). This erasing operation creates a free space in the memory card 26, making it possible to record new captured images.

On the other hand, if there is a correction etc. (YES in step #46),
When an image that requires correction or the like is selected using the keyboard 62 or position indicating member 63, the image and search information are displayed on the TV monitor screen (step #49, step #5).
0). The user makes necessary corrections and additions while looking at the screen (step #51). Every time the correction, etc. of one image is completed, the other images are asked whether or not correction, etc. is necessary (steps #51 to #46).
). When the necessary corrections and the like are completed, the process moves to step #47 and the registration process ends.

Next, the procedure for registering audio will be explained with reference to FIGS. 7 and 8.

Figure 7 shows “Voice Registration
'', and FIG. 8 shows the procedure of ``audio registration ■'' in which only audio is registered. Both steps are performed in step #51 above.
It may be executed in , or it may be provided as a separate voice registration mode.

In FIG. 7, first, after the CPU 50 enables the reception of voice input, when voice is input from the microphone of the voice input section 64 (step #61), the input voice is transmitted to the AD.
It is converted and encoded (steps #62, #63).

This encoded voice data is used for E2P recording of speaker data.
It is registered in the ROM 65 (step #64). continue,
The CPU 50 can accept data from the keyboard 62, and when the speaker's name is input from the keyboard 62 (step #65), it is encoded (step #66).
, and is further associated with the voice data of the speaker and E2PR.
It is registered in OM65 (step #67).

Therefore, as will be described later, when searching by voice, the speaker's name is superimposed on the TV monitor 57 along with the search image by superimposition.

In FIG. 8, first, after the CPU 50 is enabled to accept audio input, audio is input from the microphone of the audio input unit 64 (step #71), and the input audio is AD converted and encoded. (Steps #72, #73). This encoded audio data is stored in the E2PR for recording speaker data.
It is registered in OM65 (step #74).

Therefore, only the searched image will be displayed on the TV monitor 57 when searching by voice.

Next, various search procedures will be explained with reference to FIGS. 9 to 21.

FIG. 9 shows the main flow of the search process.

First, when you input which item (condition) to search using the keyboard 62 or the like, the CPtJ 50 collates the search item with each image or search information (step #81), and sequentially stores the matching images from the memory card 26. The data is read out and displayed in multiple formats on the TV monitor 57 (step #82). Then, the user selects the desired one from among the multi-displayed images.
Or multiple images are selected (step #83)
.

When the selection for the current display screen is completed, it is determined whether all other multi-screens that display images that match the search items have been displayed (step #84), and if there are other multi-screens, the current screen is will be updated to the next screen (step #
85). Then, when the image selection for the multi-screen to be updated is completed, Y is selected in step #83 and step #84.
ES), the selected image is output in a desired output format as described below (step #86).

FIG. 10 shows a flowchart of "item search" for the search items shown in step #81.

In this example, the search items are "location" and "date and time."
Examples include ``weather,''``people'snames,'' ``indoors and outdoors,''``portraits,''``events,'' and ``sounds.''

``When item search J is started, first, `` is selected as a search item.
An inquiry is made as to whether or not to select "Location" (Step #91). When the "location" is selected, the "location search" flow shown in FIG. 11 is executed (step #92
). If it is not selected, then an inquiry is made as to whether or not to select "date and time" as a search item (step #9).
3).

When "1 date and time" is selected, "1 date and time search" shown in Figure 12 is performed.
The flow is executed (step #94).

If it is not selected, then an inquiry is made as to whether or not to select "weather" as a search item (step #95).
. When "weather" is selected, the "weather search" flow shown in FIG. 13 is executed (step #96). If it is not selected, then an inquiry is made as to whether or not to select "person's name" as a search item (step #97). When "person's name" is selected, the "person's name search" flow shown in FIG. 14 is executed (step #98). If not selected,
Next, an inquiry is made as to whether or not to select "indoor/outdoor" as a search item (step #99). If "indoor/outdoor" is selected, the "indoor/outdoor search" flow shown in FIG. 16 is executed. (Step #100). If it is not selected, then an inquiry is made as to whether or not to select "Portrait Side 1" as a search item (step #101).If "Portrait Scenery" is selected, "Portrait Scenery Search" shown in FIG. ” flow is executed (step #102>. If not selected, then an inquiry is made as to whether or not “event” is selected as a search item (step #103). “Event J is selected. Then, the flow of "event search" shown in FIG. 19 is executed (step #104).If it is not selected, then an inquiry is made as to whether or not "audio" is selected as a search item (step #104). 105).

When “Voice” is selected, “Voice search” shown in Figure 20
The flow is executed (step #106). continue,
Re-selection is made possible in consideration of changes or additions to search items (NO in step #107). Thereafter, the "item search" process is ended and the process returns to step #82.

These search items depend on each sensor on the camera side, and it is also possible to select two or more items at the same time.

The details of each of the above search processes will be explained below with reference to FIGS. 11 to 21.

In the flow of "location search" shown in FIG. 11, the location code and/or GPS positioning data serve as an index of location information.

First, it is determined whether a map is required to be displayed on the TV monitor 57 (step #111). When displaying a map, that is, when indicating the shooting location on the map, use the filing device [6
1 or the built-in memory (not shown) of the CPU 50, or a removable map-dedicated memory (also not shown), to be displayed on the TV monitor 57 (Step #112), specifying the position of the mouse, etc. The member 63 specifies a position on the displayed map (step #113).

The indicated position data (latitude, longitude) is calculated based on the displayed map and the output position signal of the position indicating member 63. Alternatively, the detection may be performed using a tablet or the like, for example. On the other hand, if a map display is not required, the recorded place names and places are read out and displayed in association with the recorded image.
The desired place name, etc. is input from the displayed place names, etc. from the keyboard 62 to specify it (step #11).
4, #115). Subsequently, the CPU 50 executes a search for an image matching the specified position or input place name, etc. (step #116). This search is performed by scanning search information recorded in association with each image. When the search is completed, the number of matching items is displayed as the search result (step #117). At this time, the frame number of the corresponding image may be displayed. After this,
It is determined whether re-search is necessary (step #118)
. Examples of re-search include a case where the number of matching items is large or, conversely, a case where the number of matching items is zero. In the case of re-searching, if you input or specify other search conditions, a search using CPtJ50 is performed in the same manner as above (steps #111 to #1).
17). Then, when the search ends, step #118
If No>, return to step #93.

In the flow of "date and time search J" shown in FIG. 12, the date information from the timer 24 serves as an index.

When the date and time, that is, the year, month, day, hour, minute, season, etc., are input from the keyboard 62 (step #121), the CP
The tJ50 executes a search for images that match the input search conditions (step #122>. This search is performed by scanning the search information (date and time data) recorded in association with each image, as described above. .In addition, CPU50
There is a storage means in which the season and date and time data are associated with each other, and when the search condition is season, the input season is converted into the corresponding date and time data in the storage means, and the converted Search is performed using date and time data.

When the search is completed, the number of matching items is displayed as the search result (step #123). Note that, as described above, the frame number of the corresponding image may be displayed. After this, it is determined whether a re-search is necessary (step #124). In the case of re-searching, if other search conditions are input, the CPU 50 performs the search in the same manner as described above.Steps #121 to #123>. Then, when the search is completed (No in step #124), the process returns to step #95.

In the flow of "weather search" shown in FIG. 13, the temperature and humidity information from the temperature sensor 17 and humidity sensor 18 serve as indexes.

Conditions related to the weather, such as "sunny", "rainy", "station J"
, "It's cold", etc. are input from the keyboard 62 (step #131), and the CPU 50 searches for images matching the input search conditions by scanning the search information (step #132). The CPU 50 is provided with a storage means that stores in advance the correspondence between the above-mentioned weather-related conditions and weather data consisting of temperature and humidity. For example, if you enter "hot", the temperature (air temperature) is 30℃.
The search may be performed based on a certain predetermined temperature and humidity, such as those listed above or those with a humidity of 80% or higher.

Furthermore, the reference temperature and humidity may be changed depending on the location, date and time (and season). For example, if you want to search for "summer + hot", the temperature must be 30 degrees Celsius or higher, and 7 or 8 degrees Celsius.
For September, on the other hand, for "winter + hot" the temperature is 25℃.
The above is the one for December, January, and February.

When searching, the input weather-related conditions are converted into corresponding weather data in the storage means, and the search is performed using the converted weather data.

When the search is completed, the number of matching items etc. are displayed as the search results (step #133). After this, it is determined whether a re-search is necessary (step #134). If you want to search again, enter other search conditions and the CPU
50 is performed (steps #131 to #133).

Then, when the search ends, NO at step #134)
, return to step #97.

In the flow of "person name search" shown in FIG. 14, "voice" or "person name" serves as an index.

When "One Person's Name" is input from the keyboard 62 (step #141), the CPU 50 searches for images that match the input search conditions (step #142). This process is performed according to "search process (■)" shown in FIG. That is, first, it is determined whether the search is by "voice" or by "person's name" (step #151). In the case of a search by "voice", the input person's name is encoded and converted into a person's name code, and the voice code corresponding to the person's name code is extracted from the E2PROM 65 (step #
153, #154). Next, the audio data recorded in association with the pre-registered image is extracted from the filing device 61 and encoded (step #1
55, #156).

Then, the audio code from the E2 PROM 65 and the audio code from the filing device 161 are compared (step #157). This verification is done by filing device 6.
This is done for all images by sequentially scanning the audio codes of the images registered in #1 (steps #156 to
NO at step #158, loop at step #159)
. When all images have been matched (Step #15)
8), return to step #143. On the other hand, if search by person's name is selected in step #151, the person's name code input when registering the image to the filing device 61 is scanned and searched (step #152).
, When the search is completed, the process returns to step #143.

Returning to FIG. 14, the number of matching items etc. are displayed as the search results (step #143). After this, it is determined whether a re-search is necessary (step #144). If you want to search again, enter other search conditions and click CP in the same way as above.
A search is performed by U50 (steps #141 to #143).

Then, when the search is completed (No in step #144)
, return to step #99.

In the flow of “indoor/outdoor search” shown in Figure 16, W
The output from the B sensor 14 becomes the index.

When either "indoors" or "outdoors" is selectively input from the keyboard 62 (step #161), the CPU 50 searches for images that match the input search conditions by scanning the search information. (Step #162). C.P.
U50 contains the correspondence between the above search conditions and the output of the WB sensor (color temperature data), for example, "indoor" for color temperature data corresponding to fluorescent lighting, and "indoor" for color temperature data corresponding to sunlight. A storage means is provided for storing the location as "outdoors". Then, when searching, the input "
One of "indoor" and "outdoor" is converted into corresponding color temperature data in the storage means, and a search is performed using the converted color temperature data.

When the search is completed, the number of matching items etc. are displayed as the search results (step #163). After this, it is determined whether a re-search is necessary (step #164). If you want to search again, enter other search conditions and the CPU
50 is performed (step #161 to step #163).

Then, when the search is completed (No in step #164)
, return to step #101.

In the flow of “person scene search” shown in Figure 17,
Information on “focal length f” and “subject distance D” (image magnification β
=f-D) becomes the index.

First, select either "1 person" or "landscape" on the keyboard 62.
(step #171), the CPU 50
A search for images matching the input search conditions is executed (step #172). This process is performed according to "Search Process ■" shown in FIG. That is, first, all focal lengths @f and subject distances recorded corresponding to images registered in advance in the filing device 61 are read out, and each image magnification β=f-[) for all images is calculated. (Step #181). Subsequently, each obtained image magnification β is β≧
It is determined whether it is 1/100 (step #182), and β
If ≧1/100, it is determined that it is a landscape (step #184), and if the opposite is the case, it is determined that it is a person (step #183). Then, CP[J50 extracts the result of step #183 when person j is input as a search condition, and extracts the result of step #183 when person 1F@kei is input as a search condition.
184 results are extracted.

Note that as a matching method, discrimination may be performed for each image as described above, and such discrimination may be sequentially repeated.

When the determination for all images is completed, the process returns to step #173.

Returning to FIG. 17, the number of matching items etc. are displayed as the search results (step #173). Thereafter, it is determined whether a re-search is necessary (step #174). If you want to search again, enter the other search condition, and click C in the same way as above.
A search is performed by the PU 50 (steps #171 to #173). Then, when the search is completed (No in step #174), the process returns to step #103.

In addition, in the above embodiment, the image magnification β and "person", "ffl
I remember the association with "Kei" as a program,
A storage means may be provided in the CPU 50 in which the image magnification β, "person", and "landscape" are stored in association with each other in advance.

In addition, as another search method, the recorded focal length f
The image magnification β is calculated from The search may be performed by determining whether the

In the “event search” flow shown in Figure 19,
The location code (event code) becomes the index.

When an event name is input from the keyboard 62 (step #191), the CPU 50 associates the search for images matching the input search conditions with the images registered in advance in the filing device @ 61 and uses the recorded event code. This is done by scanning (step #192). When the search is completed, the number of matching items etc. are displayed as the search results (step #193). Thereafter, it is determined whether a re-search is necessary (step #194). In the case of re-search, if other search conditions are input, the search by the CPU 50 is performed in the same manner as above (steps #191 to #193).
). Then, when the search ends, in step #194
o), return to step #105.

In addition, if the location code is an identification code for the location or a JIs code string of characters that displays information about the location, it will be possible to search directly using the code, and when shooting, the content of the location code will be recorded as is without having to distinguish it. It becomes possible to do so. Furthermore, since no special determining means is required to determine the content of the location code, the configuration of the search side, for example, can be simplified accordingly.

In the flow of "voice search" shown in FIG. 20, the voice recorded in association with the image is compared with the voice input during the search.

When voice is input from the microphone of the voice input unit 64 (step #2o1), the CPU 50 searches for an image that matches the input voice (step #192). This process is performed according to "Search Process ■" shown in FIG.

That is, first, the input voice is AD converted, encoded, and then stored in a reference unit (not shown) (step #
211 to step #213). Next, the audio data recorded in association with the pre-registered image is extracted from the filing device 61 and encoded (steps #214, #215>.Then, the audio data from the reference section and the audio data recorded in advance are extracted and encoded. )? A comparison is made with the voice code from the iring device 61 (step #216). This verification is performed for all images by sequentially scanning the audio codes of the images registered in the noir ring device 61 (NO1 step #215 to step #217).
218 loops). When the verification of all images is completed (YES in step #217), the process returns to step #203.

Returning to FIG. 20, the number of matching items is displayed as the search result (step #203). After this, it is determined whether a re-search is necessary (step #204). In the case of re-searching, if another word is input by voice, the search is performed by the CPU 50 in the same manner as above (step #201).
~Step #203). When the search is completed (NO in step #204), the process returns to step #107.

Next, returning to FIG. 9, the execution process of step #86 will be explained using FIG. 22.

In this execution mode, first, the output format is selected. Table 1 shows this output format.

Table 1 (hereinafter referred to as blank space) That is, after the search is completed, one output form is selected from the output forms A to F of the clothes 1, and the keyboard 6 is pressed.
2, for example, when a corresponding character is input (step #221), the number of output images as the search result is set to N. Step #222>, and then the images to be output are sent to the filing device in ascending order of frame number. 61 and sequentially transferred to the frame memory 53 (step #2
23). Next, the image is output according to the output format selected in step #221. If output format A is selected (YES in step #224), it is displayed on the TV monitor 57 as is. If output format B is selected (YES in step #225), data regarding the size of the subject on the image plane, that is, the scale size, is determined from the focal length @f of the image and the information on the subject side @D. , the image and the scale size are combined (steps #226, #22
7).

That is, the scale size is superimposed with the image in the composition section 54 and output to the TV monitor 57.

For example, when displaying a unit scale (see Fig. 24 (B)), the scale size marked on the unit scale SC is the length per unit scale from the image magnification β calculated from the focal length f and the subject distance. is calculated. Here, regarding the calculation of the length of the unit scale SC, the 23rd
This will be specifically explained using the principle diagram in the image formation state shown in the figure.

In the figure, L is the shooting distance, from the subject 100 to the Ij image plane 20
0, f is the focal length of the photographic lens 300, H is the interval between principal points of the photographic lens 300, X is the distance from the subject 100 to the front focal point of the photographic lens 300, and X' is the imaging surface 2.
00 to the rear focal point of the photographic lens 300, y is the length of the subject 100, y' is the length of the image of the subject 100 on the imaging plane 200, and each of the above variables, f, H, x,
Between x'y and y', y:y'=x:f=f:x'...
(1)X' = 1-2f-H-x...
...There is the relationship (2). From these equations (1) and (2), x2- (L-2f-H)x+f2=O...--(
The equation 3) holds true. Finding the root of this equation (3), X= ((L-2f-H)+L-)/2... (4) Furthermore, using equation (2) above, -((L-2f-H)-H)-4f2)/2. Also, from the above formula (1), y=y' ・X/f...
・(6) y=y'・f/x'
・・・・・・ Since (7), the above (4)
, based on x and x' in equation (5), this equation (6) or (
By calculating the formula (a), the length y of the subject corresponding to the length y' of the image on the imaging plane can be found. Here, if the length y' of the image on the imaging surface is treated as the length of the unit scale SC, the actual length of this unit scale (on the imaging surface) is known in advance, so (6) The scale size of the unit scale SC is obtained by calculating the equation or (7).

FIG. 24 shows an example of displaying the scale size.

The figure (A>) is a display example in which the image magnification is displayed as is, and the figure (B) is a display example in which the unit scale SC corresponds to 10 cm.

By displaying such a scale size, the actual size of the image can be easily grasped. Furthermore, the display timing of the scale SC is controlled by a read clock generator 59 controlled by the CPLJ50.
Since the scale SC can be freely changed, it is possible to move the scale SC to a desired position. For example, if the scale SC can be moved to a desired position using a trackball (position specifying member 63), operability is excellent.

Furthermore, it is easy to turn on and off the scale display, and the display formats shown in FIGS. 3A and 3B may be freely switched.

In addition, by using the technique described in JP-A-58-158507 to imprint the scale onto the silver halide film, it is possible to make the display of the scale size applicable to the silver halide film as well. I can do it.

Next, if output form C is selected (step #228
YES), the size of the display screen (for example, CRT inches, etc.) is input from the keyboard 62 (step #
229). Next, the image size is changed based on the focal length f, the image magnification determined from the subject side 11iD, and the display screen size (step #230>. In other words, the final image size on the TV monitor 57 for the actual subject size is The display magnification (image size) of the size of the displayed image is displayed, or the size of the display image is changed and displayed so that the display magnification is fixed at a predetermined size regardless of the display screen size.

That is, the CPU 50 determines the focal length f, the object path llI
It has display magnification calculation means for calculating the display magnification of the reproduced image from the image magnification determined from D and the display screen size,
This display magnification calculation means determines the size of the image displayed on the TV monitor 57 relative to the actual size of the subject. In addition, if the display magnification is set in advance, the ratio between the display magnification calculated by the display magnification calculating means and the set magnification is calculated, and the displayed image is enlarged or reduced according to this ratio. Image processing is performed as necessary.

In the above, the final display magnification is displayed at an appropriate location on the TV monitor 57 as necessary.

By doing so, it is possible to easily grasp the actual size of the image displayed on the TV monitor 57.

Next, if the output format Dffi is selected (step #2
31 (YES), the image you want to display compositely is the 10th image above.
It is extracted by the item search shown in the figure (step #232).

Then, a desired image is selected from among the images that match the search conditions (step #233). Subsequently, the image magnification of the first selected image, the image magnification of the second selected image, and both images displayed together are led to the special reproduction processing section 52, where, for example, a specific subject in both images is The image size is changed appropriately so that they are the same size, and the image frame memory 5
3 and output to the TV monitor 57 (step #234). By doing this, you can finally
The sizes of the objects in both images displayed together on the monitor 57 can be displayed as if they were the same size. Alternatively, if the image sizes of both images that are displayed together are made to match, the actual size of the subject in both images can be easily compared. Furthermore, as in the case of scale display, by moving (superimposing) the displayed image with a trackball (position specifying member 63) or the like, a composite photograph or the like can be enjoyed.

Note that it is also possible to combine the currently taken image and a previously taken photo by using both image magnifications, so that, for example, a cut-off photo can be reproduced as a completed photo.

Next, if output form E is selected (step #235
YES), the displayed image is led to the special reproduction processing section 52, where various special processing such as mosaic, negative/positive inversion, etc. are applied to the displayed image, and then output to the TV monitor 57 ( Step #236>.

Next, if output form F is selected (step #235
(No), a predetermined number of images, such as 4, 9, or 16 images, are reproduced on one screen. The predetermined number of sheets may be selected in advance or as needed, or a desired number such as (2×3) sheets may be selected.

First, the frame number and number of images for which multiple reproduction is desired are stored (step #237).

Next, it is determined whether the number of images has reached the predetermined number (step #238), and if it is the predetermined number, multi-processing is performed (step #239), and step #24
Transition to 0. On the other hand, if the number of sheets is not the predetermined number, step #
247. Note that details of the processing in the case of output form F will be described later.

Now, when one of the output types gA to F is selected and the image obtained under the selection is displayed on the TV monitor 57 (step #240), it is next determined whether audio is recorded for the displayed image. A determination is made as to whether or not (step #24
1). If audio is recorded, the audio corresponding to the displayed image is played back (Step #242>.Next, it is determined whether the displayed image is to be printed or transmitted (Step #243, #245) When a print instruction is issued, the displayed image is printed out by the printer 71, and when a transmission instruction is issued, the FAX 72
The displayed image is transmitted using the TV phone 73 or the like (steps #244 and #246).

When printing or transmission of one sheet is completed, the number of output images N set in step #221 is decremented by 1 (unless output format F is selected),
Subsequently, it is determined whether the number N of output images is 0 (step #248>).

If N=O, the process returns to step #221 and the next image is displayed.
The value of N is decremented (steps #221 to #247). This process is repeated for the number of output images, and after that, when N=0 (Y in step #248)
ES>, except for the case of output form F (step #249
(YES), the process returns to the main flow shown in FIG.

On the other hand, when output format F is selected, since a predetermined number of images are captured within one screen, output format G
Processing that is somewhat different from the case of A-F is performed. That is,
Each time an image is read out, the number of images is decremented from the output image number N (NO in step #238, step #
247>, each time a predetermined number is reached (Y in step #238)
ES), multi-processing is performed (step #239).

After a predetermined number of multi-processed images are displayed on the TV monitor 57, they are printed or transmitted in units of a predetermined number of images as described above. At this time, by decrementing the number of images when the predetermined number has been reached in step #247 after step #246, the number N of output images can be accurately decremented. In addition,
In the case of output form F, if the number of output images N is not an integral multiple of the predetermined number of images, even if N=0 in step #248,
Since there are remaining images (NO in step #238,
YES in step #248, NO in step #249)
, step #240g for this remaining image,
[Processing is performed.

FIG. 25 shows an example of the table of contents displayed. When the memory card 26 is inserted into the playback device, the "Date and Time", "Time", and "Location" are displayed in the order of recording (or in the order of the photographed frame numbers) as shown in the figure.
Contents such as “audio presence/absence” and “person’s name” are displayed on the TV monitor 57.
will be displayed. Based on this table of contents display, it is easy to select the method for reproducing and displaying images or recording them in the filing device M61.

FIG. 26 shows an example of a screen for inputting search conditions for a search. Search conditions include "date and time" and "time and location"
"Speaker", "Weather Jr. Others" are prepared, and in each condition column, as shown in the diagram, "Date" is "Summer", "Time" is "Evening", "Place" is "Left Edge", and "speaker"
``Radio wave'' is input from the keyboard 62.

The CPU 50 executes the above-described search process based on the input search conditions. On the other hand, various operation instruction columns are prepared at the bottom of the screen, and can be specified by pointing the position with a tablet or mouse, for example.

FIG. 27 shows an example of the memory map of the memory card 26, which consists of a search information area, an image data area, an audio on/off and audio data area. Also,
In this search information area, start addresses (VSta, Asta) and end addresses (Vend, Aend) for each of the above areas are also written. Recording in each area is performed in the order of image data, audio data, and search information according to instructions from the CPLI 50.

Next, a case where each of the above-mentioned searches is performed using an inference function (fuzzy search) will be explained with reference to FIGS. 28 to 31.

Based on such reasoning, the search is performed based on the membership function. This membership function is stored in advance in the suitability storage means in a form corresponding to each search condition. Then, when a search condition is input, a membership function corresponding to the input search condition is selected, and a search is performed in descending order of suitability based on the selected membership function.

Now, Figure 28 shows the length and size) search, for example r50.
This shows a membership function when it is desired to reproduce something on the order of cmJ. “50±5cmJ is a conformity level of “1”
”, and r25cm Go and r75cmJ have a fitness of “0.5”.
”. Therefore, if you enter the search condition r50cmj, based on this membership function, the matching 11"1" is sequentially searched as 0.9""0.8".
The order of priority is given as follows: [50±5cm
J is extracted and reproduced. Next, r44cmJ
X r56cmJ, followed by U4OcmJ, r6
Those around 0cmJ, and furthermore “35cmJ, r65cmJ
The items with the highest degree of suitability, such as nearby items, are extracted and reproduced. Also, rloOcmj
If you enter the search condition r100±5cm
Let J be the fitness degree "1", and let r750mj be the fitness degree '
As "0.5", the data will be sequentially extracted and reproduced from the highest matching degree as described above.

FIG. 29 shows membership functions when searching for a location, for example, when it is desired to play back a photograph taken in the "Kinki region." Therefore, if you enter "Kinki region",
Based on this membership function, first, the fitness is “1”.
Images shot in ``Osaka'' and ``Kyoto'' are extracted and played back.

Next, those taken in "Hyogo" and "U-Nara", followed by "Wakayama J", "Shiga", followed by "Mie", "Tokushima", and then "Okayama" and "Fukui", etc., and the degree of suitability is ^ They will be extracted and regenerated in order.

Figure 30 shows seasonal searches such as "spring", "summer", F autumn J
, U-Winter J, and each membership function when it is desired to reproduce images taken in each season. for example,"
When it is desired to playback images taken in ``Spring,'' images taken in ``April'' and ``May'' with a fitness level of 1pa are first extracted and played back. Next, images taken in "June" will be extracted and played back. In addition, if you want to play back images taken in "summer", F July Δ with suitability "1", "August J
and 'September J' are extracted and played back.Next, 'June'shot's are extracted and played back. If you want to play back images taken in "autumn," images shot in "October" and "November" with a suitability of "1pa" are extracted and played back. Next, images taken in "September" will be extracted and played back. "Winter J
If you want to play back a picture taken in
Images taken in December, January, and December are extracted and played back. Next, images taken in "March" will be extracted and played back.

Note that the seasonal search is not limited to monthly units as described above, but may also be performed by date units. For example, for "mid-September," the suitability for "summer" may be 0.5", and the suitability for "autumn" may be 0.5. , humidity, and other search conditions may be taken into account to perform a search from a broader perspective.For example, when the search condition is "summer + hot J," the above-mentioned "summer J" , and the temperature of 30 degrees Celsius or higher.Similarly, when the search condition is "winter + hot", use the logic between the one that satisfies the above-mentioned "winter" and the temperature of 25 degrees Celsius or higher. Take the product.

Figure 31 shows "morning", "noon", and "evening" in the date and time search.
This shows the membership function when it is desired to play back images taken during each time period such as "U night".

If you enter "morning", first "6 o'clock" with a fitness of "1" is input.
The images taken between "9 o'clock" and "9 o'clock" are extracted and played back. Subsequently, images taken in the order of "5 o'clock,""10o'clock," and "4 o'clock" are extracted and played back. If you enter "noon", first, "12 o'clock" to "14 o'clock" with fitness degree "1" are input.
The images taken during the period are extracted and played back. Subsequently, images taken at "11 o'clock" and "15 o'clock" are extracted and played back. When "evening" is input, first, images taken at "17:00" and "18:00" with a suitability of "1" are extracted and played back. Subsequently, the image taken at "16:00" is extracted and played back. When "night" is input, first, images taken between "8:00 p.m. and "3:00 p.m." with a suitability of "1" are extracted and played back. Next, “1
Images taken at 9 o'clock and 4 o'clock are extracted and played back. Note that, as in the case of the seasonal search, search conditions such as temperature and humidity may be taken into consideration to perform a search from a broader perspective.

In addition to the above search examples, the barometric pressure sensor 19 and GP
It is also possible to search for images taken during mountain climbing from the altitude information received by S reception l1123. Furthermore, by adding the focal length 1if and photographing distance to the atmospheric pressure information and altitude information, it is possible to automatically input photographing information as an aerial photograph.

Further, the following can be considered as other determination methods at the time of search. That is, (1) Distinguish between men and women using voice recognition technology based on the difference in sound quality between men and women.

(2) Person identification is performed based on the color temperature and pattern recognition of the captured image of the WB sensor 14.

(3) Adults and children are distinguished from image magnification and pattern recognition.

(4) Determine whether or not glasses are worn by pattern recognition.

(5) The person in the image is memorized in advance, and the person in other images is discriminated using pattern recognition and a learning function.

In this embodiment, a digital memory is used as the recording medium, but an analog memory such as a floppy disk may also be used. Further, although the camera and the playback device are separate bodies, they may be integrated. Furthermore, the data obtained from each sensor may be displayed on the operation and display section 25 or on a separately provided display section.

Furthermore, although this embodiment has been explained using an electronic still camera, each sensor is provided in a silver halide camera, and the photographing information of each of the above sensors is imprinted at an appropriate location within the photographic screen using a well-known date imprinting technique. Good too. In this case, the playback machine includes an optical reading section, a film drive section, a memory, a search processing section according to this embodiment, etc., and the film container is set in the optical reading section and the frames are sequentially or instructed. The photographed image and the imprinted photographic information may be read by COD or the like, extracted as an electrical signal, and recorded in the memory. Then, the same search process as described above is executed using the captured image and the captured information.

〔Effect of the invention〕

As explained above, according to the present invention, the positioning data of the photographed position from the GPS receiver is automatically recorded together with the photographed image, and when the position on the map is input during image search, the positioning data that matches the position data is automatically recorded. The data is searched, and the captured image corresponding to the searched positioning data (shooting location) is searched, so there is no need to manually input the shooting location name etc. when shooting, and when searching for images, you can use the keyboard etc. to input the shooting location. There is no need to enter a name, and image search settings can be made with simple operations, making image searches easier.

In addition, the positioning data is searched in descending order of suitability based on the membership function that corresponds to the input location data.
Since the photographed image corresponding to the searched positioning data (l shadow location) is searched, a search can be performed within a regional range, and a search can be performed without breaking points.

[Brief explanation of the drawing]

Figure 1 is a block diagram of a still camera, and Figure 2 explains a location code transmitter/receiver. A block diagram of the receiver installed in the camera body that receives the code, Figure 3 is a detailed block diagram of the GPS receiver, Figure 4 is a flowchart explaining the operation of the camera, and Figure 5 is a camera with a search function. A block diagram showing an example of an image playback device, FIG. 6 is a flowchart showing the procedure for registering the image on the memory card in the filing device, and FIGS. 7 and 8 show the procedure for registering the audio on the memory card in the filing device. 9 to 21 are flowcharts showing various search procedures, and FIG. 22 is a flowchart showing playback,
A flowchart showing execution processing such as printing, FIG. 23 is a principle diagram in an imaging state to explain how to obtain the scale size, and FIG. 24 shows an example of displaying the scale size.
Figure 25 (A) is a diagram showing the image magnification as it is, Figure 25 (B) is a diagram showing that the unit scale is equivalent to 10 cm, and Figure 25 is a diagram showing an example of displaying the table of contents. 26
The figure shows an example of a screen for inputting search conditions during a search, and Fig. 27 shows an example of a memory map of a memory card (
- Figures 28 to 31 are diagrams showing membership functions when each search is performed using an inference function (fuzzy search). DESCRIPTION OF SYMBOLS 1... Lens, 2... Image pickup element, 5... WB correction circuit, 6... γ correction circuit, 7... Matrix processing circuit, 8... Encoder, 9... Memory card I /F
, 10...Microphone, 13...Memory, 14...W
B sensor, 15...ΔF sensor, 16...AFCP
U, 17... Temperature sensor, 18... Humidity sensor, 1
9... Barometric pressure sensor, 20... CPtJ, 21...
Reception modulation section, 22... Demodulation section, 23... GPS receiver, 24... Time measurement section, 25... Operation and display section, 2
6...Memory card, 201...ROM, 202...
...DPSK modulation section, 203...FM modulation section, 206
．． 210...timing generation circuit, 208...FM
@ Modulation unit, 209...DPSK demodulation unit, 50...CP
ut, 51...Memory card I/F, 52...Special playback processing unit, 53...Image frame memory, 54...
- Mixing unit, 57... TV monitor, 58... Superimpose memory, 59... Read clock generation circuit, 60... Character generator, 61... Filing device, 62... Keyboard, 63... Position specifying member, 64... Audio input unit, 65... Speaker data F2PROM, 66... Audio data memory, 69...
...Speaker, 70...Speaker recognition unit, SC...Unit scale. Patent applicant Minolta Camera Co., Ltd. Agent
Patent attorney small book Etsushi ) fig fig fig tLl

Claims (1)

[Scope of Claims] 1. A camera that has a GPS receiver and records positioning data from the GPS receiver on a recording medium together with photographed images, and a search device that searches for photographed images recorded on the recording medium. The search device comprises a map display means for displaying a map, a condition input means for outputting the position data when the position on the displayed map is input, and a means for inputting the position data and the positioning data. 1. A photographed image search system comprising: a search means for collating and searching for a photographed image corresponding to matching positioning data. 2. In the photographed image retrieval system according to claim 1, the retrieval device includes a compatibility storage means in which a membership function indicating the compatibility of the positioning data with the position data is stored, and a membership function inputted by the condition input means. selection means for selecting a membership function that corresponds to the position data, the search means searches the positioning data in descending order of suitability based on the membership function, and searches the positioning data corresponding to the searched positioning data. A photographic image search system characterized by searching for images.