JPH03174657A - Picture retrieving device - Google Patents

Abstract

PURPOSE:To easily retrieve pictures based on the numerical data on a key color by choosing a key color out of a 2-dimensional area and controlling the key color as the numerical data. CONSTITUTION:A 2-dimensional area set in a picture is designated by a mouse and a color used for retrieval is designated via a mouse out of those unique colors displayed on a matrix. Then an area key word 'BOSHI' is selected together with the color value AC6B57. Thus a picture having a key word field and a color value control field coincident with the value AC6B75 is retrieved via a picture retrieving means 9 out of a structure/color information control record. Then the picture data controlled by a retrieving information control record is taken out of a data storage means 3 based on a hit picture and displayed on a display means 10. Thus it is possible to retrieve pictures based on the color information and to increase the picture retrieving freedom.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of the Invention The present invention relates to systems for storing images, such as image retrieval devices such as image databases.

BACKGROUND OF THE INVENTION In recent years, there has been an increasing demand for databases that previously managed only code information such as characters and numbers to also manage graphic and image data in an integrated manner.

Since graphic and double-image data are two-dimensional data that follow text and numerical values, a search method that follows them is required.

In particular, image retrieval using images is being researched in the field of image recognition technology Q, but at present no image retrieval method using image recognition technology has been established. +r
JJJ@ *The first conventional technology for performing ligation is an image file registration system.

This is a method of performing a search using keywords that are registered as index information and pressed when all images are registered. As a second prior art, there is a user interface that appears to search for images using images. This involves managing the 2D head area within the displayed image, associating search information such as keywords for searching images with the 2D @ area, and specifying the 02D head area within the image. This allows search operations to be performed using the associated search information. (For example, JP-A-63-6
(No. 1085) However, with the recent spread of high-definition display devices capable of displaying five color colors, there is a demand for an image search method that utilizes display image zero color information as search information. When performing a search using color information based on the first prior art example, the user should register keywords expressing the color of the registered image (for example, red, yellow, etc.) as index information. , one possible method is to enter that keyword as a full search keyword and search. In the case of implementing the second conventional technique, a method of searching using keywords expressing colors in a two-dimensional area (for example, red hat, etc.) may be considered.

Problems to be Solved by the Invention In the conventional configuration, when searching registered images using color information, the following problems occur. 1st Qr.
In the case of conventional technology, generally there are various colors in the entire image to be registered, so the color used as the representative color may be used depending on the purpose of the registrant and the area, or the keyword expressing the representative color may be different. Since it differs depending on the registrant, it is difficult to get a high hit rate when searching. There are restrictions on the types of keywords that ordinary users can use to express colors.
Multicolor display is possible. In the case of a display device, for example, a full-color display device that can simultaneously display 16.7 million colors with 8 bits each for RGB, it is difficult to express all colors using keywords. In the second conventional technique, when a keyword expressed in color is associated with a two-dimensional head area, the registrant's attention@area is limited to the set two-dimensional head area, making it easier to define a representative color.

However, as in the case of the first conventional technique, when displaying a registered image on a multicolor display device, it would be nice if the registrant could select all display colors using keywords. Therefore, even in the second conventional technique, it is difficult to perform a search using color information.

The present invention solves the above problem, and aims to provide an image search device that can perform a single image search with color information by managing the image as a multicolor display.

0 means for problem decomposition method Image retrieval system of the present invention for solving the above problem a storage means, a structured information management means for managing the two-dimensional chain acid information and the code information as a pair of structured information, a search information management means for managing the code information for searching the image data, and the search an image search means for searching images stored in the data storage means using code information managed by the information management means; a display means for displaying the image searched by the image search means; A position specifying means specifies a position, and the position information specified by the position specifying means is used to extract the code information managed by the structured information management means, and the retrieved code information is searched by the image search means as a search condition. The image retrieval device performs the following: representative color selection means for selecting a representative color within the two-dimensional head area designated by the position designation means; and a color managed as search information on the representative color selected by the representative color selection means. It has an information management means and a search color selection means for selecting a color to be used as a search condition, selects a representative color using the representative color selection means at the time of the two-dimensional head registration, and selects the representative color by using the representative color in the color information management. and the color is selected by the search color selection means at the time of searching, and the image search means performs a search χ using the code information managed by the structured information and the selected color as search conditions. It is.

Effect With the above configuration, by selecting a representative color within the two-dimensional head area and managing the representative color as numerical data (color value), the image used for the representative color 0 numerical data selected by the search color selection means at the time of search. Easy to explore.

Example An embodiment of the present invention will be described below based on the drawings.

FIG. 1 is a block diagram showing an embodiment of an image search device according to the present invention. In Fig. 1, 1 is a control means for controlling the following means, 2 is a position specifying means for specifying a position in the displayed image, 3 is code information such as letters and numbers, and 1lf.
4 is a data storage means for storing the information describing the 2D head area in the statue and the image take;
5 is a representative color selection means for selecting a representative color within the two-dimensional head area set using the position specifying means 2; 6 is a numerical value of the representative color selected using the representative color selection means 5; A color information management means for managing take (color value) as search information; 7 a search color selection means for selecting a color to be used as search information during a search; 8 a code for searching image data stored in the data storage means 3; The search information to be managed as information 9 is converted into code information managed by the structured information management means 4 using the location information obtained by the embedding means and the position specifying means 2, and the code information is managed by the search information management means 8. An image retrieval means 10 searches for an image matching the image data, and 10 is a front means for displaying a searched image data button and structured information. On the Otagi side, it is assumed that it is composed of a structured information optical display Pj, 4, a color information management means 6, and a search information management system 198 and a relational database management system (RDBMS).

RDBMS uses tables (records) to manage stored data, and each management function within a record is called a field, and the table framework (all fields) is called a schema. In general, there is a database definition key as record definition, data input to record,
Contains words for inquiries about databases and words for data manipulation.

Figure 2 is a diagram showing the records managed by RDBMS on the main stream side, and Figures 2 (a) and (b) are structured information/color information management records and image information management records, respectively. be.

Figure 2 (a) I/) Click the structured information/color information management record button, 21 is a structured information ID field that is uniquely determined from the structured information, and 22 is an image ID field that uniquely determines the memory positive image. 7 redo, 23 is a two-dimensional song area field that stores the two-dimensional @ area in the mountain image (in this case, the coordinates of the first point at the top left of the rectangular head, the coordinates of the second point at the bottom right, and χ management), 24
is a keyword field that stores code information related to the two-dimensional head area, and the above four feeds are the same as the configuration used in the prior art. Here, two-dimensional area field 2
3 and the keyword field 24 correspond to the structured information management means 4 in FIG. Further, in this embodiment, a color value management field 25 is provided as color information management means 6 for managing color values within the set two-dimensional head area.

FIG. 2 (bl is a search information management record that associates code information and image data stored in the search information management means 8, and is similar to the configuration using the conventional technology.

Below, the above configuration will be explained in Figs. 3, 4, and 51'? 1
This will be explained with reference to.

FIG. 3 (al shows an image on which the two-dimensional head area is to be set is displayed on the display means 10. In this embodiment, the display means 10 displays 8 pixels each for RGB) 167
It is assumed that 00,000 colors can be displayed simultaneously. In Figure 3 (al), an image with a picture of a hat is displayed.Similar to the prior art, the two-dimensional head i' is placed on the part of the image where the hat is located (in this example, the position is specified). The mouse is used as means 2), and the keyword "1 Hat" is associated with that area. Next, in Figure 3 (bl
Then, the representative color selection means 5 calculates the color histogram within the two-dimensional head area set in FIG. The selection process is shown in χ.The fx button and fbl in FIG. 3 show the RGB values in hexadecimal.

This selection of representative colors Q and color values Q is performed for each two-dimensional head area.

In this example, the representative color of gold is simply the one with the maximum histogram frequency, but RGB jCfi zo f'L8 bits are
It is also possible to speed up and optimize calculations by calculating the histogram frequency after low quantization to about 4 bits or 4 bits, and using it as the representative color on the maximum 0.

As another example, when calculating the color histogram of the set two-dimensional singing area, calculate the color histogram excluding the colors on the set two-dimensional bright area boundary, and select the one with the maximum histogram frequency as the representative color. Another possible method is to do so. The stiffness method is a two-dimensional head area picture (Figure 3 (hat in at)
This is a method for removing the color component of the background color within the two-dimensional head area when the head area is set in a form that largely surrounds the area.

Another example with the same effect goal is to divide the color histogram in a circle touching the set 2D @ area with the center of gravity of the set 2D @ area as the center, and the histogram frequency is the maximum. A method of using objects as representative colors may also be considered.

Various methods can be considered for selecting the representative color in the two-dimensional head area, but it is conceivable that each method is individually selected, or that the representative color obtained by each method matches the representative color. .

FIG. 4 shows how the two-dimensional head area set in the third section, keywords associated with it, and color values of representative colors are registered in the structured information/color information management record. In this embodiment, color values of RGB are each packed into 8-bit values and managed as 24-bit values.

FIG. 5 shows how images registered as shown in FIGS. 3 and 4 are searched using color information. Figure 5 (a
At l, the search color selection means 7 selects a unique color value el! from among color values registered in the past. 2, and the colors of the calculated unique color values are displayed in a matrix on the display means 2. In this example, when searching, the previously registered f
Although the unique color values are calculated from the color values determined in advance, it is also possible to create nine unique color values from among the color values of the representative colors selected in advance when setting the two-dimensional chain acid. Instead of displaying or managing unique color values of previously registered colors, a color bar or the like of colors that can be displayed on the display means 10 is simply displayed, and the user can specify the color of the color bar. By doing so, it is possible to select a color to be used as a search condition. In addition, as a method of combining both, display means 1
It is also possible to display a color bar, etc. of colors that can be displayed in 0, and mark previously registered colors on the color bar.6゜Furthermore, it is possible to calculate the unique color value of the previously registered colors or to fill in the g. , for each keyword associated with the 2D @ area (for example, when specifying the fc 2D down payment with the keyword ``hat 1'' associated, the color of the 2D head area that was registered in the past with association with the keyword ``hat 1'') Another possible method is to calculate or manage a unique color from among the values.

The search instruction procedure for this embodiment is to use the mouse to specify the two-dimensional head area set in the image, as in the case of the prior art (Fig. 5(a) = 1), and then the matrix Use the mouse to specify the color to be used for search from the unique colors displayed in (Figure 5 (al=2). Figure 5 (a)
In l, 1 hat is used as a keyword and “ is used as a color value.”
"AC6B75" is selected (Figure 5(b)). As a result, the keyword field and color value management field match this value in the structured information/color information management record of Figure 2 (al). Search using the image IDk image search means 9.

Next, as in the prior art, the image data (image file name in this embodiment) managed in the search information management record is retrieved from the data storage means 3 using the hit image ID and displayed on the display means 10 ( Figure 5(b)).

In the above embodiment, RDBMS'r is used for the structured information management means 4, color information management means 6, and search information management means 8, but other database management systems may be used such as a network type database or an am database. do not have. Furthermore, any system other than the database management system may be used as long as it has the above-described structure and can store and manage data.

Effects of the invention As described above, the present invention has the following effects,
Its practical effects are very large.

(1) Search using color information is now possible in the conventional O area setting operation, increasing the degree of freedom in search.

(2) Since zero color can be selected during a search from a list of colors registered in the past, operability is improved and the search hit rate is improved.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of an image retrieval device according to an embodiment of the present invention, and FIG. 3 and 4 are explanatory diagrams for explaining the management record, and FIG. 4 is an explanatory diagram for color information registration, and FIG. 5 is an explanatory diagram for retrieving color information. 1. Control means, 2. Position specifying means, 3... Data storage means, 4... Structured information management means, 5...
Representative color selection means, 6... Color information management means, 7... Search color selection means, 8... Search information management means, 9... Image search means, 10... Display means. Daikoniri Yoshihiro Morimoto, Figure 7

Claims (1)

[Scope of Claims] 1. Data storage means for storing code information such as characters and numerical values, two-dimensional area information within an image, and image data;
structured information management means for managing dimensional area information and code information as a pair of structured information; search information management means for managing code information for searching the image data; and codes managed by the search information management means. an image retrieval means for retrieving an image stored in the data storage means using information; a display means for displaying the image searched by the image retrieval means; and a position specification for specifying a position within the image displayed on the display means. and a position information designated by the position specifying means to retrieve code information managed by the structured information management means, and perform a search by the image retrieval means using the retrieved code information as a search condition. representative color selection means for selecting a representative color within the two-dimensional area specified by the position specifying means; color information management means for managing the representative color selected by the representative color selection means as search information; search color selection means for selecting a color to be used, selecting a representative color using the representative color selection means when registering the two-dimensional area, and managing the representative color with the color information management means; An image retrieval device characterized in that: a color is selected by the search color selection means, and a search is performed by the image retrieval means using code information managed by the structured information and the selected color as search conditions. 2. The image retrieval device according to claim 1, wherein the selection of the representative color in the two-dimensional area includes obtaining a color histogram in the two-dimensional area, and selecting the color with the largest amount of histogram as the representative color. . 3. The selection of the representative color within the two-dimensional area is characterized in that a color histogram within the two-dimensional area excluding the color on the boundary of the two-dimensional area is obtained, and the one with the maximum amount of histogram is selected as the representative color. The image retrieval device according to claim 1. 4. To select a representative color within a two-dimensional area, obtain a color histogram within a circle that is centered on the center of gravity of the two-dimensional area and is in contact with the two-dimensional area, and select the color with the largest amount of histogram as the representative color. The image retrieval device according to claim 1, characterized in that: 5. The image according to claim 1, wherein the color used as the search condition is selected by displaying a unique color on the display means from among the representative colors managed by the color information management means and selecting from the displayed colors. Search device.