JPH02286124A - Picture record retrieving and displaying device - Google Patents

Abstract

PURPOSE:To simultaneously observe pictures, which are stored hourly separately, and to compare those pictures by providing a referring picture display screen, temporary select picture display screen and moving image display screen in a display means and observing a moving image while observing the referring picture display screen. CONSTITUTION:A picture record retrieving and displaying device 1 is connected to an endoscope unit 2 and can retrieve the record of an endoscope image. The picture record retrieving and displaying device is composed of a picture storing means to store a series of time sequential pictures, control means to select the arbitrary picture out of a series of the time sequential pictures, to output the selected picture and simultaneously to successively output a series of the time sequential pictures for selecting the picture and display means to simultaneously display the picture, which is selected by receiving an output from the control means, and a series of the time sequential pictures for the selection. The time sequential pictures stored in the storing means are read by the control means and displayed in the display means. When the prescribed picture is selected out of these displayed pictures, the control means simultaneously outputs the selected picture and a series of the time sequential pictures for executing the selection to the display means.

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field 1] The present invention relates to an image recording search display device for recording and searching a series of time-series images.

[Problems to be Solved by the Prior Art and the Invention 1] In recent years, by inserting an elongated insertion part into a body cavity, organs within the body cavity can be observed, and treatment instruments inserted into the treatment instrument channel as necessary have been developed. An endoscope (
scope or fiberscope) are widely used.

In addition, various electronic scopes using solid-state imaging devices such as charge-coupled devices (abbreviated as COD) as image carriers are also used. This electronic scope has advantages such as higher resolution than a fiber scope, easier recording and reproduction of images, and easier image processing such as image enlargement and comparison of two screens.

The endoscopic image visualized by the electronic scope is recorded on an image recording device, and various recording techniques have been proposed. For example, the applicant filed Japanese Patent Application No. 63-2779.
No. 13 proposes a technique for distributing and recording image signals input from an endoscope device to a plurality of image recording sections.

On the other hand, when playing back images recorded on an image recording device (
yo, displaying a series of images on multiple screens is done,
For example, a series of nine images were displayed in sequence on the screen of the multi-screen display device.

However, with this technology, if you want to compare one image in a series of images with another, it is fine if they happen to be displayed on the same screen, but if that is not the case, you can display them simultaneously on the screen and directly compare them. Couldn't compare.

The present invention has been made in view of the above-mentioned circumstances, and provides an image record that makes it easy to simultaneously observe and compare images that are stored temporally apart when searching and displaying a series of images. The purpose is to provide a search display device.

[Means and Means for Solving the Problems] The image recording search and display device of the present invention includes an image storage means for storing a series of time-series images, and an image storage means for selecting an arbitrary image from the series of time-series images. A control means for sequentially outputting a series of time-series images for selecting an image at the same time as outputting the image, an image selected in response to the output from the control means, and a series of time-series images for selection at the same time. It also has a display means for displaying the information.

In the present invention, the time-series images stored in the image storage means are read out by the control means and displayed on the display means. When a predetermined image is selected from the displayed images, the control means displays the selected image. A series of time-series images for making selections are simultaneously output to the display means.

[Example] Hereinafter, the present invention will be specifically explained with reference to the drawings.

FIGS. 1 to 7 relate to the first embodiment of the present invention.
The picture is a family celebration! 2 is a block diagram of the image recording search device, FIG. 3 is a block diagram of the internal g1m device, FIG. 4 is an explanatory diagram of the recording operation, and FIG. 6 is an explanatory diagram of a search operation, FIG. 6 is an explanatory diagram showing an example of a monitor display, and FIG. 7 is an explanatory diagram of cropping frame setting.

In FIG. 1, an image record search and display device 1 is connected to an endoscope device 2, so that a record search for 7g4 mirror images can be performed.

The endoscope device 2 includes an electronic endoscope 3 and an electronic endoscope 3.
The image input device 4 is connected to an image input device 4, and a first monitor 6 receives a video signal output from the image input device 4 and displays an image. In addition, the image input branch ri4
is connected to a record search device 7 as a control means constituting the image record search and display device 1. The image record search display device 1 is composed of the record search device 7, a second monitor 9 as a display means, and a keyboard 8.

The keyboard 8 as an input means is connected to the record search device 7, and various commands and data can be input thereto. The second monitor 9 is connected to the record search device 7, and the searched images are displayed on the second monitor 9.

The electronic endoscope 3 is flexible and elongated, and includes an insertion section 12 that is inserted into the observation site 11, an operation section 13 connected to the rear end of the insertion section 12, and an operation section 13. It has a universal cord 14 extending from the side of the housing.

A connector 16 is provided at the rear end of the universal cord 14.
is provided, and this connector 16 is connected to a light source section 17 of the image input branch @4 that supplies illumination light to the endoscope 3.

In FIG. 3, the distal end of the insertion section 12 of the electronic endoscope 3 is provided with an output end surface of a light guide 18 formed by a fiber bundle that outputs illumination light supplied from the light source section 17 to the observation region 11. ing. The light guide 18 is connected to the light source section 17 through the insertion section 12, the operation section 13, and the inside of the universal cord 14, and is supplied with illumination light.

An objective lens 19 is further provided at the distal end of the insertion section 12, and the imaging surface of a COD 21 as a solid-state image device is located at the imaging position of this objective lens 19. . A signal line 22 is connected to this C0D 21, through which an electric signal written as a result of photoelectric conversion of a subject image formed on an image carrying surface and a driving force for driving this C0D 21 are transmitted. This signal line 22 passes through the insertion portion 12 and the universal cord 14 to reach the connector 16.

The light source section 17 is provided with a light source lamp 31,
A light source lamp 3 is placed on the optical path connecting the light source lamp 31 and the incident end surface of the light guide 18 from the light source lamp 31 side.
A collimator lens 32 that converts one illumination light into parallel light, a rotating filter 33, and a condenser lens 34 that condenses the illumination light and irradiates it onto the incident end surface of the light guide 18 are provided.

The rotary filter 33G is disc-shaped and has red color (for example) in the circumferential direction.
Color transmission filters 34R, 134G, and 34B are provided to transmit each color light of R), green (G), and blue (B), and the collimator lens 32 collimates the color light into parallel light. Illumination light is allowed to enter. This rotary filter 33 is connected to the motor 3
5 to supply red, green, and blue color light to the light guide 18 in chronological order.

By connecting the connector 16 to the image input device 4, the signal line 22 is connected to the image processing section 36. The image processing unit 36 applies a drive clock to the CCD 21 to drive it, converts the electric signal sent from the CCD 21 into an RGB video signal, and outputs the RGB video signal. It also controls the balance of the image signal levels R and B signals. The RGB video signal output from the image processing unit 36 is output to the first monitor 6 and the record retrieval device 7, and the first monitor 6 displays an endoscopic image.

The record retrieval device 7 is constructed as shown in FIG.

In FIG. 2, the RGB video signal is input to a superimpose unit 37, digitally converted by an A/D converter 38, and written into a frame memory 39. The video signal read from the frame memory 39 is transferred to the D/A converter 41.
The signals are converted into analog signals and output to the second monitor 9 from the RGB output terminal.

In addition, the record retrieval device 7 has a CP
U43, ROM44, RAM46, and keyboard input section 4
Data and control signals can be input/output between 7, the input position setting section 48, the superimposition section 37, the storage position setting section 49, and the reproduction control section 51.

On the other hand, a synchronization signal is inputted to the write clock generation section 53 of the record retrieval device 7 along with the RGB video signal, and this write clock generation section 53 sends a timing signal to the A/D conversion section 38 and the write address generation section 54. Output J
It has become so.

The write address generation section 54 includes the write position setting section 4.
A control signal from 8 is input, and a write address is generated based on this control signal and output to the frame memory 39.

The storage position setting section 49 instructs the data storage section 56 to take in the video data written in the frame memory 39 in response to a control signal from the CPU 43. The data storage section 56 is playback-controlled by the playback control section 51, and the video data is stored in the frame memory 39 once again in response to a control signal from the playback control section 51.
It's getting crowded.

The record retrieval device 7 is provided with a read clock generator 52, which generates a timing signal and outputs it to the D/A converter 41 and the read address generator 57. The read address generator 57 generates a read address and outputs it to the frame memory 39, and outputs video data from the frame memory 39. Further, the read clock generating section 52 generates a synchronizing signal, and outputs this synchronizing signal to the second monitor 9 from the output terminal.

The keyboard input section 47 is connected to the keyboard 8 and is configured to send control signals and data to the CPU 43.

The writing ROM 44 stores programs for recording, searching, etc., and is designed to perform processing in response to control signals input from the keyboard 8.

Next, the operation of the CPU 43 will be explained using FIGS. 4 to 7.

Referring to FIG. 4, the recording operation will be explained.

Specify the recording interval by inputting it from the keyboard 8 using Pl. This specified recording interval is set as RA by CPtJ43.
It is stored in M46.

At P2, the superimposing section 37 superimposes the cutting frame 58 on the video data input from the image input device 4, and the seventh
The image shown in Figure (a) is displayed on the second monitor 9. This image shows an endoscope @ 6 with patient ID data 61 displayed on the left side of the screen 59 and a cutting frame 58 superimposed on the right side.
2 is displayed.

The keyboard 8 whose cutout frame 58 is shown in FIG. 7(b) at P3
Use the 0 cursor movement key 63 to move and set the image to be recorded so that it is surrounded by the cropping frame 58.

CP with P4 (J43 is 17A with command from keyboard 8
Data storage section 56 according to the recording interval stored in M46.
The video data inside the cutout frame 58 is taken in from the frame memory 39.

At P5, in response to a command from the keyboard 8, the CPU 43 outputs a command to stop taking in video data to the data storage unit 56, and the data storage unit 56 stops taking in the video data.

Images having recording intervals as described above are sequentially recorded in the data storage section 56. The video data recorded in this way is searched as follows.

When search conditions are entered from the keyboard 8 at the PIO in FIG. 5, the CPL 143 performs a search and searches for one set of images.

The video data retrieved from the data storage unit 56 by the PLL is output frame by frame to the frame memory 39, and a reference image display unit 64 is provided on the screen 59 of the second monitor 9 divided into four parts as shown in FIG. are displayed one frame at a time.

At P12, the image displayed on the reference image display section 64, for example, before the change starts, that is, the fourth frame image in the example of FIG. 6, is frozen in response to a command from the keyboard 8 at P12.

The video display section 66 is activated by a command from the keyboard 8 at Pl3.
The images are displayed sequentially starting from the 5th frame.

At Pl4, the image of interest, that is, the image at the 8th frame, is frozen in response to a command from the keyboard 8.

At Pl5, the frozen image of the 8th frame is transferred to the temporarily selected image display section (A) 67a and displayed.

The video display section 6 is activated by a command from the keyboard 8 at Pl6.
6, the images starting from the 9th frame are displayed in order.

The image is frozen at the image of interest in Pl7, that is, the 11th frame.

At Pl8, the frozen 11th frame image is transferred to the temporarily selected image display section (B) 67b and displayed.

At Pl9, frames from the keyboard 8 are sequentially displayed on the video display section 66 starting from the 12th frame.

At P2O, the image is frozen at the image of interest according to a command from the keyboard 8.

At P21, the frozen image is moved to the temporarily selected image display section (A) 67a and displayed.

Next, the operation of this embodiment will be explained.

The illumination light emitted from the light source section 17 of the image input device 4 is color-separated by the rotating filter 33, and red (R>, I(
G) and blue (B), and are irradiated onto the observation site 11 through the light guide 18. The reflected light from the observation site 11 is focused on the lid image plane of the CCO 21 by the objective lens 19, photoelectrically converted, and input to the image processing unit 36 of the image input device 4. The image processing section 36 generates, for example, an RGB video signal and outputs it to the first monitor 6 and the record retrieval device 7.

When recording an image, the RGB video signal is input to the superimpose section 37, where the cutting frame 58 is superimposed and the timing signal from the write clock generation section 53 is input./The RGB video signal is digitized by the D conversion section 38. and written into the frame memory 39. In the frame memory 39, the written video data is simultaneously read out, and the timing signal from the read clock generation section 52 is inputted to the D/A.
The converted signal is converted into an analog signal by the converter 41 and output to the second monitor 9 .

On the screen 59 of the second monitor 9, as shown in FIG. 7(a), an image 62 of a family celebration M with a cutout frame 58 superimposed thereon is displayed.

Next, operations from P1 to P5 are performed, and the image within the cutout frame 58 is recorded at the recording interval.

When performing a search, search conditions are input from the keyboard 8, and the CPU 43 searches for one set of images in accordance with the search data, and outputs this image sequence from the data storage section 56. The write position setting section 48 divides the address of the frame memory 39 into four and displays a reference image display section 64 shown in FIG. 6 and - time selection image display sections 67a and 67 at the divided addresses.
b and the moving image display section 66. The write address generation unit 54 generates an address corresponding to the reference image display unit 64 and writes video data onto the frame memory 39, and this video data is read out and sent to the second frame via the D/A conversion unit 41.
is displayed on the reference image display section 64 of the monitor 9.

Thereafter, starting from the second frame, the frames are sequentially written onto the frame memory 39 corresponding to the reference image display section 64 and displayed on the reference image display section 64. When the fourth frame of the displayed images is selected from the keyboard 8, encircling onto the frame memory 39 is prohibited and the fourth frame of the image is frozen.

Further, when a command from the keyboard 8 is input to the CP IJ 43, the CPU 43 outputs a control 11 signal to the write position setting section 48, and the write position setting section 48 sends a video display section 66 to the output address generation section 54. The address on the frame memory 39 corresponding to the address is output. The video data output from the data storage section 56 is written in accordance with this address, and simultaneously read out and output to the second monitor 9 via the D/Ala conversion section 41. On the screen 59 of the second monitor 9, a still image of the fourth frame is displayed on the reference image display section 64, and images starting from the fifth frame are sequentially displayed on the moving image display section 66.

When the eighth frame is selected from the keyboard 8, the CPU 43 outputs a control signal, R3, to the write position setting section 48, and the write position setting section 48 causes the write address generation section 54 to correspond to the temporarily selected image display section <A> 67a. Frame memory 39
The upper address is generated, and the eighth frame image is written on the frame memory 39 using this address. The written video data is read out and displayed on the screen 59 of the second monitor 9, the reference image display section 64 displays the fourth frame image, and the - time selection image display section (A) 67a displays the fourth frame image. The 8th frame image is displayed.

Thereafter, the 11th frame image is similarly displayed on the temporarily selected image display section (B) 67b, and furthermore, when a selection is made, the selected image is displayed on the temporarily selected image display section (A) 67a.

In this embodiment, the screen 59 of the second monitor 9 is divided into four parts, including a reference image display section 64, - time selection image display sections 67a and 67b.
, by forming the video display section 66, the video display section 6
6 and other display sections 64.67a, 67b
images can be compared at the same time, so images can be easily selected and each image can be easily compared.

Furthermore, when recording an affected area that changes over time as in this embodiment, it is possible to select arbitrary images and compare them, making it possible to clearly see changes in the affected area over time.

In addition, although the screen 59 of the second monitor 9 is divided into four and displayed in this embodiment, the number of divisions is not limited to this, and may be divided into nine, for example.

Furthermore, a memory section is provided to store a plurality of images that match the search conditions, and images are repeatedly recalled from this memory section, so that, for example, an image that was not selected the first time can be selected on the second recall. It's okay.

8 and 9 relate to the second example of actual droplets of the present invention, FIG. 8 is a schematic diagram of an image recording search display device used with the endoscopic Ii device, and FIG. 9 is a block diagram of the image recording search device. It is.

This embodiment has an endoscope device 2 similar to that of the first embodiment, and a description of the endoscope device 2 will be omitted.

In FIG. 8, the record retrieval device 71 includes a second monitor 72.
, a third monitor 73 , a fourth monitor 74 , and a fifth monitor 76 are connected.

The record retrieval device 71 is configured as shown in FIG.

The RGB video signal output from the image input device 4 is input to a superimposing section 77 that superimposes a cutting frame 58. The superimposing section 77 is connected to an A/D converting section 78, and the digitized video data is written into an input frame memory 79. The input frame memory 79 has output frame memories 81a, 81b, 8
1c.

81d and a video data bus 80, so that image data can be input and output from each other. Each output frame memory 81a, 81b, 81C, 81d has D
/A converters 82a, 82b.

82C and 82d are connected to each other, and the video data is converted into analog and sent to the second monitor 72 and third monitor 73, respectively.
and can be output to a fourth monitor 74 and a fifth monitor 76.

A read control section 83 is connected to the input frame memory 79, and output frame memories 81a, 81b, 8
1c, 81d1. : indicates readout control units 84a and 84b, respectively.
, 84c, and 84d are connected. Read control units 84a, 84b, and 84c, respectively.

84d are D/A converters 82a, 82b, and 82c.

82d, and outputs a timing signal and generates a synchronization signal to control each monitor 7.
It is designed to be output at 2, 73, 74, and 76.

The read control units 83.84a, 84b, 84c, 84
d is connected to a control bus 86, and this control bus 86 is further connected to a write control section 87, an image data storage section 88, a search data storage section 89, a CPtJ 43, a ROM 44, and an R
The AM46 and the keyboard interface 91 are connected so that data and the Ilj1m signal can be input and output.

Next, the operation of this embodiment will be explained.

When recording an image, the RGB video signal input from the image input device 4 is input to the superimbo 1 section 77, the cutting frame 58 is superimposed on it, the signal is digitized by the A/D conversion section 78, and the RGB video signal is input to the input frame memory 79. written to. This video data is read out and output from the frame memory 81a.
The data is written to the ROM, further read out, converted into an analog signal by the D/A converter 82a, and output to the second monitor 72. The second monitor 72 displays an endoscopic mil image 62 on which a cutout frame 58 shown in FIG. 7(a) is superimposed.

As in the first embodiment, after inputting the recording interval using the keyboard 8, the cutting frame 58 is moved using the keyboard 8 and the image to be recorded is placed in the cutting frame 58. The CPU 43 causes the image data storage section 88 to take in the video data within the cutout frame 58 of the input frame memory 79 in response to a command from the keyboard 8 . As a result, a series of time-series images having recording intervals are sequentially stored in the image data storage unit 88.

When searching for stored images, search conditions are input from the keyboard 8. The CPtJ 43 searches for one set of a series of images from among the images stored in the image data storage section 88 based on this search condition. This searched series of images is selected and stored in the search data storage section 89.

The CPU 43 outputs the first frame of the stored image to the output frame memory 81a via the video data bus 80. The output frame memory 81a converts the written image data into analog data using a D/A converter 82a and outputs the analog data to the second monitor 72.

On the second monitor 72, the stored M images for the family celebration are displayed sequentially from the first frame.

While observing the second monitor 72, the user operates the keyboard 8 to select, for example, an image before the change begins. CPU4
3, when a selection is made, prohibits the writing of image data into the output frame memory 81a and repeatedly outputs the already written image, that is, the selected image.
The image displayed on the monitor 72 is assumed to be a still image.

Next, the CPU 43 receives a second command from the keyboard 8.
The image data recorded next to the image displayed on the fifth monitor 72 is sequentially written to the output frame memory 81d, and the written image data is converted into analog by the D/Δ converter 82d and sent to the fifth monitor 76. is output and displayed.

While observing the fifth monitor 76, the user selects the image of interest using the keyboard 8. The CPU 43 inhibits writing to the output frame memory 81d by commands from the keyboard 8, repeatedly outputs the already written image, that is, the selected image, and makes the displayed image on the fifth monitor 76 a still image. Further, the CPU 43 writes the same image displayed on the fifth monitor 76 into the output horn frame memory 81b, and repeatedly outputs this image to the third monitor 73.

A still image of the image of interest is displayed on the third monitor 73.

The CPLI 43 causes the fifth monitor 76 to sequentially display the image recorded next to the image displayed on the third monitor 73 in response to commands from the keyboard 8 .

While observing the fifth monitor 76, the user operates the keyboard 8 to select an image of interest. When the selection is made, the CPU 43 simultaneously displays the selected image on the fifth monitor 76 as a still image, and displays the same image on the fourth monitor 74.

If a further selection is made, the selected image is displayed on the third monitor 7.
3, and similar operations are repeated thereafter.

According to this embodiment, the same effects as in the first embodiment can be obtained.

Note that in this embodiment, an image is displayed on the fifth monitor 76 to make a selection, and the selected image is displayed as a still image on the second to fourth monitors 72, 73, 74. Selection and still image display may be performed on the same monitor.

In each of the above embodiments, the data is cut out from within the cutout frame and stored, but the data may be stored without being cut out and cut out during playback.

Alternatively, an analog storage device may be used, the output of the analog storage device may be displayed on the video display section, and a frozen image may be displayed on the other portions.

Further, the present invention is not limited to electronic endoscopes, and similar effects can be obtained even when applied to an image capture device in which an external TV camera is attached to an optical endoscope.

[Effects of the Invention] As explained above, according to the present invention, the display means is provided with a reference image display screen, a temporarily selected image display screen after search, and a video display screen, and the video display screen is displayed while observing the reference image display screen. Therefore, when searching and displaying a series of images, it is possible to simultaneously perform alJD and compare images that are stored temporally apart.

[Brief explanation of drawings]

FIGS. 1 to 7 relate to the first embodiment of the present invention.
The figure is a schematic diagram of an image record search and display device used with an endoscope device, FIG. 2 is a block diagram of the image record search device, FIG. 3 is a block diagram of the endoscope device, and FIG. 4 is an explanation of the recording operation. Fig. 5 is an explanatory diagram of the search operation, Fig. 6 is an explanatory diagram showing an example of the display on the monitor, Fig. 7 is an explanatory diagram of cropping frame setting, and Figs. According to the embodiment, FIG. 8 is a schematic diagram of an image recording search and display device used together with an endoscope device, and FIG. 9 is a block diagram of the image recording search device. 1... Image recording search display device 2... Endoscope device 3... Electronic endoscope 4-...
Image input device 7...Record search device 9...Second monitor 6...First monitor 8...Keyboard No. 31! ! Figure 4

Claims (1)

[Scope of Claims] An image storage means for storing a series of time-series images, and an image storage means for extracting and sequentially outputting the series of time-series images from the image storage means, and for selecting an image from the series of time-series images. and a display means for simultaneously displaying the selected image and the series of time-series images in response to the output from the control means. Image recording search display device.