JPH04270580A - Display system - Google Patents

Abstract

PURPOSE:To attain flexible transmission and combination of display of a video signal from a low definition to a high definition not relying on a specific specification. CONSTITUTION:Video images at different positions of one video image are picked up by a single or plural image pickup systems 11 under the control of an image pickup system control section 12 in a discrete way and the video signals picked-up from low to high definition are used for a transmission channel corresponding to each video signal or for a few transmission channels in time division by the control of a transmission system control section 31 of a transmission section 3 and the diversified display service including from low to high definition display is implemented by the control of a display system control section 51 of a display section 5.

Description

[Detailed description of the invention]

0001

[Industrial Field of Application] The present invention connects a video source unit including an image capturing unit with information exceeding the information transmission capacity of the transmission line and a display unit through a transmission line, thereby changing from low-definition display to high-definition display and the like. The present invention relates to a display system that performs various combinations of displays.

0002

2. Description of the Related Art FIG. 15 shows a schematic block diagram showing an example of a conventional display system.
2 is an encoding unit that compresses the signal from the imaging unit 1 and performs processing for efficient transmission; 3 is a transmission unit consisting of a transmission path, etc.; 4 5 is a decoding unit that decompresses the transmitted video signal etc. if it is compressed, and 5 is a display unit that performs desired display. In such a configuration, the amount of information handled by the imaging section 1, the transmission section 3, and the display section 5 has conventionally been unified, for example, as an NTSC signal.

0003

[Problems to be Solved by the Invention] Therefore, with the configuration of the display system as described above, it is possible to obtain a higher definition HDT.
If you try to transmit a V video signal, it will become a transmission line bottleneck, and even if the transmission section were to solve the problem, the imaging section and display section would also have to be compatible with HDTV video signals. As described above, in conventional display systems, the transmission path is fixed and flexible transmission is not possible. In addition, when the image capturing section is divided into parts and transmitted at once, the amount of hardware increases, making it difficult to provide a variety of display services, etc. Because the specifications of each functional section are uniformly fixed. It had drawbacks.

The present invention solves these conventional drawbacks and provides a display system that allows for flexible transmission and display combinations of video signals from low-definition to high-definition imaging without relying on special specifications. The purpose is to obtain.

[0005]

[Means for Solving the Problem] A first means of the present invention includes means for discretely extracting and imaging different images of one image in each of a plurality of imaging systems, and a plurality of images in the imaging means. means for transmitting a video signal imaged by the imaging means using a transmission channel corresponding to the output of the imaging system;
It is characterized by comprising means for displaying one original image by combining the discretely extracted video signals transmitted through each transmission channel in the transmission means.

A second means of the present invention includes means for discretely extracting and capturing different images of one image in each of a plurality of imaging systems, and a method for controlling the number of the plurality of imaging systems in the imaging means. A means for transmitting a video signal imaged by the imaging means using fewer transmission channels in a time-division manner, and a video signal transmitted in a time-division manner by each transmission channel of the transmission means, with pixels thinned out, is synthesized. and means for displaying one original image.

The third means of the present invention has one or more imaging systems, and when imaging with a single imaging system, one image is discretely extracted and imaged, and when imaging is performed with a plurality of imaging systems. In this case, each imaging system includes a means for discretely extracting and imaging different parts of one image, and a single or plural video signals captured by the imaging means having the single or plural imaging systems. means for transmitting the video signal imaged by the imaging means using the transmission channel; and a means for calculating and combining the video signals leaked from the discrete extraction of the video signals transmitted by the transmission means to create one video. and display means.

[0008]

[Operation] According to the present invention, a plurality of imaging systems are set to discretely extract and capture images from different parts of one image, or pixels of one image are discretely extracted and output. A single imaging system, a display system that reproduces and displays the original video by synthesizing these discretely extracted video signals, and a transmission system that changes the transmission capacity according to the imaging data. This is a display system that enables a variety of display services, from high-definition display to high-definition display.

[0009]

Embodiment FIG. 1 shows a block diagram of an embodiment according to claim 1 of the present invention, in which numeral 1 denotes an imaging unit, and a plurality of (N) imaging systems 111, 112, ... 11N and these imaging systems are shown. It is composed of a system control section 12. Each imaging system 111, 112,...
11N discretely extracts and images images of different parts of one subject 6 under the control of the imaging system control unit 12;
Outputs 131, 132 of imaging systems 111, 112,...11N
, . . .13N to the transmission unit 3. This transmission section 3 includes a transmission system control section 31 and each imaging system 111, 112,...11N.
It is composed of transmission channels 321, 322, . . . 32N corresponding to the following. That is, the number of transmission channels is N channels, which is the same number as the imaging system, and the outputs 131, 132, ... 13N of the imaging system are transmitted to the transmission channel 3 by the transmission system control unit 31.
21, 322, . . . 32N, respectively. Reference numeral 5 denotes a display section, which is composed of a display system control section 51 and a display 52, and the video signals transmitted through the transmission channel are discretely extracted by the display system control section 51 and then transmitted separately. Combine the video signals and display the original video on display 5.
Display on 2.

With such a configuration, the subject 6 is imaged in a distributed manner by N imaging systems, each transmitted through a dedicated transmission channel, and then synthesized by the display unit 5.

FIG. 2 is a block diagram of the specific example of FIG.
j, Bij, Cij, Dij, each imaging system 111
~114 are each discretely extracted and imaged, and each Ai
j, Bij, Cij, and Dij are obtained. An example of this is shown in FIG.

FIG. 3 shows the relationship between the subject 6 and the imaging outputs 131-134 of the imaging systems 111-114 when N=4. In the figure, (a) is video information of the subject 6, (b) to (e)
are video information of the imaging systems 111 to 114, respectively.

FIG. 4 shows a block diagram of an embodiment according to claim 2 of the present invention, and the difference from FIG. 1 which is an embodiment according to claim 1 is the number (N) of imaging systems 11 and the transmission channels. 32
This is a case where there is a relationship N>M between the number (M) of , that is, the number of transmission channels is smaller than the number of imaging systems, and everything else is the same. Therefore, in data transmission for the imaging system, the transmission system control unit 31 uses all transmission channels or a specific channel in a time-division manner for transmission.

FIG. 5 shows a block diagram of an embodiment according to claim 3 of the present invention, which basically has the same configuration as FIG. The present invention differs in that it includes an operator section 53 that calculates original data by performing an inverse calculation of thinning information on information that has been thinned out. An illustrative diagram for explaining this concept is shown in FIG. In FIG. 6, original data (e) is
Calculate. Then, it is displayed on the disc play 52 of the display unit 5 as one video.

FIG. 7 is a block diagram of an embodiment according to claim 4 of the present invention.
Targeting TV images, discretely extracted images are converted to NTSC.
This is the case when it is made into a video. That is, in FIG. 7, the output of a high-definition (HDTV) image of a subject 6 captured by an imaging unit is divided into a plurality of NTSC video signals of lower definition and outputted via a transmission unit 3. That is, as shown in the drawing, HD
TV video signals are transmitted using multiple NTSC transmission lines. For example, discretely extracted (thinned) NTSC video signals are transmitted to each transmission path. Figure 7 (a
), the display system control unit 511 controls the display 5.
21 shows an example in which an arbitrary video signal is selected from a plurality of NTSC video signals and an NTSC video is displayed. Furthermore, an example is shown in which the display system control unit 512 synthesizes video signals transmitted as a plurality of NTSC video signals and reproduces and displays them as an HDTV video on the display 522. Both can be displayed separately or simultaneously by the display control units 511 and 512. Further, FIG. 7(b) shows a case where any one of the NTSC video signals is fixedly selected, and the other parts are the same as FIG. 7(a).

FIG. 8 is a block diagram of an embodiment according to claim 5 of the present invention, and FIG. 8(a) shows "one video".
13 is a case where HDTV video is the target and the discretely extracted video is NTSC video. As an example of a case where the transmission capacity is less than the output of the imaging unit, the transmission line is NTS
An example of one C system is shown. In FIG. 8A, a subject 6 is imaged in high definition (HDTV) by an imaging unit, and its output is divided into a plurality of NTSC video signals of lower definition and output. That is, for an HDTV video signal, a plurality of N
The video signal divided into TSC video signals is transmitted to the transmission system control unit 3.
1, transmission is performed using one system of NTSC transmission line. The transmission system control unit 31 performs control such as selecting an NTSC video signal and using the transmission path in a time-division manner when transmitting an HDTV video signal. In other words, in FIG. 8A, the display system control unit 511 displays the NTS on the display 522.
An example is shown in which a C video signal is received and an NTSC video is displayed. In addition, the display system control unit 512 controls the display 52.
2 shows an example in which a plurality of NTSC video signals sent in a time-division manner are combined and reproduced and displayed as an HDTV video. In this case, full HD is required due to transmission capacity.
It is not possible to display video of TV images, but HDTV with frame dropping
It becomes possible to display pseudo moving images and still images of HDTV images. In this case as well, the NTSC video and HDTV video can be displayed separately or simultaneously.

FIG. 8(b) shows a case where an HDTV level image is extracted discretely to produce an NTSC level image, or is imaged at the NTSC level from the beginning. The components are the same as those in FIG. 8(a), but only the display system control section 512 is characterized in that an interpolation calculation function is added. That is, an example will be shown in which HDTV video is displayed by artificially increasing the definition by performing interpolation calculations such as interpolation based on the sent NTSC level video signal. Note that in FIG. 8(a), all data to be displayed is transmitted, but in FIG. 8(b), new data is created and displayed based on the transmitted data.

FIG. 9 is a diagram showing a configuration diagram and a composite signal of an embodiment according to claim 6 of the present invention. In this example, four imaging units are used. FIG. 9A shows the overall configuration, in which 14 is a video distribution section for distributing scene images of the subject 6 into a plurality of similar images, and 15 is a plurality of imaging sections such as video cameras.

The image distribution section 14 is, for example, a semi-transparent mirror 141.
, 142, 143 and a total reflection mirror 144. FIG. 9(b) is a detailed diagram of the sensor section 16 of the imaging section,
17 is a sensor element portion (opening), and 18 is a non-photosensitive portion. In the image of the subject 6, only the portion of the sensor element section 17 is subjected to photoelectric conversion.

As a result, the scene image is obtained as (Aij), for example, as shown in FIG. 9(b), and a gap exists between each sensor element portion. For this reason, Bij, Cij,
The sensor element part of Dij is connected between the sensor element part of (Aij) (
By adjusting the position so that it is inserted into the non-photosensitive area), the composite signal shown in FIG. 9(c) is obtained.

FIG. 10 is a block diagram of an embodiment according to claim 7 of the present invention, in which N images are projected and displayed in a superimposed manner. In FIG. 10, 19 is a total reflection mirror, 20 (201, 202...20n) is a half mirror, and the reflectance and transmittance of each are determined by the combined image output 21 after considering the loss at each mirror part. Transparent display device 22
The brightness of (221, 222, 223...22n) is set to be the same. 23 (231, 232, 233...2
3n) is a light supply unit for the transmissive display device 22. Note that if the output lights of the transmissive display devices 22 are not parallel, the optical distances from each transmissive display device 22 to the composite image output 21 must be made equal in order to equalize the size (enlargement ratio) in the composite image output 21. There is (xi+yi=Xn+
Yn; i, n are arbitrary integers). With this configuration, the transmitted light from the transmissive display device 22 is transmitted through each mirror 1.
After being reflected by 9 and 20, the light is transmitted repeatedly, but by aligning each transmissive display device 22 and synthesizing a plurality of low-definition displays, high-definition display becomes possible.

FIGS. 11 and 12 are illustrations of specific examples of image data display in FIG. 10. In FIG. 11, s indicates a video portion of continuous original images, and (a) to (d) indicate discretely extracted image data. Also, (A) to (D
) indicates the actual display state of (a) to (d), respectively. In (A) to (D), the shaded area on the right is the image area, and the white area is not the image area and is actually a dark area (ideally a dark area with no light). That is, this part corresponds to a dark part of the actual pixel that is not displayed, such as a black stripe, a wiring part, a light-shielding part, or the like.

FIG. 12 shows FIGS. 11(A), (B), (C),
This is a diagram in which the images in (D) are synthesized, and when their positions are adjusted and overlapped, (A) and (B) become (E). Similarly (
When the images in C) and (D) are superimposed on each other, it becomes (F). Furthermore, (E) and (F) are superimposed on each other (in the end, (A), (
B), (C) and (D) are superimposed on each other) and (G), and a projected image of the original image (s) can be obtained. This means that by using a plurality of displays with low definition, a display with higher definition (in this case, twice the definition) can be realized.

FIG. 13 shows an embodiment according to claim 8 of the present invention, and shows data complementation, which is one of the functions performed by the display control section 51 shown in FIG. In FIG. 13, 24 is original data as input, which is illustrated at a resolution of 3×3. Reference numeral 53 denotes an operator unit that performs the interpolation process, and 25 represents the result of the interpolation process to generate high-definition data. In FIG. 13, luminance values are shown as examples of video data values. The operator unit 53 generates complementary data using an interpolation algorithm based on the original data 24. Note that the portion of the generated data 25 indicated by a thick frame is the original data 24. By doing so, even if the definition of the original data is low (the amount of transmitted information is small), high-definition data can be generated by interpolation, and high-definition display can be achieved.

FIG. 14 is a diagram illustrating the operation of the display system control section 51 and the high-definition display 52. In FIG. 14, 26 to 29 are a group of low-definition display data taken discretely, and 51 is a display system control unit for performing complementation processing and display control. 34 to 39 are display examples. Here, 34 is an example in which sampled low-definition video data is displayed on an arbitrary part of the display divided into four parts. 35 is an example in which low-definition data is displayed in the center of the display. 36 is an example in which four pieces of low-definition data are aligned as desired and displayed in high-definition. 37 is an example in which only the central part of the high-definition original image is displayed in order to reduce the amount of transmitted information. 38 is an example in which a high-definition still image is used as a background, and an arbitrary low-definition image is displayed on top of the background. 3
9 is an example in which arbitrarily sampled video data is simply displayed overlappingly on the display. Since the display is capable of high-definition display in this way, it is possible to realize a variety of displays from low-definition display to high-definition display.

[0026] In the above explanation, the video data was described as being generated from the imaging unit, but the video signal source may also be a video signal that has been recorded in advance on a VTR, optical disc, etc. Needless to say, this method can be easily implemented even when a plurality of video sources, low-definition video sources, etc. coexist. For example, multiple NTSC video signal sources and HD
Divide the TV video signal into multiple parts by thinning out, etc., and divide each into N
Using the TSC video signal source, it is possible to perform various display controls by arbitrarily selecting these sources.

Note that the high-definition signal is an NTSC video signal, and the low-definition signal is F-CIF (compliant with CCITT recommendations).
Full-Common Intermediate
Format) signal, Q-CIF (Quarter-C
ommon Intermediate Format
) It goes without saying that the present invention also includes a display system assuming a signal. It goes without saying that each control means may have a recording function.

[0028]

Effects of the Invention As explained above, the display system of the present invention enables high-definition imaging by using a plurality of normal-definition imaging sections that do not depend on special specifications (claims 1 to 4). , 6). When trying to capture an image by reducing the definition of the subject due to the relationship between the transmission unit and display unit, it is sufficient to simply extract and transmit arbitrary video data without any special processing, which reduces hardware and simplifies processing. (Claims 1 to 4, 7, and 8). Furthermore, by preparing a plurality of lines for the transmission section depending on the situation, flexible display such as high-definition display and moving image display is possible (claims 1 to 5). Currently commonly used NTSC video signals and future HDT
Compatibility with V-based video signals is ensured, and flexible control and a variety of display services are possible (especially claim 4,
5). In addition, since high-definition video data is generated by performing complementary processing on the video data itself, high-definition display is possible without imposing a burden on the transmission section, etc. (Claims 3 and 5)
8).

[Brief explanation of the drawing]

FIG. 1 is a block diagram of an embodiment according to claim 1 of the present invention.

FIG. 2 is a block diagram showing a specific example of FIG. 1;

FIG. 3 is a diagram showing the relationship between the subject in FIG. 2 and the imaging output of each imaging system.

FIG. 4 is a block diagram of an embodiment according to claim 2 of the present invention.

FIG. 5 is a block diagram of an embodiment according to claim 3 of the present invention.

FIG. 6 is a conceptual diagram illustrating the operation of the operator section in FIG. 5;

FIG. 7 is a block diagram of an embodiment according to claim 4 of the present invention.

FIG. 8 is a block diagram of an embodiment according to claim 5 of the present invention.

FIG. 9 is a diagram showing a configuration diagram and a composite signal of an embodiment according to claim 6 of the present invention.

FIG. 10 is a configuration diagram of an embodiment according to claim 7 of the present invention.

FIG. 11 is an explanatory diagram of a specific example of image data display in FIG. 10;

FIG. 12 is a diagram in which the images in FIG. 11 are combined.

FIG. 13 is a diagram of an embodiment according to claim 8 of the present invention.

FIG. 14 is a diagram illustrating the operation of a display system control unit and a high-definition display.

FIG. 15 is a schematic block diagram showing an example of a conventional display system.

[Explanation of symbols]

1,15A to 15D...imaging section, 3...transmission section, 5
...Display section, 6...Subject, 111, 112...11
N... Imaging system, 12... Imaging system control unit, 13... One image capturing, 131, 132... 13N... Imaging system output, 14... Image distribution unit, 141-143... Semi-transparent mirror, 144... Total reflection mirror, 16 ...Sensor part, 17...
Sensor element section, 18... Non-photosensitive section, 19... Total reflection mirror, 20 (201, 202...20n)... Half mirror, 21... Composite image output, 22 (221,
222, 223...22n)...transmissive display device,
23 (231, 232, 233...23n)...Light supply unit, 24...Original data, 25...High definition data,
26-29...Low definition display data, 31...Transmission system control unit, 311,322...32N...Transmission channel, 34-39...Display example 51,511,51
2... Display system control section, 52, 521, 522... Display, 53... Operator section.

Claims (8)

[Claims] Claim 1: A means for discretely extracting and imaging different parts of one image in each of a plurality of imaging systems, and a transmission channel corresponding to the output of the plurality of imaging systems in the imaging means. means for transmitting the video signal imaged by the imaging means; and means for synthesizing the discretely extracted video signals transmitted through each transmission channel in the transmission means to display one original video. A display system characterized by: 2. Means for discretely extracting and capturing images of different parts of one image in each of the plurality of imaging systems, and time-sharing transmission channels fewer than the number of the plurality of imaging systems in the imaging means. a means for transmitting a video signal imaged by the imaging means, and a means for transmitting a video signal imaged by the imaging means, and a video signal whose pixels have been thinned out and transmitted in a time-division manner through each transmission channel of the transmission means are combined to display one original video. A display system comprising means for. [Claim 3] It has a single or plural imaging systems, and when imaging is performed with a single imaging system, one image is discretely extracted and imaged, and when imaging is performed with multiple imaging systems, each imaging system means for discretely extracting and imaging different parts of one video, and video signals captured by the imaging means having one or more imaging systems, respectively, using one or more transmission channels. It has a means for transmitting a video signal imaged by the imaging means, and a means for calculating and combining the video signals leaked from the discrete extraction of the video signals transmitted by the transmission means and displaying one video. A display system featuring: [Claim 4] A video with a definition of HDTV level is targeted as one video, each discretely extracted video is taken as a video with a definition of NTSC level, and the image capturing side uses HDTV.
4. The display system according to claim 1, further comprising switching means for performing V level imaging and displaying an HDTV level or NTSC level on the display side. [Claim 5] A single image is targeted, and the imaging side captures a coarse image with a definition of the NTSC level, and the display side increases the definition to the HDTV level through processing such as calculation and displays it. A display system according to claim 1, claim 2, or claim 3. 6. The image forming apparatus according to claim 1, further comprising a means for discretely extracting and imaging different parts of one image by combining one or more half mirrors and a plurality of video cameras. The display system according to claim 2 or claim 3. [Claim 7] Claims 1 and 2 are characterized by comprising means for displaying images in a superimposed manner using a plurality of projection displays.
Or the display system according to claim 3. [Claim 8] When computing the video information that has leaked from discrete extraction, the video information of the pixels that have leaked from extraction is calculated from the average value of the extracted video information of adjacent pixels and synthesized into one video. 4. The display system according to claim 3, further comprising means for displaying.