JPH06197337A - Image transmission equipment - Google Patents

Abstract

(57) [Summary] [Purpose] To obtain an inexpensive image transmission device capable of efficiently transmitting information such as moving images, still images, and graphics in a video conference terminal device and a multimedia terminal using the same line, and performing multiple display. With the goal. [Configuration] Gate circuits 12 and 13 are provided at the input portions of the transmission frame memory 3 and the reception frame memory 4 to prohibit writing in areas other than the specific area, and to the encoder 5 to set encoding parameters inside and outside the specific area. The system control unit 11 that controls independently is provided, and the encoding suitable for the moving image / still image is performed according to the screen multiplexing state (parent-child screen) in the screen synthesis separating unit 10. [Effect] The moving image and the still image are multiplexed on the frame memory on the transmitting side, and the moving image area and the still image area are encoded in the encoder in accordance with their respective characteristics. Plays back and displays as if multiple images were displayed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to moving images and
The present invention relates to a video conference system for transmitting a conference by transmitting voice / data and the like, and a multimedia system for multiplex display of moving images / still images / graphics on the same monitor.

[0002]

2. Description of the Related Art FIG. 8 is a block diagram of a moving picture window system disclosed in, for example, Japanese Patent Publication No. 4-26273, and FIG. 9 is a block diagram showing a conventional video conference apparatus. FIG. 10 is an explanatory diagram showing an example of multiple display by the circuit of FIG. In FIG. 8, 1 is an A / D converter, 2 is a D / A converter, 31 and 32 are moving image frame memories, 33 is a still image frame memory, 9 is a drawing controller, and 1 is a drawing controller.
2, 13, 15, and 16 are gates, 14 is a moving image memory control unit, 17 is a sync separation unit, and 18 is a memory read control unit. In FIG. 9, 1 is an A / D converter, 2a and 2b.
Is a D / A converter, 3 is a transmission frame memory, 4 is a reception frame memory, 5 is an encoder (CODER), 6 is a decoder (DECODER), 7 is a multiplexing / demultiplexing unit, 8 is a line interface unit, Reference numeral 10 is a screen composition / separation unit having a built-in video switch for selecting an input image, and 11 is a system control unit for controlling switching / displaying of images.

Next, the operation will be described. FIG. 9 is a block diagram showing a configuration of a general conventional video conference terminal device, and FIG. 8 is used for an input / output unit of a video conference terminal device as shown in FIG. 9 and an input / output unit of a multimedia terminal. It is a block diagram which shows a moving image window system. In FIG. 9, moving image data and still image data are time-divisionally transmitted using a common transmission frame memory 3 and encoder 5, separated by a decoder 6 on the receiving side, and received frame memories (moving images) 4a, respectively. , Is reproduced on the reception frame memory (still image) 4b and is displayed separately, or is displayed on a single screen as shown in FIG. 10 by the circuit shown in FIG. 10A is an example in which each part of the two moving images in the moving picture frame memories 31 and 32 in FIG. 8 is cut out and displayed in multiple, and FIG. It is an example of multiple display on the screen.

[0004]

Since the conventional video conference terminal device and multimedia terminal are configured as described above, it is necessary to separately provide a moving picture frame memory and a still picture frame memory. In the case of transmitting a still image, it has to be transmitted in a time division manner on the same line or by a plurality of transmission lines. Further, even if the transmitted video information is transmitted with care, only a part of the transmitted video information is cut out and displayed, which results in a waste of transmission time.

The present invention has been made to solve the above problems, and is an inexpensive image transmission apparatus capable of efficiently transmitting information such as moving images, still images, and graphics using the same line and performing multiple display. Aim to get.

[0006]

An image transmission apparatus according to the present invention is provided with a gate circuit at an input portion of a transmission frame memory and a reception frame memory to prohibit writing in areas other than a specific area and to specify to an encoder. Equipped with an encoder / system control unit that can control the encoding parameters inside and outside the area independently, and performs encoding suitable for moving images / still images according to the screen multiplexing state (parent-child screen) in the screen combining / separating unit. It is configured as follows.

In particular, the image transmission device according to the first invention is
Video and still images do not have to be provided separately for video frame memory and still image frame memory, and can be transmitted and displayed with one frame memory and over the same line. Video area and still image area Are separated by a gate circuit so that a moving image and a still image can be mixed in one frame memory so that they can be encoded or decoded.

In the image transmitting apparatus according to the second invention, in the first invention, since the moving image and the still image are separated into a specific area, the amount of coded information for the moving image is further increased. In this way, the encoder is controlled so that the amount of encoded information is reduced in the still image area.

In the image transmission device according to the third aspect of the invention, the moving image area and the still image area are not preset, but based on designation from an external input device such as a tablet,
The feature is that the area can be arbitrarily designated.

An image transmitting apparatus according to a fourth aspect of the present invention is the first aspect.
In contrast to the case where the image transmission device according to the invention is a moving image and a still image, the moving image and the drawing information such as graphics are displayed by designating respective areas, and the moving image is stored in the transmission frame memory. It is written in a predetermined area, and the encoded information and drawing information are multiplexed and transmitted. In addition, the receiving side decodes the received moving image information into a predetermined area, and the drawing information control unit draws in the received frame memory based on the received drawing information.

[0011]

In the image transmitting apparatus according to the first aspect of the present invention, since the moving image and the still image are multiplexed on the frame memory on the transmitting side by the gate circuit, the image is reproduced and displayed as if the two images were multiplexed on the receiving side. .

The image transmission device according to the second invention is
The amount of generated information can be changed according to the characteristics of the moving image area and the still image area by controlling the encoding in the encoder according to the characteristics, so that the optimum image transmission according to the characteristics of the input image is possible. Do.

The image transmission apparatus according to the third invention is
When applying to surveillance applications, etc., an area with a particularly large amount of movement in the video is designated as a specific area by an external input device, and control is performed to increase the amount of generated information only in that area, so that it is optimal for the characteristics of the input video. Video transmission.

The image transmission device according to the fourth invention is
Instead of moving images and still images, moving images and graphic drawing information of a personal computer are multiplexed and transmitted, so that a moving image window screen in which a moving image small screen is multiplexed on a still image graphic screen can be transmitted and displayed.

[0015]

EXAMPLES Example 1. An embodiment of the present invention will be described below with reference to the drawings. In FIG. 1, 1 is an A / D converter, 2
Is a D / A converter, 3 is a transmission frame memory, 4 is a reception frame memory, 9 is a drawing control unit, 12 and 13 are gate circuits, 5 is an encoder (CODER), and 6 is a decoder (DE).
(CORDER), 7 is a multiplexing / separating unit, 8 is a line interface unit, 10 is a screen synthesizing / separating unit having a built-in picture egress (PinP) circuit for multiplexing an input video signal on a parent-child screen, and 11 is a video switching / display, This is a system control unit that controls area-specific coding parameters and the like.
Note that the transmission frame memory 3 and the reception frame memory 4 are memory blocks (M
It is assumed that the processing unit is called B).

FIG. 2 is an explanatory diagram showing an example of a multiple display screen according to an embodiment of the present invention. In the figure, (a) is an example in which graphic drawing information of a personal computer or the like is multiplexed and transmitted as low-speed data information and is multiplexed and displayed with a moving image. (B) is an example in which moving images and still images multiplexed by PinP are collectively transmitted and displayed. (C) is an example of performing area-by-area coding by designating an area in which the surveillance video moves rapidly.

FIG. 3 is a diagram showing an example of in / out data of the gate 12. The gate 12 has three modes of (1) through mode, (2) freeze mode, and (3) partial update mode.
There are two modes. The through mode is a mode in which all input data is output to the transmission frame memory (FM) as it is, and is a mode used for normal video transmission. The freeze mode is a write-protection mode in which all input data is not output. That is, no input data is output to the transmission frame memory (FM). The partial update mode is a mode in which only writing to a designated area of the transmission frame memory is permitted, and in the case of writing to a portion other than the designated one, predetermined fixed data is written.

FIG. 4 is a diagram showing an example of in / out data of the gate 13. When the gate 13 operates, (1) through mode, (2) still image update mode, (3)
There are three modes: video update mode. The through mode is a mode in which the data input to the gate 13 is directly output to the reception frame memory (FM) and is a mode used for normal video transmission. In the still image update mode, the data input to the gate 13 is prohibited from being written in the designated area of the reception frame memory (FM) and is input to the outside of the designated area. This is a mode for outputting the selected video data. In the moving image update mode, the data input to the gate 13 is output to the inside of a designated area of the reception frame memory (FM), and writing is prohibited to the outside of the designated area. The still image update mode and the video update mode described above are divided into modes depending on whether the inside of the specified area is updated or the outside is updated, and it is assumed that the video is displayed inside the specified area. There is. Therefore, updating the inside of the designated area is called the moving image updating mode, and updating the outside of the designated area is called the still image updating mode.

Next, the operation will be described. Figure 2 (a)
The case is shown in FIG. The system control unit 11 on the transmission side
First, an area to be a moving image is specified, and encoding parameters inside and outside the area are set. For example, the parameters are set differently for the PinP small screen and other portions. This area designation is performed for each memory block (MB) of the transmission frame memory 3, and the encoder 5 performs encoding according to the parameters set for each memory block.

Further, the receiving side system control unit 11 similarly designates an area by using the memory block (MB), and sets parameters for decoding to the memory block (MB) inside and outside the designated area. Set each separately. For example, the parameters are set differently for the PinP small screen and other portions. The DECODER 6 decodes the received code by the memory block (MB) according to the parameters set for the designated area.

Next, the system control unit 11 on the transmission side controls the gate 12 to be in the partial update mode. Further, the receiving side system control unit 11 controls the gate 13 so as to enter the moving image update mode.

After such initial setting is performed, the input image of the moving image / still image is input as shown in (a-1) by the PinP circuit of the screen combining / separating unit 10 in FIG. When this input image is written to the transmission frame memory 3 through the A / D converter 1, the gate circuit 12 is set to the partial update mode, so that the data other than the moving image area is fixed data such as (a-2). Control so that only the filled video data is updated. The gate circuit 12 decodes the write address to the transmission frame memory, the encoded data is passed as it is to the preset address area (moving image area), and the gate 12 selects fixed data writing in the other areas. .

The encoder 5 is generally an international standard CCITT.
H. Since even the H.261 can control the encoding parameter in the unit of the minimum pixel block, the information is controlled to be generated only in the moving image area. Next, drawing information from a personal computer or the like is input in the multiplexing / separating unit 7, multiplexed with encoded data, and transmitted to the partner station via the line interface unit 8.

Data outside the moving image area is controlled by the parameter setting of the encoder 5 so as to reach the information generation amount. However, if fixed data is set, the encoding efficiency is further improved, and a lot of moving image data is included. Information can be assigned.

The receiving side separates the received data, and the decoder 6 restores the image as shown in (a-2). Further, the drawing control unit 9 develops a graphic pattern on the reception frame memory 4 from the drawing information received at the same time.

The drawing control unit 9 sends LSD and HS from the partner station.
The drawing information (graphic command or the like) multiplexed and transmitted as data such as D is separated by the multiplexing / separating unit 7, and the graphic pattern is received in accordance with this information in the reception frame memory 4
Expand to the top. The reception frame memory 4 is a 2-port memory, and data can be written from two systems of the drawing controller 9 and the gate circuit 13. Since the gate circuit 13 is set to the moving image update mode, only moving image information is written in the reception frame memory. The gate circuit 13 decodes the write address to the reception frame memory, passes the decoded data as it is in the preset address area (moving image area), and in the other areas, the gate 13 prohibits data writing (HighZ).
Select. The drawing control unit 9 writes the drawing data in the area of the reception frame memory 4 which is write-protected by the gate 13. In this way, a multiple screen as shown in (a-3) is obtained.

The system controller 11 has a function of matching the operation modes of both stations. For example, in the case of FIG. 2A, the mode operation start of FIG. 2A is declared between the system control of both stations by END to END information, MLP, etc., and the operation is transmitted to the gate circuits 12 and 13, respectively. ,
In accordance with the drawing operation, a mode indicating an operation state such as a through mode and a partial update mode (data writing only in the moving image part) is set. Basically, the system control unit 11 designates an operation mode for the gate circuit. Then, the actual dynamic gate operation for the write data / address is controlled in the gate circuit.

The case of FIG. 2B is shown in FIG. The transmission side system control unit and the reception side system control unit separately specify the area for the PinP small screen and other portions, and specify parameters for encoding for each memory block (MB) of the frame memory belonging to the area. Alternatively, the parameters to be decrypted are set. When transmitting / updating a moving image to the gate circuit 12, the transmission side system control unit 11 specifies a new minute update mode in which only moving image data is updated, and when transmitting / updating a still image, a freeze mode is set. Is specified. By doing so, the moving image is not written in the transmission frame memory 3 and the still image can be transmitted.

On the other hand, the system controller 11 on the receiving side designates the still image update mode to the gate 13 when a still image is transmitted. When the system controller 11 on the transmission side transmits a still image in such a state, only the still image area is updated in the reception frame memory 4 on the reception side.

Next, the system control unit 11 on the transmission side designates the partial update mode to the gate 12, and the system control unit 11 on the reception side designates the moving image update mode to the gate 13 to display the moving image. It becomes possible to transmit and update the video. In this case, fixed data is transmitted outside the designated area, but since the moving image update mode is designated for the gate 13, writing outside the designated area is prohibited and the reception frame memory Still images are retained. Further, when transmitting a moving image and a still image, data such as (b-2) is stored in the transmission frame memory 3,
Performs encoding control for each moving image / still image area and sends it to the other party (b-
Transmit multiple screens such as 3). As described above, the system control unit sets the parameters by changing the parameters inside or outside the designated area, so it is possible to perform encoding for each moving image or still image, and it is possible to improve the encoding efficiency. Is.

The case of FIG. 2C is shown in FIG. The system control unit 11 designates the gate 12 and the gate 13 in the through mode. Further, the system control unit 11 designates an area and sets parameters for encoding or decoding separately for inside and outside of the area. For example, a specific area is designated by the tablet 14 as shown in (c-3), and an area having a large amount of movement as shown in (c-2) is controlled so that the amount of coded information generated is increased as compared with other areas. That is, the specific area in this case is an area in which the movement is heavy like a river, and the system control unit 11 more faithfully encodes the area in which the movement is strong, and the background such as other backgrounds is stationary. The parameters are set so that the amount of encoded information is reduced in the image portion.

As described above, the image transmission apparatus according to the above-described embodiment uses the encoder (C
ODER), decoder (DECODER), and graphic drawing information of a personal computer, etc. are multiplexed as low-speed data /
The demultiplexing / demultiplexing unit, the drawing control unit for reproducing / displaying the received drawing control information, and the gate circuit for prohibiting the writing of data other than the moving image in the transmission / reception frame memory are provided.
The feature is that a moving picture window screen in which a small moving picture screen is multiplexed on a still picture graphic screen can be transmitted and displayed by the frame memory for one sheet.

Further, the image transmission apparatus in the above-described embodiment is a PinP that synthesizes analog video input signals of two systems of moving image and still image into the same screen image signal (moving image window).
Circuit, multi / split screen circuit etc. built-in screen synthesizing / separating section, and an encoder that can control the encoding parameters in pixel block units, more encoding information is generated only in the moving image area in the transmission frame memory, It is characterized in that the system control unit controls so that a moving image with high motion reproducibility or high image quality can be sent.

Further, a system control unit to which an external coordinate input device such as a tablet can be connected is provided, and the coding parameters of an arbitrary area on the screen are arbitrarily set to further improve the motion reproducibility or the image quality compared to other areas. The encoding is controlled as follows.

Example 2. In the above embodiment, an example in which the screen synthesizing / separating unit 10 multiplexes the parent-child screen with the PinP circuit is shown. However, a multi-screen circuit other than the PinP circuit,
Screens may be combined / separated by a split screen circuit.

Example 3. In the above embodiment, the case where one system of moving image data and one system of still image or graphic data are multiplexed and transmitted / displayed is shown. However, a plurality of systems of moving images and a plurality of systems of still images or a plurality of systems of still images are displayed by cascade connection of PinP circuits. An apparatus for multiplexing / transmitting / displaying graphic data can be configured.

[0037]

As described above, according to the present invention, the image transmission apparatus is configured to multiplex input of moving images / still images, and to control the encoding for each moving image / still image area in the screen and to transmit.
This has the effect of efficiently multiplexing / transmitting / displaying moving images / still images on the system transmission line. In addition, since a gate circuit is provided at the input part of the transmission / reception frame memory to normally update only moving image information, there is an effect that a device capable of simply and inexpensively transmitting various kinds of image information with only one transmission / reception frame memory is obtained. is there.

Further, according to the present invention, it is possible to obtain an image transmission apparatus capable of transmitting a highly efficient surveillance video in which a portion having a large amount of movement is optimized by designating a specific area.

Further, according to the present invention, not only a moving image / still image but also an image based on moving image / drawing information can be multiplexed and displayed.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an image transmission device according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a multiple display screen according to an embodiment of the present invention.

FIG. 3 shows the gate of the gate in / out according to one embodiment of the present invention.
It is a figure which shows an example of out data.

FIG. 4 shows the gate of the gate 13 in / out according to an embodiment of the present invention.
It is a figure which shows an example of out data.

FIG. 5 is a diagram showing an example of operations of a system control unit and a drawing control unit according to an embodiment of the present invention.

FIG. 6 is a diagram showing an example of operations of a system control unit and a drawing control unit according to an embodiment of the present invention.

FIG. 7 is a diagram showing an example of operations of a system controller and a drawing controller according to an embodiment of the present invention.

FIG. 8 is a block diagram showing a conventional moving image window method.

FIG. 9 is a block diagram showing a configuration of a conventional image transmission device.

FIG. 10 is an explanatory diagram showing a multiple display screen according to a conventional moving image window system.

[Explanation of symbols]

 1 A / D converter 2 D / A converter 3 Transmission frame memory 4 Reception frame memory 5 Encoder (CODER) 6 Decoder (DECODER) 7 Multiplexing / separating section 8 Line interface section 9 Drawing control section 10 Screen composition Separation unit 11 System control unit 12 Gate circuit 13 Gate circuit 14 Video memory control unit 15 Gate circuit 16 Gate circuit 17 Sync separation unit 18 Memory read control unit 31 Video frame memory 32 Video frame memory 33 Still image frame memory

Claims (4)

[Claims] 1. An image transmission apparatus having at least one of the following transmitting section and receiving section: (a) a transmitting section having the following elements, (a1) image input means for inputting a moving image and a still image, (a2) above A transmission frame memory for storing a moving image and a still image input from the image input means, (a3) provided between the image input means and the transmission frame memory, and selectively passes the moving image and the still image input by the image input means. Transmission gate means, (a4) transmission control means for designating a moving image area and a still image area in the transmission frame memory, and controlling the transmission gate means to store a moving image and a still image in the designated area, (a5) Transmission means for transmitting the information of the moving image and the still image stored in the transmission frame memory, (b) a receiver having the following elements, (b1) transmitted Receiving means for receiving the information of the moving image and the still image, (b2) A receiving frame memory for storing the moving image and the still image received by the receiving means, and (b3) A receiving frame memory provided between the receiving means and the receiving frame memory for receiving. Receiving gate means for selectively passing a moving image and a still image received by the means, (b4) designating a moving image area and a still image area in the receiving frame memory, and controlling the receiving gate means to designate the moving image area and the still image area. Reception control means for storing moving images and still images in the area, (b5) Output means for outputting information of moving images and still images stored in the reception frame memory. 2. The transmission section further comprises an encoding means for encoding information of a moving picture and a still picture in the transmission frame memory between the transmission frame memory and the transmission means, and the transmission control section has a moving picture area. 2. The image transmission device according to claim 1, wherein the encoding means is controlled so that the amount of encoded information is changed depending on the still image area. 3. The transmission control unit, when designating a moving image area and a still image area in the transmission frame memory, designates a moving image area and a still image area at an arbitrary position and in an arbitrary size based on designation from an external input device. The image transmission device according to claim 2, wherein the image transmission device is capable of being formed. 4. An image transmission apparatus having at least one of the following transmitting section and receiving section: (a) a transmitting section having the following elements, (a1) image input means for inputting a moving image, (a2) the image input means A transmission frame memory that stores a moving image input from (a3) a transmission gate unit that is provided between the image input unit and the transmission frame memory to selectively pass the moving image input by the image input unit; (a4) the transmission Transmission control means for designating a moving picture area in the frame memory and controlling the transmission gate means to store the moving picture in the designated area, (a5) drawing information input means for inputting drawing information, (a6) the transmission frame Transmitting means for multiplexing and transmitting the moving image information stored in the memory and the drawing information input by the drawing information input means, (b) having the following elements (B1) receiving means for receiving the transmitted moving image information and drawing information, (b2) drawing control means for drawing based on the drawing information received by the receiving means, and (b3) receiving by the receiving means. A receiving frame memory for storing the moving image and the image drawn by the drawing control means, and (b4) receiving gate means provided between the receiving means and the receiving frame memory for selectively passing the moving image received by the receiving means, (B5) Reception control means for designating a moving picture area in the reception frame memory and controlling the reception gate means to store the moving picture in the designated area, (b6) Moving picture stored in the reception frame memory Means for outputting the information of.