JPH09200723A - Video conference terminal equipment - Google Patents

Abstract

(57) 【Abstract】 PROBLEM TO BE SOLVED: To provide a video conference terminal device capable of checking at a glance where a received video is, without requiring a special communication procedure for multipoint video conference communication. . In a video conference terminal device having a function of performing a video conference with a plurality of other video conference terminal devices via a communication line and a multipoint conference control device, self-terminal identification information, conference participant names, etc. Own terminal information registration means (DRAM 10a) for registering its own terminal information as display information to be combined with the image of the own terminal, and own terminal information registered in the own terminal information registration means for the multipoint conference control device. And a self-terminal information synthesizing means (superimposing circuit 10b) for synthesizing the image of the self-terminal transmitted to the terminal.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video conference terminal device of a video conference system, and more particularly to a video conference between a plurality of other video conference terminal devices via a communication line and a multipoint conference control device. The present invention relates to a video conference terminal device having a function.

[0002]

2. Description of the Related Art In a conventional video conference system, as shown in FIG. 15, a television (TV) conference terminal device A1 is used.
(Tokyo), TV conference terminal device A2 (Osaka), TV conference terminal device A3 (Nagoya), TV conference terminal device A4
(Sendai) are ISDN digital lines L1 to L, respectively.
It is assumed that multipoint video conference communication is being performed via the multipoint conference control unit 4 and the multipoint conference control unit MCU. Each TV conference terminal device A1
To A4 are remote conference terminal devices B1 to B4 which are the device bodies
In addition, TV cameras C1 to C4 for video input, TV monitors D1 to D4 for video output, operation keypads E1 to E4 for controlling the TV conference terminal device, etc. are connected. In the above TV conference environment, the video of the speaker is displayed on the TV monitors D1 to D4 of the respective TV conference terminal devices A1 to A4. For example, when a conference participant of the TV conference terminal device A1 speaks, the multipoint conference control device MCU detects that the audio level from the TV conference terminal device A1 has risen, and automatically the TV of the TV conference terminal device A1. The image sent from the camera C1 is distributed to the TV conference terminal devices A1 to A4 of each conference participant.

[0003]

However, in such a conventional video conference system, when there are many participants in each TV conference terminal device or when the discussion is heated, each TV conference system becomes inconvenient.
The video displayed on the conference terminal device was frequently switched, and it was sometimes difficult to know who was displayed. Prior art (for example, Japanese Patent Laid-Open No. 5-115062)
Japanese Patent Laid-Open No. 5-145918, Japanese Patent Laid-Open No. 5-2918
No. 07459, etc.), each participant information is displayed on each video conference terminal device by using a special communication procedure for multipoint connection. Since a special protocol for connection has to be provided, compatibility of each video conference terminal device may be a problem.

Therefore, the present invention has been made in order to solve such a problem, and which video is received without requiring a special communication procedure for multipoint video conference communication. It is an object of the present invention to provide a video conferencing terminal device that enables the user to check at a glance.

[0005]

In order to achieve the above-mentioned object, the invention according to claim 1 of the present application provides a communication between a communication line and a plurality of video conference terminal devices via a multipoint conference control device. In a video conference terminal device having a function of performing a video conference in, a self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with video of the self-terminal, And a self-terminal information synthesizing means for synthesizing the self-terminal information registered in the self-terminal information registration means with a video image of the self-terminal transmitted to the multipoint conference control device.

The invention according to claim 2 has a function of conducting a one-to-one video conference with another video conference terminal device via a communication line, and another function via a communication line and a multipoint conference control device. In a video conference terminal device having a function of performing a video conference with a plurality of video conference terminal devices, register the self terminal information such as self terminal identification information and conference participant name as display information to be combined with the video of the self terminal. When the own terminal information registration means and the destination of the call are multipoint conference control devices, the own terminal information registered in the own terminal information registration means is displayed on the image of the own terminal transmitted to the multipoint conference control device. It is provided with a self-terminal information synthesizing means for synthesizing.

The invention according to claim 3 is a video conference terminal device having a function of performing a video conference between a plurality of other video conference terminal devices via a communication line and a multipoint conference control device, Self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with the video of the self-terminal, and registration in the self-terminal information registration means based on operation input information It is provided with a self-terminal information synthesizing means for synthesizing the generated self-terminal information with an image of the self-terminal transmitted to the multipoint conference control device.

According to a fourth aspect of the present invention, there is provided a video conference terminal device having a function of performing a video conference between a plurality of video conference terminal devices via a communication line and a multipoint conference control device. Self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with the video of the self-terminal, and the self-terminal information when the conference participant of the self-terminal speaks. It is provided with own terminal information synthesizing means for synthesizing the own terminal information registered in the registration means with the image of the own terminal transmitted to the multipoint conference control device.

[0009]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of a video conference terminal device according to each invention of the present application. The video conference terminal device A according to the present embodiment includes a remote conference terminal device B, which is a main body of the device, a display LCD, a writing pad WP, a TV camera C and its control unit CC, a TV monitor D, and a speaker S. , Mike M and Digital Public Network I
SDN, hard disk HD, keyboard KB,
The G3 facsimile terminal device FAX is connected to the RS232C cable CB and the like.

The remote conference terminal device B has a system bus 1, a display memory (VRAM) 2, a graphic controller 3, a CPU 4, a DMA controller (DMAC) 5, and an interrupt controller (INTC).
6, a memory unit 7, a serial interface (I /
F) 8,9, video control unit 10, LAPD unit 11
A LAPB unit 12a, 12b, a media multiplexer 13, an ISDN interface (I / F) 14,
SCSI unit 16 and serial interface (I /
F) 18, modem 20, and extension interface (I /
F) 21, an HDLC (high level data link control) unit 23, and an RS232C interface (I /
F) 24, a compression / decompression unit (DCR) 25, and the like.

The display LCD is connected to the graphic controller 3 via the VRAM 2 and is used to display image information such as conference material originals and facsimile originals, other conference information, and system management information. To be Writing pad WP is a serial I / F
8 is used for system operation, operation for writing image information such as conference material manuscript and facsimile manuscript displayed on the display LCD, and telewriting service during a meeting.

The CPU 4 executes various processes such as a control process of each part of the device, an upper layer process of the video conference communication, and an execution process of various application programs of the device. Further, the CPU 4 also executes the characteristic processing of each invention shown in the flowchart described later. The DMAC 5 controls direct memory access performed without going through the CPU 4, and IN
The TC 6 controls various interrupt processes. The memory unit 7 is a ROM for storing the control processing program executed by the CPU 4 and various data necessary for its execution.
(Read-only memory) and RAM (random access memory) in which a work area for program execution is formed.

The video control unit 10 inputs an analog image from the TV camera C connected to the video input or an analog image from an external device such as another TV camera or VTR, and converts it into digital image information. To output to the media multiplexing device 13 or to convert digital video information demultiplexed by the media multiplexing device 13 into analog video and output to the TV monitor D connected to the video output. . Also, this video control unit 10
Has a superimposing function for realizing each invention of the present application, and its internal configuration will be described later in detail. The camera control unit CC is connected to the serial I / F 9 via the camera control cable, and is connected to the remote conference terminal device B.
To control pan, tilt, zoom, preset, etc. of the TV camera C.

The speaker S and the microphone M are connected to the media multiplexer 13 and used for inputting and outputting voice information during a conference. The digital public network ISDN is connected to the media multiplexer 13 and L via the ISDN interface 14.
Connected to the APD unit 11 and the LAPB units 12a and 12b,
Conference communication (multimedia communication using H221)
It is also used for G4 facsimile communication and G3 facsimile communication.

The hard disk HD is connected to the SCSI unit 16 and is used for registering document information used in G3 facsimile communication and G4 facsimile communication, registration of conference material used in conference communication, and registration of other management information.
The keyboard KB is connected to the serial I / F 18 and is used for inputting character information, key operation information and the like to be displayed on the display LCD or the like.

The extension G3 facsimile terminal device FAX is
It is connected to the modem 20 via the extension I / F 21 and is used for inputting manuscript information used in G3 facsimile communication and G4 facsimile communication, outputting manuscript information received in G3 facsimile communication and G4 facsimile communication, and used in conference communication. It is used to input conference materials and output other management information. Although the G3 facsimile apparatus is the input / output external apparatus in the embodiment of the present invention, the scanner apparatus and the printer apparatus may be the input / output external apparatuses. RS232C
The interface 24 and the RS232C cable CB are
It is used for exchanging conference information and the like during a conference with an external device. The DCR unit 25 performs coding compression and decoding expansion processing of image data.

The teleconferencing terminal device B configured as described above has a T input to the video input and the video output of the video control unit 10.
By connecting an external device such as the V camera C or the TV monitor D, the TV conference terminal device can be configured (the TV conference terminal devices A1 to A3 in FIG. 3). Further, the remote conference terminal device B connects the external device such as the TV conference device to the RS232C interface 24 without connecting the external device such as the TV camera or the TV monitor to the video input or the video output of the video control unit 10. By
A TV conference terminal device can be configured (TV of FIG. 3
Conference terminal devices A4 to A5). In the latter TV conference terminal device, the remote conference terminal device B does not execute media multiplex communication such as moving image information and audio information, but a graphic service using the display LCD or the writing pad WP via the RS232C interface 24. Only run.

FIG. 2 is a block diagram of a protocol stack installed in the remote conference terminal device B. The protocol stack of the remote conference terminal device B includes a protocol stack on the D channel, a protocol stack on the B channel, a protocol stack on the extension interface, and
It is composed of a protocol stack on RS232C.

The protocol stack on the D channel is I
I430 that satisfies the SDN layer 1 function and Dch
It is composed of a Q921 satisfying the function of layer 2 of the above and a Q931 satisfying the function of the layer 3 of Dch.

The protocol stack on the B channel is B
Media multiplexing function (H
221), H242 that controls the media multiplexing function (H221), and G711 and G that satisfy the voice coding function.
722, G728, and H26 satisfying the image coding function
1 and X75 satisfying the Bch layer 2 function, Q922 core satisfying the data multiplex transfer function, and Q921.
LAP (Link Access Protocol) similar to
Q922 control that satisfies the control function and Bch layer 3
IS8208 that satisfies the function of Bch, T70 and X224 that satisfies the function of Layer 4 of Bch, and Layer 5 of Bch
T62 and X225 that satisfy the function of Bch, T73 and X226 that satisfy the function of layer 6 of Bch, T30 that controls the protocol of the G3 facsimile, C & I of the application that controls the protocol of the conference, and the telewriting protocol. TW of application to control
And BULK, an application that transfers information such as still image information and fax information in bulk, and G4FAX, an application that controls G4 fax communication.
3 G3F, an application that controls fax communication
It is composed of AX.

The protocol stack on the extension interface is a T3 that controls the G3 facsimile protocol.
0 and G3 FAX which is an application for controlling G3 fax communication.

The protocol stack on RS232C is
Q922 core that satisfies the data multiplex transfer function, and Q92
Q922 control that satisfies the LAP control function similar to that of No. 1, X224 that satisfies the Bch layer 4 function, and B
X225 that satisfies the function of layer 5 of ch, X226 that satisfies the function of layer 6 of Bch, C & I that is an application that controls the conference protocol, and TW that is an application that controls the telewriting protocol.
And BULK which is an application for transferring information such as still image information and fax information in bulk.

When executing the conference communication, the remote conference terminal device B uses H22 in the protocol stack shown in FIG.
H242 on 1 and G711 (G722 or G72
8), H261, Q922, and X224
, X225, X226, C & I, TW, BU
Use the LK protocol stack. C & I application Below X226, X225, X224,
Q922 is used when communicating remote camera control data, cursor data, and other conference control data.
X226 and X225 below the TW application,
X224 and Q922 are used when executing a telewriting service during conference communication. X226, X225, and X224 below the BULK application,
Q922 is used when transferring conference material during conference communication, transferring still image information, and transferring other digital information.

Further, when the remote conference terminal device B outputs the conference information to the RS232C, Q922 and X224 on the RS232C in the protocol stack shown in FIG.
, X225, X226, C & I, TW, BU
Use the LK protocol stack. C & I application Below X226, X225, X224,
Q922 is used when communicating remote camera control data, cursor data, and other conference control data.
X226 and X225 below the TW application,
X224 and Q922 are used when executing a telewriting service during conference communication. X226, X225, and X224 below the BULK application,
Q922 is used when transferring conference material during conference communication, transferring still image information, and transferring other digital information.

Further, when the remote conference terminal device B executes G4 facsimile communication, in the protocol stack shown in FIG. 2, Q921 and Q931 on the D channel,
X75 on the B channel, IS8208, T70,
T62, T73, and G4FAX protocol stacks are used.

Similarly, when the remote conference terminal device B executes the G3 facsimile communication, in the protocol stack shown in FIG. 2, Q921 and Q931 on the D channel are used.
, T30 on B channel and G3 FAX protocol stack are used.

Further, the remote conference terminal device B receives T30 on the extension interface in the protocol stack shown in FIG. 2 when inputting a document from the extension G3 facsimile terminal device FAX or outputting a document. Uses the G3 FAX protocol stack.

The remote conference terminal device B having the protocol stack configuration of FIG. 2 in addition to the hardware configuration of FIG.
The video conference terminal devices A1 to A5 as shown in FIG.
It is connected via the digital public network ISDN. TV
The conference terminal devices A1 to A3 are external devices (TV camera C / C) connected to the video interface of the video control unit 10.
A TV monitor D), an extension G3 facsimile terminal device FAX connected to the extension interface 21, a remote conference terminal device B of the main body, and the like. Further, the TV conference terminal devices A4 and A5 include an external device (TV conference device T) of the main body connected to the RS232C interface 24 and an extension G connected to the extension interface 21.
It is composed of three facsimile terminal devices FAX, a remote conference terminal device B dedicated to graphic operations, and the like. In addition,
Although not shown in FIG. 3, in the digital public network ISDN, as shown in FIG.
Also, the TV conference terminal device A has a function of performing a one-to-one video conference with another video conference terminal device A via the digital public network ISDN, and the digital public network ISDN.
And a function of conducting a video conference with a plurality of other video conference terminal devices A via the multipoint conference control unit MCU.

Here, various functions of this type of video conference system will be described before the description related to the gist of each invention of the present application. Since the function of the present invention is realized without requiring a special communication procedure for multipoint video conference communication, one-to-one video conference communication whose description is simple will be described.

For example, in order to conduct a conference communication from the TV conference terminal device A1 to the TV conference terminal device A2 in FIG. 3, first, the user of the remote conference terminal device B of the TV conference terminal device A1 writes a writing pad WP or a keyboard KB. Specify the telephone number of the TV conference terminal device A2 using the input device of
Make a call by conference communication. Next, the remote conference terminal device B of the TV conference terminal device A2 that has received the call notifies the user of the TV conference terminal device A2 of the incoming call by sounding a ring tone from the speaker S or displaying the incoming call on the display LCD. Next, when the user of the TV conference terminal device A2 answers the incoming call, the call is connected and the voice is opened. Next, the user of the TV conference terminal device A1 or the TV conference terminal device A2 designates the transfer of the moving image information by using the input device such as the writing pad WP or the keyboard KB, and makes a call by conference communication. Next, in the TV conference terminal device A1 or the TV conference terminal device A2 that has received the call, the incoming call of the moving image is displayed on the display LCD and the call is automatically connected to open the moving image information. After the above procedure, the audio information and the moving image information are opened, and T
A conference is held between the users of the V conference terminal device A1 and the TV conference terminal device A2.

During the conference communication, the TV conference terminal devices A1 and T
The user of the V conference terminal device A2 performs telewriting communication using the display LCD and the writing pad WP, or the users of the TV conference terminal device A1 and the TV conference terminal device A2 perform the writing pad WP or the keyboard K.
B to execute cursor communication, the user of the TV conference terminal device A1 and the TV conference terminal device A2 to execute remote camera control communication using the writing pad WP or the keyboard KB, and the TV conference terminal device A1 (TV The conference progress is supported by reading still image information or fax information from the extension G3 facsimile device FAX or the hard disk HD of the conference terminal device A2) and transferring it to the TV conference terminal device A2 (TV conference terminal device A1).

In order to transmit the conference material from the TV conference terminal device A1 of FIG. 3 to the TV conference terminal device A2 during the conference, first, the user of the TV conference terminal device A1 uses the extension G3 facsimile terminal device FAX or the hard disk HD. Read fax information and write pad WP
Attach an appropriate title name to the meeting material to be sent using an input device such as a keyboard or keyboard KB. Next, the user of the TV conference terminal device A1 uses the input device such as the writing pad WP and the keyboard KB to set the TV conference terminal device A2.
Then, the transmission of the conference material is started by the conference communication. In the TV conference terminal device A2, the received conference material is stored on the hard disk H.
Store in D. After transmitting the conference materials, the TV conference terminal device A1
The video conference terminal device A2 and the video conference terminal device A2 have conference materials having a common title name. The conference materials have a common title name, so that
Display on the LCD of the conference terminal device A2 at the same time,
Also, by executing the telewriting service, it is possible to add and correct at the same time.

In order to previously transmit the conference material used for the conference communication from the TV conference terminal device A1 to the TV conference terminal device A2, first, the user of the TV conference terminal device A1 uses the extension G3 facsimile terminal device FAX or the hard disk. The fax information is read from the HD, and an appropriate title name is attached to the conference material to be transmitted using an input device such as a writing pad WP or a keyboard KB.
Next, the user of the TV conference terminal device A1 designates the telephone number of the TV conference terminal device A2 by using the input device such as the writing pad WP and the keyboard KB, and makes a call by G4 fax communication. In the received video conference terminal device A2,
Answer the call automatically. When the call is connected, T
The transmission of the conference material is started from the V conference terminal device A1. T
The V conference terminal device A2 stores the received conference material in the hard disk HD. After the communication is completed, the TV conference terminal device A1 and the TV conference terminal device A2 have the conference material having the common title name. The conference materials distributed in advance are simultaneously displayed on the display LCDs of the TV conference terminal device A1 and the TV conference terminal device A2 during the conference communication, or used when executing the telewriting service.

In order to send a facsimile document from the TV conference terminal device A1 to the TV conference terminal device A2 except when the conference is being held, first, the user of the TV conference terminal device A1 uses the extension G3 facsimile terminal device FAX or the hard disk HD. The fax information is read, the telephone number of the TV conference terminal device A2 is designated using an input device such as a writing pad WP or a keyboard KB, and a call is made by G4 fax communication or G3 fax communication. The incoming video conference terminal device A2 automatically answers the call. When the call is connected, the TV conference terminal device A1
Start sending fax manuscripts from. The TV conference terminal device A2 stores the received conference material in the hard disk HD. After the communication is completed, the TV conference terminal device A2 outputs the received facsimile document to the extension G3 facsimile terminal device FAX.

Further, in order to send a facsimile document from the TV conference terminal device A1 to the TV conference terminal device A2 during the conference, the user of the TV conference terminal device A1 first faxes from the extension G3 facsimile terminal device FAX or the hard disk HD. Read the information. Next, the TV conference terminal device A1 starts transmitting the conference material to the TV conference terminal device A2 by conference communication. In the TV conference terminal device A2,
The received conference material is stored in the hard disk HD. After the communication is completed, the TV conference terminal device A2 outputs the received facsimile document to the extension G3 facsimile terminal device FAX.

Next, FIG. 4 shows a protocol sequence of conference communication in the remote conference terminal device. In order to perform conference communication between the remote conference terminal device B1 and the remote conference terminal device B2 shown in FIG. 4, first, a Dch call setting procedure (ITU
-T recommendation Q931 standard procedure) is used to establish a conference communication call between the remote conference terminal device B1 and the remote conference terminal device B2. Remote conference terminal device B1 and remote conference terminal device B2
When a call is established during the period, the connection of the first channel is established (ITU-T Recommendation H242 standard procedure fuse A).

After the first channel connection is established between the remote conference terminal device B1 and the remote conference terminal device B2, Bc
h channel 1 initialization procedure (ITU-T Recommendation H24
(2 standard procedure) is used to send a FAS / BAS signal (ITU-T recommendation H221 standard signal) on the line, and capability exchange is performed between the remote conference terminal device B1 and the remote conference terminal device B2. The FAS signal is a signal used for frame synchronization of ITU-T Recommendation H221. BAS signal is ITU
-T is a signal for transferring the command and data of Recommendation H221.

In order to perform moving picture information communication between the remote conference terminal device B1 and the remote conference terminal device B2 after the initialization procedure for the first channel is completed, , First, Dch call setup procedure (IT
A second conference communication call is established between the remote conference terminal device B1 and the remote conference terminal device B2 using the U-T recommendation Q931 standard procedure). When the second call is established between the remote conference terminal device B1 and the remote conference terminal device B2, the connection of the additional channel (second channel) is established (ITU-
Recommendation H242 Standard Procedure Phase CA).

After the connection of the additional channel (second channel) is established between the remote conference terminal device B1 and the remote conference terminal device B2, the Bch additional channel initialization procedure (IT
FA on the line using U-T Recommendation H242 standard procedure)
The S / BAS signal (ITU-T recommendation H221 standard signal) is transmitted, and the remote conference terminal device B1 and the remote conference terminal device B2 are transmitted.
56 kbps voice, 6.4 kbps MLP (Mu
lti Layer Protocol), 62.4 kb
Set the transmission path for multimedia communication of ps video (I
TU-T Recommendation H242 Standard Procedure Phase CB1). 56k between the remote conference terminal device B1 and the remote conference terminal device B2
bps voice, 6.4 kbps MLP, 62.4 kbps
At the time of setting the transmission path of the multimedia communication of the movie,
The users of the remote conference terminal device B1 and the remote conference terminal device B2 can exchange voice information, moving image information, and data information.

After executing the above procedure, the remote conference terminal device B1
The remote conference terminal device B2 can exchange voice information, moving image information, and data information, and conference communication is performed between the users of the remote conference terminal device B1 and the remote conference terminal device B2.
During the conference communication, the users of the remote conference terminal device B1 and the remote conference terminal device B2 perform cursor communication using data information transfer, remote camera control communication, telewriting communication, Perform a fax communication, perform a still image transfer, or transfer other information to proceed with the conference.

FIG. 5 shows a protocol sequence in the remote conference terminal device of the conference communication part shown in FIG. After executing the protocol sequence of the conference communication in the remote conference terminal device shown in FIG. 4, the remote conference terminal device B1 and the remote conference terminal device B2 are in the conference communication state. After entering the conference communication state, the remote conference terminal device B1 and the remote conference terminal device B2 generate a protocol stack for conference control and execute the protocol for conference control. The information on the protocol for conference control includes terminal identifier information, conference material information, conference participant information, and the like for preparing a conference environment between remote conference terminal devices. After exchanging the above information, control the start and end of telewriting communication, control the start and end of fax communication (bulk transfer), start and end of still image information transfer (bulk transfer). To control
Transfers cursor information and remote camera control information. The conference control protocol is the C shown in FIG.
& I, X226, X225, X224, Q92
2 protocol stacks.

FIG. 6 shows an application protocol sequence for telewriting and fax transfer after executing the conference control protocol sequence shown in FIG. After executing the conference communication protocol sequence in the remote conference terminal device shown in FIG. 4, the remote conference terminal device B1
Then, the remote conference terminal device B2 enters the conference communication state. After entering the conference communication state, the procedure shown in FIG. 5 is executed to activate the protocol for conference control. After the conference control protocol is activated, the conference control protocol is used to generate a telewriting communication protocol stack. After the protocol stack for telewriting communication is generated, the teleconference terminal device B1 and the teleconference terminal device B2 perform telewriting communication. The conference control protocol is also used to generate a fax communication protocol stack.
After the protocol stack for fax communication is generated, the remote conference terminal device B1 and the remote conference terminal device B2 execute fax communication. Telewriting communication includes TW, X226, X225, X224, and Q shown in FIG.
922 protocol stack. The fax communication is the BULK, X226, and X2 shown in FIG.
25, X224, and Q922 protocol stacks.

The conference control protocol, the telewriting communication protocol stack, and the fax communication (bulk transfer) protocol stack are protocol-multiplexed by the protocol stack Q922 shown in FIG.
Transferred by one MLP. Further, the priority order of data transfer is set in each protocol stack. Usually, real-time data conference control communication and telewriting communication have a high priority, and bulk data fax communication and still image communication have a low priority. By assigning the priority order, it is possible to execute bulk system data transfer without disturbing real time system data transfer.

FIG. 7 shows a conference material transmission protocol sequence in the G4 facsimile communication in the remote conference terminal device. In order to previously transmit the conference material used in the conference communication between the remote conference terminal device B1 and the remote conference terminal device B2 shown in FIG. 4, first, the Dch call setting procedure (ITU
-T recommendation Q931 standard procedure) is used to establish a G4 facsimile communication call between the remote conference terminal device B1 and the remote conference terminal device B2. When a call is established between the remote conference terminal device B1 and the remote conference terminal device B2, Bch data transfer starts. After the Dch call is established, the remote conference terminal device B1 sends a SABME command to the Bch to request the setting of the link layer. Remote conference terminal device B2
Receives the SABME command and returns a UA response as a response. As a result, the link layer is set.

After setting the link layer, the remote conference terminal device B
1 sends an SQ command to Bch. The remote conference terminal device B2 receives the SQ command and returns an SF response as a response. After receiving the SF response, the remote conference terminal device B1 sends a CR command to Bch to request the setting of the network layer. Remote conference terminal device B2
Receives a CR command and returns a CA response as a response. As a result, the network layer is set. After setting the network layer, the remote conference terminal device B1
Sends a TCR command to Bch to request transport layer setting. The remote conference terminal device B2 is
It receives a TCR command and returns a TCA response as a response. This sets the transport layer. After setting the transport layer, remote conference terminal device B
1 sends a CSS command to Bch to request connection setting in the session layer. The teleconference terminal device B2 receives the CSS command, and receives the RSS command as a response.
P response is returned. Thereby, the connection of the session layer is set.

After setting the session layer connection,
The remote conference terminal device B1 sends out a CDCL command to Bch in order to execute the negotiation of the transmission function used in communication. The CDCL command is set to have the ability to execute the conference material communication function. The remote conference terminal device B2 receives the CDCL command and returns an RDCLP response as a response. For RDCLP,
It is set that the conference materials can be received. In this way, when the preparation for transmitting the conference material is completed, the remote conference terminal device B1 transmits the CDS command in which the document management information for distinguishing the document to be transmitted is set. After transmitting the CDS command, the remote conference terminal device B1 transmits the image information for one document by using the CDUI command. After transmitting the CDUI command, the remote conference terminal device B1 sends out a CDE command for notifying the end of the document, and finishes the transmission of the image information of one document. The title name of the conference material is set in the document profile in the CDUI command in which the beginning of the document is stored.

The remote conference terminal device B2 receives the CDS command and the CDUI command and outputs the image information for one document to the H level.
Store in D. When the title name of the conference material is confirmed in the document profile in the CDUI command in which the beginning of the document is stored, the remote conference terminal device B2 stores it in the HD together with the received image information for one document. The remote conference terminal device B2 receives the command CDE and returns RDEP as a response. After that, the Bch upper layer is disconnected and the Dch call is released. By executing the conference material transmission by the above G4 facsimile communication, the remote conference terminal device B1 and the remote conference terminal device B2 are
You will have meeting materials with common meeting titles.

Further, when the facsimile original is transmitted from the remote conference terminal device B1 to the remote conference terminal device B2 by G4 facsimile communication, the protocol procedure described above is executed. However, the CDCL command / RDCLP response does not exchange the capability of transmitting the conference material. Also, the title name of the conference material is not set in the document profile.

FIG. 8 shows a facsimile original transmission protocol sequence in G3 facsimile communication in the remote conference terminal device. In order to transmit a facsimile document by G3 facsimile communication from the remote conference terminal device B1 of the TV conference terminal device A1 shown in FIG. 3 to the remote conference terminal device B2 of the TV conference terminal device A2, first, a Dch call setting procedure ( ITU-T Recommendation Q931 standard procedure) is used to establish a G3 facsimile communication call between the remote conference terminal device B1 and the remote conference terminal device B2. When a call is established between the remote conference terminal device B1 and the remote conference terminal device B2, Bc
The data transfer of h starts.

After the Dch call is established, the remote conference terminal device B1
Sends a CNG signal to Bch. The remote conference terminal device B2 sends a CED signal to Bch and then sends a DIS signal notifying the communication capability. Remote conference terminal device B1
Receives the DIS signal, and determines the communication mode from the communication capabilities of the own terminal and the partner terminal. After that, the remote conference terminal device B1 notifies the DCS of the determined communication mode.
After transmitting the signal to Bch, the TCF signal of the training signal of the modem is transmitted. The remote conference terminal device B2 is D
It receives the CS signal and sets its own terminal to the determined communication mode. After that, the TCF signal of the training signal of the modem is received, and the result is transmitted to Bch (CFR signal in the case of OK, FTT signal in the case of NG).

The remote conference terminal device B1 receives the CFR signal and starts transmitting the image information signal. After sending the image information signal, send the EOP signal notifying the end of the document to Bc.
send to h. The remote conference terminal device B2 receives the image information signal normally, then receives the EOP signal, and receives M as a response.
The CF signal is sent to Bch. Remote conference terminal device B1
Is a DCN that receives the MCF signal and notifies the end of communication
The signal is sent to Bch. The remote conference terminal device B2 is D
The CN signal is received and the communication ends.

Now, FIG. 9 shows an outline of services during a video conference in the embodiments of the inventions of the present application. Also, FIG.
0 shows an internal block diagram of the video control unit 10 shown in FIG. 1 for realizing each invention of the present application.

An outline of services in each embodiment of the invention will be described with reference to FIG. 9, a TV conference terminal device A1 (Tokyo), a TV conference terminal device A2 (Osaka), and a TV conference terminal device A3 having the hardware configuration shown in FIG. 1 and the protocol stack configuration shown in FIG. It is assumed that (Nagoya) and the TV conference terminal device A4 (Sendai) are performing multipoint video conference communication via the multipoint conference control unit MCU. The TV conference terminal devices A1 to A4 are connected with TV cameras C1 to C4 for video input, TV monitors D1 to D4 for video output, and operation keypads E1 to E4 for controlling the TV conference terminal device A. There is. In the above TV conference environment, the video of the speaker is displayed on the TV monitors D1 to D4 of the TV conference terminal devices A1 to A4.
For example, when a conference participant of the video conference terminal device A1 speaks, the multipoint conference control unit MCU causes the video conference terminal device A1 to
Detected that the voice level from
The video (terminal information is superimposed) sent from the TV camera C1 of the V conference terminal device A1 is distributed to the TV conference terminal devices A1 to A4 of each conference participant.

The video control unit 10 shown in FIG. 1 for realizing each invention of the present application will be described with reference to the internal block diagram of FIG.
The video controller 10 includes a DRAM 10a, a superimposing circuit 10b, an analog / digital (A / D) conversion NTSC decoder 10c, and an H261 encoder 10.
d, an H261 decoder 10e, a digital / analog (D / A) conversion NTSC encoder 10f, and a changeover switch 10g. The video control unit 10 is connected to the system bus 1 and has a video input VI, a video output VO, an H261 data output DO, and an H261 data input DI.

The video input VI includes a TV camera C and a VT.
R or the like is connected. A TV monitor D, a VTR, or the like is connected to the video output VO. The H261 data output DO and the H261 data input DI are connected to the media multiplexer 13.

In the DRAM 10a, color bit data for superimposing is mapped from the CPU 4 via the system bus 1, and by these, the own terminal information is registered as display information to be combined with the image of the own terminal. Information registration means has been realized. In the present embodiment, as the self-terminal information, self-terminal identification information such as company branch name, self-terminal telephone number, connection time, conference participant name, etc. are combined and displayed.

The superimposing circuit 10b is connected to the DRA.
The color bit data mapped to M10a is combined with the image of the video input VI as superimposing information. The superimposing circuit 10b is provided in the CPU 4
Setting / release of the superimpose function is controlled by turning on / off the setting signal EN input from the device via the system bus 1, and these realize the own terminal image synthesizing means. When the function setting is made, the color bit data mapped in the DRAM 10a is combined with the image of the video input VI as superimpose information and output,
When the setting is released, the image of the video input VI is output as it is.

The A / D conversion NTSC decoder 10c converts the analog image output from the superimposing circuit 10b into a digital image. H261 encoder 10
d encodes the digital video from the A / D conversion NTSC decoder 10c according to the rules of ITU-T Recommendation H261 and outputs it to the H261 data output DO. H261
The decoder 10e decodes the digital video input from the H261 data input DO according to the standard of ITU-T Recommendation H261. D / A conversion NTSC encoder 1
0f converts the digital video from the H261 decoder 10e into an analog video that can be displayed on the TV monitor D.

The change-over switch 10g is for an analog image added from the video input VI via the superimposing circuit 10b or an analog image added from the H261 data input DI via the H261 decoder 10e and the D / A conversion NTSC encoder 10f. Either one is selected and output to the video output VO. This changeover switch 10g
Is controlled by a switching signal SEL input from the CPU 4 via the system bus 1, whereby an input device such as the writing pad WP, the keyboard KB, or the operation keypad is operated to display an image to be displayed on the TV monitor D. You can switch to your own or another terminal's.

FIG. 11 shows a flowchart of the embodiment of the invention described in claim 1. The present invention is realized by executing the program shown by the flowchart in FIG. 11 in the CPU 4 in the apparatus configuration shown in FIGS. 1 and 10.

First, when the TV monitor display processing is started, the character information input as the terminal information is read from the writing pad WP or the keyboard KB (processing 101). The read character information is converted into binary information (process 102). After the conversion, the data is read in bit units, and it is determined whether the data is “0” or “1” (process 103 → decision 104). After the judgment, "1"
Information to arbitrary color information (N in judgment 104 → process 1)
05), the information of “0” is converted into transparent information (decision 10)
4 Y → process 106). After conversion, the color bit data is sequentially mapped to the DRAM 10a of FIG. 10 (Process 1)
07). The above conversion processing is executed until the character information to be converted ends (N loop of determination 108). After the conversion data is completed, the superimposing circuit 10b of FIG. 10 is set, and the superimposing information mapped in the DRAM 10a and the image of the video input VI are combined (Y in the judgment 108 → process 109).

The composite video output from the superimpose circuit 10b is given to the changeover switch 10g, and if the switch 10g is set to select the video input VI, the composite video from the superimpose circuit 10b. Is output to the video output VO and displayed on the TV monitor D. Also, the composite video output from the superimposing circuit 10b is the A / D conversion NTSC decoder 10
c and the H261 encoder 10d to output the H261 data output DO. The composite video output to the H261 data output DO is multiplexed with other audio information and the like by the media multiplexing device 13, and the ISDN interface 14
And the multipoint conference control unit MCU via the digital public network ISDN. In the multipoint conference control unit MCU, the image of the terminal device in which the speaker is present is distributed to other terminal devices, but in the video conference environment of FIG.
When a conference participant of the conference terminal device A1 speaks, it is detected that the audio level from the TV conference terminal device A1 has risen,
The video transmitted from the TV camera C1 of the TV conference terminal device A1 is automatically displayed on the TV conference terminal device A of each conference participant.
1 to A4. In each of the terminal devices A1 to A4, the input device such as the writing pad WP, the keyboard KB, and the operation keypad is operated, and the changeover switch 10g of the video control unit 10 illustrated in FIG.
By selecting each terminal device A1-A
4 multi-point conference controller MC on TV monitors D1 to D4
Video from U is displayed. Multipoint conference control unit MCU
Since the video from is a combination of the terminal identification information, the terminal telephone number, the connection time, the name of the conference participant, etc. as the superimposing information as the terminal information, each terminal device A
On the TV monitors D1 to D4 of 1 to A4, as shown in the enlarged view of the TV monitor of FIG. 9, images in which the terminal information of the terminal device A1 is combined are displayed.

As described above, the multi-point video conference communication is carried out by superimposing the self-terminal information in the video conference terminal device A on the video image of the self-terminal and transmitting it to the multi-point conference control unit MCU. At this time, it becomes possible to confirm at a glance which image is being received without having a special communication procedure for multipoint video conference communication.

FIG. 12 shows a flowchart of the embodiment of the invention described in claim 2. The present invention is realized by the CPU 4 executing the program shown by the flowchart in FIG. 12 in the apparatus configuration shown in FIGS.

The processing 201 to the determination 208 are shown in FIG.
It is similar to the flow of 1. That is, when the TV monitor display process is started, the character information input from the writing pad WP or the keyboard KB is read (process 201). The read character information is converted into binary information (process 202). After the conversion, the data is read in bit units, and it is determined whether the data is “0” or “1” (process 203 → decision 204). After the determination, the information of “1” is changed to arbitrary color information (N of determination 204 → process 20).
5), information of "0" is converted into transparent information (decision 204)
Y → Process 206). After conversion, the color bit data is sequentially mapped to the DRAM 10a of FIG. 10 (Process 20).
7). The above conversion processing is executed until the character information to be converted ends (N loop of determination 208).

After the conversion data is completed, it is checked whether the calling party is the multipoint conference control unit MCU (decision 2).
09). Here, the case where the attribute of the registered telephone number is MCU, the case where the communication capability value has the MCU function, and the case of H
When the MCU command described in 230 is recognized, it is recognized that the call destination is the multipoint conference control unit MCU. When the destination is an MCU, the superimpose circuit 10b shown in FIG. 10 is set, and the superimpose information and the video input VI mapped in the DRAM 10a are set.
Are combined (Y in judgment 209 → process 210).

The composite video output from the superimpose circuit 10b is given to the changeover switch 10g, and if the switch 10g is set to select the video input VI, the composite video from the superimpose circuit 10b. Is output to the video output VO and displayed on the TV monitor D. Also, the composite video output from the superimposing circuit 10b is the A / D conversion NTSC decoder 10
c and the H261 encoder 10d to output the H261 data output DO. The composite video output to the H261 data output DO is multiplexed with other audio information and the like by the media multiplexing device 13, and the ISDN interface 14
And the multipoint conference control unit MCU via the digital public network ISDN. In the multipoint conference control unit MCU, the image of the terminal device in which the speaker is present is distributed to other terminal devices, but in the video conference environment of FIG.
When a conference participant of the conference terminal device A1 speaks, it is detected that the audio level from the TV conference terminal device A1 has risen,
The video transmitted from the TV camera C1 of the TV conference terminal device A1 is automatically displayed on the TV conference terminal device A of each conference participant.
1 to A4. In each of the terminal devices A1 to A4, the input device such as the writing pad WP, the keyboard KB, and the operation keypad is operated, and the changeover switch 10g of the video control unit 10 illustrated in FIG.
By setting to select each terminal device A1
Video from the multipoint conference control unit MCU is displayed on the TV monitors D1 to D4 of A4 to A4. Multipoint conference control device M
The video from the CU is a combination of the terminal identification information, the terminal telephone number, the connection time, the name of the conference participant, and the like as the superimposing information as the terminal information. Therefore, the TV monitor D1 of each of the terminal devices A1 to A4. ~ D4 is the TV of FIG.
As shown in the monitor enlarged view, an image in which the terminal information of the terminal device A1 is combined is displayed.

On the other hand, the destination is a multipoint conference control device M
If it is not a CU, that is, in order to hold a 1: 1 (end / end) videoconference, and if a call is made to another TV conference terminal device, the setting of the superimpose circuit 10b is not performed (N in decision 209). Therefore, the image of the video input VI is passed through the superimposing circuit 10b and is output as it is, and a TV monitor display similar to the conventional one is displayed.

As described above, in this embodiment, only when the destination is the multipoint conference control unit MCU, the superimposition information as shown in FIG. 9 is displayed to execute the multipoint video conference communication. Only in this case, the same function as that of the above-described embodiment is provided, and at the time of end / end connection other than multipoint connection, it is possible to display an image without superimpose.

In the above embodiment, it is determined whether or not the calling party is the multipoint conference control unit MCU after the superimposing information is registered in the DRAM 10a. By performing the above procedure, the registration process of superimposing information can be omitted when the call destination is not the multipoint conference control unit MCU.

FIG. 13 shows a flowchart of the embodiment of the invention described in claim 3. The present invention is realized by executing the program shown by the flow chart in FIG. 13 by the CPU 4 in the device configuration shown in FIGS.

The steps 301 to 308 are shown in FIG.
It is similar to the flow of 1. That is, when the TV monitor display process is started, the character information input from the writing pad WP or the keyboard KB is read (process 301). The read character information is converted into binary information (process 302). After conversion, the data is read in bit units, and it is determined whether the data is “0” or “1” (process 303 → decision 304). After the determination, the information “1” is changed to arbitrary color information (N in determination 304 → process 30).
5), information of “0” is converted into transparent information (decision 304)
Y → process 306). After conversion, the color bit data is sequentially mapped to the DRAM 10a of FIG. 10 (Process 30).
7). The above conversion processing is executed until the character information to be converted ends (N loop of determination 308).

After the conversion data is completed, it is checked whether or not there is a superimpose setting operation (decision 20).
9). The superimpose setting operation can be performed with one touch using an input device such as the writing pad WP, the keyboard KB, or the operation keypad. If there is a superimpose setting operation, the superimpose circuit 10b shown in FIG. 10 is set, and the superimpose information mapped in the DRAM 10a and the video of the video input VI are combined (Y in judgment 309 → process 310).

The composite video output from the superimpose circuit 10b is given to the changeover switch 10g, and if the switch 10g is set to select the video input VI, the composite video from the superimpose circuit 10b. Is output to the video output VO and displayed on the TV monitor D. Also, the composite video output from the superimposing circuit 10b is the A / D conversion NTSC decoder 10
c and the H261 encoder 10d to output the H261 data output DO. The composite video output to the H261 data output DO is multiplexed with other audio information and the like by the media multiplexing device 13, and the ISDN interface 14
And the multipoint conference control unit MCU via the digital public network ISDN. In the multipoint conference control unit MCU, the image of the terminal device in which the speaker is present is distributed to other terminal devices, but in the video conference environment of FIG.
When a conference participant of the conference terminal device A1 speaks, it is detected that the audio level from the TV conference terminal device A1 has risen,
The video transmitted from the TV camera C1 of the TV conference terminal device A1 is automatically displayed on the TV conference terminal device A of each conference participant.
1 to A4. In each of the terminal devices A1 to A4, the input device such as the writing pad WP, the keyboard KB, and the operation keypad is operated, and the changeover switch 10g of the video control unit 10 illustrated in FIG.
By setting to select each terminal device A1
Video from the multipoint conference control unit MCU is displayed on the TV monitors D1 to D4 of A4 to A4. Multipoint conference control device M
The video from the CU is a combination of the terminal identification information, the terminal telephone number, the connection time, the name of the conference participant, etc. as the superimposing information as the terminal information. Therefore, the TV monitor D1 of each of the terminal devices A1 to A4. ~ D4 is the TV of FIG.
As shown in the monitor enlarged view, an image in which the terminal information of the terminal device A1 is combined is displayed.

On the other hand, when the superimpose setting operation is not performed, the superimposing circuit 10b is not set (N loop of judgment 309). Therefore, the image of the video input VI is passed through the superimposing circuit 10b and is output as it is, and a TV monitor display similar to the conventional one is displayed. When the superimpose circuit 10b is set in the process 310, the superimpose display as described above is performed. In this state, if the superimpose setting cancel operation is performed, the superimpose circuit 10b is displayed. Is canceled, and the operation waits for the superimpose setting operation again (Y in determination 311 → process 312 → N loop in determination 309). In this state, the same as above
The video of the video input VI is the superimposing circuit 10
After passing through b, it is output as it is, and a TV monitor display similar to the conventional one is displayed. To cancel the superimpose setting,
Writing pad WP and keyboard K as well as setting operation
It can be done with one touch using input devices such as B and operation keypad.

As described above, in the present embodiment, the superimposing information as shown in FIG. 9 can be displayed and deleted so that when the multipoint video conference communication is executed, It is possible to display the necessary superimposing information by one-touch operation when a request is made from the side or when one speaks.

FIG. 14 shows a flowchart of the embodiment of the invention described in claim 4. The present invention is realized by the CPU 4 executing the program shown in the flowchart of FIG. 14 in the apparatus configuration shown in FIGS. 1 and 10.

The processing 401 to the determination 408 are shown in FIG.
It is similar to the flow of 1. That is, when the TV monitor display process is started, the character information input from the writing pad WP or the keyboard KB is read (process 401). The read character information is converted into binary information (process 402). After conversion, the data is read in bit units, and it is determined whether the data is “0” or “1” (process 403 → decision 404). After the determination, the information of “1” is changed to arbitrary color information (N of determination 404 → processing 40
5), information of "0" is converted into transparent information (decision 404)
Y → process 406). After the conversion, the color bit data is sequentially mapped in the DRAM 10a of FIG. 10 (process 40).
7). The above conversion process is executed until the character information to be converted ends (N loop of determination 408).

After the conversion data is completed, it is checked whether or not the conference participant has made a statement (decision 409). When there is a speech by the conference participant, the superimposing circuit 10b shown in FIG. 10 is set, and the superimposing information mapped in the DRAM 10a and the video of the video input VI are combined (Y in judgment 409 → process 410).

The composite video output from the superimpose circuit 10b is given to the changeover switch 10g, and if the switch 10g is set so as to select the video input VI, the composite video from the superimpose circuit 10b. Is output to the video output VO and displayed on the TV monitor D. Also, the composite video output from the superimposing circuit 10b is the A / D conversion NTSC decoder 10
c and the H261 encoder 10d to output the H261 data output DO. The composite video output to the H261 data output DO is multiplexed with other audio information and the like by the media multiplexing device 13, and the ISDN interface 14
And the multipoint conference control unit MCU via the digital public network ISDN. In the multipoint conference control unit MCU, the image of the terminal device in which the speaker is present is distributed to other terminal devices, but in the video conference environment of FIG.
When a conference participant of the conference terminal device A1 speaks, it is detected that the audio level from the TV conference terminal device A1 has risen,
The video transmitted from the TV camera C1 of the TV conference terminal device A1 is automatically displayed on the TV conference terminal device A of each conference participant.
1 to A4. In each of the terminal devices A1 to A4, the input device such as the writing pad WP, the keyboard KB, and the operation keypad is operated, and the changeover switch 10g of the video control unit 10 illustrated in FIG.
By setting to select each terminal device A1
Video from the multipoint conference control unit MCU is displayed on the TV monitors D1 to D4 of A4 to A4. Multipoint conference control device M
The video from the CU is a combination of the terminal identification information, the terminal telephone number, the connection time, the name of the conference participant, etc. as the superimposing information as the terminal information. Therefore, the TV monitor D1 of each of the terminal devices A1 to A4. ~ D4 is the TV of FIG.
As shown in the monitor enlarged view, an image in which the terminal information of the terminal device A1 is combined is displayed.

On the other hand, when there is no speech from the conference participant, the setting of the superimposing circuit 10b is not performed (N loop of decision 409). Therefore, the image of the video input VI is passed through the superimposing circuit 10b and is output as it is, and a TV monitor display similar to the conventional one is displayed. Further, in the above processing 410, the superimposing circuit 10b
When is set, the superimpose display as described above is performed. In this state, if the conference participant's utterance disappears (N in judgment 411), a fixed time (about several minutes) after the utterance disappears. It is checked whether or not it has passed, and when a certain time has passed, the setting of the superimposing circuit 10b is canceled, and the conference participant waits for the speech again (decision 4).
11 N → Y of decision 412 → Process 413 → N loop of decision 409). In this state, similarly to the above, the image of the video input VI passes through the superimposing circuit 10b and is output as it is, and the same TV monitor display as the conventional one is displayed. It should be noted that, in the above-mentioned superimpose display state, when the speech of the conference participant continues (decision 411
Y loop), or when the speech of the conference participant is temporarily interrupted and the speech is resumed within a certain period of time (N of judgment 411 → N loop of judgment 412), the superimpose The display continues.

As described above, in this embodiment, when the conference participant speaks, the superimposing information as shown in FIG. 9 is displayed, and when the conference participant does not speak, after a proper time has elapsed, By deleting the superimposing information as shown in FIG. 9, it is possible to display the necessary superimposing information only when the participant is speaking during the multipoint video conference communication. It is possible.

In each of the above embodiments, as the color information conversion method for superimposing display, the character information indicating the own terminal information is converted into binary information, and
Of the value information, the information of "1" is changed to arbitrary color information,
I tried to convert "0" information into transparent information.
Information of "0" may be converted into arbitrary color information, and information of "1" may be converted into transparent information. In this case, the superimposed information is displayed in reverse video.

[0085]

As described above, according to the invention of claim 1 of the present application, the function of performing a video conference between a plurality of other video conference terminal devices via the communication line and the multipoint conference control device. In a video conference terminal device having a self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with video of the self-terminal, and the self-terminal information registration means Since a self-terminal information synthesizing unit for synthesizing the self-terminal information registered in the multipoint conference control device with the video of the self-terminal transmitted to the multipoint conference control device, a special communication procedure for multipoint video conference communication is required. Instead, there is an effect that it is possible to confirm at a glance which image is being received.

According to the second aspect of the present invention, the function of conducting a one-to-one video conference with another video conference terminal device via the communication line, and the other function via the communication line and the multipoint conference control device. In a video conference terminal device having a function of performing a video conference with a plurality of video conference terminal devices, the self-terminal information such as self-terminal identification information and conference participant names is registered as display information to be combined with the video of the self-terminal. When the own terminal information registration means and the destination of the call are multipoint conference control devices, the image of the own terminal that transmits the own terminal information registered in the own terminal information registration means to the multipoint conference control device. Since it has a self-terminal information synthesizing means for synthesizing the same, it has the same function as in claim 1 only when executing multipoint video conference communication, and at the time of end / end connection other than multipoint connection. ,
This has the effect of displaying images without superimpose.

According to the third aspect of the invention, in a video conference terminal device having a function of performing a video conference between a plurality of other video conference terminal devices via the communication line and the multipoint conference control device. , Self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with the video of the self-terminal, and self-terminal information registration means based on operation input information. Since the self-terminal information synthesizing means for synthesizing the registered self-terminal information with the video of the self-terminal to be transmitted to the multipoint conference control device is provided, while executing the multipoint video conference communication, There is an effect that necessary superimposing information can be displayed by a one-touch operation when requesting or speaking.

According to the invention as set forth in claim 4, in a video conference terminal device having a function of performing a video conference between a plurality of other video conference terminal devices via the communication line and the multipoint conference control device. Self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with the video of the self-terminal, and the self-terminal when the conference participant of the self-terminal speaks Since the own terminal information combining means for combining the own terminal information registered in the information registration means with the image of the own terminal to be transmitted to the multipoint conference control device is provided, when performing the multipoint video conference communication. , There is an effect that necessary superimpose information can be displayed only when the participant is speaking.

[Brief description of drawings]

FIG. 1 is a block configuration diagram showing an embodiment of a video conference terminal device according to each invention of the present application.

FIG. 2 is a configuration diagram of a protocol stack installed in the remote conference terminal device of FIG.

FIG. 3 is a diagram showing a conference communication environment between remote conference terminal devices.

FIG. 4 is a diagram showing a protocol sequence of conference communication in a remote conference terminal device.

FIG. 5 is a diagram showing a conference control protocol sequence in the remote conference terminal device.

FIG. 6 is a diagram showing a protocol sequence of an application in the remote conference terminal device.

FIG. 7 is a diagram showing a conference material transmission protocol sequence in G4 facsimile communication in the remote conference terminal device.

FIG. 8 is a diagram showing a facsimile original transmission protocol sequence in G3 facsimile communication in the remote conference terminal device.

FIG. 9 is a diagram showing an outline of services during a video conference in an embodiment of each invention of the present application.

10 is an internal block diagram of the video control unit of FIG.

FIG. 11 is a flowchart showing an embodiment of the invention described in claim 1.

FIG. 12 is a flowchart showing an embodiment of the invention according to claim 2;

FIG. 13 is a flowchart showing an embodiment of the invention according to claim 3;

FIG. 14 is a flowchart showing an embodiment of the invention according to claim 4;

FIG. 15 is a diagram showing a conventional video conference environment.

[Explanation of symbols]

 1 System Bus 2 VRAM 3 Graphic Controller 4 CPU 7 Memory Section 8, 9, 18 Serial Interface 10 Video Control Section 10a DRAM 10b Superimpose Circuit 10c A / D Conversion NTSC Decoder 10d H261 Encoder 10e H261 Decoder 10f D / A Conversion NTSC Encoder 10g Changeover switch 11 LAPD unit 12a, 12b LAPB unit 13 Media multiplexing device 14 ISDN interface 16 SCSI unit 20 Modem 21 Extension interface 23 HDLC unit 24 RS232C interface 25 DCR unit A, A1 to A5 TV conference terminal device B, B1 B5 Remote conference terminal device C, C1 to C4 TV camera CC camera control unit D, D1 to D4 TV monitor E1 to E4 operation key Pad L1~L4 digital line MCU multipoint conference control device LCD display WP writing pad S speaker M microphone ISDN digital public network HD hard disk KB keyboard FAX extension G3 facsimile terminal CB RS232C cable

Claims (4)

[Claims] 1. A video conference terminal device having a function of performing a video conference between a plurality of other video conference terminal devices via a communication line and a multipoint conference control device, comprising: self-terminal identification information and conference participant names. Self-terminal information registration means for registering self-terminal information such as the display information to be combined with the video of the self-terminal, and self-terminal information registered in the self-terminal information registration means to the multipoint conference control device A video conference terminal device, comprising: self-terminal information synthesizing means for synthesizing the image of the self-terminal. 2. A function of performing a one-to-one video conference with another video conference terminal device via a communication line, and between a plurality of other video conference terminal devices via a communication line and a multipoint conference control device. In a video conference terminal device having a function of conducting a video conference in, a self-terminal information registration means for registering self-terminal information such as self-terminal identification information and conference participant names as display information to be combined with the video of the self-terminal, When the call destination is a multipoint conference control device, own terminal information synthesizing means for synthesizing the own terminal information registered in the own terminal information registering device with the image of the own terminal transmitted to the multipoint conference controlling device. A video conference terminal device characterized by being provided. 3. A video conference terminal device having a function of performing a video conference between a plurality of other video conference terminal devices via a communication line and a multipoint conference control device, the self-terminal identification information and conference participant name. Self-terminal information such as, for example, self-terminal information registration means for registering the self-terminal information as display information to be combined with the video of the self-terminal, and self-terminal information registered in the self-terminal information registration means based on operation input information. A video conference terminal device, comprising: self-terminal information synthesizing means for synthesizing the image of the self-terminal transmitted to the point conference control device. 4. A video conference terminal device having a function of performing a video conference between a plurality of other video conference terminal devices via a communication line and a multipoint conference control device, comprising: self-terminal identification information and conference participant names. Self-terminal information registration means for registering self-terminal information such as the display information to be combined with the video of the self-terminal, and self-terminal information registered in the self-terminal information registration means when a conference participant of the self-terminal speaks. And a self-terminal information synthesizing means for synthesizing the image of the self-terminal to be transmitted to the multipoint conference control device.