JPH11234643A - Multipoint video conference system - Google Patents

Abstract

(57) [Summary] In a conventional multipoint video conference system, a video of a terminal synthesized by a video processing unit into a composite video is transmitted to a multipoint video conference device of a video conference terminal (hereinafter abbreviated as a terminal). The connection is switched in various ways according to connection / disconnection of the terminal and a switch notification of the speaker terminal from the voice processing unit. That is, a specific terminal cannot always be synthesized with a synthesized video, which hinders smooth operation of a conference. SOLUTION: A video processing unit 360 has a priority order table 2
A designated terminal table 404 is provided in association with the designated video terminal 04.
5 is a designated terminal ID 406 that can designate a specific terminal.
Was provided. Accordingly, the composite video control unit 402 sets the priority 207 included in the priority table 204 to the highest level with respect to the terminal set to the terminal designation ID 406, so that the terminal set to the terminal designation ID 406 becomes a composite video. Combination is always possible.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint videoconference system using a multipoint videoconference device for connecting a plurality of videoconference terminals and performing a multipoint videoconference.

[0002]

2. Description of the Related Art FIG. 10 is a block diagram of a conventional multipoint video conference system having a video synthesizing function. 10, reference numeral 100 denotes a multipoint video conference device; 101, an operation device for controlling the multipoint video conference device 100; 102, control lines for connecting the operation device 101 to the multipoint video conference device 100; Videoconferencing terminal (hereinafter abbreviated as terminal) that can perform videoconferencing by inputting and outputting signals, 1
Reference numerals 21 to 125 denote lines connecting each of the terminals 111 to 115 and the multipoint video conference apparatus 100.

Reference numeral 130 denotes a line-corresponding unit which performs call control for connecting / disconnecting the lines 121-125.
Reference numeral 145 corresponds to each of the terminals 111 to 115, and a multiplex / demultiplex unit that multiplexes / demultiplexes each media signal such as video, audio, and data signals, 150 denotes an audio processing unit, 160 denotes a video processing unit,
170 is a data processing unit. In FIG. 10,
For simplicity, transmission lines, exchanges, and the like used by the lines 121 to 125 are omitted.

FIG. 11 is a block diagram of a video processing unit 160. In the figure, reference numeral 201 denotes an operation device 101, an audio processing unit 150, a data processing unit 170, and a demultiplexing unit 141.
145, an information I / F unit, 202 is a composite video control unit, 203 is a composite video creation unit, and 204 is a priority table updated by the composite video control unit 202 and referenced by the composite video creation unit 203. FIG. 12 is a configuration diagram of the priority order table 204, in which 205 is the terminal ID, 206 is the combination determination, and 207 is the priority. FIG. 13 is an explanatory diagram of the operation of the video processing unit 160, and reference numeral 10 denotes a composite video created by the composite video creation unit 203. Here, the priority order 207 indicates that 1 is the lowest and 5 is the highest.

Next, the operation of the conventional multipoint video conference system will be described. For the sake of simplicity, it is assumed here that the five-point conference of the terminals 111 to 115 is to be held by the multipoint video conference device 100, and that the composite video creation unit 2
The composite image 10 created by the composite image 03 is a four-divided composite image. In addition, the multipoint video conference device 100 and the terminals 111 to
115 is connected via lines 121-125. The line handling unit 130 is connected to the terminal 111 and the demultiplexing unit 14.
1. The terminal 112 is connected to the demultiplexing unit 142, the terminal 113 is connected to the demultiplexing unit 143, the terminal 114 is connected to the demultiplexing unit 144, and the terminal 115 is connected to the demultiplexing unit 145 via lines 121 to 125.

The multiplexing / demultiplexing units 141 to 145 separate video signals, audio signals, and data signals from the terminals 111 to 115, and separate them into the audio processing unit 150 and the video processing unit 1 respectively.
60 and the data processing unit 170. The demultiplexing units 141 to 145 multiplex the audio signal from the audio processing unit 150, the video signal from the video processing unit 160, and the data signal from the data processing unit 170, and
5 is output.

[0007] The audio processing unit 150 includes a demultiplexing unit 1.
Performs synthesis / switching processing of audio signals from 41 to 145,
The processed audio signal is output to each of the demultiplexing units 141 to 145. Further, the video processing unit 160 includes a demultiplexing unit 141.
145 to 145, and outputs the processed video signal to each of the demultiplexing units 141 to 145. Further, the data processing section 170 includes a demultiplexing section 141.
145 are processed, and the processed result is output to each of the demultiplexing units 141 to 145 as a data signal. The operation device 101 controls the audio processing unit 150, the video processing unit 160, and the data processing unit 170.

Next, the operation of the video processing unit 160 will be described with reference to FIGS.
FIG. 13 will be described. Here, it is assumed that the composite video creating unit 203 creates the four-divided composite video 10. In the initial state when a multipoint video conference is held, the priority order table 204 is set as shown in FIG. That is, in the initial state, as shown in FIG. 13A, the combination determination 206 of any terminal is determined to be “combination impossible”, and as shown in FIG. Has not been synthesized. Next, when the terminal 111 is connected to the multipoint video conference device 100, the connection information of the terminal 111 is notified from the demultiplexing unit 141 to the composite video control unit 202 via the information I / F unit 201.

As a result, the composite video control unit 202
As shown in FIG. 3C, the combination determination 206 corresponding to the terminal 111 in the priority table 204 is set to “combination possible”, and the priority 207 is changed to 5. When the values of the priorities 207 overlap, the synthesized video control unit 202 lowers the priority of the originally existing priority 207 by one. Further, the composite video control unit 202 instructs the composite video creation unit 203 to create the composite video 10. Synthetic video creation unit 203
Is the priority order table 20 in the state of FIG.
4, the video of the terminal 111 is synthesized with the synthesized video 10 as shown in FIG.

Next, when the terminal 112 is connected to the multipoint video conference apparatus 100, connection information of the terminal 112 is notified from the demultiplexing section 141 to the composite video control section 202 via the information I / F section 201. . As a result, as shown in FIG. 13E, the composite video control unit 202 sets the composite determination 206 corresponding to the terminal 112 in the priority table 204 to “combinable” and changes the priority 207 to 5. Thus, the priority corresponding to the terminal 111 becomes 4. Also,
The composite video control unit 202 instructs the composite video creation unit 203 to create the composite video 10. The composite video creating unit 203
Referring to the priority order table 204 in the state shown in FIG. 13E, the image of the terminal 112 is further combined with the combined image 10 as shown in FIG.

Hereinafter, similarly, the multipoint video conference apparatus 100
When the terminal 113 and the terminal 114 are connected to, the priority order table 204 becomes as shown in FIG. 13 (G), and the composite video 10 becomes as shown in FIG. 13 (H). Next, when the terminal 115 is connected to the multipoint video conference device 100, the connection information of the terminal 115 is notified from the demultiplexing unit 141 to the composite video control unit 202 via the information I / F unit 201. As a result, as shown in FIG. 13 (I), the composite video control unit 202 sets the composite determination 206 corresponding to the terminal 115 in the priority table 204 to “combinable” and changes the priority 207 to 5.

However, since the composite video 10 can only composite video of up to four terminals, the composite video control unit 202
As shown in (J), the combination determination 206 of the terminal 111 having the priority order 207 of 1 is further changed to “combination impossible”, and the combined image creation unit 203 is instructed to create a combined image. As a result, the composite video creating unit 203 deletes the video of the terminal 111 from the composite video 10 and combines the video of the terminal 115 as shown in FIG.

Also, when a multi-point video conference is being held, for example, when the voice processing unit 150 notifies the synthesized video control unit 202 via the information I / F unit 201 of the switching of the speaker terminal,
The composite video control unit 202 changes the priority order 207. That is, the composite screen control unit 202 rewrites the priority order 207 of the terminal that has newly become the speaker terminal to 5 and instructs the composite video creation unit 203 to create a composite video. Thereby, the video of the terminal that has become the speaker terminal is preferentially combined with the composite video 10.

The terminal to be synthesized with the synthesized video 10 can be arbitrarily set from the operation device 101. Also,
Here, since the number of images that can be combined with the combined image 10 is 4,
The video of the terminal having the priority 207 of 2 to 5 is combined with the composite video 10, and the video of the terminal having the priority 207 of 1 cannot be composited.

[0015]

The conventional multipoint video conference system is configured as described above, and has the following problems. (1) As described above, the composite video 10 has the priority 207
Are synthesized from the terminals of 2 to 5. Also, priority 2
07 is rewritten at random according to the order of connection of the terminals to the multipoint video conference apparatus 100 or the change of the speaker terminal. For this reason, for example, it is impossible to always combine the video of the terminal on which the conference organizer important for the operation of the conference is projected with the composite video 10. (2) In other words, since the desired specific terminal cannot always be combined with the composite video 10, the video of the desired specific terminal must be combined with the composite video 10 one by one using the operation device 101 or the like. There was a problem that hindered smooth operation. (3) Each time the speaker terminal is changed, the position of the speaker terminal to be synthesized with the synthesized video is switched. In other words, there is a problem that a conference participant (not shown) who views the composite video 10 may not know which video is the video of the speaker terminal.

A first object of the present invention is to provide a multipoint video conference system capable of always synthesizing a specific terminal with a synthesized video. To provide. A second object is to provide a multipoint video conference system that can always combine the specific terminal at a predetermined position of a combined image.

[0017]

A multipoint video conference system according to the present invention connects a plurality of terminals for conducting a video conference by inputting / outputting a video signal to the plurality of terminals. A multi-point video conference apparatus that outputs a synthesized video obtained by synthesizing the video signals to each of the connected terminals, a priority table describing the priority of the terminal to be synthesized with the synthesized video, and the priority table, A designated terminal table that describes a terminal that is always combined with the combined image, a combined image control unit that controls the combined image by rewriting the priority order table and the designated terminal table, and the priority order table and the designated terminal table. A composite video creating unit for creating the composite video with reference to the composite video creating unit.

In the multipoint video conference system according to the next invention, the terminals described in the designated terminal table are assigned by assigning the priorities of the priority table which can be combined with the synthesized video to the terminals described in the designated terminal table. Is always synthesized with the synthesized image.

Further, the multipoint video conference system according to the next invention is a system in which a designated terminal table is added with an allocation position of a terminal described above to a composite video.

Further, in the multipoint video conference system according to the next invention, when a terminal is described in the designated terminal table, it is described using a terminal identifier unique to the terminal.

Further, in the multipoint video conference system according to the next invention, when a terminal is described in the terminal designation table, a specific terminal name that can be identified by the composite video control unit and the composite video creation unit is described. .

Further, in the multipoint video conference system according to the next invention, when an operation device for operating the multipoint video conference device is provided, the operation device side capable of rewriting the designated terminal table from the operation device. A designated terminal table rewriting means is provided.

Further, the multipoint video conference system according to the next invention is provided with terminal-side designated terminal table rewriting means for enabling the designated terminal table to be rewritten from the terminal.

[0024]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram of a multipoint video conference system according to the present invention. The same reference numerals as those in FIG. 10 denote the same or equivalent functions, and a description thereof will be omitted. In the figure, reference numeral 300 denotes a multipoint video conference device;
An operation device 1 controls the multipoint video conference device 300. Reference numerals 311 to 315 denote terminals, 360 denotes a video processing unit, and 370 denotes a data processing unit.

FIG. 2 is a block diagram of the video processing unit 360. The same reference numerals as those in FIG. 11 denote the same or equivalent functions.
Description is omitted. In the figure, 401 is an information I / F unit,
Reference numeral 402 denotes a composite video control unit, and reference numeral 403 denotes a composite video creation unit. Reference numeral 404 denotes a terminal designation table, 405 denotes an assignment position, and 406 denotes a designated terminal ID. FIG. 3 is a configuration diagram of the priority order table 204 and the designated terminal table 404.

In the multipoint video conference system shown in FIG. 1, the assignment position 405 and the designated terminal ID 406 can be set from the operation device 301 or the data processing unit 370. Are different. Also, the terminals 311 to 315 are connected to the data processing unit 3.
10 is different from the multipoint video conference system in FIG. 10 in that the setting of the assignment position 405 and the designated terminal ID 406 can be performed via the.

These setting methods are described in H.264 in ITU-T. 2
LSD (Low Speed D) defined in Recommendation 21
data), HSD (High Speed Dat)
a), MLP (Multi Layered Prot)
ocol), MBE (MultiByte Exten)
If the communication with the video processing unit 360 can be performed by using, for example, the image processing unit 360, the setting can be easily performed.

FIG. 4 is a flowchart showing the operation of the composite video control unit 402, FIGS. 5 and 6 are explanatory diagrams showing an example of the operation of the composite video control unit 402, and FIGS. It is an operation explanatory view showing another example of the operation.
The specific terminal shown in FIG. 4 is, for example, a conference host terminal,
Alternatively, it refers to a terminal specified by a name that can be identified by the composite video control unit 402 and the composite video creation unit 203, such as a speaker terminal, and a terminal that can be described in the designated terminal ID 406 in FIG.

Next, the operation of the composite video control unit 402 will be described with reference to FIG.
Will be described. In S1, when registering a conference held by any one of the operating device 301 and the terminals 311 to 315, the assignment position 405 and the designated terminal ID 406 are set in response to a request from any of the operating device 301 and the terminals 311 to 315. Move to S2. In S2, when the conference is held, the process shifts to the event occurrence waiting state in S3. S
In 3, when information that is an event is input from the information I / F unit 201, the process proceeds to S4 assuming that an event has occurred. In S4, it is determined whether or not the content of the event is due to the connection of the terminal to the multipoint video conference device 300. If the event is a connection, the process proceeds to S8; otherwise, the process proceeds to S5.

In S5, it is determined whether or not the content of the event is due to disconnection of the connected terminal from the multipoint video conference apparatus 300. If disconnected, the process proceeds to S9, and if not, the process proceeds to S6. In S6, it is determined whether or not the content of the event is due to the change of the specific terminal.
Then, the process proceeds to S7. In S7, the event content is assigned position 405 or designated terminal ID.
It is determined whether or not the change is due to the change in 406, and if the change is made, the process proceeds to S11; otherwise, the process proceeds to S3.

In S8, the combined judgment 406 of the connected terminals is performed.
Is changed to “combinable”, the priority order 407 is set to the highest order, and the routine goes to S12. In step S9, the combination determination 406 of the disconnected terminal is changed to “combination impossible”, and the priority 407 is set.
Is set to the lowest order, and the process proceeds to S12. In S10,
The combination determination 406 of the specific terminal is changed to “combination possible”, the priority 407 is set to the highest priority, and the process proceeds to S12. Also, S
In step S12, the contents of change in the allocation position 405 or the designated terminal ID 406 are reflected in the priority table 404, and the process proceeds to step S12.
Move to

At S12, the combination determination 40 of the connected terminal is performed.
6 are all changed to "combinable" and the process proceeds to S13. S1
In 3, when either the terminal or the specific terminal is set in the designated terminal ID 406, the position of the terminal set to the assigned position is adjusted, the priority 407 of the terminal is set to the highest order, and the process proceeds to S14. . In S14, the terminal to which the assignment position 405 is not assigned with the priority 407 that can be combined and the assignment position 405 with the priority 407 that cannot be combined are assigned.
The terminal is replaced with a terminal to which S is assigned, and the process proceeds to S15.

In S15, the number of synthesized video divisions is compared with the number of connected terminals. If the number of connected terminals is larger, the flow shifts to S16; otherwise, the flow shifts to S3. In S16, the terminal having the higher priority order 407 up to the number of combined video divisions is kept as “combination possible”, and the combination determination 406 of the lower terminal is set as “combination impossible”, and the process shifts to S3.

Next, an example of the operation of the composite video control unit 402 and the composite video creation unit 403 will be described with reference to FIGS. For example, when registering a conference to be held from the operation device 301 (S1), the terminal 3
It is assumed that there is a request to always combine the image 11 with the upper left of the video. In this case, the composite video control unit 402 sets the terminal 311 in the item of the designated terminal ID 406 corresponding to “upper left” of the allocation position 405.

As a result, the priority order table 204 and the designated terminal table 404 are as shown in FIG. Also, in this case, as shown in FIG. 5 (B), all the terminals are "combination impossible", so that the video of any terminal is not combined. When a video conference is held by the terminals 311 to 315 registered by the operation device 301 (S2), the synthesized video control unit 402 shifts to an event occurrence waiting state (S3).

Next, when the terminal 311 is connected to the multipoint video conference device 300, the composite video control unit 202
The process moves from -4-8-12 to 15-3. As a result, the priority order table 204 and the designated terminal table 404 are as shown in FIG.
(C), the composite video 10 is as shown in FIG. 5D, and the video of the terminal 311 is composited on the upper left of the composite video 10. Next, when the terminal 312 is connected to the multipoint video conference device 300, the composite video control unit 202 executes S3-4-8-12.
It shifts to -13. Thereby, the priority table 20
4 and the designated terminal table 404 are as shown in FIG. S
In 13, the assignment position 405 is the designated terminal ID 4 of “upper left”
Since the terminal 111 is set to 07, the priority 407 of the terminal 311 is 5 at the highest level, and the priority of the terminal 312 is 4
And further proceeds to S14-15-3.

As a result, the priority order table 204 and the designated terminal table 404 are as shown in FIG. 5 (F), the composite video 10 is as shown in FIG. 5 (G), and the video of the terminal 311 is the composite video 1
0, the video of the terminal 312 is composited on the upper right of the composite video 10. Next, the terminal 1 is connected to the multipoint video conference device 300.
13 and 114 are connected in order, the composite video control unit 2
02 is S3-4- each time the terminals 113 and 114 are connected.
The process proceeds to 8-12 to 15-3. As a result, the priority order table 204 and the designated terminal table 404 are as shown in FIG.
6A, the composite video 10 is as shown in FIG. 6B, and the video of the terminal 313 is composited on the lower left of the composite video 10 and the video of the terminal 314 is composited on the lower right of the composite video 10.

Next, when the terminal 315 is connected to the multipoint video conference device 300, the composite video control unit 202
The process moves to -4-8-12. As a result, the priority order table 204 and the designated terminal table 404 become as shown in FIG. 6C, and the process shifts to S13. At S13, allocation position 4
Since the terminal 311 is set in the designated terminal ID 407 of “upper left” of the terminal 05, the priority 407 of the terminal 311 is set to 5 and the priority 407 of the terminal 315 is set to 4, and the process proceeds to S14. Thus, the priority order table 204 and the designated terminal table 404 are as shown in FIG.

In step S14, the terminal 315 having the priority 407 that can be combined and having the allocation position 405 of "none", and the terminal 3 having the priority 407 that cannot be combined and having the allocation position 405 having the upper right position.
12 and the process moves to S15. Thus, the priority order table 204 and the designated terminal table 404 are as shown in FIG. In S15, the number of terminals that can be “synthesized” is greater than the number of synthesized video divisions, so the flow shifts to S16. In S16, the terminal 3 whose priority order 407 is 1
The composition determination 406 of the twelfth is changed to “combination impossible”, and the process proceeds to S3. As a result, FIG. 6F shows the priority order table 204 and the designated terminal table 404, and FIG.
(G), the video of the terminal 315 is synthesized at the upper right of the synthesized video 10 instead of the video of the terminal 312.

Next, another example of the operation of the composite video control unit 402 and the composite video creation unit 403 will be described with reference to FIGS. In this case, in the multipoint video conference system shown in FIG.
15 are connected. Also, the priority order table 204 and the designated terminal table 404 are shown in FIG. 7A (the same as FIG. 6F), and the composite video 10 is shown in FIG.
(Same as (G)), the synthesized video control unit 402
Event waiting state. Further, it is assumed that the terminal 315 has become a speaker terminal according to the notification from the voice processing unit 150.

In such a state, for example, the operating device 30
Designated terminal ID 406 whose allocation position 405 is “upper left” from 1
Assume that there is a request to always combine the terminal 312 as the designated terminal ID 406 with the speaker terminal and the allocation position 405 being “upper right”. In this case, the composite video control unit 202
The process moves from 3-4 to 7-11. In S11, the request is reflected in the priority order table 204 and the designated terminal table 404, and the process proceeds to S12. As a result, the priority order table 204 and the designated terminal table 404 are displayed as shown in FIG.
become that way. In S12, the combination determination 40 of the terminal 312 is performed.
6 is changed to “combination possible”, and the routine goes to S13. Thereby, the priority order table 204 and the designated terminal table 40
4 is as shown in FIG.

In S13, when a plurality of terminals are set in the designated terminal ID 406, it is assumed that the operation is performed by sequentially detecting from the left side. First, the composite video control unit 202 that has detected that the speaker terminal is set to the designated terminal ID 406 whose allocation position 405 is “upper left” has the priority table 20
While exchanging the terminal 311 and the terminal 315 of No. 4,
The priority 207 of the terminal 315 is set to the highest. Thereby, the priority order table 204 and the designated terminal table 40
4 is as shown in FIG.

Next, when detecting that the terminal 312 is set to the designated terminal ID 406 whose allocation position 405 is “upper right”, the composite video control unit 202 replaces the terminal 311 with the terminal 312 in the priority order table 204 and , The priority order 207 of the terminal 312 is set to the highest order. This allows
The priority order table 204 and the designated terminal table 404 are as shown in FIG. Also, the composite video control unit 402
Further searches the designated terminal table 404. When the allocation position 405 is "lower left" and "lower right", the designated terminal ID 40
Since no terminal is designated in No. 6, the process of S13 ends, and the process proceeds to S14.

In step S14, the terminal 311 with the priority 407 that can be combined and the allocation position 405 is “none”, and the terminal 311 with the priority 407 that cannot be combined and the allocation position 405 that is “lower left”.
13 and the process moves to S15. As a result, the priority order table 204 and the designated terminal table 404 become as shown in FIG. In S15, the number of terminals that can be “synthesized” is greater than the number of synthesized video divisions, so the flow shifts to S16. In S16, the terminal 3 whose priority order 407 is 1
The combining determination 406 of the thirteenth is changed to “combination impossible”, and the process shifts to S3.

As a result, the priority order table 204 and the designated terminal table 404 are as shown in FIG. 8B, the composite video 10 is as shown in FIG. 8C, and the video of the terminal 315 is the composite video 1
0, the video of the terminal 312 is composited on the upper right of the composite video 10, the video of the terminal 311 is composited on the lower left of the composite video 10, and the video of the terminal 314 is composited on the lower right of the composite video 10.

Next, it is assumed that the speaker terminal has been changed from the terminal 315 to the terminal 313 by the notification from the voice processing unit 150. Then, the composite video control unit 202 performs S3 to
It moves to 6-10. In S10, the terminal 313 and the terminal 3
15 and the priority order 2 of the terminal 313.
Then, the process goes to S12 with 07 as the highest order. Thus, the priority order table 204 and the designated terminal table 404 are as shown in FIG.

In S 12, the combination determination 206 of the terminal 315
Is set to “combinable” and the process proceeds to S13. Thus, the priority order table 204 and the designated terminal table 404 are as shown in FIG. In S13, the designated terminal ID 40
When a plurality of terminals are registered as No. 6, the operation is performed while sequentially detecting from the left side of the designated terminal table 202 as described above. That is, here, the priority order 2 of the terminal 313
After setting 07 as the highest priority, the priority 207 of the terminal 312 is set as the highest priority, and the process shifts to S14.

In step S14, the terminal 313 whose priority is 407 that can be combined and the allocation position 405 is “none” and the terminal 313 whose priority 407 that cannot be combined and whose allocation position 405 is “lower right” are used.
14 and the process proceeds to S15. Thus, the priority order table 204 and the designated terminal table 404 are as shown in FIG. In S15, the number of terminals that can be “synthesized” is greater than the number of synthesized video divisions, so the flow shifts to S16. In S16, the terminal 3 whose priority order 407 is 1
The combination determination 406 of 14 is changed to “combination impossible”, and the flow shifts to S3.

As a result, the priority order table 204 and the designated terminal table 404 are as shown in FIG. 9A, the composite video 10 is as shown in FIG. 9B, and the video of the terminal 313 is the composite video 1
0, the video of the terminal 312 is composited on the upper right of the composite video 10, the video of the terminal 311 is composited on the lower left of the composite video 10, and the video of the terminal 315 is composited on the lower right of the composite video 10.

Next, when the terminal 315 is disconnected from the multipoint video conference device 100, the composite video control unit 202
It moves to 3-5-9. In S9, the combination determination 206 of the terminal 315 is set to “combination impossible”, the priority is set to the lowest, and the process proceeds to S12. When the values of the priorities 207 overlap in the operation of S9, the synthesized video control unit 402 increases the priority 407 that originally existed by one. Thus, the priority order table 204 and the designated terminal table 404 are as shown in FIG. Also, S1
In 2, the combination determination 206 of the connected terminal is all “combination possible”.
Therefore, the process proceeds to S13 without doing anything. S1
In 3, the priority 207 of the terminal 313 is set to the highest priority, and then the priority 207 of the terminal 312 is set to the highest priority.

In step S14, the terminal 314 with the priority 407 that can be combined and the allocation position 405 is “none”, and the terminal 3 with the priority 407 that cannot be combined and the allocation position 405 that is “lower right”.
15 and the process proceeds to S15. In S15, since the number of synthesized video divisions is the same as the number of terminals that can be "synthesized", the process proceeds to S3. As a result, the priority table 20
4 and the designated terminal table 404 are as shown in FIG. 9D, and the composite video 10 is as shown in FIG. 9E. The video of the terminal 314 is synthesized at the lower right of the composite video 10 instead of the terminal 315.

With the above operation, in the multipoint video conference system shown in FIG. 1, the video of the terminal designated by the operation device 101 or the terminal 311 to 315 can be always synthesized with the synthesized video 10. There is no need to operate the video of the desired terminal from the operating device 301 and assign it to the composite image 10 one by one, so that a smooth conference operation can be performed. Further, although the assignment position 405 corresponding to the designated terminal ID 406 is provided in the designated terminal table 404, the assignment position 405 may be omitted if it is not necessary to specify the assigned position of the designated terminal ID 406.

Further, since a specific terminal such as a speaker terminal can be described in the designated terminal table 404, for example, a video of the speaker terminal can be allocated to a predetermined position of the composite video 10 so that participation in a conference in which the composite video 10 is viewed can be performed. The user can easily determine which video is the video of the speaker terminal, so that a smooth conference operation can be performed.

In this case, the terminal 207 specified by the specified terminal ID 406 has the highest priority 207, so that the terminal 406 can always be synthesized with the synthesized video 10. That is, here, FIG.
1, since the above-mentioned operation can be performed using the priority order table 204 used by the conventional composite video control unit 202 as it is, the production cost of the composite video control unit 402 can be reduced. However, various other methods are conceivable as methods for enabling the above operation. For example, a privilege class having a higher priority than the priority order 207 is provided for the designated terminal ID 406, and the designated terminal of the privilege class is always assigned to the composite video 10
May be combined.

Further, in the present embodiment, the number of images to be synthesized with the synthesized image 10 is 4 and the number of connected terminals is 5, but it is needless to say that other settings may be used. Also, if the contents of the designated terminal table 404 are displayed on the display units (not shown) of the terminals 311 to 315, the conference participants (not shown) who see the composite video 10 Since it is possible to recognize whether the terminal is allocated, it is possible to operate the conference more smoothly.

[0056]

According to the present invention, in the multipoint video conference system, the priority order table describes the priority order of the terminal to be synthesized with the synthesized video, and the designated terminal table which describes the terminal that is constantly synthesized with the synthesized video is described. In cooperation with the priority table, the composite video control unit controls the composite video by rewriting the priority table and the designated terminal table,
Since the composite video creating unit creates the composite video with reference to the priority order table and the designated terminal table, the video of the desired terminal can always be composited with the composite video, and the smooth operation of the video conference is achieved. There is an effect that can be.

Further, according to the next invention, the multipoint video conference system assigns the priority of the priority table which can be combined with the synthesized video to the terminal described in the designated terminal table, thereby describing the designated terminal table. Since the synthesized video of the terminal is always synthesized with the synthesized video, the video of the desired terminal can always be synthesized by using the priority order table as it is, so that there is an effect of reducing the creation cost.

Further, according to the next invention, the multipoint video conference system adds the assigned position of the described terminal to the composite video to the specified terminal table, so that the video of the terminal specified in the specified terminal table is synthesized. There is an effect that it can be allocated to a predetermined position of the video.

According to the next invention, the multipoint video conference system uses a terminal identifier unique to the terminal when describing the terminal in the designated terminal table. There is an effect that can be selected according to.

Further, according to the next invention, when describing a terminal in the terminal designation table, the multipoint video conference system describes a specific terminal name that can be identified by the composite video control unit and the composite video creation unit. In addition, there is an effect that a terminal to be assigned to the composite video can be selected by a specific terminal name such as a speaker terminal.

According to the next invention, when the multipoint video conference system is provided with an operation device for operating the multipoint video conference device, the multipoint video conference system can rewrite the designated terminal table from the operation device. Since the device-side designated terminal table rewriting means is provided, there is an effect that the designated terminal table can be rewritten from the operating device.

Further, according to the next invention, the multipoint video conference system is provided with terminal-side designated terminal table rewriting means for enabling the designated terminal table to be rewritten from the terminal. There is an effect that can be rewritten.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a multipoint video conference system according to Embodiment 1 of the present invention.

FIG. 2 is a configuration diagram of a video processing unit shown in FIG.

FIG. 3 is a configuration diagram of a priority order table and a designated terminal table shown in FIG. 2;

FIG. 4 is an operation flowchart of the composite video control unit shown in FIG. 2;

FIG. 5 is an operation explanatory diagram showing an example of the operation of the video processing unit.

FIG. 6 is an operation explanatory view showing an example of the operation of the video processing unit (continuation of FIG. 5).

FIG. 7 is an operation explanatory diagram showing another example of the operation of the video processing unit.

FIG. 8 is an operation explanatory diagram showing another example of the operation of the video processing unit (continuation of FIG. 7).

FIG. 9 is an operation explanatory view showing another example of the operation of the video processing unit (continuation of FIG. 8).

FIG. 10 is a configuration diagram of a conventional multipoint video conference system.

11 is a configuration diagram of a video processing unit shown in FIG.

FIG. 12 is a configuration diagram of a priority order table shown in FIG. 11;

13 is an operation explanatory diagram of the video processing unit shown in FIG.

[Explanation of symbols]

 150 Audio processing unit 204 Priority table 205 Terminal ID 206 Synthetic determination 207 Priority 300 Multipoint video conference device 301 Operating device 311 to 315 Terminal 360 Video processing unit 370 Data processing unit 401 Information I / F unit 402 Synthetic video control unit 403 Synthetic image creation unit 404 Designated terminal table 405 Assigned position 406 Designated terminal ID

Claims (7)

[Claims] A plurality of terminals for inputting / outputting video signals and performing a video conference, connecting the plurality of terminals, and synthesizing a video signal from the connected terminals to each of the connected terminals; A multi-point video conference apparatus that outputs to the composite video, a priority table that describes the priorities of the terminals that are to be composited with the composite video, and a designated terminal table that describes the terminals that are always combined with the composite video in association with the priority table. A composite video control unit that controls the composite video by rewriting the priority table and the designated terminal table; and a composite video creation unit that creates the composite video with reference to the priority table and the designated terminal table. A multipoint video conference system comprising: 2. Assigning a priority of a priority order table which can be combined with a composite video to a terminal described in a designated terminal table so that a video of a terminal described in the designated terminal table is always combined with the composite video. 2. The multipoint video conference system according to claim 1, wherein: 3. The multipoint video conference system according to claim 1, wherein an assignment position of the terminal to the composite video is added to the designated terminal table. 4. The multipoint video conference according to claim 1, wherein a terminal is described in a designated terminal table using a terminal identifier unique to the terminal. system. 5. The method according to claim 1, wherein when the terminal is described in the terminal designation table, a specific terminal name that can be identified by the composite video control unit and the composite video creation unit is described. The multipoint video conference system according to any one of the above. 6. An operation device-side designated terminal table rewriting means for enabling a designated terminal table to be rewritten by the operation device when an operation device for operating the multipoint video conference device is provided. The multipoint video conference system according to any one of claims 1 to 5, wherein 7. The multipoint according to claim 1, further comprising a terminal-side designated terminal table rewriting means for enabling a designated terminal table to be rewritten from a terminal. Video conference system.