WO2023051710A1 - 一种切换会议模式的方法、装置及介质 - Google Patents

一种切换会议模式的方法、装置及介质 Download PDF

Info

Publication number
WO2023051710A1
WO2023051710A1 PCT/CN2022/122667 CN2022122667W WO2023051710A1 WO 2023051710 A1 WO2023051710 A1 WO 2023051710A1 CN 2022122667 W CN2022122667 W CN 2022122667W WO 2023051710 A1 WO2023051710 A1 WO 2023051710A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
server
conference
connection
internal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2022/122667
Other languages
English (en)
French (fr)
Inventor
吴刚
黄顺炎
吕梁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP22875091.5A priority Critical patent/EP4373075A4/en
Publication of WO2023051710A1 publication Critical patent/WO2023051710A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4038—Arrangements for multi-party communication, e.g. for conferences with floor control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1101—Session protocols
    • H04L65/1108—Web based protocols, e.g. webRTC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/752—Media network packet handling adapting media to network capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/568—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/50—Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
    • H04M3/51—Centralised call answering arrangements requiring operator intervention, e.g. call or contact centers for telemarketing

Definitions

  • the embodiments of the present application relate to the field of communication technologies, and in particular, to a method, device, and medium for switching conference modes.
  • the video server In the field of video conferencing, it is necessary for the video server to process the audio and video streams of the participants so that each participant can hear/see the desired user voice/video.
  • Different conference servers are deployed in the call center to provide different conference services, such as a server responsible for forwarding only and a server responsible for mixed processing of audio and video.
  • a server responsible for forwarding only and a server responsible for mixed processing of audio and video.
  • Embodiments of the present application provide a method, device, and medium for switching conference modes, so as to solve the problem of long time consumption when switching conference servers.
  • the embodiment of the present application provides a method for switching conference modes, which is applied to a media exchange server.
  • the method includes: the media exchange server receives a trigger instruction sent by the signaling server, and associates the conference mode with the external media connection according to the trigger instruction.
  • the first internal media connection is switched to the second internal media connection; the external media connection is used to transmit the media data of the video conference between the first conference terminal and the media exchange server; the first conference terminal is any conference terminal participating in the conference; The first internal media connection is used to transmit the media data of the video conference between the media exchange server and the first conference server; the second internal media connection is used to transmit the media data of the video conference between the media exchange server and the second conference server,
  • the first conference server provides video conference services in selective forwarding mode, and the second conference server provides video conference servers in multipoint control mode; or, the first conference server provides video conference services in multipoint control mode, and the second conference server provides selection Video conferencing service in sexual forwarding mode.
  • the media exchange server switches the first internal media connection associated with the external media connection to the second internal media connection under the instruction of the signaling server, and does not need to perform the process of reconnecting the conference terminal to the conference.
  • the switching time of the internal switching server is much shorter than the external switching time, so the switching time of the conference service switching can be reduced.
  • the participants they are not disconnected from the video conferencing system, so that the participants hardly perceive the switching of the conference server.
  • the media switching server switches the first internal media connection associated with the external media connection to the second internal media connection, including: the media switching server cancels the connection between the external media connection and the first internal media connection association relationship, and associate the external media connection with the second internal media connection.
  • the method may further include: the media exchange server deletes the first internal media connection.
  • the media exchange server deletes the first internal media connection.
  • the media exchange server switches the first internal media connection associated with the external media connection to the second internal media connection, including: the media exchange server disconnects the connection established between the media exchange server and the first conference server and establish a second internal media connection between the media exchange server and the second conference server.
  • the signaling server triggers to disconnect the first internal media connection between the media exchange server and the first conference server, and then triggers the establishment of the first internal media connection between the media exchange server and the second conference server. 2.
  • For internal media connection it is no longer necessary to perform the process of re-connecting the conference terminal to the conference. Improve switching efficiency.
  • the method further includes: before the media switching server switches the first internal media connection associated with the external media connection to the second internal media connection, the media switching server creates the external media connection, and creates the first Internal media connections.
  • the media exchange server establishes the association between the external media connection and the first internal media connection under the trigger of the signaling server.
  • establishing an external media connection between the media exchange server and the first conference terminal includes: the media exchange server receives the media port information of the first conference terminal sent by the signaling server; Send the first media port information of the media switching server to the first conference terminal; the media port information of the first conference terminal and the first media port information of the media switching server are used to create an external media connection of the first conference terminal.
  • the media exchange server creates the first internal media connection, including: the media exchange server receives the second request sent by the signaling server, and the second request carries the media port information of the first conference terminal; The signaling server sends a second response, and the second response carries the first media port information of the media switching server; the media port information of the first conference terminal and the first media port information of the media switching server are used to create the external media port of the first conference terminal connect.
  • the establishment of the first internal media connection is completed by exchanging media port information between the media exchange server and the first conference server through the signaling server.
  • the media exchange server creates the first internal media connection, including: the second response also carries the second media port information of the media exchange server; the media exchange server receives the information of the first conference server sent by the signaling server Media port information: the media port information of the first conference server and the second media port information of the media exchange server are used to create the first internal media connection of the first conference terminal.
  • the method further includes: the media switching server receives indication information from the signaling server, where the indication information is used to indicate the associated external media connection and the first internal media connection; the media switching server establishes the first media port information and the second The relationship between the two media port information.
  • the media switching server canceling the association relationship between the external media connection and the first internal media connection includes: the media switching server canceling the association relationship between the first media port information and the second media port information.
  • the method further includes: after the media exchange server receives the trigger instruction from the signaling server, before associating the external media connection with the second internal media connection, establishing the second internal media connection.
  • the media exchange server establishes the second internal media connection, including: the media exchange server sends the third media port information of the media exchange server to the second conference server through the signaling server; the media exchange server receives the third media port information of the signaling server The media port information of the second conference server sent; the media port information of the second conference server and the third media port information of the media exchange server are used to create the second internal media connection of the first conference terminal; the media exchange server connects the external media Being associated with the second internal media connection includes establishing an association relationship between the first media port information and the third media port information by the media switching server.
  • the media exchange server disconnects the first internal media connection established between the media exchange server and the first conference server, including: the media exchange server deletes the media port information of the first conference server; the media exchange server establishes The second internal media connection between the media exchange server and the second conference server includes: the media exchange server sends the second media port information of the media exchange server to the second conference server through the signaling server; the media exchange server receives the information sent by the signaling server.
  • the media port information of the second conference server; wherein, the second media port information and the media port information of the second conference server are used to create a second internal media connection.
  • the embodiment of the present application provides a method for switching conference modes, which is applied to a signaling server, and the signaling server is used to enable the first conference server and the second conference server to provide different modes of video conferences for the conference terminals participating in the conference service, the first conference server/second conference server provide video conference services in selective forwarding mode/multipoint control mode respectively, or the first conference server/second conference server provide video conference services in multipoint control mode/selective forwarding mode respectively
  • the signaling server is connected to the media exchange server, and the media exchange server is respectively connected to the first conference server and the second conference server.
  • the method includes: the signaling server acquires a conference mode switching request; in response to the conference mode switching request, The signaling server triggers the media exchange server to switch the first internal media connection associated with the external media connection to a second internal media connection; wherein: the external media connection is used to transmit video conference information between the first conference terminal and the media exchange server Media data; the first conference terminal is any conference terminal participating in the conference; the first internal media connection is used to transmit the media data of the video conference between the media exchange server and the first conference server; the second internal media connection is used to Media data of the video conference is transmitted between the exchange server and the second conference server.
  • the present application only needs to switch the internal media connection associated with the external media connection when it is necessary to switch the conference mode or switch the conference server, and does not need to perform the process of re-connecting the conference terminal to the conference.
  • the switching time of the internal switching server is much shorter than the external switching time, so the switching time of the conference service switching can be reduced.
  • the participants they are not disconnected from the video conferencing system, so that the participants hardly perceive the switching of the conference server.
  • the signaling server triggers the media switching server to switch the first internal media connection associated with the external media connection to the second internal media connection, which may be implemented in the following manner: the signaling server triggers the media switching server to cancel An association relationship between the external media connection and the first internal media connection, and associating the external media connection with the second internal media connection.
  • the signaling server triggers the disconnection of the association between the external media connection and the first internal media connection, and then re-establishes the association with the second internal media connection, and it is no longer necessary to reconnect the conference terminal to The flow of the meeting. Improve switching efficiency.
  • the method further includes: the signaling server also triggers the media switching server to delete the first internal media connection.
  • the method may further include: the signaling server triggering the media switching server to switch the first internal media connection associated with the external media connection to the second internal media connection, including: the signaling server triggering the media switching The server disconnects the first internal media connection established between the media exchange server and the first conference server, and establishes a second internal media connection between the media exchange server and the second conference server.
  • the above method further includes: when the first conference terminal joins the video conference, the signaling server triggers the media exchange server and the first conference terminal to create an external media connection, and triggers the media exchange server and the first conference server to A first internal media connection is created, and the media exchange server is triggered to associate the external media connection with the first internal media connection.
  • the signaling server when a conference terminal accesses a video conference, the signaling server triggers the creation of an external media connection and an internal media connection, and triggers the media switching server to associate the external media connection with the first internal media connection, and through the added media switching server To realize the forwarding of video data, and then when the conference mode is switched, the switching efficiency is improved and the switching delay is reduced.
  • the method further includes: the signaling server triggers the creation of a second internal media connection between the media exchange server and the second conference server.
  • the above method may further include: the signaling server receives a first request from the first conference terminal, where the first request includes the media port information of the first conference terminal; the signaling server triggers the media exchange server and the second Establishing an external media connection between a conference terminal includes: the signaling server sends a second request to the media exchange server, the second request is used to request media port information for establishing an external media connection, and the second request carries the media port of the first conference terminal Information; the signaling server receives the second response sent by the media exchange server, the second response carries the first media port information of the media exchange server, and the first media port information of the media exchange device is used to create the external media connection of the first conference terminal; The signaling server sends a first response to the first conference terminal, where the first response carries the first media port information of the media switching server.
  • the signaling server controls the exchange of media port information between the media switching server and the conference terminals to realize the establishment of an external media connection, which is simple and effective.
  • the signaling server triggers the establishment of the first internal media connection between the media switching server and the first conference server, including: the signaling server receives the second response sent by the media switching server and also carries the media switching server
  • the second media port information of the media switching device is used to create the first internal media connection of the first conference terminal;
  • the signaling server sends a conference access request to the first conference server, and the conference access request is used to Requesting the first conference terminal to connect to the first conference server, the conference access request carries the second media port information of the media exchange server;
  • the signaling server receives the first conference access response sent by the first conference server, and the first conference access response carries The media port information of the first conference server;
  • the signaling server sends the media port information of the first conference server to the media exchange server.
  • the establishment of the internal media connection is realized by controlling the exchange of media port information between the media exchange server and the conference server by the signaling server, which is simple and effective. And when the media exchange server allocates the media port information of the external media connection for the conference terminal, and distributes the media port information of the internal media connection to the signaling server, so that when the signaling server triggers the establishment of the internal media connection, there is no need to send the application request again To apply for media port information, improve the efficiency of creating media connections, and reduce delays.
  • the above method further includes: the signaling server receives a first request from the second conference terminal, the first request is used to request the first conference terminal to access the video conference; the signaling server triggers the media exchange server and Establishing an external media connection between the first conference terminals includes: the signaling server sends a second request to the media exchange server, and the second request is used to request the establishment of the first media port information of the external media connection; the signaling server receives the information sent by the media exchange server The second response of the second response carries the first media port information of the media switching server.
  • the method further includes: the signaling server sends a first response to the first conference terminal, and the first response carries the first media port information of the media exchange server.
  • the first conference terminal can be invited by the second conference terminal to join the video conference, and the signaling server controls the exchange of media port information between the media exchange server and the first conference terminal to realize the establishment of an external media connection. Simple and effective.
  • the signaling server triggers the establishment of the first internal media connection between the media exchange server and the first conference server, including: the second request is also used to request the establishment of the second media port information of the first internal media connection , the second response also carries the second media port information of the media exchange server; the signaling server sends a conference access request to the first conference server, and the conference access request is used to request the first conference terminal to connect to the first conference server, and the conference access
  • the incoming request carries the second media port information of the media exchange server;
  • the signaling server receives the conference access response sent by the first conference server, and the conference access response carries the media port information of the first conference server;
  • the signaling server sends the media port information to the media exchange server Media port information of the first conference server.
  • the establishment of the internal media connection is realized by controlling the exchange of media port information between the media exchange server and the conference server by the signaling server, which is simple and effective. And when the media exchange server allocates the media port information of the external media connection for the conference terminal, and distributes the media port information of the internal media connection to the signaling server, so that when the signaling server triggers the establishment of the internal media connection, there is no need to send the application request again To apply for media port information, improve the efficiency of creating media connections, and reduce delays.
  • the signaling server triggers the media switching server to associate the external media connection of the first conference terminal with the first internal media connection, including: the signaling server sends a first association request to the media switching server, and the first The association request is used to instruct the media exchange server to establish an association relationship between the first media port information and the second media port information.
  • the signaling server triggers the media switching server to associate the external media connection of the first conference terminal with the first internal media connection, including: the second request sent by the signaling server to the media switching server is also used to Instructing the media exchange server to establish an association relationship between the first media port information and the second media port information.
  • the signaling server when the signaling server triggers the application for the media port information for the external media connection and the internal media connection, it also instructs to associate the two media port information, so as to realize the automatic association after the external media connection and the internal media connection are created , there is no need to trigger the media exchange server to associate the two internal media connections with the external media connection after sending a separate message, which improves the efficiency of the conference terminal joining the video conference and reduces the delay.
  • the signaling server triggers the media exchange server to disconnect the association between the external media connection and the first internal media connection, including: the signaling server sends a disassociation request to the media exchange server, and the disassociation request is used to indicate that the media The exchange server cancels the association relationship between the first media port information and the second media port information.
  • the association between the external media connection and the first internal media connection is disconnected by canceling the association relationship of the media port information, which is simple and effective.
  • the signaling server triggers the creation of the second internal media connection between the media switching server and the second conference server, including: the signaling server sends a third request to the media switching server, and the third request is used to request establishment The third media port information of the second internal media connection; the signaling server receives the third response sent by the media switching server, and the third response carries the third media port information; the signaling server sends the second conference access request to the second conference server , the second conference access request is used to request the first conference terminal to connect to the second conference server, and the second conference access request carries third media port information; the signaling server receives the second conference access response sent by the second conference server, The second conference access response carries the media port information of the second conference server; the signaling server sends the media port information of the second conference server to the media exchange server.
  • the signaling server triggers the media switching server to associate the external media connection with the second internal media connection, including: the signaling server sends a second association request to the media switching server, and the second association request is used to indicate The media switching server establishes an association relationship between the first media port information and the third media port information.
  • the signaling server triggers the media exchange server to disconnect the first internal media connection established between the media exchange server and the first conference server, including: the signaling server triggers the media exchange server to delete the first internal media connection of the first conference server Media port information.
  • the signaling server establishes the second internal media connection between the media exchange server and the second conference server, including: the signaling server sends the second conference access request to the second conference server, and the second conference request It is used to request the first conference terminal to connect to the second conference server, and the fourth request carries the first media port information; the signaling server receives the second conference access response sent by the second conference server, and the second conference access response carries the second conference The media port information of the server; the signaling server sends the media port information of the second conference server to the media exchange server.
  • the method further includes: the signaling server respectively instructs the first conference server and the media exchange server to delete the first internal media connection.
  • the signaling server controls the deletion of the first internal media connection to reduce resource occupation.
  • the signaling server obtains the conference mode switching request, including: the signaling server receives the conference mode switching request sent from the third conference terminal; the third conference terminal supports enabling conference recording among the conference terminals participating in the conference A conferencing terminal for the service.
  • a scenario of switching the conference mode is provided, and the conference terminal that supports the conference recording service is triggered to start the conference recording, so that the signaling server obtains the conference mode switching request.
  • the conference terminals participating in the conference include at least two user terminal devices, or include user terminal devices and service representative terminal devices, or include user terminal devices, service representative terminal devices, and user terminal devices, service representative terminal devices equipment and specialist terminal equipment.
  • the present application provides a communication device used for a media exchange server or a chip of a media exchange server, including a module or means for performing the method in the first aspect or any possible implementation of the first aspect ( means).
  • the present application provides a communication device used in a signaling server or a chip of the signaling server, including a module or means for executing the method in the foregoing second aspect or any possible implementation manner of the second aspect.
  • the present application provides a communication device used for a media exchange server or a chip of a media exchange server, including at least one processor and at least one memory, wherein at least one memory is used for storing programs and data, and at least one processor is used for Execute the method in the foregoing first aspect or any possible implementation manner of the first aspect.
  • the present application provides a communication device for a signaling server or a chip of a signaling server, including at least one processor and at least one memory, wherein at least one memory is used to store programs and data, and at least one processor is used to Execute the method in the aforementioned second aspect or any possible implementation manner of the second aspect.
  • the present application provides a communication device used in a media exchange server or a chip of a media exchange server, including a processor and an interface circuit, and the interface circuit is used to receive signals from other communication devices other than the communication device and transmit them to
  • the processor sends signals from the processor to other communication devices other than the communication device, and the processor implements the method in the first aspect or any possible implementation of the first aspect through a logic circuit or by executing code instructions.
  • the present application provides a communication device used for a signaling server or a chip of a signaling server, including a processor and an interface circuit, and the interface circuit is used to receive signals from other communication devices other than the communication device and transmit them to
  • the processor sends signals from the processor to other communication devices other than the communication device, and the processor implements the method in the aforementioned second aspect or any possible implementation of the second aspect through a logic circuit or executing code instructions.
  • the embodiment of the present application provides a communication system, including the device described in the third aspect and the device described in the fourth aspect; or including the device described in the fifth aspect and the device described in the sixth aspect; or It includes the device described in the seventh aspect and the device described in the eighth aspect.
  • the communication system also includes a first conference server and a second conference server.
  • the first conference server provides the video conference service in the selective forwarding mode
  • the second conference server provides the video conference server in the multi-point control mode
  • the first conference server provides the video conference service in the multi-point control mode
  • the second conference server provides video conferencing services in selective forwarding mode
  • the signaling server obtains the conference mode switching request, and sends a trigger instruction to the media switching server according to the conference mode switching request
  • the media switching server associates with the external media connection according to the triggering instruction
  • the first internal media connection is switched to the second internal media connection
  • the external media connection is used to transmit the media data of the video conference between the first conference terminal and the media exchange server
  • the first conference terminal is any conference terminal participating in the conference
  • the first internal media connection is used to transmit the media data of the video conference between the media exchange server and the first conference server
  • the second internal media connection is used to transmit the media data of the video conference between the media exchange server and the second conference server.
  • the present application provides a computer program product.
  • the computer program product includes computer instructions. When the computer instructions are executed, the method in the aforementioned first aspect or any possible implementation manner of the first aspect is executed.
  • the present application provides a computer program product, the computer program product includes computer instructions, and when the computer instructions are executed, the method in the aforementioned second aspect or any possible implementation manner of the second aspect is executed .
  • the present application provides a computer-readable storage medium, the computer storage medium stores computer instructions, and when the computer instructions are executed, the above-mentioned first aspect or any possible implementation of the first aspect The method is executed, or the method in the aforementioned fourth aspect or any possible implementation manner of the fourth aspect is executed.
  • the present application provides a computer-readable storage medium, the computer storage medium stores computer instructions, and when the computer instructions are executed, the aforementioned second aspect or any possible implementation of the second aspect method is executed.
  • Figure 1 is a schematic diagram of the communication system architecture in SFU mode
  • Figure 2 is a schematic diagram of the communication system architecture in the MCU mode
  • FIG. 3 is a schematic diagram of a call center system architecture
  • FIG. 4 is a schematic diagram of a conference recording triggering process
  • FIG. 5A is a schematic diagram of the architecture of the video conferencing system in the embodiment of the present application.
  • FIG. 5B is a schematic diagram of the architecture of the video conferencing system in the embodiment of the present application.
  • FIG. 6A is a schematic flowchart of a possible method for switching conference modes in the embodiment of the present application.
  • FIG. 6B is a schematic flowchart of a possible method for switching conference modes in the embodiment of the present application.
  • FIG. 6C is a schematic flowchart of a possible establishment of a video conference in the embodiment of the present application.
  • FIG. 6D is a schematic flowchart of a possible establishment of a media connection of a second conference terminal in the embodiment of the present application.
  • FIG. 7 is a schematic flow diagram of another possible establishment of a video conference in the embodiment of the present application.
  • FIG. 8 is a schematic diagram of a transmission process of an audio and video stream in SFU mode in an embodiment of the present application.
  • FIG. 9A is a schematic diagram of a conference mode switching process in an embodiment of the present application.
  • FIG. 9B is a schematic diagram of another conference mode switching process in the embodiment of the present application.
  • FIG. 9C is a schematic diagram of another conference mode switching process in the embodiment of the present application.
  • FIG. 9D is a schematic diagram of another conference mode switching process in the embodiment of the present application.
  • FIG. 10A is a schematic flow diagram of creating a video conference in a second mode in the embodiment of the present application.
  • FIG. 10B is a schematic flow diagram of creating a video conference in another second mode in the embodiment of the present application.
  • FIG. 11A is a schematic diagram of the transmission process of an audio and video stream in the MCU mode in the embodiment of the present application.
  • FIG. 11B is a schematic diagram of another audio and video stream transmission process in the MCU mode in the embodiment of the present application.
  • FIG. 12 is a schematic flow diagram of inviting other conference terminals to join a video conference in the embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of a communication device 1300 in an embodiment of the present application.
  • FIG. 14 is a schematic structural diagram of a communication device 1400 in an embodiment of the present application.
  • Video stream processing mode selective forwarding unit (selective forwarding unit, SFU) mode and multipoint conferencing unit (multipoint conferencing unit, MCU) mode.
  • the SFU mode can also be called stream forwarding mode or selective forwarding mode.
  • SFU mode a communication system can be composed of a video server and multiple terminal devices. After the video server receives the audio and video stream shared by a certain terminal device, it directly forwards the audio and video stream to other terminal devices in the conference. The video server is actually an audio and video routing forwarder.
  • the video server can also be called SFU conference server or SFU for short. SFU does not need to do audio and video transcoding.
  • the user's terminal equipment, the service representative's terminal equipment, and the service expert's terminal equipment transfer voice and video streams to each other through the SFU, wherein the service representative terminal equipment and the service expert terminal equipment display the user's video screen, and the user terminal equipment Displays the video screen of the agent.
  • MCU mode can also be called multi-point control mode or hybrid mode.
  • MCU mode a communication system is composed of a video server and multiple terminal devices.
  • the video server mixes the audio and video streams generated by all terminal devices in the same conference, generates a mixed audio and video stream and sends it to each terminal device, and each terminal device can display the video stream of other terminal devices and play other terminal devices audio stream.
  • the video server is an audio and video mixer, and the video server can also be called an MCU conference server or MCU for short.
  • the video images of the user terminal equipment, service representative terminal equipment, and service expert terminal equipment are arranged and mixed by the video server and displayed in the same video image.
  • the video server corresponding to the SFU conference mode is called the SFU conference server
  • the video server corresponding to the MCU conference mode is called the MCU conference server
  • the conference resources allocated on the SFU conference server are called SFU Conference resources
  • conference resources allocated on the MCU conference server are called MCU conference resources.
  • a user can be understood as a user of an ordinary terminal device.
  • the user can access the conference through a telephone application (telephony application) dial pad, other non-system default application (Application, APP), etc.
  • a terminal device used by a user may be called a user terminal device.
  • the user terminal device may be a mobile phone (such as a mobile phone), a tablet computer, a notebook computer, and the like.
  • the user terminal equipment may be long-term evolution voice bearer (voice over long-term evolution, VoLTE) user equipment.
  • the VoLTE terminal device can be a terminal device such as a mobile phone/tablet connected to the LTE network, such as an Android (Android) , or Hongmeng
  • the dial pad application, APP) that comes with the system makes a call.
  • the user terminal equipment may adopt a voice transmission (voice over internet protocol, VoIP) terminal equipment based on an internet protocol (internet protocol IP).
  • VoIP voice over internet protocol
  • IP internet protocol
  • the VoIP terminal device dials a VoIP call through the dial pad of the application APP installed by itself; the VoIP terminal device, for example, can be a personal computer (person computer, PC) PC/mobile phone/tablet computer and other terminal devices connected to the Internet.
  • VoLTE terminal device in this application actually can access the telecommunications network not limited to the LTE network, but can also be a 5G network, a 6G network, etc., which is not limited in this embodiment of the application.
  • the service representative can be understood as the operator of the call center, mainly dealing with the user's business consultation and business handling.
  • the terminal device used by the service representative may be called a service representative terminal device or a service representative terminal device.
  • Service representatives access the call center through service representative terminal equipment, and implement audio and video calls.
  • the service representative terminal equipment may be, for example, a session initiation protocol (session initiation protocol, SIP) softphone, a thin client (Thin Client, TC) terminal, etc. installed on a PC.
  • session initiation protocol session initiation protocol, SIP
  • TC thin client
  • Service experts can be understood as senior operators of call centers, and can be referred to as experts for short. When service representatives cannot solve user problems, service experts are required.
  • the equipment used by experts may be referred to as expert terminal equipment.
  • the expert terminal equipment may be a mobile phone (such as a mobile phone), a tablet computer, a notebook computer, a session initiation protocol (session initiation protocol, SIP) softphone installed on a PC, a thin client (Thin Client, TC) terminal, and the like.
  • the user call-in service means that after the user dials the access number (such as 10086) of the call center, the call center assigns a service representative to handle specific services.
  • outbound call service means that the service representative controls the call center to call the user's number and join the user in the conference call.
  • a call center can also be called a customer service center, which refers to a relatively concentrated place where a group of A service organization composed of service personnel uses computer communication technology to handle telephone inquiries from enterprises and customers.
  • a call center can include both roles of business representatives and business experts.
  • the service representative and the service expert can respectively use their own terminal equipment to establish a communication connection with the user terminal equipment through the call center system.
  • the embodiment of the present application can be applied to a call center system, and can also be applied to other systems that require video conferencing.
  • the scenarios applied to the call center system may include the following: In the first possible scenario, the user and the service representative conduct a two-party call. In the second possible scenario, the user talks with the service representative and the expert.
  • the SFU mode is generally preferred to implement a call between the user and an agent. If you need to start the recording function during a call, or if you need expert access and all three parties need to see other people's pages, switch the call to MCU mode.
  • the call center system includes signaling server, MCU conference server and SFU conference server.
  • the signaling server is used to control the access of users, service representatives or experts to the SFU conference server or MCU conference server, so as to realize the communication between users and service representatives, or the communication between users, service representatives and experts.
  • the SFU conference server is used to forward media data between users, service representatives, or experts.
  • the MCU conference server is used to realize mixed processing and forwarding of media data among users, service representatives or experts.
  • the SFU conference server and the MCU conference server are completely separated and undertake different conference functions independently.
  • the SFU conference server uses less computing resources, and the MCU conference server uses more computing resources.
  • the signaling server is connected to the SFU conference server.
  • the user terminal device and the service representative terminal device talk for a period of time.
  • the service representative judges When the conference recording operation needs to be performed, the agent terminal device triggers the execution of the conference recording operation, and then notifies the user terminal device to hang up by voice, and waits to be called out by the call center; after the user hangs up, the agent terminal device initiates switching of the MCU conference mode and calls Call the user terminal device, and add the user terminal device to the MCU conference to realize the call and recording.
  • step 401 the user terminal device triggers an active call to the call center, that is, initiates a call request to the signaling server to call the call center.
  • the user terminal equipment can initiate a call request to the signaling server through the IMS core network.
  • the call request may carry media description information for establishing a media connection between the user terminal device and the SFU conference server.
  • media description information for establishing a media connection between the user terminal device and the SFU conference server.
  • it includes media port information and media codec capability information of the user terminal equipment.
  • Step 402 After receiving the call request from the user terminal equipment, the signaling server controls the SFU conference server to allocate SFU conference resources. It can be understood that the signaling server requests the SFU conference server to allocate SFU resources for the user terminal equipment, and then the SFU conference server sends the SFU resources allocated to the user terminal equipment to the signaling server.
  • the SFU conference resource may include media description information of the SFU conference server for establishing a media connection with the user terminal equipment, such as media port information and media codec capability information of the SFU conference server.
  • the SFU conference resource may also include media description information of the SFU conference server used to create a media connection with the service representative terminal equipment, such as including media port information and media codec capability information of the SFU conference server.
  • media description information may adopt a session description protocol (session description protocol, SDP) format.
  • Step 403 the signaling server adds the media connection of the user terminal equipment to the SFU conference server. It can be understood as sending the media description information of the user terminal equipment to the SFU conference server.
  • the SFU conference server creates an association relationship between the media port information of the user terminal equipment and the media port information of the SFU conference server.
  • Step 404 the signaling server sends the media description information of the SFU conference server to the user terminal equipment.
  • the user terminal device establishes an association relationship between the media port information of the user terminal device and the media port information of the SFU conference server.
  • a media connection is established between the user terminal device and the SFU conference server.
  • the SFU conference server For example, the dotted line between the SFU conference server and the user terminal equipment in FIG. 4 .
  • Step 405 the signaling server makes an outbound call to the terminal equipment of the service representative.
  • the media description information used to create the media connection between the SFU conference server and the service representative terminal equipment is sent to the service representative terminal equipment.
  • Step 406 the signaling server receives the media description information of the terminal equipment of the service representative.
  • the media description information of the service representative terminal equipment includes media port information and media codec capability information of the service representative terminal equipment.
  • the SFU conference server creates an association relationship between the media port information of the service representative terminal equipment and the media port information of the SFU conference server.
  • Step 407 the signaling server joins the terminal equipment of the service representative into the SFU conference.
  • the signaling server may send the media description information of the SFU conference server to the service representative terminal device.
  • the service representative terminal device After receiving the media description information of the SFU conference server, the service representative terminal device creates an association relationship between the media port information of the service representative terminal device and the media port information of the SFU conference server.
  • a media connection is established between the SFU conference server and the service representative terminal equipment, for example, the dotted line between the SFU conference server and the service representative terminal equipment in FIG. 4 .
  • the signaling server can configure the mutual viewing attribute of the participants.
  • different scenarios may have different configurations.
  • the SFU mode when multiple parties conduct a video conference, for example, set the service representatives and experts to watch the user's video screen, and the user to watch the service representative's table video screen.
  • step 408 the signaling server configures the mutual viewing attribute between the service representative and the user on the SFU conference server.
  • Step 409 after the user terminal equipment generates the audio and video stream, it sends it to the SFU conference server.
  • the audio and video stream may adopt the RTP format, or other formats, which are not specifically limited in this application.
  • Step 410 the SFU conference server forwards the audio and video streams of the user terminal equipment to the service representative terminal equipment according to the configured inter-view attribute.
  • the SFU conference server may update the RTP header of the audio and video stream from the user terminal device according to the media connection between the SFU conference server and the service representative terminal device, and then forward it to the service representative terminal device.
  • Step 411 after the terminal equipment of the service representative generates the audio and video stream, it sends it to the SFU conference server.
  • the audio and video stream may adopt the RTP format, or other formats, which are not specifically limited in this application.
  • step 412 the SFU conference server forwards the audio and video streams of the service representative terminal equipment to the user terminal equipment according to the configured mutual viewing attribute.
  • the SFU conference server may update the RTP header of the audio and video stream from the service representative terminal device according to the media connection between the SFU conference server and the user terminal device, and then forward it to the user terminal device.
  • step 409-step 410 and step 411-step 412 may be parallel processing.
  • step 413 the terminal equipment of the service representative receives the operation of recording the conference triggered by the service representative, and sends an instruction of notifying the recording of the conference to the signaling server.
  • Step 414 the signaling server controls the SFU conference server to release the SFU conference resources.
  • Releasing the SFU conference resource can be understood as releasing the media description information of the SFU conference server used to create a media connection with the user terminal equipment and the media description information used to create a media connection with the service representative terminal equipment.
  • the SFU conference server deletes the association relationship between the media port information of the service representative terminal equipment and the media port information of the SFU conference server, and the association relationship between the media port information of the SFU conference server and the media port information of the service representative terminal equipment.
  • Step 415 the signaling server controls the user terminal equipment to release the SFU conference call.
  • step 416 the signaling server controls the terminal equipment of the service representative to release the SFU conference call. At this time, the user and the service representative can perceive that the call is hung up.
  • the service representative triggers the operation of calling out to the user terminal equipment through the service representative terminal equipment, and sends an instruction to call out to the user terminal equipment to the signaling server.
  • the instruction to call out to a user terminal device may include a user identifier of the terminal device, such as a user number.
  • step 418 the signaling server controls the MCU conference server to allocate MCU conference resources.
  • the MCU conference resource may include media description information of the MCU conference server for establishing a media connection with the user terminal equipment, such as media port information and media codec capability information of the MCU conference server.
  • the MCU conference resource may also include media description information of the MCU conference server for establishing a media connection with the service representative terminal equipment, such as media port information and media codec capability information of the MCU conference server.
  • Step 419 the signaling server calls out the user terminal device, for example, obtains the media description information of the user terminal device from the user terminal device, and uses the MCU conference server to create the media description information of the media connection with the user terminal device sent to user terminal equipment.
  • Step 420 the signaling server joins the user terminal equipment into the MCU conference.
  • the signaling server sends the media description information of the user terminal equipment to the MCU conference server.
  • Step 421 the signaling server makes an outbound call to the service representative terminal device, for example, obtains the media description information of the service representative terminal device from the service representative terminal device, and uses the MCU conference server to create a media connection with the service representative terminal device Send the media description information to the agent terminal device.
  • Step 422 the signaling server joins the terminal equipment of the service representative into the MCU conference.
  • the signaling server sends the media description information of the service representative terminal equipment to the MCU conference server.
  • Step 423 after the user terminal equipment generates the audio and video stream, it sends it to the MCU conference server.
  • the audio and video stream may adopt the RTP format, or other formats, which are not specifically limited in this application.
  • Step 424 after the terminal equipment of the service representative generates the audio and video stream, it sends it to the MCU conference server.
  • step 423 and step 424 the user terminal equipment and the service representative terminal equipment send their respective audio and video streams to the MCU conference server, and the two can be sent in parallel;
  • the MCU conference server performs mixing processing on multiple input audio and video streams, including audio mixing and video screen mixing.
  • Step 426-Step 427 the MCU conference server sends the mixed audio and video stream to the user terminal equipment and service representative terminal equipment.
  • the audio and video encoding and decoding steps inside the MCU conference server are omitted in the flow chart.
  • the video stream input by the user terminal device or the service representative terminal device reaches the MCU conference server, it first undergoes video decoding processing.
  • the decoded video of the video stream generated by the user terminal equipment and the decoded video of the video stream generated by the service representative terminal equipment are mixed for screen processing, and the mixed screen video is encoded and compressed, and then sent to the user terminal equipment and the service representative terminal equipment .
  • Step 428 the signaling server controls the MCU conference server to record audio and video of all participants.
  • step 429 the MCU conference server sends the audio and video stream after audio mixing and video mixing to the recording server.
  • the signaling server may send a conference recording instruction to the MCU conference server after step 422 is completed. After the MCU conference server completes step 425, the audio and video streams after audio mixing and video mixing are sent to the recording server.
  • Step 430 the recording server writes the mixed audio and video stream into the storage device according to the video file format.
  • the SFU conference server is generally used by default to save computing resources.
  • service representatives start recording, they need to switch from the SFU conference mode to the MCU conference mode.
  • the signaling server controls the switching of the conference mode.
  • the existing conference resources need to be released, the conference connection between the user terminal equipment and the service representative terminal equipment should be released, and the service representative terminal equipment should be restarted to initiate an outbound call.
  • the user terminal device controls the MCU conference server to create conference resources through the signaling server, and realizes the conference connection between the user terminal device and the service representative terminal device.
  • the signaling server controls the conference to switch between the SFU conference mode and the MCU conference mode
  • the call is hung up, and then waits for the agent terminal device to initiate an outbound call before rejoining the conference, resulting in a switch between the SFU conference mode and the MCU conference mode.
  • Switching takes a long time. Long switching time, on the one hand, reduces the work efficiency of service representatives, thereby reducing the utilization rate of human resources, and on the other hand, increases the waiting time of user terminal equipment.
  • the signaling server controls the conference to switch between the SFU conference mode and the MCU conference mode
  • the user terminal device needs to be hung up and then called in again, resulting in poor user experience.
  • a media exchange server is provided in the video conference system, so that the conference terminal of the video conference establishes a media connection with the conference server through the media exchange server.
  • the media connection of the conference terminal includes the external media connection between the conference terminal and the media switching server and the internal media connection between the media switching server and the conference server.
  • the switching time of the association relationship is much shorter than the time required for disconnecting and re-establishing the media connection between the conference terminal and the conference server, so the switching time of the conference service can be reduced Switching duration. And for the participants, they are not disconnected from the video conferencing system, so that the participants hardly perceive the switching of the conference server.
  • the name of the "media exchange server” is only exemplary, and in some occasions, it can also be called “conference bridge server”, “conference proxy server”, “conference media connection management server” or “conference switching server” .
  • the embodiment of the present application does not limit the name of the device, and the subsequent embodiments all use “media switching server” as an example.
  • the video conference system includes a first conference server, a second conference server, a media switching server and a signaling server.
  • the video conference system may also include other conference servers. It should be noted that different conference servers provide different conference services. As an example, the first conference server provides the first conference service, and the second conference server provides the second conference service.
  • the conference terminals participating in the video conference may include multiple user terminal devices, or user terminal devices and service representative terminal devices, or include user terminal devices, service representative terminal devices or expert terminal devices.
  • the VoIP terminal device may access a conference through a signaling server.
  • the VoLTE terminal device can access a conference through an access network, an IP Multimedia Subsystem (IP Multimedia Subsystem, IMS) core network, and a signaling server.
  • IP Multimedia Subsystem IP Multimedia Subsystem
  • IMS IP Multimedia Subsystem
  • a participant can also use the desktop cloud system to establish a connection with the video conference system through the desktop cloud system, that is, a participant can use a virtual machine in the desktop cloud system to connect to the video conference system.
  • the virtual machine in the desktop cloud system used by the participant and the terminal device used by the participant to log in to the virtual machine are combined as the conference terminal.
  • the IMS core network device is a device in the IMS core network.
  • the IMS core network equipment may include a call session control function (call session control function, CSCF) and a home subscriber server (home subscriber server, HSS), and the IMS core network equipment may also include other network elements, which will not be repeated in the embodiments of this application .
  • the CSCF is the call control center of the IMS core network, and implements functions such as user access, authentication, session routing, and service triggering on the IP transmission platform.
  • the CSCF may include one or the Multiple.
  • the HSS is used to record user subscription data (such as user information and service data).
  • the CSCFs to which different UEs belong may be the same or different. For example, different terminal devices belong to different locations, and may belong to different CSCFs.
  • the signaling server is used to establish calls between conference terminals (for example, between user terminal equipment and user terminal equipment/service representative terminal equipment/expert terminal equipment), and to control the allocation, management, and release of various resources within the video conference system , and the control of business logic, including two functions of signaling processing and business processing.
  • conference terminals for example, between user terminal equipment and user terminal equipment/service representative terminal equipment/expert terminal equipment
  • business logic including two functions of signaling processing and business processing.
  • Media exchange server it can be understood as a bridge connecting the conference terminal to the first conference server/second conference server.
  • the media exchange server is used for forwarding the media data of the conference between the conference terminal and the conference server (the first conference server or the second conference server).
  • the media exchange server can be deployed independently.
  • the media exchange server may be deployed in combination with the first conference server or the second conference server.
  • the media exchange servers that provide media proxy services for different conference terminals participating in the video conference may be the same or different.
  • the first conference server and the second conference server correspond to different modes, and conference servers of different modes provide different conference services and have different conference functions.
  • the first conference server provides the first conference service for the conference terminal in the first mode.
  • the first conference server provides the first conference service for conference terminals of the video conference in the second mode.
  • the first mode may be the SFU mode
  • the second mode may be the MCU mode
  • the first mode may be the MCU mode
  • the second mode may be the SFU mode.
  • the first conference server and the second conference server may be an SFU conference server and an MCU conference server respectively.
  • the first conference server may be an SFU conference server
  • the second conference server may be an MCU conference server
  • the first conference server may be an MCU conference server
  • the second conference server may be an SFU conference server.
  • the two conference servers included in the video conference system are the SFU conference server and the MCU conference server respectively.
  • the video conferencing system may also include a recording server, as shown in FIG. 5B .
  • the recording server is used to record and save the audio and video generated during the video conference.
  • the SFU conference server is used to realize the routing and forwarding function of the input audio and video streams of multiple conference terminals, such as forwarding the audio and video streams of the user terminal equipment to the service representative terminal equipment or expert terminal equipment, or forwarding the service representative terminal equipment or expert terminal equipment
  • the audio and video streams are forwarded to the user terminal equipment.
  • the MCU conference server is used to implement mixed processing of input audio and video streams of multiple conference terminals, such as decoding, mixing, and encoding the video streams input by user terminal equipment/service representative terminal equipment, and then sending them to service representative terminal equipment/users Terminal Equipment.
  • the media connection of the conference terminal may include an external media connection and an internal media connection.
  • the external media connection refers to the media connection between the conference terminal and the media exchange server, and is used to transmit the media data of the video conference between the conference terminal and the media exchange server.
  • the internal media connection refers to the media connection between the media exchange server and the conference server, which is used to transmit the media data of the video conference between the media exchange server and the conference server. Correlation between external media connections and internal media connections on the media exchange server. It should be noted that, in different modes, different internal media connections are created for the conference terminal. It can be understood that the internal media connection is established between the media exchange server and the conference server supporting different modes.
  • the internal media connection of the conference terminal is a media connection between the media exchange server and the conference server supporting the first mode.
  • the internal media connection of the conference terminal is a media connection between the media exchange server and the conference server supporting the second mode.
  • the internal mentioned in the embodiment of the present application mainly refers to the interaction between the internal network elements of the video conference system, and the external refers to the interaction between the internal network elements of the video conference system and the conference terminal.
  • the signaling server obtains a conference mode switching request. For example, in some scenarios, the conference terminal does not perceive the conference mode.
  • the signaling server determines that conference recording is required according to the request. If it is originally in SFU mode, it switches to MCU mode. The conferencing server that provides the video conferencing service needs to be replaced.
  • the signaling server determines to stop the conference recording according to the request. If it is originally in the MCU mode, switch to the MCU mode, and the conference server that provides the video conference service needs to be replaced.
  • Step 6002 the signaling server triggers the media switching server to switch the internal media connection associated with the external media connection, without re-executing the process of connecting the conference terminal to the conference.
  • the signaling server triggers the media switching server to switch the internal media connection associated with the external media connection, without re-executing the process of connecting the conference terminal to the conference.
  • the first media connection represents the media connection between the media exchange server and the first conference server
  • the second media connection represents the media connection between the media exchange server and the second conference server.
  • the signaling server respectively triggers the creation of media connections for each conference terminal participating in the video conference.
  • the media connection of each conference terminal includes an external media connection between the conference terminal and the media exchange server and an internal media connection between the media exchange server and the first conference server.
  • a media connection may be understood as a media data transmission channel (or simply called a media transmission channel) established between two devices.
  • the external media connection can be understood as a media data transmission channel between the media exchange server and the conference terminal
  • the first internal media connection can be understood as a media data transmission channel between the media exchange server and the first conference server device.
  • both devices establishing a media connection are assigned media port information, which may be referred to as media endpoints for short, and the two media endpoints are used to create a media channel.
  • a media endpoint can be understood as an IP port used to establish a media connection inside a device.
  • RTP real-time transport protocol
  • a media endpoint may include an IP address and a port (IP:port).
  • the internal media connection between the media exchange server and the first conference server is referred to as the first internal media connection herein.
  • the signaling server triggers the media switching server to create an association of the external media connection with the first internal media connection.
  • Establishing an association between the external media connection and the first internal media connection means that the media data of the conference is forwarded back and forth between the external media connection and the first internal connection.
  • Establishing an association relationship between the external media connection and the first internal media connection can be understood as that after the media exchange server receives the audio and video stream from the external media connection, it can route the audio and video stream to the first internal media connection through the association relationship . Or, after receiving the audio and video stream from the first internal media connection, the audio and video stream may be routed to the external media connection through an association relationship.
  • the first internal media connections created for different conference terminals are different, but they are all created between the media exchange server and the first conference server.
  • the signaling server triggers the media exchange server to switch the first internal media connection associated with the external media connection to the second internal media connection for each conference terminal.
  • the external media connection is associated with the second internal media connection, which means that the media data of the conference is forwarded back and forth between the external media connection and the second internal connection.
  • the external media connection is associated with the second internal media connection. It can be understood that after the media exchange server receives the audio and video stream from the external media connection, it can route the audio and video stream to the second internal media connection through the association relationship. Alternatively, after receiving the audio and video stream from the second internal media connection, the audio and video stream may be routed to the external media connection through an association relationship.
  • the media exchange server switches the first internal media connection associated with the external media connection to the second internal media connection for each conference terminal, which may include the signaling server triggering the media exchange server to cancel the external media connection and the first internal media connection. connection relationship, and associate the external media connection with the second internal media connection.
  • the first possible implementation take the conference system supporting two modes as an example, and take switching from the first mode to the second mode as an example, when the mode is switched, the first internal media connection created for the first mode can be retained , it only needs to trigger the media exchange server to cancel the association relationship between the external media connection and the first internal media connection, and associate the external media connection with the second internal media connection. If the second internal media connection has not been created, the second internal media connection may be created first, and then the external media connection is associated with the second internal media connection.
  • the association between the external media connection and the second internal media connection can be directly canceled, and the external media connection can be directly connected to the previously reserved first internal media connection Associating, there is no need to create the first internal media connection again, which improves the switching speed and avoids affecting the user experience.
  • the signaling server may trigger the media switching server and the first conference server to delete the first internal media connection.
  • the internal media connection so that the resources occupied by the first internal media connection can be released, so as to improve resource utilization.
  • the signaling server triggers The media exchange server cancels the first internal media connection established between the media exchange server and the first conference server, and establishes a second internal media connection between the media exchange server and the second conference server. Therefore, when the mode is switched, the resources of the first internal media connection can be released in time, reducing resource waste and improving resource utilization.
  • the signaling server may first trigger the disconnection of the first internal media connection of each conference terminal, and then trigger the creation of the second internal media connection of each conference terminal.
  • the signaling server may first trigger the creation of the second internal media connection of each conference terminal, and then trigger the disconnection of the first internal media connection of each conference terminal.
  • the establishment process of the second internal media connection of each conference terminal is executed in parallel with the deletion process of the first internal media connection of each conference terminal.
  • the signaling server can simultaneously trigger the creation of the second internal media connection of each conference terminal, And trigger deletion of the first internal media connection of each conference terminal.
  • the flow of the first conference terminal initiating a video conference call and requesting to establish a video conference with the second conference terminal will be described below with reference to FIG. 6C and FIG. 6D .
  • the first conference terminal sends a first request to the signaling server, where the first request is used to request to establish a video conference with the second conference terminal.
  • the first request is referred to as call request 1
  • the call request 1 is used to request to establish a video conference with the second conference terminal.
  • the first conference terminal may initiate a video conference with other multiple conference terminals. In this embodiment, it is taken as an example to initiate a video conference with the second conference terminal.
  • the call request 1 may carry the media endpoint of the first conference terminal.
  • the media endpoint includes the IP address of the first conference terminal, or includes the IP address and port of the first conference terminal.
  • Step 602 When receiving the call request 1, the signaling server requests the media exchange server to allocate a media endpoint for establishing an external media channel with the first conference terminal to the first conference terminal. For example, a second request is sent, and the second request is used to request the establishment of a media endpoint of an external media channel.
  • the media endpoint used to establish the external media channel (interconnection conference terminal) is referred to as the external media endpoint.
  • External media endpoints are used to connect with conference endpoints.
  • the second request sent to the media exchange server to request an external media endpoint is called application request 1 as an example.
  • Application request 1 is used to request the media exchange server to allocate an external media endpoint for the first conference terminal.
  • Step 603 the media exchange server sends the external media endpoint allocated for the first conference terminal to the signaling server.
  • the external media endpoint of the media exchange server as IP2:port2 as an example.
  • the media exchange server may send the external media endpoint allocated to the first conference terminal to the signaling server in the second response.
  • the second response is called Application Response 1 as an example.
  • the media exchange server After receiving the media endpoint of the first conference terminal, the media exchange server completes the creation of the external media connection on the side of the media exchange server according to the media endpoint of the first conference terminal and the external media endpoint allocated to the first conference terminal.
  • Step 604 After receiving the external media endpoint assigned to the first conference terminal sent by the media exchange server, the signaling server sends the external media endpoint to the first conference terminal.
  • the signaling server sends a first response (call response 1 is taken as an example in FIG. 6C ) to the first conference terminal, and the call response 1 carries the external media endpoint allocated for the first conference terminal.
  • the first conference terminal receives the call response 1, it completes the establishment of the external media connection on the first conference terminal side according to the media endpoint IP1:port1 of the first conference terminal and the received external media endpoint IP2:port2, that is, at the media endpoint An external media connection is established between IP1:port1 and external media endpoint IP2:port2.
  • the external media connection of the first conference terminal is called OutLink01 as an example.
  • the signaling server requests the media switching server to allocate a media port for creating an internal media connection to the first conference terminal.
  • the media endpoint used to establish the internal media channel is referred to as an internal media endpoint.
  • the internal media endpoint is used to connect to the SFU/MCU conference server.
  • the request sent to the media exchange server for requesting the internal media endpoint of the first conference terminal is called application request 2 as an example, and the application request 2 is used to request the media exchange server to allocate an internal media endpoint for the first conference terminal.
  • Step 606 the media switching server sends an application response 2 to the signaling server, where the application response 2 includes allocating an internal media endpoint for the first conference terminal.
  • the internal media endpoint is IP3:port3.
  • the external media endpoint and the internal media endpoint allocated by the media exchange server may use the same IP address but different port numbers. For example, both the internal media endpoint and the external media endpoint use IP2 or both use IP3, but use different port numbers.
  • Step 607 the signaling server sends a conference access request 1 to the first conference server, where the conference access request 1 is used to request the first conference terminal to access the video conference.
  • the first conference server allocates conference resources for the first conference terminal to access the video conference according to the conference access request 1 .
  • the conference resource may include a media endpoint for creating an internal media connection allocation for the first conference terminal.
  • the conference access request will be referred to as access request for short, and other message names may also be used, which is not specifically limited in this application.
  • the access request 1 may include an internal media endpoint allocated for the first conference terminal.
  • the SFU mode when the video conference is initiated, the SFU mode may be adopted by default, so that when the signaling server receives the call request 1 from the first conference terminal, it requests the SFU conference server to assign the first conference terminal to communicate with the first conference terminal.
  • the first conference server may be an SFU conference server.
  • the conference type when the first conference terminal initiates the call request 1 for establishing a video conference, the conference type may be determined preferentially, and different conference types correspond to different modes. For example, whether it is necessary to start the recording function, when the first conference terminal initiates a video conference and chooses to start the recording function, then the call request 1 includes an instruction to start the recording function. Further, the signaling server requests the MCU conference server to allocate a media endpoint for establishing an external media channel with the first conference terminal to the first conference terminal according to the recording function start instruction.
  • the first conference server may be an MCU server.
  • the signaling server requests the SFU conference server to allocate a recording function for the first conference terminal to the A media endpoint for a conference terminal to establish an external media channel.
  • the first conference server may be an SFU conference server.
  • Step 608 the first conference server sends a conference access response 1 to the signaling server, where the conference access response 1 includes the media endpoint of the first conference server assigned to the first conference terminal.
  • the media endpoint of the first conference server allocated to the first conference terminal is expressed as IP4:port4.
  • the first conference server allocates the media endpoint IP4:port4 to the first conference terminal, and can complete the creation of the internal media connection according to the internal media endpoint IP3:port3 and the media endpoint IP4:port4 of the first conference terminal.
  • Step 609 the signaling server sends the media endpoint IP4:port4 of the first conference server assigned to the first conference terminal to the media exchange server.
  • the media exchange server can complete the creation of the internal media connection according to the internal media endpoint IP3:port3 and the media endpoint IP4:port4 of the first conference terminal.
  • the internal media connection of the first conference terminal is called InLink01 as an example.
  • the media exchange server completes the correlation between the internal media connection InLink01 and the external media connection OutLink01 of the first conference terminal.
  • the media exchange server may associate the internal media endpoint and the external media endpoint assigned by the media exchange server to the first conference terminal according to the instruction of the signaling server, that is, complete the internal media connection of the first conference terminal and the first Association of external media connections of conference endpoints.
  • Mode 1 when the signaling server sends the application request 2 to the media exchange server in step 605, after indicating to the media exchange server the internal media endpoint allocated for the first conference terminal, establish an association with the external media endpoint allocated for the first conference terminal relation. Therefore, after the media exchange server finishes allocating the external media endpoints to the first conference terminal, it creates an association relationship between the internal media endpoints and the external media endpoints of the first conference terminal.
  • the application request 2 may carry the external media endpoint of the first conference terminal.
  • the first conference terminal has completed the first Create the association relationship between the internal media connection and the external media connection of the conference terminal.
  • the signaling server may indicate to the media switching server the internal media endpoint allocated for the first conference terminal and the external media endpoint allocated for the first conference terminal.
  • Media endpoints establish association relationships.
  • the signaling server when the signaling server sends the media endpoint of the first conference server to the media switching server in step 609, it can indicate to the media switching server the internal media endpoint allocated for the first conference terminal and the external media endpoint allocated for the first conference terminal Create an association.
  • the signaling server may indicate to the media exchange server that the internal media endpoint allocated for the first conference terminal establishes an association relationship with the external media endpoint allocated for the first conference terminal.
  • the signaling server may apply to the media switching server for the external media endpoint of the first conference terminal, and at the same time apply to the media switching server for the internal media endpoint of the first conference terminal.
  • the application request 1 sent by the signaling server to the media exchange server is used not only to request the media exchange server to allocate an external media endpoint for the first conference terminal, but also to request the media exchange server to allocate an internal media endpoint to the first conference terminal. Furthermore, the application response 1 fed back by the media exchange server to the signaling server in step 603 carries the allocation of internal media endpoints for the first conference terminal and the allocation of external media endpoints for the first conference terminal.
  • the signaling server applies to the media switching server for the internal media endpoint and the external media endpoint of the first conference terminal, it may also instruct the media switching server to associate the internal media endpoint and the external media endpoint allocated for the first conference terminal.
  • the application request 1 may also carry indication information 1, and the indication information 1 is used to instruct the media exchange server to associate the internal media endpoint and the external media endpoint allocated for the first conference terminal. It should be noted that, when mode 5 is adopted, step 605 and step 606 are not executed any more.
  • step 701 refer to step 601, which will not be repeated here.
  • Step 702 When receiving the call request 1, the signaling server applies for an internal media endpoint and an external media endpoint to the media exchange server for the first conference terminal.
  • an application request 1 is sent to the media exchange server, requesting the media exchange server to allocate the external media endpoints and internal media endpoints of the first conference terminal that are associated with each other.
  • the application request 1 carries the media endpoint IP1:port1 of the first conference terminal.
  • Step 703 After receiving the application request 1, the media exchange server assigns two media endpoints to the first conference terminal, namely the external media endpoint IP2:port2 and the internal media endpoint IP3:port3, and sends an application response 1 to the signaling server.
  • Application response 1 carries the external media endpoint IP2:port2 and the internal media endpoint IP3:port3.
  • the media exchange server saves the association relationship between the external media endpoint IP2:port2 and the internal media endpoint IP3:port3.
  • Step 704 After receiving the application response 1, the signaling server sends the call response 1 to the first conference terminal.
  • Call response 1 carries the external media endpoint IP2:port2.
  • the first conference terminal After receiving the call response 1, the first conference terminal establishes an external media connection OutLink01, that is, an external media connection between the media endpoint IP1:port1 and the external media endpoint IP2:port2 of the first conference terminal.
  • OutLink01 an external media connection between the media endpoint IP1:port1 and the external media endpoint IP2:port2 of the first conference terminal.
  • the signaling server triggers the media exchange server to establish an external media connection OutLink01 between the media endpoint IP1:port1 of the first conference terminal itself and the external media endpoint IP2:port2 of the first conference terminal.
  • the signaling server may save the mapping relationship between the external media endpoint IP2:port2 of the first conference terminal and the internal media endpoint IP3:port3 of the first conference terminal.
  • Step 705 the signaling server joins the first conference terminal into the video conference, that is, the signaling server sends an access request to the first conference server, and the access request carries the internal media endpoint IP3:port3 allocated by the media switching server for the first conference terminal;
  • Step 706 the first conference server sends an access response to the signaling server, and the access response carries the media endpoint IP4:port4 allocated by the first conference server to the first conference terminal.
  • Step 707 the signaling server sends a request for establishing an internal media connection to the media exchange server, carrying the media endpoint IP4:port4 of the first conference server.
  • the internal media connection established by the media exchange server is InLink01.
  • the above steps 601-609 complete the media connection of the first conference terminal, including internal media connection and external media connection.
  • the process of triggering the establishment of the media connection of the second conference terminal by the signaling server is described as follows, as shown in FIG. 6D .
  • the signaling server makes an outbound call to the second conference terminal, and may send a call request 2 to the second conference terminal, where the call request 2 is used to request the second conference terminal to access the video conference.
  • Step 611 after receiving the call request 2, the second conference terminal sends a call response 2 to the signaling server, and the call response 2 carries the media endpoint of the second conference terminal, such as IP1':port1'.
  • the signaling server sends an application request 3 to the media exchange server, where the application request 3 is used to request the media exchange server to allocate an external media endpoint for the second conference terminal.
  • the application request 3 may carry the media endpoint IP1':port1' of the second conference terminal.
  • the media exchange server allocates an external media endpoint for the second conference terminal, for example, the external media endpoint allocated for the second conference terminal is IP2':port2', according to the media endpoint IP1':port1' of the second conference terminal and the second
  • the external media endpoint IP2':port2' allocated by the conference terminal completes the creation of the external media connection on the side of the media exchange server.
  • the media exchange server may be deployed in a cluster mode.
  • the media exchange servers that provide services for the first conference terminal and the second conference terminal may be the same or different.
  • the IP addresses of the external media endpoints assigned by the media exchange server to the first conference terminal and the second conference terminal respectively can be the same and the port numbers different.
  • the IP addresses of the external media endpoints allocated by the media switching server to the first conference terminal and the second conference terminal can both be IP2, but the port numbers are different.
  • the IP addresses and port numbers of the external media ports allocated to the first conference terminal and the second terminal are different.
  • the IP addresses of the internal media endpoints assigned by the media exchange server to the first conference terminal and the second conference terminal respectively can be the same and the port numbers different.
  • the IP addresses of the external media endpoints allocated by the media switching server to the first conference terminal and the second conference terminal can both be IP3, but the port numbers are different.
  • the IP addresses and port numbers of the internal media endpoints assigned to the first conference terminal and the second terminal are different.
  • Step 613 the media exchange server sends an application response 3 to the signaling server, and the application response 3 carries the external media endpoint IP2':port2' allocated by the media exchange server to the second conference terminal.
  • Step 614 the signaling server sends the external media endpoint IP2':port2' assigned to the second conference terminal to the second conference terminal, and then the second conference terminal according to its own media endpoint IP1':port1' and the external media endpoint IP2': port2' completes the creation of the external media connection on the side of the second conference terminal, for example, the external media connection of the second conference terminal is called OutLink02.
  • the signaling server may first request the media exchange server to allocate an external media endpoint for the second conference terminal before making an outbound call to the second conference terminal. Then, when the call request 2 is sent to the second conference terminal, the external media endpoint allocated for the second conference terminal is sent to the second conference terminal.
  • the signaling server may apply for a media endpoint from the media switching server after receiving the call response 2 sent by the second conference terminal. This method is taken as an example in Fig. 6D.
  • Step 615 the signaling server sends an application request 4 to the media exchange server, where the application request 4 is used to request the media exchange server to allocate an internal media endpoint for the second conference terminal.
  • Step 616 after the media exchange server receives the application request 4, it allocates an internal media endpoint for the second conference terminal, such as IP3':port3', and then sends an application response 4 to the signaling server, and the application response 4 includes the media exchange server as the second conference terminal.
  • Step 617 After receiving the application response 4, the signaling server requests the first conference server to add the second conference terminal to the video conference.
  • the signaling server sends an access request 2 to the first conference server, where the access request 2 is used to request the second conference terminal to access the video conference.
  • the access request 2 carries the internal media endpoint IP3':port3' allocated for the second conference terminal.
  • Step 618 the first conference server sends an access response 2 to the signaling server, and the access response 2 carries the media endpoint allocated by the first conference server to the second conference terminal, such as IP4:port4'.
  • the first conference terminal and the second conference terminal use the same first conference server, so the first conference server can assign the same IP address ip4 to the first conference terminal and the second conference terminal, but assign different IP addresses. port.
  • the first conference server is deployed in a cluster mode, and the first conference terminal and the second conference terminal may use different first conference servers or use the same first conference server.
  • the signaling server sends the media endpoint IP4:port4' of the first conference server to the media exchange server.
  • the media exchange server completes the internal media connection of the second conference terminal on the side of the media exchange server according to the media endpoint IP4:port4' of the first conference server and the internal media endpoint IP3':port3' of the second conference terminal, such as the internal media connection of the second conference terminal.
  • the internal media link is called InLink02.
  • the media exchange server completes the mutual association between the internal media connection InLink02 and the external media connection OutLink02 of the second conference terminal.
  • the media exchange server can associate the internal media endpoint and the external media endpoint allocated by the media exchange server for the second conference terminal according to the instruction of the signaling server, that is, complete the internal media connection and the external media endpoint of the second conference terminal.
  • the association of the external media connection of the second conference terminal is not limited to the association method of the first conference terminal.
  • Mode 2-1 when the signaling server sends the application request 4 to the media exchange server in step 615, after indicating to the media exchange server the internal media endpoint allocated for the second conference terminal, it can communicate with the external media endpoint allocated for the second conference terminal Create an association. Therefore, after the media exchange server finishes allocating the external media endpoints to the second conference terminal, it creates an association relationship between the internal media endpoints and the external media endpoints of the second conference terminal.
  • the application request 4 may carry the external media endpoint of the second conference terminal.
  • the second media connection is completed on the media exchange server due to the creation of the association relationship between the internal media endpoint and the external media endpoint of the second conference terminal. Create the association relationship between the internal media connection and the external media connection of the conference terminal.
  • the signaling server may indicate to the media exchange server that the internal media endpoint allocated for the second conference terminal is different from the internal media endpoint allocated for the second conference terminal. Establish an association relationship with the external media endpoint.
  • the signaling server when the signaling server sends the media endpoint allocated by the first conference server to the second conference terminal to the media exchange server in step 619, it can indicate to the media exchange server that the internal media endpoint allocated for the second conference terminal is the same as the internal media endpoint allocated for the second conference terminal.
  • An association relationship is established between the external media endpoints assigned by the two conference terminals.
  • the signaling server may indicate to the media switching server that the internal media endpoint allocated for the second conference terminal establishes an association relationship with the external media endpoint allocated for the second conference terminal.
  • the signaling server may apply to the media switching server for the external media port of the first conference terminal, and at the same time apply to the media switching server for the internal media port of the first conference terminal.
  • the application request 3 sent by the signaling server to the media exchange server is used not only to request the media exchange server to allocate an external media endpoint for the second conference terminal, but also to request the media exchange server to allocate an internal media endpoint to the second conference terminal.
  • the application response 4 fed back by the media exchange server to the signaling server in step 613 carries the allocation of internal media endpoints for the second conference terminal and the allocation of external media endpoints for the second conference terminal.
  • the signaling server applies to the media switching server for the internal media endpoint and the external media endpoint of the second conference terminal, it may also instruct the media switching server to associate the internal media endpoint and the external media endpoint allocated for the second conference terminal.
  • the application request 3 may also carry indication information 2, where the indication information 2 is used to instruct the media switching server to associate the internal media endpoint and the external media endpoint allocated for the second conference terminal. It should be noted that, when mode 2-5 is adopted, step 615 and step 616 are not executed again.
  • a participant uses a virtual machine in the desktop cloud system to connect to the video conferencing system.
  • the participant may be the An external media connection is established between the virtual machine and the media exchange server.
  • the subsequent media stream is forwarded, the media stream is sent to the terminal of the participant to display or play through the virtual machine.
  • the first conference server is an SFU conference server as an example.
  • step 801 the first conference terminal sends the generated audio and video stream to the media exchange server through the external media connection OutLink01 of the first conference terminal.
  • the first conference terminal sends the external media endpoint (ip2:port2) of the first conference terminal of the media exchange server through the media endpoint ip1:port1 according to the association relationship between the media endpoint ip1:port1 and the external media endpoint ip2:port2 .
  • Step 802 the media exchange server sends the audio and video stream to the first conference server according to the association relationship between the external media connection OutLink01 and the internal media connection InLink01 of the first conference terminal.
  • the media exchange server forwards the audio and video stream to the internal media endpoint (ip3:port3) of the first conference terminal, and sends it to the media endpoint (ip3:port3) of the first conference terminal of the first conference server through the internal media endpoint ip3:port3 ip4:port4).
  • the first conference server sends the message to the media exchange server through the internal media connection of the second conference terminal according to the forwarding rule.
  • the first conference server forwards the audio and video stream of the first conference terminal to the media endpoint (ip4:port4) of the second conference terminal in the first conference server according to the forwarding rule, and uses this endpoint ip4:port4 to send to The internal media endpoint (ip3':port3') of the second conference terminal of the media exchange server.
  • Step 804 the media exchange server sends the audio and video stream of the first conference terminal to the second conference terminal through the external media connection of the second conference terminal.
  • the media exchange server forwards the audio and video stream from the internal media endpoint of the second conference terminal to the external media endpoint (ip2':port2') of the second conference terminal, and then sends it to the media endpoint of the second conference terminal (ip1':port1'), so far, the video conference system completes sending the audio and video stream input by the first conference terminal to the second conference terminal.
  • the implementation process of forwarding the audio-video stream input by the second conference terminal to the first conference terminal is similar to the implementation process of forwarding the audio-video stream input by the first conference terminal to the second conference terminal. For details, see step 805-step 808.
  • Step 805 the second conference terminal sends the generated audio and video stream to the media exchange server through the external media connection OutLink02 of the second conference terminal.
  • the second conference terminal sends the external media of the second conference terminal to the media exchange server through the media endpoint ip1':port1' according to the association relationship between the media endpoint ip1':port1' and the external media endpoint ip2':port2' endpoint(ip2':port2').
  • Step 806 the media exchange server sends the audio and video stream to the first conference server according to the association relationship between the external media connection OutLink02 and the internal media connection InLink02 of the second conference terminal.
  • the media exchange server forwards the audio and video stream to the internal media endpoint (ip3':port3') of the second conference terminal, and sends it to the second conference terminal of the second conference server through the internal media endpoint ip3':port3' media endpoint (ip4:port4').
  • the first conference server sends the message to the media exchange server through the internal media connection of the first conference terminal according to the forwarding rule.
  • the first conference server forwards the audio and video stream of the second conference terminal to the media endpoint (ip4:port4) of the first conference terminal in the first conference server according to the forwarding rule, and uses this endpoint ip4:port4 to send to The internal media endpoint (ip3:port3) of the first conference terminal of the media exchange server.
  • Step 808 the media exchange server sends the audio and video stream of the second conference terminal to the first conference terminal through the external media connection of the first conference terminal.
  • the media exchange server forwards the audio and video stream from the internal media endpoint of the first conference terminal to the external media endpoint (ip2:port2) of the first conference terminal, and then sends it to the media endpoint (ip1:port2) of the first conference terminal :port1), so far, the video conferencing system sends the audio and video stream input by the second conference terminal to the first conference terminal.
  • the signaling server can configure the mutual viewing attributes of the participants, that is, configure forwarding rules to the first conference server.
  • different scenarios may have different configurations.
  • the two parties can be configured to watch each other.
  • the service representative can be configured to watch the user's video screen, and the user can watch the service representative's video screen.
  • the signaling server configures audio and video stream forwarding rules between the first conference terminal and the second conference terminal on the first conference server.
  • the first conference terminal After the first conference terminal generates the audio and video stream, it sends it to the first conference server, and the first conference server can forward the audio and video stream to the second conference terminal according to the forwarding rule.
  • the second conference terminal After the second conference terminal generates the audio and video stream, it sends it to the first conference server, and the first conference server can forward the audio and video stream to the first conference terminal according to the forwarding rule.
  • the first participant can be configured to watch the video image of the second participant, but the second participant does not watch the video image of the first participant.
  • multiple parties such as users, service representatives, and experts in video conferences, set the service representatives and experts to watch the user's video screen, and the user to watch the service representative's video screen.
  • the signaling server can be configured with different forwarding rules according to the scenario requirements. For example, each of the three participants watches the video images of the other participants.
  • the video conference mode needs to be changed due to the operation of a certain participant, such as switching from the SFU mode to the MCU mode, or switching from the MCU mode to the SFU mode.
  • a certain participant such as switching from the SFU mode to the MCU mode, or switching from the MCU mode to the SFU mode.
  • the video conference mode needs to be changed due to the operation of a certain participant, such as switching from the SFU mode to the MCU mode, or switching from the MCU mode to the SFU mode.
  • the switching of the conference mode from the first mode to the second mode as an example.
  • the first mode corresponds to the first conference server
  • the second mode corresponds to the second conference server. Take the switching from the first mode to the second mode initiated by the second conference terminal as an example.
  • FIG. 9A-FIG. 9D the conference mode switching process is described.
  • FIG. 9A and FIG. 9B are illustrated by taking the second possible implementation manner when switching the internal media connection associated with the external media connection as an example.
  • FIG. 9C and FIG. 9D are illustrated by taking the first possible implementation manner when switching the internal media connection associated with the external media connection as an example.
  • Step 901a the second conference terminal sends a conference mode switch request to the signaling server, and the conference mode switch request is used to instruct the conference mode to switch from the first mode to the second mode.
  • the conference terminal does not perceive the conference mode.
  • the signaling server determines that the conference recording is required according to the notification. If it is originally in the SFU mode, it will switch to the MCU mode and needs to be replaced.
  • a conferencing server that provides video conferencing services For another example, when requesting to stop the conference recording, the signaling server determines to stop the conference recording according to the request. If it is originally in the MCU mode, switch to the MCU mode, and the conference server that provides the video conference service needs to be replaced.
  • the signaling server instructs the first conference server to delete the first conference terminal from the video conference in the first mode.
  • the first conference server may release the media endpoint allocated to the first conference terminal according to the instruction of the signaling server. For example, if the media endpoint allocated to the first conference terminal is ip4:port4, the first conference server will release the media endpoint ip4:port4 allocated to the first conference terminal.
  • the first conference server may also delete the internal media connection of the first conference terminal created on the side of the first conference server.
  • the signaling server may trigger the media exchange server to disconnect the internal media connection with the first conference server and create an internal media connection with the second conference server.
  • Step 903a the signaling server instructs the media exchange server to disconnect the internal media connection of the first conference terminal.
  • the media exchange server may disconnect the internal media connection of the first conference terminal according to the instruction of the signaling server.
  • the internal media connection of the first conference terminal is a media connection between the internal media endpoint ip3:port3 allocated for the first conference terminal and the media endpoint ip4:port4 of the first conference server, and the media exchange server can delete the saved The media endpoint ip4:port4 of the first conference server. That is, the media exchange server modifies the media endpoint pointed to by the internal media endpoint ip3:port3 assigned by the first conference terminal to be empty, and disconnects the internal media connection of the first conference terminal, as shown in FIG. 9B .
  • the signaling server instructs the first conference server to delete the second conference terminal from the video conference in the first mode.
  • the first conference server may release the media endpoint allocated to the second conference terminal according to the instruction of the signaling server. For example, if the media endpoint allocated to the second conference terminal is ip4:port4', the first conference server will release the media endpoint ip4:port4' allocated to the first conference terminal.
  • the first conference server may also delete the internal media connection of the second conference terminal created on the side of the first conference server.
  • the signaling server instructs the media exchange server to delete the internal media connection of the second conference terminal.
  • the media exchange server may delete the internal media connection of the second conference terminal according to the instruction of the signaling server.
  • the internal media connection of the second conference terminal is a media connection between the internal media endpoint ip3':port3' allocated for the second conference terminal and the media endpoint ip4:port4' of the first conference server, and the media exchange server can Delete the saved media endpoint ip4:port4' of the first conference server. That is, the media exchange server will modify the media endpoint pointed to by the internal media endpoint ip3':port3' assigned by the second conference terminal to be empty.
  • steps 902a-903a and steps 904a-905a may be executed in parallel, and this embodiment of the present application does not limit the sequence of execution.
  • the signaling server completes the deletion of the two conference terminals from the video conference in the first mode. It should be noted that three or more conference terminals are required to participate in the video conference, and the signaling server will delete multiple conference terminals from the video conference in the first mode.
  • the signaling server may also control the first conference server to release the conference resources allocated for the first conference terminal and the second conference terminal.
  • the signaling server may instruct the first conference server to release the conference allocated by the first conference terminal and the second conference terminal when instructing the first conference server to delete the internal media connection between the first conference terminal and the second conference terminal. resource.
  • the signaling server deletes the conference terminal from the video conference in the first mode, it only releases the internal media connection between the media exchange server and the first conference server.
  • the external media connection between the conference terminals continues to be maintained, and it can be considered that the calls of the conference terminals are not hung up.
  • the internal media connection resources in the first mode are released in time, which can reduce resource waste and improve resource utilization.
  • Step 901c refer to step 901a, which will not be repeated here.
  • the signaling server instructs the media exchange server to cancel the association between the external media connection of the first conference terminal and the internal media connection of the first conference terminal.
  • the media switching server may cancel the association between the external media connection and the internal media connection of the first conference terminal according to the instruction of the signaling server.
  • the association relationship between the external media connection of the first conference terminal and the first internal media connection includes the association relationship between the first internal media endpoint ip3:port3 allocated for the first conference terminal and the external media endpoint ip2:port2.
  • the media exchange server may delete the association relationship between the first internal media endpoint ip3:port3 and the external media endpoint ip2:port2, as shown in FIG. 9D .
  • the signaling server instructs the media exchange server to cancel the association between the external media connection of the second conference terminal and the first internal media connection of the second conference terminal.
  • the media switching server may cancel the association relationship between the external media connection of the second conference terminal and the first internal media connection of the second conference terminal according to the instruction of the signaling server.
  • the association relationship between the external media connection of the second conference terminal and the first internal media connection of the second conference terminal includes the internal media endpoint ip3':port3' and the external media endpoint ip2':port2 allocated for the first conference terminal 'The relationship between.
  • the media exchange server can delete the association relationship between the internal media endpoint ip3':port3' and the external media endpoint ip2':port2'.
  • the signaling server completes the deletion of the two conference terminals from the video conference in the first mode. It should be noted that three or more conference terminals are required to participate in the video conference, and the signaling server will delete multiple conference terminals from the video conference in the first mode.
  • the signaling server deletes the conference terminal from the video conference in the first mode, it only cancels the association between the internal media connection and the external media connection of each conference terminal.
  • the external media connection between the conference terminals continues to be maintained, and it can be considered that the calls of the conference terminals are not hung up.
  • the creation process of the video conference in the second mode will be described.
  • the signaling server maintains the external media connection between the conference terminal and the media switching server through the media switching server.
  • the signaling server joins the first conference terminal and the second conference terminal into the video conference in the second mode, it can be understood that the internal media endpoints assigned to the first conference terminal and the second conference terminal are associated with the second conference server.
  • Step 1001a the signaling server sends the external media endpoint of the first conference terminal to the second conference server.
  • the signaling server sends an access request 3 to the second conference server, where the access request 3 includes the external media endpoint ip3:port3 of the first conference terminal.
  • the access request 3 is used to request the second conference server to add the first conference terminal to the video conference in the second mode.
  • the second conference server allocates a media endpoint, such as ip5:port5, to the first conference terminal.
  • the second conference server is an MCU conference server
  • the second conference server also allocates a channel encoder and a channel decoder to the first conference terminal.
  • Step 1002a the second conference server sends the media endpoint ip5:port5 assigned by the second conference server to the first conference terminal to the signaling server.
  • the second conference server can complete the creation of the internal media connection of the second conference terminal according to the media endpoint ip5:port5 allocated to the first conference terminal and the external media endpoint ip3:port3 of the first conference terminal.
  • the second conference server sends an access response 3 to the signaling server, where the access response 3 includes the media endpoint ip5:port5 allocated for the first conference terminal.
  • Step 1003a the signaling server sends the media endpoint ip5:port5 of the second conference server to the media exchange server.
  • the media exchange server completes the establishment of the internal media connection of the first conference terminal according to the media endpoint ip5:port5 of the second conference server and the internal media endpoint ip3:port3 of the first conference terminal. It can be understood as: the media exchange server establishes the association relationship between the internal media endpoint ip3:port3 of the first conference terminal and the media endpoint ip5:port5 of the second conference server, that is, updating the point of ip3:port3 to point to ip5:port5.
  • Step 1004a the signaling server sends the external media endpoint of the second conference terminal to the second conference server.
  • the signaling server sends an access request 4 to the second conference server, where the access request 4 includes the external media endpoint ip3':port3' of the second conference terminal.
  • the access request 4 is used to request the second conference server to add the second conference terminal to the video conference in the second mode.
  • the second conference server allocates a media endpoint, such as ip5:port5', to the second conference terminal.
  • the second conference server also allocates a channel encoder and a channel decoder to the second conference terminal.
  • Step 1005a the second conference server sends the media endpoint ip5:port5' assigned by the second conference server to the second conference terminal to the signaling server.
  • the second conference server can complete the establishment of the internal media connection of the first conference terminal according to the media endpoint ip5:port5' allocated for the second conference terminal and the internal media endpoint ip3':port3' of the second conference terminal.
  • the second conference server sends an access response 4 to the signaling server, and the access response 4 includes the media endpoint ip5:port5' allocated for the first conference terminal.
  • Step 1006a the signaling server sends the media endpoint ip5:port5' of the second conference server to the media exchange server.
  • the media exchange server completes the establishment of the internal media connection of the second conference terminal according to the media endpoint ip5:port5' of the second conference server and the internal media endpoint ip3':port3' of the second conference terminal. It can be understood as: the media exchange server establishes the association relationship between the internal media endpoint ip3':port3' of the second conference terminal and the media endpoint ip5:port5' of the second conference server, that is, the ip3':port3' pointing to empty is updated to point to ip5 :port5.
  • steps 1002a-1003a and steps 1004a-1005a may be executed in parallel, and this embodiment of the present application does not limit the sequence of execution.
  • the signaling server completes the process of two conference terminals joining the video conference in the first mode. It should be noted that three or more conference terminals are required to participate in the video conference, and the signaling server will execute a process of adding multiple conference terminals to the video conference in the second mode.
  • step 1001b the signaling server sends an application request 11 to the media exchange server, and the application request 11 requests to allocate an internal media endpoint in the second mode to the first conference terminal.
  • Step 1002b after receiving the application request 11, the media exchange server assigns the internal media endpoint IP33:port33 in the second mode to the first conference terminal, and sends an application response 11 to the signaling server.
  • Application Response 11 carries the internal media endpoint IP33:port33.
  • the media exchange server saves the association relationship between the external media endpoint IP2:port2 and the internal media endpoint IP33:port33.
  • Step 1003b the signaling server joins the first conference terminal into the video conference, that is, the signaling server sends an access request 5 to the second conference server, and the access request 5 carries the internal media endpoint IP33 allocated by the media switching server for the first conference terminal: port33;
  • Step 1004b the second conference server sends an access response 5 to the signaling server, and the access response 5 carries the media endpoint IP44:port44 allocated by the second conference server to the first conference terminal.
  • Step 1005b the signaling server sends a request for establishing an internal media connection to the media exchange server, carrying the media endpoint IP44:port44 of the second conference server.
  • the media exchange server establishes the internal media connection in the second mode.
  • Step 1006b the signaling server sends an application request 22 to the media exchange server, and the application request 22 requests to allocate an internal media endpoint in the second mode to the second conference terminal.
  • Step 1007b after receiving the application request 22, the media exchange server assigns the internal media endpoint IP33':port33' in the second mode to the second conference terminal, and sends the application response 22 to the signaling server.
  • Request Response 22 carries internal media endpoint IP33':port33'.
  • the media exchange server saves the association relationship between the external media endpoint IP2':port2' and the internal media endpoint IP33':port33'.
  • Step 1008b the signaling server joins the second conference terminal into the video conference, that is, the signaling server sends an access request 6 to the second conference server, and the access request 6 carries the internal media endpoint IP33' assigned by the media exchange server to the second conference terminal :port33';
  • Step 1009b the second conference server sends an access response 6 to the signaling server, and the access response 5 carries the media endpoint IP44:port44' assigned by the second conference server to the second conference terminal.
  • Step 1010b the signaling server sends a request for establishing an internal media connection to the media exchange server, carrying the media endpoint IP44:port44' of the second conference server.
  • the media exchange server establishes the internal media connection in the second mode.
  • the second conference server is an MCU conference server.
  • step 1101 refer to step 801, which will not be repeated here.
  • Step 1102 the media exchange server sends the audio and video stream of the first conference terminal to the second conference server according to the association relationship between the external media endpoint ip3:port3 of the first conference terminal and the media endpoint ip5:port5 of the second conference server.
  • the media exchange server forwards the audio and video stream to the internal media endpoint (ip3:port3) of the first conference terminal, and sends it to the media endpoint (ip3:port3) of the first conference terminal of the second conference server through the internal media endpoint ip3:port3 ip5:port5).
  • Step 1103 the second conference terminal sends the generated audio and video stream to the media exchange server through the external media connection of the second conference terminal.
  • the second conference terminal sends the external media of the second conference terminal to the media exchange server through the media endpoint ip1':port1' according to the association relationship between the media endpoint ip1':port1' and the external media endpoint ip2':port2' endpoint(ip2':port2').
  • Step 1104 the media exchange server sends the audio and video stream of the second conference terminal to the second conference according to the association relationship between the external media endpoint ip3':port3' of the second conference terminal and the media endpoint ip5:port5' of the second conference server server.
  • the media exchange server forwards the audio and video stream to the internal media endpoint (ip3':port3') of the second conference terminal, and sends it to the first conference terminal of the second conference server through the internal media endpoint ip3':port3' The media endpoint (ip5:port5').
  • Step 1105 the second conference server decodes the audio-video stream of the first conference terminal and the audio-video stream of the second conference terminal, and then decodes the decoded audio-video data of the first conference terminal and the decoded audio-video data of the second conference terminal
  • the audio and video data are mixed and screen mixed, and then the audio and video data after the audio and video mixing and screen mixed are encoded to obtain an encoded audio and video stream.
  • the second conference server decodes the video stream of the first conference terminal through a channel decoder allocated to the first conference terminal.
  • the second conference server decodes the video stream of the second conference terminal through the channel decoder allocated to the second conference terminal.
  • the second conference server encodes the audio and video data after audio mixing and screen mixing processing through the channel encoder assigned to the first conference terminal.
  • the second conference server encodes the audio and video data after audio mixing and screen mixing processing through the channel encoder assigned to the second conference terminal to obtain the encoded audio and video stream 2 sent to the second conference terminal.
  • Step 1106 the second conference server sends the encoded audio and video stream 1 to the media exchange server through the internal media connection of the first conference terminal.
  • the second conference server forwards the encoded audio and video stream 1 to the media endpoint (ip5:port5) of the first conference terminal in the second conference server, and uses this endpoint ip5:port5 to send to the first conference of the media exchange server The endpoint's internal media endpoint (ip3:port3).
  • Step 1107 the media exchange server sends the encoded audio and video stream 1 to the first conference terminal through the external media connection of the first conference terminal.
  • the media exchange server forwards the encoded audio and video stream 1 to the external media endpoint (ip2:port2) of the first conference terminal, and then sends it to the media endpoint (ip1:port1) of the first conference terminal. Further, the first participant can watch the mixed video image of the first participant's video image and the second participant's video image through the first conference terminal, and hear the mixed sound.
  • Step 1108 the second conference server sends the encoded audio and video stream 2 to the media exchange server through the internal media connection of the second conference terminal.
  • the second conference server forwards the encoded audio and video stream 2 to the media endpoint (ip5:port5') of the second conference terminal in the second conference server, and uses this endpoint ip5:port5' to send to the media exchange server's first The internal media endpoint (ip3':port3') of the two conference endpoints.
  • Step 1109 the media exchange server sends the encoded audio and video stream 2 to the second conference terminal through the external media connection of the second conference terminal.
  • the media exchange server forwards the encoded audio and video stream 2 to the external media endpoint (ip2':port2') of the second conference terminal, and then sends it to the media endpoint (ip1':port1') of the second conference terminal. Further, the first participant can watch the mixed video image of the first participant's video image and the second participant's video image through the first conference terminal, and hear the mixed sound.
  • the second conference terminal when the second conference terminal triggers the conference recording, it triggers the switching of the conference mode from the SFU mode to the MCU mode.
  • the signaling server After the signaling server completes joining the first conference terminal and the second conference terminal into the video conference in the MCU mode, it controls and allocates a recording server for recording the video conference.
  • the recording server is deployed in a cluster mode, and the signaling server controls the selection of the recording server for recording the video conference from the recording server cluster.
  • the signaling server sends indication information 3 to the second conference server, where the indication information 3 is used to instruct the second conference server to start conference recording.
  • the second conference server allocates a recorded encoder for the video conference.
  • the second conference server executes step 1104, after performing audio mixing and screen mixing processing on the decoded audio and video data of the first conference terminal and the decoded audio and video data of the second conference terminal, it also executes:
  • Step 1112 the second conference server encodes the audio and video data processed by audio mixing and screen mixing to obtain encoded audio and video stream 3 .
  • Step 1113 the second conference server sends the encoded audio and video stream 3 to the recording server.
  • the recording server decodes the encoded audio and video stream 3 according to the recorded file format and writes it into a video file.
  • the service representative judges the need for service experts based on the content of the call, and initiates the process of inviting the expert to join the video conference through the service representative terminal device.
  • the second conference terminal invites a third participant to join the video conference as an example. See Figure 12:
  • Step 1201 the second conference terminal notifies the signaling server to call the third conference terminal to join the video conference.
  • the second conference terminal sends a notification message to the signaling server, and the notification message is used to notify the signaling server to call the third conference terminal to join the video conference.
  • Step 1202 after receiving the notification message, the signaling server sends a call request 3 to the third conference terminal, where the call request 3 is used to request the third conference terminal to access the video conference.
  • Step 1203 after receiving the call request 3, the third conference terminal sends a call response 3 to the signaling server, and the call response 3 carries the media endpoint of the third conference terminal, such as IP1":port1".
  • Step 1204 the signaling server sends an application request 5 to the media exchange server, where the application request 5 is used to request the media exchange server to allocate an external media endpoint for the third conference terminal.
  • the application request 5 may carry the media endpoint IP1":port1" of the third conference terminal.
  • the media exchange server allocates the external media endpoint for the third conference terminal, for example, the external media endpoint allocated for the third conference terminal is IP2":port2", according to the media endpoint IP1":port1" of the third conference terminal and the third The external media endpoint IP2":port2" allocated by the conference terminal completes the creation of the external media connection on the side of the media exchange server.
  • Step 1205 the media exchange server sends an application response 5 to the signaling server, and the application response 5 carries the external media endpoint IP2":port2" allocated by the media exchange server to the third conference terminal.
  • Step 1206 the signaling server sends the external media endpoint IP2":port2" assigned to the third conference terminal to the third conference terminal, and then the third conference terminal according to its own media endpoint IP1":port1" and the external media endpoint IP2": port2" to complete the creation of the external media connection on the third conference terminal side, for example, the external media connection of the third conference terminal is called OutLink03.
  • the signaling server may first request the media exchange server to allocate an external media endpoint for the third conference terminal before making an outbound call to the third conference terminal. Then, when the call request 3 is sent to the third conference terminal, the external media endpoint allocated for the third conference terminal is sent to the third conference terminal.
  • the signaling server may apply for a media endpoint from the media exchange server after receiving the call response 3 sent by the third conference terminal.
  • Figure 12 takes this method as an example.
  • Step 1207 the signaling server sends an application request 6 to the media exchange server, where the application request 6 is used to request the media exchange server to allocate an internal media endpoint for the third conference terminal.
  • Step 1208 after the media exchange server receives the application request 6, it allocates an internal media endpoint for the third conference terminal, such as IP3":port3", and then sends an application response 6 to the signaling server, and the application response 6 includes that the media exchange server is the third conference terminal.
  • Step 1209 after receiving the application response 6, the signaling server requests the second conference server to add the third conference terminal to the video conference.
  • the signaling server sends an access request 7 to the second conference server, where the access request 7 is used to request the third conference terminal to access the video conference.
  • the access request 7 carries the internal media endpoint IP3":port3" allocated for the third conference terminal.
  • Step 1210 the second conference server sends an access response 7 to the signaling server, and the access response 7 carries the media endpoint assigned by the second conference server to the third conference terminal, such as IP5:port5".
  • Step 1211 the signaling server sends the media access server the media endpoint IP5:port5" assigned by the second conference server to the third conference terminal.
  • the signaling server, the conference terminal (such as the first conference terminal, the second conference terminal), and the conference server (such as the first conference server or the second conference server) include execution The hardware structure and/or software module corresponding to each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software with reference to the units and method steps of the examples described in the embodiments disclosed in the present application. Whether a certain function is executed by hardware or computer software drives the hardware depends on the specific application scenario and design constraints of the technical solution.
  • FIG. 13 is a schematic block diagram of a communication device 1300 provided by an embodiment of the present application.
  • the communication device 1300 includes a processing module 1310 and a transceiver module 1320 .
  • the communications apparatus 1300 may be applied to a signaling server or a chip in the signaling server. It is used to implement the method performed by the signaling server in any of the foregoing embodiments.
  • a transceiver module 1320 configured to acquire a conference mode switching request
  • the processing module 1310 is configured to trigger the media exchange server to switch the first internal media connection associated with the external media connection to the second internal media connection according to the conference mode switching request; wherein: the external media connection is used for the first conference terminal and The media data of the video conference is transmitted between the media exchange servers; the first conference terminal is any conference terminal participating in the conference; the first internal media connection is used to transmit the media data of the video conference between the media exchange server and the first conference server; The second internal media connection is used to transmit media data of the video conference between the media exchange server and the second conference server.
  • the processing module 1310 when triggering the media switching server to switch the first internal media connection associated with the external media connection to the second internal media connection, is specifically configured to: trigger the media switching server to cancel the connection between the external media connection and the second internal media connection An association relationship of an internal media connection, and associates the external media connection with the second internal media connection.
  • the processing module 1310 is further configured to trigger the media exchange server to delete the first internal media connection to delete the first internal media connection.
  • the processing module 1310 triggers the media exchange server to disconnect the first internal media connection established between the media exchange server and the first conference server, and establishes the connection between the media exchange server and the first conference server. A second internal media connection between two conference servers.
  • the processing module 1310 is also used to: when the first conference terminal joins the video conference, trigger the media exchange server and the first conference terminal to create an external media connection through the transceiver module 1320, and trigger the media exchange server to communicate with the first conference terminal
  • the server creates the first internal media connection and triggers the media exchange server to associate the external media connection with the first internal media connection.
  • the processing module 1310 is further configured to: after acquiring the conference mode switching request, trigger the creation of a second internal media connection between the media exchange server and the second conference server through the transceiver module 1320 .
  • the transceiver module 1320 is also configured to: receive a first request from the first conference terminal, the first request includes the media port information of the first conference terminal; send a second request to the media exchange server, the second request The media port information used to request the establishment of an external media connection, the second request carries the media port information of the first conference terminal; receives the second response sent by the media exchange server, the second response carries the first media port information of the media exchange server, and the media The first media port information of the switching device is used to create an external media connection of the first conference terminal; a first response is sent to the first conference terminal, and the first response carries the first media port information of the media switching server.
  • the second response sent by the media switching server received by the transceiver module 1320 also carries the second media port information of the media switching server, and the second media port information of the media switching device is used to create the second media port information of the first conference terminal.
  • An internal media connection; the transceiver module 1320 is also used to send a conference access request to the first conference server, the conference access request is used to request the first conference terminal to connect to the first conference server, and the conference access request carries the second Media port information; sending a conference access response to the first conference server, where the conference access response carries the media port information of the first conference server; sending the media port information of the first conference server to the media exchange server.
  • the transceiver module 1320 is also used to receive the first request from the second conference terminal, the first request is used to request the first conference terminal to access the video conference; send the second request to the media exchange server, the second request The first media port information for requesting the establishment of the external media connection; receiving the second response sent by the media switching server, the second response carrying the first media port information of the media switching server.
  • the second request is also used to request information on the second media port for establishing the first internal media connection
  • the second response also carries the second media port information of the media switching server
  • a conference server sends a first conference access request, the first conference access request is used to request the first conference terminal to connect to the first conference server, and the first conference access request carries the second media port information of the media exchange server; receiving the first The first conference access response sent by the conference server, the first conference access response carrying the media port information of the first conference server; sending the media port information of the first conference server to the media exchange server.
  • the transceiving module 1320 is further configured to send a first association request to the media exchange server, where the first association request is used to instruct the media exchange server to establish an association relationship between the first media port information and the second media port information.
  • the transceiving module 1320 is further configured to send the second request to the media exchange server to instruct the media exchange server to establish an association relationship between the first media port information and the second media port information.
  • the transceiver module 1320 is further configured to send a disassociation request to the media exchange server, where the disassociation request is used to instruct the media exchange server to cancel the association relationship between the first media port information and the second media port information.
  • the transceiver module 1320 when triggering the establishment of the second internal media connection between the media exchange server and the second conference server, is further configured to send a third request to the media exchange server, and the third request is used to request the establishment of the second internal media connection.
  • the third media port information of the internal media connection receiving the third response sent by the media exchange server, the third response carries the third media port information; sending the second conference access request to the second conference server, and the second conference access request uses
  • the second conference access request carries the third media port information; receives the second conference access response sent by the second conference server, and the second conference access response carries the second conference server the media port information of the second conference server; and send the media port information of the second conference server to the media exchange server.
  • the transceiver module 1320 when the media exchange server is triggered to associate the external media connection with the second internal media connection, the transceiver module 1320 is further configured to send a second association request to the media exchange server, and the second association request is used to indicate the media exchange The server establishes an association relationship between the first media port information and the third media port information.
  • the processing module 1310 triggers the media exchange server to delete the media port information of the first conference server.
  • the transceiver module 1320 sends a second conference access request to the second conference server, the second conference request is used to request the first conference terminal to connect to the second conference server, and the fourth request carries the first media port information; receiving The second conference access response sent by the second conference server, the second conference access response carrying the media port information of the second conference server; sending the media port information of the second conference server to the media exchange server.
  • the transceiving module 1320 is further configured to respectively instruct the first conference server and the media exchange server to delete the first internal media connection.
  • the transceiver module 1320 when acquiring the conference mode switching request, is specifically configured to receive the conference mode switching request sent from the third conference terminal; the third conference terminal is one of the conference terminals participating in the conference that supports enabling the conference recording service A conference terminal.
  • the conference terminal participating in the conference includes at least two user terminal devices, or includes a user terminal device and a service representative terminal device, or includes a user terminal device, a service representative terminal device, and a user terminal device, a service representative terminal device and a user terminal device.
  • Expert terminal equipment included in the conference.
  • the communication device 1300 may be applied to a media exchange server or a chip in the media exchange server. It is used to implement the method performed by the media exchange server in any of the foregoing embodiments.
  • the transceiver module 1320 is configured to receive a trigger instruction from the signaling server.
  • the processing module 1310 switches the first internal media connection associated with the external media connection to a second internal media connection according to the trigger instruction; the external media connection is used to transmit video conference media data between the first conference terminal and the media exchange server;
  • the first conference terminal is any conference terminal participating in the conference; the first internal media connection is used to transmit the media data of the video conference between the media exchange server and the first conference server; the second internal media connection is used to connect the media exchange server and the first conference server The media data of the video conference is transmitted between the second conference servers.
  • the processing module 1310 is specifically configured to cancel the association relationship between the external media connection and the first internal media connection, and associate the external media connection with the second internal media connection.
  • the processing module 1310 deletes the first internal media connection.
  • the processing module 1310 is specifically configured to disconnect the first internal media connection established between the media exchange server and the first conference server, and establish the media exchange server and the second conference server The second internal media connection between.
  • the processing module 1310 is further configured to establish an external media connection with the first conference terminal, and establish a first internal media connection with the first conference server.
  • the transceiver module 1320 is also used to receive the media port information of the first conference terminal sent by the signaling server; send the first media port information of the media exchange server to the first conference terminal through the signaling server; The media port information of the terminal and the first media port information of the media exchange server are used to create an external media connection of the first conference terminal.
  • the transceiver module 1320 is also used to send the second media port information of the media exchange server to the first conference server through the signaling server; receive the media port information of the first conference server sent by the signaling server; The media port information of the server and the second media port information of the media exchange server are used to create the first internal media connection of the first conference terminal.
  • the transceiver module 1320 is also used to receive indication information from the signaling server, the indication information is used to indicate the associated external media connection and the first internal media connection; the processing module 1310 establishes the first media port information and the second media port information information relationship.
  • the processing module 1310 when the processing module 1310 cancels the association relationship between the external media connection and the first internal media connection, it may cancel the association relationship between the first media port information and the second media port information.
  • the processing module 1310 establishes the second internal media connection after the transceiver module 1320 receives the trigger instruction from the signaling server and before associating the external media connection with the second internal media connection.
  • the transceiver module 1320 sends the third media port information of the media exchange server to the second conference server through the signaling server; receives the media port information of the second conference server sent by the signaling server; the media port information of the second conference server The port information and the third media port information of the media exchange server are used to create the second internal media connection of the first conference terminal; the processing module 1310 establishes the first media port when performing associating the external media connection with the second internal media connection The association relationship between the information and the third media port information.
  • the processing module 1310 deletes the media port information of the first conference server; the transceiver module 1320 sends the second media port information of the media exchange server to the second conference server through the signaling server; receives the second media port information sent by the signaling server The media port information of the conference server; wherein, the second media port information and the media port information of the second conference server are used to create the second internal media connection.
  • each module in the device can be realized in the form of software called by the processing element; they can also be realized in the form of hardware; some modules can also be realized in the form of software called by the processing element, and some modules can be realized in the form of hardware.
  • each module can be a separate processing element, or it can be integrated in a certain chip of the device.
  • it can also be stored in the memory in the form of a program, which is called and executed by a certain processing element of the device. Function.
  • all or part of these modules can be integrated together, and can also be implemented independently.
  • the processing element mentioned here may also be a processor, which may be an integrated circuit with signal processing capability.
  • each step of the above method or each module above may be realized by an integrated logic circuit of hardware in the processor element, or implemented in the form of software called by the processing element.
  • FIG. 14 is a schematic structural diagram of a possible communication device 1400 provided by an embodiment of the present application.
  • the communication device 1400 may be used to implement the functions of the signaling server or the media exchange server in the above method embodiments, and thus also realize the beneficial effects of the above method embodiments.
  • a communication device 1400 includes a processor 1410 and an interface circuit 1420 .
  • the processor 1410 and the interface circuit 1420 are coupled to each other.
  • the interface circuit 1420 may be a transceiver or an input-output interface.
  • the communication device 1400 may further include a memory 1430 for storing instructions executed by the processor 1410 or storing input data required by the processor 1410 to execute the instructions or storing data generated after the processor 1410 executes the instructions.
  • the processor in the embodiment of the present application can be a central controller (CPU, central processing unit), a general processor, a co-controller, a digital signal processor (digital signal processor, DSP), an application specific integrated circuit (ASIC, application-specific integrated circuit), field programmable gate array (FPGA, field programmable gate array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof.
  • the controller can also be a combination of computing functions, such as a combination of one or more microcontrollers, a combination of a DSP and a microcontroller, and so on.
  • the processor 1410 is used to execute the functions of the above-mentioned processing module 1410
  • the interface circuit 1420 is used to execute the functions of the above-mentioned transceiver module 1320 .
  • the communication device When the above communication device is applied to a signaling server or a chip of a signaling server, the communication device implements the function of the signaling server in the above method embodiment.
  • the communication device When the above communication device is applied to a media exchange server or a chip of the media exchange server, the communication device implements the function of the media exchange server in the above method embodiment.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program implements the method implemented by the aforementioned signaling server or media switching server when executed by a computing device.
  • the present application also provides a computer program product, which includes computer instructions.
  • the computer instructions When the computer instructions are executed by the computing device, the method implemented by the aforementioned signaling server or media switching server is realized.
  • system and “network” are often used interchangeably herein.
  • the term “and/or” in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations.
  • the character “/” in this article generally indicates that the contextual objects are an "or” relationship.
  • the term “at least one” involved in this application refers to one, or more than one, including one, two, three and more; “plurality” refers to two, or more than two, including two, Three or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items.
  • At least one item (piece) of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple .
  • "B corresponding to A" means that B is associated with A, and B can be determined according to A.
  • determining B according to A does not mean determining B only according to A, and B may also be determined according to A and/or other information.
  • the method steps in the embodiments of the present application may be implemented by means of hardware, or may be implemented by means of a processor executing software instructions.
  • Software instructions can be composed of corresponding software modules, and software modules can be stored in random access memory, flash memory, read-only memory, programmable read-only memory, erasable programmable read-only memory, electrically erasable programmable read-only Memory, registers, hard disk, removable hard disk, CD-ROM or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium.
  • the storage medium may also be a component of the processor.
  • the processor and storage medium can be located in the ASIC.
  • the ASIC can be located in a network device or a terminal. Certainly, the processor and the storage medium may also exist in the network device or the terminal as discrete components.
  • all or part of them may be implemented by software, hardware, firmware or any combination thereof.
  • software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product comprises one or more computer programs or instructions. When the computer program or instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are executed in whole or in part.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, network equipment, user equipment, or other programmable devices.
  • the computer program or instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be downloaded from a website, computer, A server or data center transmits to another website site, computer, server or data center by wired or wireless means.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrating one or more available media.
  • the available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; and it may also be a semiconductor medium, such as a solid state disk.
  • the computer readable storage medium may be a volatile or a nonvolatile storage medium, or may include both volatile and nonvolatile types of storage media.
  • the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions
  • the device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本申请公开一种切换会议模式的方法、装置及介质，用以会议服务器切换时耗时较长的问题。本申请实施例在视频会议系统中配置媒体交换服务器，会议终端在与会议服务器建立媒体连接时经过媒体交换服务器。媒体连接包括会议终端与媒体交换服务器的外部媒体连接以及媒体交换服务器与会议服务器的内部媒体连接。在需要切换会议模式时，仅需要媒体交换服务器的外部媒体连接与模式切换前会议服务器的内部媒体连接的关联切换为模式切换后的会议服务器的内部媒体连接。会议终端不需要与媒体交换服务器之间断开外部媒体连接，并且由于会议服务器与媒体交换服务器在同一视频会议系统中，内部切换服务器的切换时间远小于外部切换时间，使得切换时间很短。

Description

一种切换会议模式的方法、装置及介质
相关申请的交叉引用
本申请要求在2021年09月30日提交中国专利局、申请号为202111160039.6、申请名称为“一种切换会议模式的方法、装置及介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及通信技术领域，尤其涉及一种切换会议模式的方法、装置及介质。
背景技术
随着第五代(5G)通信技术的成熟，网络的传输带宽成倍增加，视频相关业务得到迅猛发展，视频通话、视频会议等业务在呼叫中心中得到广泛的应用。
在视频会议领域，需要视频服务器对参与方的音视频流处理，让每个参与方能听到/看到期望的用户声音/视频。呼叫中心中部署不同的会议服务器，提供不同的会议服务，比如仅负责转发的服务器和负责音视频混合处理的服务器。目前在切换会议服务时，需要断开会议终端与一个会议服务器之间的媒体连接，然后重新建立该会议终端与另一个会议服务器之间的媒体连接，导致切换耗时较长，降低用户体验。
发明内容
本申请实施例提供一种切换会议模式的方法、装置及介质，用以解决会议服务器切换时，导致耗时较长的问题。
第一方面，本申请实施例提供一种切换会议模式的方法，应用于媒体交换服务器，方法包括：媒体交换服务器接收信令服务器发送的触发指令，根据所述触发指令将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；外部媒体连接用于在第一会议终端和媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；第一内部媒体连接用于在媒体交换服务器与第一会议服务器之间传输视频会议的媒体数据；第二内部媒体连接用于在媒体交换服务器与第二会议服务器之间传输视频会议的媒体数据，第一会议服务器提供选择性转发模式的视频会议服务，第二会议服务器提供多点控制模式的视频会议服务器；或者，第一会议服务器提供多点控制模式的视频会议服务，第二会议服务器提供选择性转发模式的视频会议服务。
上述方案，媒体交换服务器在信令服务器的指示下，将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，并不需要执行重新将会议终端接入会议的流程。并且由于会议服务器与媒体交换服务器均在一个视频会议系统内部，内部切换服务器的切换时间远小于外部切换时间，因此，可以减少会议服务切换的切换时长。并且对于参与方来说，并未与视频会议系统断开连接，使得参与方几乎感知不到会议服务器的切换。
在一种可能的设计中，媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：媒体交换服务器取消外部媒体连接与第一内部媒体连接 之间的关联关系，并将外部媒体连接与第二内部媒体连接相关联。通过上述设计，在需要切换会议模式时，信令服务器触发断开外部媒体连接与第一内部媒体连接的关联，然后重新与第二内部媒体连接建立关联，不再需要执行重新将会议终端接入会议的流程。提高切换效率。
在一种可能的设计中，该方法还可以包括：媒体交换服务器删除所述第一内部媒体连接。通过上述设计，在需要切换会议模式时，将原有的第一内部媒体连接删除，以释放第一内部媒体连接占用的资源，从而提供资源利用率。
在一种可能的设计中，媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：媒体交换服务器断开媒体交换服务器与第一会议服务器之间建立的第一内部媒体连接，并建立媒体交换服务器与第二会议服务器之间的第二内部媒体连接。通过上述设计，在需要切换会议模式时，信令服务器触发断开媒体交换服务器与第一会议服务器之间的第一内部媒体连接，然后再触发建立媒体交换服务器与第二会议服务器之间的第二内部媒体连接，不再需要执行重新将会议终端接入会议的流程。提高切换效率。
在一种可能的设计中，方法还包括：媒体交换服务器在将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接之前，媒体交换服务器创建外部媒体连接，以及创建第一内部媒体连接。
一些实施例中，媒体交换服务器在信令服务器的触发下建立外部媒体连接与第一内部媒体连接之间的关联。
在一种可能的设计中，媒体交换服务器与第一会议终端之间创建外部媒体连接，包括：媒体交换服务器接收信令服务器发送的第一会议终端的媒体端口信息；媒体交换服务器通过信令服务器向第一会议终端发送媒体交换服务器的第一媒体端口信息；第一会议终端的媒体端口信息和媒体交换服务器的第一媒体端口信息用于创建第一会议终端的外部媒体连接。
在一种可能的设计中，媒体交换服务器创建第一内部媒体连接，包括：媒体交换服务器接收信令服务器发送的第二请求，第二请求携带第一会议终端的媒体端口信息；媒体交换服务器向信令服务器发送第二响应，第二响应携带媒体交换服务器的第一媒体端口信息；第一会议终端的媒体端口信息和媒体交换服务器的第一媒体端口信息用于创建第一会议终端的外部媒体连接。上述设计中，通过媒体交换服务器通过信令服务器与第一会议服务器之间交换媒体端口信息以完成第一内部媒体连接的创建。
在一种可能的设计中，媒体交换服务器创建第一内部媒体连接，包括：第二响应中还携带媒体交换服务器的第二媒体端口信息；媒体交换服务器接收信令服务器发送的第一会议服务器的媒体端口信息；第一会议服务器的媒体端口信息和媒体交换服务器的第二媒体端口信息用于创建第一会议终端的第一内部媒体连接。
在一种可能的设计中，方法还包括：媒体交换服务器接收信令服务器的指示信息，指示信息用于指示关联外部媒体连接和第一内部媒体连接；媒体交换服务器建立第一媒体端口信息与第二媒体端口信息的关联关系。
在一种可能的设计中，媒体交换服务器取消外部媒体连接与第一内部媒体连接之间的关联关系，包括：媒体交换服务器取消第一媒体端口信息与第二媒体端口信息的关联关系。
在一种可能的设计中，方法还包括：媒体交换服务器接收信令服务器的触发指令后， 将外部媒体连接与第二内部媒体连接相关联之前，建立第二内部媒体连接。
在一种可能的设计中，媒体交换服务器建立第二内部媒体连接，包括：媒体交换服务器通过信令服务器向第二会议服务器发送媒体交换服务器的第三媒体端口信息；媒体交换服务器接收信令服务器发送的第二会议服务器的媒体端口信息；第二会议服务器的媒体端口信息和媒体交换服务器的第三媒体端口信息用于创建第一会议终端的第二内部媒体连接；媒体交换服务器将外部媒体连接与第二内部媒体连接相关联，包括媒体交换服务器建立第一媒体端口信息与第三媒体端口信息的关联关系。
在一种可能的设计中，媒体交换服务器断开媒体交换服务器与第一会议服务器之间建立的第一内部媒体连接，包括：媒体交换服务器删除第一会议服务器的媒体端口信息；媒体交换服务器建立媒体交换服务器与第二会议服务器之间的第二内部媒体连接，包括：媒体交换服务器通过信令服务器向第二会议服务器发送媒体交换服务器的第二媒体端口信息；媒体交换服务器接收信令服务器发送的第二会议服务器的媒体端口信息；其中，第二媒体端口信息和第二会议服务器的媒体端口信息用于创建第二内部媒体连接。通过上述设计，媒体交换服务器在断开连接时，并不会断开第一媒体端口信息与第二媒体端口信息之间的关联关系，仅重新建立第二内部媒体连接，不仅能够提高切换速率，还能够提升资源利用率。
第二方面，本申请实施例提供一种切换会议模式的方法，应用于信令服务器，信令服务器用于使第一会议服务器和第二会议服务器为参与会议的会议终端提供不同模式的视频会议服务，第一会议服务器/第二会议服务器分别提供选择性转发模式/多点控制模式的视频会议服务，或者，第一会议服务器/第二会议服务器分别提供多点控制模式/选择性转发模式的视频会议服务，信令服务器与媒体交换服务器相连，媒体交换服务器分别与第一会议服务器和第二会议服务器相连，所述方法包括：信令服务器获取会议模式切换请求；响应于会议模式切换请求，信令服务器触发媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；其中：外部媒体连接用于在第一会议终端和媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；第一内部媒体连接用于在媒体交换服务器与第一会议服务器之间传输视频会议的媒体数据；第二内部媒体连接用于在媒体交换服务器与第二会议服务器之间传输视频会议的媒体数据。
本申请通过上述方案，在需要切换会议模式，或者说需要切换会议服务器时，仅需要切换与外部媒体连接关联的内部媒体连接，并不需要执行重新将会议终端接入会议的流程。并且由于会议服务器与媒体交换服务器均在一个视频会议系统内部，内部切换服务器的切换时间远小于外部切换时间，因此，可以减少会议服务切换的切换时长。并且对于参与方来说，并未与视频会议系统断开连接，使得参与方几乎感知不到会议服务器的切换。
在一种可能的设计中，信令服务器触发媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，可以通过如下方式实现：信令服务器触发媒体交换服务器取消外部媒体连接与第一内部媒体连接的关联关系，并将外部媒体连接与第二内部媒体连接相关联。通过上述设计，在需要切换会议模式时，信令服务器触发断开外部媒体连接与第一内部媒体连接的关联，然后重新与第二内部媒体连接建立关联，不再需要执行重新将会议终端接入会议的流程。提高切换效率。
在一种可能的设计中，该方法还包括：信令服务器还触发所述媒体交换服务器删除所 述第一内部媒体连接。
在一种可能的设计中，该方法还可以包括：信令服务器触发媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：信令服务器触发媒体交换服务器断开媒体交换服务器与第一会议服务器之间建立的第一内部媒体连接，并建立媒体交换服务器与第二会议服务器之间的第二内部媒体连接。
在一种可能的设计中，上述方法还包括：在第一会议终端加入视频会议时，信令服务器触发媒体交换服务器和第一会议终端创建外部媒体连接，以及触发媒体交换服务器与第一会议服务器创建第一内部媒体连接，并触发媒体交换服务器将外部媒体连接与第一内部媒体连接相关联。上述设计中，在会议终端接入视频会议时，信令服务器触发创建外部媒体连接以及内部媒体连接，并触发媒体交换服务器将外部媒体连接与第一内部媒体连接相关联，通过增加的媒体交换服务器来实现视频数据的转发，进而会议模式切换时，提高切换效率，减少切换时延。
在一种可能的设计中，信令服务器获取会议模式切换请求后，上述方法还包括：信令服务器触发媒体交换服务器与第二会议服务器之间创建第二内部媒体连接。
在一种可能的设计中，上述方法还可以包括：信令服务器接收来自第一会议终端的第一请求，第一请求包括第一会议终端的媒体端口信息；信令服务器触发媒体交换服务器和第一会议终端之间创建外部媒体连接，包括：信令服务器向媒体交换服务器发送第二请求，第二请求用于请求建立外部媒体连接的媒体端口信息，第二请求携带第一会议终端的媒体端口信息；信令服务器接收媒体交换服务器发送的第二响应，第二响应携带媒体交换服务器的第一媒体端口信息，媒体交换设备的第一媒体端口信息用于创建第一会议终端的外部媒体连接；信令服务器向第一会议终端发送第一响应，第一响应携带媒体交换服务器的第一媒体端口信息。
上述设计中，在第一会议终端主动加入视频会议时，通过信令服务器控制媒体交换服务器、会议终端之间进行媒体端口信息的交换来实现外部媒体连接的建立，简单且有效。
在一种可能的设计中，信令服务器触发媒体交换服务器与第一会议服务器之间创建第一内部媒体连接，包括：信令服务器接收到媒体交换服务器发送的第二响应中还携带媒体交换服务器的第二媒体端口信息，媒体交换设备的第二媒体端口信息用于创建第一会议终端的第一内部媒体连接；信令服务器向第一会议服务器发送会议接入请求，会议接入请求用于请求第一会议终端连接第一会议服务器，会议接入请求携带媒体交换服务器的第二媒体端口信息；信令服务器接收第一会议服务器发送的第一会议接入响应，第一会议接入响应携带第一会议服务器的媒体端口信息；信令服务器向媒体交换服务器发送第一会议服务器的媒体端口信息。
上述设计中，通过信令服务器控制媒体交换服务器、会议服务器之间进行媒体端口信息的交换来实现内部媒体连接的建立，简单且有效。并且在媒体交换服务器在为会议终端分配外部媒体连接的媒体端口信息，一并将内部媒体连接的媒体端口信息分配给信令服务器，从而信令服务器触发建立内部媒体连接时，无需再次发送申请请求来申请媒体端口信息，提高媒体连接的创建效率，减少时延。
在一种可能的设计中，上述方法还包括：信令服务器接收来自第二会议终端的第一请求，第一请求用于请求第一会议终端接入视频会议；信令服务器触发媒体交换服务器和第一会议终端之间创建外部媒体连接，包括：信令服务器向媒体交换服务器发送第二请求， 第二请求用于请求建立外部媒体连接的第一媒体端口信息；信令服务器接收媒体交换服务器发送的第二响应，第二响应携带媒体交换服务器的第一媒体端口信息。方法还包括：信令服务器向第一会议终端发送第一响应，第一响应携带媒体交换服务器的第一媒体端口信息。
上述设计中，第一会议终端可以由第二会议终端的邀请来加入视频会议，通过信令服务器控制媒体交换服务器、第一会议终端之间进行媒体端口信息的交换来实现外部媒体连接的建立，简单且有效。
在一种可能的设计中，信令服务器触发媒体交换服务器与第一会议服务器之间创建第一内部媒体连接，包括：第二请求还用于请求建立第一内部媒体连接的第二媒体端口信息，第二响应中还携带媒体交换服务器的第二媒体端口信息；信令服务器向第一会议服务器发送会议接入请求，会议接入请求用于请求第一会议终端连接第一会议服务器，会议接入请求携带媒体交换服务器的第二媒体端口信息；信令服务器接收第一会议服务器发送的会议接入响应，会议接入响应携带第一会议服务器的媒体端口信息；信令服务器向媒体交换服务器发送第一会议服务器的媒体端口信息。
上述设计中，通过信令服务器控制媒体交换服务器、会议服务器之间进行媒体端口信息的交换来实现内部媒体连接的建立，简单且有效。并且在媒体交换服务器在为会议终端分配外部媒体连接的媒体端口信息，一并将内部媒体连接的媒体端口信息分配给信令服务器，从而信令服务器触发建立内部媒体连接时，无需再次发送申请请求来申请媒体端口信息，提高媒体连接的创建效率，减少时延。
在一种可能的设计中，信令服务器触发媒体交换服务器将第一会议终端的外部媒体连接和第一内部媒体连接相关联，包括：信令服务器向媒体交换服务器发送第一关联请求，第一关联请求用于指示媒体交换服务器建立第一媒体端口信息和第二媒体端口信息的关联关系。
在一种可能的设计中，信令服务器触发媒体交换服务器将第一会议终端的外部媒体连接和第一内部媒体连接相关联，包括：信令服务器向媒体交换服务器发送的第二请求还用于指示媒体交换服务器建立第一媒体端口信息和第二媒体端口信息的关联关系。
上述设计中，信令服务器在触发申请用于外部媒体连接和内部媒体连接的媒体端口信息时，一并指示将两个媒体端口信息关联，实现外部媒体连接和内部媒体连接完成创建后的自动关联，后续无需在单独发送消息触发媒体交换服务器进行两个内部媒体连接和外部媒体连接的关联，提高会议终端加入视频会议的效率，减少时延。
在一种可能的设计中，信令服务器触发媒体交换服务器断开外部媒体连接与第一内部媒体连接的关联，包括：信令服务器向媒体交换服务器发送取消关联请求，取消关联请求用于指示媒体交换服务器取消第一媒体端口信息和第二媒体端口信息的关联关系。
上述设计中，通过取消媒体端口信息的关联关系来实现外部媒体连接与第一内部媒体连接的关联的断开，实现简单且有效。
在一种可能的设计中，信令服务器触发媒体交换服务器与第二会议服务器之间创建第二内部媒体连接，包括：信令服务器向媒体交换服务器发送第三请求，第三请求用于请求建立第二内部媒体连接的第三媒体端口信息；信令服务器接收媒体交换服务器发送的第三响应，第三响应携带第三媒体端口信息；信令服务器向第二会议服务器发送第二会议接入请求，第二会议接入请求用于请求第一会议终端连接第二会议服务器，第二会议接入请求 携带第三媒体端口信息；信令服务器接收第二会议服务器发送的第二会议接入响应，第二会议接入响应携带第二会议服务器的媒体端口信息；信令服务器向媒体交换服务器发送第二会议服务器的媒体端口信息。
在一种可能的设计中，信令服务器触发媒体交换服务器将外部媒体连接与第二内部媒体连接相关联，包括：信令服务器向媒体交换服务器发送第二关联请求，第二关联请求用于指示媒体交换服务器建立第一媒体端口信息和第三媒体端口信息的关联关系。
在一种可能的设计中，信令服务器触发媒体交换服务器断开媒体交换服务器与第一会议服务器之间建立的第一内部媒体连接，包括：信令服务器触发媒体交换服务器删除第一会议服务器的媒体端口信息。
在一种可能的设计中，信令服务器建立媒体交换服务器与第二会议服务器之间的第二内部媒体连接，包括：信令服务器第二会议服务器发送第二会议接入请求，第二会议请求用于请求第一会议终端连接第二会议服务器，第四请求携带第一媒体端口信息；信令服务器接收第二会议服务器发送的第二会议接入响应，第二会议接入响应携带第二会议服务器的媒体端口信息；信令服务器向媒体交换服务器发送第二会议服务器的媒体端口信息。
在一种可能的设计中，信令服务器获取会议模式切换请求后，方法还包括：信令服务器分别指示第一会议服务器和媒体交换服务器删除第一内部媒体连接。
上述设计中，在模式切换时，信令服务器控制第一内部媒体连接的删除，减少资源的占用。
在一种可能的设计中，信令服务器获取会议模式切换请求，包括：信令服务器接收来自第三会议终端发送的会议模式切换请求；第三会议终端为参与会议的会议终端中支持开启会议录制服务的一个会议终端。
上述设计中，提供一种会议模式切换的场景，由支持开启会议录制服务的会议终端触发开启会议录制，从而信令服务器获取到会议模式切换请求。
在一种可能的设计中，参与会议的会议终端包括至少两个用户终端设备，或者包括用户终端设备和业务代表终端设备，或者包括用户终端设备、业务代表终端设备以及用户终端设备、业务代表终端设备和专家终端设备。
第三方面，本申请提供一种通信装置，用于媒体交换服务器或媒体交换服务器的芯片，包括用于执行前述第一方面或第一方面的任意可能的实现方式中的方法的模块或手段(means)。
第四方面，本申请提供一种通信装置，用于信令服务器或信令服务器的芯片，包括用于执行前述第二方面或第二方面的任意可能的实现方式中的方法的模块或手段。
第五方面，本申请提供一种通信装置，用于媒体交换服务器或媒体交换服务器的芯片，包括至少一个处理器和至少一个存储器，其中至少一个存储器用于存储程序和数据，至少一个处理器用于执行前述第一方面或第一方面的任意可能的实现方式中的方法。
第六方面，本申请提供一种通信装置，用于信令服务器或信令服务器的芯片，包括至少一个处理器和至少一个存储器，其中至少一个存储器用于存储程序和数据，至少一个处理器用于执行前述第二方面或第二方面的任意可能的实现方式中的方法。
第七方面，本申请提供一种通信装置，用于媒体交换服务器或媒体交换服务器的芯片，包括处理器和接口电路，接口电路用于接收来自通信装置之外的其它通信装置的信号并传输至处理器或将来自处理器的信号发送给通信装置之外的其它通信装置，处理器通过逻辑 电路或执行代码指令用于实现前述第一方面或第一方面的任意可能的实现方式中的方法。
第八方面，本申请提供一种通信装置，用于信令服务器或信令服务器的芯片，包括处理器和接口电路，接口电路用于接收来自通信装置之外的其它通信装置的信号并传输至处理器或将来自处理器的信号发送给通信装置之外的其它通信装置，处理器通过逻辑电路或执行代码指令用于实现前述第二方面或第二方面的任意可能的实现方式中的方法。
第九方面，本申请实施例提供一种通信系统，包括第三方面所述的装置和第四方面所述的装置；或者包括第五方面所述的装置和第六方面所述的装置；或者包括第七方面所述的装置和第八方面所述的装置。通信系统中还包括第一会议服务器和第二会议服务器。
一种可能的设计中，第一会议服务器提供选择性转发模式的视频会议服务，第二会议服务器提供多点控制模式的视频会议服务器，或者，第一会议服务器提供多点控制模式的视频会议服务，第二会议服务器提供选择性转发模式的视频会议服务；信令服务器获取会议模式切换请求，根据会议模式切换请求向媒体交换服务器发送触发指令；媒体交换服务器根据触发指令将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；外部媒体连接用于在第一会议终端和媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；第一内部媒体连接用于在媒体交换服务器与第一会议服务器之间传输视频会议的媒体数据；第二内部媒体连接用于在媒体交换服务器与第二会议服务器之间传输视频会议的媒体数据。
第十方面，本申请提供一种计算机程序产品，该计算机程序产品包括计算机指令，当该计算机指令被执行时，使得前述第一方面或第一方面的任意可能的实现方式中的方法被执行。
第十一方面，本申请提供一种计算机程序产品，该计算机程序产品包括计算机指令，当该计算机指令被执行时，使得前述第二方面或第二方面的任意可能的实现方式中的方法被执行。
第十二方面，本申请提供了一种计算机可读存储介质，该计算机存储介质存储有计算机指令，当计算机指令被执行时，使得前述第一方面或第一方面的任意可能的实现方式中的方法被执行，或使得前述第四方面或第四方面的任意可能的实现方式中的方法被执行。
第十三方面，本申请提供了一种计算机可读存储介质，该计算机存储介质存储有计算机指令，当计算机指令被执行时，使得前述第二方面或第二方面的任意可能的实现方式中的方法被执行。
关于上述第三方面-第十三方面的有益效果的介绍，可具体参见上述第一方面-第二方面的记载，此处不再赘述。
附图说明
图1为SFU模式下通信系统架构示意图；
图2为MCU模式下通信系统架构示意图；
图3为呼叫中心系统架构示意图；
图4为会议录制触发流程示意图；
图5A为本申请实施例中视频会议系统架构示意图；
图5B为本申请实施例中视频会议系统架构示意图；
图6A为本申请实施例中一种可能的切换会议模式的方法流程示意图；
图6B为本申请实施例中一种可能的切换会议模式的方法流程示意图；
图6C为本申请实施例中一种可能的建立视频会议的流程示意图；
图6D为本申请实施例中一种可能的建立第二会议终端的媒体连接的流程示意图；
图7为本申请实施例中另一种可能的建立视频会议的流程示意图；
图8为本申请实施例中SFU模式下一种音视频流的传输流程示意图；
图9A为本申请实施例中一种会议模式切换流程示意图；
图9B为本申请实施例中另一种会议模式切换流程示意图；
图9C为本申请实施例中又一种会议模式切换流程示意图；
图9D为本申请实施例中再一种会议模式切换流程示意图；
图10A为本申请实施例中一种第二模式的视频会议的创建流程示意图；
图10B为本申请实施例中另一种第二模式的视频会议的创建流程示意图；
图11A为本申请实施例中MCU模式下一种音视频流的传输流程示意图；
图11B为本申请实施例中MCU模式下另一种音视频流的传输流程示意图；
图12为本申请实施例中邀请其它会议终端加入视频会议的流程示意图；
图13为本申请实施例中通信装置1300结构示意图；
图14为本申请实施例中通信装置1400结构示意图。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
下面对本申请涉及的技术概念进行描述。
1)视频流处理模式：选择性转发单元(selective forwarding unit，SFU)模式和多点控制单元(multipoint conferencing unit，MCU)模式。
SFU模式也可以称为流转发模式或者选择性转发模式。在SFU模式下，可以通过一个视频服务器和多个终端设备组成一个通信系统。视频服务器收到某个终端设备共享的音视频流后，直接将该音视频流转发给会议中的其他终端设备。视频服务器实际上就是一个音视频路由转发器。在SFU模式下，视频服务器也可以称为SFU会议服务器或者简称为SFU。SFU无需做音视频转码。参见图1所示，用户的终端设备、业务代表的终端设备、业务专家的终端设备通过SFU相互转发音视频流，其中，业务代表终端设备和业务专家终端设备显示用户的视频画面，用户终端设备显示业务代表的视频画面。
MCU模式也可以称为多点控制模式或者混合模式。在MCU模式下，通过一个视频服务器和多个终端设备组成一个通信系统。视频服务器对同一个会议中的所有终端设备产生的音视频流进行混合，生成一个混合后的音视频流再发给各个终端设备，各个终端设备可以显示其它终端设备的视频流和播放其它终端设备的音频流。在MCU模式下，视频服务器是一个音视频混合器，视频服务器也可以称为MCU会议服务器或者简称为MCU。参见图2所示，在MCU模式中，用户终端设备、业务代表终端设备、业务专家终端设备的视频画面经过视频服务器编排混合后展示在同一个视频画面中。
在后续描述中，为方便区分，将SFU会议模式对应的视频服务器称为SFU会议服务 器、将MCU会议模式对应的视频服务器称为MCU会议服务器，将在SFU会议服务器上分配的会议资源称为SFU会议资源、将在MCU会议服务器上分配的会议资源称为MCU会议资源。
2)用户，可以理解为普通的终端设备的用户，用户接入会议的方式可以采用电话应用程序(telephony application)拨号盘、非系统默认的其他应用程序(application，APP)等。用户采用的终端设备可以称为用户终端设备。用户终端设备可以是移动电话(比如手机)、平板电脑、笔记本电脑等设备。
用户终端设备可以是长期演进语音承载(voice over long-term evolution，VoLTE)用户设备。VoLTE终端设备可以是接入LTE网络的手机/平板电脑等终端设备，比如可以采用安卓(Android)
Figure PCTCN2022122667-appb-000001
、
Figure PCTCN2022122667-appb-000002
或者鸿蒙
Figure PCTCN2022122667-appb-000003
系统自带的拨号盘(application，APP)拨打电话。
用户终端设备可以采用基于网络协议(internet protocol IP)的语音传输(voice over internet protocol，VoIP)终端设备。VoIP终端设备通过自行安装的应用APP拨号盘拨打VoIP电话；VoIP终端设备，比如可以是接入互联网的个人计算机(person computer，PC)PC/手机/平板电脑等终端设备。
需要说明的是，本申请中“VoLTE终端设备”，实际上所能接入的电信网络不限于LTE网络，还可以是5G网络、6G网络等，本申请实施例对此不作限定。
3)业务代表，可以理解为呼叫中心的话务员，主要处理用户的业务咨询、业务办理等。
业务代表采用的终端设备可以称为业务代表终端设备或者业务代表终端设备。业务代表通过业务代表终端设备接入到呼叫中心，并实现音视频通话。业务代表终端设备比如可以是安装在PC上的会话初始协议(session initiation protocol，SIP)软电话、瘦客户机(Thin Client，TC)终端等。一些可能的场景中，业务代表终端设备上有控制端，业务代表通过该控制端可实现呼叫控制、录制控制、话务转接、求助等功能。
4)业务专家，可以理解为呼叫中心的高级话务员，可以简称为专家，当业务代表无法解决用户问题时，需求助业务专家。专家使用的设备可以称为专家终端设备。专家终端设备可以是移动电话(比如手机)、平板电脑、笔记本电脑、安装在PC上的会话初始协议(session initiation protocol，SIP)软电话、瘦客户机(Thin Client，TC)终端等。
5)用户呼入业务：用户呼入业务指用户拨打呼叫中心的接入号码(如10086)后，呼叫中心分配业务代表处理具体业务。
6)业务代表外呼业务：外呼业务指业务代表控制呼叫中心呼叫用户的号码，并将用户加入到会议中通话。
7)呼叫中心(Call Center)也可以称客户服务中心，是指通过多种通讯媒介(电话、传真、互联网访问、E-mail、视频、短信等)，在一个相对集中的场所，由一批服务人员组成的服务机构，利用计算机通讯技术，处理来自企业、顾客的电话垂询。呼叫中心可以包括业务代表和业务专家两种角色。一些实施例中，业务代表、业务专家分别使用各自的终端设备可以通过呼叫中心系统来与用户终端设备建立通信连接。
本申请实施例可以应用呼叫中心系统，还可以应用于其它需要进行视频会议的系统。
以应用于呼叫中心系统为例，应用于呼叫中心系统的场景可以包括如下几种：第一种可能的场景中，用户与业务代表进行两方通话。第二种可能的场景中，用户与业务代表以及专家三方进行通话。
作为一种举例，用户拨打接入呼叫中心的号码，并且转人工服务时，为了减少计算成本，一般优先采用SFU模式实现用户与业务代表之间的通话。在通话过程中如果需要启动录制功能，或者需要专家接入且三方都需要看到其他人的页面，将通话切换到MCU模式。
示例性地，参见图3所示，为一种可能的呼叫中心系统架构示意图。呼叫中心系统中包括信令服务器、MCU会议服务器和SFU会议服务器。信令服务器，用于控制用户、业务代表或者专家接入SFU会议服务器或者MCU会议服务器，从而实现用户与业务代表通信，或者用户、业务代表和专家三方实现通信。SFU会议服务器用于实现用户、业务代表或者专家之间的媒体数据的转发。MCU会议服务器用于实现用户、业务代表或者专家之间的媒体数据的混合处理及转发。SFU会议服务器和MCU会议服务器完全分离，独自承担不同的会议功能。SFU会议服务器使用的计算资源较少，MCU会议服务器使用的计算资源较大。
下面结合图4对用户呼叫业务代表、以及业务代表触发录制的流程进行说明。比如，用户终端设备拨打呼叫中心的接入码，转人工业务时，统一由信令服务器接入到SFU会议服务器，用户终端设备和业务代表终端设备通话一段时间，根据通话实际情况，业务代表判断需执行会议录制操作，业务代表终端设备触发执行会议录制操作，然后通过语音方式通知用户终端设备挂机，并等待被呼叫中心外呼；用户挂机后，业务代表终端设备发起切换MCU会议模式，并外呼用户终端设备，将用户终端设备加入到MCU会议中实现通话和录制。
步骤401，用户终端设备触发主动呼入呼叫中心，即向信令服务器发起呼入呼叫中心的呼叫请求。
用户终端设备可以通过IMS核心网向信令服务器发起呼叫请求。
示例性地，呼叫请求可以携带用户终端设备的用于创建与SFU会议服务器之间的媒体连接的媒体描述信息。比如包括媒体端口信息和用户终端设备的媒体编解码能力信息。
步骤402，信令服务器接收到用户终端设备的呼叫请求后，控制SFU会议服务器分配SFU会议资源。可以理解为，信令服务器请求SFU会议服务器为用户终端设备分配SFU资源，然后SFU会议服务器将为用户终端设备分配的SFU资源发送给信令服务器。
示例性地，SFU会议资源可以包括SFU会议服务器的用于创建与用户终端设备之间的媒体连接的媒体描述信息，比如媒体端口信息和SFU会议服务器的媒体编解码能力信息。
SFU会议资源还可以包括SFU会议服务器的用于创建与业务代表终端设备之间的媒体连接的媒体描述信息，比如包括媒体端口信息和SFU会议服务器的媒体编解码能力信息。示例性地，媒体描述信息可以采用会话描述协议(session description protocol，SDP)格式。
步骤403，信令服务器将用户终端设备的媒体连接加入到SFU会议服务器。可以理解为将用户终端设备的媒体描述信息发送给SFU会议服务器。SFU会议服务器创建用户终端设备的媒体端口信息与SFU会议服务器的媒体端口信息的关联关系。
步骤404，信令服务器将SFU会议服务器的媒体描述信息发送给用户终端设备。用户终端设备创建用户终端设备的媒体端口信息与SFU会议服务器的媒体端口信息的关联关系。
经过步骤401-步骤404后，在用户终端设备和SFU会议服务器之间建立媒体连接。例如图4中SFU会议服务器与用户终端设备之间的虚线。
步骤405，信令服务器外呼业务代表终端设备。比如，将SFU会议服务器的用于创建 与业务代表终端设备之间的媒体连接的媒体描述信息发送给业务代表终端设备。
步骤406，信令服务器接收业务代表终端设备的媒体描述信息。业务代表终端设备的媒体描述信息包括媒体端口信息和业务代表终端设备的媒体编解码能力信息。SFU会议服务器创建业务代表终端设备的媒体端口信息与SFU会议服务器的媒体端口信息的关联关系。
步骤407，信令服务器将业务代表终端设备加入SFU会议。示例性地，信令服务器可以将SFU会议服务器的媒体描述信息发送给业务代表终端设备。业务代表终端设备接收到SFU会议服务器的媒体描述信息后，创建业务代表终端设备的媒体端口信息与SFU会议服务器的媒体端口信息的关联关系。
经过步骤405-步骤407后，在SFU会议服务器与业务代表终端设备之间建立媒体连接，例如图4中SFU会议服务器与业务代表终端设备之间的虚线。
在业务代表终端设备和用户终端设备均加入会议后，信令服务器可以配置参与方的互看属性。一些实施例中，不同的场景可以有不同的配置。在业务代表与用户通话过程中，可以配置业务代表观看用户的视频画面，用户观看业务代表的视频画面。参见步骤408。在SFU模式下，多方进行视频会议时，比如设置业务代表和专家都看用户的视频画面、用户看业务代的表视频画面。
步骤408，信令服务器在SFU会议服务器配置业务代表与用户之间互看属性。
步骤409，用户终端设备产生音视频流后，发送给SFU会议服务器。例如，音视频流可以采用RTP格式，还可以采用其它的格式，本申请对此不作具体限定。
步骤410，SFU会议服务器根据配置的互看属性，将用户终端设备的音视频流转发给业务代表终端设备。
示例性地，SFU会议服务器可以根据SFU会议服务器与业务代表终端设备之间的媒体连接，对来自用户终端设备的音视频流的RTP头进行更新，然后转发给业务代表终端设备。
步骤411，业务代表终端设备产生音视频流后，发送给SFU会议服务器。例如，音视频流可以采用RTP格式，还可以采用其它的格式，本申请对此不作具体限定。
步骤412，SFU会议服务器根据配置的互看属性，将业务代表终端设备的音视频流转发给用户终端设备。
示例性地，SFU会议服务器可以根据SFU会议服务器与用户终端设备之间的媒体连接，对来自业务代表终端设备的音视频流的RTP头进行更新，然后转发给用户终端设备。
应理解的是，步骤409-步骤410以及步骤411-步骤412之间可以是并行处理。
通过上述方案用户终端设备与业务代表终端设备之间通信。如下对业务代表触发会议录制的操作。
步骤413，业务代表终端设备接收到业务代表触发的会议录制的操作，向信令服务器发送通知会议录制的指令。
步骤414，信令服务器控制SFU会议服务器释放SFU会议资源。释放SFU会议资源可以理解为释放SFU会议服务器的用于创建与用户终端设备之间的媒体连接的媒体描述信息，以及用于创建与业务代表终端设备之间的媒体连接的媒体描述信息。SFU会议服务器删除业务代表终端设备的媒体端口信息与SFU会议服务器的媒体端口信息的关联关系，以及SFU会议服务器的媒体端口信息与业务代表终端设备的媒体端口信息的关联关系。
步骤415，信令服务器控制用户终端设备释放SFU会议呼叫。
步骤416，信令服务器控制业务代表终端设备释放SFU会议呼叫，此时用户和业务代表能感知呼叫被挂断。
步骤417，业务代表通过业务代表终端设备触发外呼用户终端设备的操作，向信令服务器发送外呼用户终端设备的指令。外呼用户终端设备指令可以包括终端设备的用户标识，比如用户号码。
步骤418，信令服务器控制MCU会议服务器分配MCU会议资源。
示例性地，MCU会议资源可以包括MCU会议服务器的用于创建与用户终端设备之间的媒体连接的媒体描述信息，比如媒体端口信息和MCU会议服务器的媒体编解码能力信息。
MCU会议资源还可以包括MCU会议服务器的用于创建与业务代表终端设备之间的媒体连接的媒体描述信息，比如媒体端口信息和MCU会议服务器的媒体编解码能力信息。
步骤419，信令服务器外呼用户终端设备，示例性地，从用户终端设备获取用户终端设备的媒体描述信息，并将MCU会议服务器用于创建与用户终端设备之间的媒体连接的媒体描述信息发送给用户终端设备。
步骤420，信令服务器将用户终端设备加入MCU会议。信令服务器将用户终端设备的媒体描述信息发送给MCU会议服务器。
步骤421，信令服务器外呼业务代表终端设备，示例性地，从业务代表终端设备获取业务代表终端设备的媒体描述信息，并将MCU会议服务器用于创建与业务代表终端设备之间的媒体连接的媒体描述信息发送给业务代表终端设备。
步骤422，信令服务器将业务代表终端设备加入MCU会议。信令服务器将业务代表终端设备的媒体描述信息发送给MCU会议服务器。
步骤423，用户终端设备产生音视频流后，发送给MCU会议服务器。例如，音视频流可以采用RTP格式，还可以采用其它的格式，本申请对此不作具体限定。
步骤424，业务代表终端设备产生音视频流后，发送给MCU会议服务器。
步骤423和步骤424用户终端设备和业务代表终端设备将各自的音视频流发送至MCU会议服务器，两者可以是并行发送；
步骤425，MCU会议服务器对输入的多个音视频流做混合处理，包含音频的混音和视频的混屏。
步骤426-步骤427，MCU会议服务器将混合后的音视频流发送至用户终端设备、业务代表终端设备。
需要说明的是，MCU会议服务器内部的音视频编解码步骤在流程图中省略，如用户终端设备或者业务代表终端设备输入的视频流到达MCU会议服务器后，先经过视频解码处理，MCU会议服务器针对用户终端设备产生的视频流解码后的视频、业务代表终端设备产生的视频流解码后的视频做混屏处理，针对混屏后的视频做编码压缩，再发送至用户终端设备和业务代表终端设备。
步骤428，信令服务器控制MCU会议服务器录制所有参与方的音视频。
步骤429，MCU会议服务器将音频混音、视频混屏后的音视频流发送至录制服务器。
一些实施例中，信令服务器可以在完成步骤422后，向MCU会议服务器发送给会议录制指令。MCU会议服务器在完成步骤425后，将音频混音、视频混屏后的音视频流发 送至录制服务器。
步骤430，录制服务器将混合处理后的音视频流按照视频文件格式写入存储设备。
在呼叫中心系统中，由于呼叫中心业务并发量比较大，用户终端设备发起会议呼叫接入时，一般默认使用SFU会议服务器，以节省计算资源。而业务代表启动录制时，需要从SFU会议模式切换到MCU会议模式。通过图4可知，信令服务器控制会议模式的切换，在切换过程中需释放已有会议资源、释放用户终端设备和业务代表终端设备之间的会议连接，并由业务代表终端设备重启发起外呼用户终端设备，通过信令服务器控制MCU会议服务器创建会议资源，并实现用户终端设备和业务代表终端设备之间的会议连接。由于信令服务器控制会议在SFU会议模式和MCU会议模式之间切换时，呼叫被挂断，再等待业务代表终端设备发起外呼后再重新加入会议，导致在SFU会议模式和MCU会议模式之间切换耗时较长。切换时间较长，一方面降低业务代表工作效率，进而降低人力资源利用率，另一方面增加了用户终端设备的等待时长。此外，信令服务器控制会议在SFU会议模式和MCU会议模式之间切换时，用户终端设备需要电话被挂断后再重新被呼入，导致用户体验较差。
为了降低切换时长，本申请实施例在视频会议系统中设有一个媒体交换服务器，使得视频会议的会议终端经过媒体交换服务器建立与会议服务器之间的媒体连接。会议终端的媒体连接包括会议终端与媒体交换服务器之间的外部媒体连接以及媒体交换服务器与会议服务器之间的内部媒体连接。在需要切换会议模式时，外部媒体连接保持不变，但与将外部媒体连接相关联的模式切换前的内部媒体连接切换为模式切换后的内部媒体连接。而由于会议服务器与媒体交换服务器均在一个视频会议系统内部，该关联关系的切换时间远小于断开再重建会议终端与会议服务器之间的媒体连接所需时间，因此，可以减少会议服务切换的切换时长。并且对于参与方来说，并未与视频会议系统断开连接，使得参与方几乎感知不到会议服务器的切换。
可以理解，“媒体交换服务器”的名字只是示例性的，在有些场合下，也可以被称为“会议桥接服务器”、“会议代理服务器”、“会议媒体连接管理服务器”或“会议切换服务器”。本申请实施例不限定该设备名称，后续实施例均以“媒体交换服务器”为例。
参加图5A所示，为本申请实施例提供一种可能的视频会议系统架构示意图。视频会议系统中包括第一会议服务器、第二会议服务器、媒体交换服务器和信令服务器。一些实施例中，视频会议系统还可以包括其它的会议服务器。需要说明的是，不同的会议服务器提供不同的会议服务。作为一种示例，第一会议服务器提供第一会议服务，第二会议服务器提供第二会议服务。
参与视频会议的会议终端可以包括多个用户终端设备、或者用户终端设备和业务代表终端设备，又或者包括用户终端设备、业务代表终端设备或者专家终端设备。以用户终端设备为VoIP终端设备为例，VoIP终端设备可以通过信令服务器接入会议。以用户终端设备为VoLTE终端设备为例，VoLTE终端设备可以通过接入网、IP多媒体子系统(IP Multimedia Subsystem，IMS)核心网和信令服务器接入会议。
一些可能的场景中，某个参与方还可以使用桌面云系统，通过桌面云系统与视频会议系统建立连接，即某个参与方可以使用桌面云系统中的虚拟机连接视频会议系统。在该场景中，该参与方使用的桌面云系统中的虚拟机和参与方使用的登录虚拟机的终端设备组合作为该会议终端。
IMS核心网设备为IMS核心网中的设备。IMS核心网设备可以包括呼叫会话控制功能(call session control function，CSCF)和归属签约用户服务器(home subscriber server，HSS)，IMS核心网设备还可以包括其它网元，本申请实施例中不再赘述。CSCF是IMS核心网的呼叫控制中心，是在IP传输平台上实现用户接入，鉴权、会话路由和业务触发等功能。CSCF可以包括服务-呼叫会话控制功能(serving-call session control function，S-CSCF)、代理-CSCF(Proxy CSCF，P-CSCF)、查询-CSCF(Interrogating-CSCF，I-CSCF)中的一个或多个。HSS用于记录用户的签约数据(比如用户信息、业务数据)。不同的用户终端设备所属的CSCF可能相同，也可能不同。比如，不同终端设备的归属地不同，所属的CSCF可能不同。
信令服务器，用于会议终端之间(比如，用户终端设备和用户终端设备/业务代表终端设备/专家终端设备之间)建立呼叫，并控制视频会议系统内部的各种资源分配、管理、释放，以及业务逻辑的控制，包含信令处理和业务处理两部分功能。业界通用等效设备如排队机、电话交换平台等。
媒体交换服务器：可以理解为是会议终端连接到第一会议服务器/第二会议服务器的桥接器。媒体交换服务器用于会议终端与会议服务器(第一会议服务器或者第二会议服务器)之间会议的媒体数据的转发。一些场景中媒体交换服务器可以单独部署。另一些场景中，媒体交换服务器可以与第一会议服务器或者第二会议服务器合并部署。一些实施例中，为参与视频会议的不同会议终端提供媒体代理服务的媒体交换服务器可以是相同，也可以不同。
第一会议服务器和第二会议服务器对应不同的模式，不同模式的会议服务器提供不同的会议服务，具有不同的会议功能。比如第一会议服务器以第一模式为会议终端提供第一会议服务。比如，第一会议服务器以第二模式为视频会议的会议终端提供第一会议服务。第一模式可以是SFU模式、第二模式可以是MCU模式，或者第一模式为MCU模式、第二模式为SFU模式。第一会议服务器和第二会议服务器分别可以是SFU会议服务器和MCU会议服务器。比如，第一会议服务器可以是SFU会议服务器、第二会议服务器可以是MCU会议服务器，或者第一会议服务器可以是MCU会议服务器，第二会议服务器可以是SFU会议服务器。
一些场景中，在视频会议系统中包括的两个会议服务器分别为SFU会议服务器和MCU会议服务器。视频会议系统中还可以包括录制服务器，参见图5B所示。录制服务器用于对视频会议过程中产生的音视频进行录制保存。
SFU会议服务器，用于实现多个会议终端的输入音视频流路由转发功能，如将用户终端设备的音视频流转发至业务代表终端设备或者专家终端设备，或者将业务代表终端设备或者专家终端设备的音视频流转发至用户终端设备。
MCU会议服务器，用于实现多个会议终端的输入音视频流混合处理，如将用户终端设备/业务代表终端设备输入的视频流解码、混屏、编码输出，再发送至业务代表终端设备/用户终端设备。
在本申请实施例中，某个会议终端接入视频会议后，该会议终端的媒体连接可以包括外部媒体连接和内部媒体连接。外部媒体连接是指会议终端与媒体交换服务器之间的媒体连接，用于在会议终端与媒体交换服务器之间传输视频会议的媒体数据。内部媒体连接是指媒体交换服务器与会议服务器之间的媒体连接，用于在媒体交换服务器与会议服务器之 间传输视频会议的媒体数据。在媒体交换服务器上外部媒体连接与内部媒体连接之间相关联。需要说明的是，在不同模式下，针对该会议终端，所创建的内部媒体连接不同，可以理解为，媒体交换服务器与支持不同的模式的会议服务器之间建立内部媒体连接。比如第一模式下，该会议终端的内部媒体连接为媒体交换服务器与支持第一模式的会议服务器之间的媒体连接。在第二模式下，该会议终端的内部媒体连接为媒体交换服务器与支持第二模式的会议服务器之间的媒体连接。需要说明的是，本申请实施例所说的内部主要是指视频会议系统内部网元交互，外部是指视频会议系统内部网元和会议终端的交互。
参见图6A所示，以第一会议终端为例，在需要会议模式的切换时，比如步骤6001，信令服务器获取会议模式切换请求。例如，一些场景中，会议终端无感知会议模式，在会议终端发起某种请求时，比如请求发起会议录制，信令服务器根据请求确定需要会议录制，如果原来是SFU模式，则切换到MCU模式，需要更换提供视频会议服务的会议服务器。又比如，请求停止会议录制，信令服务器根据请求确定停止会议录制，如果原来是MCU模式，则切换到MCU模式，需要更换提供视频会议服务的会议服务器。
步骤6002，信令服务器触发媒体交换服务器将外部媒体连接相关联的内部媒体连接进行切换，无需再重新执行将会议终端接入会议的流程。参见图6B所示，在需要切换会议模式时，仅需要将与外部媒体连接关联的第一内部媒体连接切换为第二内部媒体连接。图6B中，第一媒体连接表示媒体交换服务器与第一会议服务器之间的媒体连接，第二媒体连接表示为媒体交换服务器与第二会议服务器之间的媒体连接。
一些实施例中，以发起时的会议模式为第一模式为例。当某个会议终端向其它会议终端发起第一模式的视频会议时，信令服务器分别触发创建各个参与视频会议的各个会议终端的媒体连接。每个会议终端的媒体连接包括该会议终端与媒体交换服务器之间的外部媒体连接和媒体交换服务器与第一会议服务器的内部媒体连接。媒体连接可以理解为两个设备之间建立的媒体数据传输通道(或者简称为媒体传输通道)。外部媒体连接可以理解为媒体交换服务器和会议终端之间的媒体数据传输通道，第一内部媒体连接可以理解为媒体交换服务器和第一会议服务器设备之间的媒体数据传输通道。一种可能的示例中，建立媒体连接的两个设备均分配媒体端口信息，可以简称为媒体端点，两个媒体端点用于创建媒体通道。比如媒体端点，可以理解为设备内部用于建立媒体连接的IP端口。比如实时传输协议(real-time transport protocol，RTP)媒体的交互基于ip:port(即IP地址与端口)，因此可以使用ip:port标识一个端点。媒体端点可以包括IP地址和端口(IP：port)。
为了便于区分，此处将媒体交换服务器与第一会议服务器之间的内部媒体连接称为第一内部媒体连接。信令服务器触发媒体交换服务器创建外部媒体连接与第一内部媒体连接的关联。外部媒体连接与第一内部媒体连接之间建立关联，意味着会议的媒体数据在外部媒体连接与第一内部连接之间往返转发。外部媒体连接与第一内部媒体连接之间建立关联关系，可以理解为媒体交换服务器从外部媒体连接接收到音视频流后，可以通过该关联关系将该音视频流路由到第一内部媒体连接中。或者，从第一内部媒体连接接收到音视频流后，可以通过关联关系将该音视频流路由到外部媒体连接。需要说明的是，针对不同的会议终端创建的第一内部媒体连接不同，但是均在媒体交换服务器与第一会议服务器之间创建。
当某个会议终端触发由第一模式的视频会议切换到第二视频会议时，信令服务器触发媒体交换服务器针对各个会议终端将与外部媒体连接相关联的第一内部媒体连接切换为 第二内部媒体连接。外部媒体连接与第二内部媒体连接关联，意味着会议的媒体数据在外部媒体连接与第二内部连接之间往返转发。外部媒体连接与第二内部媒体连接关联，可以理解为媒体交换服务器从外部媒体连接接收到音视频流后，可以通过该关联关系将该音视频流路由到第二内部媒体连接中。或者，从第二内部媒体连接接收到音视频流后，可以通过关联关系将该音视频流路由到外部媒体连接。示例性地，媒体交换服务器针对各个会议终端将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，可以包括信令服务器触发媒体交换服务器取消外部媒体连接与第一内部媒体连接的关联关系，并将外部媒体连接与第二内部媒体连接相关联。
在切换外部媒体连接关联的内部媒体连接时，可以通过两种实现方式中的任一种实现：
第一种可能的实现方式中，以会议系统支持两种模式为例，以由第一模式切换到第二模式为例，在模式切换时，可以保留针对第一模式创建的第一内部媒体连接，仅需要触发媒体交换服务器取消外部媒体连接与第一内部媒体连接的关联关系，并将外部媒体连接与第二内部媒体连接相关联。如果第二内部媒体连接未被创建过时，可以先创建第二内部媒体连接，然后再将外部媒体连接与第二内部媒体连接相关联。一些实施例中，当需要再从第二模式切换回第一模式时，可以直接取消外部媒体连接与第二内部媒体连接的关联关系，并直接将外部媒体连接与之前保留的第一内部媒体连接相关联，不必再次创建第一内部媒体连接，提高切换速度，避免影响用户体验。
一些可能的实施例中，在模式切换时，为了提高资源利用率，在取消外部媒体连接与第一内部媒体连接的关联关系时，信令服务器可以触发媒体交换服务器以及第一会议服务器删除第一内部媒体连接，从而能够释放第一内部媒体连接占用的资源，以提高资源利用率。
第二种可能的实现方式中，以会议系统支持两种模式为例，以由第一模式切换到第二模式为例，不再保留第一模式下的第一内部媒体连接，信令服务器触发媒体交换服务器取消媒体交换服务器与第一会议服务器之间建立的第一内部媒体连接，并建立媒体交换服务器与第二会议服务器之间的第二内部媒体连接。从而在模式切换时，能够及时释放第一内部媒体连接的资源，减少资源浪费，提高资源利用率。示例性地，信令服务器可以先触发断开各个会议终端的第一内部媒体连接，然后再触发创建各个会议终端的第二内部媒体连接。或者信令服务器可以先触发创建各个会议终端的第二内部媒体连接，然后再触发断开各个会议终端的第一内部媒体连接。又或者，各个会议终端的第二内部媒体连接的建立流程，与各个会议终端的第一内部媒体连接的删除流程并行执行，比如信令服务器可以同时触发创建各个会议终端的第二内部媒体连接，以及触发删除各个会议终端的第一内部媒体连接。
下面结合图6C和图6D对第一会议终端发起视频会议呼叫，请求与第二会议终端之间建立视频会议的流程进行说明。
步骤601，第一会议终端向信令服务器发送第一请求，第一请求用于请求与第二会议终端之间建立视频会议。为了便于描述，将第一请求称为呼叫请求1，该呼叫请求1用于请求与第二会议终端之间建立视频会议。
一些可能的实施例中，第一会议终端可以发起与其它多个会议终端之间的视频会议。本实施例中以发起与第二会议终端之间的视频会议为例。
示例性地，呼叫请求1中可以携带第一会议终端的媒体端点。媒体端点包括第一会议 终端的IP地址，或者包括第一会议终端的IP地址和端口。比如，以第一会议终端的IP地址和端口为IP1:port1为例。
步骤602，信令服务器在接收呼叫请求1时，向媒体交换服务器请求为第一会议终端分配用于与第一会议终端建立外部媒体通道的媒体端点。比如发送第二请求，第二请求用于请求建立外部媒体通道的媒体端点。此处为了便于区分，将用于建立外部媒体通道(对接会议终端)的媒体端点称为外部媒体端点。外部媒体端点用于对接会议终端。
为了便于描述，图6C中，以向媒体交换服务器发送的请求外部媒体端点的第二请求称为申请请求1为例，申请请求1用于请求媒体交换服务器为第一会议终端分配外部媒体端点。
步骤603，媒体交换服务器向信令服务器发送为第一会议终端分配的外部媒体端点。比如，以媒体交换服务器的外部媒体端点为IP2:port2为例。
一些实施例中，媒体交换服务器可以在第二响应中将为第一会议终端分配的外部媒体端点发送给信令服务器。图6C中以将第二响应称为申请响应1为例。
媒体交换服务器在接收到第一会议终端的媒体端点后，根据第一会议终端的媒体端点以及为第一会议终端分配的外部媒体端点完成媒体交换服务器侧的外部媒体连接的创建。
步骤604，信令服务器在接收媒体交换服务器发送的为第一会议终端分配的外部媒体端点后，将该外部媒体端点发送给第一会议终端。示例性地，信令服务器向第一会议终端发送第一响应(图6C中以称为呼叫响应1为例)，呼叫响应1中携带为第一会议终端分配的外部媒体端点。第一会议终端在接收到呼叫响应1时，根据第一会议终端的媒体端点IP1:port1和接收到的外部媒体端点IP2:port2完成第一会议终端侧的外部媒体连接的建立，即在媒体端点IP1:port1和外部媒体端点IP2:port2之间建立外部媒体连接。图6C中将第一会议终端的外部媒体连接称为OutLink01为例。
步骤605，信令服务器向媒体交换服务器请求为第一会议终端分配用于创建内部媒体连接的媒体端口。此处为了便于区分，将用于建立内部媒体通道的媒体端点称为内部媒体端点。内部媒体端点用于对接SFU/MCU会议服务器。
图6C中，以向媒体交换服务器发送用于请求第一会议终端的内部媒体端点的请求称为申请请求2为例，申请请求2用于请求媒体交换服务器为第一会议终端分配内部媒体端点。
步骤606，媒体交换服务器向信令服务器发送申请响应2，申请响应2中包括为第一会议终端分配内部媒体端点。以内部媒体端点为IP3:port3为例。一些实施例中，媒体交换服务器分配的外部媒体端点和内部媒体端点可以采用相同的IP地址且不同的端口号。比如内部媒体端点和外部媒体端点均采用IP2或者均采用IP3，但是采用不同端口号。
步骤607，信令服务器向第一会议服务器发送会议接入请求1，会议接入请求1用于请求将第一会议终端接入视频会议。第一会议服务器根据会议接入请求1为第一会议终端接入视频会议分配会议资源。会议资源中可以包括为第一会议终端创建内部媒体连接分配的媒体端点。后续描述时，将会议接入请求简称为接入请求，还可以采用其它的消息名称，本申请对此不作具体限定。示例性地，接入请求1可以包括为第一会议终端分配的内部媒体端点。
一些实施例中，视频会议发起时，可以默认采用SFU模式，从而信令服务器在接收到来自第一会议终端的呼叫请求1时，向SFU会议服务器请求为第一会议终端分配用于与第 一会议终端建立外部媒体通道的媒体端点。则该实施例中，第一会议服务器可以为SFU会议服务器。
另一些实施例中，第一会议终端发起用于建立视频会议的呼叫请求1时，可以优先确定会议类型，不同的会议类型对应不同的模式。比如是否需要启动录制功能，在第一会议终端发起视频会议时，选择启动录制功能时，则呼叫请求1包括录制功能启动指示。进一步地，信令服务器根据该录制功能启动指示，向MCU会议服务器请求为第一会议终端分配用于与第一会议终端建立外部媒体通道的媒体端点。在该情况下，第一会议服务器可以是MCU服务器。又比如，在第一会议终端发起视频会议时，未选择启动录制功能时，信令服务器根据呼叫请求1中未携带录制功能启动指示，向SFU会议服务器请求为第一会议终端分配用于与第一会议终端建立外部媒体通道的媒体端点。在该情况下，第一会议服务器可以是SFU会议服务器。
步骤608，第一会议服务器向信令服务器发送会议接入响应1，会议接入响应1包括为第一会议终端分配的第一会议服务器的媒体端点。作为一种举例，为第一会议终端分配的第一会议服务器的媒体端点表示为IP4:port4。
第一会议服务器在为第一会议终端分配媒体端点IP4:port4，可以根据第一会议终端的内部媒体端点IP3:port3和媒体端点IP4:port4完成内部媒体连接的创建。
步骤609，信令服务器将为第一会议终端分配的第一会议服务器的媒体端点IP4:port4发送给媒体交换服务器。媒体交换服务器在接收到媒体端点IP4:port4后，可以根据第一会议终端的内部媒体端点IP3:port3和媒体端点IP4:port4完成内部媒体连接的创建。图6A中以将第一会议终端的内部媒体连接称为InLink01为例。
进一步地，媒体交换服务器完成第一会议终端的内部媒体连接InLink01与外部媒体连接OutLink01的相互关联。
一种可能的实施方式中，媒体交换服务器可以根据信令服务器的指示关联媒体交换服务器为第一会议终端分配的内部媒体端点和外部媒体端点，即完成第一会议终端的内部媒体连接与第一会议终端的外部媒体连接的关联。
方式1，信令服务器可以在步骤605向媒体交换服务器发送申请请求2时，向媒体交换服务器指示为第一会议终端分配的内部媒体端点后，与为第一会议终端分配的外部媒体端点建立关联关系。从而媒体交换服务器在完成为第一会议终端分配外部媒体端点后，创建第一会议终端的内部媒体端点和外部媒体端点的关联关系。一些实施例中，申请请求2中可以携带第一会议终端的外部媒体端点。
进一步地，第一会议终端的内部媒体连接和外部媒体连接完成建立后，也即在媒体交换服务器上由于创建了第一会议终端的内部媒体端点和外部媒体端点的关联关系，而完成了第一会议终端的内部媒体连接与外部媒体连接的关联关系的创建。
方式2，信令服务器可以步骤606接收到媒体交换服务器为第一会议终端分配的内部媒体端点后，向媒体交换服务器指示为第一会议终端分配的内部媒体端点与为第一会议终端分配的外部媒体端点建立关联关系。
方式3，信令服务器可以在步骤609向媒体交换服务器发送第一会议服务器的媒体端点时，向媒体交换服务器指示为第一会议终端分配的内部媒体端点与为第一会议终端分配的外部媒体端点建立关联关系。
方式4，信令服务器可以在完成步骤609后，向媒体交换服务器指示为第一会议终端 分配的内部媒体端点与为第一会议终端分配的外部媒体端点建立关联关系。
方式5，信令服务器在接收到呼叫请求1后，可以向媒体交换服务器申请第一会议终端的外部媒体端点的同时，也一并向媒体交换服务器申请第一会议终端的内部媒体端点。
步骤602中信令服务器向媒体交换服务器发送的申请请求1既用于请求媒体交换服务器为第一会议终端分配外部媒体端点，也用于请求媒体交换服务器为第一会议终端分配内部媒体端点。进而，媒体交换服务器在步骤603向信令服务器反馈的申请响应1中携带为第一会议终端分配内部媒体端点和为第一会议终端分配外部媒体端点。信令服务器一并向媒体交换服务器申请第一会议终端的内部媒体端点和外部媒体端点时，还可以指示媒体交换服务器关联为第一会议终端分配的内部媒体端点和外部媒体端点。比如申请请求1中还可以携带指示信息1，该指示信息1用于指示媒体交换服务器关联为第一会议终端分配的内部媒体端点和外部媒体端点。需要说明的是，在采用方式5时，步骤605和步骤606则不再执行。
下面结合图7对方式5进行描述。
步骤701，参见步骤601，此处不再赘述。
步骤702，信令服务器在接收呼叫请求1时，为第一会议终端向媒体交换服务器申请内部媒体端点、外部媒体端点。比如向媒体交换服务器发送申请请求1，请求媒体交换服务器分配相互关联的第一会议终端的外部媒体端点和内部媒体端点。申请请求1中携带第一会议终端的媒体端点IP1:port1。
步骤703，媒体交换服务器接收到申请请求1后，为第一会议终端分配两个媒体端点，即外部媒体端点IP2:port2，内部媒体端点IP3:port3，向信令服务器发送申请响应1。申请响应1携带外部媒体端点IP2:port2，内部媒体端点IP3:port3。媒体交换服务器保存外部媒体端点IP2:port2，内部媒体端点IP3:port3的关联关系。
媒体交换服务器分配外部媒体端点IP2:port2后，在第一会议终端的媒体端点IP1：port1与外部媒体端点IP2：port2之间创建外部媒体连接。
步骤704，信令服务器收到该申请响应1后，向第一会议终端发送呼叫响应1。呼叫响应1中携带外部媒体端点IP2:port2。第一会议终端收到该呼叫响应1后，建立外部媒体连接OutLink01，即在第一会议终端的媒体端点IP1：port1与外部媒体端点IP2：port2之间的外部媒体连接。
上述步骤701-步骤704，信令服务器触发媒体交换服务器在第一会议终端自身的媒体端点IP1:port1和第一会议终端的外部媒体端点IP2:port2之间建立外部媒体连接OutLink01。一些实施例中，信令服务器可以保存第一会议终端的外部媒体端点IP2:port2和第一会议终端的内部媒体端点IP3:port3映射关系。
步骤705，信令服务器将第一会议终端加入视频会议，即信令服务器向第一会议服务器发送接入请求，接入请求携带媒体交换服务器为第一会议终端分配的内部媒体端点IP3:port3；
步骤706，第一会议服务器给信令服务器发送接入响应，接入响应携带第一会议服务器为第一会议终端分配的媒体端点IP4:port4。
步骤707，信令服务器向媒体交换服务器发送用于建立内部媒体连接的请求，携带第一会议服务器的媒体端点IP4:port4。从而媒体交换服务器建立的内部媒体连接是InLink01。
上述步骤601-步骤609完成了第一会议终端的媒体连接，包括内部媒体连接和外部媒 体连接。如下信令服务器触发建立第二会议终端的媒体连接的流程进行描述，参见图6D所示。
步骤610，信令服务器外呼第二会议终端，可以向第二会议终端发送呼叫请求2，呼叫请求2用于请求第二会议终端接入视频会议。
步骤611，第二会议终端接收到呼叫请求2后，向信令服务器发送呼叫响应2，呼叫响应2携带第二会议终端的媒体端点，比如为IP1’:port1’。
步骤612，信令服务器向媒体交换服务器发送申请请求3，申请请求3用于请求媒体交换服务器为第二会议终端分配外部媒体端点。申请请求3可以携带第二会议终端的媒体端点IP1’:port1’。媒体交换服务器在为第二会议终端分配外部媒体端点后，比如为第二会议终端分配的外部媒体端点为IP2’:port2’，根据第二会议终端的媒体端点IP1’:port1’和为第二会议终端分配的外部媒体端点IP2’:port2’完成媒体交换服务器侧的外部媒体连接的创建。本申请实施例中媒体交换服务器可以采用集群的方式部署。
一些实施例中，为第一会议终端和第二会议终端提供服务的媒体交换服务器可以相同也可以不同。比如，为第一会议终端和第二会议终端提供服务的媒体交换服务器相同时，该媒体交换服务器为第一会议终端和为第二会议终端分别分配的外部媒体端点的IP地址可以相同且端口号不同。比如，该媒体交换服务器为第一会议终端和第二会议终端分配的外部媒体端点的IP地址均可以采用IP2，但端口号不同。当然，媒体交换服务器上部署于有多个IP地址时，为第一会议终端和为第二终端分配的外部媒体端口的IP地址不同且端口号不同。再比如，为第一会议终端和第二会议终端提供服务的媒体交换服务相同时，媒体交换服务器为第一会议终端和为第二会议终端分别分配的内部媒体端点的IP地址可以相同且端口号不同。比如，该媒体交换服务器为第一会议终端和第二会议终端分配的外部媒体端点的IP地址均可以采用IP3，但端口号不同。当然，媒体交换服务器上部署有多个IP地址时，为第一会议终端和为第二终端分配的内部媒体端点的IP地址不同且端口号不同。
步骤613，媒体交换服务器向信令服务器发送申请响应3，申请响应3携带媒体交换服务器为第二会议终端分配的外部媒体端点IP2’:port2’。
步骤614，信令服务器向第二会议终端发送为第二会议终端分配的外部媒体端点IP2’:port2’，进而第二会议终端根据自身的媒体端点IP1’:port1’和外部媒体端点IP2’:port2’完成第二会议终端侧的外部媒体连接的创建，比如第二会议终端的外部媒体连接称为OutLink02。
一些实施例中，信令服务器可以在外呼第二会议终端之前，先向媒体交换服务器请求为第二会议终端分配外部媒体端点。然后在向第二会议终端发送呼叫请求2时将为第二会议终端分配的外部媒体端点发送给第二会议终端。
另一些实施例中，信令服务器可以在接收到第二会议终端发送的呼叫响应2后，再向媒体交换服务器申请媒体端点。图6D中以采用该方式为例。
步骤615，信令服务器向媒体交换服务器发送申请请求4，申请请求4用于请求媒体交换服务器为第二会议终端分配内部媒体端点。
步骤616，媒体交换服务器接收到申请请求4后，为第二会议终端分配内部媒体端点，比如IP3’:port3’，然后向信令服务器发送申请响应4，申请响应4包括媒体交换服务器为第二会议终端分配的内部媒体端点IP3’:port3’。
步骤617，信令服务器接收到申请响应4后，请求第一会议服务器将第二会议终端加入视频会议。信令服务器向第一会议服务器发送接入请求2，接入请求2用于请求将第二会议终端接入视频会议。示例性地，接入请求2携带为第二会议终端分配的内部媒体端点IP3’:port3’。
步骤618，第一会议服务器向信令服务器发送接入响应2，接入响应2携带第一会议服务器为第二会议终端分配的媒体端点，比如IP4:port4’。
上述实施例中，以第一会议终端与第二会议终端使用相同的第一会议服务器，因此第一会议服务器可以为第一会议终端和第二会议终端分配相同的IP地址ip4，但分配不同的端口。一些可能的实施例中，第一会议服务器采用集群方式部署，第一会议终端和第二会议终端可以使用不同的第一会议服务器或者使用相同的第一会议服务器。
步骤619，信令服务器向媒体交换服务器发送第一会议服务器的媒体端点IP4:port4’。媒体交换服务器根据第一会议服务器的媒体端点IP4:port4’以及第二会议终端的内部媒体端点IP3’:port3’完成媒体交换服务器侧的第二会议终端的内部媒体连接，比如第二会议终端的内部媒体连接称为InLink02。
进一步地，媒体交换服务器完成第二会议终端的内部媒体连接InLink02与外部媒体连接OutLink02的相互关联。
与第一会议终端的关联方式类似，媒体交换服务器可以根据信令服务器的指示关联媒体交换服务器为第二会议终端分配的内部媒体端点和外部媒体端点，即完成第二会议终端的内部媒体连接与第二会议终端的外部媒体连接的关联。
方式2-1，信令服务器可以在步骤615向媒体交换服务器发送申请请求4时，向媒体交换服务器指示为第二会议终端分配的内部媒体端点后，与为第二会议终端分配的外部媒体端点建立关联关系。从而媒体交换服务器在完成为第二会议终端分配外部媒体端点后，创建第二会议终端的内部媒体端点和外部媒体端点的关联关系。一些实施例中，申请请求4中可以携带第二会议终端的外部媒体端点。
进一步地，第二会议终端的内部媒体连接和外部媒体连接完成建立后，也即在媒体交换服务器上由于创建了第二会议终端的内部媒体端点和外部媒体端点的关联关系，而完成了第二会议终端的内部媒体连接与外部媒体连接的关联关系的创建。
方式2-2，信令服务器可以步骤616接收到媒体交换服务器为第二会议终端分配的内部媒体端点后，向媒体交换服务器指示为第二会议终端分配的内部媒体端点与为第二会议终端分配的外部媒体端点建立关联关系。
方式2-3，信令服务器可以在步骤619向媒体交换服务器发送第一会议服务器为第二会议终端分配的媒体端点时，向媒体交换服务器指示为第二会议终端分配的内部媒体端点与为第二会议终端分配的外部媒体端点建立关联关系。
方式2-4，信令服务器可以在完成步骤619后，向媒体交换服务器指示为第二会议终端分配的内部媒体端点与为第二会议终端分配的外部媒体端点建立关联关系。
方式2-5，信令服务器可以向媒体交换服务器申请第一会议终端的外部媒体端口的同时，也一并向媒体交换服务器申请第一会议终端的内部媒体端口。
步骤612中信令服务器向媒体交换服务器发送的申请请求3既用于请求媒体交换服务器为第二会议终端分配外部媒体端点，也用于请求媒体交换服务器为第二会议终端分配内部媒体端点。进而，媒体交换服务器在步骤613向信令服务器反馈的申请响应4中携带为 第二会议终端分配内部媒体端点和为第二会议终端分配外部媒体端点。信令服务器一并向媒体交换服务器申请第二会议终端的内部媒体端点和外部媒体端点时，还可以指示媒体交换服务器关联为第二会议终端分配的内部媒体端点和外部媒体端点。比如申请请求3中还可以携带指示信息2，该指示信息2用于指示媒体交换服务器关联为第二会议终端分配的内部媒体端点和外部媒体端点。需要说明的是，在采用方式2-5时，步骤615和步骤616则不再执行。
通过上述图6C和图6D所示的流程，完成第一会议终端的媒体连接与第二会议终端的媒体连接的创建，进一步第一会议终端与第二会议终端可以通过建立的媒体连接进行视频通话。
在一些实施例中，在桌面云场景中，某一参与方使用桌面云系统中的虚拟机连接视频会议系统，在该参与方与媒体交换服务器建立外部媒体连接时，可以是该参与方使用的虚拟机与媒体交换服务器之间建立外部媒体连接。在后续媒体流转发时，通过虚拟机将媒体流发送给参与方的使用终端显示或者播放。
参见图8所示，对音视频流的传输流程进行描述。图8中，以第一会议服务器为SFU会议服务器为例。
步骤801，第一会议终端通过第一会议终端的外部媒体连接OutLink01将产生的音视频流发送给媒体交换服务器。
示例性地，第一会议终端根据媒体端点ip1:port1和外部媒体端点ip2:port2的关联关系，通过媒体端点ip1:port1发送至媒体交换服务器的第一会议终端的外部媒体端点(ip2:port2)。
步骤802，媒体交换服务器根据第一会议终端的外部媒体连接OutLink01与内部媒体连接InLink01的关联关系，将音视频流发送给第一会议服务器。
示例性地，媒体交换服务器将音视频流转发至第一会议终端的内部媒体端点(ip3:port3)，通过该内部媒体端点ip3:port3发送至第一会议服务器的第一会议终端的媒体端点(ip4:port4)。
步骤803，第一会议服务器根据转发规则，通过第二会议终端的内部媒体连接发送给媒体交换服务器。示例性地，第一会议服务器根据转发规则，将第一会议终端的音视频流转发至第一会议服务器中的第二会议终端的媒体端点(ip4:port4)，使用此端点ip4:port4发送至媒体交换服务器的第二会议终端的内部媒体端点(ip3’:port3’)。
步骤804，媒体交换服务器通过第二会议终端的外部媒体连接将第一会议终端的音视频流发送给第二会议终端。
示例性地，媒体交换服务器将来自第二会议终端的内部媒体端点的音视频流，转发至第二会议终端的外部媒体端点(ip2’:port2’)，再发送至第二会议终端的媒体端点(ip1’:port1’)，至此，视频会议系统完成第一会议终端输入的音视频流发送至第二会议终端。
同样地，第二会议终端输入的音视频流转发至第一会议终端的实现过程，原理与第一会议终端输入的音视频流转发至第二会议终端的实现过程类似。具体参见步骤805-步骤808。
步骤805，第二会议终端通过第二会议终端的外部媒体连接OutLink02将产生的音视频流发送给媒体交换服务器。
示例性地，第二会议终端根据媒体端点ip1’:port1’和外部媒体端点ip2’:port2’的关联关系，通过媒体端点ip1’:port1’发送至媒体交换服务器的第二会议终端的外部媒体端点 (ip2’:port2’)。
步骤806，媒体交换服务器根据第二会议终端的外部媒体连接OutLink02与内部媒体连接InLink02的关联关系，将音视频流发送给第一会议服务器。
示例性地，媒体交换服务器将音视频流转发至第二会议终端的内部媒体端点(ip3’:port3’)，通过该内部媒体端点ip3’:port3’发送至第二会议服务器的第二会议终端的媒体端点(ip4:port4’)。
步骤807，第一会议服务器根据转发规则，通过第一会议终端的内部媒体连接发送给媒体交换服务器。示例性地，第一会议服务器根据转发规则，将第二会议终端的音视频流转发至第一会议服务器中的第一会议终端的媒体端点(ip4:port4)，使用此端点ip4:port4发送至媒体交换服务器的第一会议终端的内部媒体端点(ip3:port3)。
步骤808，媒体交换服务器通过第一会议终端的外部媒体连接将第二会议终端的音视频流发送给第一会议终端。
示例性地，媒体交换服务器将来自第一会议终端的内部媒体端点的音视频流，转发至第一会议终端的外部媒体端点(ip2:port2)，再发送至第一会议终端的媒体端点(ip1:port1)，至此，视频会议系统完成第二会议终端输入的音视频流发送至第一会议终端。
一些可能的实施例中，在第二会议终端和第一会议终端均加入视频会议后，信令服务器可以配置参与方的互看属性，即向第一会议服务器配置转发规则。一些实施例中，不同的场景可以有不同的配置。在第一参与方与第二参与方通话过程中，可以配置双方互看，比如业务代表和用户通话过程中，可以配置业务代表观看用户的视频画面，用户观看业务代表的视频画面。信令服务器在第一会议服务器配置第一会议终端与第二会议终端的音视频流转发规则。进而第一会议终端产生音视频流后，发送给第一会议服务器，第一会议服务器可以根据转发规则向第二会议终端转发音视频流。第二会议终端产生音视频流后，发送给第一会议服务器，第一会议服务器可以根据转发规则向第一会议终端转发音视频流。一些场景中，两个参与方通话过程中，还可以配置第一参与方看第二参与方的视频画面，但第二参与方不看第一参与方的视频画面。一些场景中，多方进行视频会议时，比如用户、业务代表和专家进行视频会议，设置业务代表和专家都看用户的视频画面、用户看业务代表的视频画面。三个或者三个以上的会议终端加入视频会议，可以根据场景需求，信令服务器配置不同的转发规则。比如三个参与方中每个参与方都互看其它参与方的视频画面。
一些场景中，在视频会议发起后，由于某个参与方的操作需要更换视频会议模式，比如由SFU模式切换到MCU模式，或者由MCU模式切换到SFU模式。比如，启动会议录制，需要将两方或者多方的视频画面混合后录制，或者由原来的会议录制场景切换到不需要录制的场景等等。如下以会议模式由第一模式切换到第二模式为例。第一模式对应于第一会议服务器，第二模式对应于第二会议服务器。以第二会议终端发起由第一模式切换到第二模式为例。
参见图9A-图9D所示，对会议模式切换流程进行描述。图9A和图9B，以在切换外部媒体连接关联的内部媒体连接时采用第二种可能的实现方式为例进行说明。图9C和图9D，以在切换外部媒体连接关联的内部媒体连接时采用第一种可能的实现方式为例进行说明。
步骤901a，第二会议终端向信令服务器发送会议模式切换请求，所述会议模式切换请 求用于指示会议模式由第一模式切换到第二模式。
一些场景中，会议终端无感知会议模式，在会议终端发起某种请求时，比如请求发起会议录制，信令服务器根据通知确定需要会议录制，如果原来是SFU模式，则切换到MCU模式，需要更换提供视频会议服务的会议服务器。又比如，请求停止会议录制，信令服务器根据请求确定停止会议录制，如果原来是MCU模式，则切换到MCU模式，需要更换提供视频会议服务的会议服务器。
步骤902a，信令服务器向第一会议服务器指示将第一会议终端从第一模式的视频会议中删除。第一会议服务器可以根据信令服务器的指示，将为第一会议终端分配的媒体端点释放。比如，为第一会议终端分配的媒体端点为ip4:port4，则第一会议服务器将为第一会议终端分配的媒体端点ip4:port4释放。第一会议服务器还可以删除在第一会议服务器侧创建的第一会议终端的内部媒体连接。
信令服务器在接收到会议模式切换请求后，可以触发媒体交换服务器断开与第一会议服务器的内部媒体连接并创建与第二会议服务器的内部媒体连接。
步骤903a，信令服务器向媒体交换服务器指示断开所述第一会议终端的内部媒体连接。媒体交换服务器可以根据信令服务器的指示，断开所述第一会议终端的内部媒体连接。比如，所述第一会议终端的内部媒体连接是为第一会议终端分配的内部媒体端点ip3:port3与第一会议服务器的媒体端点ip4:port4之间的媒体连接，媒体交换服务器可以删除保存的第一会议服务器的媒体端点ip4:port4。即媒体交换服务器将第一会议终端分配的内部媒体端点ip3:port3所指向的媒体端点修改为空，完成断开第一会议终端的内部媒体连接，参见图9B所示。
步骤904a，信令服务器向第一会议服务器指示将第二会议终端从第一模式的视频会议中删除。第一会议服务器可以根据信令服务器的指示，将为第二会议终端分配的媒体端点释放。比如，为第二会议终端分配的媒体端点为ip4:port4’，则第一会议服务器将为第一会议终端分配的媒体端点ip4:port4’释放。第一会议服务器还可以删除在第一会议服务器侧创建的第二会议终端的内部媒体连接。
步骤905a，信令服务器向媒体交换服务器指示删除所述第二会议终端的内部媒体连接。媒体交换服务器可以根据信令服务器的指示，删除所述第二会议终端的内部媒体连接。比如，所述第二会议终端的内部媒体连接是为第二会议终端分配的内部媒体端点ip3’:port3’与第一会议服务器的媒体端点ip4:port4’之间的媒体连接，媒体交换服务器可以删除保存的第一会议服务器的媒体端点ip4:port4’。即媒体交换服务器将为第二会议终端分配的内部媒体端点ip3’:port3’所指向的媒体端点修改为空。
一些可能的实施例中，步骤902a-903a，与步骤904a-905a可以并行执行，本申请实施例并不限定先后执行顺序。
在经过上述步骤901a-905a后，信令服务器完成了两个会议终端从第一模式的视频会议中删除。需要说明的是，需要三个或者三个以上的会议终端参与视频会议，信令服务器会执行将多个会议终端从第一模式的视频会议中删除。
一种可能的示例中，信令服务器在将两个会议终端从第一模式的视频会议中删除后，还可以执行控制第一会议服务器释放为第一会议终端和第二会议终端分配的会议资源。一些可能的方式中，信令服务器可以在指示第一会议服务器删除第一会议终端和第二会议终端的内部媒体连接时，指示第一会议服务器释放第一会议终端和第二会议终端分配的会议 资源。
上述流程中，由于媒体交换服务器的存在，信令服务器在将会议终端从第一模式的视频会议中删除时，只是释放媒体交换服务器和第一会议服务器之间的内部媒体连接，媒体交换服务器和会议终端之间的外部媒体连接继续维持，可以认为会议终端的呼叫并未被挂断。并且在模式切换时，及时释放第一模式下的内部媒体连接资源，可以减少资源浪费，提升资源利用率。
参见图9C所示：
步骤901c，参见步骤901a所示，此处不再赘述。
步骤902c，信令服务器向媒体交换服务器指示取消第一会议终端的外部媒体连接与第一会议终端的内部媒体连接的关联关系。媒体交换服务器可以根据信令服务器的指示，取消外部媒体连接与所述第一会议终端的内部媒体连接的关联关系。比如，所述第一会议终端的外部媒体连接与第一内部媒体连接的关联关系包括为第一会议终端分配的第一内部媒体端点ip3:port3与外部媒体端点ip2:port2之间的关联关系。媒体交换服务器可以将第一内部媒体端点ip3:port3与外部媒体端点ip2:port2之间的关联关系删除，参见图9D所示。
步骤903c，信令服务器向媒体交换服务器指示取消第二会议终端的外部媒体连接与第二会议终端的第一内部媒体连接的关联关系。媒体交换服务器可以根据信令服务器的指示，取消第二会议终端的外部媒体连接与第二会议终端的第一内部媒体连接的关联关系。比如，所述第二会议终端的外部媒体连接与第二会议终端的第一内部媒体连接的关联关系包括为第一会议终端分配的内部媒体端点ip3’:port3’与外部媒体端点ip2’:port2’之间的关联关系。媒体交换服务器可以将内部媒体端点ip3’:port3’与外部媒体端点ip2’:port2’之间的关联关系删除。
在经过上述步骤901c-步骤903c后，信令服务器完成了两个会议终端从第一模式的视频会议中删除。需要说明的是，需要三个或者三个以上的会议终端参与视频会议，信令服务器会执行将多个会议终端从第一模式的视频会议中删除。
上述流程中，由于媒体交换服务器的存在，信令服务器在将会议终端从第一模式的视频会议中删除时，只是取消各个会议终端的内部媒体连接和外部媒体连接的关联关系，媒体交换服务器和会议终端之间的外部媒体连接继续维持，可以认为会议终端的呼叫并未被挂断。
如下结合图10A对第一模式切换第二模式场景中，以在切换外部媒体连接关联的内部媒体连接时采用第二种可能的实现方式为例，对第二模式的视频会议的创建流程进行说明。从图9A和图9B可知，创建第二模式的视频会议前，信令服务器通过媒体交换服务器维持会议终端与媒体交换服务器之间的外部媒体连接。进而信令服务器将第一会议终端和第二会议终端加入第二模式的视频会议，可以理解是将为第一会议终端和第二会议终端分配的内部媒体端点与第二会议服务器建立关联。
步骤1001a，信令服务器将第一会议终端的外部媒体端点发送给第二会议服务器。示例性地，信令服务器向第二会议服务器发送接入请求3，接入请求3包括第一会议终端的外部媒体端点ip3:port3。接入请求3用于请求第二会议服务器将第一会议终端加入第二模式的视频会议。一些实施例中，第二会议服务器在接收到接入请求3后，为第一会议终端分配媒体端点，比如ip5:port5。作为一种举例，第二会议服务器为MCU会议服务器时，第二会议服务器还为第一会议终端分配通道编码器和通道解码器。
步骤1002a，第二会议服务器向信令服务器发送第二会议服务器为第一会议终端分配的媒体端点ip5:port5。第二会议服务器可以根据为第一会议终端分配的媒体端点ip5:port5以及第一会议终端的外部媒体端点ip3:port3完成第二会议终端的内部媒体连接的创建。
比如，第二会议服务器向信令服务器发送接入响应3，接入响应3包括为第一会议终端分配的媒体端点ip5:port5。
步骤1003a，信令服务器将第二会议服务器的媒体端点ip5:port5发送给媒体交换服务器。媒体交换服务器根据第二会议服务器的媒体端点ip5:port5和第一会议终端的内部媒体端点ip3:port3完成第一会议终端的内部媒体连接的创建。可以理解为：媒体交换服务器建立第一会议终端的内部媒体端点ip3:port3与第二会议服务器的媒体端点ip5:port5的关联关系，即将ip3:port3指向为空更新为指向ip5:port5。
步骤1004a，信令服务器将第二会议终端的外部媒体端点发送给第二会议服务器。示例性地，信令服务器向第二会议服务器发送接入请求4，接入请求4包括第二会议终端的外部媒体端点ip3’:port3’。接入请求4用于请求第二会议服务器将第二会议终端加入第二模式的视频会议。一些实施例中，第二会议服务器在接收到接入请求4后，为第二会议终端分配媒体端点，比如ip5:port5’。作为一种举例，第二会议服务器为MCU会议服务器时，第二会议服务器还为第二会议终端分配通道编码器和通道解码器。
步骤1005a，第二会议服务器向信令服务器发送第二会议服务器为第二会议终端分配的媒体端点ip5:port5’。第二会议服务器可以根据为第二会议终端分配的媒体端点ip5:port5’以及第二会议终端的内部媒体端点ip3’:port3’完成第一会议终端的内部媒体连接的创建。比如，第二会议服务器向信令服务器发送接入响应4，接入响应4包括为第一会议终端分配的媒体端点ip5:port5’。
步骤1006a，信令服务器将第二会议服务器的媒体端点ip5:port5’发送给媒体交换服务器。媒体交换服务器根据第二会议服务器的媒体端点ip5:port5’和第二会议终端的内部媒体端点ip3’:port3’完成第二会议终端的内部媒体连接的创建。可以理解为：媒体交换服务器建立第二会议终端的内部媒体端点ip3’:port3’与第二会议服务器的媒体端点ip5:port5’的关联关系，即将ip3’:port3’指向为空更新为指向ip5:port5。
一些可能的实施例中，步骤1002a-1003a，与步骤1004a-1005a可以并行执行，本申请实施例并不限定先后执行顺序。
在经过上述步骤1001a-1005a后，信令服务器完成了两个会议终端加入第一模式的视频会议的流程。需要说明的是，需要三个或者三个以上的会议终端参与视频会议，信令服务器会执行将多个会议终端加入第二模式的视频会议的流程。
如下结合图10B对第一模式切换第二模式场景中，以在切换外部媒体连接关联的内部媒体连接时采用第一种可能的实现方式为例，对第二模式的视频会议的创建流程进行说明。
步骤1001b，信令服务器向媒体交换服务器发送申请请求11，申请请求11请求为第一会议终端分配第二模式下的内部媒体端点。
步骤1002b，媒体交换服务器接收到申请请求11后，为第一会议终端分配第二模式下的内部媒体端点IP33:port33，向信令服务器发送申请响应11。申请响应11携带内部媒体端点IP33:port33。媒体交换服务器保存外部媒体端点IP2:port2，内部媒体端点IP33:port33的关联关系。
步骤1003b，信令服务器将第一会议终端加入视频会议，即信令服务器向第二会议服务器发送接入请求5，接入请求5携带媒体交换服务器为第一会议终端分配的内部媒体端点IP33:port33；
步骤1004b，第二会议服务器给信令服务器发送接入响应5，接入响应5携带第二会议服务器为第一会议终端分配的媒体端点IP44:port44。
步骤1005b，信令服务器向媒体交换服务器发送用于建立内部媒体连接的请求，携带第二会议服务器的媒体端点IP44:port44。从而媒体交换服务器建立第二模式下的内部媒体连接。
步骤1006b，信令服务器向媒体交换服务器发送申请请求22，申请请求22请求为第二会议终端分配第二模式下的内部媒体端点。
步骤1007b，媒体交换服务器接收到申请请求22后，为第二会议终端分配第二模式下的内部媒体端点IP33’:port33’，向信令服务器发送申请响应22。申请响应22携带内部媒体端点IP33’:port33’。媒体交换服务器保存外部媒体端点IP2’:port2’和内部媒体端点IP33’:port33’的关联关系。
步骤1008b，信令服务器将第二会议终端加入视频会议，即信令服务器向第二会议服务器发送接入请求6，接入请求6携带媒体交换服务器为第二会议终端分配的内部媒体端点IP33’:port33’；
步骤1009b，第二会议服务器给信令服务器发送接入响应6，接入响应5携带第二会议服务器为第二会议终端分配的媒体端点IP44:port44’。
步骤1010b，信令服务器向媒体交换服务器发送用于建立内部媒体连接的请求，携带第二会议服务器的媒体端点IP44:port44’。从而媒体交换服务器建立第二模式下的内部媒体连接。
通过上述流程看出，在会议模式切换时，保留切换前的内部媒体连接，当后续需要切回原来的会议模式时，无需再重新建立该模式下的内部媒体连接，仅需要在媒体交换服务器上将该模式下的内部媒体连接与外部媒体连接关联即可，可以提高切换速度，避免影响用户体验。
参见图11A所示，在图10A所示的加入第二会议服务器的基础上，对音视频流的传输流程进行描述。图11A中，以第二会议服务器为MCU会议服务器为例。
步骤1101，参见步骤801，此处不再赘述。
步骤1102，媒体交换服务器根据第一会议终端的外部媒体端点ip3:port3与第二会议服务器的媒体端点ip5:port5的关联关系，将第一会议终端的音视频流发送给第二会议服务器。
示例性地，媒体交换服务器将音视频流转发至第一会议终端的内部媒体端点(ip3:port3)，通过该内部媒体端点ip3:port3发送至第二会议服务器的第一会议终端的媒体端点(ip5:port5)。
步骤1103，第二会议终端通过第二会议终端的外部媒体连接将产生的音视频流发送给媒体交换服务器。
示例性地，第二会议终端根据媒体端点ip1’:port1’和外部媒体端点ip2’:port2’的关联关系，通过媒体端点ip1’:port1’发送至媒体交换服务器的第二会议终端的外部媒体端点(ip2’:port2’)。
步骤1104，媒体交换服务器根据第二会议终端的外部媒体端点ip3’:port3’与第二会议 服务器的媒体端点ip5:port5’的关联关系，将第二会议终端的音视频流发送给第二会议服务器。
示例性地，媒体交换服务器将音视频流转发至第二会议终端的内部媒体端点(ip3’:port3’)，通过该内部媒体端点ip3’:port3’发送至第二会议服务器的第一会议终端的媒体端点(ip5:port5’)。
步骤1105，第二会议服务器对第一会议终端的音视频流和第二会议终端的音视频流进行解码处理，然后对解码后的第一会议终端的音视频数据和解码后的第二会议终端的音视频数据进行混音和混屏处理，然后对混音和混屏处理后的音视频数据进行编码得到编码音视频流。
一些实施例中，第二会议服务器通过为第一会议终端分配的通道解码器对第一会议终端的视频流进行解码。第二会议服务器通过为第二会议终端分配的通道解码器对第二会议终端的视频流进行解码。
另一些实施例中，第二会议服务器通过为第一会议终端分配的通道编码器对混音和混屏处理后的音视频数据进行编码处理。第二会议服务器通过为第二会议终端分配的通道编码器对混音和混屏处理后的音视频数据进行编码得到发送给第二会议终端的编码音视频流2。
步骤1106，第二会议服务器通过第一会议终端的内部媒体连接将编码音视频流1发送给媒体交换服务器。示例性地，第二会议服务器将编码音视频流1转发至第二会议服务器中的第一会议终端的媒体端点(ip5:port5)，使用此端点ip5:port5发送至媒体交换服务器的第一会议终端的内部媒体端点(ip3:port3)。
步骤1107，媒体交换服务器通过第一会议终端的外部媒体连接将编码音视频流1发送给第一会议终端。
示例性地，媒体交换服务器将编码音视频流1转发至第一会议终端的外部媒体端点(ip2:port2)，再发送至第一会议终端的媒体端点(ip1:port1)。进一步地，第一参与方可以通过第一会议终端观看到第一参与方的视频画面与第二参与方的视频画面混合后的视频画面，以及听到混合后的声音。
步骤1108，第二会议服务器通过第二会议终端的内部媒体连接将编码音视频流2发送给媒体交换服务器。示例性地，第二会议服务器将编码音视频流2转发至第二会议服务器中的第二会议终端的媒体端点(ip5:port5’)，使用此端点ip5:port5’发送至媒体交换服务器的第二会议终端的内部媒体端点(ip3’:port3’)。
步骤1109，媒体交换服务器通过第二会议终端的外部媒体连接将编码音视频流2发送给第二会议终端。
示例性地，媒体交换服务器将编码音视频流2转发至第二会议终端的外部媒体端点(ip2’:port2’)，再发送至第二会议终端的媒体端点(ip1’:port1’)。进一步地，第一参与方可以通过第一会议终端观看到第一参与方的视频画面与第二参与方的视频画面混合后的视频画面，以及听到混合后的声音。
作为一种举例，针对第二会议终端在触发会议录制时，即触发将会议模式由SFU模式切换到MCU模式的场景中。信令服务器在完成将第一会议终端与第二会议终端加入MCU模式的视频会议后，控制分配录制该视频会议的录制服务器。比如录制服务器采用集群方 式部署，信令服务器控制从录制服务器集群中选择录制该视频会议的录制服务器。比如，参见图11B，在步骤1101之前，步骤1110，信令服务器向第二会议服务器发送给指示信息3，指示信息3用于指示第二会议服务器启动会议录制。步骤1111，第二会议服务器为该视频会议分配录制的编码器。进一步地，第二会议服务器执行步骤1104，对解码后的第一会议终端的音视频数据和解码后的第二会议终端的音视频数据进行混音和混屏处理后，还执行：
步骤1112，第二会议服务器对混音和混屏处理的音视频数据进行编码得到编码音视频流3。
步骤1113，第二会议服务器将编码音视频流3发送给录制服务器。录制服务器对编码音视频流3按照录制的文件格式解码并写入视频文件。
一种可能的场景中，在视频会议过程中，还可以邀请其它参与方接入视频会议。比如呼叫中心系统中，用户与业务代表进行视频通话的过程中，业务代表根据通话内容判断需求助业务专家，通过业务代表终端设备发起邀请专家接入视频会议的流程。
作为一种举例，以第一会议终端与第二会议终端进行第二模式的视频会议中，第二会议终端邀请第三参与方加入视频会议为例。参见图12所示：
步骤1201，第二会议终端通知信令服务器呼叫第三会议终端加入视频会议。比如，第二会议终端向信令服务器发送通知消息，通知消息用于通知信令服务器呼叫第三会议终端加入视频会议。
步骤1202，信令服务器接收到通知消息后，向第三会议终端发送呼叫请求3，所述呼叫请求3用于请求第三会议终端接入视频会议。
步骤1203，第三会议终端接收到呼叫请求3后，向信令服务器发送呼叫响应3，呼叫响应3携带第三会议终端的媒体端点，比如为IP1”:port1”。
步骤1204，信令服务器向媒体交换服务器发送申请请求5，申请请求5用于请求媒体交换服务器为第三会议终端分配外部媒体端点。申请请求5可以携带第三会议终端的媒体端点IP1”:port1”。媒体交换服务器在为第三会议终端分配外部媒体端点后，比如为第三会议终端分配的外部媒体端点为IP2”:port2”，根据第三会议终端的媒体端点IP1”:port1”和为第三会议终端分配的外部媒体端点IP2”:port2”完成媒体交换服务器侧的外部媒体连接的创建。
步骤1205，媒体交换服务器向信令服务器发送申请响应5，申请响应5携带媒体交换服务器为第三会议终端分配的外部媒体端点IP2”:port2”。
步骤1206，信令服务器向第三会议终端发送为第三会议终端分配的外部媒体端点IP2”:port2”，进而第三会议终端根据自身的媒体端点IP1”:port1”和外部媒体端点IP2”:port2”完成第三会议终端侧的外部媒体连接的创建，比如第三会议终端的外部媒体连接称为OutLink03。
一些实施例中，信令服务器可以在外呼第三会议终端之前，先向媒体交换服务器请求为第三会议终端分配外部媒体端点。然后在向第三会议终端发送呼叫请求3时将为第三会议终端分配的外部媒体端点发送给第三会议终端。
另一些实施例中，信令服务器可以在接收到第三会议终端发送的呼叫响应3后，再向媒体交换服务器申请媒体端点。
图12中以采用该方式为例。
步骤1207，信令服务器向媒体交换服务器发送申请请求6，申请请求6用于请求媒体交换服务器为第三会议终端分配内部媒体端点。
步骤1208，媒体交换服务器接收到申请请求6后，为第三会议终端分配内部媒体端点，比如IP3”:port3”，然后向信令服务器发送申请响应6，申请响应6包括媒体交换服务器为第三会议终端分配的内部媒体端点IP3”:port3”。
步骤1209，信令服务器接收到申请响应6后，请求第二会议服务器将第三会议终端加入视频会议。信令服务器向第二会议服务器发送接入请求7，接入请求7用于请求将第三会议终端接入视频会议。示例性地，接入请求7携带为第三会议终端分配的内部媒体端点IP3”:port3”。
步骤1210，第二会议服务器向信令服务器发送接入响应7，接入响应7携带第二会议服务器为第三会议终端分配的媒体端点，比如IP5:port5”。
步骤1211，信令服务器向媒体接入服务器第二会议服务器为第三会议终端分配的媒体端点IP5:port5”。
可以理解的是，为了实现上述方法实施例中功能，信令服务器、会议终端(比如第一会议终端、第二会议终端)、会议服务器(比如第一会议服务器或者第二会议服务器)包括了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本申请中所公开的实施例描述的各示例的单元及方法步骤，本申请能够以硬件或硬件和计算机软件相结合的形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用场景和设计约束条件。
图13为本申请实施例提供的通信装置1300的示意性框图。通信装置1300包括处理模块1310和收发模块1320。
在一种可能的场景中，该通信装置1300可以应用于信令服务器或者应用于信令服务器中的芯片。用于实现上述任一实施例中信令服务器执行的方法。
收发模块1320，用于获取会议模式切换请求；
处理模块1310，用于根据会议模式切换请求，触发媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；其中：外部媒体连接用于在第一会议终端和媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；第一内部媒体连接用于在媒体交换服务器与第一会议服务器之间传输视频会议的媒体数据；第二内部媒体连接用于在媒体交换服务器与第二会议服务器之间传输视频会议的媒体数据。
一些实施例中，处理模块1310，在触发媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接时，具体用于：触发媒体交换服务器取消外部媒体连接与第一内部媒体连接的关联关系，并将外部媒体连接与第二内部媒体连接相关联。
一些实施例中，处理模块1310还用于触发所述媒体交换服务器删除所述第一内部媒体连接删除第一内部媒体连接。
一些实施例中，处理模块1310，触发所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，并建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接。
在一些实施例中，处理模块1310还用于：在第一会议终端加入视频会议时，通过收 发模块1320触发媒体交换服务器和第一会议终端创建外部媒体连接，以及触发媒体交换服务器与第一会议服务器创建第一内部媒体连接，并触发媒体交换服务器将外部媒体连接与第一内部媒体连接相关联。
在一些实施例中，处理模块1310还用于：在获取会议模式切换请求后，通过收发模块1320触发媒体交换服务器与第二会议服务器之间创建第二内部媒体连接。
在一些实施例中，收发模块1320，还用于：接收来自第一会议终端的第一请求，第一请求包括第一会议终端的媒体端口信息；向媒体交换服务器发送第二请求，第二请求用于请求建立外部媒体连接的媒体端口信息，第二请求携带第一会议终端的媒体端口信息；接收媒体交换服务器发送的第二响应，第二响应携带媒体交换服务器的第一媒体端口信息，媒体交换设备的第一媒体端口信息用于创建第一会议终端的外部媒体连接；向第一会议终端发送第一响应，第一响应中携带媒体交换服务器的第一媒体端口信息。
在一些实施例中，收发模块1320接收到媒体交换服务器发送的第二响应中还携带媒体交换服务器的第二媒体端口信息，媒体交换设备的第二媒体端口信息用于创建第一会议终端的第一内部媒体连接；收发模块1320还用于向第一会议服务器发送会议接入请求，会议接入请求用于请求第一会议终端连接第一会议服务器，会议接入请求携带媒体交换服务器的第二媒体端口信息；向第一会议服务器发送会议接入响应，会议接入响应携带第一会议服务器的媒体端口信息；向媒体交换服务器发送第一会议服务器的媒体端口信息。
在一些实施例中，收发模块1320还用于接收来自第二会议终端的第一请求，第一请求用于请求第一会议终端接入视频会议；向媒体交换服务器发送第二请求，第二请求用于请求建立外部媒体连接的第一媒体端口信息；接收媒体交换服务器发送的第二响应，第二响应携带媒体交换服务器的第一媒体端口信息。
在一些实施例中，第二请求还用于请求建立第一内部媒体连接的第二媒体端口信息，第二响应中还携带媒体交换服务器的第二媒体端口信息；收发模块1320还用于向第一会议服务器发送第一会议接入请求，第一会议接入请求用于请求第一会议终端连接第一会议服务器，第一会议接入请求携带媒体交换服务器的第二媒体端口信息；接收第一会议服务器发送的第一会议接入响应，第一会议接入响应携带第一会议服务器的媒体端口信息；向媒体交换服务器发送第一会议服务器的媒体端口信息。
在一些实施例中，收发模块1320还用于向媒体交换服务器发送第一关联请求，第一关联请求用于指示媒体交换服务器建立第一媒体端口信息和第二媒体端口信息的关联关系。
在一些实施例中，收发模块1320还用于向媒体交换服务器发送的第二请求还用于指示媒体交换服务器建立第一媒体端口信息和第二媒体端口信息的关联关系。
在一些实施例中，收发模块1320还用于向媒体交换服务器发送取消关联请求，取消关联请求用于指示媒体交换服务器取消第一媒体端口信息和第二媒体端口信息的关联关系。
在一些实施例中，在触发媒体交换服务器与第二会议服务器之间创建第二内部媒体连接时，收发模块1320还用于向媒体交换服务器发送第三请求，第三请求用于请求建立第二内部媒体连接的第三媒体端口信息；接收媒体交换服务器发送的第三响应，第三响应携带第三媒体端口信息；向第二会议服务器发送第二会议接入请求，第二会议接入请求用于请求第一会议终端连接第二会议服务器，第二会议接入请求携带第三媒体端口信息；接收 第二会议服务器发送的第二会议接入响应，第二会议接入响应携带第二会议服务器的媒体端口信息；向媒体交换服务器发送第二会议服务器的媒体端口信息。
在一些实施例中，在触发媒体交换服务器将外部媒体连接与第二内部媒体连接相关联时，收发模块1320还用于向媒体交换服务器发送第二关联请求，第二关联请求用于指示媒体交换服务器建立第一媒体端口信息和第三媒体端口信息的关联关系。
在一些实施例中，处理模块1310触发所述媒体交换服务器删除所述第一会议服务器的媒体端口信息。
在一些实施例中，收发模块1320向第二会议服务器发送第二会议接入请求，第二会议请求用于请求第一会议终端连接第二会议服务器，第四请求携带第一媒体端口信息；接收第二会议服务器发送的第二会议接入响应，第二会议接入响应携带第二会议服务器的媒体端口信息；向媒体交换服务器发送第二会议服务器的媒体端口信息。
在一些实施例中，在获取会议模式切换请求后，收发模块1320还用于分别指示第一会议服务器和媒体交换服务器删除第一内部媒体连接。
在一些实施例中，收发模块1320在获取会议模式切换请求时，具体用于接收来自第三会议终端发送的会议模式切换请求；第三会议终端为参与会议的会议终端中支持开启会议录制服务的一个会议终端。
在一些实施例中，参与会议的会议终端包括至少两个用户终端设备，或者包括用户终端设备和业务代表终端设备，或者包括用户终端设备、业务代表终端设备以及用户终端设备、业务代表终端设备和专家终端设备。
在另一种可能的场景中，该通信装置1300可以应用于媒体交换服务器或者应用于媒体交换服务器中的芯片。用于实现上述任一实施例中媒体交换服务器执行的方法。
收发模块1320，接收信令服务器的触发指令。处理模块1310根据触发指令将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；外部媒体连接用于在第一会议终端和媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；第一内部媒体连接用于在媒体交换服务器与第一会议服务器之间传输视频会议的媒体数据；第二内部媒体连接用于在媒体交换服务器与第二会议服务器之间传输视频会议的媒体数据。
在一些实施例中，处理模块1310具体用于取消外部媒体连接与第一内部媒体连接之间的关联关系，并将外部媒体连接与第二内部媒体连接相关联。
在一些实施例中，处理模块1310删除所述第一内部媒体连接。
在一些实施例中，处理模块1310具体用于断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，并建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接。
在一些实施例中，处理模块1310还用于与第一会议终端之间创建外部媒体连接，以及与第一会议服务器之间创建第一内部媒体连接。
在一些实施例中，收发模块1320还用于接收信令服务器发送的第一会议终端的媒体端口信息；通过信令服务器向第一会议终端发送媒体交换服务器的第一媒体端口信息；第一会议终端的媒体端口信息和媒体交换服务器的第一媒体端口信息用于创建第一会议终端的外部媒体连接。
在一些实施例中，收发模块1320还用于通过信令服务器向第一会议服务器发送媒体 交换服务器的第二媒体端口信息；接收信令服务器发送的第一会议服务器的媒体端口信息；第一会议服务器的媒体端口信息和媒体交换服务器的第二媒体端口信息用于创建第一会议终端的第一内部媒体连接。
在一些实施例中，收发模块1320还用于接收信令服务器的指示信息，指示信息用于指示关联外部媒体连接和第一内部媒体连接；处理模块1310建立第一媒体端口信息与第二媒体端口信息的关联关系。
在一些实施例中，处理模块1310在执行取消外部媒体连接与第一内部媒体连接之间的关联关系时，可以取消第一媒体端口信息与第二媒体端口信息的关联关系。
在一些实施例中，处理模块1310，在收发模块1320接收信令服务器的触发指令后，将所述外部媒体连接与所述第二内部媒体连接相关联之前，建立所述第二内部媒体连接。
在一些实施例中，收发模块1320通过信令服务器向第二会议服务器发送媒体交换服务器的第三媒体端口信息；接收信令服务器发送的第二会议服务器的媒体端口信息；第二会议服务器的媒体端口信息和媒体交换服务器的第三媒体端口信息用于创建第一会议终端的第二内部媒体连接；处理模块1310在执行将外部媒体连接与第二内部媒体连接相关联时，建立第一媒体端口信息与第三媒体端口信息的关联关系。
在一些实施例中，处理模块1310删除第一会议服务器的媒体端口信息；收发模块1320通过信令服务器向第二会议服务器发送媒体交换服务器的第二媒体端口信息；接收信令服务器发送的第二会议服务器的媒体端口信息；其中，第二媒体端口信息和第二会议服务器的媒体端口信息用于创建第二内部媒体连接。
应理解，以上装置中模块的划分仅仅是一种逻辑功能的划分，实际实现时可以全部或部分集成到一个物理实体上，也可以物理上分开。且装置中的模块可以全部以软件通过处理元件调用的形式实现；也可以全部以硬件的形式实现；还可以部分模块以软件通过处理元件调用的形式实现，部分模块以硬件的形式实现。例如，各个模块可以为单独设立的处理元件，也可以集成在装置的某一个芯片中实现，此外，也可以以程序的形式存储于存储器中，由装置的某一个处理元件调用并执行该模块的功能。此外这些模块全部或部分可以集成在一起，也可以独立实现。这里所述的处理元件又可以成为处理器，可以是一种具有信号的处理能力的集成电路。在实现过程中，上述方法的各步骤或以上各个模块可以通过处理器元件中的硬件的集成逻辑电路实现或者以软件通过处理元件调用的形式实现。
图14为本申请的实施例提供的可能的通信装置1400的结构示意图。通信装置1400可以用于实现上述方法实施例中信令服务器或者媒体交换服务器的功能，因此也能实现上述方法实施例所具备的有益效果。
如图14所示，通信装置1400包括处理器1410和接口电路1420。处理器1410和接口电路1420之间相互耦合。可以理解的是，接口电路1420可以为收发器或输入输出接口。可选的，通信装置1400还可以包括存储器1430，用于存储处理器1410执行的指令或存储处理器1410运行指令所需要的输入数据或存储处理器1410运行指令后产生的数据。
可以理解的是，本申请的实施例中的处理器可以是中央控制器(CPU，central processing unit)，通用处理器，协控制器，数字信号控制器(digital signal processor，DSP)，专用集成电路(ASIC，application-specific integrated circuit)，现场可编程门阵列(FPGA，field programmable gate array)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。该控制器也可以是实现计算功能的组合，例如包含一个或多个微控制器组合，DSP 和微控制器的组合等等。
当通信装置1400用于实现上述方法实施例中的方法时，处理器1410用于执行上述处理模块1410的功能，接口电路1420用于执行上述收发模块1320的功能。
当上述通信装置应用于信令服务器或者信令服务器的芯片时，该通信装置实现上述方法实施例中信令服务器的功能。当上述通信装置为应用于媒体交换服务器或者媒体交换服务器的芯片时，该通信装置实现上述方法实施例中媒体交换服务器的功能。
此外，本申请还提供了一种计算机可读存储介质，该计算机可读存储介质存储有计算机程序，上述计算机程序在被计算设备执行时实现前述信令服务器或者媒体交换服务器所实现的方法。
此外，本申请还提供了一种计算机程序产品，该计算机程序产品包括计算机指令。当该计算机指令被计算设备执行时实现前述信令服务器或者媒体交换服务器所实现的方法。
本文中术语“系统”和“网络”在本文中常被可互换使用。本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。本申请涉及的术语“至少一个”，是指一个，或一个以上，即包括一个、两个、三个及以上；“多个”，是指两个，或两个以上，即包括两个、三个及以上。“以下至少一项(个)”或其类似表达，是指的这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a,b,或c中的至少一项(个)，可以表示：a,b,c,a-b,a-c,b-c,或a-b-c，其中a,b,c可以是单个，也可以是多个。应理解，在本申请实施例中，“与A相应的B”表示B与A相关联，根据A可以确定B。但还应理解，根据A确定B并不意味着仅仅根据A确定B，还可以根据A和/或其它信息确定B。以及，除非有相反的说明，本申请实施例提及“第一”、“第二”等序数词是用于对多个对象进行区分，不用于限定多个对象的顺序、时序、优先级或者重要程度。此外，本申请实施例和权利要求书及附图中的术语“包括”和“具有”不是排他的。例如，包括了一系列步骤或模块的过程、方法、系统、产品或设备没有限定于已列出的步骤或模块，还可以包括没有列出的步骤或模块。
本申请的实施例中的方法步骤可以通过硬件的方式来实现，也可以由处理器执行软件指令的方式来实现。软件指令可以由相应的软件模块组成，软件模块可以被存放于随机存取存储器、闪存、只读存储器、可编程只读存储器、可擦除可编程只读存储器、电可擦除可编程只读存储器、寄存器、硬盘、移动硬盘、CD-ROM或者本领域熟知的任何其它形式的存储介质中。一种示例性的存储介质耦合至处理器，从而使处理器能够从该存储介质读取信息，且可向该存储介质写入信息。当然，存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外，该ASIC可以位于网络设备或终端中。当然，处理器和存储介质也可以作为分立组件存在于网络设备或终端中。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机程序或指令。在计算机上加载和执行所述计算机程序或指令时，全部或部分地执行本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、网络设备、用户设备或者其它可编程装置。所述计算机程序或指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机程序或指令可以从一个网站站点、计算机、服务器或数 据中心通过有线或无线方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是集成一个或多个可用介质的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，例如，软盘、硬盘、磁带；也可以是光介质，例如，数字视频光盘；还可以是半导体介质，例如，固态硬盘。该计算机可读存储介质可以是易失性或非易失性存储介质，或可包括易失性和非易失性两种类型的存储介质。
在本申请的各个实施例中，如果没有特殊说明以及逻辑冲突，不同的实施例之间的术语和/或描述具有一致性、且可以相互引用，不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。
本领域内的技术人员应明白，本申请的实施例可提供为方法、系统、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (53)

  1. 一种切换会议模式的方法，其特征在于，所述方法包括：
    媒体交换服务器接收信令服务器的触发指令；
    所述媒体交换服务器根据所述触发指令将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；
    其中：所述外部媒体连接用于在第一会议终端和所述媒体交换服务器之间传输视频会议的媒体数据；
    所述第一内部媒体连接用于在所述媒体交换服务器与第一会议服务器之间传输所述视频会议的媒体数据；
    所述第二内部媒体连接用于在所述媒体交换服务器与第二会议服务器之间传输所述视频会议的媒体数据；
    所述第一会议服务器提供选择性转发模式的视频会议服务，所述第二会议服务器提供多点控制模式的视频会议服务器；或者，所述第一会议服务器提供多点控制模式的视频会议服务，所述第二会议服务器提供选择性转发模式的视频会议服务。
  2. 如权利要求1所述的方法，其特征在于，所述媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：
    所述媒体交换服务器取消所述外部媒体连接与所述第一内部媒体连接之间的关联关系，并将所述外部媒体连接与所述第二内部媒体连接相关联。
  3. 如权利要求2所述的方法，其特征在于，所述方法还包括：
    所述媒体交换服务器删除所述第一内部媒体连接。
  4. 如权利要求1所述的方法，其特征在于，所述媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：
    所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，并建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接。
  5. 如权利要求2-4任一项所述的方法，其特征在于，所述媒体交换服务器在将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接之前，所述方法还包括：
    所述媒体交换服务器创建所述外部媒体连接，以及创建所述第一内部媒体连接。
  6. 如权利要求5所述的方法，其特征在于，所述媒体交换服务器创建所述外部媒体连接，包括：
    所述媒体交换服务器接收所述信令服务器发送的第二请求，所述第二请求携带所述第一会议终端的媒体端口信息；
    所述媒体交换服务器向所述信令服务器发送第二响应，所述第二响应携带所述媒体交换服务器的第一媒体端口信息；
    所述第一会议终端的媒体端口信息和所述媒体交换服务器的第一媒体端口信息用于创建所述第一会议终端的外部媒体连接。
  7. 如权利要求6所述的方法，其特征在于，所述媒体交换服务器创建所述第一内部媒体连接，包括：
    所述第二响应中还携带所述媒体交换服务器的第二媒体端口信息；
    所述媒体交换服务器接收所述信令服务器发送的所述第一会议服务器的媒体端口信息；
    所述第一会议服务器的媒体端口信息和所述媒体交换服务器的第二媒体端口信息用于创建所述第一会议终端的第一内部媒体连接。
  8. 如权利要求7所述的方法，其特征在于，所述方法还包括：
    所述媒体交换服务器接收所述信令服务器的指示信息，所述指示信息用于指示关联所述外部媒体连接和所述第一内部媒体连接；
    所述媒体交换服务器建立所述第一媒体端口信息与所述第二媒体端口信息的关联关系。
  9. 如权利要求7或8所述的方法，其特征在于，所述媒体交换服务器取消所述外部媒体连接与所述第一内部媒体连接之间的关联关系，包括：
    所述媒体交换服务器删除所述第一媒体端口信息与所述第二媒体端口信息的关联关系。
  10. 如权利要求6-9任一项所述的方法，其特征在于，所述方法还包括：
    所述媒体交换服务器接收信令服务器的触发指令后，将所述外部媒体连接与所述第二内部媒体连接相关联之前，建立所述第二内部媒体连接。
  11. 如权利要求10所述的方法，其特征在于，所述媒体交换服务器建立所述第二内部媒体连接，包括：
    所述媒体交换服务器通过所述信令服务器向所述第二会议服务器发送所述媒体交换服务器的第三媒体端口信息；
    所述媒体交换服务器接收所述信令服务器发送的所述第二会议服务器的媒体端口信息；
    所述第二会议服务器的媒体端口信息和所述媒体交换服务器的第三媒体端口信息用于创建所述第一会议终端的第二内部媒体连接；
    所述媒体交换服务器将所述外部媒体连接与所述第二内部媒体连接相关联，包括：
    所述媒体交换服务器建立所述第一媒体端口信息与所述第三媒体端口信息的关联关系。
  12. 如权利要求7或8所述的方法，其特征在于，所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，包括：
    所述媒体交换服务器删除所述第一会议服务器的媒体端口信息；
    所述媒体交换服务器建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接，包括：
    所述媒体交换服务器通过所述信令服务器向所述第二会议服务器发送所述媒体交换服务器的第二媒体端口信息；
    所述媒体交换服务器接收所述信令服务器发送的所述第二会议服务器的媒体端口信息；
    其中，所述第二媒体端口信息和所述第二会议服务器的媒体端口信息用于创建所述第二内部媒体连接。
  13. 一种切换会议模式的方法，其特征在于，所述方法包括：
    信令服务器获取会议模式切换请求；
    所述信令服务器根据所述会议模式切换请求触发媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；其中：
    所述外部媒体连接用于在第一会议终端和所述媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；
    所述第一内部媒体连接用于在所述媒体交换服务器与第一会议服务器之间传输所述视频会议的媒体数据；
    所述第二内部媒体连接用于在所述媒体交换服务器与第二会议服务器之间传输所述视频会议的媒体数据；
    所述第一会议服务器提供选择性转发模式的视频会议服务，所述第二会议服务器提供多点控制模式的视频会议服务器，或者，所述第一会议服务器提供多点控制模式的视频会议服务，所述第二会议服务器提供选择性转发模式的视频会议服务。
  14. 如权利要求13所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：
    所述信令服务器触发所述媒体交换服务器取消所述外部媒体连接与所述第一内部媒体连接的关联关系，并将所述外部媒体连接与所述第二内部媒体连接相关联。
  15. 如权利要求14所述的方法，其特征在于，所述方法还包括：
    所述信令服务器还触发所述媒体交换服务器删除所述第一内部媒体连接。
  16. 如权利要求13所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：
    所述信令服务器触发所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，并建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接。
  17. 如权利要求14-16任一项所述的方法，其特征在于，所述方法还包括：
    在第一会议终端加入视频会议时，所述信令服务器触发所述媒体交换服务器和所述第一会议终端创建所述外部媒体连接，以及触发所述媒体交换服务器与所述第一会议服务器创建所述第一内部媒体连接，并触发所述媒体交换服务器将所述外部媒体连接与所述第一内部媒体连接相关联。
  18. 如权利要求17所述的方法，其特征在于，所述方法还包括：
    所述信令服务器接收来自所述第一会议终端的第一请求，所述第一请求包括所述第一会议终端的媒体端口信息；
    所述信令服务器触发媒体交换服务器和第一会议终端之间创建所述外部媒体连接，包括：
    所述信令服务器向所述媒体交换服务器发送第二请求，所述第二请求用于请求建立所述外部媒体连接的媒体端口信息，所述第二请求携带所述第一会议终端的媒体端口信息；
    所述信令服务器接收所述媒体交换服务器发送的第二响应，所述第二响应携带所述媒体交换服务器的第一媒体端口信息，所述媒体交换设备的第一媒体端口信息用于创建所述第一会议终端的外部媒体连接；
    所述信令服务器向所述第一会议终端发送第一响应，所述第一响应携带所述媒体交换服务器的第一媒体端口信息。
  19. 如权利要求18所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务 器创建所述第一内部媒体连接，包括：
    所述信令服务器接收到所述媒体交换服务器发送的第二响应中还携带所述媒体交换服务器的第二媒体端口信息，所述媒体交换设备的第二媒体端口信息用于创建所述第一会议终端的第一内部媒体连接；
    所述信令服务器向所述第一会议服务器发送第一会议接入请求，所述第一会议接入请求用于请求所述第一会议终端连接所述第一会议服务器，所述第一会议接入请求携带所述媒体交换服务器的第二媒体端口信息；
    所述信令服务器接收所述第一会议服务器发送的第一会议接入响应，所述第一会议接入响应携带所述第一会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第一会议服务器的媒体端口信息。
  20. 如权利要求17所述的方法，其特征在于，所述方法还包括：
    所述信令服务器接收来自第二会议终端的第一请求，所述第一请求用于请求所述第一会议终端接入视频会议；所述信令服务器触发媒体交换服务器和第一会议终端创建所述外部媒体连接，包括：
    所述信令服务器向所述媒体交换服务器发送第二请求，所述第二请求用于请求建立所述外部媒体连接的第一媒体端口信息；所述信令服务器接收所述媒体交换服务器发送的第二响应，所述第二响应携带所述媒体交换服务器的第一媒体端口信息；
    所述方法还包括：
    所述信令服务器向所述第一会议终端发送第一响应，所述第一响应携带所述媒体交换服务器的第一媒体端口信息。
  21. 如权利要求20所述的方法，其特征在于，所述信令服务器触发媒体交换服务器与第一会议服务器创建所述第一内部媒体连接，包括：
    所述第二请求还用于请求建立所述第一内部媒体连接的第二媒体端口信息，所述第二响应中还携带所述媒体交换服务器的第二媒体端口信息；
    所述信令服务器向所述第一会议服务器发送第一会议接入请求，所述第一会议接入请求用于请求所述第一会议终端连接所述第一会议服务器，所述第一会议接入请求携带所述媒体交换服务器的第二媒体端口信息；
    所述信令服务器接收所述第一会议服务器发送的第一会议接入响应，所述第一会议接入响应携带所述第一会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第一会议服务器的媒体端口信息。
  22. 如权利要求19或21所述的方法，其特征在于，所述信令服务器触发媒体交换服务器将所述第一会议终端的外部媒体连接和第一内部媒体连接相关联，包括：
    所述信令服务器向所述媒体交换服务器发送第一关联请求，所述第一关联请求用于指示所述媒体交换服务器建立第一媒体端口信息和所述第二媒体端口信息的关联关系。
  23. 如权利要求19或21所述的方法，其特征在于，所述信令服务器触发媒体交换服务器将所述第一会议终端的外部媒体连接和第一内部媒体连接相关联，包括：
    所述信令服务器向所述媒体交换服务器发送的所述第二请求还用于指示所述媒体交换服务器建立第一媒体端口信息和所述第二媒体端口信息的关联关系。
  24. 如权利要求19、21-23任一项所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务器取消所述外部媒体连接与第一内部媒体连接的关联关系，包括：
    所述信令服务器向所述媒体交换服务器发送取消关联请求，所述取消关联请求用于指示所述媒体交换服务器取消第一媒体端口信息和所述第二媒体端口信息的关联关系。
  25. 如权利要求14-15、17-24任一项所述的方法，其特征在于，所述信令服务器获取会议模式切换请求之前，所述方法还包括：
    所述信令服务器触发所述媒体交换服务器与所述第二会议服务器之间创建所述第二内部媒体连接。
  26. 如权利要求25所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务器与所述第二会议服务器之间创建所述第二内部媒体连接，包括：
    所述信令服务器向所述媒体交换服务器发送第三请求，所述第三请求用于请求建立所述第二内部媒体连接的第三媒体端口信息；
    所述信令服务器接收所述媒体交换服务器发送的第三响应，所述第三响应携带所述第三媒体端口信息；
    所述信令服务器向所述第二会议服务器发送第二会议接入请求，所述第二会议接入请求用于请求所述第一会议终端连接所述第二会议服务器，所述第二会议接入请求携带所述第三媒体端口信息；
    所述信令服务器接收所述第二会议服务器发送的第二会议接入响应，所述第二会议接入响应携带所述第二会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第二会议服务器的媒体端口信息。
  27. 如权利要求26所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务器将所述外部媒体连接与第二内部媒体连接相关联，包括：
    所述信令服务器向所述媒体交换服务器发送第二关联请求，所述第二关联请求用于指示所述媒体交换服务器建立第一媒体端口信息和所述第三媒体端口信息的关联关系。
  28. 如权利要求16-23任一项所述的方法，其特征在于，所述信令服务器触发所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，包括：
    所述信令服务器触发所述媒体交换服务器删除所述第一会议服务器的媒体端口信息。
  29. 如权利要求28所述的方法，其特征在于，所述信令服务器建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接，包括：
    所述信令服务器向所述第二会议服务器发送第二会议接入请求，所述第二会议请求用于请求所述第一会议终端连接所述第二会议服务器，所述第二会议接入请求携带所述第一媒体端口信息；
    所述信令服务器接收所述第二会议服务器发送的第二会议接入响应，所述第二会议接入响应携带所述第二会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第二会议服务器的媒体端口信息。
  30. 如权利要求16-23和28-29任一项所述的方法，其特征在于，所述信令服务器获取会议模式切换请求后，所述方法还包括：
    所述信令服务器分别指示所述第一会议服务器和所述媒体交换服务器删除所述第一内部媒体连接。
  31. 如权利要求13-30任一项所述的方法，其特征在于，所述信令服务器获取会议模式切换请求，包括：
    所述信令服务器接收来自第三会议终端发送的所述会议模式切换请求；所述第三会议终端为参与会议的会议终端中支持开启会议录制服务的一个会议终端。
  32. 如权利要求13-31任一项所述的方法，其特征在于，参与会议的会议终端包括至少两个用户终端设备，或者包括用户终端设备和业务代表终端设备，或者包括用户终端设备、业务代表终端设备以及用户终端设备、业务代表终端设备和专家终端设备。
  33. 一种通信装置，其特征在于，包括处理器和存储器，所述处理器与所述存储器耦合；
    所述存储器，用于存储程序指令；
    所述处理器，用于读取所述存储器中存储的所述程序指令，以实现如权利要求1至12任一所述的方法。
  34. 一种通信装置，其特征在于，包括处理器和存储器，所述处理器与所述存储器耦合；
    所述存储器，用于存储程序指令；
    所述处理器，用于读取所述存储器中存储的所述程序指令，以实现如权利要求13至32任一所述的方法。
  35. 一种通信系统，其特征在于，包括信令服务器、媒体交换服务器、第一会议服务器以及第二会议服务器；所述第一会议服务器提供选择性转发模式的视频会议服务，所述第二会议服务器提供多点控制模式的视频会议服务器，或者，所述第一会议服务器提供多点控制模式的视频会议服务，所述第二会议服务器提供选择性转发模式的视频会议服务；
    所述信令服务器获取会议模式切换请求，根据所述会议模式切换请求向所述媒体交换服务器发送触发指令；
    所述媒体交换服务器根据所述触发指令将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；
    所述外部媒体连接用于在第一会议终端和所述媒体交换服务器之间传输视频会议的媒体数据；第一会议终端为参与会议的任一会议终端；
    所述第一内部媒体连接用于在所述媒体交换服务器与第一会议服务器之间传输所述视频会议的媒体数据；
    所述第二内部媒体连接用于在所述媒体交换服务器与第二会议服务器之间传输所述视频会议的媒体数据。
  36. 一种计算机可读存储介质，其特征在于，所述存储介质中存储有计算机程序或指令，当所述计算机程序或指令被通信装置执行时，实现如权利要求1至32中任一项所述的方法。
  37. 一种切换会议模式的方法，其特征在于，所述方法包括：
    信令服务器获取会议模式切换请求；
    所述信令服务器根据所述会议模式切换请求向所述媒体交换服务器发送触发指令；
    所述媒体交换服务器根据所述触发指令将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接；
    其中：所述外部媒体连接用于在第一会议终端和所述媒体交换服务器之间传输视频会议的媒体数据；
    所述第一内部媒体连接用于在所述媒体交换服务器与第一会议服务器之间传输所述视频会议的媒体数据；
    所述第二内部媒体连接用于在所述媒体交换服务器与第二会议服务器之间传输所述 视频会议的媒体数据；
    所述第一会议服务器提供选择性转发模式的视频会议服务，所述第二会议服务器提供多点控制模式的视频会议服务器；或者，所述第一会议服务器提供多点控制模式的视频会议服务，所述第二会议服务器提供选择性转发模式的视频会议服务。
  38. 如权利要求37所述的方法，其特征在于，所述媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：
    所述媒体交换服务器取消所述外部媒体连接与所述第一内部媒体连接之间的关联关系，并将所述外部媒体连接与所述第二内部媒体连接相关联。
  39. 如权利要求38所述的方法，其特征在于，所述方法还包括：
    所述媒体交换服务器删除所述第一内部媒体连接。
  40. 如权利要求37所述的方法，其特征在于，所述媒体交换服务器将与外部媒体连接相关联的第一内部媒体连接切换为第二内部媒体连接，包括：
    所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，并建立所述媒体交换服务器与所述第二会议服务器之间的第二内部媒体连接。
  41. 如权利要求38-40任一项所述的方法，其特征在于，所述方法还包括：
    在第一会议终端加入视频会议时，所述信令服务器触发所述媒体交换服务器和所述第一会议终端创建所述外部媒体连接，以及触发所述媒体交换服务器与所述第一会议服务器创建所述第一内部媒体连接，并触发所述媒体交换服务器将所述外部媒体连接与所述第一内部媒体连接相关联；
    所述媒体交换服务器在所述信令服务器的触发下，创建所述外部媒体连接，以及创建所述第一内部媒体连接。
  42. 如权利要求41所述的方法，其特征在于，所述方法还包括：
    所述第一会议终端向所述信令服务器发送第一请求，所述第一请求包括所述第一会议终端的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送第二请求，所述第二请求用于请求建立所述外部媒体连接的媒体端口信息，所述第二请求携带所述第一会议终端的媒体端口信息；
    所述媒体交换服务器与所述第一会议终端之间创建所述外部媒体连接，包括：
    所述媒体交换服务器接收所述信令服务器发送的第二请求，向所述信令服务器发送第二响应，所述第二响应携带所述媒体交换服务器的第一媒体端口信息；
    所述信令服务器向所述第一会议终端第一响应，所述第一响应携带所述媒体交换服务器的第一媒体端口信息；
    所述第一会议终端的媒体端口信息和所述媒体交换服务器的第一媒体端口信息用于创建所述第一会议终端的外部媒体连接。
  43. 如权利要求42所述的方法，其特征在于，所述第二响应中还携带所述媒体交换服务器的第二媒体端口信息；所述媒体交换设备的第二媒体端口信息用于创建所述第一会议终端的第一内部媒体连接；
    所述方法还包括：
    所述信令服务器向所述第一会议服务器发送第一会议接入请求，所述第一会议接入请求用于请求所述第一会议终端连接所述第一会议服务器，所述第一会议接入请求携带所述 媒体交换服务器的第二媒体端口信息；
    所述第一会议服务器向所述媒体交换服务器发送第一会议接入响应，所述第一会议接入响应携带所述第一会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第一会议服务器的媒体端口信息；
    所述媒体交换服务器接收所述第一会议服务器的媒体端口信息；
    所述第一会议服务器的媒体端口信息用于创建所述第一会议终端的第一内部媒体连接。
  44. 如权利要求41所述的方法，其特征在于，所述方法还包括：
    所述第二会议终端向所述信令服务器发送第一请求，所述第一请求用于请求所述第一会议终端接入视频会议；所述信令服务器触发媒体交换服务器和第一会议终端创建所述外部媒体连接，包括：
    所述信令服务器向所述媒体交换服务器发送第二请求，所述第二请求用于请求建立所述外部媒体连接的第一媒体端口信息；所述信令服务器接收所述媒体交换服务器发送的第二响应，所述第二响应携带所述媒体交换服务器的第一媒体端口信息；
    所述信令服务器向所述第一会议终端发送第一响应，所述第一响应携带所述媒体交换服务器的第一媒体端口信息；
    所述第一会议终端接收所述第一响应。
  45. 如权利要求44所述的方法，其特征在于，所述信令服务器触发媒体交换服务器与第一会议服务器创建所述第一内部媒体连接，包括：
    所述第二请求还用于请求建立所述第一内部媒体连接的第二媒体端口信息，所述第二响应中还携带所述媒体交换服务器的第二媒体端口信息；
    所述信令服务器向所述第一会议服务器发送第一会议接入请求，所述第一会议接入请求用于请求所述第一会议终端连接所述第一会议服务器，所述第一会议接入请求携带所述媒体交换服务器的第二媒体端口信息；
    所述第一会议服务器向所述信令服务器发送第一会议接入响应，所述第一会议接入响应携带所述第一会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第一会议服务器的媒体端口信息；
    所述媒体交换服务器接收所述第一会议服务器的媒体端口信息。
  46. 如权利要求43或45所述的方法，其特征在于，所述方法还包括：
    所述信令服务器向所述媒体交换服务器发送第一关联请求，所述第一关联请求用于指示所述媒体交换服务器建立第一媒体端口信息和所述第二媒体端口信息的关联关系；
    媒体交换服务器将所述第一会议终端的外部媒体连接和第一内部媒体连接相关联，包括：
    所述媒体交换服务器根据所述第一关联请求将所述第一会议终端的外部媒体连接和第一内部媒体连接相关联。
  47. 如权利要求43或45所述的方法，其特征在于，所述信令服务器向所述媒体交换服务器发送的所述第二请求还用于指示所述媒体交换服务器建立第一媒体端口信息和所述第二媒体端口信息的关联关系。
  48. 如权利要求43、45-47任一项所述的方法，其特征在于，所述方法还包括：
    所述信令服务器向所述媒体交换服务器发送取消关联请求，所述取消关联请求用于指 示所述媒体交换服务器取消第一媒体端口信息和所述第二媒体端口信息的关联关系；
    媒体交换服务器取消所述外部媒体连接与第一内部媒体连接的关联关系，包括：
    所述媒体交换服务器根据所述取消关联请求取消第一媒体端口信息和所述第二媒体端口信息的关联关系。
  49. 如权利要求39-40、42-48任一项所述的方法，其特征在于，所述信令服务器获取会议模式切换请求之前，所述方法还包括：
    所述信令服务器触发所述媒体交换服务器与所述第二会议服务器之间创建所述第二内部媒体连接。
  50. 如权利要求49所述的方法，其特征在于，所述方法还包括：
    所述信令服务器向所述媒体交换服务器发送第三请求，所述第三请求用于请求建立所述第二内部媒体连接的第三媒体端口信息；
    所述媒体交换服务器与所述第二会议服务器创建所述第二内部媒体连接，包括：
    所述媒体交换服务器向所述信令服务器发送第三响应，所述第三响应携带所述第三媒体端口信息；
    所述信令服务器向所述第二会议服务器发送第二会议接入请求，所述第二会议接入请求用于请求所述第一会议终端连接所述第二会议服务器，所述第二会议接入请求携带所述第三媒体端口信息；
    所述第二会议服务器向所述信令服务器发送第二会议接入响应，所述第二会议接入响应携带所述第二会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第二会议服务器的媒体端口信息。
  51. 如权利要求50所述的方法，其特征在于，所述方法还包括：
    所述信令服务器向所述媒体交换服务器发送第二关联请求，所述第二关联请求用于指示所述媒体交换服务器建立第一媒体端口信息和所述第三媒体端口信息的关联关系；
    所述媒体交换服务器将所述外部媒体连接与所述第二内部媒体连接相关联，包括：
    所述媒体交换服务器根据所述第二关联请求建立所述第一媒体端口信息与所述第三媒体端口信息的关联关系。
  52. 如权利要求41-48任一项所述的方法，其特征在于，所述媒体交换服务器断开所述媒体交换服务器与所述第一会议服务器之间建立的第一内部媒体连接，包括：
    所述媒体交换服务器删除所述第一会议服务器的媒体端口信息。
  53. 如权利要求49所述的方法，其特征在于，所述方法还包括：
    所述信令服务器向所述第二会议服务器发送第二会议接入请求，所述第二会议请求用于请求所述第一会议终端连接所述第二会议服务器，所述第二会议接入请求携带所述第一媒体端口信息；
    所述媒体交换服务器与所述第二会议服务器建立第二内部媒体连接，包括：
    所述第二会议服务器向所述信令服务器发送第二会议接入响应，所述第二会议接入响应携带所述第二会议服务器的媒体端口信息；
    所述信令服务器向所述媒体交换服务器发送所述第二会议服务器的媒体端口信息；
    所述媒体交换服务器接收所述第二会议服务器的媒体端口信息。
PCT/CN2022/122667 2021-09-30 2022-09-29 一种切换会议模式的方法、装置及介质 Ceased WO2023051710A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22875091.5A EP4373075A4 (en) 2021-09-30 2022-09-29 METHOD AND DEVICE FOR SWITCHING CONFERENCE MODE AND MEDIUM

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111160039.6 2021-09-30
CN202111160039.6A CN115914534A (zh) 2021-09-30 2021-09-30 一种切换会议模式的方法、装置及介质

Publications (1)

Publication Number Publication Date
WO2023051710A1 true WO2023051710A1 (zh) 2023-04-06

Family

ID=85737643

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/122667 Ceased WO2023051710A1 (zh) 2021-09-30 2022-09-29 一种切换会议模式的方法、装置及介质

Country Status (3)

Country Link
EP (1) EP4373075A4 (zh)
CN (1) CN115914534A (zh)
WO (1) WO2023051710A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119276845A (zh) * 2024-08-19 2025-01-07 北京红云融通技术有限公司 视频会议迁移方法、装置、系统、介质及电子设备

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117812218A (zh) * 2024-02-28 2024-04-02 安康鸿天科技股份有限公司 基于ims通信单流媒通道下的分屏会议实现方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0305254D0 (en) * 2003-03-07 2003-04-09 Ip Access Ltd Enhancing circuit-switched media transmission over IP access networks
CN101488875A (zh) * 2009-02-12 2009-07-22 中兴通讯股份有限公司 一种点击拨号业务到多媒体会议业务的切换系统及方法
EP2099230A1 (en) * 2008-03-04 2009-09-09 Alcatel Lucent Method and system for enabling an interaction between a terminal user of intelligent TDM network and an intelligent peripheral
CN101702722A (zh) * 2009-10-28 2010-05-05 北京中星微电子有限公司 融合多业务的多媒体系统以及控制方法
WO2016027136A1 (en) * 2014-08-22 2016-02-25 Nokia Technologies Oy Method and apparatus for supporting an emergency call service in an ip multimedia subsystem session during handover
CN111711784A (zh) * 2020-06-15 2020-09-25 北京字节跳动网络技术有限公司 会议控制方法、装置、可读介质及电子设备

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9948785B2 (en) * 2016-03-22 2018-04-17 Ale International Methods and nodes for controlling a conference communication
CN106341409A (zh) * 2016-09-21 2017-01-18 深圳市潮流网络技术有限公司 一种电话会议无缝切换方法
CN108347337B (zh) * 2017-01-23 2022-03-01 腾讯科技（深圳）有限公司 会议通信方法和装置
US10708320B2 (en) * 2017-06-27 2020-07-07 Atlassian Pty Ltd Selective internal forwarding in conferences with distributed media servers
US10999346B1 (en) * 2020-01-06 2021-05-04 Dialogic Corporation Dynamically changing characteristics of simulcast video streams in selective forwarding units

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0305254D0 (en) * 2003-03-07 2003-04-09 Ip Access Ltd Enhancing circuit-switched media transmission over IP access networks
EP2099230A1 (en) * 2008-03-04 2009-09-09 Alcatel Lucent Method and system for enabling an interaction between a terminal user of intelligent TDM network and an intelligent peripheral
CN101488875A (zh) * 2009-02-12 2009-07-22 中兴通讯股份有限公司 一种点击拨号业务到多媒体会议业务的切换系统及方法
CN101702722A (zh) * 2009-10-28 2010-05-05 北京中星微电子有限公司 融合多业务的多媒体系统以及控制方法
WO2016027136A1 (en) * 2014-08-22 2016-02-25 Nokia Technologies Oy Method and apparatus for supporting an emergency call service in an ip multimedia subsystem session during handover
CN111711784A (zh) * 2020-06-15 2020-09-25 北京字节跳动网络技术有限公司 会议控制方法、装置、可读介质及电子设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4373075A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119276845A (zh) * 2024-08-19 2025-01-07 北京红云融通技术有限公司 视频会议迁移方法、装置、系统、介质及电子设备

Also Published As

Publication number Publication date
CN115914534A (zh) 2023-04-04
EP4373075A1 (en) 2024-05-22
EP4373075A4 (en) 2024-05-22

Similar Documents

Publication Publication Date Title
US11570216B2 (en) Systems and methods for conferencing
US12355830B2 (en) Transferring a phone call into a video conferencing session
US9258134B2 (en) System and method for recording communication interaction over a mobile device
CN109802913B (zh) 融合会议实现方法及装置、电子设备、可读存储介质
JP2009540659A (ja) セッション設定プロトコル基盤のアーリーメディアサービス提供方法
RU2490831C2 (ru) Способ поддержки многостороннего вызова в комбинационном сеансе
EP2910007A2 (en) Reduction of chaining in conference sessions
CN102572371A (zh) 一种视频会议实现方法及系统
EP4373075A1 (en) Method and apparatus for switching conference mode, and medium
CN101467420B (zh) 提供基于会话发起协议的早期媒体服务的方法
CN101090417A (zh) 一种Parlay网关构建多媒体呼叫中心的方法及系统
CN115941761B (zh) 一种通信、数据通道的建立方法、设备及存储介质
CN107666396B (zh) 一种多终端会议处理方法及装置
CN104756447B (zh) 一种录制会话信息的方法和录制服务器
US20200396333A1 (en) System and method for dynamic redundant call recording
KR100937025B1 (ko) Ｉｐ 단말을 이용한 다자간 통화 시스템 및 그 방법
CN103595704A (zh) 一种面向voip的企业通信应用一键呼叫方法
CN102891831A (zh) 一种多媒体会议业务的实现方法及相应设备
JP2004527156A (ja) パケット交換クライアント及び回線交換クライアントをリンクするためのシステムアーキテクチャ
WO2025146104A1 (zh) 一种多方通话处理方法、装置、电子设备及存储介质
US20120014375A1 (en) Method for Telephone Connection Preservation
CN114520805B (zh) 一种会议系统
CN107846382B (zh) 一种融合通信中多屏共享的方法、服务器、终端及系统
CN101227473B (zh) 用于多媒体通信系统的主控会议的系统及方法
CN115695387A (zh) 音视频会议实现方法、音视频会议系统及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22875091

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022875091

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022875091

Country of ref document: EP

Effective date: 20240215

NENP Non-entry into the national phase

Ref country code: DE