WO2013178188A1 - 视频会议显示方法及装置 - Google Patents

视频会议显示方法及装置 Download PDF

Info

Publication number
WO2013178188A1
WO2013178188A1 PCT/CN2013/080574 CN2013080574W WO2013178188A1 WO 2013178188 A1 WO2013178188 A1 WO 2013178188A1 CN 2013080574 W CN2013080574 W CN 2013080574W WO 2013178188 A1 WO2013178188 A1 WO 2013178188A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
terminal device
conference
mcu
stereoscopic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2013/080574
Other languages
English (en)
French (fr)
Inventor
伍贤云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to EP13797480.4A priority Critical patent/EP2890121A4/en
Priority to JP2015527768A priority patent/JP2015530037A/ja
Priority to US14/420,734 priority patent/US9661273B2/en
Publication of WO2013178188A1 publication Critical patent/WO2013178188A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/0088—Adaptation of holography to specific applications for video-holography, i.e. integrating hologram acquisition, transmission and display

Definitions

  • the present invention relates to the field of communications, and in particular to a video conference display method and apparatus.
  • a video conference system is used for holding remote, multi-point and real-time conferences, and realizes transmission and interaction of video and sound between multiple points. It is widely used in enterprises due to simple, real-time, visual effects and diversity of meetings. As the technology matures, it may be widely used in the family life in the future.
  • the video conferencing system is mainly composed of a terminal device and a management device (MCU, also referred to as a management control unit).
  • MCU management device
  • a plurality of terminal devices are usually connected to one MCU in a centralized manner to form a star topology network.
  • the terminal device is a client device, usually equipped with a multimedia component such as a television, a camera, a speaker, a microphone, etc.
  • the MCU is a system-side device that centrally exchanges and processes multimedia information of each terminal.
  • 3D technology and 4D technology people's requirements for vision are getting higher and higher, and the pursuit of that immersive feeling is like a wonderful mirage of "mirage”.
  • video conferencing systems usually use a television or other screen-based media to display remote images, and stereoscopic impact and immersive feelings are poor. In view of the poor user experience of video conferencing in related art, an effective solution has not been proposed yet.
  • a video conference display method including: a central office device MCU acquiring a stereo video source of a conference site where a first terminal device is located in a video conference; and the MCU transmitting the stereoscopic video source to the foregoing In the video conference, the terminal device other than the first terminal device, wherein the stereoscopic video source is used by the other terminal device to display the conference site where the first terminal device is located in the conference site where the other terminal device is located.
  • the acquiring, by the MCU, the stereoscopic video source of the conference site where the first terminal device is located in the video conference comprises: acquiring, by the MCU, the video data, the audio data, and the conference site of the first terminal device that is sent by the first terminal device.
  • Video acquisition parameters, the above MCU will use the above video data, audio data and video capture
  • the set parameter is synthesized into the stereoscopic video source; or the MCU obtains the stereoscopic video source sent by the first terminal device.
  • the MCU synthesizes the two-dimensional image captured by the plurality of cameras and the audio data into the stereoscopic video source according to the video capture parameter; or
  • the MCU converts the two-dimensional image captured by the one camera into a three-dimensional image according to the video capturing parameter, and synthesizes the three-dimensional image and the audio data into the stereoscopic image.
  • Video source the MCU converts the two-dimensional image captured by the one camera into a three-dimensional image according to the video capturing parameter, and synthesizes the three-dimensional image and the audio data into the stereoscopic image.
  • a video conference display method including: the second terminal device receives a stereoscopic video source sent by the central office device MCU, where the stereoscopic video source is a video of the second terminal The stereoscopic video of the conference site where the other terminal devices other than the second terminal device are located in the conference; the second terminal device displays the stereoscopic video source without the screen in the conference site where the second terminal device is located.
  • the method further includes: the second terminal device collects video data, audio data, and video collection parameters of the conference site where the second terminal device is located; and the second terminal device sends the video data, audio data, and video collection parameters.
  • the second terminal device synthesizes the video data, the audio data, and the video collection parameters into a stereo video source, and sends the data to the MCU.
  • the video data is a two-dimensional image captured by a plurality of cameras
  • the second terminal device synthesizes the two-dimensional image captured by the plurality of cameras and the audio data into the stereoscopic video source according to the video capture parameter.
  • the second terminal device converts the two-dimensional image captured by the one camera into a three-dimensional image according to the video capturing parameter, and the three-dimensional image and the above
  • the audio data is synthesized into the above stereo video source.
  • the second terminal device displays the stereoscopic video source on the conference site where the second terminal device is located in at least one of the following manners: a holographic projection device, and a plurality of projectors disposed at different angles.
  • the second terminal device displays the stereoscopic video source in the conference site where the second terminal device is located, and the second terminal device displays the stereoscopic video source without a screen according to the preset location. The conference site where the second terminal device is located.
  • a video conference display device which is located in a central office device (MCU), and the video conference display device includes: an acquisition module, configured to acquire a conference site where the first terminal device in the video conference is located a stereoscopic video source; a sending module, configured to send the stereoscopic video source to the video The terminal device other than the first terminal device in the conference, wherein the stereoscopic video source is used by the other terminal device to display the conference site where the first terminal device is located in the conference site where the other terminal device is located.
  • MCU central office device
  • the obtaining module includes: an acquiring unit, configured to acquire video data, audio data, and video collection parameters of the conference site where the first terminal device is sent by the first terminal device; and a synthesizing unit, configured to be in the video
  • the data is a two-dimensional image captured by a plurality of cameras
  • the two-dimensional image captured by the plurality of cameras and the audio data are combined into the stereoscopic video source according to the video capture parameter; or, the video data is captured by a camera.
  • the two-dimensional image the two-dimensional image captured by the one camera is converted into a three-dimensional image according to the video capture parameter, and the three-dimensional image and the audio data are combined into the stereoscopic video source.
  • a video conference display device which is located in a second terminal device, and the video conference display device includes: a receiving module, configured to receive a stereoscopic video source sent by the central office device MCU, where The stereoscopic video source is a stereoscopic video of a conference site where other terminal devices other than the second terminal device are located in the video conference in which the second terminal participates; the no-screen display module is configured to display the stereoscopic video source without a screen. In the conference site where the second terminal device is located.
  • the device further includes: an acquisition module, configured to: the second terminal device collects video data, audio data, and video collection parameters of the conference site where the second terminal device is located; and the sending module is configured to set the video data and the audio data. And transmitting the video acquisition parameters to the MCU; or synthesizing the video data, the audio data, and the video collection parameters into a stereo video source, and sending the data to the MCU.
  • an acquisition module configured to: the second terminal device collects video data, audio data, and video collection parameters of the conference site where the second terminal device is located; and the sending module is configured to set the video data and the audio data. And transmitting the video acquisition parameters to the MCU; or synthesizing the video data, the audio data, and the video collection parameters into a stereo video source, and sending the data to the MCU.
  • the MCU obtains the stereoscopic video source of the conference site where the first terminal device is located in the video conference; the MCU sends the stereoscopic video source to other terminal devices other than the first terminal device in the video conference, where the stereoscopic
  • the video source is used by other terminal devices to display the scene of the conference where the first terminal device is located in the conference site where other terminal devices are located, and solves the problem that the user experience of the video conference is poor in the related art, and the video conference is improved.
  • the sense of presence, except for the inability to touch the entity, is no different from the on-site meeting, which improves the user experience and is of great significance for the widespread promotion of video systems.
  • FIG. 1 is a flowchart of a video conference display method according to an embodiment of the present invention
  • 2 is a structural block diagram of a video conference display apparatus according to an embodiment of the present invention
  • FIG. 3 is a block diagram showing a preferred structure of an acquisition module according to an embodiment of the present invention
  • FIG. 4 is another video conference display method according to an embodiment of the present invention.
  • FIG. 5 is a block diagram showing the structure of another video conference display apparatus according to an embodiment of the present invention
  • FIG. 6 is a block diagram showing a preferred structure of another video conference display apparatus according to an embodiment of the present invention
  • FIG. 8 is a schematic diagram of data flow of a screenless video system in accordance with a preferred embodiment of the present invention.
  • Step S102 The MCU obtains a video.
  • the stereo video source of the conference site where the first terminal device is located in the conference
  • Step S104 the MCU sends the stereoscopic video source to other terminal devices other than the first terminal device in the video conference, where the stereoscopic video source is used for other terminals
  • the device displays no screen of the conference site where the first terminal device is located in the conference site where other terminal devices are located.
  • the MCU obtains the stereo video source of the conference site where the first terminal device is located in the video conference, and sends the stereoscopic video source to other terminal devices in the video conference, so that other terminal devices can use the same.
  • the stereoscopic video source stereoscopically displays the image of the conference site where the first terminal device is located in the conference site where the other terminal devices are located, because the physical real three-dimensional image is displayed in the air through the screenless display manner, thereby enabling other terminals.
  • the user corresponding to the device feels that the user corresponding to the first terminal device is at the local conference site, which solves the problem of poor user experience of the video conference in the related technology, and improves the live feeling of the video conference, except that the entity cannot be touched.
  • the manner in which the MCU obtains the stereoscopic video source may be sent after the first terminal device synthesizes the stereoscopic video source, or the first terminal device may present the conference where the first terminal device is located.
  • the video data, audio data and video acquisition parameters of the field are sent directly, and the MCU combines the video data, audio data and video acquisition parameters into a stereo video source. In this way, the flexibility of the solution is improved.
  • the MCU or the first terminal device can be conveniently synthesized; if the video data is a two-dimensional image, the two-dimensional image needs to be synthesized into a three-dimensional image, and then synthesized into a stereoscopic video source.
  • the MCU can synthesize the two-dimensional image captured by the plurality of cameras and the audio data into a stereoscopic video source according to the video capturing parameters; or, the video data is a camera.
  • the MCU can convert a two-dimensional image captured by one camera into a three-dimensional image according to the video acquisition parameters, and synthesize the three-dimensional image and the audio data into a stereoscopic video source.
  • a video conference display device is provided in the present embodiment, which is located in the MCU, and is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • FIG. 2 is a structural block diagram of a video conference display apparatus according to an embodiment of the present invention.
  • the apparatus includes: an acquisition module 22 and a transmission module 24.
  • the obtaining module 22 is configured to obtain a stereoscopic video source of the conference site where the first terminal device is located in the video conference
  • the sending module 24 is coupled to the acquiring module 22, and configured to send the stereoscopic video source to the video conference except the first terminal.
  • Other terminal devices other than the device, wherein the stereoscopic video source is used by other terminal devices to display no screen of the conference site where the first terminal device is located in the conference site where other terminal devices are located.
  • the MCU obtains the stereo video source of the conference site where the first terminal device is located in the video conference, and uses the sending module 24 to send the stereo video source to other terminal devices in the video conference.
  • the other terminal device can use the stereoscopic video source to stereoscopically display the image of the conference site where the first terminal device is located in the conference site where the other terminal devices are located, because the physical reality is displayed in the air through the screenless display manner.
  • the three-dimensional image enables the user corresponding to the other terminal device to feel that the user corresponding to the first terminal device is at the local conference site, solving the problem of poor user experience of the video conference in the related art, and improving the video conference.
  • FIG. 3 is a block diagram of a preferred structure of the acquiring module 22 according to an embodiment of the present invention.
  • the obtaining module 22 may include: an obtaining unit 222, configured to obtain a conference where the first terminal device is sent by the first terminal device.
  • FIG. 4 is a flowchart of another video conference display method according to an embodiment of the present invention.
  • the method includes the following steps: Step S402
  • the second terminal device receives the stereoscopic video source sent by the MCU, where the stereoscopic video source is a stereoscopic video of a conference site where other terminal devices other than the second terminal device are located in the video conference attended by the second terminal; S404.
  • the second terminal device displays the stereoscopic video source without a screen in the conference site where the second terminal device is located.
  • the second terminal device receives the stereo video source of the conference site where the other terminal device is located in the video conference sent by the MCU, and performs the screenless display on the stereoscopic video source, so that the second terminal device can use the second terminal device.
  • the stereoscopic video source stereoscopically displays an image of a conference site where other terminal devices are located in a conference site where the second terminal device itself is located, because the physical real three-dimensional image is displayed in the air by means of no-screen display, thereby enabling the second
  • the user corresponding to the terminal device feels that the user corresponding to the other terminal device is in the local conference site of the second terminal device, and solves the problem that the user experience of the video conference is poor in the related art, and improves the live feeling of the video conference, except There is no difference between not being able to touch the entity and meeting on the spot, which improves the user experience and is of great significance for the widespread promotion of the video system.
  • the second terminal device may collect or synthesize the stereo video source of the conference site, or the video data, the audio data, and the video collection parameters, and send the same to the MCU.
  • the interactivity of video conferencing is improved.
  • the MCU or the second terminal device can be conveniently synthesized; if the video data is a two-dimensional image, the two-dimensional image needs to be synthesized into a three-dimensional image, and then synthesized into a stereoscopic video source. .
  • the second terminal device may synthesize the two-dimensional image captured by the plurality of cameras and the audio data into a stereoscopic video source according to the video collection parameter; or, in the video data
  • the second terminal device can convert the two-dimensional image captured by one camera into a three-dimensional image according to the video acquisition parameters, and synthesize the three-dimensional image and the audio data into a stereoscopic video source.
  • the second terminal device can display the stereoscopic video source without a screen on the local conference site through the holographic projection device, or the second terminal device can also display the stereoscopic video source without the screen through multiple projectors set at different angles. Local meeting site.
  • the second terminal device may perform the screenless display according to the preset location.
  • the stereoscopic video sources corresponding to the other plurality of terminal devices in the video conference may be respectively displayed in multiple seats of the conference room in a preset order. In this way, the user can feel that everyone in the video conference feels In the conference room, and in this way to achieve remote body language communication, enhance the user experience.
  • the stereo video source corresponding to multiple terminal devices can be directly combined into a stereo video source according to the preset position, and the user can also feel that everyone in the video conference is in the conference room. Achieve the effect of remote body language communication.
  • another video conference display device is provided in the second terminal device, which is used to implement the foregoing embodiment and the preferred embodiment. The description will not be repeated.
  • the term "module" may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus includes: a receiving module 52 and a screenless display module 54, and each module is described in detail below.
  • the receiving module 52 is configured to receive a stereoscopic video source sent by the MCU, where the stereoscopic video source is a stereoscopic video of a conference site where other terminal devices other than the second terminal device are located in the video conference attended by the second terminal;
  • the screenless display module 54 is coupled to the receiving module 52 and configured to display the stereoscopic video source without a screen in the conference site where the second terminal device is located.
  • the second terminal device uses the receiving module 52 to receive the stereoscopic video source of the conference site where the other terminal device is located in the video conference sent by the MCU, and uses the no-screen display module 54 to perform the stereoscopic video source.
  • the screen display enables the second terminal device to stereoscopically display the image of the conference site where the other terminal device is located in the conference site where the second terminal device is located, because the physical device is displayed in the air by means of no screen display.
  • the real three-dimensional image enables the user corresponding to the second terminal device to feel that the user corresponding to the other terminal device is located at the conference site local to the second terminal device, and solves the problem of poor user experience of the video conference in the related art.
  • FIG. 6 is a block diagram of a preferred structure of another video conference display device 50.
  • the device 50 may further include: an acquisition module 62 configured to collect a second terminal device by the second terminal device.
  • the sending module 64 coupled with the acquisition module 62, configured to send video data, audio data and video acquisition parameters to the MCU; or, the video data, the audio data and The video acquisition parameters are synthesized into a stereo video source and sent to the MCU.
  • FIG. 7 is a schematic diagram of a screenless video conferencing system according to a preferred embodiment of the present invention.
  • the screenless video conferencing system shown in FIG. 7 is composed of a terminal device and a central office device (MCU).
  • the terminal device is used for video audio data collection, processing, and playback, and the central office device is used for media data processing and conference control.
  • the principle of the system is as follows: The terminal device collects a stereo video source or the terminal collects a plane video. After being processed by the MCU or the terminal, the conference terminal uses the screenless technology to perform stereoscopic image playback.
  • the system basic unit in the following preferred embodiments may include: a video data acquisition parameter module, a video data acquisition module, an audio data acquisition module, a video data encoding module, an audio data encoding module, a video data synthesizing module, an audio data synthesizing module, and a video.
  • Data output module, audio data output module may include the following steps: Step S2: The terminal collects audio.
  • Step S4 the terminal encodes the collected data and transmits the data to the MCU;
  • Step S6 the MCU processes according to the video data and the video collection parameters of the terminal site;
  • Step S8, the MCU plays the video audio
  • the data is encoded and distributed to each terminal; in step S10, the terminal receives the video audio data transmitted from the MCU end and completes decoding;
  • Step S12 The decoded video audio data outputs a stereoscopic image through the terminal device.
  • Embodiment 1 This embodiment is described by a video conference system with no screen placement.
  • the video conference system component includes a terminal device and a central office device, and the central office device uses an M9000 system, and the terminal device is a common camera, a video capture card, and an audio device. Acquisition card, speaker, microphone, holographic projection device, the terminal uses multiple ordinary cameras to shoot the conference site from different dimensions, and the distance between each camera and the object, angle and other dimensional parameters, focal length parameters and other control reference together with the collected data,
  • the camera is connected to the terminal device, and the terminal device encodes it and sends it to the central office device MCU through the Internet or a dedicated cable network. After the MCU decodes, the MCU performs a series of calculations according to the terminal control parameter information and the video data, and then synthesizes the stereoscopic screenlessly.
  • Embodiment 2 This embodiment illustrates a video conferencing system by using a screenless system.
  • the video conferencing system component includes a terminal device and a central office device, and the central office device uses an M9000 system, and the terminal device is a common camera, a video capture card, and an audio device.
  • the terminal uses multiple ordinary cameras to shoot the conference site from different dimensions, and the distance between each camera and the object, angle and other dimensional parameters, focal length parameters and other control reference together with the collected data
  • the camera is connected to the terminal device, and the terminal device synthesizes the stereoscopic video source according to each camera data and parameter information, encodes it, and sends it to the central office device MCU through the Internet or a dedicated cable network, and the MCU encodes and decodes it and sends it to the Internet or a dedicated cable network.
  • the terminal uses a holographic projection device for screenless display.
  • Embodiment 3 This embodiment illustrates a video conferencing system by using a screenless system.
  • the video conferencing system component includes a terminal device and a central office device, and the central office device uses a M9000 system, and the terminal device is a 3D camera and a video capture card. Audio capture card, speaker, microphone, holographic projection device, the terminal uses a 3D camera to shoot the conference site, the 3D camera is connected to the terminal device, and the terminal device encodes the collected data and sends it to the central office via the Internet or a dedicated cable network.
  • the device MCU and the MCU are transmitted to the conference terminal devices through the Internet or a dedicated cable network through codec, and the terminal uses the holographic projection device to perform screenless display.
  • Embodiment 4 This embodiment illustrates a video conferencing system by using a screenless system.
  • the video conferencing system component includes a terminal device and a central office device, and the central office device uses an M9000 system, and the terminal device is a common camera and a video capture card. Audio capture card, speaker, microphone, projector, terminal use multiple ordinary cameras to shoot the conference site from different dimensions, and the distance between each camera and the object, angle and other dimensional parameters, focal length parameters and other control reference together with the collected data,
  • the camera is connected to the terminal device, and the terminal device encodes it and sends it to the central office device MCU through the Internet or a dedicated cable network.
  • the MCU is coded and sent to each conference terminal device through the Internet or a dedicated cable network, and the terminal device passes multiple projections.
  • Embodiment 5 This embodiment illustrates a video conferencing system by using a screenless system.
  • the video conferencing system component includes a terminal device and a central office device, and the central office device uses an M9000 system, and the terminal device is a common camera, a video capture card, and an audio device.
  • Capture card, speaker, microphone, projector, terminal use multiple ordinary cameras to shoot the conference site from different dimensions, and the distance between each camera and the object, angle and other dimensional parameters, focal length parameters and other control reference together with the collected data, camera
  • the terminal device encodes it and sends it to the central office device MCU through the Internet or a dedicated cable network.
  • the MCU simultaneously acquires the projector parameter information of the terminal, and the MCU according to the collected video data and the terminal camera and the projector parameter information.
  • the codec is sent to each conference terminal device through the Internet or a dedicated cable network.
  • Embodiment 6 This embodiment illustrates a video conference system by using a screenless system.
  • the video conference system component includes a terminal device and a central office device, and the central office device uses an M9000 system, and the terminal device is a common camera, a video capture card, and an audio device.
  • Capture card, speaker, microphone, projector, terminal use ordinary camera to shoot the conference site, and the distance between the camera and the object, angle and other dimensional parameters, focal length parameters and other control reference together with the collected data, the camera is connected with the terminal device, the terminal The device encodes it and sends it to the central office device MCU through the Internet or a dedicated cable network.
  • the MCU simultaneously acquires the projector parameter information of the terminal, and the MCU converts the platform image into based on the collected video data and the parameter information of the terminal camera and the projector.
  • the 3D image is sent to each conference terminal device through the Internet or a dedicated cable network after processing.
  • Embodiment 7 This embodiment illustrates a video conferencing system by using a screenless system.
  • the video conferencing system component includes a terminal device and a central office device, and the central office device uses an M9000 system, the terminal device is a common camera, a video capture card, and audio.
  • Capture card, speaker, microphone, projector, terminal use ordinary camera to shoot the conference site, and take the photo
  • the distance between the head and the object, the angle parameter, the focal length parameter and other control references together with the collected data, the camera is connected to the terminal device, and the terminal device converts the ordinary 2D image into a 3D image, and then encodes it.
  • the MCU is sent to the central office device MCU through the Internet or a dedicated cable network, and the MCU simultaneously acquires the projector parameter information of the terminal, and the MCU processes and decodes the code according to the collected video data and the terminal camera and the projector parameter information through the Internet or a dedicated cable network.
  • the terminal device After being sent to each conference terminal device, after the terminal device acquires the data, the designated data is sent to the designated projector, and the projection device at different angles is projected to form a screenless stereoscopic video in the air.
  • software is also provided for performing the technical solutions described in the above embodiments and preferred embodiments.
  • a storage medium is also provided, the software being stored, including but not limited to an optical disk, a floppy disk, a hard disk, a rewritable memory, and the like.
  • the computing device may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明公开了一种视频会议显示方法及装置，其中，该方法包括：MCU获取到视频会议中的第一终端设备所在会议现场的立体视频源；MCU将立体视频源发送给视频会议中除第一终端设备之外的其他终端设备，其中，该立体视频源用于其他终端设备将第一终端设备所在会议现场无屏显示在其他终端设备所在的会议现场中。通过本发明，解决了相关技术中视频会议的用户体验度较差的问题，提高了视频会议的现场感，除了无法触摸到实体之外与现场开会并无其他区别，提高了用户体验度，对视频系统广泛推广有重要意义。

Description

视频会议显示方法及装置 技术领域 本发明涉及通信领域， 具体而言， 涉及一种视频会议显示方法及装置。 背景技术 视频会议系统用于召开远程、 多点及实时的会议， 实现多点之间视频和声音的传 输和交互， 因开会简单， 实时， 可视效果及多样性， 被广泛应用于企业中， 随着技术 的越来越成熟， 未来可能会广泛应用于家庭生活中， 视频会议系统主要由终端设备和 局端设备 （Management Control Unit, 简称为 MCU， 又称管理控制单元） 组成。 在一 个小型的视频会议系统中， 通常由多个终端设备集中连接至一个 MCU上， 组成星型 拓扑结构网络。 终端设备是用户端设备， 通常配有电视机、 摄像机、 扬声器、 麦克风 等多媒体部件； MCU是系统端设备， 集中对各终端的多媒体信息进行交换和处理。 随着 3D技术以及 4D技术的兴起， 人们对视觉的要求越来越高， 追求那种身临其 境的感觉， 犹如"海市蜃楼"般美妙幻景。 目前视频会议系统中通常是使用电视或者其 他有屏介质显示远端图像， 立体视觉冲击以及身临其境的感觉较差。 针对相关技术中视频会议的用户体验度较差的问题， 目前尚未提出有效的解决方 案。 发明内容 针对相关技术中视频会议的用户体验度较差的问题， 本发明提供了一种视频会议 显示方法及装置， 以至少解决上述问题。 根据本发明的一个方面， 提供了一种视频会议显示方法， 包括： 局端设备 MCU 获取到视频会议中的第一终端设备所在会议现场的立体视频源； 上述 MCU将上述立 体视频源发送给上述视频会议中除上述第一终端设备之外的其他终端设备， 其中， 上 述立体视频源用于上述其他终端设备将上述第一终端设备所在会议现场无屏显示在上 述其他终端设备所在的会议现场中。 优选地， MCU 获取到视频会议中的第一终端设备所在会议现场的立体视频源包 括： 上述 MCU获取到上述第一终端设备发来的上述第一终端设备所在会议现场的视 频数据、 音频数据和视频采集参数， 上述 MCU将上述视频数据、 音频数据和视频采 集参数合成为上述立体视频源； 或者， 上述 MCU获取到上述第一终端设备发来的上 述立体视频源。 优选地， 在上述视频数据为多个摄像头拍摄的二维图像的情况下， 上述 MCU根 据上述视频采集参数将上述多个摄像头拍摄的二维图像以及上述音频数据合成为上述 立体视频源； 或者， 在上述视频数据为一个摄像头拍摄的二维图像的情况下， 上述 MCU根据上述视频采集参数将上述一个摄像头拍摄的二维图像转换为三维图像，并将 上述三维图像以及上述音频数据合成为上述立体视频源。 根据本发明的另一个方面， 提供了一种视频会议显示方法， 包括： 第二终端设备 接收到局端设备 MCU发来的立体视频源， 其中， 上述立体视频源为上述第二终端参 加的视频会议中的除上述第二终端设备之外的其他终端设备所在会议现场的立体视 频； 上述第二终端设备将上述立体视频源无屏显示在上述第二终端设备所在的会议现 场中。 优选地， 上述方法还包括： 上述第二终端设备采集上述第二终端设备所在会议现 场的视频数据、 音频数据和视频采集参数； 上述第二终端设备将上述视频数据、 音频 数据和视频采集参数发送给上述 MCU; 或者， 上述第二终端设备将上述视频数据、音 频数据和视频采集参数合成为立体视频源， 并发送给上述 MCU。 优选地， 在上述视频数据为多个摄像头拍摄的二维图像的情况下， 上述第二终端 设备根据上述视频采集参数将上述多个摄像头拍摄的二维图像以及上述音频数据合成 为上述立体视频源； 或者， 在上述视频数据为一个摄像头拍摄的二维图像的情况下， 上述第二终端设备根据上述视频采集参数将上述一个摄像头拍摄的二维图像转换为三 维图像， 并将上述三维图像以及上述音频数据合成为上述立体视频源。 优选地， 上述第二终端设备将上述立体视频源无屏显示在上述第二终端设备所在 的会议现场中可以通过以下方式至少之一进行： 全息投影装置、 设置在不同角度的多 个投影仪。 优选地， 上述第二终端设备将上述立体视频源无屏显示在上述第二终端设备所在 的会议现场中包括： 上述第二终端设备按照预设的位置将上述立体视频源无屏显示在 上述第二终端设备所在的会议现场中。 根据本发明的又一个方面， 提供了一种视频会议显示装置， 位于局端设备 MCU 中， 上述视频会议显示装置包括： 获取模块， 设置为获取到视频会议中的第一终端设 备所在会议现场的立体视频源； 发送模块， 设置为将上述立体视频源发送给上述视频 会议中除上述第一终端设备之外的其他终端设备， 其中， 上述立体视频源用于上述其 他终端设备将上述第一终端设备所在会议现场无屏显示在上述其他终端设备所在的会 议现场中。 优选地， 上述获取模块包括： 获取单元， 设置为获取到上述第一终端设备发来的 上述第一终端设备所在会议现场的视频数据、 音频数据和视频采集参数； 合成单元， 设置为在上述视频数据为多个摄像头拍摄的二维图像的情况下， 根据上述视频采集参 数将上述多个摄像头拍摄的二维图像以及上述音频数据合成为上述立体视频源；或者， 在上述视频数据为一个摄像头拍摄的二维图像的情况下， 根据上述视频采集参数将上 述一个摄像头拍摄的二维图像转换为三维图像， 并将上述三维图像以及上述音频数据 合成为上述立体视频源。 根据本发明的又一个方面，提供了一种视频会议显示装置，位于第二终端设备中， 上述视频会议显示装置包括： 接收模块， 设置为接收到局端设备 MCU发来的立体视 频源， 其中， 上述立体视频源为上述第二终端参加的视频会议中的除上述第二终端设 备之外的其他终端设备所在会议现场的立体视频； 无屏显示模块， 设置为将上述立体 视频源无屏显示在上述第二终端设备所在的会议现场中。 优选地， 上述装置还包括： 采集模块， 设置为上述第二终端设备采集上述第二终 端设备所在会议现场的视频数据、 音频数据和视频采集参数； 发送模块， 设置为将上 述视频数据、 音频数据和视频采集参数发送给上述 MCU; 或者， 将上述视频数据、 音 频数据和视频采集参数合成为立体视频源， 并发送给上述 MCU。 通过本发明， 采用 MCU获取到视频会议中的第一终端设备所在会议现场的立体 视频源； MCU将立体视频源发送给视频会议中除第一终端设备之外的其他终端设备， 其中， 该立体视频源用于其他终端设备将第一终端设备所在会议现场无屏显示在其他 终端设备所在的会议现场中的方式， 解决了相关技术中视频会议的用户体验度较差的 问题，提高了视频会议的现场感， 除了无法触摸到实体之外与现场开会并无其他区别， 提高了用户体验度， 对视频系统广泛推广有重要意义。 附图说明 此处所说明的附图用来提供对本发明的进一步理解， 构成本申请的一部分， 本发 明的示意性实施例及其说明用于解释本发明， 并不构成对本发明的不当限定。 在附图 中- 图 1是根据本发明实施例的视频会议显示方法的流程图； 图 2是根据本发明实施例的视频会议显示装置的结构框图; 图 3是根据本发明实施例的获取模块的优选结构框图; 图 4是根据本发明实施例的另一种视频会议显示方法的流程图； 图 5是根据本发明实施例的另一种视频会议显示装置的结构框图； 图 6是根据本发明实施例的另一种视频会议显示装置的优选结构框图； 图 7是根据本发明优选实施例的无屏视频会议系统的示意图； 图 8是根据本发明优选实施例的无屏视频系统的数据流示意图。 具体实施方式 下文中将参考附图并结合实施例来详细说明本发明。 需要说明的是， 在不冲突的 情况下， 本申请中的实施例及实施例中的特征可以相互组合。 在本实施例中提供了一种视频会议显示方法， 图 1是根据本发明实施例的视频会 议显示方法的流程图， 如图 1所示， 该方法包括如下步骤： 步骤 S102， MCU获取到视频会议中的第一终端设备所在会议现场的立体视频源； 步骤 S104， MCU将立体视频源发送给视频会议中除第一终端设备之外的其他终 端设备， 其中， 该立体视频源用于其他终端设备将第一终端设备所在会议现场无屏显 示在其他终端设备所在的会议现场中。 本实施例通过上述步骤， MCU获取到视频会议中的第一终端设备所在会议现场的 立体视频源， 并将该立体视频源发送给该视频会议中的其他终端设备， 使得其他终端 设备能够使用该立体视频源将第一终端设备所在会议现场的图像立体显示在这些其他 终端设备自身所在的会议现场中， 由于是通过无屏显示的方式在空气中显示物理真实 的三维图像， 从而能够令其他终端设备所对应的用户感觉第一终端设备所对应的用户 就在本地的会议现场， 解决了相关技术中视频会议的用户体验度较差的问题， 提高了 视频会议的现场感， 除了无法触摸到实体之外与现场开会并无其他区别， 提高了用户 体验度， 对视频系统广泛推广有重要意义。 作为一种优选实施方式， MCU获取到上述立体视频源的方式可以是通过第一终端 设备合成立体视频源后发送过来， 也可以是第一终端设备将第一终端设备所在会议现 场的视频数据、 音频数据和视频采集参数直接发送过来， 由 MCU将视频数据、 音频 数据和视频采集参数合成为立体视频源。 通过这种方式， 提升了方案的灵活性。 优选地， 若上述视频数据是三维图像， 则 MCU或者第一终端设备可以很方便地 合成； 若上述视频数据是二维图像， 则需要将二维图像合成为三维图像， 再合成为立 体视频源。例如， 在视频数据为多个摄像头拍摄的二维图像的情况下， MCU可以根据 视频采集参数将多个摄像头拍摄的二维图像以及音频数据合成为立体视频源； 或者， 在视频数据为一个摄像头拍摄的二维图像的情况下， MCU可以根据视频采集参数将一 个摄像头拍摄的二维图像转换为三维图像， 并将三维图像以及音频数据合成为立体视 频源。 对应于上述视频会议显示方法， 在本实施例中提供了一种视频会议显示装置， 位 于 MCU中， 该装置用于实现上述实施例及优选实施方式， 已经进行过说明的不再赘 述。 如以下所使用的， 术语"模块"可以实现预定功能的软件和 /或硬件的组合。 尽管以 下实施例所描述的装置较佳地以软件来实现， 但是硬件， 或者软件和硬件的组合的实 现也是可能并被构想的。 图 2是根据本发明实施例的视频会议显示装置的结构框图， 如图 2所示， 该装置 包括： 获取模块 22和发送模块 24， 下面对各个模块进行详细说明。 获取模块 22， 设置为获取到视频会议中的第一终端设备所在会议现场的立体视频 源； 发送模块 24， 与获取模块 22相耦合， 设置为将立体视频源发送给视频会议中除 第一终端设备之外的其他终端设备， 其中， 该立体视频源用于其他终端设备将第一终 端设备所在会议现场无屏显示在其他终端设备所在的会议现场中。 本实施例通过上述模块， MCU使用获取模块 22获取到视频会议中的第一终端设 备所在会议现场的立体视频源，并使用发送模块 24将该立体视频源发送给该视频会议 中的其他终端设备， 使得其他终端设备能够使用该立体视频源将第一终端设备所在会 议现场的图像立体显示在这些其他终端设备自身所在的会议现场中， 由于是通过无屏 显示的方式在空气中显示物理真实的三维图像， 从而能够令其他终端设备所对应的用 户感觉第一终端设备所对应的用户就在本地的会议现场， 解决了相关技术中视频会议 的用户体验度较差的问题， 提高了视频会议的现场感， 除了无法触摸到实体之外与现 场开会并无其他区别， 提高了用户体验度， 对视频系统广泛推广有重要意义。 图 3是根据本发明实施例的获取模块 22的优选结构框图， 如图 3所示， 获取模块 22可以包括： 获取单元 222， 设置为获取到第一终端设备发来的第一终端设备所在会 议现场的视频数据、 音频数据和视频采集参数； 合成单元 224， 与获取单元 222相耦 合， 设置为在视频数据为多个摄像头拍摄的二维图像的情况下， 根据视频采集参数将 多个摄像头拍摄的二维图像以及音频数据合成为立体视频源； 或者， 在视频数据为一 个摄像头拍摄的二维图像的情况下， 根据视频采集参数将一个摄像头拍摄的二维图像 转换为三维图像， 并将三维图像以及音频数据合成为立体视频源。 在本实施例中还提供了另一种视频会议显示方法， 图 4是根据本发明实施例的另 一种视频会议显示方法的流程图， 如图 4所示， 该方法包括如下步骤： 步骤 S402， 第二终端设备接收到 MCU发来的立体视频源， 其中， 该立体视频源 为第二终端参加的视频会议中的除第二终端设备之外的其他终端设备所在会议现场的 立体视频； 步骤 S404，第二终端设备将该立体视频源无屏显示在第二终端设备所在的会议现 场中。 本实施例通过上述步骤， 第二终端设备接收到 MCU发来的视频会议中的其他终 端设备所在会议现场的立体视频源， 并将该立体视频源进行无屏显示， 使得第二终端 设备能够使用该立体视频源将其他终端设备所在会议现场的图像立体显示在第二终端 设备自身所在的会议现场中， 由于是通过无屏显示的方式在空气中显示物理真实的三 维图像， 从而能够令第二终端设备所对应的用户感觉其他终端设备所对应的用户就在 第二终端设备本地的会议现场，解决了相关技术中视频会议的用户体验度较差的问题， 提高了视频会议的现场感， 除了无法触摸到实体之外与现场开会并无其他区别， 提高 了用户体验度， 对视频系统广泛推广有重要意义。 作为一种优选实施方式， 与其他终端设备相同， 第二终端设备也可以将其所在的 会议现场的立体视频源， 或者视频数据、 音频数据和视频采集参数等， 采集或者合成 后发送给 MCU。 通过这种方式， 提升了视频会议的交互性。 优选地， 若上述视频数据是三维图像， 则 MCU或者第二终端设备可以很方便地 合成； 若上述视频数据是二维图像， 则需要将二维图像合成为三维图像， 再合成为立 体视频源。 例如， 在视频数据为多个摄像头拍摄的二维图像的情况下， 第二终端设备 可以根据视频采集参数将多个摄像头拍摄的二维图像以及音频数据合成为立体视频 源； 或者， 在视频数据为一个摄像头拍摄的二维图像的情况下， 第二终端设备可以根 据视频采集参数将一个摄像头拍摄的二维图像转换为三维图像， 并将三维图像以及音 频数据合成为立体视频源。 优选地， 第二终端设备可以通过全息投影装置将立体视频源无屏显示在本地会议 现场， 或者第二终端设备也可以通过多台设置在不同角度的投影仪实现将立体视频源 无屏显示在本地会议现场。 作为一种优选实施方式， 在将立体视频源无屏显示在本地会议现场的过程中， 第 二终端设备可以按照预设的位置进行无屏显示。 例如， 可以按照预设的顺序将视频会 议中的其他多个终端设备对应的立体视频源分别显示在会议室的多个座位上， 通过这 种方式， 能够使用户感觉视频会议中的所有人都在会议室之中， 并且能够通过这种方 式达到远程肢体语言的交流， 提升了用户体验。 当然， 也可以在 MCU中将多个终端 设备对应的立体视频源直接按着预设的位置合成为一个立体视频源， 同样也可以使用 户感觉视频会议中的所有人都在会议室之中， 达到远程肢体语言的交流的效果。 对应于上述另一种视频会议显示方法， 在本实施例中还提供了另一种视频会议显 示装置， 位于第二终端设备中， 该装置用于实现上述实施例及优选实施方式， 已经进 行过说明的不再赘述。 如以下所使用的， 术语"模块"可以实现预定功能的软件和 /或硬 件的组合。 尽管以下实施例所描述的装置较佳地以软件来实现， 但是硬件， 或者软件 和硬件的组合的实现也是可能并被构想的。 图 5是根据本发明实施例的另一种视频会议显示装置的结构框图， 如图 5所示， 该装置包括： 接收模块 52和无屏显示模块 54， 下面对各个模块进行详细说明。 接收模块 52， 设置为接收到 MCU发来的立体视频源， 其中， 该立体视频源为第 二终端参加的视频会议中的除第二终端设备之外的其他终端设备所在会议现场的立体 视频； 无屏显示模块 54， 与接收模块 52相耦合， 设置为将该立体视频源无屏显示在 第二终端设备所在的会议现场中。 本实施例通过上述模块， 第二终端设备使用接收模块 52接收到 MCU发来的视频 会议中的其他终端设备所在会议现场的立体视频源，并使用无屏显示模块 54将该立体 视频源进行无屏显示， 使得第二终端设备能够使用该立体视频源将其他终端设备所在 会议现场的图像立体显示在第二终端设备自身所在的会议现场中， 由于是通过无屏显 示的方式在空气中显示物理真实的三维图像， 从而能够令第二终端设备所对应的用户 感觉其他终端设备所对应的用户就在第二终端设备本地的会议现场， 解决了相关技术 中视频会议的用户体验度较差的问题， 提高了视频会议的现场感， 除了无法触摸到实 体之外与现场开会并无其他区别， 提高了用户体验度， 对视频系统广泛推广有重要意 义。 图 6是根据本发明实施例的另一种视频会议显示装置 50的优选结构框图， 如图 6 所示， 该装置 50还可以包括： 采集模块 62， 设置为第二终端设备采集第二终端设备 所在会议现场的视频数据、 音频数据和视频采集参数； 发送模块 64， 与采集模块 62 相耦合， 设置为将视频数据、音频数据和视频采集参数发送给 MCU; 或者， 将视频数 据、 音频数据和视频采集参数合成为立体视频源， 并发送给 MCU。 下面结合优选实施例进行说明， 以下优选实施例结合了上述实施例及其优选实施 方式。 若在视频会议中能够使用无屏介质如"海市蜃楼"般在空气中显示物理真实的三维 图像， 将大大提高视频会议的现场感， 因此， 为增强现场开会效果， 在视频会议系统 使用无屏技术并进行立体视频， 使参加视频会议的各方无论在何方， 感觉就是跟现场 开会一样， 除了摸不着外跟现场开会没有区别， 极大提高视频会议的现场性及趣味性， 对视频系统广泛推广有重要意义。 因此， 在以下优选实施例中， 提供了一种无屏的视 频会议系统， 该视频会议系统中使用无屏显示技术。 在以下优选实施例中， 图 7是根据本发明优选实施例的无屏视频会议系统的示意 图， 如图 7所示的无屏的视频会议系统， 由终端设备和局端设备 （MCU) 组成， 终端 设备用于视频音频数据采集、处理、播放， 局端设备用于媒体数据处理和会议控制等。 该系统的原理为： 终端设备采集立体视频源或者终端采集平面视频， 经 MCU或者终 端处理后， 会议终端使用无屏技术进行立体图像播放。 在以下优选实施例中的系统基本单元可以包括： 视频数据采集参数模块， 视频数 据采集模块， 音频数据采集模块， 视频数据编码模块， 音频数据编码模块， 视频数据 合成模块， 音频数据合成模块， 视频数据输出模块， 音频数据输出模块。 图 8是根据本发明优选实施例的无屏视频系统的数据流示意图， 参考图 8所示， 以下优选实施例的无屏的视频会议系统的实现方法可以包括如下步骤： 步骤 S2， 终端采集音频， 视频数据及对应的控制参数信息； 步骤 S4， 终端对采集后的数据进行编码并传送到 MCU; 步骤 S6， MCU根据终端会场的视频数据和视频采集参数进行处理； 步骤 S8， MCU对视频音频数据编码后分发到各终端； 步骤 S10， 终端接收从 MCU端传过来的视频音频数据并完成解码； 步骤 S12， 解码后的视频音频数据通过终端设备输出立体图像。 实施例一： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由普通摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 全息投影装置， 终端使用多台普通摄像头从不同维度 拍摄会议现场， 并把各摄像头与实物之间距离,角度等各维度参数， 焦距参数等控制参 考连同采集的数据， 摄像头与终端设备相连， 终端设备对其进行编码后通过因特网或 者专用电缆网络发送给局端设备 MCU， MCU解码后根据终端控制参数信息及视频数 据通过一系列计算后， 合成能无屏投放的立体源视频， 然后再编码通过因特网或者专 用电缆网络发送给各会议终端设备， 终端使用全息投影装置进行无屏显示。 实施例二： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由普通摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 全息投影装置， 终端使用多台普通摄像头从不同维度 拍摄会议现场， 并把各摄像头与实物之间距离,角度等各维度参数， 焦距参数等控制参 考连同采集的数据， 摄像头与终端设备相连， 终端设备根据各摄像头数据及参数信息 合成立体视频源， 对其进行编码后通过因特网或者专用电缆网络发送给局端设备 MCU， MCU编解码后通过因特网或者专用电缆网络发送给各会议终端设备， 终端使 用全息投影装置进行无屏显示。 实施例三： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由 3维摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 全息投影装置， 终端使用 3维摄像头拍摄会议现场， 3 维摄像头与终端设备相连， 终端设备对其采集到的数据进行编码后通过因特网或者专 用电缆网络发送给局端设备 MCU， MCU通过编解码通过因特网或者专用电缆网络发 送给各会议终端设备， 终端使用全息投影装置进行无屏显示。 实施例四： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由普通摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 投影仪， 终端使用多台普通摄像头从不同维度拍摄会 议现场， 并把各摄像头与实物之间距离,角度等各维度参数， 焦距参数等控制参考连同 采集的数据， 摄像头与终端设备相连， 终端设备对其进行编码后通过因特网或者专用 电缆网络发送给局端设备 MCU， MCU编解码后通过因特网或者专用电缆网络发送给 各会议终端设备， 终端设备通过连多台投影仪， 终端设备根据采集的视频数据， 参数 及投影仪的参数， 指定数据分发指定投影仪， 不同角度的投影装置投射后在空中形成 无屏立体视频。 实施例五： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由普通摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 投影仪， 终端使用多台普通摄像头从不同维度拍摄会 议现场， 并把各摄像头与实物之间距离,角度等各维度参数， 焦距参数等控制参考连同 采集的数据， 摄像头与终端设备相连， 终端设备对其进行编码后通过因特网或者专用 电缆网络发送给局端设备 MCU， MCU同时获取终端的投影仪参数信息， MCU根据采 集的视频数据及终端摄像头和投影仪的参数信息， 经过处理后编解码通过因特网或者 专用电缆网络发送给各会议终端设备， 终端设备获取到数据后， 指定数据发往指定投 影仪， 不同角度的投影装置投射后在空中形成无屏立体视频。 实施例六： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由普通摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 投影仪， 终端使用普通摄像头拍摄会议现场， 并把摄 像头与实物之间距离,角度等各维度参数， 焦距参数等控制参考连同采集的数据， 摄像 头与终端设备相连， 终端设备对其进行编码后通过因特网或者专用电缆网络发送给局 端设备 MCU， MCU同时获取终端的投影仪参数信息， MCU根据采集的视频数据及终 端摄像头和投影仪的参数信息， 把平台图像转换为 3维图像， 经过处理后编解码通过 因特网或者专用电缆网络发送给各会议终端设备， 终端设备获取到数据后， 指定数据 发往指定投影仪， 不同角度的投影装置投射后在空中形成无屏立体视频。 实施例七： 本实施例通过一种无屏投放的视频会议系统说明， 视频会议系统部件包括终端设 备和局端设备， 局端设备使用如 M9000系统， 终端设备由普通摄像头， 视频采集卡， 音频采集卡， 扬声器， 麦克风， 投影仪， 终端使用普通摄像头拍摄会议现场， 并把摄 像头与实物之间距离,角度等各维度参数， 焦距参数等控制参考连同采集的数据， 摄像 头与终端设备相连， 终端设备把普通的 2维图像转换为 3维图像， 然后对其进行编码 后通过因特网或者专用电缆网络发送给局端设备 MCU， MCU同时获取终端的投影仪 参数信息， MCU根据采集的视频数据及终端摄像头和投影仪的参数信息，经过处理后 编解码通过因特网或者专用电缆网络发送给各会议终端设备，终端设备获取到数据后， 指定数据发往指定投影仪， 不同角度的投影装置投射后在空中形成无屏立体视频。 在另外一个实施例中， 还提供了一种软件， 该软件用于执行上述实施例及优选实 施例中描述的技术方案。 在另外一个实施例中， 还提供了一种存储介质， 该存储介质中存储有上述软件， 该存储介质包括但不限于光盘、 软盘、 硬盘、 可擦写存储器等。 显然， 本领域的技术人员应该明白， 上述的本发明的各模块或各步骤可以用通用 的计算装置来实现， 它们可以集中在单个的计算装置上， 或者分布在多个计算装置所 组成的网络上， 可选地， 它们可以用计算装置可执行的程序代码来实现， 从而， 可以 将它们存储在存储装置中由计算装置来执行， 并且在某些情况下， 可以以不同于此处 的顺序执行所示出或描述的步骤， 或者将它们分别制作成各个集成电路模块， 或者将 它们中的多个模块或步骤制作成单个集成电路模块来实现。 这样， 本发明不限制于任 何特定的硬件和软件结合。 以上所述仅为本发明的优选实施例而已， 并不用于限制本发明， 对于本领域的技 术人员来说， 本发明可以有各种更改和变化。 凡在本发明的精神和原则之内， 所作的 任何修改、 等同替换、 改进等， 均应包含在本发明的保护范围之内。

Claims

权 利 要 求 书 一种视频会议显示方法， 包括：
局端设备 MCU获取到视频会议中的第一终端设备所在会议现场的立体视 频源；
所述 MCU将所述立体视频源发送给所述视频会议中除所述第一终端设备 之外的其他终端设备， 其中， 所述立体视频源用于所述其他终端设备将所述第 一终端设备所在会议现场无屏显示在所述其他终端设备所在的会议现场中。 根据权利要求 1所述的方法，其中， MCU获取到视频会议中的第一终端设备所 在会议现场的立体视频源包括：
所述 MCU获取到所述第一终端设备发来的所述第一终端设备所在会议现 场的视频数据、 音频数据和视频采集参数， 所述 MCU将所述视频数据、 音频 数据和视频采集参数合成为所述立体视频源； 或者，
所述 MCU获取到所述第一终端设备发来的所述立体视频源。 根据权利要求 2所述的方法， 其中， 在所述视频数据为多个摄像头拍摄的二维图像的情况下， 所述 MCU根据 所述视频采集参数将所述多个摄像头拍摄的二维图像以及所述音频数据合成为 所述立体视频源； 或者，
在所述视频数据为一个摄像头拍摄的二维图像的情况下， 所述 MCU根据 所述视频采集参数将所述一个摄像头拍摄的二维图像转换为三维图像， 并将所 述三维图像以及所述音频数据合成为所述立体视频源。 一种视频会议显示方法， 包括：
第二终端设备接收到局端设备 MCU发来的立体视频源， 其中， 所述立体 视频源为所述第二终端参加的视频会议中的除所述第二终端设备之外的其他终 端设备所在会议现场的立体视频；
所述第二终端设备将所述立体视频源无屏显示在所述第二终端设备所在的 会议现场中。 根据权利要求 4所述的方法， 还包括: 所述第二终端设备采集所述第二终端设备所在会议现场的视频数据、 音频 数据和视频采集参数；
所述第二终端设备将所述视频数据、 音频数据和视频采集参数发送给所述 MCU; 或者， 所述第二终端设备将所述视频数据、 音频数据和视频采集参数合 成为立体视频源， 并发送给所述 MCU。 根据权利要求 5所述的方法， 其中， 在所述视频数据为多个摄像头拍摄的二维图像的情况下， 所述第二终端设 备根据所述视频采集参数将所述多个摄像头拍摄的二维图像以及所述音频数据 合成为所述立体视频源； 或者，
在所述视频数据为一个摄像头拍摄的二维图像的情况下， 所述第二终端设 备根据所述视频采集参数将所述一个摄像头拍摄的二维图像转换为三维图像， 并将所述三维图像以及所述音频数据合成为所述立体视频源。 根据权利要求 4至 6中任一项所述的方法， 其中， 所述第二终端设备将所述立 体视频源无屏显示在所述第二终端设备所在的会议现场中可以通过以下方式至 少之一进行：
全息投影装置、 设置在不同角度的多个投影仪。 根据权利要求 4至 6中任一项所述的方法， 其中， 所述第二终端设备将所述立 体视频源无屏显示在所述第二终端设备所在的会议现场中包括：
所述第二终端设备按照预设的位置将所述立体视频源无屏显示在所述第二 终端设备所在的会议现场中。 一种视频会议显示装置， 位于局端设备 MCU中， 其中， 所述视频会议显示装 置包括：
获取模块， 设置为获取到视频会议中的第一终端设备所在会议现场的立体 视频源；
发送模块， 设置为将所述立体视频源发送给所述视频会议中除所述第一终 端设备之外的其他终端设备， 其中， 所述立体视频源用于所述其他终端设备将 所述第一终端设备所在会议现场无屏显示在所述其他终端设备所在的会议现场 中。 根据权利要求 9所述的装置， 其中， 所述获取模块包括: 获取单元， 设置为获取到所述第一终端设备发来的所述第一终端设备所在 会议现场的视频数据、 音频数据和视频采集参数；
合成单元，设置为在所述视频数据为多个摄像头拍摄的二维图像的情况下， 根据所述视频采集参数将所述多个摄像头拍摄的二维图像以及所述音频数据合 成为所述立体视频源； 或者， 在所述视频数据为一个摄像头拍摄的二维图像的 情况下， 根据所述视频采集参数将所述一个摄像头拍摄的二维图像转换为三维 图像， 并将所述三维图像以及所述音频数据合成为所述立体视频源。
11. 一种视频会议显示装置， 位于第二终端设备中， 其中， 所述视频会议显示装置 包括：
接收模块， 设置为接收到局端设备 MCU发来的立体视频源， 其中， 所述 立体视频源为所述第二终端参加的视频会议中的除所述第二终端设备之外的其 他终端设备所在会议现场的立体视频；
无屏显示模块， 设置为将所述立体视频源无屏显示在所述第二终端设备所 在的会议现场中。
12. 根据权利要求 11所述的装置， 还包括：
采集模块， 设置为所述第二终端设备采集所述第二终端设备所在会议现场 的视频数据、 音频数据和视频采集参数；
发送模块， 设置为将所述视频数据、 音频数据和视频采集参数发送给所述 MCU; 或者， 将所述视频数据、 音频数据和视频采集参数合成为立体视频源， 并发送给所述 MCU。
PCT/CN2013/080574 2012-08-24 2013-07-31 视频会议显示方法及装置 Ceased WO2013178188A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP13797480.4A EP2890121A4 (en) 2012-08-24 2013-07-31 VIDEO CONFERENCE PROCESS AND DEVICE
JP2015527768A JP2015530037A (ja) 2012-08-24 2013-07-31 テレビ会議表示方法及び装置
US14/420,734 US9661273B2 (en) 2012-08-24 2013-07-31 Video conference display method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210305508.3 2012-08-24
CN201210305508.3A CN103634563A (zh) 2012-08-24 2012-08-24 视频会议显示方法及装置

Publications (1)

Publication Number Publication Date
WO2013178188A1 true WO2013178188A1 (zh) 2013-12-05

Family

ID=49672484

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/080574 Ceased WO2013178188A1 (zh) 2012-08-24 2013-07-31 视频会议显示方法及装置

Country Status (5)

Country Link
US (1) US9661273B2 (zh)
EP (1) EP2890121A4 (zh)
JP (1) JP2015530037A (zh)
CN (1) CN103634563A (zh)
WO (1) WO2013178188A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104837004A (zh) * 2015-05-08 2015-08-12 天脉聚源(北京)传媒科技有限公司 一种3d数据的传输方法和装置
CN106303358A (zh) * 2015-05-12 2017-01-04 中兴通讯股份有限公司 对终端多个视频源的处理方法及装置
CN108431872A (zh) * 2016-12-27 2018-08-21 华为技术有限公司 一种共享虚拟现实数据的方法和设备
CN108933913A (zh) * 2017-05-24 2018-12-04 中兴通讯股份有限公司 一种视频会议实现方法、装置、系统及计算机存储介质
CN108513117A (zh) * 2018-05-09 2018-09-07 北京邦邦共赢网络科技有限公司 一种基于全息投影的影像投射方法及装置
CN108833931A (zh) * 2018-06-28 2018-11-16 南京曼殊室信息科技有限公司 一种异地用3d全息影像交互直播平台
WO2020161701A1 (en) * 2019-02-10 2020-08-13 Eitan Lavie A teleconferencing device
CN110333837B (zh) * 2019-07-09 2023-05-16 高创(苏州)电子有限公司 会议系统、通信方法和装置
CN112672089B (zh) * 2019-10-16 2024-02-06 中兴通讯股份有限公司 会议控制及与会方法、装置、服务器、终端及存储介质
CN114500911A (zh) * 2022-01-25 2022-05-13 纵深视觉科技(南京)有限责任公司 一种视频通话的实现方法、装置、设备、系统及介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291415A (zh) * 2008-05-30 2008-10-22 深圳华为通信技术有限公司 一种三维视频通信的方法、装置及系统
CN101771830A (zh) * 2008-12-30 2010-07-07 华为终端有限公司 立体全景视频流生成方法、设备及视频会议方法和设备
US20100302345A1 (en) * 2009-05-29 2010-12-02 Cisco Technology, Inc. System and Method for Extending Communications Between Participants in a Conferencing Environment

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6583808B2 (en) * 2001-10-04 2003-06-24 National Research Council Of Canada Method and system for stereo videoconferencing
JP2003195214A (ja) * 2001-12-26 2003-07-09 Seiko Epson Corp 立体表示装置
DE10253502A1 (de) * 2002-11-16 2004-05-27 Robert Bosch Gmbh Vorrichtung zur Projektion eines Objekts in einem Raum eines Fahrzeugs
CN100521770C (zh) * 2003-03-14 2009-07-29 皇家飞利浦电子股份有限公司 3d视频会议系统
JP2005208308A (ja) * 2004-01-22 2005-08-04 Yasuaki Tanaka 立体投影装置
JP2005328332A (ja) * 2004-05-14 2005-11-24 Matsushita Electric Ind Co Ltd 三次元画像通信端末
JP2006276347A (ja) * 2005-03-29 2006-10-12 Brother Ind Ltd 立体画像表示装置
KR101234495B1 (ko) * 2009-10-19 2013-02-18 한국전자통신연구원 화상회의 시스템을 위한 단말, 중계 노드 및 스트림 처리 방법
US8334889B2 (en) * 2010-03-18 2012-12-18 Tipd, Llc Auto stereoscopic 3D telepresence using integral holography
WO2012059279A1 (en) 2010-11-05 2012-05-10 Telefonica, S.A. System and method for multiperspective 3d telepresence communication
WO2012059280A2 (en) * 2010-11-05 2012-05-10 Telefonica, S.A. System and method for multiperspective telepresence communication
US9990770B2 (en) * 2011-12-20 2018-06-05 Intel Corporation User-to-user communication enhancement with augmented reality

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291415A (zh) * 2008-05-30 2008-10-22 深圳华为通信技术有限公司 一种三维视频通信的方法、装置及系统
CN101771830A (zh) * 2008-12-30 2010-07-07 华为终端有限公司 立体全景视频流生成方法、设备及视频会议方法和设备
US20100302345A1 (en) * 2009-05-29 2010-12-02 Cisco Technology, Inc. System and Method for Extending Communications Between Participants in a Conferencing Environment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
NETEASE TECHNOLOGY REPORT: "Video: Cisco holographic meeting system", NETEASE TECHNOLOGY REPORT, 2 June 2008 (2008-06-02), XP054975802, Retrieved from the Internet <URL:http://tech.163.com/08/0602/13/4DEI14FK000928R4.html> *

Also Published As

Publication number Publication date
US20150208036A1 (en) 2015-07-23
JP2015530037A (ja) 2015-10-08
EP2890121A4 (en) 2015-08-12
CN103634563A (zh) 2014-03-12
US9661273B2 (en) 2017-05-23
EP2890121A1 (en) 2015-07-01

Similar Documents

Publication Publication Date Title
WO2013178188A1 (zh) 视频会议显示方法及装置
Zhang et al. Viewport: A distributed, immersive teleconferencing system with infrared dot pattern
WO2010022633A1 (zh) 音频信号的生成、播放方法及装置、处理系统
JP6285941B2 (ja) 制御された三次元通信エンドポイント
US20100103244A1 (en) device for and method of processing image data representative of an object
CN101453662B (zh) 立体视频通信终端、系统及方法
CN101651841B (zh) 一种立体视频通讯的实现方法、系统和设备
CN101939989B (zh) 虚拟桌子
WO2015070558A1 (zh) 一种控制视频拍摄的方法和装置
CN102084650A (zh) 远程呈现系统、方法及视频采集设备
CN102547209A (zh) 视讯设备控制方法、装置及视讯系统
WO2012068960A1 (zh) 视频通信中的音频处理方法和装置
WO2018214746A1 (zh) 一种视频会议实现方法、装置、系统及计算机存储介质
WO2014173091A1 (zh) 一种视频会议中会议材料的显示方法及装置
WO2018068481A1 (zh) 一种双目 720 度全景采集系统
WO2010022658A1 (zh) 多视点媒体内容的发送和播放方法、装置及系统
WO2018121699A1 (zh) 视频通信方法、设备和终端
CN105933637A (zh) 一种视频通信的方法及系统
JP6091850B2 (ja) テレコミュニケーション装置及びテレコミュニケーション方法
CN102143312B (zh) 实物展示的控制方法、设备及系统
CN115314663A (zh) 基于虚拟现实的视频会议融合方法及其系统
Nguyen et al. Teleimmersive audio-visual communication using commodity hardware [applications corner]
CN114938460A (zh) 直播数据处理方法、装置、设备及存储介质
Kurowski et al. PSNC advanced multimedia and visualization infrastructures, services and applications
CN102572417B (zh) 发送、接收视频信息的方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13797480

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013797480

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14420734

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2015527768

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE