US12395537B2 - Augmented reality communication method, apparatus, and system - Google Patents

Augmented reality communication method, apparatus, and system

Info

Publication number
US12395537B2
US12395537B2 US18/474,721 US202318474721A US12395537B2 US 12395537 B2 US12395537 B2 US 12395537B2 US 202318474721 A US202318474721 A US 202318474721A US 12395537 B2 US12395537 B2 US 12395537B2
Authority
US
United States
Prior art keywords
network element
ims
terminal device
media
processing network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US18/474,721
Other languages
English (en)
Other versions
US20240022619A1 (en
Inventor
Yan Liu
Yang Gao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of US20240022619A1 publication Critical patent/US20240022619A1/en
Assigned to HUAWEI TECHNOLOGIES CO., LTD. reassignment HUAWEI TECHNOLOGIES CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GAO, YANG, LIU, YAN
Application granted granted Critical
Publication of US12395537B2 publication Critical patent/US12395537B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1016—IP multimedia subsystem [IMS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/102—Gateways
    • H04L65/1033—Signalling gateways
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1063—Application servers providing network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/14—Multichannel or multilink protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/24—Negotiation of communication capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Definitions

  • VoLTE voice over long term evolution
  • 4G 4th generation
  • VoLTE Voice over long term evolution
  • a plurality of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing are widely used to simulate virtual information such as a text, an image, a three-dimensional model, music, and a video that are generated by a computer. Then, simulated information is applied to the real world, and the two types of information complement each other, to implement “augmentation” of the real world.
  • the augmented reality technology can not only effectively reflect content of the real world, but also display content of the virtual information content.
  • AR is integrated into voice and video calls.
  • the AR media processing network element is located in an IMS network to which a second terminal device belongs, and the method further includes:
  • a third request message from the first terminal device is received, where the third request message is further for requesting for establishing of the media stream channel.
  • That the IMS core network element controls establishing of a media stream channel between the AR media processing network element and the first terminal device includes: The IMS core network element sends a fourth request message to the AR media processing network element, where the fourth request message is for requesting for establishing of the media stream channel between the AR media processing network element and the first terminal device.
  • the IMS core network element receives a fourth response message sent by the AR media processing network element, where the fourth response message indicates to the IMS core network element that the AR media processing network element agrees upon the establishing of the media stream channel.
  • the IMS core network element sends a third response message to the first terminal device, where the third response message indicates to the first terminal device that the AR media processing network element is ready for establishing of the media stream channel.
  • the method further includes: The AR media processing network element receives AR auxiliary data from the first terminal device through the auxiliary data channel after the establishment of the auxiliary data channel is completed.
  • the method further includes: The AR media processing network element sends the AR media stream obtained through augmented processing to a second terminal device.
  • the AR media processing network element is located in an IMS network to which the first terminal device belongs (or in which the first terminal device is located) or is located in an IMS network to which the second terminal device belongs (or in which the second terminal device is located).
  • the second request message carries a first description parameter that is of the first terminal device and that is for establishing the auxiliary data channel
  • the method further includes: The AR media processing network element determines, from the first description parameter, a second description parameter supported by the AR media processing network element, where the second response message carries the second description parameter.
  • an embodiment of this application provides an augmented reality AR communication method, including: A first terminal device sends a first request message to an IMS core network element, where the first request message is for requesting for establishing of an auxiliary data channel.
  • the first terminal device receives a first response message sent by the IMS core network element, where the first response message indicates that the AR media processing network element completes the establishment of the auxiliary data channel, and the auxiliary data channel is for transmitting auxiliary data for AR communication between the first terminal device and the AR media processing network element.
  • the method further includes:
  • the first terminal device receives an AR media stream obtained through augmented processing from the AR media processing network element through the media stream channel.
  • the method further includes:
  • the first request message carries a first description parameter that is of the first terminal device and that is for establishing the auxiliary data channel.
  • the first response message carries a second description parameter that is of the AR media processing network element and that is for establishing the auxiliary data channel.
  • the AR media processing network element is located in an IMS network to which the first terminal device belongs (or in which the first terminal device is located) or is located in an IMS network to which the second terminal device belongs (or in which the second terminal device is located).
  • an embodiment of this application further provides an apparatus.
  • the apparatus is used in an IMS core network element.
  • the apparatus has a function of implementing the behavior in the method example in the second aspect.
  • the function may be implemented by hardware, or may be implemented by hardware executing corresponding software.
  • the hardware or the software includes one or more modules corresponding to the foregoing function.
  • a structure of the apparatus may include a sending unit and a receiving unit. The units may perform corresponding functions in the method example in the second aspect. For details, refer to the detailed descriptions in the method example. Details are not described herein again.
  • an embodiment of this application further provides an apparatus.
  • the apparatus is used in an AR media processing network element.
  • the apparatus has a function of implementing the behavior in the method example in the third aspect.
  • the function may be implemented by hardware, or may be implemented by hardware executing corresponding software.
  • the hardware or the software includes one or more modules corresponding to the foregoing function.
  • a structure of the apparatus may include a sending unit, a receiving unit, and a processing unit.
  • the units may perform corresponding functions in the method example in the third aspect. For details, refer to the detailed descriptions in the method example. Details are not described herein again.
  • an embodiment of this application further provides an apparatus.
  • the apparatus is used in the terminal device.
  • the apparatus has a function of implementing the behavior in the method example in the fourth aspect.
  • the function may be implemented by hardware, or may be implemented by hardware executing corresponding software.
  • the hardware or the software includes one or more modules corresponding to the foregoing function.
  • a structure of the apparatus includes a sending unit and a receiving unit. The units may perform corresponding functions in the method example in the fourth aspect. For details, refer to the detailed descriptions in the method example. Details are not described herein again.
  • an embodiment of this application further provides an apparatus.
  • the apparatus is used in an IMS core network element.
  • a structure of the communication apparatus includes a processor and a communication interface, and may further include a memory.
  • the processor is configured to support the IMS core network element in performing a corresponding function in the method in the second aspect through the communication interface.
  • the memory is coupled to the processor, and stores program instructions and data that are necessary for the communication apparatus.
  • an embodiment of this application further provides an apparatus.
  • the apparatus is used in a terminal device.
  • a structure of the apparatus includes a processor and a communication interface, and may further include a memory.
  • the processor is configured to support the terminal device in performing a corresponding function in the method in the fourth aspect through the communication interface.
  • the memory is coupled to the processor and stores program instructions and data that are necessary for the apparatus.
  • an embodiment of this application further provides an apparatus, and the apparatus is used in an application server.
  • a structure of the communication apparatus includes a processor and a communication interface, and may further include a memory.
  • the processor is configured to support the application server in performing a corresponding function of the application server in any one of the foregoing aspects through the communication interface.
  • the memory is coupled to the processor, and stores program instructions and data that are necessary for the communication apparatus.
  • this application further provides a computer chip.
  • the chip is connected to a memory.
  • the chip is configured to read and execute a software program stored in the memory, to perform the methods according to the foregoing aspects.
  • FIG. 2 A is a schematic diagram of an architecture of another possible AR communication system according to an embodiment of this application.
  • FIG. 3 is a schematic diagram of an architecture of another possible AR communication system according to an embodiment of this application.
  • FIG. 4 is a schematic diagram of an architecture of another possible AR communication system according to an embodiment of this application.
  • FIG. 5 is a schematic diagram of an architecture of another possible AR communication system according to an embodiment of this application.
  • FIG. 6 is a schematic flowchart of an AR communication method according to an embodiment of this application.
  • FIG. 7 A is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 7 B is a schematic flowchart of still another AR communication method according to an embodiment of this application.
  • FIG. 8 A- 1 and FIG. 8 A- 2 are a schematic flowchart of another AR communication method according to an embodiment of this application;
  • FIG. 8 B is a schematic diagram of a termination T1 and a termination T2 on an IMS AGW according to an embodiment of this application;
  • FIG. 9 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 10 A and FIG. 10 B are a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 11 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 12 A is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 12 B is a schematic flowchart of still another AR communication method according to an embodiment of this application.
  • FIG. 12 C is a schematic flowchart of yet another AR communication method according to an embodiment of this application.
  • FIG. 13 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 14 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 15 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 16 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 18 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 19 is a schematic flowchart of another AR communication method according to an embodiment of this application.
  • FIG. 20 is a schematic diagram of a structure of an apparatus according to an embodiment of this application.
  • FIG. 21 is a schematic diagram of a structure of another apparatus according to an embodiment of this application.
  • FIG. 23 is a schematic diagram of a structure of another apparatus according to an embodiment of this application.
  • This application provides an AR communication method and apparatus, to provide an implementation in which AR is integrated into voice and video calls, thereby improving user experience.
  • the voice and video calls may be, but are not limited to, VoLTE, and may also be applicable to voice and video calls provided by a future technology.
  • the AR has three characteristics: virtual-reality integration, real-time interaction, and three-dimensional registration.
  • the virtual-reality integration is to superimpose a virtual object and information that are generated by a computer to a real-world scene, to understand the real scene more intuitively and deeply.
  • Augmented information may be non-geometric information related to a real object, for example, a video and a text; or may be geometric information, for example, a virtual three-dimensional object and scene.
  • the real-time interaction is real-time interaction between people and an augmented reality environment in a natural manner via an interaction interface device in an augmented reality system.
  • the “registration” in the three-dimensional registration may be interpreted as tracking and locating.
  • the three-dimensional registration is that a virtual object generated by a computer is in a one-to-one correspondence with a real environment, and a correct alignment relationship is continuously maintained when a user moves in the real environment.
  • a and/or B may represent the following three cases: Only A exists, both A and B exist, and only B exists.
  • the character “/” in this specification usually indicates an “or” relationship between the associated objects.
  • the term “at least one” in this application means one or more, that is, includes one, two, three, or more; and the term “a plurality of” means two or more, that is, includes two, three, or more.
  • B corresponding to A indicates that B is associated with A, and B may be determined according to A.
  • determining B based on A does not mean that B is determined based only on A.
  • B may alternatively be determined based on A and/or other information.
  • the terms “include” and “have” in embodiments, claims, and accompanying drawings of this application are not exclusive.
  • a process, method, system, product, or device including a series of steps or modules is not limited to the enumerated steps or modules, and may further include a step or module that is not enumerated.
  • FIG. 1 is a schematic diagram of an architecture of an AR communication system according to an embodiment of this application.
  • the AR communication system includes an AR media processing network element and an AR control network element.
  • the AR media processing network element provides a media processing service for a terminal device that has an AR capability.
  • the AR media processing network element has an AR user plane (AR User plane, AR-U) function, and may also be referred to as an AR-U network element.
  • the AR control network element has an AR control plane function, and may be referred to as an AR control plane (AR Control plane, AR-C) network element.
  • a network element may be referred to as a device.
  • the AR media processing network element may be referred to as an AR media processing device.
  • the terminal device that has the AR capability may have one or more of the following logical functions: supporting acquisition of audio and video data in a real scene via a camera and/or a sensor, supporting a logical operation function (for example, a visual engine may be deployed), supporting low-latency encoding and lightweight image rendering, supporting obtaining of a virtual object from a cloud, and the like.
  • the terminal device in this embodiment of this application may be a device configured with a camera and having a video call function.
  • the terminal device may be a wearable device (for example, an electronic watch), or the terminal device may be a device, for example, a mobile phone or a tablet computer.
  • a specific form of the terminal device is not specifically limited in this embodiment of this application.
  • the AR media processing network element has an AR media processing function.
  • the AR media processing function includes one or more of three-dimensional modeling, object identification, tracking and locating, interaction perception, virtual-scene rendering, virtual-reality integration, and the like.
  • the three-dimensional modeling is to perform three-dimensional construction on a real environment based on data acquired by a terminal device.
  • the object identification is to identify a concerned object of a terminal device user.
  • the tracking and locating is to track and locate a concerned object of a terminal device user.
  • the interaction perception is to implement consistency of a plurality of senses by using a user interaction technology.
  • the virtual-scene rendering is to render a virtual scene.
  • the virtual-reality integration is to integrate a virtual object with a real object.
  • the AR media processing network element supports establishment of a media stream channel and an auxiliary data channel with the terminal device.
  • the media stream channel is for transmitting, between the terminal device and the AR media processing network element, AR core data (or referred to as media stream data, which may also be referred to as a media stream for short), for example, an audio and video stream.
  • the auxiliary data channel is for transmitting AR auxiliary data between the terminal device and the AR media processing network element.
  • the AR auxiliary data (or AR specific data) is a general name of non-media data transmitted between the terminal device and the AR media processing network element.
  • a data type that may be included in AR auxiliary data in an uplink direction and a video data type that is included in AR core data are described as an example.
  • a data type that may be included in AR auxiliary data in a downlink direction and a video data type that is included in the audio and video streams are described as an example.
  • Table 1 and Table 2 are merely used as an example, and do not constitute a specific limitation on the AR auxiliary data and the AR core data.
  • the AR control network element has functions of a session association and service control.
  • the session association may include an association between the media stream between the terminal device and the AR media processing network element and a signaling stream between the AR media processing network element and an AS; or an association among the media stream between the terminal device and the AR media processing network element, a signaling stream between the AR media processing network element and an AS, and a message stream between the AS and a third-party server.
  • the third-party server is configured to provide a material required for AR processing, such as a virtual object and a real background object.
  • the service control may be to control AR media processing based on a service feature or the like. For example, different service features correspond to different AR media processing manners, and the AR control network element may indicate different AR media processing manners to the AR media processing network element based on different service features of the terminal device.
  • the AR media processing network element may be an IP multimedia subsystem (IMS) access gateway (AGW) or a media resource function (MRF).
  • IMS IP multimedia subsystem
  • AGW IP multimedia subsystem access gateway
  • MRF media resource function
  • the AR control network element may be an application server.
  • an AR media processing network element is an IMS AGW
  • an AR communication system includes the IMS AGW and an IMS core.
  • the IMS core controls establishment of an auxiliary data channel and a media stream channel between the IMS AGW having an AR processing capability and a terminal device that has an AR capability.
  • the auxiliary data channel is for transmitting AR auxiliary data for AR communication between at least two terminal devices.
  • the media stream channel is for transmitting a media stream for AR communication between the at least two terminal devices.
  • the IMS AGW may provide a media processing service for the terminal device. For example, when receiving the media stream through the media stream channel and the AR auxiliary data through the auxiliary data channel, the IMS AGW may perform augmented processing on the media stream by using the AR auxiliary data.
  • the AR communication system may further include an application server (AS).
  • the AR communication system may further include at least two terminal devices. IMS AGWs respectively serving different terminal devices may be the same or different. In FIG. 2 A , for example, the two terminal devices are respectively a first terminal device and a second terminal device, and IMS AGWs serving the first terminal device and the second terminal device are different, and are respectively an IMS AGW 1 and an IMS AGW 2.
  • the two terminal devices in AR communication may both have the AR capability; or one terminal device may have the AR capability, and the other terminal device does not have the AR capability. In FIG. 2 A , for example, both the first terminal device and the second terminal device have the AR capability.
  • different terminal devices access different IMS networks, and the IMS AGWs serving the different terminal devices are different.
  • Different IMS AGWs serving the two terminal devices in AR communication may both have the AR processing capability; or only one IMS AGW has the AR processing capability, and the other IMS AGW does not have the AR processing capability.
  • both the IMS AGW 1 and the IMS AGW 2 have the AR processing capability.
  • the IMS AGW 1 serves the first terminal device, or the IMS AGW 1 is an access gateway of the first terminal device, or the IMS AGW 1 is located in an IMS network to which the first terminal device belongs (or in which the first terminal device is located).
  • the IMS AGW 2 serves the second terminal device.
  • the IMS AGW 2 is an access gateway of the second terminal device, or the IMS AGW 2 is located in an IMS network to which the second terminal device belongs.
  • One access gateway may serve a plurality of terminal devices.
  • the IMS AGW 1 serves the first terminal device, and further serves a third terminal device (not shown in FIG. 2 A ).
  • the IMS core may include a call session control function (call session control function, CSCF) and/or a home subscriber server (home subscriber server, HSS).
  • CSCF call control center of the IMS core, and implements functions such as user access, authentication, session routing, and service triggering on an IP transmission platform.
  • the CSCF may include one or more of a serving-call session control function (S-CSCF), a proxy-CSCF (P-CSCF), and an interrogating-CSCF (I-CSCF).
  • S-CSCF serving-call session control function
  • P-CSCF proxy-CSCF
  • I-CSCF interrogating-CSCF
  • the HSS is configured to record subscription data (such as user information and service data) of a user.
  • subscription data such as user information and service data
  • an IMS core network element that provides a service for the first terminal device may be different from an IMS core network element that provides a service for the second terminal device, which, for example, is related to a location of the terminal device.
  • the IMS core network element mentioned in this embodiment of this application may include the CSCF.
  • the AR communication system may further include a third-party server.
  • the third-party server may be understood as a server of a third-party provider.
  • the third-party server is configured to provide a target object required by the terminal device to perform AR communication, for example, a virtual object, or for another example, a real background object.
  • the third-party server and the application server each are configured with address information of each other, which, for example, may include an IP address and a port number. In a possible example, refer to FIG. 2 B .
  • the third-party server supports establishing a communication connection to the AR media processing network element, which, for example, may be a hypertext transfer protocol (http) connection.
  • http hypertext transfer protocol
  • the third-party server does not support establishing a communication connection to the AR media processing network element. As shown in FIG. 2 C , the third-party server establishes a communication connection to the application server, for example, a hypertext transfer protocol http connection.
  • one of the two terminal devices in AR communication does not have the AR capability.
  • a first terminal device has an AR capability
  • a second terminal device does not have the AR capability.
  • an IMS AGW 1 serving the first terminal device has the AR capability.
  • one of the two terminal devices in AR communication does not have the AR capability.
  • a first terminal device has an AR capability
  • a second terminal device does not have the AR capability.
  • an IMS AGW 2 serving the second terminal device has an AR capability
  • an IMS AGW 1 serving the first terminal device does not have the AR capability.
  • an AR media processing network element may be a media resource function (MRF).
  • MRF media resource function
  • an AR media processing network element is an MRF
  • an AR communication system includes the MRF, an IMS core, an application server (AS), and a third-party server is used.
  • the MRF is usually classified as a media resource function controller (MRFC) and a media resource function processor (MRFP).
  • MRFC media resource function controller
  • MRFP media resource function processor
  • a terminal device communicates with another terminal device via the MRF.
  • the MRF is a central node between a session message and a media stream.
  • a first terminal device, a second terminal device, and a third terminal device are used as examples.
  • a plurality of terminal devices in an AR conference may all have an AR capability; or one or more of the terminal devices may have an AR capability, and other terminal devices do not have the AR capability.
  • both the first terminal device and the second terminal device have the AR capability, and the third terminal device does not have the AR capability.
  • MRFs respectively serving a plurality of terminal devices may be the same or different.
  • MRFs serving the first terminal device and the third terminal device are a same MRF, namely, an MRF 1, and an MRF serving the second terminal device is an MRF 2.
  • the terminal device may establish different auxiliary data channels based on types of transmitted AR auxiliary data. For example, when pose data needs to be transmitted, an auxiliary data channel 1 is established, and when operation data needs to be transmitted, an auxiliary data channel 2 is established.
  • the terminal device may alternatively transmit different types of AR auxiliary data through one auxiliary data channel.
  • first terminal device and the second terminal device perform AR communication
  • FIG. 6 An example in which the first terminal device and the second terminal device perform AR communication is used below, to describe a procedure of establishing an auxiliary data channel between the first terminal device and the AR media processing network element after the first terminal device and the second terminal device trigger AR communication.
  • FIG. 6 An example in which the first terminal device and the second terminal device perform AR communication is used below, to describe a procedure of establishing an auxiliary data channel between the first terminal device and the AR media processing network element after the first terminal device and the second terminal device trigger AR communication.
  • the first terminal device sends a first request message to an IMS core network element, where the first request message is for requesting for establishing of an auxiliary data channel.
  • the first request message may carry a first description parameter of the first terminal device.
  • the first description parameter is used by the first terminal device for establishing of the auxiliary data channel with an AR media processing network element.
  • the first request message further carries an address of the first terminal device.
  • the first description parameter may use a session description protocol (SDP).
  • SDP session description protocol
  • the first description parameter may alternatively use another description protocol. This is not specifically limited in this application.
  • SDP information carrying the first description parameter is referred to as first SDP information (which may be referred to as a first SDP for short).
  • the first request message carries the first SDP information of the first terminal device.
  • the first SDP information includes the description parameter for establishing the auxiliary data channel between the first terminal device and the AR media processing network element.
  • the first SDP information may include one or more of parameters such as a port number used by the first terminal device to transmit AR auxiliary data, a media stream type, and a supported codec format.
  • the media stream type may include a video, an audio, and data channel (AR auxiliary data).
  • AR auxiliary data data channel
  • the first SDP information may include an m line for describing the AR auxiliary data.
  • the m line is described as follows.
  • the m line represents a description of a specific AR auxiliary data stream.
  • 10001 may represent a port number of a quintuple
  • UDP/DTLS/SCTP represents a transmission protocol that the AR auxiliary data complies with
  • webrtc-datachannel represents an established auxiliary data channel.
  • the first SDP information may further include other information, for example, an a line for describing AR auxiliary data.
  • the a line is described as follows.
  • the first SDP information may further include the following.
  • the first terminal device may send the first request message to the IMS core network element in a procedure of establishing AR communication with the second terminal device.
  • the first request message may be a session initiation protocol (SIP) invite message.
  • the first request message may further carry address information of the first terminal device.
  • the address information of the first terminal device may include an IP address and/or a port number of the first terminal device.
  • the first request message is further for requesting for establishing of a media stream channel, where the media stream channel is for transmitting a media stream for performing AR communication between the first terminal device and the second terminal device.
  • the first request message further carries a description parameter for establishing the media stream channel between the first terminal device and the AR media processing network element.
  • the first SDP information further includes a description parameter for establishing the media stream channel between the first terminal device and the AR media processing network element.
  • the first terminal device may send a first request message to the IMS core network element in a procedure of re-establishing an AR session with the second terminal device.
  • the first request message may be a SIP Re-invite (re-invite) message.
  • the IMS core network element after receiving the first request message, forwards the first request message to an application server.
  • the application server may send address information of the first terminal device to the AR media processing network element via the IMS core network element.
  • the application server may add the address information of the application server to the first request message and send the first request message to the IMS core network element.
  • the IMS core network element includes the address information of the application server in the second request message sent to the AR media processing network element, so that when the AR media processing network element subsequently needs to obtain content provided by a third-party server, the AR media processing network element may obtain the needed content from the third-party server via the AS.
  • m audio 49152 RTP/AVP 98 97 99.
  • the 1 st parameter in the m line represents a media name, and indicates that a supported media stream type is audio.
  • the 2 nd parameter represents a port number, and indicates that the audio stream is sent through a port 49152.
  • a third parameter represents a transmission protocol, in which a real-time transport protocol (RTP)/audio video profile (AVP) is used.
  • RTP real-time transport protocol
  • AVP audio video profile
  • the H248 add request 1 is received, and an outgoing termination T2 (outgoing termination T2) is created.
  • an outgoing termination of the IMS AGW 1 is created.
  • the IMS AGW 1 feeds back, to the intermediate IMS 1, address information corresponding to the termination T2 and indication information indicating whether the IMS AGW 1 has the AR processing capability.
  • the IMS AGW 1 has the AR processing capability.
  • the intermediate IMS 1 identifies that the IMS AGW 1 has the AR processing capability, only an auxiliary data channel needs to be established between the first terminal device and the IMS AGW 1. In this case, an AR session establishment request sent to a network side of a second terminal device does not need to carry an SDP for requesting for establishing of the auxiliary data channel.
  • the intermediate IMS 2 sends, to an AS 2, the SIP INVITE 3 that carries the address information corresponding to the termination T2 of the IMS AGW 1.
  • the AS 2 sends, to the intermediate IMS 2, the SIP INVITE 3 that carries the address information corresponding to the termination T2 of the IMS AGW 1.
  • the intermediate IMS 2 sends, to an IMS AGW 2, an H248 add request 2 indicating the IMS AGW 2 to create an outgoing termination T2.
  • an IP address and a port number are included.
  • the IP address is IP30
  • the port number is P30.
  • the IMS AGW 2 creates an outgoing termination T3, and sends, to the intermediate IMS 2, an H248 add resp 2 that carries address information corresponding to the termination T2 of the IMS AGW 2.
  • the IMS AGW 2 sends a SIP INVITE 4 to the second terminal device, where the SIP INVITE 4 includes the address information corresponding to the termination T2 of the IMS AGW 2.
  • the second terminal device sends a SIP 180 to the IMS AGW 2, where the SIP 180 carries address information (IP1a, P1a) of the second terminal device.
  • the intermediate IMS 2 sends, to the IMS AGW 2, an H248 mod request 1 indicating the IMS AGW 2 to configure an outgoing termination T1. For example, an association relationship between address information of T1 of the IMS AGW 2 and the address information of the second terminal device is established.
  • the IMS AGW 2 configures the outgoing termination T3, and sends an H248 mod resp 1 to the intermediate IMS 2.
  • the H248 mod resp 1 may carry the address information corresponding to the termination T2 of the IMS AGW 2 and the address information of the second terminal device.
  • the intermediate IMS 2 sends, to the IMS AGW 2, an H248 add request 3 indicating the IMS AGW 2 to create an incoming termination T2.
  • the H248 add request 3 includes the address information corresponding to the termination T2 of the IMS AGW 1.
  • the IMS AGW 2 creates an incoming termination T2, and sends, to the intermediate IMS 2, an H248 add resp 2 that carries the address information (IP40, P40) corresponding to the termination T2 of the IMS AGW 2.
  • the intermediate IMS 1 receives the SIP 180 from the second terminal device, where, for example, the SIP 180 may include the address information of the second terminal device.
  • the SIP 180 may include the address information of the second terminal device.
  • an IP address of the second terminal device is IP1a
  • a port number of the second terminal device is P1a.
  • the intermediate IMS 1 records the IP address and the port number of the second terminal device.
  • the intermediate IMS 1 sends a configuration modification request to the IMS AGW 1.
  • the configuration modification request may be an H248 mod req 3.
  • the H248 mod req 3 includes the IP address (IP1a) and the port number (P1a) of the second terminal device.
  • the H248 mod req 3 is for requesting the IMS AGW 1 to configure an outgoing termination T2.
  • the IMS AGW 1 configures the outgoing termination T2 based on the address information of the second terminal device, and sends a configuration modification response to the intermediate IMS 1, where the configuration modification response may be an H248 mod response 3.
  • the intermediate IMS 1 receives the configuration modification response from the IMS AGW 1, and sends a second request message to the IMS AGW 1.
  • the second request message is for requesting for establishing of an auxiliary data channel, or may be for requesting to create an incoming termination T1, for example, by using an H248 add req 4.
  • the H248 add req 4 is further for requesting for establishing of the auxiliary data channel.
  • the H248 add req 4 includes the first SDP of the first terminal device and the address information of the first terminal device.
  • the IMS AGW 1 After receiving the H248 add req 4, the IMS AGW 1 creates an incoming termination T1, and agrees upon the establishing of the auxiliary data channel.
  • the IMS AGW 1 sends, to the intermediate IMS 1, a second response message that includes a response to information about the incoming termination T1, and may further include a response to the establishment of the auxiliary data channel.
  • the second response message may be an H248 add response 4.
  • the H248 add response 4 includes second SDP information of the IMS AGW 1 and address information of the IMS AGW 1.
  • the address information of the IMS AGW 1 includes an IP address (IP2a) and a port number (P2a) of the IMS AGW 1.
  • the H248 add response 4 may further include the address information of the first terminal device.
  • the second SDP information includes the m line for describing the auxiliary data channel that needs to be established by the IMS AGW 1.
  • a response of the IMS AGW 1 to the m line of the first terminal device may be described as follows.
  • the intermediate IMS 1 records the address information of the termination T1 of the IMS AGW 1, and determines the second SDP information for establishing the auxiliary data channel, where a first response message sent to the AS includes the second SDP information and the address information of the IMS AGW 1.
  • the first response message may be a SIP 180.
  • the SIP 180 includes the second SDP information and the address information of the IMS AGW 1.
  • the AS forwards the SIP 180 to the intermediate IMS 1.
  • the intermediate IMS 1 forwards the SIP 180 to the first terminal device.
  • step 803 after receiving the SIP INVITE 1, when determining that the first terminal device has subscribed to the AR service, the AS may send address information of the AS to the IMS AGW 1 via the intermediate IMS 1.
  • the AS may add the address information of the AS to the SIP INVITE 1 and send the SIP INVITE 1 to the intermediate IMS 1.
  • the second request message (H248 add request) sent by the intermediate IMS 1 to the IMS AGW 1 carries the address information of the AS, so that when the IMS AGW 1 subsequently needs to obtain content provided by the third-party server, the IMS AGW 1 may obtain the needed content from the third-party server via the AS.
  • the AS may send a subscription query request to an HSS, to query whether the subscription information of the first terminal device includes information about the subscribed AR service.
  • the HSS may feed back the subscription information of the first terminal device to the AS by using a subscription query response.
  • the subscription query request may be a diameter request message.
  • the subscription query response may be a diameter response message.
  • the intermediate IMS 1 forwards the SIP INVITE 1 to the AS.
  • the AS may send stored address information of the third-party server to the IMS AGW 1 via the intermediate IMS 1.
  • the AS may add the address information of the third-party server to the first request message and send the first request message to the intermediate IMS 1.
  • the second request message (H248 add request) sent by the intermediate IMS 1 to the IMS AGW 1 carries the address information of the third-party server, so that when the IMS AGW 1 subsequently needs to obtain content provided by the third-party server, the IMS AGW 1 may obtain the needed content from the third-party server.
  • the termination T1 is a termination that is on the IMS AGW and that is for connecting to a terminal device through an access network.
  • the termination T2 is a termination that is on the IMS AGW and that is for connecting to an IMS core network.
  • the IMS AGW can establish a connection with a communication peer terminal device through the IMS core network.
  • establishment of the auxiliary data channel is triggered by triggering a process of re-establishing an AR session.
  • an example in which the IMS AGW 1 to which the first terminal device belongs has the AR processing capability is used.
  • FIG. 9 is a schematic flowchart of a communication method in a second possible application scenario according to this application.
  • the first terminal device After an AR session is established between a first terminal device and a second terminal device, the first terminal device sends a first request message to an IMS core network element (for example, an intermediate IMS 1).
  • an IMS core network element for example, an intermediate IMS 1).
  • an example in which the first request message is a SIP re-establishment request (Re-INVITE 1) is used.
  • the SIP Re-INVITE 1 is for requesting to create an auxiliary data channel.
  • the SIP Re-INVITE 1 includes a first SDP of the first terminal device. For descriptions of the first SDP of the first terminal device, refer to the descriptions in the embodiment corresponding to FIG. 6 . Details are not described herein again.
  • the intermediate IMS 1 receives the SIP Re-INVITE 1 from the first terminal device, and forwards the SIP Re-INVITE 1 to an AS.
  • the AS sends the SIP Re-INVITE 1 to the intermediate IMS 1.
  • the intermediate IMS 1 sends a query message 1 to an IMS AGW 1.
  • the query message 1 may be carried in an H248 mod req.
  • the H248 mod req is for requesting to establish a bearer.
  • the H248 mod req may further carry a parameter for querying whether the IMS AGW 1 has an AR processing capability.
  • the parameter for querying whether the IMS AGW 1 has the AR processing capability may be “IfSupportforAR_flag”.
  • the IMS AGW 1 after receiving the H248 mod req, the IMS AGW 1 indicates to the intermediate IMS 1 whether the IMS AGW 1 has the AR processing capability.
  • the IMS AGW 1 After receiving the H248 mod request, the IMS AGW 1 sends a query response 1 to the intermediate IMS 1, where the query response 1 includes indication information indicating whether the IMS AGW 1 has the AR processing capability.
  • the intermediate IMS 1 sends an H248 mod response, where the H248 mod response includes the indication information.
  • the IMS AGW 1 has the AR processing capability.
  • the intermediate IMS 1 After receiving the H248 mod response, the intermediate IMS 1 identifies that the IMS AGW 1 has the AR processing capability, in other words, only an auxiliary data channel needs to be established between the first terminal device and the IMS AGW 1. In this case, an AR session establishment request sent to the second terminal device does not need to carry a request for requesting for establishing of the auxiliary data channel.
  • the AR session establishment request may be a SIP Re-INVITE 2.
  • the intermediate IMS 1 sends the SIP Re-INVITE 2 to the second terminal device via the intermediate IMS 2 to which the second terminal device belongs.
  • the intermediate IMS 1 receives, from the second terminal device, a SIP response, for example, a SIP 200 OK.
  • the intermediate IMS 1 sends a second request message to the IMS AGW 1, where the second request message may be for requesting for establishing of an auxiliary data channel, and is further for modifying incoming termination T1 information.
  • the intermediate IMS 1 sends, by using an H248 add req, a request for modifying the incoming termination T1 information to the IMS AGW 1.
  • the H248 add req is further for requesting for establishing of the auxiliary data channel.
  • the H248 add req includes the first SDP of the first terminal device.
  • the IMS AGW 1 After receiving the H248 add req, the IMS AGW 1 modifies the incoming termination T1 information, and agrees upon the establishing of the auxiliary data channel.
  • the IMS AGW 1 sends a response for modifying the incoming termination T1 information to the intermediate IMS 1.
  • the response for modifying the incoming termination T1 information may be an H248 add response.
  • the H248 add response includes second SDP information of the IMS AGW 1. For descriptions of the second SDP, refer to the descriptions in the embodiment corresponding to FIG. 6 . Details are not described herein again.
  • the intermediate IMS 1 extracts the second SDP information of the IMS AGW and sends, to the AS, an AR session establishment response that includes the second SDP information.
  • the AR session establishment response may be a SIP 200 OK.
  • the SIP 200 OK includes the second SDP information.
  • the AS forwards the SIP 200 OK to the intermediate IMS 1.
  • the intermediate IMS 1 forwards the SIP 200 OK to the first terminal device.
  • the intermediate IMS 1 forwards the SIP Re-INVITE 1 to the AS.
  • the AS may send stored address information of the third-party server to the IMS AGW 1 via the intermediate IMS 1.
  • the AS may add the address information of the third-party server to the first request message and send the first request message to the intermediate IMS 1.
  • the second request message (H248 add request) sent by the intermediate IMS 1 to the IMS AGW 1 carries the address information of the third-party server, so that when the IMS AGW 1 subsequently needs to obtain content provided by the third-party server, the IMS AGW 1 may obtain the needed content from the third-party server.
  • the auxiliary data channel is established in a process of creating an AR session.
  • the IMS AGW 1 to which the first terminal device belongs does not have the AR processing capability
  • the IMS AGW 2 to which the second terminal device belongs has the AR processing capability.
  • 1001 to 1004 Refer to 801 to 804 . Details are not described herein again.
  • an IMS AGW 1 After receiving an H248 add request, an IMS AGW 1 sends, to an intermediate IMS 1, indication information indicating whether the IMS AGW 1 has an AR processing capability. For example, the intermediate IMS 1 sends an H248 add response, where the H248 add response carries the indication information and address information corresponding to a termination T2.
  • the address information corresponding to the termination T2 includes an IP address and a port number. For example, the IP address is IP20, and the port number is P20.
  • the IMS AGW 1 does not have the AR processing capability.
  • the intermediate IMS 1 After receiving the H248 add response, the intermediate IMS 1 identifies that the IMS AGW 1 does not have the AR processing capability, and sends a second request message (SIP INVITE 2) to an IMS AGW 2 via the intermediate IMS 2 to which a second terminal device belongs and an AS.
  • the SIP INVITE 2 sent to the second terminal device does not need to carry a request for requesting for establishing of an auxiliary data channel.
  • the SIP INVITE 2 sent to the second terminal device carries the address information corresponding to the termination T2 of the IMS AGW 1.
  • 1006 to 1008 Refer to 806 to 808 . Details are not described herein again.
  • the intermediate IMS 2 may send a query message 2 to the IMS AGW 2.
  • the query message 2 may be carried in an H248 add req 2.
  • the H248 add req 2 may further carry a parameter for querying whether the IMS AGW 2 has the AR processing capability.
  • the parameter for querying whether the IMS AGW 2 has the AR processing capability may be “IfSupportforAR_flag”.
  • the H248 add req 2 further indicates to create an outgoing termination T2. For details, refer to 809 . Details are not described herein again.
  • the IMS AGW 2 indicates to the intermediate IMS 2 whether the IMS AGW 2 has the AR processing capability.
  • the IMS AGW 2 After receiving the H248 add request 2, the IMS AGW 2 sends a query response 2 to the intermediate IMS 2, where the query response 2 includes indication information 2 indicating whether the IMS AGW 2 has the AR processing capability.
  • the IMS AGW 2 sends an H248 add response 2 (namely, the query response 2), where the H248 add response 2 includes the indication information 2.
  • the IMS AGW 2 has the AR processing capability.
  • the H248 add response 2 further includes address information of T2.
  • 1011 to 1014 Refer to 811 to 814 . Details are not described herein again.
  • the intermediate IMS 2 sends, to the IMS AGW 2, an H248 add request 3 indicating the IMS AGW 2 to create an incoming termination T1
  • the H248 add request 3 is further for requesting for establishing of an auxiliary data channel with the first terminal device.
  • the H248 add request 3 includes the first SDP of the first terminal device.
  • the H248 add request 3 further includes the address information corresponding to the termination T2 of the IMS AGW 1.
  • the intermediate IMS 1 sends a configuration modification request to the IMS AGW 1.
  • the configuration modification request may be an H248 mod req 3.
  • the H248 mod req 3 is for requesting the IMS AGW 1 to configure an outgoing termination T2.
  • the IMS AGW 1 sends an H248 add response 4 to the intermediate IMS 1.
  • the H248 add response 4 includes address information of the IMS AGW 1.
  • the address information of the IMS AGW 1 includes an IP address (IP2a) and a port number (P2a) of the IMS AGW 1.
  • the H248 add response 4 may further include the address information of the first terminal device.
  • the auxiliary data channel is established in a process of creating an AR conference.
  • an example in which the MRF to which the first terminal device belongs has the AR processing capability is used.
  • FIG. 11 is a schematic flowchart of a communication method in a fourth possible application scenario according to this application.
  • 1101 to 1103 Refer to 801 to 803 . Details are not described herein again.
  • the MRF sends a second response message to the intermediate IMS 1, where the second response message includes a second SDP of the MRF.
  • the MRF ignores a request of the first terminal device for establishing an auxiliary data channel.
  • the second response message may be a SIP 180.
  • the intermediate IMS 1 sends a first response message to an AS, where the first response message may be the SIP 180.
  • the first response message includes the second SDP of the MRF.
  • the AS sends a first response message to the intermediate IMS 1.
  • the intermediate IMS 1 sends the first response message to the first terminal device.
  • the intermediate IMS 1 forwards the SIP INVITE 1 to the AS.
  • the AS may send stored address information of the third-party server to the MRF via the intermediate IMS 1.
  • the AS may add the address information of the third-party server to the first request message and send the first request message to the intermediate IMS 1.
  • the second request message (SIP INVITE 2) sent by the intermediate IMS 1 to the MRF carries the address information of the third-party server, so that when the IMS AGW 1 subsequently needs to obtain content provided by the third-party server, the MRF may obtain the needed content from the third-party server.
  • the following describes a procedure of augmenting a media stream by completing establishment of an auxiliary data channel in embodiments of this application.
  • FIG. 12 A describes a procedure of augmenting a media stream in a process of performing AR communication between a first terminal device and a second terminal device.
  • An auxiliary data channel is established between the first terminal device and an AR media processing network element.
  • a media stream channel is further established between the first terminal device and the second terminal device. The media stream channel passes through the AR media processing network element.
  • the first terminal device sends AR auxiliary data to the AR media processing network element through the auxiliary data channel in the process of performing AR communication with the second terminal device.
  • the AR media processing network element is located in an IMS network of the first terminal device or is located in an IMS network of the second terminal device.
  • the AR media processing network element may be an IMS AGW or an MRF.
  • the first terminal device sends the media stream to the AR media processing network element through the media stream channel.
  • the media stream is generated in the process of performing AR communication between the first terminal device and the second terminal device.
  • the AR media processing network element performs media augmented processing on the media stream based on the AR auxiliary data to obtain an AR media stream.
  • the AR media processing network element sends the AR media stream to the first terminal device.
  • the first terminal device receives the AR media stream.
  • the AR media processing network element sends the AR media stream to the second terminal device through the media stream channel.
  • the second terminal device receives the AR media stream.
  • the AR media processing network element is the IMS AGW.
  • An IMS AGW serving the first terminal device is referred to as an IMS AGW 1
  • an IMS AGW that provides a service for the second terminal device is referred to as an IMS AGW 2.
  • both the IMS AGW 1 and the IMS AGW 2 have an AR processing capability.
  • an AR auxiliary data proximity processing principle is used. If AR auxiliary data (non-media data) received by the IMS AGW 1 is data related to the first terminal device, for example, pose data of a user of the first terminal device, the AR auxiliary data is used only for performing pose rendering on a media stream shared by the first terminal device.
  • the IMS AGW 1 obtains 1 ⁇ a+b ⁇ (AR media stream) through combination and rendering based on 1 (an original media stream), a (non-media data such as the pose data of the user of the first terminal device) and b (non-media data such as user annotation data acquired by the first terminal device), and returns the AR media stream to the first terminal device.
  • the IMS AGW 1 then obtains 1 ⁇ b ⁇ (AR media stream) through rendering based on 1 (original media stream) and b (non-media data such as user annotation data acquired by UE 1), and sends the AR media stream to the IMS AGW 2.
  • the IMS AGW 2 finally obtains a media stream 1 ⁇ b+c ⁇ (AR media stream) through rendering based on the received media stream and c (non-media data) of UE 2, and sends the AR media stream to the UE 2. As shown in FIG. 12 C , if the IMS AGW 2 does not have the AR media processing capability, the IMS AGW 2 transfers c (the non-media data) of the UE2 to the IMS AGW 1 for media augmented processing.
  • the following describes a solution for augmenting a media stream through the auxiliary data channel.
  • the user of the first terminal device shares a video with a user of the second terminal device.
  • the user of the first terminal device and the user of the second terminal device can simultaneously watch the video shared by the first terminal device.
  • the AR media processing network element is the IMS AGW.
  • both an IMS AGW 1 to which a first terminal device belongs and an IMS AGW 2 to which a second terminal device belongs have an AR processing capability.
  • Establishment of an auxiliary data channel 1 has been completed between the first terminal device and the IMS AGW 1 to which the first terminal device belongs.
  • Establishment of an auxiliary data channel 2 has been completed between the second terminal device and the IMS AGW 2 to which the second terminal device belongs.
  • a media stream channel is established between the first terminal device and the second terminal device.
  • the IMS AGW 1 renders the media stream based on the pose data 1 to obtain an AR media stream 1.
  • the second terminal device also has the AR capability.
  • the second terminal device supports a user in annotating a shared picture.
  • the media stream channel is divided into three segments, which respectively include a media stream channel between the first terminal device and the IMS AGW 1, a media stream channel between the IMS AGW 1 and the IMS AGW 2, and a media stream channel between the IMS AGW 2 and the second terminal device.
  • the first terminal device has the AR capability.
  • the first terminal device supports a user in annotating a shared picture.
  • a user of the first terminal device is referred to as a user 1
  • a user of the second terminal device is referred to as a user 2.
  • the first terminal device obtains pose data 1 generated through annotation performed by the user 2 on a display interface corresponding to the media stream, and sends the pose data 1 as AR auxiliary data to the IMS AGW 2 through the auxiliary data channel 1.
  • the IMS AGW 2 sends the AR media stream 1 to the IMS AGW 1 through the media stream channel.
  • the IMS AGW 1 sends the AR media stream 1 to the first terminal device through the media stream channel.
  • the IMS AGW 2 sends the AR media stream 1 to the second terminal device.
  • both the user 1 of the first terminal device and the user 2 of the second terminal device can watch the display interface on which the user 1 performs annotation.
  • the second terminal device also has the AR capability.
  • the second terminal device supports a user in annotating a shared picture.
  • the second terminal device obtains pose data 2 generated through annotation performed by the user 2 on the display interface corresponding to the media stream, and sends the pose data 2 as AR auxiliary data to the IMS AGW 2 through the auxiliary data channel 2.
  • the IMS AGW 2 renders the media stream based on the pose data 2 to obtain an AR media stream 2.
  • the IMS AGW 2 sends the AR media stream 2 to the IMS AGW 1.
  • the IMS AGW 2 sends the AR media stream 2 to the second terminal device.
  • the IMS AGW 1 sends the AR media stream 2 to the first terminal device through the media stream channel 1. In this way, both the user 1 of the first terminal device and the user 2 of the second terminal device can watch the display interface on which the user 2 performs annotation.
  • FIG. 15 is a schematic flowchart of obtaining a possible target object according to an embodiment of this application.
  • the first terminal device sends first AR auxiliary data to an AR media processing network element through an auxiliary data channel in a process of AR communication between a first terminal device and a second terminal device.
  • the first AR auxiliary data includes information about a target object that needs to be used in the AR communication.
  • the AR media processing network element mentioned herein is an IMS access gateway having an AR processing capability or an MRF. It may be understood that an auxiliary data channel is established between the AR media processing network element and the first terminal device.
  • the AR media processing network element may be located in an IMS network to which the first terminal device belongs, namely, an IMS AGW or an MRF corresponding to the first terminal device.
  • the AR media processing network element may be located in an IMS network to which the second terminal device belongs, namely, an IMS AGW or an MRF corresponding to the second terminal device.
  • the AR media processing network element When receiving the first AR auxiliary data from the first terminal device through the auxiliary data channel, the AR media processing network element obtains the target object from a third-party server based on the first AR auxiliary data. It may be understood that the target object is used to augment a media stream for the AR communication between the first terminal device and the second terminal device.
  • a virtual object for example, a 2D/3D object
  • the terminal device usually does not have a capability of storing a large quantity of 2D/3D objects. Therefore, in the foregoing manner, a requirement of a terminal device user may be received through the auxiliary data channel, and the 2D/3D object may be obtained from the third-party server.
  • the AR media processing network element may render a foreground picture and the background picture.
  • the terminal device may send requirement information of the real background picture to the AR media processing network element through the auxiliary data channel, so that the AR media processing network element obtains the real background picture from the third-party server based on the requirement information, and further renders the real background picture and a foreground media stream sent by the terminal device and sends a media stream obtained by rendering the rendered background picture and the foreground media stream to the terminal device.
  • the AR media processing network element obtains address information of an AS in advance, and when obtaining a target object, the AR media processing network element obtains the target object from the third-party server via the AS.
  • the AR media processing network element obtains address information of an AS in advance, and when obtaining a target object, the AR media processing network element obtains the target object from the third-party server via the AS.
  • the application server receives the request message 1, and when determining that the first terminal device needs to request the virtual object, forwards the request message 1 to the third-party server. For example, the application server may extract the identifier of the terminal device from the request message 1, and determine, based on the identifier of the terminal device, an identifier of a session established by the terminal device. The application server may establish, to the third-party server based on the identifier of the session, a communication connection, for example, an HI IP connection, so that the application server forwards the request message 1 to the third-party server, to obtain the virtual object from the third-party server. A session identifier of the first terminal device may be added to the request message 1 forwarded to the third-party server.
  • the third-party server receives the request message 1, and obtains, based on the type of the virtual object, a plurality of virtual object identifiers that meet the type of the virtual object.
  • a virtual object list includes the plurality of virtual object identifiers is used.
  • the plurality of virtual object identifiers may alternatively be sent in another form. This is not specifically limited in this application.
  • the third-party server sends a response message 1 to the application server.
  • the response message 1 may include the virtual object list.
  • the response message 1 may be of an HTTP message type.
  • the response message 1 may be an HTTP response (resp) message 1.
  • the response message 1 includes a session identifier.
  • the IMS AGW/MRF obtains the virtual object list from the response message 1 from the application server, and sends the virtual object list to the first terminal device through the auxiliary data channel.
  • the IMS AGW/MRF stores the virtual object list.
  • the IMS AGW/MRF may no longer obtain the virtual object list from the third-party server. It may be understood that, in step 1602 , when it is determined that the IMS AGW/MRF stores the virtual object list corresponding to the virtual object information, the IMS AGW/MRF may no longer perform the subsequent step of obtaining the virtual object list.
  • the application server receives the request message 2, and forwards the request message 2 to the third-party server.
  • the application server forwards the response message 2 to the IMS AGW/MRF.
  • the IMS AGW/MRF obtains the first virtual object from the response message 2, and sends the first virtual object to the first terminal device through the auxiliary data channel.
  • the third-party server receives the request message 11, and obtains, based on the type of the virtual object, a plurality of virtual object identifiers that meet the type of the virtual object.
  • a virtual object list includes the plurality of virtual object identifiers is used.
  • the plurality of virtual object identifiers may alternatively be sent in another form. This is not specifically limited in this application.
  • the third-party server sends a response message 11 to the IMS AGW/MRF.
  • the response message 11 may include the virtual object list.
  • the response message 11 may be of an HI IP message type.
  • the response message 11 may be an HTTP response (resp) message 11.
  • the first terminal device sends a first virtual object identifier to the IMS AGW/MRF through the auxiliary data channel.
  • the first virtual object identifier is one in the virtual object list.
  • the IMS AGW/MRF obtains the first virtual object from the response message 12, and sends the first virtual object to the first terminal device through the auxiliary data channel.
  • the following describes a media augmented procedure of obtaining and using a real background object. For details, refer to FIG. 18 and FIG. 19 .
  • the first terminal device sends, to the IMS AGW/MRF through an auxiliary data channel, information about the real background object, for example, an identifier of the real background object or a geographical location of the real background object.
  • the first terminal device sends a media stream 1 generated by the first terminal device to the IMS AGW/MRF through a media stream channel.
  • the IMS AGW/MRF When receiving the information about the real background object, the IMS AGW/MRF sends a request message 21 to the application server, where the request message 21 includes the information about the real background object.
  • the geographical location of the real background object is used as an example.
  • the request message 21 may be of an HTTP message type. Certainly, another message type may alternatively be used. This is not limited in this application.
  • the request message 21 may be an HTTP request (req) message 21.
  • the third-party server receives the request message 21, and obtains the real background object based on the geographical location of the real background object.
  • the third-party server sends a response message 21 to the application server.
  • the response message 21 may include a real background object list.
  • the response message 21 may be of an HTTP message type.
  • the response message 21 may be an HTTP response (resp) message 21.
  • the application server forwards the response message 21 to the IMS AGW/MRF.
  • the IMS AGW/MRF obtains the real background object from the response message 21, and renders the real background object to the media stream 1 to obtain an AR media stream 2.
  • the IMS AGW/MRF sends the AR media stream 2 to the first terminal device through the media stream channel.
  • an AR media processing network element directly obtains a real background object from a third-party server.
  • the AR media processing network element is an IMS AGW/MRF.
  • the IMS AGW may be an IMS AGW to which a first terminal device or a second terminal device at a communication peer belongs.
  • the MRF may be an MRF to which a first terminal device or a second terminal device at a communication peer belongs.
  • the first terminal device sends, to the IMS AGW/MRF through an auxiliary data channel, information about the real background object, for example, an identifier of the real background object or a geographical location of the real background object.
  • the first terminal device sends a media stream 1 generated by the first terminal device to the IMS AGW/MRF through a media stream channel.
  • the IMS AGW/MRF sends a request message 22 to the third-party server, where the request message 22 includes the information about the real background object.
  • the geographical location of the real background object is used as an example.
  • the request message 22 may be of an HTTP message type. Certainly, another message type may alternatively be used. This is not limited in this application.
  • the request message 22 may be an HTTP request (request, req) message 22.
  • the third-party server receives the request message 22, and obtains the real background object based on the geographical location of the real background object.
  • the third-party server sends a response message 22 to the IMS AGW/MRF.
  • the response message 22 may include a real background object list.
  • the response message 22 may be of an HTTP message type.
  • the response message 22 may be an HTTP response (response) message 22.
  • the IMS AGW/MRF obtains the real background object from the response message 22, and renders the real background object to the media stream 1 to obtain an AR media stream 2.
  • the IMS AGW/MRF sends the AR media stream 2 to the first terminal device through the media stream channel.
  • an embodiment of this application provides an apparatus, specifically configured to implement the method performed by the IMS core network element in the foregoing method embodiments.
  • a structure of the apparatus is shown in FIG. 20 , and includes a receiving unit 2001 , a sending unit 2002 , and a processing unit 2003 .
  • the receiving unit 2001 is configured to receive a first request message from a first terminal device, where the first request message is for requesting for establishing of an auxiliary data channel, and the auxiliary data channel is for transmitting auxiliary data for AR communication between the first terminal device and an AR media processing network element.
  • the processing unit 2003 is configured to control establishing of the auxiliary data channel between the AR media processing network element and the first terminal device.
  • the processing unit 2003 controls, via the receiving unit 2001 and the sending unit 2002 , establishing of the auxiliary data channel between the AR media processing network element and the first terminal device.
  • the sending unit 2002 is configured to send a second request message to the AR media processing network element, where the second request message is for requesting for establishing of the auxiliary data channel between the AR media processing network element and the first terminal device.
  • the sending unit 2002 is further configured to send a first response message to the first terminal device, where the first response message indicates to the first terminal device that the AR media processing network element is ready for establishing of the auxiliary data channel.
  • the AR media processing network element is an IMS access gateway having an AR processing capability or a media resource function MRF.
  • the AR media processing network element is located in an IMS network to which the first terminal device belongs or is located in an IMS network to which the second terminal device belongs.
  • the first response message and the second response message carry a second description parameter that is of the AR media processing network element and that is for establishing the auxiliary data channel.
  • an embodiment of this application provides an apparatus, specifically configured to implement the method performed by the AR media processing network element in the foregoing method embodiments.
  • a structure of the apparatus is shown in FIG. 21 , and includes a receiving unit 2101 , a sending unit 2102 , and a processing unit 2103 .
  • the AR auxiliary data includes one or more of operation data of a virtual model, annotation or tracking data of a target object, identification data of a facial expression or a body action, or pose data.
  • a media stream channel for transmitting content for the AR communication is established between the first terminal device and the AR media processing network element.
  • the sending unit 2202 sends a third request message to the IMS core network element, where the third request message is for requesting for establishing of the media stream channel.
  • the receiving unit 2201 receives a third response message sent by the IMS core network element, where the third response message indicates to the first terminal device that the AR media processing network element is ready for establishing of the media stream channel.
  • the receiving unit 2201 receives, through the media stream channel, an AR media stream that is of the second terminal device and that is sent by the AR media processing network element.
  • the first request message carries a first description parameter that is of the first terminal device and that is for establishing the auxiliary data channel.
  • the first response message carries a second description parameter that is of the AR media processing network element and that is for establishing the auxiliary data channel.
  • the AR media processing network element is located in an IMS network to which the first terminal device belongs or is located in an IMS network to which the second terminal device belongs.
  • division into the units is an example and is merely logical function division, and may be other division during actual implementation.
  • functional units in embodiments of this application may be integrated into one processor, may exist alone physically, or two or more units may be integrated into one unit.
  • the foregoing integrated unit may be implemented in a form of hardware, or may be implemented in a form of a software functional unit.
  • the integrated unit When the integrated unit is implemented in a form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium.
  • the computer software product is stored in a storage medium and includes several instructions for instructing a terminal device (which may be a personal computer, a mobile phone, a network device, or the like) or a processor to perform all or some of the steps of the methods in embodiments of this application.
  • the foregoing storage medium includes: any medium that can store program code, such as a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disc.
  • the AR media processing network element, the application server, the IMS core network element, and the terminal device may all be presented in a form of functional modules obtained through division in an integrated manner.
  • the “module” herein may be an ASIC, a circuit, a processor executing one or more software or firmware programs, a memory, an integrated logic circuit, and/or another device that can provide the foregoing functions.
  • the AR media processing network element, the application server, the IMS core network element, and the terminal device may be implemented by using a structure shown in FIG. 23 .
  • the apparatus 2300 shown in FIG. 23 includes at least one processor 2301 and a communication interface 2302 , and optionally, may further include a memory 2303 .
  • the processor 2301 in FIG. 23 may invoke computer-executable instructions stored in the memory 2303 , so that the AR media processing network element may perform the method performed by the AR media processing network element in any one of the foregoing method embodiments.
  • the processor 2301 may communicate with another device via the communication interface 2302 .
  • the processor 2301 receives, via the communication interface 2302 , a request message sent by an IMS core network element, and sends a response message to the IMS core network element.
  • the memory 2303 stores computer-executable instructions for implementing functions of the sending unit, the receiving unit, and the processing unit in FIG. 21 . All functions/implementation processes of the sending unit, the receiving unit, and the processing unit in FIG. 21 may be implemented by the processor 2301 in FIG. 23 by invoking the computer-executable instructions stored in the memory 2303 and in combination with the communication interface 2302 .
  • the processor 2301 in FIG. 23 may invoke the computer-executable instructions stored in the memory 2303 , so that the IMS core network element may perform the method performed by the IMS core network element (the IMS AGW 1, the IMS AGW 2, the MRF 1, or the MRF 2) in any one of the foregoing method embodiments.
  • the processor 2301 may communicate with another device via the communication interface 2302 .
  • the processor 2301 receives, via the communication interface 2302 , a message sent by the AR media processing network element and a message sent to the AR media processing network element.
  • the memory 2303 stores computer-executable instructions for implementing functions of the sending unit, the receiving unit, and the processing unit in FIG. 20 . All functions/implementation processes of the sending unit, the receiving unit, and the processing unit in FIG. 20 may be implemented by the processor 2301 in FIG. 23 by invoking the computer-executable instructions stored in the memory 2303 and in combination with the communication interface 2302 .
  • the processor 2301 in FIG. 23 may invoke computer-executable instructions stored in the memory 2303 , so that the terminal device may perform the method performed by the first terminal device or the second terminal device in any one of the foregoing method embodiments.
  • the processor 2301 may communicate with another device via the communication interface 2302 .
  • the processor 2301 receives, via the communication interface 2302 , an augmented media stream and the like sent by the AR media processing network element, and sends AR auxiliary data, a media stream, and the like to the AR media processing network element.
  • the memory 2303 stores computer-executable instructions for implementing functions of the sending unit, the receiving unit, and the processing unit in FIG. 22 . All functions/implementation processes of the sending unit, the receiving unit, and the processing unit in FIG. 22 may be implemented by the processor 2301 in FIG. 23 by invoking the computer-executable instructions stored in the memory 2303 and in combination with the communication interface 2302 .
  • a specific connection medium between the processor 2301 and the memory 2303 is not limited in this embodiment of this application.
  • the memory 2303 is connected to the processor 2301 through a bus 2304 in the figure.
  • the bus 2304 is represented by a thick line in the figure.
  • a connection manner between other components is schematically described, and is not limited thereto.
  • the bus 2304 may be classified into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is used to represent the bus in FIG. 23 , but this does not mean that there is only one bus or only one type of bus.
  • an embodiment of this application further provides a computer storage medium.
  • the storage medium stores a software program.
  • the software program is read and executed by one or more processors, the method performed by a service platform or an edge computing device provided in any one or more of the foregoing embodiments may be implemented.
  • the computer storage medium may include any medium that can store program code, such as a USB flash drive, a removable hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disc.
  • system and “network” are usually used interchangeably in this specification.
  • the term “and/or” in this specification describes only an association relationship for describing associated objects and represents that three relationships may exist. For example, A and/or B may represent the following three cases: Only A exists, both A and B exist, and only B exists.
  • the character “/” in this specification usually indicates an “or” relationship between the associated objects.
  • the term “at least one” in this application means one or more, that is, includes one, two, three, or more; and the term “a plurality of” means two or more, that is, includes two, three, or more.
  • the terms such as “first” and “second” are merely used for distinguishing and description, but cannot be understood as indicating or implying relative importance, or cannot be understood as indicating or implying a sequence.
  • the term “at least one of the following items (pieces)” or a similar expression thereof indicates any combination of these items, including a single item (piece) or any combination of a plurality of items (pieces).
  • at least one item (piece) of a, b, or c may indicate: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural.
  • B corresponding to A indicates that B is associated with A, and B may be determined according to A.
  • determining B based on A does not mean that B is determined based only on A.
  • B may alternatively be determined based on A and/or other information.
  • the terms “include” and “have” in embodiments, claims, and accompanying drawings of this application are not exclusive.
  • a process, method, system, product, or device including a series of steps or modules is not limited to the enumerated steps or modules, and may further include a step or module that is not enumerated.
  • the method steps in embodiments of this application may be implemented in a hardware manner, or may be implemented in a manner of executing software instructions by the processor.
  • the software instructions may include a corresponding software module.
  • the software module may be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium well-known in the art.
  • a storage medium is coupled to a processor, so that the processor can read information from the storage medium and write information into the storage medium.
  • the storage medium may be a component of the processor.
  • the processor and the storage medium may be located in the ASIC.
  • the ASIC may be located in a network device or a terminal device.
  • the processor and the storage medium may exist in the network device or the terminal device as discrete components.
  • All or some of the foregoing embodiments may be implemented by software, hardware, firmware, or any combination thereof.
  • the computer program product includes one or more computer programs or instructions.
  • the computer programs or the instructions When the computer programs or the instructions are loaded and executed on a computer, the procedures or the functions according to embodiments of this application are all or partially executed.
  • the computer may be a general-purpose computer, a dedicated computer, a computer network, or another programmable apparatus.
  • the computer programs or the instructions may be stored in a computer-readable storage medium, or may be transmitted by using a computer-readable storage medium.
  • the computer-readable storage medium may be any usable medium accessible by the computer, or a data storage device such as a server integrating one or more usable media.
  • the usable medium may be a magnetic medium, for example, a floppy disk, a hard disk, or a magnetic tape; may be an optical medium, for example, a DVD; or may be a semiconductor medium, for example, a solid-state disk (solid-state disk, SSD).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer And Data Communications (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
US18/474,721 2021-03-27 2023-09-26 Augmented reality communication method, apparatus, and system Active US12395537B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN202110329252.9 2021-03-27
CN202110329252.9A CN115134335A (zh) 2021-03-27 2021-03-27 一种增强现实通信的方法、装置及系统
PCT/CN2022/083191 WO2022206626A1 (fr) 2021-03-27 2022-03-25 Procédé, appareil et système de communication à réalité augmentée

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/083191 Continuation WO2022206626A1 (fr) 2021-03-27 2022-03-25 Procédé, appareil et système de communication à réalité augmentée

Publications (2)

Publication Number Publication Date
US20240022619A1 US20240022619A1 (en) 2024-01-18
US12395537B2 true US12395537B2 (en) 2025-08-19

Family

ID=83374764

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/474,721 Active US12395537B2 (en) 2021-03-27 2023-09-26 Augmented reality communication method, apparatus, and system

Country Status (5)

Country Link
US (1) US12395537B2 (fr)
EP (2) EP4716196A3 (fr)
JP (1) JP7667305B2 (fr)
CN (1) CN115134335A (fr)
WO (1) WO2022206626A1 (fr)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12206718B2 (en) * 2021-07-20 2025-01-21 Samsung Electronics Co., Ltd. System and methods for handling immersive service in IP multimedia subsystem and mission critical services
CN116939884A (zh) * 2022-03-29 2023-10-24 中国移动通信有限公司研究院 一种信息处理方法、装置、通信设备和存储介质
WO2023212853A1 (fr) * 2022-05-05 2023-11-09 Qualcomm Incorporated Commande de politique et cartographie pour canaux de données dans des réseaux de sous-système multimédia de protocole internet
US12380608B2 (en) * 2022-08-11 2025-08-05 Qualcomm Incorporated Enhanced dual video call with augmented reality stream
WO2024184397A1 (fr) * 2023-03-06 2024-09-12 Telefonaktiebolaget Lm Ericsson (Publ) Noeuds de réseau, équipement utilisateur et procédés exécutés dans ceux-ci
CN118740943A (zh) * 2023-03-31 2024-10-01 华为技术有限公司 快速识别设备并显示信息的方法、服务器、设备和系统
CN116582524B (zh) * 2023-06-07 2026-04-21 中国联合网络通信集团有限公司 通话过程中xr动效的实现方法、装置、设备及存储介质
CN119946024A (zh) * 2023-11-06 2025-05-06 中兴通讯股份有限公司 一种渲染方法、通信节点及存储介质
WO2025150975A1 (fr) * 2024-01-11 2025-07-17 Samsung Electronics Co., Ltd. Procédé et dispositif pour établir une session dans un système de communication
CN121664781A (zh) * 2024-09-13 2026-03-13 中兴通讯股份有限公司 一种数据渲染方法、媒体处理网元、终端设备及存储介质

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110221962A1 (en) 2010-03-10 2011-09-15 Microsoft Corporation Augmented reality via a secondary channel
JP2011526441A (ja) 2008-07-01 2011-10-06 アルカテル−ルーセント ユーエスエー インコーポレーテッド Ｉｍｓネットワーク内でカスタマイズされたビデオサービスを実現するための方法およびネットワークユニット
JP2014525699A (ja) 2011-08-11 2014-09-29 インテル コーポレイション Ｉｍｓネットワーク上でのｄａｓｈフォーマット化コンテンツの、ｍｂｍｓダウンロードとｈｔｔｐに基づいた配信との間の切換え方法
CN104185220A (zh) 2013-05-22 2014-12-03 中国电信股份有限公司 Ims核心网设备失效切换方法和边缘接入控制设备
US20150029296A1 (en) * 2013-07-25 2015-01-29 Verizon Patent And Licensing Inc. Multimedia-enhanced emergency call systems
CN106803921A (zh) 2017-03-20 2017-06-06 深圳市丰巨泰科电子有限公司 基于ar技术的即时音视频通信方法及装置
JP2018509113A (ja) 2015-01-22 2018-03-29 ハドリー インコーポレイテッド 独立符号化バックグラウンド更新に基づく映像伝送
WO2019017885A1 (fr) 2017-07-17 2019-01-24 Nokia Solutions And Networks Oy Réalité augmentée assistée par réseau
CN110324284A (zh) 2018-03-30 2019-10-11 华为技术有限公司 接入ims的方法和通信装置
WO2021025430A1 (fr) 2019-08-07 2021-02-11 엘지전자 주식회사 Signalisation ims
CN112788274A (zh) 2019-11-08 2021-05-11 华为技术有限公司 一种基于增强现实的通信方法及装置
US20230007706A1 (en) * 2019-12-03 2023-01-05 Telefonaktiebolaget Lm Ericsson (Publ) First Network Node, Second Wireless Device and Methods Performed Therein

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011526441A (ja) 2008-07-01 2011-10-06 アルカテル−ルーセント ユーエスエー インコーポレーテッド Ｉｍｓネットワーク内でカスタマイズされたビデオサービスを実現するための方法およびネットワークユニット
US20110221962A1 (en) 2010-03-10 2011-09-15 Microsoft Corporation Augmented reality via a secondary channel
JP2014525699A (ja) 2011-08-11 2014-09-29 インテル コーポレイション Ｉｍｓネットワーク上でのｄａｓｈフォーマット化コンテンツの、ｍｂｍｓダウンロードとｈｔｔｐに基づいた配信との間の切換え方法
CN104185220A (zh) 2013-05-22 2014-12-03 中国电信股份有限公司 Ims核心网设备失效切换方法和边缘接入控制设备
US20150029296A1 (en) * 2013-07-25 2015-01-29 Verizon Patent And Licensing Inc. Multimedia-enhanced emergency call systems
JP2018509113A (ja) 2015-01-22 2018-03-29 ハドリー インコーポレイテッド 独立符号化バックグラウンド更新に基づく映像伝送
CN106803921A (zh) 2017-03-20 2017-06-06 深圳市丰巨泰科电子有限公司 基于ar技术的即时音视频通信方法及装置
WO2019017885A1 (fr) 2017-07-17 2019-01-24 Nokia Solutions And Networks Oy Réalité augmentée assistée par réseau
CN110324284A (zh) 2018-03-30 2019-10-11 华为技术有限公司 接入ims的方法和通信装置
WO2021025430A1 (fr) 2019-08-07 2021-02-11 엘지전자 주식회사 Signalisation ims
CN112788274A (zh) 2019-11-08 2021-05-11 华为技术有限公司 一种基于增强现实的通信方法及装置
US20230007706A1 (en) * 2019-12-03 2023-01-05 Telefonaktiebolaget Lm Ericsson (Publ) First Network Node, Second Wireless Device and Methods Performed Therein

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
"The relationship between wireless signal transmission attenuation and distance [Indoor positioning]_Beidou GPS Navigation", Sina Blog, UPL:https://blog.sina.com.cn/s/blog_c253baf70102zndw.html, Mar. 27, 2019, with the English translation, total 6 pages.
3GPP TR 26.928 V16.1.0 (Dec. 2020),"3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Extended Reality (XR) in 5G (Release 16)", total 130 pages.
3GPP TS 22.173 V17.2.0 (Dec. 2020), "3rd Generation Partnership Project; Technical Specification Group Services and System Aspects;IP Multimedia Core Network Subsystem (IMS) Multimedia Telephony Service and supplementary services;Stage 1 (Release 17)", total 77 pages.
3GPP TS 23.334 V16.2.0 (Dec. 2020),"3rd Generation Partnership Project; Technical Specification Group Core Network and Terminals; IP Multimedia Subsystem (IMS) Application Level Gateway (IMS-ALG)-IMS Access Gateway (IMS-AGW) interface:Procedures descriptions (Release 16)",total 109 pages.
3GPP TS 26.114 V16.8.2 (Jan. 2021), "3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; IP Multimedia Subsystem (IMS); Multimedia Telephony; Media handling and interaction(Release 16)", total 71 pages.
Huawei, "FS_5GSTAR: Proposed Architectures for AR Conversational", 3GPP TSG SA4 Meeting #110-e Online meeting, Aug. 19-28, 2020, S4-201066, total 4 pages.

Also Published As

Publication number Publication date
EP4304166A1 (fr) 2024-01-10
US20240022619A1 (en) 2024-01-18
EP4304166B1 (fr) 2025-12-03
WO2022206626A1 (fr) 2022-10-06
EP4716196A3 (fr) 2026-04-08
EP4716196A2 (fr) 2026-03-25
EP4304166A4 (fr) 2024-05-29
JP2024511504A (ja) 2024-03-13
JP7667305B2 (ja) 2025-04-22
CN115134335A (zh) 2022-09-30

Similar Documents

Publication Publication Date Title
US12395537B2 (en) Augmented reality communication method, apparatus, and system
US20240022632A1 (en) Augmented reality communication method, apparatus, and system
CN113709190B (zh) 业务设置方法和装置、存储介质及电子设备
EP4391611B1 (fr) Procédé et appareil de transmission d'informations
US20240236153A1 (en) Communication Method, Apparatus, and Communication System
US12495080B2 (en) Communication method, signaling control network element, media control network element and communication system
EP4507262A1 (fr) Procédé et dispositif de communication
CN104125221B (zh) Ims终端设备多软终端资源共享和应用协同装置及方法
CN115695382A (zh) 一种通信方法及装置
EP3288230A1 (fr) Cadriciel et procédé pour réaliser une communication multimédia, équipement de fusion et équipement utilisateur (ue)
US20250071178A1 (en) Method and Apparatus for Processing Data Channel Application List, and Device
CN109962904B (zh) 一种基于Kubernetes的IMS系统
EP4593328A1 (fr) Procédé et appareil de vérification de signature électronique
CN119865489A (zh) 会话处理方法、装置、设备、存储介质及程序产品
WO2024032213A1 (fr) Procédé de communication, appareil et système
CN119603763A (zh) 通信方法、装置、网络功能、呼叫实体、存储介质及计算机程序产品
CN120111039A (zh) 一种通信方法、装置及系统
CN118573659A (zh) 提供媒体服务的方法、装置和系统
CN120658714A (zh) 一种数据传输方法和通信装置
CN118158201A (zh) 信息传输方法、信息传输装置和通信设备
CN118450539A (zh) 数据通道的建立方法、装置、核心网设备及存储介质
CN104660545A (zh) 一种利用服务代理器传输信息的方法及服务代理器

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

AS Assignment

Owner name: HUAWEI TECHNOLOGIES CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIU, YAN;GAO, YANG;SIGNING DATES FROM 20231018 TO 20250523;REEL/FRAME:071207/0534

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE