EP4104401A1 - Procédé de transmission de données - Google Patents

Procédé de transmission de données

Info

Publication number
EP4104401A1
EP4104401A1 EP20705923.9A EP20705923A EP4104401A1 EP 4104401 A1 EP4104401 A1 EP 4104401A1 EP 20705923 A EP20705923 A EP 20705923A EP 4104401 A1 EP4104401 A1 EP 4104401A1
Authority
EP
European Patent Office
Prior art keywords
data
user
user terminals
time
media stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20705923.9A
Other languages
German (de)
English (en)
Inventor
Martin KLIMSCHA
Max KOSSATZ
Markus LEITSCH
René WEINBERGER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitbox Entertainment GmbH
Original Assignee
Hitbox Entertainment GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitbox Entertainment GmbH filed Critical Hitbox Entertainment GmbH
Publication of EP4104401A1 publication Critical patent/EP4104401A1/fr
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/765—Media network packet handling intermediate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Definitions

  • the invention relates to a method for data transmission in which an audiovisual media stream of a live event, for example a sporting event, is sent from a first provider to a large number of user terminals via the Internet and / or via at least one cellular network, and from a second Provider is provided with a data stream generated on the basis of the live event for further processing or display via the Internet and / or via at least one cellular network, according to the preamble of claim 1.
  • a live transmission is understood here to mean that the audiovisual data about an event are not subject to any further time delay apart from the delay generated in the preparation and transmission process.
  • audio-visual data being broadcast via television stations that has been common for decades, audio-visual data content such as image and sound recorded at the location of the event can be transmitted within a few seconds to the receiving end device such as a consumer's television set. This time delay caused by processing and broadcasting is also referred to as latency.
  • OTT over-the-top content
  • ISP Internet Service Providers
  • Some of the bits form the actual useful data and some of the bits form a data header that contains certain control information.
  • This control information is used by Internet servers to route the data segments to their destination.
  • the transmission protocols used for this are usually TCP (Transmission Control Protocol), UDP (User Datagram Protocol) and IP (Internet Protocol).
  • TCP Transmission Control Protocol
  • UDP User Datagram Protocol
  • IP Internet Protocol
  • the segments must subsequently be reassembled in such a way that continuous playback of the entire media stream is made possible.
  • this process causes latency times that are usually between 3 and 40 seconds, but can also be significantly higher. These comparatively long latencies are primarily due to the ones used
  • Transmission protocols such as HLS or MPEG-DASH, which were not optimized for the rapid transmission of data, but rather for the successful and complete transmission of audiovisual data to technically even less powerful but also less diverse end devices under the sometimes unstable Internet connections in the past.
  • the intermediate buffering of the data used in this case and the merging of the individual data segments into playable media content in the end device of a user caused the delays in the display of the data content.
  • the high latency also means that the audiovisual data is usually displayed on the user's terminal at different times.
  • the time of the display can differ by up to 30 seconds with latency times, which are usually between 3 and 40 seconds. Therefore, there is no simultaneity of the reproduction of audiovisual media content on the respective user terminals, which can impair the feeling of communal experience of the broadcast live event.
  • the feeling of communal experience can, however, intensify media consumption emotionally.
  • an interaction of the user with a provider or with other users based on the consumed media content is to be made possible, for example the placing of bets or just the mere exchange of comments, it is as simultaneous as possible Playback of the audiovisual media stream is essential. In other words, the lowest possible latency is required in the delivery of the audiovisual media stream to the individual user terminals and their reproduction on the screens of the user terminals.
  • the personal perception of a communal experience of the broadcast live event could also be intensified by providing the users with additional information or input requests as interactive offers for the audiovisual media stream.
  • the respective user is given the opportunity to exchange directly or indirectly with others about the media content they have just experienced, which gives them the feeling of shared experience of the broadcast live event.
  • these possibilities hardly exist or are impaired by the lack of synchronization.
  • Claim 1 relates to a method for data transmission in which an audiovisual media stream of a live event, for example a sporting event, is sent via the Internet and / or via at least one cellular network to a large number of user terminals from a first provider, and from a data stream generated on the basis of the live event is made available to a second provider for further processing or display via the Internet and / or via at least one cellular network.
  • the audiovisual media stream and the data stream are fed to a data processing device which generates a sequence of time-spaced data packets from the data stream and each data packet with a data packet that identifies the respective data packet
  • Real-time transfer protocols are sent to a group of user terminals for simultaneous playback synchronized with the audiovisual media stream.
  • first provider and “second provider” are intended to make it clear that the audiovisual media stream and the data stream come from different technical sources in practice, although in a legal sense they could also be the same company. Likewise, the operator of the method according to the invention could also be the “first provider” and / or “second provider” in the legal sense.
  • the second provider is a provider who is sometimes on site with their own equipment for image and sound extraction, or provides data streams generated on the basis of the live event for the distribution of sports data by media partners with the aid of audio-visual data that has already been recorded .
  • These data streams do not contain any audiovisual data, but data such as scores, statistics and other evaluations of the current live event.
  • the data streams are heavily dependent on the respective live event in terms of their data volume and time structure, for example on the sport in question, and are subject to strong fluctuations in terms of data volume and time structure. They are therefore not per se suitable for synchronization with continuously transmitted media streams or for simultaneous display on user terminals.
  • “simultaneity” is understood to mean the instantaneous occurrence of several events at the same time, for example the simultaneous display of certain audiovisual media content with the data of a generated data packet on several user terminals constant sequence of simultaneous presentations of a specific audiovisual media content with the data of a generated data packet on several user terminals.
  • a data processing device generates a sequence of time-spaced data packets from the data stream, the generated data packets being synchronized with the media stream at controllable time intervals.
  • a synchronization with the media stream can be achieved by the operator generating such a sequence of time-spaced data packets with controllable time intervals.
  • the data packets are preferably generated with an algorithm that recognizes typical events on the basis of the data stream and creates information or input requests that are coordinated with them as interactive offers.
  • Such algorithms are known in principle and are also used, for example, to generate the data streams themselves. For example, they are able to automatically recognize typical events from the audio and video material, such as scoring a goal or a penalty decision in football.
  • Similar algorithms are used according to the invention to generate the data packets by, for example, in the examples cited above, the prompt "Will team X equalize?" Or "Will a goal be scored from the penalty?" as a ready-to-send data packet.
  • Each data packet is then provided in a data header, which conventionally contains the control information for the transmission of the data packet over the Internet, with identification information identifying the respective data packet and a time stamp.
  • the time stamp enables synchronization with the audiovisual media stream, which has usually already been provided with a time stamp by the first provider, usually in the data headers of the so-called "frames" with which a media stream is transmitted.
  • a data packet and a frame of the media stream with the same time stamp are reproduced at the same time on the user terminal.
  • the reproduction can take place, for example, using a split screen by displaying the content of the audiovisual media stream in a first half of the screen is displayed, and in a second half of the screen the content of the data packet, for example a comment, additional information, or a prompt to the question "Will team X equalize?" .
  • the data packets synchronized with the media stream are transmitted to a group of user terminals via a bidirectional communication link using real-time transfer protocols and real-time streaming protocols.
  • the group of user terminals is preferably created by prior registration of the user with a Operator of the method according to the invention defined.
  • An interested user logs on to the operator of the method according to the invention by disclosing his connection data and optionally also by disclosing a specific group as a member of which he would like to participate, for example with the help of a web-based application or by installing a corresponding software application beforehand (" App ”) on his device.
  • App a corresponding software application beforehand
  • An essential aspect of the method according to the invention is the controllability of the time interval between two successive data packets. This makes it possible, on the one hand, to meet the requirements of different live events, since some live events are characterized by faster changes in events than others. On the other hand, it is also possible to focus on the quality of the bidirectional communication connection, which is essentially given by the maximum possible bit rate of the transmission, the number of frames transmitted per second and the latency times of the transmission. In the case of poor quality, i.e. with low bit rates and a low number of frames transmitted per second as well as long latency times, the time interval between two successive data packets will have to be selected to be greater than in the case of comparatively high quality. Possible criteria for this are discussed below.
  • Real-time protocols are understood to mean protocols that allow data to be transmitted with negligible latency. In the present case, the latency is to be neglected in particular if any existing latency would be technically measurable, but not perceptible by the user, i.e. if, for example, two images are perceived as being displayed at the same time, although they were actually displayed with a minimal time difference.
  • a real-time transfer protocol is characterized by the fact that there is no intermediate storage of the data on their way from the sender to the recipient. Conventional HTTP is therefore not a real-time protocol, for example, because it provides for the data to be temporarily stored on the user's terminal device before it is reproduced.
  • RTP Real Time Protocol
  • UDP User Datagram Protocol
  • IP Internet Protocol
  • RTP Real-time transfer protocol
  • DDP User Datagram Protocol
  • IP Internet Protocol
  • RTP is intended for real-time traffic over the Internet, on all types of Network protocol to be operated in that it does not depend on any information in the lower levels of the computing network model.
  • RTP is usually only implemented via IP / üDP, but could be used as a protocol on any type of packet network, e.g.
  • ATM or ISDN practical implementation can take place, for example, with the help of WebRTC (Web Real-Time Communication), an open standard that defines a collection of communication protocols and programming points (API) that enable real-time communication via computer-computer connections Web browsers no longer just retrieve data resources from backend servers, but also real-time information from other users' browsers.
  • WebRTC Web Real-Time Communication
  • API programming points
  • the transmission of the media stream with the synchronized data packets takes place according to the invention via a bidirectional communication connection, which can be implemented, for example, via so-called WebSockets.
  • a bidirectional communication connection which can be implemented, for example, via so-called WebSockets.
  • This is a bidirectional connection between a web application and a WebSocket server, i.e. a web server that also supports WebSockets.
  • a WebSocket server i.e. a web server that also supports WebSockets.
  • a content delivery network is a network of regionally distributed servers connected via the Internet with which content, usually large media files, is delivered.
  • a CDN provides scalable storage and delivery capacities and is in good shape organized by interconnected nodes, with the CDN nodes being distributed across many locations and backbones. The task of the CDN is to serve user requests for content as economically as possible. Individual locations are also referred to as PoP (Point of Presence) and consist of server clusters.
  • PoP Point of Presence
  • the method according to the invention enables the transmission of audiovisual media streams and synchronized data packets with a latency of less than 300 ms. This short latency ensures that the transmitted data is reproduced on all user terminals in a manner that is perceptible to all users at the same time. As part of this simultaneous playback, the synchronized playback with data packets generated by the operator also takes place.
  • the content of the synchronized data packets is basically freely selectable. For example, it can be additional information or comments on the transmitted content of the media stream.
  • the generated data packets each contain an input request displayed on the user terminals, and that a user-generated data packet is created from a user input and the identification information of the relevant data packet and sent to the data processing device via the bidirectional communication connection for evaluation or forwarding to other users .
  • the data packets synchronized with the media stream using the time stamp are transmitted by the data processing device at different bit rates via the bidirectional communication link.
  • the media stream and the data packets synchronized with the media stream are available to the user terminal with different bit rates, so that the user terminal can choose a suitable bit rate depending on the performance of the terminal and the reception quality in order to optimize the playback quality.
  • an essential aspect of the method according to the invention is the controllability of the time interval between two successive data packets. This is particularly important in order to check the quality of the bidirectional communication link between the data processing device and the user terminals to turn off.
  • an appropriate criterion could be developed for this purpose, according to which the controllable time interval between two successive data packets of the sequence of time-spaced data packets is controlled in such a way that it fulfills the criterion DT> (BR / FPS) t ed , where BR is the bit rate of the audiovisual media stream transmitted to the group of user terminals in kb / s (kilobits per second), FPS is the number of frames per second of the audiovisual media stream transmitted to the group of user terminals, and t ed the latency of the transmission of the audiovisual media stream transmitted to the group of user terminals between the
  • a good connection quality can be characterized, for example, by a bit rate of 2500 kb / s at 60 FPS and a latency time t ed between the data processing device and the user terminals of, for example, 100 ms, which results in a lower limit for the time interval DT between two data packets generated by the data processing device 4.2 seconds results.
  • a poor connection quality can be characterized, for example, by a bit rate of 500 kb / s at 30 FPS and a latency time t ed between the data processing device and the user terminals of 500 ms, for example, so that, according to the proposed criterion, the time interval DT between two of the
  • Data packets generated by the data processing device should be at least 8.3 seconds. These limits each represent technical limits for the time interval DT, which are determined by the transmission quality of the bidirectional communication link between the
  • time interval DT can be selected as desired above these technical limits.
  • the generated data packets can each contain, for example, an input request displayed on the user terminals.
  • a user-generated data packet can be created from a user input and the identification information of the relevant data packet, which is sent to the
  • the Data preparation device is sent.
  • the evaluation and any forwarding takes place in the The data processing device is, of course, preferably automated, since in practical operation a large number of data packets generated by the operator and data packets generated by the user can be expected. It would be advantageous to have criteria that check the correct sequence of this process of sending and receiving data packets, that is, plausibility criteria that make it possible, for example, to detect manipulations.
  • a simple criterion has proven to be particularly effective, as a result of which it is proposed that the evaluation of the user-generated data packet include a check of the criterion
  • qet is a predefined maximum period of time in seconds, measured from the sending of a certain data packet by the data processing device to the user terminals, for the creation of the user input
  • Provider and the data processing facility is in seconds
  • t ED is the latency of the transmission of the audiovisual media stream transmitted to the group of user terminals between the data preparation device and the user terminals in seconds
  • t D is the latency of the data processing and display at the user terminal in seconds, and if the criterion is not met, the relevant user-generated data packet is discarded.
  • Fig. 1 is a schematic representation of an embodiment of a method according to the invention.
  • FIG. 2 shows a schematic illustration of an embodiment of the data processing device.
  • FIG. 1 shows the basic mode of operation of the method according to the invention.
  • a first provider 1 is located with appropriate equipment for obtaining image and sound recordings on site of a live event, for example a sporting event, and provides these image and sound recordings as an audiovisual media stream MS via the Internet 6 and / or via at least one Cellular network of a large number of user terminals 4 are available.
  • a second provider 2 generates a data stream DS on the basis of the live event and makes this data stream DS available for further processing or display likewise via the Internet 6 and / or via at least one cellular network.
  • the data streams DS are intended for professional users and not for private consumers. In the case of sporting events, they contain an abundance of sport data, which can be used, for example, to determine any
  • the second provider 2 can either be on site with its own equipment for image and sound extraction, or it generates the data stream DS with the aid of audiovisual data that has already been recorded.
  • these data streams DS are highly dependent on the respective live event in terms of their data volume and their temporal structuring, for example on the sport in question, and are subject to strong fluctuations in terms of data volume and temporal structuring.
  • Data processing device 3 are supplied, which is operated by an operator of the method according to the invention.
  • the data processing device 3 performs in Essentially two steps, as will be explained with reference to FIG. 2.
  • a sequence of time-spaced data packets DP is generated from the data stream DS at controllable time intervals DT.
  • the data packets DP are preferably generated using an algorithm 8 which recognizes typical events on the basis of the data stream DS and creates information or input prompts that are coordinated with them as interactive offers.
  • algorithms 8 are known in principle and are also used, for example, to generate the data streams DS themselves. For example, they are able to automatically recognize typical events from the audio and video material, such as scoring a goal or a penalty decision in football.
  • Similar algorithms 8 are used according to the invention to generate the data packets DP by, for example, in the examples cited above, the input prompt "Will team X equalize?" Or "Will a goal be scored from the penalty?" as a ready-to-send data packet DP.
  • the content of the data packets DP can in principle be freely selected, so it can also be, for example, additional information or comments on the transmitted content of the media stream MS.
  • Each data packet DP is subsequently provided with identification information identifying the respective data packet and a time stamp in a data header which conventionally contains the control information for the transmission of the data packet DP over the Internet.
  • the generated data packets DP are synchronized with the media stream MS at controllable time intervals DT.
  • the controllable time interval DT between two successive data packets DP of the sequence of time-spaced data packets DP is chosen approximately in such a way that it meets the criterion
  • BR bit rate of the audiovisual media stream MS transmitted to the group of user terminals 4 in kb / s (kilobits per second)
  • FPS is the number of frames per second sent to the group from user terminals 4 transmitted audiovisual media streams MS
  • t ed is the latency of the transmission of the audiovisual media stream MS transmitted to the group of user terminals 4 between the
  • the synchronization takes place with the help of the time stamp of the data packets DP and the time stamp of the audiovisual media stream MS, which has usually already been provided by the first provider 1, usually in the data headers of the so-called "frames", with which a media stream
  • the result is an audiovisual media stream MS which has been synchronized with data packets DP with controllable time intervals DT and is hereinafter also referred to as a synchronized media data stream MD in FIGS when the synchronized media data stream MD is provided and transmitted by the data processing device 3 with different bit rates.
  • the synchronized media data stream MD is thus available to the user terminal 4 with different bit rates, so that the user terminal 4 depending on the performance of the terminal and reception quality can choose a suitable bit rate in each case n to optimize the playback quality.
  • the synchronized media data stream MD is transmitted via a bidirectional communication link 7 using real-time transfer protocols to a group of user terminals 4.
  • An example of a real-time transfer protocol is currently RTP (Real Time Protocol).
  • RTP can be used with ÜDP and IP as IP / UDP / RTP.
  • the practical implementation can take place, for example, with the help of WebRTC (Web Real-Time Communication).
  • the bidirectional communication connection 7 can be implemented, for example, via what are known as web sockets, with the transmission of audiovisual data usually being carried out with the aid of a content delivery network 5 (CDN or content distribution network).
  • a content delivery network 5 is a network of regionally distributed servers connected via the Internet, with which content, usually large media files, is delivered. Individual locations are also called PoP (Point of Presence) denotes and consist of server clusters.
  • the group of user terminals 4 is preferably defined by prior registration of the user with the operator of the method according to the invention.
  • An interested user registers with the operator of the method according to the invention by disclosing his connection data and optionally also by announcing a certain group as a member of which he would like to participate, for example with the help of a web-based application, or by installing a corresponding software application beforehand (" App ") on his terminal device.
  • App software application beforehand
  • the user starts a request for the transmission of data using a WebSocket protocol, for example, whereby after the transmission of the initial data to establish the connection, the underlying TCP connection remains and asynchronous transmissions in both Directions made possible.
  • the user in question then receives the data packets DP synchronized with the media stream MS as a synchronized media data stream MD. Since the synchronized media data stream MD with different bit rates is available to the user terminal 4, the user terminal 4 can subsequently, depending on the performance of the terminal as well
  • Reception quality select a suitable bit rate in each case in order to optimize the playback quality.
  • a data packet DP and a frame of the media stream MS with the same time stamp are displayed simultaneously on the user terminal 4 while the synchronized media data stream MD is being received.
  • the reproduction can take place, for example, with the aid of a split screen, as indicated with the aid of the dashed lines in FIG. 1, in that the content of the audiovisual media stream MS is displayed in a first half of the screen and the content is displayed in a second half of the screen of the data packet DP, for example a comment, additional information, or a prompt to the question "Will team X equalize?"
  • the user can make an input corresponding to the input request.
  • the input from the user and the identification information of the relevant data packet DP subsequently becomes a created user-generated data packet D and via the bidirectional communication link 7 for evaluation or forwarding to other users to the
  • Data processing device 3 sent, in turn the already mentioned content delivery network 5 can be used.
  • the data processing device 3 can use the relevant input for betting games, for example, or compare it with the inputs of other users.
  • the evaluation and any forwarding takes place in the data processing device 3, of course, preferably in an automated manner, since in practical operation an abundance of data packets DP generated by the operator and data packets D generated by the user can be expected.
  • qet is a predefined maximum period of time in seconds, measured from the sending of a specific data packet DP by the data processing device 3 to the user terminals 4, for the creation of the user input,
  • T BE is the latency of the transmission between the first provider 1 and the data processing device 3 in seconds
  • t E is the latency of the data processing at the data processing device 3 in seconds
  • t ß o is the latency of the transmission of the audiovisual media transmitted to the group of user terminals 4 Streams MS between the data processing device 3 and the user terminals 4 in seconds
  • t D is the latency of the data processing and display at the user terminal 4 in seconds, and if the criterion is not met, the relevant user-generated data packet D is discarded.
  • a notification of any kind is usually sent from the data processing device 3 to the user concerned in response to the input of a user in order to promote the collective experience of the live event.
  • This can be, for example, a notification of which or how many users in the same group have correctly answered questions that have been asked so far and contain a corresponding ranking.
  • the method according to the invention enables the transmission of audiovisual media streams MS and synchronized data packets DP with a latency of less than 300 ms. This short latency ensures that the transmitted data are reproduced on all user terminals 4 so that they can be perceived by all users at the same time. As part of this simultaneous playback, the synchronized playback with the data packets DP generated by the operator also takes place. This also enables the users to interact on the basis of the live event they have just experienced, both with the operator of the method according to the invention and with other users, as a result of which the shared experience of the transmitted live event can be intensified.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un procédé de transmission de données, selon lequel un flux multimédia audiovisuel (MS) d'un événement en direct, par exemple d'un événement sportif, est envoyé par un premier fournisseur (1) à une pluralité de terminaux d'utilisateurs (4) par le biais de l'Internet (6) et/ou par l'intermédiaire d'au moins un réseau de téléphonie mobile, et un flux de données (DS) généré sur la base de l'événement en direct est fourni par un deuxième fournisseur (2). Selon l'invention, le flux multimédia audiovisuel (MS) et le flux de données (DS) sont acheminés vers un dispositif de traitement de données (3) qui génère, à partir du flux de données (DS), une succession de paquets de données (DP) séparés dans le temps et qui muni chaque paquet de données (DP) d'une estampille temporelle et d'une information d'identification identifiant le paquet de données respectif (DP), les paquets de données générés (DP) étant synchronisés avec le flux multimédia (MS) au moyen de l'estampille temporelle à intervalles réglables (ΔΤ) et étant envoyés à un groupe de terminaux d'utilisateurs (4) à des fins de reproduction simultanée et synchronisée avec le flux multimédia audiovisuel (MS) par l'intermédiaire d'une liaison de communication bidirectionnelle (7) au moyen de protocoles de transfert en temps réel (RTP) et de protocoles de diffusion en temps réel (RTSP).
EP20705923.9A 2020-02-13 2020-02-13 Procédé de transmission de données Pending EP4104401A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2020/053795 WO2021160271A1 (fr) 2020-02-13 2020-02-13 Procédé de transmission de données

Publications (1)

Publication Number Publication Date
EP4104401A1 true EP4104401A1 (fr) 2022-12-21

Family

ID=69630288

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20705923.9A Pending EP4104401A1 (fr) 2020-02-13 2020-02-13 Procédé de transmission de données

Country Status (3)

Country Link
US (1) US20230063532A1 (fr)
EP (1) EP4104401A1 (fr)
WO (1) WO2021160271A1 (fr)

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7502368B2 (en) * 2004-04-08 2009-03-10 John Sanders Method and apparatus for switching a source of an audiovisual program configured for distribution among user terminals
US8677006B2 (en) * 2011-05-05 2014-03-18 Microsoft Corporation Processing media streams
US8826350B1 (en) * 2012-01-24 2014-09-02 Intellectual Ventures Fund 79 Llc Methods, devices, and mediums for providing group video on demand
US9262794B2 (en) * 2013-03-14 2016-02-16 Verance Corporation Transactional video marking system
US9860581B2 (en) * 2013-09-20 2018-01-02 Koninklijke Kpn N.V. Correlating timeline information between media streams
US10198777B2 (en) * 2013-12-06 2019-02-05 Remote Media, Llc System, method, and application for exchanging content in a social network environment
WO2017215733A1 (fr) * 2016-06-14 2017-12-21 Netent Product Services Ltd. Diffusion en continu en direct de contenu multimédia pour applications à faible latence telles que des applications de jeux de casino en direct
US10419808B2 (en) * 2016-09-08 2019-09-17 Gvbb Holdings S.A.R.L. System and method for scalable physical layer flow of packetized media streams
US10200768B2 (en) * 2017-03-30 2019-02-05 Microsoft Technology Licensing, Llc Low-latency mobile device audiovisual streaming
US10560502B2 (en) * 2017-08-24 2020-02-11 OpenExchange, Inc. Method to re-synchronize live media streams, commands, and on-screen events transmitted through different internet pathways

Also Published As

Publication number Publication date
WO2021160271A1 (fr) 2021-08-19
US20230063532A1 (en) 2023-03-02

Similar Documents

Publication Publication Date Title
DE60130665T2 (de) Audiodatenverarbeitung
DE102012224268B4 (de) Verdecken von Web-Videos: Ein Verfahren und Computersystem zum Darstellen der in mehreren Fenstern angesehenen Videos
DE69832247T2 (de) Auf einem verteilten Internet- Protokollen basierte Echtzeit- Multimedia- Datenströmungs- Architektur
DE19983761B9 (de) Vorrichtung und Verfahren zum Sammeln und Analysieren von Kommunikationsdaten
DE602004011485T2 (de) Breitbandfernmeldesystem und darin verwendetes Verfahren zur Reduzierung der Latenzzeit eines Kanal-Zappings von einem Multimedia-Empfänger
DE112006002644T5 (de) Mediendatenverarbeitung unter Verwendung von charakteristischen Elementen für Streaming- und Steuerprozesse
DE112020004978T5 (de) System und Verfahren zum Ausliefern in Echtzeit eines zielgerichteten Inhalts in einem Streaming-Inhalt
CN107864402A (zh) 直播视频播放方法及装置
DE60035273T2 (de) Methoden zum übertragen und empfangen von informationen
DE10004829B4 (de) Verfahren und Vorrichtung zum Übertragen von Dateneinheiten eines Datenstroms
Fallica et al. On the quality of experience of sopcast
EP1428371B1 (fr) Procede de transmission d'un flux de donnees d'un producteur a une pluralite de spectateurs
DE69722162T2 (de) Verfahren zur Steuerung eines Nachrichtenflusses in einem interaktiven Netzwerk
WO2015120839A1 (fr) Procédé de transfert d'un flux de données en temps réel
EP4104401A1 (fr) Procédé de transmission de données
DE60205393T2 (de) Verfahren und vorrichtung zum empfang von rundsendedaten
WO2021008943A1 (fr) Procédé de transmission d'informations vidéo à un appareil de télécommunication, les informations vidéo comprenant une pluralité de flux d'informations vidéo, système, appareil de télécommunication, dispositif serveur d'arrière plan lié au contenu, programme informatique et support lisible par ordinateur
DE10050536C1 (de) Personalisierbares Radio
EP1855437A1 (fr) Procédé pour établir une connection de communication de type 'Push-to-Talk'
DE102007006432B4 (de) Vorrichtung und Verfahren zur Bereitstellung von Daten
EP2030474B1 (fr) Procédé et dispositif d'établissement de relations de communication
DE102023102250A1 (de) Dezentrale Datenbank, Verfahren zum Unterhalten einer solchen und darauf basierende Konferenz-Anwendung
EP1168829B1 (fr) Méthode de réalisation d'émissions en direct avec insertion d'images
DE112016004480T5 (de) Synchronisierung des Renderns von Medien in heterogenen Netzwerkumgebungen
DE10104961A1 (de) Verfahren zur bandbreiteneffizienten Übertragung von Datenströmen in einem IP-Netz

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220713

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04L0029060000

Ipc: H04L0065401000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04L 65/75 20220101ALI20230517BHEP

Ipc: H04L 65/611 20220101ALI20230517BHEP

Ipc: H04L 65/401 20220101AFI20230517BHEP

INTG Intention to grant announced

Effective date: 20230609

19U Interruption of proceedings before grant

Effective date: 20230823