WO2010023828A1 - 情報処理システムおよび情報処理装置 - Google Patents
情報処理システムおよび情報処理装置 Download PDFInfo
- Publication number
- WO2010023828A1 WO2010023828A1 PCT/JP2009/003781 JP2009003781W WO2010023828A1 WO 2010023828 A1 WO2010023828 A1 WO 2010023828A1 JP 2009003781 W JP2009003781 W JP 2009003781W WO 2010023828 A1 WO2010023828 A1 WO 2010023828A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- unit
- information
- content data
- frame
- host device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronisation processes, e.g. processing of PCR [Programme Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Definitions
- the present invention relates to a technique used in an information processing apparatus that processes content data, and more particularly to a technique in which a plurality of information processing apparatuses connected to a network reproduce content data in synchronization.
- P2P peer-to-peer
- the P2P method is characterized in that a terminal device of another user directly accesses a terminal device of a general user.
- a line is increased even if the number of terminals becomes enormous.
- communication is possible as long as there is a margin in bandwidth.
- services for distributing content data by the P2P method are also being put into practical use.
- an object of the present invention is to provide a technique in which a plurality of information processing apparatuses reproduce content data in synchronization.
- an information processing system in which a content distribution server, a host device, and one or more client devices are connected via a network.
- the client device includes a first storage unit that stores content data downloaded from the content distribution server, a first processing unit that reproduces content data stored in the first storage unit, and a first state that detects a download state of the content data.
- a detection unit, and a first notification unit that notifies the host device of the detected download status.
- the host device includes an acquisition unit that acquires a download status notified from the client device, and a control unit that controls reproduction processing of the client device based on the notified download status.
- the content data may be moving image data.
- This apparatus includes a storage unit that stores content data downloaded from a content distribution server, a processing unit that reproduces content data stored in the storage unit, a detection unit that detects a download state of content data, and a detected download state And a notification unit that notifies the host device, and the processing unit stops the reproduction process when the frame specified by the final frame information notified from the host device is reproduced.
- FIG. 10 is a sequence diagram for controlling synchronous playback processing between a host device and a client device.
- (A) is a figure which shows the download condition when content data is progressively downloaded
- (b) is a figure which shows the download condition when content data is downloaded by the P2P method.
- (A) is explanatory drawing for demonstrating the moving image file of content data
- (b) is explanatory drawing for demonstrating an index file.
- FIG. 1 shows an information processing system 1 according to an embodiment of the present invention.
- the information processing system 1 includes a host device 10, a content distribution server 16, client devices 18 a, 18 b, 18 c (hereinafter collectively referred to as “client device 18”), and a network server 20.
- the host device 10, the content distribution server 16, the client device 18, and the network server 20 are connected to each other via a network 14 so that they can communicate with each other.
- the network 14 may be the Internet using, for example, a TCP / IP protocol.
- Each of the client devices 18a, 18b, 18c and the host device 10 includes output devices 12a, 12b, 12c, 12d (hereinafter collectively referred to as “output device 12”) that output processing results.
- the output device 12 may be a television having a display for outputting an image and a speaker for outputting sound.
- the content distribution server 16 is operated by a video distribution company or the like, and provides content data to the host device 10 and the client device 18.
- the content data may be AV data compressed in the MPEG2 format.
- the host device 10 and the client device 18 obtain AV data such as a movie from the content distribution server 16 by the progressive download method.
- the host device 10 and the client device 18 can simultaneously output video and audio to the output device 12 while downloading AV data to a storage unit configured by a hard disk drive or the like.
- the information processing system 1 according to the embodiment provides an environment in which a plurality of people are watching movies together while being in different places.
- Each information processing apparatus reproduces the received stream and text data, thereby constructing a chat system that shares a virtual space.
- the network device 20 constructs a chat system
- the host device 10 reproduces content data such as a movie in synchronization with a plurality of information processing devices including the host device 10 itself. To build a virtual cinema.
- the host device 10 operates as an information processing device that synchronously reproduces content data such as a movie together with the client device 18.
- the host device 10 has a role of controlling the reproduction processing of the client device 18 in addition to the content data reproduction processing function.
- the information processing device of one user when a plurality of users try to watch the same movie, the information processing device of one user operates as the host device 10, and the information processing devices of the remaining users operate as the client device 18. May be.
- the function of the host device 10 may be realized by a management server (not shown) connected to the network 14, and at this time, the management server does not need to have a content data reproduction processing function.
- FIG. 2A shows an example of a movie playback screen displayed on the output device 12.
- a progressively downloaded movie is reproduced and displayed on the screen of the output device 12, and a video chat window 22 for displaying a user who is watching the same movie is formed on a part of the screen.
- Each user has a camera and a microphone, and image data captured by the camera and audio data acquired by the microphone are stream-distributed to information processing apparatuses of other users via the network 14.
- the video chat window 22 displays images of users other than the user in real time, and outputs audio in real time.
- the information processing system 1 can realize a virtual movie theater by constructing a video chat system, and a plurality of users can enjoy a movie simultaneously.
- the information processing system 1 may construct a voice chat system by streaming only audio data from each information processing apparatus.
- FIG. 2B shows another example of a movie playback screen displayed on the output device 12.
- a progressively downloaded movie is reproduced and displayed on the screen of the output device 12, and a text chat window 24 for displaying text data input by other users is formed on a part of the screen.
- Each user has a text input device such as a keyboard, and text data input from the text input device is transmitted to information processing devices of other users via the network 14.
- the information processing system 1 may construct a text chat system to realize a virtual movie theater.
- one information processing apparatus serving as the host apparatus 10 causes the network server 20 to generate a virtual room (chat room) for chatting.
- the host user of the host device 10 designates a guest user to be invited to the chat room, and transmits an invitation message from the host device 10 to the information processing device of the guest user.
- a chat system is constructed among the users who enter the chat room.
- FIG. 3 is a sequence diagram showing processing for establishing a chat connection.
- the network server 20 manages the network ID, address information, and user ID of information processing apparatuses participating in the information processing system 1 in association with each other.
- the host device 10 creates a chat room generation request (S10).
- the chat room generation request is transmitted to the network server 20 (S12), and the network server 20 generates a chat room (S14).
- the host device 10 holds a plurality of other user IDs in advance, selects a guest user to be invited to the chat room (S16), and transmits the guest user's user ID and an invitation message to the network server 20 (S18). ).
- the network server 20 specifies the network ID of the guest user's information processing apparatus (client apparatus 18) from the guest user's user ID (S20), and transfers the invitation message to the address associated with the network ID ( S22).
- the client device 18 generates a room entry request indicating consent to the invitation message (S24), and transmits it to the network server 20 (S26).
- the network server 20 permits the guest user to enter the chat room (S28) and transmits the address information of the client device 18 to the host device 10 (S30).
- the host device 10 accesses the client device 18 based on the transmitted address information and establishes a chat connection (S32). Thereby, the host user of the host device 10 and the guest user of the client device 18 can chat.
- the host device 10 can perform a similar process with other information processing devices, so that a plurality of guest users can enter the chat room.
- the address information of all users who entered the chat room is notified to the respective client devices 18, and the host device 10 and each client device 18 transmit stream data or text data to the other entering users. . Thereby, it becomes possible to chat between users who entered the chat room.
- the host device 10 holds address information of all users who have entered the chat room.
- the host device 10 notifies the content distribution server 16 of information specifying content data to be downloaded and address information of all users who have entered the chat room.
- the content distribution server 16 distributes the content data to all the notified addresses. As a result, an environment in which the host device 10 and the client device 18 synchronously reproduce content data is prepared.
- the host device 10 and each client device 18 may transmit information specifying content data for which download is requested together with a connection request to the content distribution server 16.
- the content distribution server 16 distributes the content data to the host device 10 and the client device 18 that have transmitted the connection request. In this manner, an environment in which the host device 10 and the client device 18 reproduce content data in a synchronized manner may be prepared.
- the host device 10 notifies the content distribution server 16 of the address information of all users who have entered the chat room in advance, and the host device 10 and the client device 18 send a connection request to the content distribution server 16.
- information specifying content data for which download is requested may be transmitted.
- the content distribution server 16 determines whether to respond to the connection request transmitted from the host device 10 or the client device 18 based on the address information notified in advance. Specifically, the content distribution server 16 determines that it can respond to the connection request if the address information of the information processing apparatus that has transmitted the connection request exists in a plurality of previously notified address information. Then, the content data may be distributed to the information processing apparatus.
- FIG. 4 shows a configuration of the client device 18 having a content data reproduction processing function.
- the client device 18 includes a reception unit 40, a download status detection unit 60, a storage unit 62, a reproduction processing unit 64, a notification unit 66, a request input unit 68, and a transmission unit 70.
- the receiving unit 40 includes a content data acquisition unit 42, an instruction acquisition unit 44, a clock information acquisition unit 46, and a final frame information acquisition unit 48.
- FIG. 5 shows a configuration of the host device 10 having a content data reproduction processing function and a client device control function.
- the host device 10 includes a reception unit 80, a download status detection unit 100, a storage unit 102, a reproduction processing unit 104, a notification unit 106, a request input unit 108, a transmission unit 110, a download instruction unit 112, and a control unit 120.
- the receiving unit 80 includes a content data acquisition unit 82, a clock information acquisition unit 84, a download status acquisition unit 86, a response acquisition unit 88, and a request acquisition unit 90.
- the control unit 120 includes an echo request generation unit 122, a reproduction instruction generation unit 124, a stop instruction generation unit 126, a fast-forward instruction generation unit 128, a rewind instruction generation unit 130, and a final frame information derivation unit 132.
- each element described as a functional block for performing various processes can be composed of a CPU (Central Processing Unit), a memory, and other LSIs in terms of hardware. Is realized by a program loaded in a memory. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.
- CPU Central Processing Unit
- the host device 10 and the client device 18 may be information processing devices having the same processing function. Therefore, when the information processing apparatus operates as the host apparatus 10, the functional block illustrated in FIG. 5 is constructed in the information processing apparatus, and when the information processing apparatus operates as the client apparatus 18, the functional block illustrated in FIG. Is built.
- the host device 10 of the present embodiment has a content data reproduction processing function in the same way as the client device 18. Specifically, the content data acquisition unit 82, the clock information acquisition unit 84, the download status shown in FIG. Configurations such as the detection unit 100, the storage unit 102, and the reproduction processing unit 104 are in charge of the reproduction processing function.
- the storage unit 62 and the storage unit 102 may be configured by a mass storage device such as a hard disk drive.
- the client device 18 and the host device 10 receive time information based on NTP (Network Time Protocol) at the clock information acquisition unit 46 and the clock information acquisition unit 84, respectively, and time synchronization based on UTC (Universal Time Coordinated) is taken. ing.
- NTP Network Time Protocol
- UTC Universal Time Coordinated
- time synchronization by UTC based on NTP is an example, and the clock information acquisition unit 46 and the clock information acquisition unit 84 may acquire other clock information that can be shared on the network 14 to achieve time synchronization.
- time synchronization in all the devices may be taken with reference to local clock information of any one of the client device 18 and the host device 10.
- the download instruction unit 112 when the host user selects content to be viewed, the download instruction unit 112 generates a download instruction including information for specifying the selected content and address information of the host device 10 and the client device 18 that are the distribution destinations.
- the transmission unit 110 transmits a download instruction to the content distribution server 16.
- this download instruction may be transmitted from each of the information processing apparatuses to the content distribution server 16 together with the connection request.
- the client apparatus 18 includes the download instruction unit 112, A download instruction including information for specifying content is generated, and the transmission unit 70 transmits the download instruction to the content distribution server 16.
- the content distribution server 16 When the content distribution server 16 receives the download instruction, the content distribution server 16 distributes the content data to the host device 10 and the client device 18 based on the content specifying information and the address information included in the download instruction. Thereby, the host device 10 and the client device 18 start downloading content data.
- the content data acquisition unit 42 acquires the downloaded content data and stores it in the storage unit 62.
- the download status detection unit 60 detects the download status of the content data. For example, when the video content data is compressed in the MPEG2 format, the download status detection unit 60 detects the amount of downloaded data, that is, the download size, as the download status.
- the notification unit 66 notifies the detected download status to the host device 10 via the transmission unit 70 at a predetermined cycle.
- the notification cycle by the notification unit 66 may be the same as the detection cycle by the download status detection unit 60, and is set to several seconds, for example.
- the content data acquisition unit 82 acquires the downloaded content data and stores it in the storage unit 102.
- the download status detection unit 100 detects the download status of content data at a predetermined cycle. Similar to the download status detection unit 60, when the video content data is compressed in the MPEG2 format, the download status detection unit 100 detects the amount of downloaded data as the download status.
- the download status detection unit 100 preferably detects the download status at the same timing as the download status detection unit 60. Thereby, in the information processing system 1, the download situation reflecting the communication environment of each information processing apparatus is acquired.
- the download status acquisition unit 86 acquires the download status notified from the client device 18.
- the final frame information deriving unit 132 monitors the download status notified from each client device 18 and the download status detected by the download status detection unit 100, and derives a final frame that can be synchronously reproduced.
- the communication environment in the network 14 is different between the host device 10 and the plurality of client devices 18, and therefore the download speeds are also different.
- the host device 10 and the plurality of client devices 18 In order for the host device 10 and the plurality of client devices 18 to reproduce content data synchronously, it is necessary to match the reproduction processing of the information processing device with the reproduction processing of the information processing device having the worst download status.
- the final frame information deriving unit 132 derives the final frame number reproducible in the client device 18 from the notified download status, and calculates the final frame number reproducible in the host device 10 from the own download status. To derive.
- the last frame number reproducible in the host device 10 is F1
- the last frame number reproducible in the client device 18a is F2
- the last frame number reproducible in the client device 18b is F3
- the last frame number reproducible in the client device 18c Is derived as F4
- the last frame information deriving unit 132 derives the last frame number that can be synchronously reproduced as follows. In the content data, it is assumed that frame numbers are assigned in order of frames to be reproduced.
- (Final frame capable of synchronous reproduction) Min (F1, F2, F3, F4)
- PTS may be used as information for specifying a frame.
- the final frame information deriving unit 132 derives the minimum value of F1 to F4, thereby specifying the final frame that can be synchronously reproduced in the information processing system 1.
- the control unit 120 obtains a round trip time between the client device 18 and the like by using ping in the TCP / IP network, for example, and grasps the line status between the host device 10 and the client device 18. Specifically, the echo request generation unit 122 generates an echo request for the client device 18 to be connected. The transmission unit 110 transmits an echo request to the client device 18, and the response acquisition unit 88 receives an echo response from the client device 18. The control unit 120 derives the propagation delay time between each client device 18 from the transmission time of the echo request and the reception time of the echo response. Using the ping, the control unit 120 can obtain the propagation delay time with the client device 18 having the worst line condition as the maximum propagation delay time.
- the control unit 120 controls the reproduction processing of the host device 10 and the client device 18 to be synchronized based on the download status in the host device 10 and the download status in the client device 18. Specifically, the playback instruction generation unit 124 determines whether content data having a size sufficient for playback by the host device 10 and each client device 18 is downloaded from the final frame number derived by the final frame information deriving unit 132. To do.
- the reproduction instruction generation unit 124 generates a reproduction instruction including the reproduction start time and the reproduction start frame information.
- the times of the host device 10 and the client device 18 are synchronized with respect to a sharable clock, for example, UTC, and the reproduction start time is expressed by the shared clock time.
- the reproduction instruction generation unit 124 sets the reproduction start time by taking into account the maximum propagation delay time between the host device 10 and the client device 18 and the decoding time in each client device 18.
- the reproduction start frame information may be a frame number at which reproduction is started, and is usually frame number 0.
- the notification unit 106 notifies the client device 18 of the generated reproduction instruction via the transmission unit 110.
- the instruction acquisition unit 44 acquires a reproduction instruction.
- the reproduction processing unit 64 refers to the time information supplied from the clock information acquisition unit 46, reads the content data from the storage unit 62 based on the reproduction start time and the reproduction start frame information included in the reproduction instruction, Perform playback processing.
- the reproduction processing unit 104 refers to the time information supplied from the clock information acquisition unit 84, and the reproduction start time and reproduction start included in the reproduction instruction generated by the reproduction instruction generation unit 124. Based on the frame information, the content data is read from the storage unit 102 and the reproduction process is executed.
- the content data acquisition unit 82 and the content data acquisition unit 42 continue to download and acquire content data from the content distribution server 16, respectively.
- the data is stored in the storage unit 62.
- the download status detection unit 100 periodically detects the download status of content data and supplies it to the final frame information deriving unit 132.
- the download status detection unit 60 periodically detects the download status of content data, and the notification unit 66 notifies the host device 10. The notified download status is acquired by the download status acquisition unit 86 and supplied to the final frame information deriving unit 132.
- the final frame information deriving unit 132 periodically derives a final frame that can be synchronously reproduced based on the download statuses of the host device 10 and the client device 18, for example, the download size.
- the notification unit 106 periodically notifies the client device 18 of information for identifying the derived final frame (final frame information) via the transmission unit 110.
- the final frame information acquisition unit 48 acquires the notified final frame information and supplies it to the reproduction processing unit 64.
- the reproduction processing unit 64 has a memory area for holding the last frame information, and stores the supplied last frame information in the memory area. Each time the last frame information is supplied, the reproduction processing unit 64 overwrites and updates the stored last frame information to be stored.
- the reproduction processing unit 104 has a memory area for holding final frame information, and stores the final frame information derived by the final frame information deriving unit 132 in the memory area. Each time the final frame information is derived, the reproduction processing unit 104 overwrites and updates the stored final frame information to be stored.
- the reproduction processing unit 64 and the reproduction processing unit 104 stop the reproduction process when reproducing the frame specified by the held last frame information. Thereby, the reproduction process in all information processing apparatuses is stopped. Therefore, it is possible to avoid a situation in which only one information processing device that cannot download content data sufficiently due to a poor communication environment cannot be played back, and the other information processing devices can continue to play back. it can.
- the stop instruction generating unit 126 In the host device 10, when the reproduction processing unit 104 reproduces the last frame, the stop instruction generating unit 126 generates a reproduction process pause instruction. As described above, in each client device 18, the playback processing unit 64 stops the playback processing after playing back the last frame, but the control unit 120 controls each client device 18 to perform synchronization control of playback processing. Need to manage the status of For this reason, the stop instruction generation unit 126 generates a temporary stop instruction, and the notification unit 106 operates so as to notify the client device 18 of the generated temporary stop instruction via the transmission unit 110. Note that the pause instruction includes playback stop frame information. In this case, the playback stop frame information is information for specifying the last frame.
- the progress of the movie may be freely controlled. For example, you may be thirsty or watch a movie while watching a movie. In such a case, it is preferable that the reproduction process can be paused. In addition, when a touching scene is missed, it is preferable that the scene can be returned to and reproduced. Under such circumstances, the host device 10 and the client device 18 have a request input unit 108 and a request input unit 68, respectively, so that a user can input a request regarding reproduction processing. The request input from the request input unit 68 is notified from the notification unit 66 to the host device 10 via the transmission unit 70.
- the request acquisition unit 90 acquires a request for reproduction from the client device 18 and supplies the request to the control unit 120.
- a request regarding reproduction from the client device 18 may be supplied to the control unit 120 after the host device 10 receives permission from the host user.
- a request regarding reproduction input from the request input unit 108 by the host user is supplied to the control unit 120.
- Requests related to playback include a playback request from a specific frame (target frame), a pause request, a fast forward playback request, and a rewind playback request.
- the stop instruction generating unit 126 When receiving the pause request, the stop instruction generating unit 126 generates a stop instruction including the playback stop frame information.
- the notification unit 106 notifies the client device 18 of the generated stop instruction via the transmission unit 110.
- the fast-forward instruction generating unit 128 generates a fast-forward reproduction instruction from the target frame when TPD ⁇ PFC is satisfied.
- the fast-forward instruction generating unit 128 generates a fast-forward instruction including a fast-forward playback start time, fast-forward playback start frame information, and information for specifying a fast-forward playback speed.
- the information specifying the fast-forward playback speed may be (fast-forward playback speed / playback speed).
- the frame number for starting fast-forward playback is determined in consideration of the time required for the fast-forward instruction generating unit 128 to generate a fast-forward instruction.
- the notification unit 106 notifies the client device 18 of the generated fast-forward instruction via the transmission unit 110.
- the rewind instruction generating unit 130 When receiving the rewind playback request, the rewind instruction generating unit 130 generates a rewind instruction. Specifically, the rewind instruction generating unit 130 generates a rewind instruction including a rewind playback start time, rewind playback start frame information, and information for specifying a rewind playback speed. The information specifying the rewind playback speed may be (rewind playback speed / playback speed). The frame number for starting the rewind playback is determined in consideration of the time required for the rewind instruction generating unit 130 to generate the rewind instruction.
- the notification unit 106 notifies the client device 18 of the generated rewind instruction via the transmission unit 110.
- the rewind instruction generation unit 130 determines whether the number of frames from the first frame of the downloaded content data to the current frame is sufficient for rewind playback.
- PFC current frame number ⁇ first frame number
- TPD Trick Play Determinant
- PBD x rewind playback speed / playback speed
- the host device 10 controls so-called trick play based on the final frame number specified from the download status in the plurality of information processing devices. This makes it possible to synchronize the playback processes of a plurality of information processing apparatuses, and all users can enjoy a movie in the same environment.
- FIG. 6 is a sequence diagram in which the host device 10 controls the synchronized playback process with the client device 18.
- the host device 10 and the client device 18 start downloading content data (S40, S42). After the download is started, the download status detection unit 100 and the download status detection unit 60 periodically detect the download status of the content data, respectively (S44, S46).
- the notification unit 66 notifies the host device 10 of the download status detected by the download status detection unit 60 (S48).
- the final frame information deriving unit 132 derives a final frame that can be synchronously reproduced based on the notified download status and the download status detected by the download status detecting unit 100 (S50).
- the reproduction processing unit 104 stores the last frame information in the memory area (S54).
- the notification unit 106 of the host device 10 notifies the client device 18 of the final frame information (S52), and the reproduction processing unit 64 stores the final frame information in the memory area (S56).
- the reproduction instruction generating unit 124 sets the data amount sufficient for reproducing the downloaded content data based on the final frame information. It is determined whether it has reached (S62). If the data amount has not reached a sufficient amount, the reproduction instruction generation unit 124 determines that the content data cannot be reproduced (N in S62). In addition, since a reproduction instruction is not generated, the instruction acquisition unit 44 does not acquire a reproduction instruction in the client device 18 (N in S66).
- the host device 10 re-executes the processing of S44, S50, S52, and S54, and the client device 18 re-executes the processing of S46, S48, and S56, so that the final frame information is set to the same latest value. Updated.
- the reproduction instruction generation unit 124 determines that the content data can be reproduced (Y in S62), generates a reproduction instruction, and notifies the notification unit 106 notifies the reproduction instruction to the client device 18 (S64).
- the instruction acquisition unit 44 acquires the reproduction instruction (Y in S66), and the reproduction processing unit 104 and the reproduction processing unit 64 start the content data reproduction process according to the reproduction start time and the reproduction start frame information included in the reproduction instruction. (S68, S70).
- the host device 10 re-executes the processing of S44, S50, S52, and S54.
- the client device 18 re-executes the processes of S46, S48, and S56, and the respective last frame information is updated.
- the reproduction processing unit 104 and the reproduction processing unit 64 reproduce the last frame (Y in S72, Y in S74)
- the respective reproduction processes are stopped (S76, S78).
- the playback instruction generation unit 124 establishes PBD ⁇ PFC. If it is established, a reproduction instruction from the target frame is generated. The reproduction instruction is notified to the client device 18, and the reproduction processing unit 104 and the reproduction processing unit 64 execute content data reproduction processing according to the reproduction start time and the reproduction start frame information included in the reproduction instruction.
- the stop instruction generation unit 126 when the host device 10 receives a pause request during the content data reproduction process, the stop instruction generation unit 126 generates a stop instruction.
- the stop instruction is notified to the client device 18, and the playback processing unit 104 and the playback processing unit 64 pause the content data playback process according to the playback stop frame information included in the stop command.
- the fast-forward instruction generating unit 128 determines whether TPD ⁇ PFC is satisfied. If it is established, a fast-forward playback instruction from the target frame is generated. The fast-forward playback instruction is notified to the client device 18, and the playback processing unit 104 and the playback processing unit 64 follow the fast-forward playback start time, fast-forward playback start frame information, and information specifying the fast-forward playback speed included in the fast-forward playback instruction. Then, fast-forward playback processing of content data is executed.
- the rewind instruction generating unit 130 when the host device 10 receives the rewind playback request, the rewind instruction generating unit 130 generates a rewind playback instruction from the target frame.
- the rewind playback instruction is notified to the client device 18, and the playback processing unit 104 and the playback processing unit 64 specify the rewind playback start time, the rewind playback start frame information, and the rewind playback speed included in the rewind playback instruction.
- Content data rewind playback processing is executed in accordance with the information to be performed.
- the final frame information deriving unit 132 specifies the final frame that can be synchronously reproduced. However, for example, instead of directly specifying the final frame number, the final frame information may be indirectly specified. Good.
- the final frame information deriving unit 132 may derive information for specifying a GOP (Group Of Pictures) including the final frame, or may derive information for specifying a playback time from the first frame at the start of playback. Good.
- the final frame information deriving unit 132 may specify a frame just before the final frame.
- the final frame information deriving unit 132 derives the final frame from the downloaded data amount, for example, a frame several seconds before may be identified from the derived final frame and may be derived as the final frame.
- the derivation error of the final frame can be absorbed, and synchronized reproduction in a plurality of information processing apparatuses can be ensured. If such correction is not performed, the reproduction processing unit 104 and the reproduction processing unit 64 may stop the reproduction process slightly before the last frame.
- the client device 18 that has downloaded the content data executes the content data reproduction process.
- the client device 18 may transfer the downloaded content data to another client device, and the transfer destination client device may execute the content data reproduction process.
- the client device of the transfer destination is a mobile terminal device, and the user can enjoy content data even when outside.
- the client device 18 and the transfer destination client device are not different from one client device when viewed from the host device 10, and in this specification, the client device 18 and the transfer destination client device cooperate with each other.
- One client device is configured.
- the transfer destination client device has at least the configuration of the content data acquisition unit 42, the clock information acquisition unit 46, the reproduction processing unit 64, and the request input unit 68 shown in FIG.
- the transfer destination client device is referred to as a “portable terminal device”.
- the control unit 120 of the host device 10 uses the ping to obtain the round trip time between the client device 18 and the line between the host device 10 and the client device 18. I grasped the situation. This is based on the premise that the client device 18 executes content data reproduction processing. When the portable terminal device reproduces content data as in the modification, the portable terminal device and the host device 10 It is necessary to find the round trip time between Accordingly, the client device 18 includes a control unit having functions of an echo request generation unit and a response acquisition unit illustrated in FIG. 5 in addition to the configuration illustrated in FIG.
- the echo request generation unit generates an echo request for the mobile terminal device.
- the transmission unit 70 transmits an echo request to the mobile terminal device, and the response acquisition unit receives an echo response from the mobile terminal device.
- the control unit derives a propagation delay time with the connected mobile terminal device from the transmission time of the echo request and the reception time of the echo response. This propagation delay time is sent from the transmission unit 70 to the host device 10.
- the control unit 120 adds the propagation delay time between the host device 10 and the client device 18 and the propagation delay time between the client device 18 and the mobile terminal device, so that the host device 10 The propagation delay time with the portable terminal device is derived.
- the control unit 120 can determine the propagation delay time with the client device having the worst line condition as the maximum propagation delay time, taking into account the presence of the mobile terminal device.
- the host device 10 and the client device 18 acquire AV data such as a movie from the content distribution server 16 by the progressive download method.
- the progressive download method when the communication environment in the network 14 is not significantly different between the information processing devices of the host device 10 and the plurality of client devices 18, it is assumed that the download status of each information processing device is not significantly different.
- each information processing apparatus downloads AV data from the content distribution server 16 in the client server model, the load is concentrated on the content distribution server 16, and the communication environment in the network 14 is actually different in each information processing apparatus. Since they are often different, there may be a difference in the download status of each information processing apparatus.
- the information processing apparatus can acquire content data from a plurality of terminal devices connected to the network 14 without being greatly affected by the communication environment. Therefore, the download method has an aspect superior to the client server model. Yes.
- FIG. 7 shows a conceptual diagram of the download state of content data.
- the downloaded content data is hatched.
- a file offset (hereinafter also simply referred to as “offset”) is used in order to specify the download status of the content data.
- the offset indicates the position from the beginning of the content data file.
- Fig. 7 (a) shows the download status when the content data is progressively downloaded.
- content data with offsets b1 to b2 is downloaded.
- the content data is downloaded from the beginning of the file, so the offset b1 is always zero. Therefore, the final frame information deriving unit 132 of the host device 10 in the embodiment may derive a final frame that can be synchronously reproduced from the download status of each information processing apparatus.
- FIG. 7B shows a download situation when content data is downloaded by the P2P method.
- content data from offsets b1 to b2, offsets b3 to b4, and offsets b5 to b_end are downloaded.
- content data is transmitted in pieces from a plurality of terminal devices via the network 14.
- the client device 18 obtains in advance an index file in which index information of content data is recorded, for example, from the content distribution server 16 before starting the download.
- an example of content data compressed in the MPEG2 format will be described.
- the index file includes a header area and an index data area.
- information indicating the entire configuration of the content data such as the first PTS, the final PTS of the content data, and the size of the moving image file is recorded.
- index data area In the index data area, PTS, file offset, and transport stream (TS) packet length information for each I frame are recorded.
- the download status detection unit 60 of the client device 18 and the download status detection unit 100 of the host device 10 detect information related to the downloaded data frame as the download status.
- the notification unit 66 notifies the host device 10 of the detected download status.
- the download status detection units 60 and 100 acquire the offset included in the TS packet and detect the offset information of the downloaded content data. Each of the download status detection units 60 and 100 detects the downloaded offset information as the download status of the content data, and specifies the offset information of the content data that has not been downloaded yet.
- the transmission unit 70 in the client device 18 uses the content data.
- a download request is transmitted to the terminal device holding This download request is transmitted until the content data acquisition unit 42 acquires all data files from the first PTS to the final PTS included in the index file. The above processing is the same in the host device 10.
- the content data acquisition unit 42 acquires the downloaded content data and stores it in the storage unit 62.
- the download status detector 60 detects the downloaded offset information as the download status.
- the notification unit 66 notifies the detected download status to the host device 10 via the transmission unit 70 at a predetermined cycle.
- the notified offset information is information indicating that the content data from the offsets b1 to b2, the offsets b3 to b4, and the offsets b5 to b_end have been downloaded.
- the content data acquisition unit 82 acquires the downloaded content data and stores it in the storage unit 102.
- the download status detection unit 100 detects the downloaded offset information as a download status.
- the download status detection unit 100 preferably detects the download status at the same timing as the download status detection unit 60.
- the download status acquisition unit 86 acquires the download status notified from the client device 18.
- the host device 10 when downloading in the P2P method is performed, the host device 10 includes a synchronously reproducible frame information deriving unit instead of the final frame information deriving unit 132.
- the synchronously reproducible frame information deriving unit derives frame information reproducible in each information processing device from the download status in each information processing device.
- MPEG2 playback is possible from an I frame
- a synchronously playable frame information deriving unit derives a frame range that can be continuously played back by each information processing device from offset information indicating that the information processing device has already been downloaded. .
- the offset information indicates that the content data from the offset b1 to b2, the offset b3 to b4, and the offset b5 to b_end has been downloaded.
- the index data area of the index file includes PTS, file offset, and TS packet length information for all I frames included in the moving image file. In the following description, it is assumed that the file offset of the I frame is a and the length information is l.
- FIG. 8A is an explanatory diagram for explaining a moving image file of content data.
- FIG. 8A shows an encoded stream composed of transport stream (TS) packets in MPEG2.
- the moving image file includes image information of I frame, P frame, and B frame.
- FIG. 8A shows TS packets of I frame related to the index file shown in FIG.
- the I frame is specified by an offset a and a TS packet length l.
- One TS packet basically has a fixed length (bytes), and the TS packet length l is set according to the number of TS packets constituting the I frame. Note that the TS packet includes information for specifying the offset a.
- FIG. 8B is an explanatory diagram for explaining the index file.
- the index data area includes PTS, offset, and length information of each I frame.
- index information of I frames included in the moving image file shown in FIG. 8A is recorded.
- the synchronously reproducible frame information deriving unit derives the largest offset a_max among the offsets of the I frame in which the value obtained by adding the length l to the offset a is b2 or less with reference to the index information. That is, the maximum offset a_max that satisfies a + l ⁇ b2 is derived.
- the synchronously reproducible frame information deriving unit derives reproducible offsets a_min to a_max for content data from offsets b3 to b4 and offsets b5 to b_end, respectively.
- the synchronously reproducible frame information deriving unit derives a reproducible frame range by converting the reproducible offset range into frame information. Thereby, the reproducible frame range is derived from the offset information shown in FIG. This frame information may be expressed in PTS.
- the synchronously reproducible frame information deriving unit derives a reproducible frame range in each client device 18 based on the download status notified from all the client devices 18.
- the synchronously reproducible frame information deriving unit derives a frame range reproducible in the host device 10 from its own download status.
- the synchronous reproducible frame information deriving unit derives an overlapping frame range from the reproducible frame range in each information processing apparatus.
- This overlapping frame range becomes frame information that can be synchronously reproduced in a plurality of information processing apparatuses.
- the notification unit 106 periodically notifies the client device 18 of the derived frame information via the transmission unit 110.
- the client device 18 updates the notified frame information.
- synchronous reproduction can be performed by deriving frame information that can be synchronously reproduced by a plurality of information processing apparatuses from the download status of each information processing apparatus.
- the control unit 120 generates an instruction such as a reproduction instruction based on the frame range in which synchronous reproduction is possible.
- the frame range in which synchronous playback is possible is the same as the range from frame number 0 to the last frame number in the embodiment. Etc. can be realized.
- the playback processing unit 64 and the playback processing unit 104 stop the playback process when playing back the last frame specified in the synchronously playable frame range in response to the playback instruction including the playback start time and the playback start frame information. To do. Thereby, the reproduction process in all information processing apparatuses is stopped.
- the P2P method includes a method of downloading content data from a plurality of content distribution servers 16, and a content from a plurality of content distribution servers 16 and a plurality of terminal devices.
- a method of downloading data is also feasible.
- the P2P method includes all methods of collecting partial content data from each of a plurality of devices including a terminal device and a server.
- the content data to be downloaded differs depending on the display resolution (HD, SD) of the output device 12.
- a CM is inserted in front of the movie in the high-resolution content data, but is not inserted in the low-resolution content data.
- the host device 10 grasps the first frame number of the high-resolution and low-resolution movie data, and corrects the frame number according to the downloaded data, thereby synchronizing the display image between the information processing devices. It becomes possible to make it.
- the synchronously reproducible frame information deriving unit in the host device 10 holds an HD index file and an SD index file.
- the header area of the index file describes information related to the CM, specifically information indicating the CM insertion period.
- the head frame number of movie data for example, can be specified by PTS in HD and SD video files. Therefore, by recognizing the head frame number of HD and SD movie data, the synchronously reproducible frame information deriving unit can derive the frame information that can be synchronously reproduced in each information processing apparatus. Movie data can be played back synchronously.
- SYMBOLS 1 Information processing system, 10 ... Host device, 12 ... Output device, 14 ... Network, 16 ... Content distribution server, 18 ... Client device, 20 ... Network server, 22 ... Video chat window, 24 ... Text chat window, 40 ... Receiving unit, 42 ... Content data acquisition unit, 44 ... Instruction acquisition unit, 46 ... Clock information acquisition unit, 48 ... last frame information acquisition unit, 60 ... download status detection unit, 62 ... storage unit, 64 ... reproduction processing unit, 66 ... notification unit, 68 ... request input unit, 70 ..Transmission unit, 80... Reception unit, 82 .. content data acquisition unit, 84... Clock information acquisition unit, 86... Download status acquisition unit, 88.
- ... request acquisition unit 100 ... download status detection unit, 102 ... storage unit, 104 ... reproduction processing unit, 106 ... notification unit, 108 ... request input unit, 110 ... Transmission unit 112 ... Download instruction unit 120 ... Control unit 122 ... Echo request generation unit 124 ... Playback instruction generation unit 126 ... Stop instruction generation unit 128 ... Fast forward Instruction generating unit, 130... Rewinding instruction generating unit, 132.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
(同期再生可能な最終フレーム)=Min(F1,F2,F3,F4)
たとえばコンテンツデータがMPEG2形式で圧縮されている場合には、フレームを特定する情報としてPTSが利用されてもよい。このように、最終フレーム情報導出部132は、F1~F4の最小値を導出することで、情報処理システム1において同期再生可能な最終フレームを特定する。
PFC(Playable Frame Count)=最終フレーム番号
とし、プログレッシブダウンロード時に同時再生するのに十分なストックであると考えられるフレーム数をPBD(Playable Back Determinant)としたとき、再生指示生成部124は、PBD<PFCが成立する場合に、ホスト装置10およびクライアント装置18での再生処理の開始を決定する。たとえばPBDは、再生時間1分を確保できるフレーム数として設定されてもよい。
PFC=最終フレーム番号-ターゲットフレーム番号
とし、プログレッシブダウンロード時に同時再生するのに十分なストックであると考えられるフレーム数をPBDとしたとき、再生指示生成部124は、PBD<PFCが成立する場合に、ターゲットフレームからの再生指示を生成する。このとき再生指示生成部124は、再生開始時刻と、ターゲットフレーム情報とを含めた再生指示を生成する。通知部106は、生成された再生指示を送信部110を介してクライアント装置18に通知する。
PFC=最終フレーム番号-現在フレーム番号
であり、早送り再生するのに十分なフレーム数であると考えられるフレーム数は、
TPD(Trick Play Determinant)=PBD×(早送り再生速度/再生速度)
となる。
早送り指示生成部128は、TPD<PFCが成立する場合に、ターゲットフレームからの早送り再生指示を生成する。具体的に早送り指示生成部128は、早送り再生開始時刻と、早送り再生開始フレーム情報と、早送り再生速度を特定する情報とを含めた早送り指示を生成する。早送り再生速度を特定する情報は、(早送り再生速度/再生速度)であってよい。早送り再生を開始するフレーム番号は、早送り指示生成部128が早送り指示を生成するまでに要する時間を加味して決定される。通知部106は、生成された早送り指示を送信部110を介してクライアント装置18に通知する。
PFC=現在フレーム番号-最初のフレーム番号
であり、巻戻し再生するのに十分なフレーム数であると考えられるフレーム数は、
TPD(Trick Play Determinant)=PBD×(巻戻し再生速度/再生速度)
となる。
巻戻し指示生成部130は、TPD<PFCが成立する場合に、ターゲットフレームからの巻戻し再生指示を生成する。
Claims (12)
- コンテンツ配信サーバとホスト装置と1つ以上のクライアント装置とがネットワークで接続された情報処理システムであって、
前記クライアント装置は、
前記コンテンツ配信サーバからダウンロードしたコンテンツデータを記憶する第1記憶部と、
前記第1記憶部に記憶されたコンテンツデータを再生する第1処理部と、
コンテンツデータのダウンロード状況を検出する第1検出部と、
検出したダウンロード状況を前記ホスト装置に通知する第1通知部と、
を備え、
前記ホスト装置は、
前記クライアント装置から通知されたダウンロード状況を取得する取得部と、
通知されたダウンロード状況をもとに、クライアント装置の再生処理を制御する制御部と、
を備えることを特徴とする情報処理システム。 - 前記ホスト装置は、
前記コンテンツ配信サーバからダウンロードしたコンテンツデータを記憶する第2記憶部と、
前記第2記憶部に記憶されたコンテンツデータを再生する第2処理部と、
コンテンツデータのダウンロード状況を検出する第2検出部と、をさらに備え、
前記制御部は、前記第1処理部および前記第2処理部による再生処理を同期させることを特徴とする請求項1に記載の情報処理システム。 - 前記第1通知部は、ダウンロード済みのデータ量を、ダウンロード状況として前記ホスト装置に通知し、
前記制御部は、
通知されたデータ量をもとに、同期再生可能な最終フレームを特定する導出部を有し、
前記ホスト装置は、
最終フレーム情報を前記クライアント装置に通知する第2通知部をさらに備えることを特徴とする請求項1または2に記載の情報処理システム。 - 前記第1処理部は、前記第2通知部より通知される最終フレーム情報で特定されるフレームを再生すると、再生処理を停止することを特徴とする請求項3に記載の情報処理システム。
- 前記第1処理部は、前記第2通知部から通知された最終フレーム情報を取得すると、保持している最終フレーム情報を更新することを特徴とする請求項3または4に記載の情報処理システム。
- 前記第1通知部は、ダウンロード済みのデータのフレームに関する情報を、ダウンロード状況として前記ホスト装置に通知し、
前記制御部は、
通知された前記フレームに関する情報をもとに、同期再生可能なフレームを特定する導出部を有し、
前記ホスト装置は、
同期再生可能なフレームを特定するフレーム情報を、前記クライアント装置に通知する第2通知部をさらに備えることを特徴とする請求項1または2に記載の情報処理システム。 - 前記第1処理部は、前記第2通知部より通知されるフレーム情報で特定される最終フレームを再生すると、再生処理を停止することを特徴とする請求項6に記載の情報処理システム。
- 前記第1処理部は、前記第2通知部から通知されたフレーム情報を取得すると、保持しているフレーム情報を更新することを特徴とする請求項6または7に記載の情報処理システム。
- 前記第1通知部は、所定の周期でダウンロード状況を前記ホスト装置に通知することを特徴とする請求項1から8のいずれかに記載の情報処理システム。
- コンテンツ配信サーバからダウンロードしたコンテンツデータを記憶する記憶部と、
前記記憶部に記憶されたコンテンツデータを再生する処理部と、
コンテンツデータのダウンロード状況を検出する検出部と、
検出したダウンロード状況をホスト装置に通知する通知部と、を備えた情報処理装置であって、
前記処理部は、ホスト装置から通知される最終フレーム情報で特定されるフレームを再生すると、再生処理を停止することを特徴とする情報処理装置。 - コンピュータに、
記憶部にダウンロードされたコンテンツデータを再生する機能と、
コンテンツデータのダウンロード状況を検出する機能と、
検出したダウンロード状況をホスト装置に通知する機能とを実現させるためのプログラムであって、
コンテンツデータの再生機能は、ホスト装置から通知される最終フレーム情報で特定されるフレームを再生すると、再生処理を停止することを特徴とするプログラム。 - 請求項11に記載のプログラムを記録したコンピュータ読み取り可能な記録媒体。
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020117006432A KR101277511B1 (ko) | 2008-08-29 | 2009-08-06 | 정보처리시스템 및 정보처리장치 |
| CN2009801329600A CN102132575B (zh) | 2008-08-29 | 2009-08-06 | 信息处理系统及信息处理装置 |
| EP09809485.7A EP2328349B1 (en) | 2008-08-29 | 2009-08-06 | Information processing system and information processing device |
| US13/060,369 US9485467B2 (en) | 2008-08-29 | 2009-08-06 | Information processing system and information processing devices |
| JP2010526515A JP5230744B2 (ja) | 2008-08-29 | 2009-08-06 | 情報処理システムおよび情報処理装置 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2008222446 | 2008-08-29 | ||
| JP2008-222446 | 2008-08-29 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2010023828A1 true WO2010023828A1 (ja) | 2010-03-04 |
Family
ID=41721013
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2009/003781 Ceased WO2010023828A1 (ja) | 2008-08-29 | 2009-08-06 | 情報処理システムおよび情報処理装置 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US9485467B2 (ja) |
| EP (1) | EP2328349B1 (ja) |
| JP (1) | JP5230744B2 (ja) |
| KR (1) | KR101277511B1 (ja) |
| CN (1) | CN102132575B (ja) |
| WO (1) | WO2010023828A1 (ja) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012147225A (ja) * | 2011-01-12 | 2012-08-02 | Seiko Epson Corp | プロジェクター、プロジェクターシステム、プロジェクターのデータ出力方法およびプロジェクターシステムのデータ出力方法 |
| US20120249415A1 (en) * | 2011-03-29 | 2012-10-04 | Fujitsu Limited | Server, terminal device, and grouping method |
| JPWO2012169175A1 (ja) * | 2011-06-09 | 2015-02-23 | パナソニック株式会社 | 通信端末、通信制御方法及びプログラム |
| US8963802B2 (en) | 2010-03-26 | 2015-02-24 | Seiko Epson Corporation | Projector, projector system, data output method of projector, and data output method of projector system |
| JP2015521431A (ja) * | 2012-05-17 | 2015-07-27 | 華為技術有限公司Huawei Technologies Co.,Ltd. | マルチスクリーン・インタラクション方法及びシステム |
| JP2015142380A (ja) * | 2014-01-28 | 2015-08-03 | ▲ホア▼▲ウェイ▼技術有限公司 | 複数のスマート・デバイスによる同期再生のための方法、および装置 |
| JP2015216679A (ja) * | 2010-08-13 | 2015-12-03 | ネットフリックス・インコーポレイテッドNetflix, Inc. | ストリーミングデジタルコンテンツの同期再生システム及び方法 |
| US9438876B2 (en) | 2010-09-17 | 2016-09-06 | Thomson Licensing | Method for semantics based trick mode play in video system |
| US9866922B2 (en) | 2010-03-31 | 2018-01-09 | Thomson Licensing | Trick playback of video data |
| JP2018530944A (ja) * | 2015-09-30 | 2018-10-18 | アップル インコーポレイテッドApple Inc. | 異種ネットワーキング環境におけるメディアレンダリングの同期化 |
| JP2018182761A (ja) * | 2015-04-24 | 2018-11-15 | マーシブ テクノロジーズ,インコーポレイティド | 分散メディアの相互作用かつリアルタイムの可視化のためのシステムおよび方法 |
| JP2022536387A (ja) * | 2019-09-04 | 2022-08-15 | 北京字節跳動網絡技術有限公司 | ビデオデータの処理方法、装置、電子機器およびコンピュータ可読媒体 |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SG171495A1 (en) * | 2009-12-01 | 2011-06-29 | Creative Tech Ltd | Methods and systems for consuming media content among a group of at least two entities |
| CN104205860B (zh) * | 2012-04-04 | 2017-09-26 | 三菱电机株式会社 | 数字数据发布装置和方法、数字数据再现装置和方法以及同步再现系统 |
| US11861561B2 (en) | 2013-02-04 | 2024-01-02 | Haworth, Inc. | Collaboration system including a spatial event map |
| US9467486B2 (en) * | 2013-03-15 | 2016-10-11 | Samsung Electronics Co., Ltd. | Capturing and analyzing user activity during a multi-user video chat session |
| US9992261B2 (en) * | 2014-03-13 | 2018-06-05 | Canon Information And Imaging Solutions, Inc. | System and method for forwarding a file |
| EP3132613A1 (en) * | 2014-04-15 | 2017-02-22 | Telefonaktiebolaget LM Ericsson (publ) | Synchronised social tv |
| US10097874B2 (en) | 2014-06-27 | 2018-10-09 | Qualcomm Incorporated | System and method for monitoring media stream buffers of media output devices in order to synchronize media content output |
| CN104867513B (zh) * | 2015-04-20 | 2017-09-29 | 广东欧珀移动通信有限公司 | 一种播放控制方法及设备 |
| JP2018524661A (ja) | 2015-05-06 | 2018-08-30 | ハワース, インコーポレイテッドHaworth, Inc. | 共同システムにおける仮想作業空間ビューポート・フォロー・モード |
| JP6751919B2 (ja) * | 2016-04-07 | 2020-09-09 | 国立大学法人 鹿児島大学 | ソーシャルメディアシステム及びプログラム |
| US10887387B2 (en) | 2018-01-05 | 2021-01-05 | Barrett Adams | Digital media synchronization system and method |
| EP3509312B1 (en) * | 2018-01-08 | 2023-06-07 | MySyncster Holding OÜ | System for real-time synchronization |
| WO2021031598A1 (zh) * | 2019-08-18 | 2021-02-25 | 海信视像科技股份有限公司 | 视频聊天窗口位置的自适应调整方法及显示设备 |
| US11178446B2 (en) * | 2020-03-09 | 2021-11-16 | Haworth, Inc. | Synchronous video content collaboration across multiple clients in a distributed collaboration system |
| US11784840B2 (en) | 2021-12-20 | 2023-10-10 | Zoom Video Communications, Inc. | Receiving data for presentation during a conference |
| US11848975B2 (en) | 2021-12-20 | 2023-12-19 | Zoom Video Communications, Inc. | United states sharing data for presentation during a conference |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002218277A (ja) * | 2001-01-22 | 2002-08-02 | Nec Corp | 情報再生方法及び情報再生システム。 |
| JP2005244605A (ja) * | 2004-02-26 | 2005-09-08 | Nippon Telegr & Teleph Corp <Ntt> | ストリーミングコンテンツ配信制御システム、プログラム及び該プログラムを格納した記録媒体 |
| JP2006235897A (ja) * | 2005-02-24 | 2006-09-07 | Sony Corp | 情報処理システム、再生端末装置および再生方法、情報処理装置および方法、並びにプログラム |
| JP2007104193A (ja) * | 2005-10-03 | 2007-04-19 | Nec Corp | 映像配信システム、映像配信方法および映像同期共有装置 |
| JP2007257820A (ja) * | 1997-04-15 | 2007-10-04 | Gracenote Inc | 音声記録物を補足する対話型エンターテイメントのネットワーク配信 |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6005600A (en) | 1996-10-18 | 1999-12-21 | Silcon Graphics, Inc. | High-performance player for distributed, time-based media |
| SG64486A1 (en) * | 1997-03-27 | 1999-04-27 | Sony Corp | Method and apparatus for information processing computer readable medium and authoring system |
| JP2002175194A (ja) * | 2000-12-07 | 2002-06-21 | Ricoh Co Ltd | プログラムダウンロードシステム、プログラムダウンロード装置、画像形成装置、プログラムダウンロード方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体 |
| CN1860455B (zh) * | 2003-09-30 | 2010-09-22 | 索尼株式会社 | 内容获取方法 |
| ITMI20042074A1 (it) * | 2004-10-29 | 2005-01-29 | St Microelectronics Srl | Amplificatore di lettura in corrente per applicazioni a bassa tensione con sensing diretto sulla bitline di una matrice di memoria |
| US8230456B2 (en) * | 2005-01-05 | 2012-07-24 | Yahoo! Inc. | Framework for delivering a plurality of content and providing for interaction with the same in a television environment |
| US8219493B2 (en) * | 2005-06-10 | 2012-07-10 | Aniruddha Gupte | Messaging method and apparatus for use in digital distribution systems |
| US8832760B2 (en) * | 2006-03-17 | 2014-09-09 | Sony Corporation | System and method for organizing group content presentations and group communications during the same |
| US20080133767A1 (en) * | 2006-11-22 | 2008-06-05 | Metis Enterprise Technologies Llc | Real-time multicast peer-to-peer video streaming platform |
| US7797633B2 (en) * | 2007-01-08 | 2010-09-14 | Apple Inc. | Streaming to media device during acquisition with random access |
| JP5061829B2 (ja) * | 2007-10-04 | 2012-10-31 | ソニー株式会社 | コンテンツ提供装置、およびデータ処理方法、並びにコンピュータ・プログラム |
| EP2232812B1 (en) | 2007-12-05 | 2018-02-21 | Koninklijke KPN N.V. | Method and system for synchronizing the output of terminals |
| EP2068528A1 (en) | 2007-12-05 | 2009-06-10 | Koninklijke KPN N.V. | Method and system for synchronizing the output of end-terminals |
| CN101990661B (zh) * | 2007-12-28 | 2013-11-06 | 松下电器产业株式会社 | 通信装置、通信系统、图像提示方法以及程序 |
| US8190683B2 (en) * | 2008-02-29 | 2012-05-29 | Microsoft Corporation | Synchronizing multiple user remote content playback |
| JP5222662B2 (ja) * | 2008-08-22 | 2013-06-26 | 株式会社日立製作所 | コンテンツ制御システム |
-
2009
- 2009-08-06 CN CN2009801329600A patent/CN102132575B/zh active Active
- 2009-08-06 JP JP2010526515A patent/JP5230744B2/ja active Active
- 2009-08-06 KR KR1020117006432A patent/KR101277511B1/ko active Active
- 2009-08-06 US US13/060,369 patent/US9485467B2/en active Active
- 2009-08-06 EP EP09809485.7A patent/EP2328349B1/en active Active
- 2009-08-06 WO PCT/JP2009/003781 patent/WO2010023828A1/ja not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007257820A (ja) * | 1997-04-15 | 2007-10-04 | Gracenote Inc | 音声記録物を補足する対話型エンターテイメントのネットワーク配信 |
| JP2002218277A (ja) * | 2001-01-22 | 2002-08-02 | Nec Corp | 情報再生方法及び情報再生システム。 |
| JP2005244605A (ja) * | 2004-02-26 | 2005-09-08 | Nippon Telegr & Teleph Corp <Ntt> | ストリーミングコンテンツ配信制御システム、プログラム及び該プログラムを格納した記録媒体 |
| JP2006235897A (ja) * | 2005-02-24 | 2006-09-07 | Sony Corp | 情報処理システム、再生端末装置および再生方法、情報処理装置および方法、並びにプログラム |
| JP2007104193A (ja) * | 2005-10-03 | 2007-04-19 | Nec Corp | 映像配信システム、映像配信方法および映像同期共有装置 |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8963802B2 (en) | 2010-03-26 | 2015-02-24 | Seiko Epson Corporation | Projector, projector system, data output method of projector, and data output method of projector system |
| US9866922B2 (en) | 2010-03-31 | 2018-01-09 | Thomson Licensing | Trick playback of video data |
| US11418853B2 (en) | 2010-03-31 | 2022-08-16 | Interdigital Madison Patent Holdings, Sas | Trick playback of video data |
| JP2015216679A (ja) * | 2010-08-13 | 2015-12-03 | ネットフリックス・インコーポレイテッドNetflix, Inc. | ストリーミングデジタルコンテンツの同期再生システム及び方法 |
| US9438876B2 (en) | 2010-09-17 | 2016-09-06 | Thomson Licensing | Method for semantics based trick mode play in video system |
| JP2012147225A (ja) * | 2011-01-12 | 2012-08-02 | Seiko Epson Corp | プロジェクター、プロジェクターシステム、プロジェクターのデータ出力方法およびプロジェクターシステムのデータ出力方法 |
| US20120249415A1 (en) * | 2011-03-29 | 2012-10-04 | Fujitsu Limited | Server, terminal device, and grouping method |
| JPWO2012169175A1 (ja) * | 2011-06-09 | 2015-02-23 | パナソニック株式会社 | 通信端末、通信制御方法及びプログラム |
| US9456034B2 (en) | 2011-06-09 | 2016-09-27 | Panasonic Intellectual Property Management Co., Ltd. | Communication terminal, communication control method, and program |
| JP2015521431A (ja) * | 2012-05-17 | 2015-07-27 | 華為技術有限公司Huawei Technologies Co.,Ltd. | マルチスクリーン・インタラクション方法及びシステム |
| JP2016226016A (ja) * | 2012-05-17 | 2016-12-28 | 華為技術有限公司Huawei Technologies Co.,Ltd. | マルチスクリーン・インタラクション方法及びシステム |
| US9538237B2 (en) | 2012-05-17 | 2017-01-03 | Huawei Technologies Co., Ltd. | Multi-screen interaction method and system |
| US9973812B2 (en) | 2012-05-17 | 2018-05-15 | Huawei Technologies Co., Ltd. | Multi-screen interaction method and system |
| JP2015142380A (ja) * | 2014-01-28 | 2015-08-03 | ▲ホア▼▲ウェイ▼技術有限公司 | 複数のスマート・デバイスによる同期再生のための方法、および装置 |
| US10298901B2 (en) | 2014-01-28 | 2019-05-21 | Huawei Technologies Co., Ltd. | Method for synchronous playback by multiple smart devices, and apparatus |
| JP2018182761A (ja) * | 2015-04-24 | 2018-11-15 | マーシブ テクノロジーズ,インコーポレイティド | 分散メディアの相互作用かつリアルタイムの可視化のためのシステムおよび方法 |
| JP2018530944A (ja) * | 2015-09-30 | 2018-10-18 | アップル インコーポレイテッドApple Inc. | 異種ネットワーキング環境におけるメディアレンダリングの同期化 |
| JP2022536387A (ja) * | 2019-09-04 | 2022-08-15 | 北京字節跳動網絡技術有限公司 | ビデオデータの処理方法、装置、電子機器およびコンピュータ可読媒体 |
| JP7524231B2 (ja) | 2019-09-04 | 2024-07-29 | 北京字節跳動網絡技術有限公司 | ビデオデータの処理方法、装置、電子機器およびコンピュータ可読媒体 |
| US12069332B2 (en) | 2019-09-04 | 2024-08-20 | Beijing Bytedance Network Technology Co., Ltd. | Video data processing method, electronic device and computer-readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102132575A (zh) | 2011-07-20 |
| EP2328349A1 (en) | 2011-06-01 |
| JP5230744B2 (ja) | 2013-07-10 |
| KR20110044319A (ko) | 2011-04-28 |
| CN102132575B (zh) | 2013-10-02 |
| EP2328349B1 (en) | 2019-07-03 |
| US9485467B2 (en) | 2016-11-01 |
| US20110196918A1 (en) | 2011-08-11 |
| KR101277511B1 (ko) | 2013-06-21 |
| JPWO2010023828A1 (ja) | 2012-01-26 |
| EP2328349A4 (en) | 2015-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5230744B2 (ja) | 情報処理システムおよび情報処理装置 | |
| KR101326739B1 (ko) | 정보처리 시스템 및 정보처리 장치 | |
| EP3840394B1 (en) | Video screen projection method, device, computer equipment and storage medium | |
| CN109889543B (zh) | 视频传输的方法、根节点、子节点、p2p服务器和系统 | |
| RU2620716C2 (ru) | Синхронизация воспроизведения мультимедийного контента при групповом просмотре | |
| CN107819809B (zh) | 对内容进行同步操作的方法及装置 | |
| JP2003235027A (ja) | 配信映像の同時再生方法、映像配信システムおよび端末装置 | |
| JP2009284055A (ja) | プログラム、情報記憶媒体及び動画配信システム | |
| JP2005086222A (ja) | マルチキャスト型コンテンツ受信制御方法及びマルチキャスト型コンテンツ受信クライアント | |
| JP5552171B2 (ja) | ライブメディアストリームの時間シフト | |
| WO2017016266A1 (zh) | 一种实现同步播放的方法和装置 | |
| JP2020174378A (ja) | 異種ネットワーキング環境におけるメディアレンダリングの同期化 | |
| TW202046707A (zh) | 視訊會議影音共享方法 | |
| CN102510470B (zh) | 一种媒体流数据复制方法和设备 | |
| JP2010183237A (ja) | コンテンツ同期再生システム、コンテンツ同期再生方法、再生端末、再生端末の制御方法、及び制御プログラム | |
| JP2007074684A (ja) | 動画配信システム | |
| KR100619698B1 (ko) | 배속재생 방법 및 시스템 | |
| WO2022217409A1 (zh) | 手机多场景直播系统与脚本控制切换方法 | |
| CN121814995A (zh) | 一种多设备音视频同步播放方法、系统、电子设备及存储介质 | |
| CN113612728A (zh) | 流媒体播放方法、传输设备和系统 | |
| JP2004112129A (ja) | 映像配信装置及び映像配信工程を実現するプログラム | |
| JP2012049944A (ja) | Tv受信機 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 200980132960.0 Country of ref document: CN |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09809485 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2010526515 Country of ref document: JP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2009809485 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 20117006432 Country of ref document: KR Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 13060369 Country of ref document: US |