WO2004071089A1 - 画像データ配信制御方法及び装置とシステムならびにプログラム - Google Patents
画像データ配信制御方法及び装置とシステムならびにプログラム Download PDFInfo
- Publication number
- WO2004071089A1 WO2004071089A1 PCT/JP2004/001176 JP2004001176W WO2004071089A1 WO 2004071089 A1 WO2004071089 A1 WO 2004071089A1 JP 2004001176 W JP2004001176 W JP 2004001176W WO 2004071089 A1 WO2004071089 A1 WO 2004071089A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image data
- image
- distribution
- data
- encoded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
- H04N21/23476—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption by partially encrypting, e.g. encrypting the ending portion of a movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
- H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/454—Content or additional data filtering, e.g. blocking advertisements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management e.g. creating a master electronic programme guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/64—Addressing
- H04N21/6405—Multicasting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
Definitions
- the present invention relates to a method, an apparatus, and a system for distributing encoded moving image data in at least one or more sessions and controlling the received image quality of the receiver by notifying the session information to the receiver. , And the program. Background art
- the input image frame is inter-frame predicted by motion compensation in units of a rectangular area of a fixed size called a macroblock, and the obtained motion vector and the prediction residual image data are two-dimensionally encoded.
- Variable length coding is performed on the signal data that has been compressed by performing discrete cosine transform and quantization.
- Image data that is optimally compressed to the communication speed of the line to which the computer is connected image data extracted from previously stored image data with different compression rates, or compressed at the optimal compression rate each time
- An image distribution system configured to transmit image data is known (for example, see Patent Document 1).
- the multicast or broadcast distribution method in order for the transmission side to control the image quality of the moving image data received by the receiver, the moving image data for each quality (image quality) must be distributed.
- the multicast or broadcast distribution method generally has no mechanism for the receiver to request retransmission of the missing data when the packet is lost, and the receiver (receiving device) cannot correctly decode the image data. .
- the frame before and after the frame that could be decoded correctly There is an error concealment method that generates image data that makes errors less noticeable from an image or surrounding image data in the same frame.
- the inter-frame prediction since the inter-frame prediction is used, there is a problem that once-disturbed image is propagated to subsequent frames.
- a first object of the present invention is to provide a method for receiving or receiving a signal while suppressing an increase in traffic in multicast or broadcast distribution of a moving image.
- An object of the present invention is to provide a system, an apparatus, a method, and a computer program capable of variably setting the image quality of a moving image on a transmission side.
- a second object of the present invention is to receive image data from at least one or more sessions and select and decode the data according to the image quality in order to increase the reliability of the multicast or broadcast distribution method.
- Another object of the present invention is to provide a distribution system, device, method, and computer program for suppressing image disturbance when packet loss occurs.
- Still another object of the present invention is to provide a distribution system, an apparatus, a method, and a program for performing a program, in which the processing amount applied to both the transmitting and receiving parties is reduced to achieve the first and second objects. It is in.
- Still another object of the present invention is to provide a distribution system, an apparatus, a method, and a computer program that achieve the above first and second objects without sending feedback information from a receiving side to a transmitting side. .
- Still another object of the present invention is to provide a method, an apparatus, a system, and a computer that can suppress an increase in power consumption applied to a receiver to achieve the first and second objects. To provide a program.
- An image data distribution apparatus that solves at least one of the above objects, comprising: an image according to one aspect of the present invention that solves at least one of the above objects;
- the overnight delivery device is means for multicast or broadcast delivery of image encoded data of the same image but having different compression rates, and means for selecting a session for multicast or broadcast delivery according to the compression rate.
- the encoding scheme and the frame configuration are the same for the image encoding data of the same image having different compression ratios.
- Each transmission unit (for example, a video packet in the MPEG-4 encoding system) is a data in which the same part of the same frame is encoded.
- the present invention includes means for distributing image coded data of the same image having different compression ratios, and means for selecting a session to be distributed according to the compression ratio. At least one of the distribution sessions is multicast or Sent by the broadcast method.
- An image data distribution apparatus includes: means for multicasting or broadcasting distribution of encoded image data of the same image but different compression ratios; and changing session information to be notified according to a receiver. And means for controlling the quality of the received image on the receiver side.
- encoded image data of the same image but having different compression ratios have the same encoding system and frame configuration, and each transmission unit (eg, a video packet of the MPEG-4 encoding system) has the same frame. Are the encoded data.
- An image data distribution apparatus includes: means for multicast or broadcast distribution of image-encoded data having different compression rates; and means for transmitting image-encoded data for each distribution session selected by the compression rate. Means for setting information including the presence / absence of concealment, the concealment method in the case of concealment, and Z or concealment strength.
- image encoding data of the same image but having different compression ratios have the same encoding method and frame configuration.
- Each transmission unit (for example, a video packet of the MPEG-4 encoding method) is data in which the same part of the same frame is encoded.
- an image data distribution apparatus which selects a session to be distributed according to a type of a multicast or broadcast distribution of image encoded data and a type of an image frame or an image block. Means to perform.
- An image data distribution apparatus includes: means for multicasting or broadcasting distribution of image encoded data having different types of image frames and image blocks; And means for controlling the reception quality at the receiver side by changing the session information to be notified.
- an image data distribution apparatus comprising: means for multicast or broadcast distribution of image encoded data; and a distribution session selected according to a type of an image frame or an image block. And means for setting information including concealment method and / or concealment strength when distribution data is confidential or not.
- an image data distribution apparatus which is configured to determine whether or not distribution data is concealed, and, in the case of confidentiality, at least 1 Means for multicast or broadcast delivery in one or more sessions, and means for controlling the reception quality at the receiver side by changing the information about concealment notified according to the receiver. .
- An image data receiving apparatus includes: means for receiving session information notified from the image data distribution apparatus; and means for receiving the session information from the image data distribution apparatus based on the session information. Means for selecting image-encoded data based on image quality (compression rate) from the normally received encoded data, and decoding the selected image-encoded data Means to perform.
- the apparatus further comprises means for selecting whether or not to receive at least one image data based on at least one of an error Z loss rate of received data, available power, and a predetermined setting. May be adopted.
- an image data receiving apparatus configured to receive information related to concealment of data notified from an image data distribution apparatus, and based on the information related to concealment. Restores the concealed image coded data received from the image data distribution device, and selects the image coded data based on the image quality (compression ratio) from the normally coded image coded data. Means, and means for decoding the selected image encoded data. In the present invention, there is further provided a means for selecting whether or not to receive at least one image data based on at least one of an error Z loss rate of received data, available power, and a predetermined setting. It may be configured.
- An image data overnight distribution system comprises: an image data distribution device; an image data reception device; And a transmission path for transmitting information from a data distribution device to the image data receiving device,
- the image data distribution device includes
- Means for notifying the image data receiving apparatus of at least one session information including session information permitting distribution and / or quality permitting reception.
- the image data overnight receiving device The image data overnight receiving device
- the apparatus further comprises means for selecting whether or not to receive at least one image data based on at least one of an error Z loss rate of received data, available power, and a predetermined setting. It may be configured.
- An image data distribution system includes an image data distribution device, an image data reception device, and information transmitted from the image data distribution device to the image data reception device. And a transmission path for transmitting the image data.
- a method for notifying the image data overnight receiving device of at least one session information including session information permitting distribution and / or quality permitting reception. Steps and
- the image data receiving device receives the image data from the image data from the image data receiving device.
- the image data distribution system may include an image data distribution device, an image data distribution receiving device, and an image data distribution device. And a transmission path for transmitting information to the image data receiving device, the image data distribution device,
- Intra-MB intra-macroblock
- the image data overnight receiving device comprises:
- Means for decoding the reconstructed moving image data It has.
- An image data distribution system may further include an image data distribution device, an image data reception device, and information from the image data distribution device.
- Intra-macro block encoded data of I-pictures and P-pictures of video data, or I-pictures, P-pictures and B-pictures, and at least a part of the frame of the video, Means for multicasting or broadcasting in different sessions,
- the image data receiving device of the notified session information, means for receiving data distributed by at least one session.
- the apparatus further comprises means for selecting whether or not to receive at least one image data based on at least one of an error / loss rate of received data, available power, and a predetermined setting. It may be configured.
- An image data distribution system includes an image data distribution device, an image data reception device, and information from the image data distribution device transmitted to the image data reception device. And a transmission path for transmission, wherein the image data distribution device comprises: The I-picture, P-picture, or I-picture, P-picture, and B-picture coded data of multiple moving image data of the same image with different compression ratios are multicast or pro- Ded in multiple different sessions.
- Means for notifying the image data receiving apparatus of at least one session information including session information permitting distribution, and Z or quality permitting reception;
- the image data receiving device receives the image data from the image data from the image data receiving device.
- the apparatus further includes means for selecting whether or not to receive at least one image data based on at least one of an error / loss rate of received data, available power, and a predetermined setting. May be adopted.
- An image data distribution system includes an image data distribution device, an image data reception device, and transmitting information from the image data distribution device to the image data reception device.
- the image data distribution device includes an image data distribution device, an image data reception device, and transmitting information from the image data distribution device to the image data reception device.
- I-pictures and P-pictures, or I-pictures, P-pictures and B-pictures, and moving pictures of the same picture which have the same encoding method and frame structure and different compression ratios Means for multicast or broadcast distribution of intra-macroblock (Intra-MB) encoded data of at least a part of the frame of the image in a plurality of different sessions;
- Intra-MB intra-macroblock
- Means for notifying the image data receiving apparatus of at least one piece of session information including session information permitting distribution and / or quality permitting reception;
- the image data receiving device receives the image data from the image data from the image data receiving device.
- a means for selecting whether to receive at least one image data based on at least one of an error / loss rate of received data, available power, and a predetermined setting is further provided.
- the image data distribution system according to another aspect (seventh aspect) of the present invention may include a configuration in which the image data overnight distribution device determines whether or not to conceal the distribution data for each session to be distributed. Means for setting information including the concealment method and / or the strength of concealment,
- the image data receiving device includes means for receiving the confidential information notified from the image data distribution device, and restoring the concealed received moving image data based on the confidential information.
- a means for selecting whether to receive at least one image data based on at least one of an error / loss rate of received data, available power, and a predetermined setting is further provided. According to the present invention, by setting session information or concealment information to be notified to the receiving side by the receiver, the image data to be multicast or broadcast distributed can be changed without changing the image data of the receiver. The effect is that the image quality that can be received can be controlled on the transmission side.
- the advantage of multicast or broadcast distribution that effectively uses network resources is maintained, and while suppressing an increase in the amount of distributed data, This has the effect that the quality of the image received by the receiver can be set in multiple stages on the transmitting side.
- an increase in power consumption required for a receiver can be suppressed to a small level.
- FIG. 1 is a diagram showing a configuration of a first example of the present invention.
- FIG. 2 is a diagram showing a configuration of a second embodiment of the present invention.
- FIG. 3 is a diagram showing a configuration of a third embodiment of the present invention.
- FIG. 4 is a diagram showing a configuration of a fourth embodiment of the present invention.
- FIG. 5 is a diagram showing a configuration of a fifth embodiment of the present invention.
- FIG. 6 is a diagram showing a configuration of a sixth embodiment of the present invention.
- FIG. 7 is a view showing a modification of the first embodiment of the present invention.
- FIG. 8 is a diagram showing a configuration of an embodiment of a bucket receiving / separating unit according to the present invention.
- FIG. 9 is a diagram showing a modification of the second embodiment of the present invention.
- FIG. 10 is a diagram showing a modification of the third embodiment of the present invention.
- FIG. 11 is a diagram showing a modification of the fourth embodiment of the present invention.
- FIG. 12 is a diagram showing a modification of the fifth embodiment of the present invention.
- FIG. 13 is a view showing a modification of the sixth embodiment of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION
- the image data distribution device transmits a plurality of moving image data having the same image, the same coding method, the same frame configuration, and different compression ratios in different sessions.
- the presence or absence of reception of at least one image data is determined based on at least one of an error Z loss rate of received data, available power, and a predetermined setting. Based on this, a configuration may be further provided with means for selecting.
- the image data receiving device receives the data distributed by at least one session from the session information notified by the image data distribution device, and selects the data based on the image quality from the received moving image data. Means for reconstructing and decoding a single moving picture over time.
- the image data distribution device notifies the receiver (image data receiving device) of the setting of the presence / absence of concealment of the distribution data, the concealment means, the concealment strength, and the confidentiality setting information for each distribution session. Means.
- the image data receiving device includes means for receiving the confidential information notified from the image data distribution device, restoring the received data, and decoding the moving image data.
- FIG. 1 shows a configuration of a first embodiment of the present invention.
- an image data distribution device 101 for distributing image encoded data an image data receiving device 108, and a transmission line 107 for transmitting image encoded data.
- the image data delivery device 101 is connected to a transmission line 107, which is an IP (Internet Protocol) network.
- Image data is distributed using UDP (User Datagram Protocol) / IP, and the image data receiving device 108 is a client terminal connected to the IP network.
- UDP User Datagram Protocol
- IP IP
- the image data receiving device 108 is a client terminal connected to the IP network.
- the number of image data to be distributed is described as “2” for the sake of simplicity, but the number of image data to be distributed in the present invention is not limited to two. It is.
- the image data distribution device 101 includes a distribution information transmission unit 102, a session information management unit 103, an image data storage Z generation unit 104, an image encoded data 1 transmission unit 105, And a coded image data 2 transmission unit 106.
- the image data receiving apparatus 108 includes a session information receiving section 109, an image coded data receiving section 110, an image coded data 2 receiving section 111, and a coded data reconstructing section. 1 1 2 and a decoder 1 1 3 are provided.
- a session information receiving section 109 receives a session information from the image data delivery device 101 and the image data receiving device 108 and the image data receiving device 108 .
- the image data storage Z generation unit 104 includes: • image data stored in a storage device (not shown) in advance; or • image data generated by encoding in real time. Evening or
- a plurality of image encoded data transmission units in the example of FIG. 1, the image encoded data 1 transmission unit 105 and the image encoded data 2 transmission unit Transmission is performed from 106 through the transmission path 107.
- the session information management unit 103 manages information of a session that is permitted to be transmitted to a receiver (image data receiving device), and according to the receiver, session information to be notified, image quality, and the like.
- the information relating to the image coding is supplied to the distribution information transmitting unit 102, and the distribution information transmitting unit 102 notifies the image data receiving device 108 of the information.
- the coded image data 1 transmission unit 105 and the coded image data 2 transmission unit 106 receive the image data when the image data receiving device 108 receives a plurality of overlapping image data.
- the RTP Real-Time Transport Protocol
- Equivalent information (example For example, RTP header information) (for example, see RFC1889, Non-Patent Document 1).
- each transmission unit of the image encoded data 1 and the image encoded data 2 is data obtained by encoding the same part of the same frame of the same image, and the same RTP sequence number is added to this data.
- a payload type and / or SRC (Synchronization Source identifier) and / or CSRC (Contributing Source identifier) indicating whether the data is image encoded data may be added.
- the image encoded data 1 and the image encoded data 2 are transmitted with a time difference longer than the burst length of the data error or loss on the transmission line 107, for example, so that the image on the transmission line If the possibility that both the coded data and the coded data are affected by the error or loss is reduced, and the image data receiving device 108 has a receiving buffer of this time difference or more, more stable image data distribution You can do.
- the transmission time difference is managed by the session information management unit 103, and is notified from the distribution information transmission unit 102 to the image data receiving device 108, or is determined in advance between the image data distribution device 101 and the image data receiving device 108,
- the image data receiving apparatus 108 may set the receiving buffer amount based on the time difference.
- the image encoded data 1 transmitting unit 105 and the image encoded data 2 transmitting unit 106 respond to the setting. Perform concealment processing. Then, information on concealment such as presence / absence of concealment and a concealment method is notified from distribution information transmitting section 102 to image data receiving apparatus 108.
- Various known methods are used for concealing information. For example, a common key method (for example, DES (Data Encryption Standard)) or a public key method (for example, RAS encryption), or scrambling of the image itself (for example, a line rotation method) can be used to decode the payload of an RTP packet. Used.
- the session information receiving unit 109 receives the session information from the image data distribution apparatus 101, the information on the image encoding, and the information on the concealment when the distribution data is concealed, based on this information.
- Image encoded data 1 Receiver 1 10 Then, the session receiving port is opened by the image-encoded data 2 receiving unit 111 to receive the image data from the transmission line 107.
- the original image data is restored using the information obtained by the session information receiving unit 109.
- the session information management unit 103 sets the encoding settings of the encoded image data 1 and the encoded image data 2, an encoding option (a tool to be used), a download option of the encoded data, an encoding data
- the payload type of the RTP header and / or information corresponding to SSRC and CSRC may be set, and the distribution information transmitting unit 102 may notify the image data receiving device 108 of this. May be set in advance between the image data distribution device 101 and the image data reception device 108.
- the duplicated image data is encoded by the encoded data reconstructing unit 1 1 In step 2, based on the image quality based on the function corresponding to RTP, the sequence number of the RTP header, the payload type, the information by SSRC and CSRC, and the information received by Z or the session information receiving unit 109 Data is selected, reconstructed into one image data, and output to the decoder 113.
- the decoder 113 needs to decode only one image data selected by the encoded data reconstructing unit 112. For this reason, the load of the decoding process of the decoder 113 does not increase.
- the following method is employed. be able to.
- the quality (compression rate) of the image encoded data 1 and the image encoded data 2 is changed, and for example, the image encoded data 1 is set to a higher quality (lower compression rate).
- the image data receiving device 108 of the receiver A will receive the encoded image data 1 and the image.
- the session information of both the encoded data 2 and the session information of the encoded image data 2 are notified to the image data receiving apparatus 108 of the receiver B.
- the receiver A's image data receiver 1 108 uses the notified image coded data 1 and image coded data 2 session information to obtain a high quality image Image data and low-quality image encoded data 2 can be received, and even if errors or omissions occur in the image encoded data 1
- the location can be complemented with the image data of the image encoded data 2.
- the image data receiving apparatus 108 of the receiver B can receive only low-quality image data of the image encoded data 2 according to the notified session information.
- the image quality of the received image can be different between the two receivers A and B.
- the image encoded data 1 is transmitted by the unicast method, for example, only to the receiver A, and the image encoded data 2 is transmitted by the multicast or broadcast method. Therefore, a similar difference in image quality occurs when transmission is performed to both the receiver A and the receiver B.
- the image data receiving device 108 of the receiver A receives the session information of both the image encoded data 1 and the image encoded data 2 and the image data receiving device 108 of the receiver B receives the image information. If only the session information of the coded data 1 is notified and the image data of the coded data 1 is not affected by errors or omissions on the transmission path, the receiver A and the receiver B will have the same image quality Can be obtained. On the other hand, if an error or omission occurs in the image data, the receiver A can supplement the relevant portion with the image data of the image encoded data 2, but the receiver B cannot. Thus, there is a difference in image stability between the two receivers A and B.
- the image coded data 1 and the image coded data 2 have the same quality, the image coded data 1 is transmitted to the image coded data 1 transmitting unit 105 and the image coded data 2 If transmission is performed from both the transmission units 106, it is possible to minimize the deterioration of the reproduced image quality in the image data receiving device when there is an error or loss in the transmission path.
- image encoded data 2 is transmitted in a unicast manner, for example, only to receiver A, and image encoded data 1 is transmitted to both receiver A and receiver B in a multicast or broadcast scheme. , Similar image quality stability differences You. In this case, since the band of the image encoded data transmitted by the unicast method can be smaller, it is more desirable to suppress an increase in traffic.
- the quality (compression ratio) is set in the same way for the encoded image data 1 and the encoded image data 2 and, for example, only the encoded image data 1 is concealed, and the Informs the method of restoring the concealed encoded image data 1 and does not notify the image data receiving device 108 of the receiver B, or conceals both the encoded image data 1 and the encoded image data 2 Then, the image data receiving device 108 of the receiver A is notified of information for restoring both of the encoded image data, and the image data receiving device 108 of the receiver B is notified of the encoded image data. The same effect can be obtained by notifying only the information for restoring overnight 2.
- the image data receiving apparatus 108 when the image data receiving apparatus 108 is used in an environment where the available power is limited, such as when operating on a battery / battery, and / or in a good reception environment, If the encoded image data 1 can be received almost without errors or omissions, the reception of the encoded image data 2 may be stopped and the use time of the apparatus may be extended as much as possible. Conversely, when a large-capacity battery or an AC power supply is connected to the image data receiving device 108, both the image encoded data 1 and the image encoded data 2 may be received. In this way, it is possible to control whether or not to receive data according to the available power and the reception environment. Further, in the present embodiment, the number of the received image data may be set to the image data receiving device 108 by the receiver.
- the transmitting sections 105, 106 of the image encoded data 1, 2 are transmitted.
- the packet multiplexing unit 701 may multiplex the output of the packet into one session, and may add a sequence of image data and / or identification information regarding a compression ratio to the transmission packet and transmit the packet.
- the received packet is separated into encoded data and identification information by the bucket reception separation unit 720 of the image data reception device 108.
- the encoded data reconstructing unit 703 determines the overlap of the data and the compression ratio based on the sequence obtained from the identification information and the information on the compression ratio, and if there is a duplication, the information on the compression ratio , And may be reconstructed into one encoded data.
- the identification information uses, for example, the sequence number of the RTP header, the payload type, SSRC, CSRC, or adds information corresponding to this.
- FIG. 8 is a diagram showing an example of the configuration of the bucket reception separation unit 720 of FIG.
- the packet reception separation section 800 (corresponding to the packet reception separation section 720 in FIG. 7) includes an error detection section 800 and a data extraction section 800, and performs data extraction.
- the unit 802 includes an identification information extracting unit 803 and an encoded data extracting unit 804.
- the data error of the received packet is detected by the error detecting section 800, and if an error is detected, the received packet is discarded. This corresponds to error detection by the checksum of the UDP in the present embodiment.
- the identification information and the encoded data are extracted by the identification information extraction section 803 and the encoded data extraction section 804 of the data extraction section 802.
- the former corresponds to, for example, the sequence number and payload type of the RTP header, SSRC, and CSRC. It is to be noted that not only all sessions may be multiplexed into one session but also a plurality of packet multiplexing transmission units for multiplexing several sessions may be provided and similar identification information may be added.
- a distribution information transmission unit 102 In the image data distribution device 101, a distribution information transmission unit 102, a session information management unit 103, an image data storage / generation unit 104, and an image encoded data 1 transmission unit 105
- the functions and processing of the image coded data 2 transmission unit 106 and the bucket multiplex transmission unit 701 are realized by program control executed by the computer constituting the image data distribution device 101. Needless to say, this may be done.
- the image data receiving device 108, the session information receiving unit 109, the encoded image data 1 receiving unit 110 and the encoded image data 2 receiving unit 111, and the encoded data reconstructing unit 111 2, the decoder 113, the packet reception separation unit 702, and the coded data reconstruction unit 703 by program control executed by the combination constituting the image data distribution apparatus 101. Functions and processing Needless to say, this may be done.
- the image data distribution device includes an I picture (Intra-picture: intra-coded picture) of moving picture data, a P-picture (Prediction-picture: frame). Inter-forward predictive image) and, if present in the encoding method used to encode the moving image, a B-picture (Bi-rectily ly predicative-Picture: bidirectional predictive coded image).
- At least one session information multicast address, port number, picture type, etc.), including means for multicast or broadcast distribution in a given session, and the quality of the recipient to allow the recipient to receive it.
- Means for notifying In the second embodiment of the present invention, the presence or absence of at least one image data is determined by determining at least one of an error / loss rate of received data, available power, and a predetermined setting. Based on the above, a means for selecting may be further provided.
- the image data receiving apparatus includes: a means for receiving, from the notified session information (multicast address, port number, picture type, etc.), data that has been multicast or broadcast distributed by at least one session; Means for reconstructing and decoding the data into one video sequence.
- notified session information multicast address, port number, picture type, etc.
- the image data distribution device includes: a unit for setting whether or not the distribution data is concealed, a concealment unit, a concealment strength, and a unit for notifying a receiver of confidentiality setting information for each session to be distributed.
- the image data receiving device includes means for receiving the notified confidential information, restoring the received data, and decoding the moving image data.
- FIG. 2 shows a second embodiment of the present invention.
- the image data distribution device 201 is connected to a transmission line 208 which is an IP (Intern et Protocol) network.
- IP Intern et Protocol
- image encoded data is distributed
- the image data receiving apparatus 209 is a client terminal connected to an IP network.
- the image data distribution device 201 includes a distribution information transmission unit 202, a session information management unit 203, an image data overnight storage Z generation unit 204, and an I picture encoded data transmission unit 205. And a P-picture coded data transmission unit 206 and a B-picture coded data transmission unit 207.
- the image data receiving apparatus 209 includes a session information receiving section 210, an I-picture coded data receiving section 211, a P-picture coded data receiving section 212, and a B-picture coded data receiving section 2. 13, an encoded data reconstructing unit 2 14, and a decoder 2 15.
- the image data distribution device 201 in the image data storage / generation unit 204, the image data stored in advance, or
- the I-picture coded data transmission unit 205 Based on the information set by the session information management unit 203, the I-picture coded data transmission unit 205, the P-picture coded data transmission unit 206, and the B-picture coded data transmission unit 20 According to 7, transmission is performed via the transmission path 208.
- the session information management unit 203 manages information on sessions that are permitted to be delivered to the receiver, and stores session information to be notified according to the receiver and information on image coding such as picture type. Then, the distribution information transmitting unit 202 notifies the image data receiving device 209.
- the I-picture coded data transmission unit 205, the P-picture coded data transmission unit 206, and the B-picture coded data transmission unit 207 It has a function to add information equivalent to RTP (Real-Time Transport Protocol) so that it can be rearranged correctly even if the order is changed. If the session information management unit 203 is set to conceal the distribution image data, the I picture encoded data transmission unit 205, the P picture encoded data transmission unit 206, and the B picture
- the coded data transmission unit 207 performs concealment processing according to the setting, and transmits information on concealment such as presence / absence of concealment and concealment method from the distribution information transmission unit 202 to the image data receiving device 209. Notify
- the information obtained by the session information receiving unit 210 allows the I-picture coded data receiving unit 211 and the P-picture coded data receiving unit 21 2, and B picture coded data reception.
- the unit 2 13 restores the original image data.
- the session information management unit 203 sets the encoding setting of the image encoded data, the encoding option (tool used), the payload option of the encoded data, the payload type of the RTP header for identifying the encoded data, and Alternatively, information corresponding to SSRC and CSRC may be set and notified to the image data receiving device 209 by the distribution information transmitting unit 202, and such information may be set in advance in the image data transmitting device 2 01 and the image data receiving device 209 may be set.
- the received I picture, P picture, and B picture are encoded by the coded data reconstructing unit 214, and the functions corresponding to the RTP, the sequence number of the RTP header, the payload type, information by SSRC and CSRC, and / or Based on the information received by the session information receiving unit 210, it reconstructs into one moving image stream and outputs it to the decoder 215.
- the I-picture must be transmitted to the receiver A's image data receiver.
- the image data receiving apparatus of the receiver B is notified of the information of the session for transmitting the encoded data of the I picture and the P picture.
- the image data receiving device of the receiver A can receive the encoded data of all the pictures, it can receive the moving image with the highest image quality (smooth motion), and the image data of the receiver B can be received.
- the receiving device can receive the moving image with the next highest image quality, and the image receiving device of the receiver C can receive only the lowest-quality moving image of only the I picture.
- the image quality of the received image can be different between each receiver (image data receiving device).
- the present embodiment it is possible to control the difference in image quality among the receivers by transmitting the coded data of the specific picture to the specific receiver only by the unicast method.
- I-picture coded data is transmitted by multicast or broadcast method
- P-picture coded data is transmitted to receiver A and receiver B by unicast method
- B-picture coded data is transmitted only to receiver A. The same effect can be obtained if transmission is performed by the e-cast method.
- information for concealing only the coded data of P and B pictures and returning the coded data of the concealed P and B pictures to the receiver A's image data receiving device for example, (Common key, etc.
- the receiver A's image data receiving device for example, (Common key, etc.)
- the same effect can be obtained if the information about the activation is not notified.
- the coded data of the I picture and the P picture is delivered in one session, and the coded data of the B picture is delivered in another session.
- I-picture encoded data is distributed in one session, and P-picture and B-picture encoded data are distributed in another session.
- the same effect can be obtained by notifying the confidential information of the session information or the distribution data in the same manner.
- the image data receiving apparatus 209 when the image data receiving apparatus 209 is used in an environment where power is limited, such as when operating on a battery, a B-picture coded data or a P / B picture The reception of the encoded data may be stopped, and the usage time of the device may be made as long as possible.
- the image data receiving device 209 when the image data receiving device 209 is connected to a large-capacity battery or an AC power supply, the image data receiving device 209 may receive encoded data of all pictures. In this way, the presence or absence of data reception can be controlled according to the available power and the reception environment.
- the configuration may be such that the receiver can set the received picture coded data in the image data receiving apparatus 209.
- I-picture coded data P-picture coded data
- B-picture coded data session information
- the transmission sections 205, 206, and 210 of the image data distribution apparatus 201 in the present embodiment as shown in FIG. 9, the transmission sections 205, 206, and 210 of the image data distribution apparatus 201 in the present embodiment, as shown in FIG.
- the packet output is multiplexed into one session by the packet multiplexing transmission section 910, and identification information on the picture type of the image data is added to the transmission packet and transmitted.
- the packet reception separation of the image data receiving apparatus 209 is performed.
- the received packet is separated into encoded data and identification information by the unit 902, and the encoded data reconstructing unit 903 uses the information on the picture type obtained from the identification information to generate one encoded data. It may be reconfigured to With this configuration, the same effect as in the above embodiment can be obtained.
- the identification information for example, the payload type of the RTP header, SSRC, CSRC is used, or information corresponding thereto is added.
- the packet receiving / separating section 902 performs the same processing as that of the packet receiving / separating section 702 in the first embodiment. It is to be noted that not only all sessions may be multiplexed into one session but also a plurality of packet multiplexing transmission units for multiplexing several sessions may be provided and similar identification information may be added.
- each unit in the image data distribution device 201 and the image data reception device 209 is also executed by a computer constituting the image data distribution device and the image data reception device.
- each function and processing may be realized by program control.
- the image data distribution device is configured to separate moving image data and data obtained by encoding at least a part of the frame of the moving image with an intra-macro block (Intra-MB), respectively. Notify the receiver of at least one session information (multicast address, port number, image type, etc.), including means for multicast or broadcast distribution, and the quality that allows the receiver to receive in the session. Means.
- the image data receiving device receives the multicast or broadcast data from at least one session among the notified session information, and selects data based on the image quality from the received moving image data.
- Means for reconstructing and decoding one moving picture data overnight, and determining whether or not at least one image data has been received, an error in the received data overnight Z loss rate, available A means for selecting based on at least one of electric power and predetermined settings may be further provided.
- the image data distribution device comprises: means for setting whether or not distribution data is concealed, a concealment means, a concealment strength for each session to be distributed, and means for notifying a receiver of confidentiality setting information to the receiver.
- the receiving device includes means for receiving the notified confidential information, restoring the received data, and decoding the moving image data.
- FIG. 3 shows a third embodiment of the present invention.
- an image data distribution device 301 an image data reception device 310, and a transmission line 3 for transmitting moving image encoded data It consists of 07.
- the image data distribution device 301 is connected to a transmission line 307, which is an IP (Internet Protocol) network, and distributes image encoded data using UD IP, and
- the receiving device 308 is a client terminal connected to the IP network.
- the image data distribution device 301 includes a distribution information transmission unit 302, a session information management unit 303, an image data overnight storage Z generation unit 304, an image encoded data transmission unit 305, and an intra-macro block ( (Intra-MB) Encoded data transmission unit 303 is provided.
- a distribution information transmission unit 302 a session information management unit 303, an image data overnight storage Z generation unit 304, an image encoded data transmission unit 305, and an intra-macro block ( (Intra-MB) Encoded data transmission unit 303 is provided.
- the image data receiving apparatus 308 includes a session information receiving section 309, an image coded data receiving section 310, an Intra-MB coded data receiving section 311, and a coded data overnight reconstructing section 3 1 2 and a decoder 3 1 3.
- a session information receiving section 309 receives image data from the image data distribution device 301 and the image data overnight receiving device 310 and a decoder 3 1 3.
- the image data distribution device 301 is an image data storage / generation unit 3
- the image data transmission unit 305 and the intra-macroblock (Intra-MB) coded data transmission unit 306 provide a transmission path. Sent via 30 7
- the session information management unit 303 manages information on sessions that are permitted to be delivered to the receiver, and stores session information to be notified according to the receiver and information on image coding such as image type.
- the distribution information transmitting unit 302 notifies the image data receiving device 308.
- the image coded data transmitting unit 305 and the Intra-MB coded data transmitting unit 306 transmit data when a plurality of overlapping image data are received by the image data receiving device 308.
- RTP Real-Time Transport Protocol
- the same RTP sequence number is assigned to the image coded data in the same area of the image to be coded by the Intra macroblock coded data, and furthermore, any one of the image coded data and the Payload type, and / or SS RC and / or CSRC.
- the image encoded data transmission unit 2005 and the Intra-MB encoded data transmission unit 303 will respond to the setting.
- the distribution information transmitting unit 302 notifies the image data receiving device 308 of confidentiality information such as presence / absence of concealment and a concealment method.
- the image data receiving device 308 receives the session information from the image data distributing device 301, the information on image encoding, and the information on concealment if the distribution data is concealed, Based on this information, the image encoded data receiving unit 310 and the Intra-MB encoded data receiving unit 311 open a session reception port and transmit image data from the transmission path 307. Receive. When the received image data is concealed, the information obtained by the session information receiving unit 309 is used to transmit the image coded data receiving unit 310 and the Intra-MB coded data receiving unit 3 1 1 Then, restore the original image.
- the session information management unit 303 sets the encoding setting of the image encoded data, the encoding option (used tool), the encoded data payload option, and the payload type of the RTP header that identifies the encoded data. , And / or information corresponding to SS RC and CS RC may be set and notified to the image data receiving device 308 by the distribution information transmitting unit 302, and the information may be transmitted in advance to the image data receiving unit 308.
- the setting may be made between the device 301 and the image data receiving device 308.
- the duplicated image data is sent to the coded data reconstructing unit 312, a function equivalent to RTP, the sequence number of the RTP header.
- the coded data reconstructing unit 312 a function equivalent to RTP, the sequence number of the RTP header.
- the image quality based on the image quality based on the information received by the session information receiving unit 309, the payload type, the information by the SS RC and the CS RC, and / or the decoder 3 1 3 Output to. Since only one image data needs to be decoded, the load on the decoding process of the decoder 313 does not increase.
- the receiver A On the transmission side (image data distribution device), the image data of To control the quality of the received image data in the evening receiver, the receiver A is allowed to receive both the image encoded data and the intra-macroblock encoded data, and the receiver B , If only reception of encoded video data is allowed, the receiver A's image data receiver receives both session information of the image encoded data and the intra-macroblock encoded data, and the receiver B's image data receiver Is notified of only the session information of the image encoded data.
- the receiver A's image data receiving device can receive both the image-encoded data and the intra-macroblock-encoded data, and even if there is an error or omission in the image-encoded data, If an intra-macroblock coded data can be received, this can be complemented.
- the image data receiving device of the receiver B can receive only the image encoded data, and if the data has an error or omission, the image quality is degraded.
- the image quality of the received image differs between the image data receiving apparatuses of the two receivers A and B.
- the image encoded data 1 is transmitted in a multicast or broadcast mode, and the intra-macroblock encoded data is transmitted to the receiver A.
- the image is transmitted by the Unicast method only, there is a difference in the stability of the image quality of the received image.
- only the intra-macroblock coded data is concealed, and the receiver A's image data receiving device is notified of a method for restoring the concealed intra-macroblock coded data, and the receiver A Do not notify the image data receiving device of B of the method of the restoration, or conceal both the image encoded data and the intra-macroblock encoded data, and receive the image data of the receiver A.
- the device is notified of the information for restoring both image data, and the receiver B's image data overnight receiving device is notified of only the information for restoring the encoded image data. The effect of can be obtained.
- the image data receiving device 308 when the image data receiving device 308 is used in an environment where power is limited, such as when operating with a battery Z battery, and / or in a good receiving environment, If the coded data can be received almost without errors or omissions, The reception of encoded macroblock data may be stopped, and the usage time of the device may be extended as much as possible. Conversely, when a large-capacity battery or an AC power supply is connected, the image data receiving device 308 may receive both image encoded data and intra macroblock encoded data. In this way, it is also possible to control the presence or absence of overnight reception according to the available power and the reception environment. Further, in the present embodiment, the configuration may be such that the type of the received image encoded data can be set in the image data receiving device 308 by the receiver.
- the coded data overnight reconstructing unit 312 periodically injects the data.
- the Toler macroblock coded data even if an error or loss occurs on the transmission line, the same as CIR (Cyclic Intra Re fresh) in MPEG-4 coding As a result, it is possible to quickly recover the deterioration of the reproduced image quality due to an error or loss in the transmission path, and to suppress the propagation of the quality deterioration to subsequent frames.
- a configuration may be adopted in which a plurality of transmission paths are used, and image coded data and intra-macroblock coded data and session information are transmitted through different transmission paths.
- the coded data transmission section 305 The output of the Intra macroblock (Intra_MB) coded data transmission unit 306 is multiplexed into one session by the bucket multiplex transmission unit 1001, and identification information on the data type of image data is added to the transmission bucket.
- the received packet is separated into encoded data and identification information by the packet reception separation unit 1002 of the image data reception device 308, and the identification is performed by the encoded data reconstruction unit 1003.
- the same effect can be obtained by reconstructing into one coded data based on the information on the data type obtained from the information.
- the identification information for example, the payload type of the RTP header, SSRC, CSRC is used, or information corresponding thereto is added.
- the bucket reception in the first embodiment is described. The same processing as that performed by the separation unit 720 is performed.
- each unit in the image data distribution device 301 and the image data reception device 308 is also executed by a computer constituting the image data distribution device and the image data reception device.
- each function and processing may be realized by the program control performed.
- the image data distribution device includes an I-picture, a P-picture, and a B-picture when the encoding method used for encoding the moving image is used.
- the image data receiving apparatus receives, from the notified session information, means for receiving data multicast or broadcast distributed by at least one session, and selects data from the received moving image data based on the image quality.
- the presence / absence of at least one image data is determined by at least one of an error / loss rate of received data, available power, and a predetermined setting. Based on the above, it may be configured to further include means for selecting.
- the image data distribution device comprises: means for setting whether or not distribution data is concealed, a concealment means, a concealment strength for each session to be distributed, and means for notifying a receiver of confidentiality setting information to the receiver.
- the receiving device may be configured to receive the notified confidential information, restore the received data, and decode the moving image data.
- FIG. 4 shows a fourth embodiment of the present invention. As shown in FIG. 4, it is composed of a moving image data distribution device, a receiving device, and a transmission path for transmitting moving image encoded data.
- the image data distribution device 401 is connected to a transmission line 409, which is an IP (Internet Protocol) network, and distributes image encoded data using UDP / IP. Is a client terminal connected to the IP network.
- IP Internet Protocol
- the image data distribution device 401 includes a distribution information transmission unit 402, a session information management unit 403, an image data storage Z generation unit 404, an I picture encoded data transmission unit 405, and a P picture encoded data transmission unit. 406, a B picture encoded data transmitting section 407, and an intra-macro block (Intra-MB) encoded data transmitting section 408.
- a distribution information transmission unit 402 a session information management unit 403, an image data storage Z generation unit 404, an I picture encoded data transmission unit 405, and a P picture encoded data transmission unit.
- 406 a B picture encoded data transmitting section 407, and an intra-macro block (Intra-MB) encoded data transmitting section 408.
- Intra-MB intra-macro block
- the image data receiving device 410 includes a session information receiving unit 411, an I-picture coded data receiving unit 412, a P-picture coded data receiving unit 413, a B-picture coded data receiving unit 414, It includes an Intra-MB encoded data receiving section 415, an encoded data reconstructing section 416, and a decoder 417.
- a session information receiving unit 411 an I-picture coded data receiving unit 412, a P-picture coded data receiving unit 413, a B-picture coded data receiving unit 414, It includes an Intra-MB encoded data receiving section 415, an encoded data reconstructing section 416, and a decoder 417.
- the image data storage / generation unit 404 • stores image data stored in advance or
- the I-picture coded data transmission unit 405 Based on the information set by the session information management unit 403, the I-picture coded data transmission unit 405, the P-picture coded data transmission unit 406, the B-picture coded data transmission unit 407, The data is transmitted by the Intra-MB encoded data transmission unit 408 via the transmission path 409.
- the session information management unit 403 manages information on sessions that are permitted to be delivered to the recipient, and provides session information to be notified according to the recipient,
- the distribution information transmitting unit 402 notifies the image data receiving device 410 of information on image encoding.
- the I picture coded data transmission unit 405, the P picture coded data transmission unit 406, the B picture coded data transmission unit 407, and the Intra-MB coded data transmission unit 408 are: RTP (Real-Time Transport) so that data can be selected when multiple overlapping image data are received, and that the received data is rearranged correctly even if the order is changed. Protocol).
- RTP Real-Time Transport
- the same RTP sequence number is assigned to the image coded data of the same area of the image to be coded by the INTRAR macroblock coded data.
- Payload type, and Z or SS RC and Z or CSRC may be added.
- the session information management unit 403 is set to conceal the distribution image data
- the I picture encoded data transmission unit 405, the P picture encoded data transmission unit 406, and the B picture encoded data transmission The unit 407 and the intra-MB coded data transmission unit 408 perform concealment processing according to the setting, and transmit information on concealment such as the presence or absence of concealment and the method of concealment to the distribution information transmission unit 402. Notifies the image data receiving apparatus 410 of the image data.
- the session information from the image data distribution device 401, information on image coding, and, if the distribution data is concealed, information on concealment is received by the session information receiving unit 411, Based on this information, the I picture coded data receiving section 412, the P picture coded data receiving section 413, the B picture coded data receiving section 414, and the intra-MB coded data receiving section 415 Then, the session reception port is opened, and image data from the transmission path 409 is received.
- the information obtained by the session information receiving unit 411, the I-picture coded data receiving unit 412, the P-picture coded data receiving unit 413, and the B-picture is restored by the encoded data receiving unit 414 and the Intra-MB encoded data receiving unit 4 15.
- the session information management unit 403 sets the coding Set the encoding option (tool used), the payload option of the encoded data, the payload type of the RTP header that identifies the encoded data, and the information corresponding to SSRC or CSRC.
- the information may be notified to the image data receiving device 410 by 02, and such information may be set in advance between the image data receiving device 410 and the image data receiving device 410. .
- the received I picture, P picture, B picture, and intra-macroblock can receive both the encoded data of one of the pictures and the intra-macroblock encoded data
- the coded data reconstructing unit 4 16 the function corresponding to RTP, the sequence number of the RTP header, information on the payload evening, SSRC and CSRC, and information received by the session information receiving unit 4 1 1 Based on the image quality, selection is made based on the image quality, reconstructed into one moving image stream, and output to the decoder 417. Since only one image data needs to be decoded, the decoding processing load on the decoder 417 does not increase.
- the receiver A's image data Notify information of all sessions that transmit coded data of pictures, P-pictures, B-pictures, and intra-macroblocks.
- the image data receiving apparatus of the receiver B is notified of the information of the session for transmitting the encoded data of the I picture, the P picture, and the B picture.
- the image data receiving apparatus of the receiver C is notified of the information of the session for transmitting the encoded data of the I picture and the P picture.
- the image data receiving devices of the receivers A and B receive the encoded data of all pictures.
- the highest quality (smooth motion) video images can be received.
- the image data receiving device of the receiver C can receive a moving image of the next image quality next, and the image data receiving device of the receiver D can receive only the I-picture and the lowest-quality moving image. You can only receive images. In this way, each recipient can make a difference in the quality of the received image.
- the receiver A's image data receiving device can complement the location if it can receive the intra-macroblock coded data.
- the image data receiving devices of receiver B, receiver C, and receiver D have no complementary information, so the image quality deteriorates. This makes it possible for each recipient to differ in the quality of the received image.
- the present embodiment it is possible to control the difference in image quality among the receivers by transmitting specific encoded data only to specific receivers by the unicast method.
- the I-picture coded data and the P-picture coded data are transmitted by the multicast or broadcast method as described above, and the B-picture coded data are transmitted to the receiver A and the receiver B by the unicast method.
- the same effect as above can be obtained by transmitting the intra-macroblock coded data to the receiver A only by the unicast method.
- the coded data of P pictures, B pictures, and intra-macroblocks are concealed, and the receiver A's image data receiving apparatus provides concealed P-picture, B-picture, and intra-macroblock codes.
- Information for restoring the coded data, and the image data receiving device of the receiver B is notified of information for restoring the encoded data of the P picture and the B picture, and the image data of the receiver C is notified.
- the same effect as described above can be achieved by notifying the receiving device of information for restoring the coded data of the P picture and not sending the information related to concealment to the image data receiving device of the receiver D. Fruit can be obtained.
- the image data receiving apparatus 410 when the image data receiving apparatus 410 is used in an environment where power is limited, such as when operating on a battery / battery, the intra-macroblock coded data is used. Alternatively, the reception of the B-picture coded data and the P-picture coded data may be stopped so that the use time of the apparatus is made as long as possible. Conversely, when a large capacity battery or an AC power supply is connected, the image data receiving device 410 may receive encoded data of all pictures. In this way, whether to receive data overnight is controlled according to the available power and the reception environment. You can also. In the present embodiment, the configuration may be such that the receiver can set the received picture encoded data in the image data receiving apparatus 410.
- I-picture and P-picture encoded data are distributed in one session
- B-picture encoded data is distributed in one session
- intra-macroblock encoded data is distributed in another session.
- Distribute distribute I-picture encoded data in one session, distribute P-picture and B-picture encoded data in one session, and distribute intra-macroblock encoded data in another session. The same effect as described above can be obtained by notifying the session information or the secret information of the distribution data in the same manner.
- the encoded data reconstructing section 416 periodically performs an infinite delay.
- macroblock coding even if an error or loss occurs in the transmission path, the same effect as the CEG (Cyclic Intra Refresh) of the MPEG-4 coding method is obtained.
- CEG Cyclic Intra Refresh
- the I-picture coded data transmission unit 405 of the image data distribution device 401 in the present embodiment P picture coded data transmission unit 406, B picture coded data transmission unit 407, Intra macroblock (Intra-MB) coded data transmission unit 408, packet multiplex transmission Unit 111 multiplexes the data into one session, adds the compression ratio of the image data and / or the identification information about the picture type to the transmission packet, and transmits the packet.
- I-picture coded data transmission unit 405 of the image data distribution device 401 in the present embodiment P picture coded data transmission unit 406, B picture coded data transmission unit 407, Intra macroblock (Intra-MB) coded data transmission unit 408, packet multiplex transmission Unit 111 multiplexes the data into one session, adds the compression ratio of the image data and / or the identification information about the picture type to the transmission packet, and transmits the packet.
- IP-MB Intra macroblock
- the received packet is separated into encoded image data and image data identification information by the unit 1102, and the compression ratio obtained from the image data identification information by the encoded data reconstructing unit 1103, and / or Information about picture type To determine data duplication However, if there is an overlap, the same effect can be obtained by selecting based on information about the compression ratio and reconstructing one coded data in the evening.
- the image data identification information for example, the payload type of the RTP header, SSRC, CSRC is used, or identification information corresponding to this is added.
- the sequence number of the RTP header or information equivalent thereto is added to each output of the image data distribution device 401 throughout the picture type.
- the identification of the picture type is performed. Even if information is not added, the same effect can be obtained by performing reordering by sequence numbers and reconstructing into one piece of encoded data.
- each part of the image data distribution device 401 and the image data reception device 410 is also controlled by a program executed by a computer constituting the image data distribution device and the image data reception device. ⁇ Needless to say, processing may be realized.
- the image data distribution apparatus is configured to transmit the same I-picture, P-picture data of a plurality of moving image data having the same image, the same encoding method, the same frame configuration, and different compression ratios.
- a means for multicast or broadcast distribution of B-pictures in different sessions if present in the encoding method used for encoding pictures and moving images, Means for notifying at least one session information (multicast address, port number, image quality, etc.), including the permitted quality.
- the image data receiving device receives the multicast or broadcast data from at least one session among the notified session information, and selects data based on the image quality from the received moving image data. And reconstruct it into one video data Decoding means.
- the presence or absence of reception of at least one image data is determined by at least one of an error Z loss rate of received data, available power, and a predetermined setting. Based on the above, a configuration may be further provided with means for selecting.
- the image data distribution device comprises: means for setting whether or not distribution data is concealed, a concealment means, a concealment strength for each session to be distributed, and means for notifying a receiver of confidentiality setting information to the receiver.
- the receiving device may be configured to receive the notified confidential information, restore the received data, and decrypt the moving image data.
- FIG. 5 shows the configuration of the fifth embodiment of the present invention.
- the image data distribution device 501 is connected to a transmission line 509 which is an IP (Internet Protocol) network, and distributes image encoded data using UDPZIP.
- IP Internet Protocol
- the data receiving device 5110 is a client terminal connected to the IP network.
- I-picture and P-picture there are two frame types, I-picture and P-picture, in the encoding method of the image data to be distributed, and the number of image data to be distributed is two.
- the image data overnight distribution device 501 includes a distribution information transmission unit 502, a session information management unit 503, an image data storage / generation unit 504, and transmission of I-picture coded data of image data 1. 505, P-picture coded data transmitter for image data 1 506, I-picture coded data transmitter for image data 2 507, P-picture coding for image data 2 It is equipped with a data transmission unit 508.
- the image data receiver 5 110 includes a session information receiver 5 11 1, an I-picture coded data receiver 5 1 2 for image data 1, and a P-picture coded data receiver 5 1 for image data 1 5 1 3.I-picture coded data receiving unit 5 14 for image data 2, P-picture coded data receiving unit 5 15 for image data 2, coded data reconstructing unit 5 16 and decoder 5 17 It has.
- the operations of the image data distribution device 501 and the image data reception device 510 will be described in order.
- the image data distribution device 501 is an image data storage Z generation unit 504,
- the I-picture coded data transmission unit 505 of the image data 1 the P-picture coded data transmission unit 506 of the image data 1, and the image The data 2 is transmitted via the transmission path 509 by the I picture encoded data transmission section 507 and the image data P picture encoded data transmission section 508.
- the session information management unit 503 manages information on sessions that are permitted to be delivered to the receiver, and relates to session information to be notified according to the receiver and image coding such as image quality and picture type. Information is transmitted from the distribution information transmitting unit 502 to the image data receiving device 5110.
- the picture-encoding transmitting section 508 is arranged such that when the image data receiving apparatus 510 receives a plurality of overlapping image data, the data can be selected and the order of the received data is changed. Even so, it has a function to add information corresponding to RTP (Real-Time Transport Protocol) so that sorting can be performed correctly.
- RTP Real-Time Transport Protocol
- the I picture coded data of image data 1 and the I picture coded data of image data 2, the P picture coded data of image data 1 and the P picture coded data of image data 2 are respectively For example, by adopting a configuration in which transmission is performed with a time difference that is longer than the burst length of the data error or loss in the transmission path 509, both of the image encoding data in the transmission path are erroneous, or The possibility of being affected by the loss is reduced, and more stable image data distribution can be achieved.
- the transmission time difference is managed by the session information management unit 503, and the The communication unit 5002 notifies the image data receiving apparatus 5110, or determines in advance between the image data distribution apparatus 501 and the image data receiving apparatus 501, and based on the time difference,
- the data receiving device 510 may set the receiving buffer amount (buffer size).
- the session information management unit 503 If the session information management unit 503 is set to conceal the distribution image data, the I-picture coded data transmission unit 505 for image data 1 and the P-picture coded data transmission unit 5 for image data 1 06, the I-picture coded data transmission unit 507 of the image data 2 and the P-picture coded data transmission unit 508 of the image data 2 perform concealment processing according to the settings, Information about concealment, such as a concealment method, is notified from the distribution information transmitting section 502 to the image data overnight receiving apparatus 5110.
- the image data receiving device 501 transmits the session information from the image data distribution device 501, information relating to image coding, and if the distribution data is concealed, information relating to concealment, and the session information.
- the receiving unit 511 receives the data, and based on these information, the I-picture coded data receiving unit 512 for image data 1, the P-picture coded data receiving unit 513 for image data 1, and the image data
- the I-picture coded data receiving unit 5 14 of 2 and the P-picture coded data receiving unit 5 15 of image data 2 open the session receiving port and receive the image data from the transmission path 509. .
- the received image data is concealed, the original image data is restored based on the information obtained by the session information receiving unit 511.
- the session information management section 503 includes the coding settings and coding options (used tools) for the coded image data 1 and the coded image data 2, the payload options for the coded data overnight, and the coding.
- Information corresponding to the payload type of the RTP header and / or SSRC and CSRC for identifying the encrypted data, and the distribution information transmitting unit 502 may notify the image data receiving device 501 of the image data. These pieces of information may be set in advance between the image data distribution device 501 and the image data reception device 501.
- the received I-picture of image data 1, P-picture of image data 1, I-picture of image data 2, and P-picture of image data 2 are transmitted to RTP by the encoded data reconstructing unit 5 16.
- the quality (compression ratio) of the image data 1 and the image data 2 is changed. Higher quality.
- the coded data of the I-picture of image data 1, the P-picture of image data 1, the I-picture of image data 2 and the P-picture of image data 2 are transmitted to the receiver A's image data receiver. Report all session information.
- the receiver B's image data overnight receiver is notified of the information of the session for transmitting the I picture of the image data 1, the I picture of the image data 2, and the P picture encoded data of the image data 2.
- the image data receiving device of the receiver C is notified of only the information of the session for transmitting the I picture of the image data 2 and the coded data of the P picture of the image data 2. Since the image data receiving device of the receiver A can receive all the coded data, it can receive the highest quality (smoothly moving) moving image. Even if there is an error or omission in the image, the relevant part can be complemented with the image data of the image encoded data 2.
- the image data receiving device of the receiver B can receive the moving image with the second highest image quality, and even if there is an error or omission in the I picture encoding Can be complemented by the I-picture encoding of image data 2.
- the receiver C's image data receiving device can only receive encoded data with a high compression rate.
- the I-picture and P-picture encoded data of image data 2 can be multicast or broadcast. —Transmit using the broadcast method, transmit the I-picture coded data of the image data 1 to the receivers of the receivers A and B by the unicast method, and transmit the P-picture coded data of the coded data 1
- the same effect as described above can be obtained by transmitting the image data to the receiver A only by the unicast method.
- all the receivers of the image data receivers are notified of the session information for transmitting the coded data of the I picture and the B picture of the image data 1, and the receiver A and the receiver B receive the image data receivers.
- the session information for transmitting the I-picture coded data of the image data 2 to the device, and the session information for transmitting the P-picture coded data of the image data 2 to the image data receiving device of the receiver A are further notified.
- receiver C cannot compensate for any errors or omissions in the received data, but receiver B is an I-picture coded data and receiver A is This can be complemented from the encoded data of image data 2 even during the encoding of the image, resulting in a difference in the stability of the image quality for each receiver.
- the quality of the coded image data 1 and the coded image data 2 is the same, or if the coded image data 1 is the same as the coded data 1 transmission unit 505, 506 and the image Encoding data 2
- the transmission units 507 and 508 By transmitting from the transmission units 507 and 508, it is possible to minimize the degradation of the reproduced image quality in the image data receiving device when there is an effect of errors or omissions in the transmission path. Becomes possible.
- the I-picture coded data of image data 1 and the P-picture coded data of image data 1 are transmitted in a multicast or broadcast format, and the I-picture coded data of image data 2 is transmitted to receiver A and receiver.
- a similar difference in image quality stability occurs when the image data 2 is transmitted to the receiver A by the unicast method and the P picture data of the image data 2 is transmitted to the receiver A by the unicast method.
- the band of the image coded data transmitted by the unicast method can be smaller, it is more desirable to suppress an increase in traffic.
- the I-picture and P-picture coded data of the image data 1 are concealed, and the receiver A's image data receiving device is notified of information for restoring the concealed image data 1, and the reception is performed. Only the information for restoring the I-picture coded data of the image data 1 to the image data receiving device of the receiver B is notified, and the image data Even if the information about concealment is not notified to the device, the same effect as described above (difference in image quality of the received image among the recipients) can be obtained.
- the image data receiving apparatus 5 10 when the image data receiving apparatus 5 10 is used in an environment where power is limited, such as when operating on a battery / battery, and / or in a good receiving environment, If coded data can be received with almost no errors or omissions, reception of P-picture coded data for image data 2 and I-picture coded data for image data 2 is stopped, and the use time of the device is reduced as much as possible. It may be longer. Conversely, when a large-capacity battery or an AC power supply is connected, the image data receiving device 510 may receive encoded data of all pictures. In this way, the presence or absence of data reception can be controlled according to the available power and the reception environment. Further, in the present embodiment, a configuration may be adopted in which the received picture coded data can be set in the image data receiving apparatus 5110 by the receiver.
- the configuration may be such that the session information is transmitted through different transmission paths.
- each transmission unit of the image data distribution device 501 in the present embodiment is transmitted by packet multiplex transmission.
- the packet is multiplexed into one session by the unit 1221, and the transmission packet is added with identification information on the compression ratio and picture type of the image data and transmitted.
- the same effect can also be obtained by judging the duplication of data and, if there is a duplication, by selecting based on the information on the compression ratio and reconstructing it into one encoded data.
- the identification information for example, the payload type of the RTP header, SSR C, C SRC is used, or information corresponding thereto is added.
- the sequence number of the RTP header or the information corresponding thereto is added to each output of the image data distribution device 501 throughout the picture type.
- the same effect can be obtained by re-arranging into one piece of encoded data by rearranging by sequence number without adding identification information on the picture type.
- the packet reception separation section 122 performs the same processing as the packet reception separation section 720 in the first embodiment.
- each unit in the image data distribution device 501 and the image data reception device 501 is also executed by a computer constituting the image data distribution device and the image data reception device.
- each function and process may be realized by program control.
- the image data distribution device is an I picture for each of a plurality of moving image data having the same image, the same encoding method, the same frame configuration, and different compression ratios.
- P picture, and at least a part of the frame of the moving picture, if present in the coding method used for coding the moving picture is intra-macroblock (Intra-MB) coding.
- the image data receiving apparatus receives, from the notified session information, means for receiving data multicast or broadcast distributed by at least one session, and selects data based on the image quality from the received moving image data. Means for reconstructing and decoding one set of moving image data. In the sixth embodiment of the present invention, whether or not at least one image data is received is determined based on at least one of an error / loss rate of received data, available power, and a predetermined setting. Alternatively, a configuration may further be provided with means for selecting. Further, the image data distribution device comprises: means for setting whether or not distribution data is concealed, a concealment means, a concealment strength for each session to be distributed, and means for notifying a receiver of confidentiality setting information to the receiver. The receiving device may be configured to receive the notified confidential information, restore the received data, and decode the moving image data.
- FIG. 6 shows the configuration of the sixth embodiment of the present invention.
- the apparatus comprises an image data distribution device 6001, an image data overnight receiving device 6111, and a transmission line 6110 for transmitting moving image encoded data.
- the image data distribution device 601 is connected to a transmission line 610 which is an IP (Internet Protocol) network, and distributes image encoded data using UDP / IP.
- the receiving device 6 11 is a client terminal connected to the IP network.
- IP Internet Protocol
- the image data distribution device 600 includes a distribution information transmission unit 602, a session information management unit 603, an image data storage Z generation unit 604, and an I-picture coded data transmission unit 6 for image data 1.
- P-picture coded data transmitter for image data 1 606, intra-macroblock (Intra-MB) coded data transmitter 607, I-picture coded data transmitter for image data 2 6 08, a P-picture encoded data transmission section 609 for image data 2.
- the image data receiver 6 1 1 includes a session information receiver 6 1 2, an I picture encoded data receiver 6 13 for image data 1, and a P-picture encoded data receiver 6 1 4 for image data 1. , Intra-macroblock (Intra-MB) coded data receiving section 615, I-picture coded data receiving section 6-16 for image data 2, P-picture coded data receiving section 6-1 7 for image data 2 And a coded data reconstructing unit 6 18 and a decoder 6 19.
- Intra-macroblock (Intra-MB) coded data receiving section 615 Intra-macroblock (Intra-MB) coded data receiving section 615, I-picture coded data receiving section 6-16 for image data 2, P-picture coded data receiving section 6-1 7 for image data 2
- the operations of the image data overnight distribution device 600 and the image data receiving device 611 will be described in order.
- the image data distribution device 600 is an image data overnight storage / generation unit 604, • Image data stored in advance, or
- the I-picture coded data transmission unit 605 of the image data 1 the P-picture coded data transmission unit 606 of the image data 1
- the MB coded data transmitter 607, the I picture coded data transmitter 608 for image data 2, and the P picture coded data transmitter for image data 2 are transmitted via the transmission line 610 by the overnight transmitter 609. .
- the session information management unit 603 manages information on sessions that are permitted to be delivered to the receiver, and provides information on session information to be notified according to the receiver and information on image coding such as image quality and image type. Is transmitted from the distribution information transmitting unit 602 to the image data receiving device 6 11.
- I-picture coded data transmitter 605 of image data 1 P-picture coded data transmitter 606 of image data 1, Intra-MB coded data transmitter 607, image data 2
- the I-picture coded transmission unit 608 and the P-picture coded transmission unit 609 for image data 2 select the data when the image data receiving device 611 receives multiple overlapping image data.
- it has a function to add information corresponding to RTP (Real-Time Transport Protocol) so that it can be rearranged correctly even if the order of received data is changed.
- RTP Real-Time Transport Protocol
- the unit is a data that encodes the same part of the same frame of the same image, and the same RTP sequence number is used for the intra-macro block coded data that encodes the same part. And a payload type and / or SSRC, and / or CSRC, which indicates which image is to be encoded.
- the I picture coded data of the image data 1 and the I picture coded data of the image data 2 the P picture coded data of the image data 1 and the P picture coded data of the image data 2, Data error at 1 0, or If transmission is performed with a time difference longer than the burst length of the loss, the possibility that both of the image-encoded data on the transmission line are erroneous or affected by the loss is reduced, and a more stable image data is transmitted. Can be delivered.
- the transmission time difference is managed by the session information management unit 603 and notified from the distribution information transmission unit 602 to the image data receiving device 611, or the image data distribution device 601 and image data reception are performed in advance.
- the image data overnight receiving device 611 may set the receiving buffer amount based on the time difference between the devices 6 11.
- the session information management section 603 is set to conceal the distribution image data, the I picture coded data transmission section 605 of the image data 1 and the P picture coded data transmission section 6 of the image data 1 06, Intra-MB coded data transmitter 607, I-picture coded data transmitter 608 for image data 2, P-picture coded data transmitter 609 for image data 2
- concealment processing is performed, and information on concealment such as presence / absence of concealment and a concealment method is notified from the distribution information transmitting unit 602 to the image data overnight receiving device 611.
- the image data receiving device 611 transmits the session information from the image data distribution device 6 01, the information related to image encoding, and the information related to concealment when the distribution data is concealed. It is received by the session information receiving unit 6 12, and based on this information, the I picture encoded data receiving unit 6 13 of image data 1 and the P-picture encoded data receiving unit 6 14 ntra-MB coded data receiving unit 615, I-picture coded data receiving unit for image data 2 616, P-picture coded data receiving unit for image data 2 617 open session reception port and transmit The image data from the path 610 is received. If the received image data is concealed, the original image data is restored using the information obtained by the session information receiving unit 6 12.
- the session information management section 603 sets the encoding settings for the image encoded data 1 and the image encoded data 1, the encoding option (used tool), the payment option of the encoded data,
- the payload type of the RTP header for identifying the encoded data, and information corresponding to Z, SSRC, CSRC may be set, and the distribution information transmitting unit 62 may notify the image data receiving device 6 11 of the encoded data.
- the settings may be set in advance between the image data distribution device 601 and the image data reception device 611.
- the encoded data of the received I-picture of image data 1, P-picture of image data 1, intra-macroblock, I-picture of image data 2, and P-picture of image data 2 are encoded by encoded data reconstructing unit 6 18 Based on the image quality based on the function equivalent to RTP, the sequence number of the RTP header, the payload type, information by SSRC or CSRC, and / or information received by the session information receiver 6 12 Then, data is selected, reconstructed into one 'moving image stream, and output to the decoder 6 19. Since only one image data needs to be decoded, the load on the decoding process of the decoder 610 does not increase.
- the image data of the receiver A, the receiver B, the receiver C, and the receiver D can be controlled by the image data 1 and the image data 2 Change the quality (compression ratio), for example, to make image data 1 higher quality.
- the image data receiving device of the receiver B is notified of the information of the session for transmitting the coded data of the I picture of the image data 1, the I picture of the image data 2, and the P picture of the image data 2.
- the image data receiving apparatus of the receiver D is notified of only the information of the session for transmitting the I picture of the image data 2 and the encoded data of the P picture of the image data 2. Since the image data receiving device of the receiver A can receive all the coded data, it can receive the highest quality (smoothly moving) moving image. Even if there is an error or omission in the image, the relevant part can be complemented with the image data of the image encoded data 2.
- the image data receiving device of the receiver B can receive a moving image with the next highest image quality. Even if there is an error or omission in the I-picture coded data of the image data 1, it is possible to supplement the corresponding portion with the I-picture coded data of the image data 2.
- the image data receiving device of the receiver C can receive only the image data 2 and the intra-macroblock coded data with high compression ratio, but even if there is an error or omission in the received coded data, If the intra-macroblock coded data at that location can be received, this can be complemented.
- the image data receiving apparatus of the receiver D can receive only the image data 2 with a high compression rate, and the image quality is degraded if there is an error or omission in the data.
- the image quality of the received image can be different for each receiver.
- the I-picture and P-picture coded data of the image data 2 are transmitted in a multicast or broadcast method, and the intra-macroblock coded data is transmitted to the image data receiving apparatus of the receiver C by the unicast method.
- the same effect as described above can be obtained by transmitting only to the unicast system.
- all the receivers of the image data are notified of the session information for transmitting the coded data of the I picture and the B picture of the image data 1 to the image data receivers of the receivers, and the receiver C's image data receivers are subjected to the intra-macroblock coding.
- Notify the session information for transmitting the data and notify the receivers A and B of the image data and the receiver of the session information for transmitting the I picture coded data of the image data 2 to the receivers.
- the receiver D should compensate for any errors or omissions in the received data.
- the receiver C can receive the intra-macroblock coded data at the relevant location, it can supplement this. If No. Cadet Isseki sign of recipient A is either a picture
- the quality of the coded image data 1 and the coded image data 2 is the same, or the coded image data 1 is transmitted to the coded data 1 transmitting sections 605, 606 and the coded image data By transmitting from the data 2 transmitter 608 and 609, it is possible to minimize the deterioration of the reproduced image quality at the image data receiving device when there is an error or omission on the transmission line It becomes.
- I-picture coded data of image data 1 and P-picture coded data of image data 1 are transmitted in a multicast or broadcast format, and intra-macroblock coded data is transmitted to receiver C in a unicast format.
- the I-picture coded data of image data 2 is transmitted to receiver A and receiver B in a unicast format, and the P-picture coded data of image data 2 is transmitted to receiver A in a unicast format.
- a similar difference in image quality stability occurs.
- the band of the image coded data transmitted by the unicast method can be smaller, it is more desirable to suppress an increase in traffic.
- the coded data of the I picture, P picture, and intra-macro block of the image data 1 is concealed, and the concealed image data 1 is restored to the image data receiving apparatus of the receiver A.
- the receiver B's image data receiver only information for restoring the I-picture coded data of the image data 1 to the receiver, and to the receiver C's image data receiver, an intra- A similar effect can be obtained by notifying only the information for restoring the macroblock coded data to the image data receiving apparatus of the receiver D and not sending the information regarding concealment.
- the image data receiving device 6 11 when the image data receiving device 6 11 is used in an environment where power is limited, such as operating on a battery / battery, and Z or the receiving environment is good, If the data can be received almost without errors or omissions, the intra-macroblock coded data and / or the P-picture coded data of image data 2 and the I-picture coded data of image data 2 Stop reception and extend the usage time of the device as much as possible.On the other hand, connect a large capacity battery or AC power. If the connection is continued, it is possible to control whether or not to receive data overnight according to the available power and the reception environment, such as receiving encoded data for all pictures. Further, the receiver may set the received encoded picture data in the image data receiving device 611.
- the encoded data reconstructing unit 618 periodically performs an infinite delay. If macro-block coded data is selected, even if an error or loss occurs on the transmission line, the same effect as the CEG (Cyclic Intra Refresh) of the MPEG-4 coding method can be obtained. As a result, it is possible to quickly recover the degradation of the reproduced image quality due to an error or loss in the transmission path, and to suppress the propagation of the quality degradation to subsequent frames.
- CEG Cyclic Intra Refresh
- the I-picture coded data of the image data 1, the P-picture coded data of the image 1, the intra-macroblock coded data, the I-picture coded data of the image data 2, and the The configuration may be such that P-picture coded data and session information are transmitted through different transmission paths.
- the I picture encoding of the image data 1 of the image data distribution device 601 in this embodiment is performed as shown in FIG.
- Data transmitter 605 P-picture coded data transmitter for image data 1 606, Intra macroblock coded data transmitter 607, Image data 2 I-picture coded data transmitter 608,
- the output of the P-picture coded data transmission unit 609 of the image data 2 is multiplexed into one session by the packet multiplex transmission unit 1301, and the transmission packet has identification information on the image data compression ratio and picture type.
- the packet is separated and transmitted by the packet reception separating unit 1302 of the image data receiving device 6111, and the packet is separated by the encoded data reconstructing unit 1303.
- the same effect can be obtained.
- the identification information for example, the payload type of the RTP header, SS RC, CS RC is used, or information corresponding thereto is added.
- the sequence number of the RTP header or information corresponding thereto is added to each output of the image data distribution device 601 throughout the picture type, identification information relating to the picture type is not added.
- the same effect can be obtained by reconstructing one piece of encoded data by rearranging by the identification information on the image data type and the sequence number.
- the packet reception demultiplexing unit 1322 performs the same processing as that of the bucket reception demultiplexing unit 720 in the first embodiment.
- each unit in the image data distribution device 61 and the image data receiving device 611 is also a computer that constitutes the image data distribution device and the image data receiving device. It goes without saying that each function and processing may be realized by controlling the program to be executed.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2005504871A JPWO2004071089A1 (ja) | 2003-02-07 | 2004-02-05 | 画像データ配信制御方法及び装置とシステムならびにプログラム |
| US10/544,403 US20060123456A1 (en) | 2003-02-07 | 2004-02-05 | Video data distribution control method, device, system and program |
| EP04708439A EP1592252A4 (en) | 2003-02-07 | 2004-02-05 | VIDEO DATA DISTRIBUTION CONTROL, DEVICE, SYSTEM AND PROGRAM |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2003-031174 | 2003-02-07 | ||
| JP2003031174 | 2003-02-07 | ||
| JP2003-391933 | 2003-11-21 | ||
| JP2003391933 | 2003-11-21 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2004071089A1 true WO2004071089A1 (ja) | 2004-08-19 |
Family
ID=32852690
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2004/001176 Ceased WO2004071089A1 (ja) | 2003-02-07 | 2004-02-05 | 画像データ配信制御方法及び装置とシステムならびにプログラム |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20060123456A1 (ja) |
| EP (1) | EP1592252A4 (ja) |
| JP (1) | JPWO2004071089A1 (ja) |
| KR (1) | KR100808306B1 (ja) |
| CN (2) | CN101686377A (ja) |
| WO (1) | WO2004071089A1 (ja) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014220840A (ja) * | 2005-04-08 | 2014-11-20 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | マルチキャスト通信またはブロードキャスト通信において拡張したファイル配信を行う方法および装置 |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8224896B2 (en) * | 2005-11-23 | 2012-07-17 | Cisco Technology, Inc. | Methods and apparatuses for locating and contacting an invited participant of a meeting |
| JP2008141373A (ja) * | 2006-11-30 | 2008-06-19 | Matsushita Electric Ind Co Ltd | 復号化装置、移動体受信装置、メディア再生装置 |
| US9325682B2 (en) * | 2007-04-16 | 2016-04-26 | Tailstream Technologies, Llc | System for interactive matrix manipulation control of streamed data and media |
| KR20090011223A (ko) * | 2007-07-25 | 2009-02-02 | 삼성전자주식회사 | 방송처리장치 및 그 제어방법 |
| US8387097B2 (en) * | 2007-08-24 | 2013-02-26 | Lg Electronics Inc. | Digital broadcasting system and method of processing data in the digital broadcasting system |
| US7995494B2 (en) * | 2009-04-08 | 2011-08-09 | At&T Intellectual Property I, L.P. | Method and apparatus for conducting media quality measurements at a gateway |
| US9124523B2 (en) * | 2009-11-06 | 2015-09-01 | Comcast Cable Communications, Llc | Failover with redundant multicasts for switched digital video |
| US8938013B2 (en) * | 2010-03-16 | 2015-01-20 | Cleversafe, Inc. | Dispersal of priority data in a dispersed storage network |
| JP5512045B2 (ja) * | 2011-07-25 | 2014-06-04 | 三菱電機株式会社 | 暗号化装置、暗号化方法及び暗号化プログラム |
| US9292826B1 (en) * | 2011-12-21 | 2016-03-22 | Time Warner Cable Enterprises Llc | Adaptive bit rates in multicast communications |
| US10158898B2 (en) | 2012-07-26 | 2018-12-18 | Comcast Cable Communications, Llc | Customized options for consumption of content |
| US9307021B2 (en) * | 2013-02-27 | 2016-04-05 | Comcast Cable Communications, Llc | Adaptive media transmission processing |
| US9402107B2 (en) | 2013-03-15 | 2016-07-26 | Time Warner Cable Enterprises Llc | Apparatus and methods for delivery of multicast and unicast content in a content delivery network |
| US9066153B2 (en) | 2013-03-15 | 2015-06-23 | Time Warner Cable Enterprises Llc | Apparatus and methods for multicast delivery of content in a content delivery network |
| JP2019029931A (ja) * | 2017-08-02 | 2019-02-21 | キヤノン株式会社 | 映像送信装置、映像受信装置、映像送受信システム、制御方法、並びにプログラム |
| EP3616668A1 (fr) * | 2018-09-03 | 2020-03-04 | Bodyfeed | Table de massage vibrante |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0923214A (ja) * | 1995-07-05 | 1997-01-21 | Hitachi Ltd | ディジタル信号送受信装置 |
| JPH1023380A (ja) * | 1996-06-28 | 1998-01-23 | Canon Inc | 画像通信システム、画像通信装置、画像通信方法および媒体 |
| JPH11177628A (ja) * | 1997-12-15 | 1999-07-02 | Mitsubishi Electric Corp | 広域環境用3次元仮想空間共有システム |
| JP2002094560A (ja) * | 2000-09-12 | 2002-03-29 | Sony Corp | 情報提供方法 |
| JP2002353964A (ja) * | 2001-05-30 | 2002-12-06 | Sony Corp | コンテンツ提供装置及びコンテンツ提供方法 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7213005B2 (en) * | 1999-12-09 | 2007-05-01 | International Business Machines Corporation | Digital content distribution using web broadcasting services |
| KR20020070362A (ko) * | 1999-12-22 | 2002-09-06 | 제너럴 인스트루먼트 코포레이션 | 공간 스케일성 및 시뮬캐스트 코딩을 이용한 멀티캐스트환경의 비디오 압축 |
| JP3662473B2 (ja) * | 2000-05-12 | 2005-06-22 | 株式会社エヌ・ティ・ティ・ドコモ | マルチキャストサービス提供方法及び情報配信装置 |
| US7003794B2 (en) * | 2000-06-27 | 2006-02-21 | Bamboo Mediacasting, Inc. | Multicasting transmission of multimedia information |
| JP2002251494A (ja) * | 2000-12-20 | 2002-09-06 | Victor Co Of Japan Ltd | デジタルコンテンツデータ配信システム |
| US20020163964A1 (en) * | 2001-05-02 | 2002-11-07 | Nichols James B. | Apparatus and method for compressing video |
-
2004
- 2004-02-05 JP JP2005504871A patent/JPWO2004071089A1/ja active Pending
- 2004-02-05 EP EP04708439A patent/EP1592252A4/en not_active Withdrawn
- 2004-02-05 WO PCT/JP2004/001176 patent/WO2004071089A1/ja not_active Ceased
- 2004-02-05 CN CN200910174561A patent/CN101686377A/zh active Pending
- 2004-02-05 CN CNA2004800037532A patent/CN1748421A/zh active Pending
- 2004-02-05 KR KR1020057014467A patent/KR100808306B1/ko not_active Expired - Fee Related
- 2004-02-05 US US10/544,403 patent/US20060123456A1/en not_active Abandoned
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0923214A (ja) * | 1995-07-05 | 1997-01-21 | Hitachi Ltd | ディジタル信号送受信装置 |
| JPH1023380A (ja) * | 1996-06-28 | 1998-01-23 | Canon Inc | 画像通信システム、画像通信装置、画像通信方法および媒体 |
| JPH11177628A (ja) * | 1997-12-15 | 1999-07-02 | Mitsubishi Electric Corp | 広域環境用3次元仮想空間共有システム |
| JP2002094560A (ja) * | 2000-09-12 | 2002-03-29 | Sony Corp | 情報提供方法 |
| JP2002353964A (ja) * | 2001-05-30 | 2002-12-06 | Sony Corp | コンテンツ提供装置及びコンテンツ提供方法 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP1592252A4 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014220840A (ja) * | 2005-04-08 | 2014-11-20 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | マルチキャスト通信またはブロードキャスト通信において拡張したファイル配信を行う方法および装置 |
| JP2016184971A (ja) * | 2005-04-08 | 2016-10-20 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | マルチキャスト通信またはブロードキャスト通信において拡張したファイル配信を行う方法および装置 |
| JP2018201215A (ja) * | 2005-04-08 | 2018-12-20 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | マルチキャスト通信またはブロードキャスト通信において拡張したファイル配信を行う方法および装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1592252A1 (en) | 2005-11-02 |
| CN101686377A (zh) | 2010-03-31 |
| US20060123456A1 (en) | 2006-06-08 |
| EP1592252A4 (en) | 2010-05-12 |
| KR100808306B1 (ko) | 2008-02-27 |
| KR20050096975A (ko) | 2005-10-06 |
| JPWO2004071089A1 (ja) | 2006-06-01 |
| CN1748421A (zh) | 2006-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wenger et al. | RTP payload format for H. 264 video | |
| KR100960282B1 (ko) | 비디오 부호화 | |
| Wee et al. | Secure scalable video streaming for wireless networks | |
| Schierl et al. | Using H. 264/AVC-based scalable video coding (SVC) for real time streaming in wireless IP networks | |
| CN100380976C (zh) | 运动画面数据的代码转换/发送方法和装置和运动画面数据的代码转换/接收方法和装置 | |
| CN1914922B (zh) | 内容的编码、分发及接收的方法、装置、系统 | |
| US7627184B2 (en) | Content distribution/reception device, content transmission/reception method, and content distribution/reception program | |
| WO2004071089A1 (ja) | 画像データ配信制御方法及び装置とシステムならびにプログラム | |
| Lu | Signal processing for Internet video streaming: A review | |
| CN105049894A (zh) | 用于视频通信系统中的差错弹性和随机接入的系统和方法 | |
| CN1754385B (zh) | 图像数据分发装置、方法及图像数据接收方法 | |
| JP3439361B2 (ja) | 画像符号化装置および動画像伝送システム | |
| Wenger et al. | RFC 3984: RTP payload format for H. 264 video | |
| Psannis et al. | Impact of video coding on delay and jitter in 3G wireless video multicast services | |
| US20110191448A1 (en) | Subdivision of Media Streams for Channel Switching | |
| Noh et al. | Robust mobile video streaming in a peer-to-peer system | |
| Vilei et al. | A novel unbalanced multiple description scheme for video transmission over wlan | |
| Psannis et al. | Efficient Support of Wireless Video Multicast Services in 3G and Beyond | |
| Reguant et al. | Delivery of H264 SVC/MDC streams over Wimax and DVB-T networks | |
| HK1080652A (en) | Video data distribution control method, device, system, and program | |
| Zhao | Design and implementation of video surveillance system based on CDMA cellular wireless networks | |
| HK1090220A (en) | Content distribution/reception device, content transmission/reception system, content distribution/reception method, and content distribution/reception program | |
| Lyonnet et al. | Architecture Considerations for Video Conferencing in the Internet with Wireless Links | |
| Stockhammer et al. | Mobile TV—‘Daumenkino’gets reality | |
| Park et al. | Effective Relay Communication for Scalable Video Transmission |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 2005504871 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 1020057014467 Country of ref document: KR |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 20048037532 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004708439 Country of ref document: EP |
|
| WWP | Wipo information: published in national office |
Ref document number: 1020057014467 Country of ref document: KR |
|
| WWP | Wipo information: published in national office |
Ref document number: 2004708439 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2006123456 Country of ref document: US Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 10544403 Country of ref document: US |
|
| WWP | Wipo information: published in national office |
Ref document number: 10544403 Country of ref document: US |