WO2006092770A2 - Streamed file system for optical disc applications - Google Patents

Streamed file system for optical disc applications Download PDF

Info

Publication number
WO2006092770A2
WO2006092770A2 PCT/IB2006/050659 IB2006050659W WO2006092770A2 WO 2006092770 A2 WO2006092770 A2 WO 2006092770A2 IB 2006050659 W IB2006050659 W IB 2006050659W WO 2006092770 A2 WO2006092770 A2 WO 2006092770A2
Authority
WO
WIPO (PCT)
Prior art keywords
data
presentation
application
transport stream
application data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2006/050659
Other languages
French (fr)
Other versions
WO2006092770A3 (en
Inventor
Hendrick F. Moll
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
US Philips Corp
Original Assignee
Koninklijke Philips Electronics NV
US Philips Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV, US Philips Corp filed Critical Koninklijke Philips Electronics NV
Priority to EP06711009A priority Critical patent/EP1859624A2/en
Priority to CN2006800068262A priority patent/CN101133646B/en
Priority to JP2007557659A priority patent/JP2008537273A/en
Priority to US11/817,507 priority patent/US20090125810A1/en
Publication of WO2006092770A2 publication Critical patent/WO2006092770A2/en
Publication of WO2006092770A3 publication Critical patent/WO2006092770A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H04N21/4349—Demultiplexing of additional data and video streams by extracting from data carousels, e.g. extraction of software modules from a DVB carousel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B19/00—Driving, starting, stopping record carriers not specifically of filamentary or web form, or of supports therefor; Control thereof; Control of operating function ; Driving both disc and head
    • G11B19/02—Control of operating function, e.g. switching from recording to reproducing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42646—Internal components of the client ; Characteristics thereof for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal

Definitions

  • the invention relates to the field of transferring multimedia content to and from optical storage.
  • US 2004/0013416 shows an optical disk player that retrieves audio, video and application data from optical disk using an MPEG/MPEG2 format.
  • MPEG MPEG based systems
  • the head of the drive is busy reading MPEG data from the disc cannot be moved freely during operation.
  • accessing application data in accordance with this patent document will generally require interruption of any audio/video presentation that a user is experiencing, or alternatively require very large data buffers.
  • a storage and retrieval format is used that interleaves all types of data into a transport stream, including audio, video and application data.
  • the application data repeats.
  • An example of a data format that can be used for the application data is a carousel.
  • Fig. 1 shows reading a data stream from an optical disk file system to retrieve audio, video, subtitle, and application data.
  • Fig. 2 shows recording a data stream to disk, the data stream including audio, video, subtitle, and application data.
  • FIG. 3 shows more detail of interleaving application data into a transport stream with audio & visual data.
  • Fig. 4 shows schematically an embodiment of how the invention would look in operation.
  • the invention is most likely to be useful in optical disk environments, particularly in the blu-ray disk (BD) such as documented in Blu-ray Disc Founders, "The Blu-ray Disc Format," Aug. 2004. This document can be found at the official web site of the Blu-ray Disc Association - http://www.blu-
  • transport streams can hold multiple elementary streams.
  • the logical format is a file system, in other words like the DVD (Digital Video Disc) or the Universal Disk Format (UDF) version 2.5. Within that file system, there is room for much more data, so bigger files can be stored. Bandwith is also higher.
  • the data rate can go as high as 25 Mega-bits/s. Transport streams containing high definition ("HD") video can be read.
  • HD high definition
  • BD format standardization for video streams and interactivity includes Java programs that can do things while the user is watching a program.
  • One possible application is to provide extra textual and photographic information on the actors of a movie or the participants of a sports event. This information can be shown on a part of the screen while the video is shown in a scaled way in the remainder of the screen (picture in picture) .
  • Another possible alternative is that the information can be shown semi- transparently on top of the video.
  • the Java program may require additional data while an HD video stream is being read and decoded from the disc.
  • UDF format typically application data and Java byte code are stored in different places from data for audio/video presentations.
  • allocation rules i.e. rules regarding where to put the audio/video stream data on the disc — ensure uninterrupted playback of the audio and video.
  • Java program data such rules do not apply. In other words, it cannot be predicted what data an interactive program needs next. Therefore, if the host platform needs application data or additional program code for an application program, it has to interrupt the audio/video presentation to get that data or code.
  • application data will be used to mean application data and/or code.
  • Fig. 1 shows an embodiment of a data retrieval system in accordance with the invention.
  • Data from an optical disk file system 113 is retrieved using a disk head 110 in the form of a transport file 112.
  • the transport file has a stream format as illustrated at 111.
  • audio information is shown with vertical hatching; subtitles with horizontal; application data is shown with hatching that slants down from left to right; and video data is shown with hatching that slants up from left to right.
  • the transport stream 111 goes to demultiplexer 105, which separates out the audio, video and subtitle data 114, which are output to the user at 107, 108, and 109, respectively.
  • the application data is demultiplexed to a unit 104.
  • Unit 104 processes the packets in the elementary stream that contains all the file system data. These packets are generated on recording by a packetizer 208, which will be discussed further below with reference to Fig 2.
  • the unit 104 retrieves any application code or data files the application needs on request of the application by filtering out the relevant packets and assembling them back into their original files — also shown with respect to Fig. 4.
  • the decoded files 103 are stored in application memory 102, where they are used for application execution and rendering at 106. Files can be delivered from the stream via streamed packets. Preferably the application data is stored and retrieved in a repeating format, such as the DSM — CC format, formerly used only in broadcasting.
  • a repeating format such as the DSM — CC format, formerly used only in broadcasting.
  • the use of MHP/DSM-CC file formats in broadcasting has been documented in Steven Morris, "Interactive TV Web" ⁇ MdlMM ⁇ M ⁇ I ⁇ h ⁇ &l ⁇ QlMI ⁇ M ⁇ MSI ⁇ M.
  • the DSM — CC format used for broadcast content, allows application code and data, including a directory tree, to be stored in a format called a "carousel.”
  • carousel is used, in analogy with an old-fashioned carnival ride, to indicate that the data is presented in a repeating fashion, as if the receiver were watching a rotating carousel.
  • the advantage of this format is that all necessary data is presented fairly frequently, so that an application program can use it without pausing to wait for new data. It is desirable to store and retrieve application data with respect to an optical disc as part of a transport stream transport stream, where the application is organized within the transport stream in a repeating format, such as the carousel of the broadcast DSM — CC.
  • Caching is known in the art prior art. Caching all the data a program might ever need is an alternative solution, but it restricts the maximum size of the data to the size of the cache. For a system to use DSM-CC, some caching of retrieved section of data is also needed. Typically this cache size is related with the size of the files in the carousel and the number of files that a system can retrieve concurrently from the stream. With the example numbers used above, if the data would consist of 100 files of size 100- lOOOKbyte, a buffer of 2 Mbyte would allow 2-10 files to be retrieved at the same time. The choice of the buffer size influences the performance in terms of latency of the carousel.
  • the exact information that is retrieved from the carousel is under user control via the application program, e.g. using remote control keys.
  • Fig. 2 shows an embodiment of a device for storing data in accordance with the invention.
  • Audio, video, and subtitle content which are to be used to make up a presentation to a user are encoded in respective encoders at 201, 202, and 203.
  • Application code files are made available at 204. All four types of content and/or data are packetized in respective packetizers at 205, 206, 207, and 208. The resulting packets are multiplexed at 212 to create the transport stream 209.
  • This transport stream becomes transport stream file 211, which is then stored to the optical disk system 113.
  • application code files 204 can be provided directly to the optical disk file system 113 at 210.
  • the stream 209 is preferably organized so that the application data repeats, for instance as a carousel, like that shown in the broadcast standard, DSM - CC.
  • FIG.s 1 and 2 are shown as separate devices, they might be housed together in a single device. Typically however what is drawn in figure 2 is part of the production process of optical disc and what is drawn in figure 1 is part of a optical disc player. In an optical disc system that can play back from disc as well as record data on optical disc both can be included.
  • Fig. 3 shows more detail of an example of how application data and code may be stored in accordance with the invention.
  • the file structure includes files aaa and bbb in directory dl ; files ccc and eee in directory d2; and directory d2 in directory dl.
  • This is just an example of a file structure. More or less files might be used. More or less directories might be used. The directories might be nested differently. Those of ordinary skill in the art know how to design file structures as necessary for particular applications.
  • the data from the file structure 301 are shown cut into pieces.
  • Directory dl is shown cut into 2 pieces, both labeled, dl.
  • File aaa is shown cut into four pieces, each labeled a.
  • File bbb is shown cut into four pieces, each labeled b.
  • Directory d2 is shown cut into 2 pieces, each labeled d2.
  • File ccc is shown cut into 3 pieces, each labeled c.
  • File eee is shown cut into four pieces, each labeled e. These numbers of pieces are also only examples.
  • Files or directories might be cut into more or less pieces, in accordance with known DSM-CC technology.
  • Each piece from 302 is concatenated into a carousel cycle shown at 303.
  • the carousel cycle is shown repeated three times, forming an elementary stream. Three times is also just an example. More or less repetitions might be desirable depending on the needs of the application.
  • the elementary stream is packetized to yield packets 305. Again, the number of packets shown is only an example. More or less packets might be used. Those of ordinary skill in the art know how to determine how many packets and what size packets are necessary, in order to make the application work.
  • the packets of application data and code (D) are interleaved with packets of video data (V), audio data (A), and subtitle data (S) to form a transport stream.
  • This transport stream is then made into a transport file 307, which becomes a part 309 of a file structure 308.
  • the file structure 308 is then stored in the optical disk file system
  • FIG. 4 shows an example of an application program using a data stream in accordance with the invention.
  • a display screen is shown at 401. This might be a display screen on a television, or other similar consumer electronics device, such as a PC.
  • the screen
  • the 401 is showing two windows, or picture-in-picture displays.
  • the first is a video window 402 where a standard television program might be shown.
  • the second is an application area 403, where image and/or text data from an application might be shown. For instance, biographical information about a movie star might appear under his picture.
  • An application program 406 resides in an optical disk player 405.
  • the user 404 will typically interact with the application program 406 via a remote control or other similar mechanism, though other user input devices might also be used.
  • the application program will also communicate with the area 403.
  • the transport file stream 307 is retrieved from the optical disk file system 113.
  • the file structure 301 is reconstructed from the transport stream 307 to support the application program 406.
  • Audio, video and/or subtitle data are also communicated at 408 to the television or other similar consumer electronics device.
  • HD-DVD High Definition - Digital Video Disks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

An optical disk player (101, 405) can run an application program (406) while also showing an audio/video presentation (402) to a user. In order to ensure uninterrupted viewing of the presentation for the user, the application program must secure application data from the optical disk (113) at the same time as audio/video data is being retrieved. This is facilitated if the audio and video data are stored interleaved together with the application data in a transport stream(111, 203, 306). Preferably the application data is in a format (306) that repeats frequently, so that the application program (406) can pick it up in many different parts of the audio/video presentation (402), without interrupting the audio/video presentation (402). An example of a format that repeats frequently is a carousel.

Description

STREAMED FILE SYSTEM FOR OPTICAL DISC APPLICATIONS
The invention relates to the field of transferring multimedia content to and from optical storage.
US 2004/0013416 shows an optical disk player that retrieves audio, video and application data from optical disk using an MPEG/MPEG2 format. In MPEG based systems, the head of the drive is busy reading MPEG data from the disc cannot be moved freely during operation. As a result, accessing application data in accordance with this patent document will generally require interruption of any audio/video presentation that a user is experiencing, or alternatively require very large data buffers.
It would be desirable to be able to retrieve audio and video data from an optical disk at the same time as application data, without the user experiencing any interruption of an audio/video presentation.
Preferably, a storage and retrieval format is used that interleaves all types of data into a transport stream, including audio, video and application data. Preferably the application data repeats. An example of a data format that can be used for the application data is a carousel.
The invention will now be described by way of non-limiting example with reference to the drawing in which:
Fig. 1 shows reading a data stream from an optical disk file system to retrieve audio, video, subtitle, and application data.
Fig. 2 shows recording a data stream to disk, the data stream including audio, video, subtitle, and application data.
Fig. 3 shows more detail of interleaving application data into a transport stream with audio & visual data. Fig. 4 shows schematically an embodiment of how the invention would look in operation.
The invention is most likely to be useful in optical disk environments, particularly in the blu-ray disk (BD) such as documented in Blu-ray Disc Founders, "The Blu-ray Disc Format," Aug. 2004. This document can be found at the official web site of the Blu-ray Disc Association - http://www.blu-
In BD, transport streams can hold multiple elementary streams. The logical format is a file system, in other words like the DVD (Digital Video Disc) or the Universal Disk Format (UDF) version 2.5. Within that file system, there is room for much more data, so bigger files can be stored. Bandwith is also higher. The data rate can go as high as 25 Mega-bits/s. Transport streams containing high definition ("HD") video can be read.
BD format standardization for video streams and interactivity includes Java programs that can do things while the user is watching a program. One possible application is to provide extra textual and photographic information on the actors of a movie or the participants of a sports event. This information can be shown on a part of the screen while the video is shown in a scaled way in the remainder of the screen (picture in picture) . Another possible alternative is that the information can be shown semi- transparently on top of the video.
The Java program may require additional data while an HD video stream is being read and decoded from the disc. In the UDF format, typically application data and Java byte code are stored in different places from data for audio/video presentations. For data from the audio/video streams, allocation rules — i.e. rules regarding where to put the audio/video stream data on the disc — ensure uninterrupted playback of the audio and video. For Java program data, such rules do not apply. In other words, it cannot be predicted what data an interactive program needs next. Therefore, if the host platform needs application data or additional program code for an application program, it has to interrupt the audio/video presentation to get that data or code. Herein, the term "application data" will be used to mean application data and/or code.
Fig. 1 shows an embodiment of a data retrieval system in accordance with the invention. Data from an optical disk file system 113 is retrieved using a disk head 110 in the form of a transport file 112. The transport file has a stream format as illustrated at 111. In the figure, audio information is shown with vertical hatching; subtitles with horizontal; application data is shown with hatching that slants down from left to right; and video data is shown with hatching that slants up from left to right.
The transport stream 111 goes to demultiplexer 105, which separates out the audio, video and subtitle data 114, which are output to the user at 107, 108, and 109, respectively. The application data is demultiplexed to a unit 104. Unit 104 processes the packets in the elementary stream that contains all the file system data. These packets are generated on recording by a packetizer 208, which will be discussed further below with reference to Fig 2. The unit 104 retrieves any application code or data files the application needs on request of the application by filtering out the relevant packets and assembling them back into their original files — also shown with respect to Fig. 4.
The decoded files 103 are stored in application memory 102, where they are used for application execution and rendering at 106. Files can be delivered from the stream via streamed packets. Preferably the application data is stored and retrieved in a repeating format, such as the DSM — CC format, formerly used only in broadcasting. The use of MHP/DSM-CC file formats in broadcasting has been documented in Steven Morris, "Interactive TV Web" ^MdlMM^M^ά^I^^h^ΩΪ&l^QlMI^MΪύ^^MSI^^M.
(2002).
The DSM — CC format, used for broadcast content, allows application code and data, including a directory tree, to be stored in a format called a "carousel." The term carousel is used, in analogy with an old-fashioned carnival ride, to indicate that the data is presented in a repeating fashion, as if the receiver were watching a rotating carousel. The advantage of this format is that all necessary data is presented fairly frequently, so that an application program can use it without pausing to wait for new data. It is desirable to store and retrieve application data with respect to an optical disc as part of a transport stream transport stream, where the application is organized within the transport stream in a repeating format, such as the carousel of the broadcast DSM — CC.
The carousel uses a small part of the bandwidth available to the complete transport stream. As an example, 20% of the available bandwidth of a high- definition MPEG2 audio & video stream can be used for the carousel with only a minimal effect on the video quality. This would be 5Mbit/second for Blu-ray. With a repetition cycle of 32 seconds this would allow 32*5/8 = 20 Mbyte of data to be available to the application program including some overhead for the protocol used (such as DSM-CC). Using 20Mbyte of data without a carousel would require the addition of 20Mbyte of cache memory in each system.
Caching is known in the art prior art. Caching all the data a program might ever need is an alternative solution, but it restricts the maximum size of the data to the size of the cache. For a system to use DSM-CC, some caching of retrieved section of data is also needed. Typically this cache size is related with the size of the files in the carousel and the number of files that a system can retrieve concurrently from the stream. With the example numbers used above, if the data would consist of 100 files of size 100- lOOOKbyte, a buffer of 2 Mbyte would allow 2-10 files to be retrieved at the same time. The choice of the buffer size influences the performance in terms of latency of the carousel.
The exact information that is retrieved from the carousel is under user control via the application program, e.g. using remote control keys.
Fig. 2 shows an embodiment of a device for storing data in accordance with the invention. Audio, video, and subtitle content which are to be used to make up a presentation to a user are encoded in respective encoders at 201, 202, and 203. Application code files are made available at 204. All four types of content and/or data are packetized in respective packetizers at 205, 206, 207, and 208. The resulting packets are multiplexed at 212 to create the transport stream 209. This transport stream becomes transport stream file 211, which is then stored to the optical disk system 113. If there is no need to coordinate audio, video and/or subtitle content, application code files 204 can be provided directly to the optical disk file system 113 at 210. Like the transport stream 111, the stream 209 is preferably organized so that the application data repeats, for instance as a carousel, like that shown in the broadcast standard, DSM - CC.
While Fig.s 1 and 2 are shown as separate devices, they might be housed together in a single device. Typically however what is drawn in figure 2 is part of the production process of optical disc and what is drawn in figure 1 is part of a optical disc player. In an optical disc system that can play back from disc as well as record data on optical disc both can be included.
Fig. 3 shows more detail of an example of how application data and code may be stored in accordance with the invention.
At 301, is an example of a file structure for some application data and code. The file structure includes files aaa and bbb in directory dl ; files ccc and eee in directory d2; and directory d2 in directory dl. This is just an example of a file structure. More or less files might be used. More or less directories might be used. The directories might be nested differently. Those of ordinary skill in the art know how to design file structures as necessary for particular applications.
At 302, the data from the file structure 301 are shown cut into pieces. Directory dl is shown cut into 2 pieces, both labeled, dl. File aaa is shown cut into four pieces, each labeled a. File bbb is shown cut into four pieces, each labeled b. Directory d2 is shown cut into 2 pieces, each labeled d2. File ccc is shown cut into 3 pieces, each labeled c. File eee is shown cut into four pieces, each labeled e. These numbers of pieces are also only examples. Files or directories might be cut into more or less pieces, in accordance with known DSM-CC technology. Each piece from 302 is concatenated into a carousel cycle shown at 303. At 304, the carousel cycle is shown repeated three times, forming an elementary stream. Three times is also just an example. More or less repetitions might be desirable depending on the needs of the application.
The elementary stream is packetized to yield packets 305. Again, the number of packets shown is only an example. More or less packets might be used. Those of ordinary skill in the art know how to determine how many packets and what size packets are necessary, in order to make the application work.
At 306, the packets of application data and code (D) are interleaved with packets of video data (V), audio data (A), and subtitle data (S) to form a transport stream. This transport stream is then made into a transport file 307, which becomes a part 309 of a file structure 308. The file structure 308 is then stored in the optical disk file system
113.
Fig. 4 shows an example of an application program using a data stream in accordance with the invention. A display screen is shown at 401. This might be a display screen on a television, or other similar consumer electronics device, such as a PC. The screen
401 is showing two windows, or picture-in-picture displays. The first is a video window 402 where a standard television program might be shown. The second is an application area 403, where image and/or text data from an application might be shown. For instance, biographical information about a movie star might appear under his picture.
An application program 406 resides in an optical disk player 405. The user 404 will typically interact with the application program 406 via a remote control or other similar mechanism, though other user input devices might also be used. The application program will also communicate with the area 403. In order to support the application 406, the transport file stream 307 is retrieved from the optical disk file system 113. The file structure 301 is reconstructed from the transport stream 307 to support the application program 406.
Audio, video and/or subtitle data are also communicated at 408 to the television or other similar consumer electronics device.
An example of an application area for the invention is High Definition - Digital Video Disks (HD-DVD).
From reading the present disclosure, other modifications will be apparent to persons skilled in the art. Such modifications may involve other features which are already known in the design and use of optical recording techniques and which may be used instead of or in addition to features already described herein. Although claims have been formulated in this application to particular combinations of features, it should be understood that the scope of the disclosure of the present application also includes any novel feature or novel combination of features disclosed herein either explicitly or implicitly or any generalization thereof, whether or not it mitigates any or all of the same technical problems as does the present invention. The applicants hereby give notice that new claims may be formulated to such features during the prosecution of the present application or any further application derived therefrom.
The word "comprising", "comprise", or "comprises" as used herein should not be viewed as excluding additional elements. The singular article "a" or "an" as used herein should not be viewed as excluding a plurality of elements. The word "or" should be construed as an inclusive or, in other words as "and/or".

Claims

CLAIMS:
1. A system comprising:
• at least one user interface (401) for presenting audio and video data to a user (404) and for receiving interactive commands from the user;
• at least one drive (110) for reading a data storage medium (113) embodying data structures comprising a transport stream file structure (111, 203, 306) including interleaved packets of audio, video, and application data;
• at least one processor (104) for performing the following operations: • using the audio and video data from the transport stream to create a presentation
(402) for a user; and
• using the application data from the transport stream to run an application program (403) for the user, without interrupting the presentation.
2. The system of claim 1, wherein the application data are arranged to appear repeatedly (304) in their entirety as part of the transport stream along with the audio and video data.
3. The system of claim 1, wherein the application and the presentation simultaneously present respective windows on a display screen.
4. The system of claim 1, wherein the transport stream also comprises subtitle data.
5. A data carrier (113) embodying data structures readable by a data processing device and comprising a transport stream file structure (111, 203, 306) including interleaved packets of audio, video, and application data, so that a device utilizing the optical carrier can
• use the audio and video data to create a presentation (402) for a user; and • use the application data to run an application program (406) for the user, without interrupting the presentation.
6. The carrier of claim 5 wherein the application data are arranged to appear repeatedly in their entirety (304) as part of the transport stream along with the audio and video data
7. The carrier of claim 5, wherein the transport file stream structure is in accordance with the DSM-CC standard, and stored in accordance with the UDF standard.
8. The carrier of claim 5, wherein the application data is arranged in at least one carousel.
9. The carrier of claim 5, wherein the carrier is an optical disk (113).
10. The carrier of claim 9, wherein the optical disk is a blu-ray disk.
11. The carrier of claim 9, wherein the optical disk is a DVD disk.
12. The carrier of claim 11, wherein the disk is HD-DVD.
13. A method for storing multimedia data comprising:
• organizing multimedia data including presentation content and application data into a transport stream (111, 203, 306), in which packets of audio, video and application data are interleaved, so that a device utilizing the optical carrier can use the presentation content to create a presentation for a user; and use the application data to run an application program for the user, without interrupting the presentation; and
• saving the transport stream as a transport file to a storage medium.
14. The method of claim 10, wherein the application data are arranged to appear repeatedly in their entirety (306) as part of the transport stream along with the presentation content.
15. The method of claim 11, wherein the application data is organized into a carousel within the transport stream.
16. A method for retrieving multimedia data comprising;
• retrieving a transport file (112) from a storage medium (113), the transport file comprising a transport stream file structure (111) in which packets of audio, video, and application data are interleaved, so that a device utilizing the storage medium (113) can use the presentation content to create a presentation (402) for a user; and use the application data to run an application program(406) for the user, without interrupting the presentation; • demultiplexing (105) the application data from the presentation content;
• providing the presentation content to a user as a presentation (402); and
• providing the application data to an application program and using the data within the application program without interrupting the presentation.
17. The method of claim 13, wherein the application data are arranged to appear repeatedly in their entirety (306) as part of the transport stream.
18. The method of claim 14, wherein the application data is organized as a carousel within the transport stream.
19. A data carrier (113) embodying data structures readable by a data processing device, which data structures comprise a transport stream (111, 203, 306) including presentation content and application data, which application data is repeated (306) sufficiently frequently that a player device (405) interpreting the carrier (113) can run an application program (406) using the application data and play the presentation (402) at the same time, without interrupting the presentation.
PCT/IB2006/050659 2005-03-03 2006-03-02 Streamed file system for optical disc applications Ceased WO2006092770A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP06711009A EP1859624A2 (en) 2005-03-03 2006-03-02 Streamed file system for optical disc applications
CN2006800068262A CN101133646B (en) 2005-03-03 2006-03-02 Streaming File System for Optical Disc Applications
JP2007557659A JP2008537273A (en) 2005-03-03 2006-03-02 Stream file system for optical disc applications
US11/817,507 US20090125810A1 (en) 2005-03-03 2006-03-02 Streamed File System for Optical Disc Applications

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US65825205P 2005-03-03 2005-03-03
US60/658,252 2005-03-03

Publications (2)

Publication Number Publication Date
WO2006092770A2 true WO2006092770A2 (en) 2006-09-08
WO2006092770A3 WO2006092770A3 (en) 2006-11-23

Family

ID=36384781

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/050659 Ceased WO2006092770A2 (en) 2005-03-03 2006-03-02 Streamed file system for optical disc applications

Country Status (6)

Country Link
US (1) US20090125810A1 (en)
EP (1) EP1859624A2 (en)
JP (1) JP2008537273A (en)
KR (1) KR20070116063A (en)
CN (1) CN101133646B (en)
WO (1) WO2006092770A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1906667A3 (en) * 2006-09-29 2011-08-31 Samsung Electronics Co., Ltd. Handling applications received by data broadcast

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6496981B1 (en) * 1997-09-19 2002-12-17 Douglass A. Wistendahl System for converting media content for interactive TV use
US6088747A (en) * 1998-02-20 2000-07-11 Unisys Corp System for reformatting and burning of data files having a first format onto a compact disk to be utilized in a network using different format
US6631403B1 (en) * 1998-05-11 2003-10-07 At&T Corp. Architecture and application programming interfaces for Java-enabled MPEG-4 (MPEG-J) systems
US7392312B1 (en) * 1998-09-11 2008-06-24 Lv Partners, L.P. Method for utilizing visual cue in conjunction with web access
EP1234446B1 (en) * 1999-10-29 2003-06-18 OpenTV, Corp. Playback of interactive programs
US20050172214A1 (en) * 2001-06-14 2005-08-04 Samsung Electronics Co., Ltd. Information storage medium containing preload information, apparatus for and method of reproducing therefor
KR100502710B1 (en) * 2002-05-24 2005-07-20 주식회사 아이큐브 Optical disk regenerative apparatus
US7555199B2 (en) * 2003-01-16 2009-06-30 Panasonic Corporation Recording apparatus, OSD controlling method, program, and recording medium
JP3790761B2 (en) * 2003-01-16 2006-06-28 松下電器産業株式会社 Recording apparatus, OSD display control method, program, and recording medium
US7907833B2 (en) * 2003-07-21 2011-03-15 Thomson Licensing Apparatus and method for communicating stop and pause commands in a video recording and playback system
JP4082318B2 (en) * 2003-09-04 2008-04-30 カシオ計算機株式会社 Imaging apparatus, image processing method, and program
TW200518070A (en) * 2003-10-10 2005-06-01 Matsushita Electric Industrial Co Ltd Recording medium, reproduction device, program, and reproduction method
KR100788655B1 (en) * 2003-11-10 2007-12-26 삼성전자주식회사 Storage medium, reproducing apparatus, and reproducing method in which text-based subtitle data including style information is recorded
JP2008066764A (en) * 2005-02-10 2008-03-21 Matsushita Electric Ind Co Ltd Broadcast recording device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1906667A3 (en) * 2006-09-29 2011-08-31 Samsung Electronics Co., Ltd. Handling applications received by data broadcast

Also Published As

Publication number Publication date
CN101133646B (en) 2010-05-19
EP1859624A2 (en) 2007-11-28
JP2008537273A (en) 2008-09-11
CN101133646A (en) 2008-02-27
WO2006092770A3 (en) 2006-11-23
KR20070116063A (en) 2007-12-06
US20090125810A1 (en) 2009-05-14

Similar Documents

Publication Publication Date Title
CN100440216C (en) Data structure of metadata stream of object in moving picture, and search method and playback method thereof
JP4642885B2 (en) Video information playback method and video information playback apparatus
US20070091492A1 (en) Information playback system using information storage medium
CN101068329A (en) Method for controlling apparatus for text subtitle data synchronized with AV data
JP2002057985A (en) Digital video stream decoding method and apparatus by inserting pseudo header in digital video system
CN1647519A (en) Display of closed captioned information during video trick modes
JP2007295519A (en) System for simultaneous playback of multiple video angles from multimedia content onto display device and method thereof
JP2005318472A (en) Video metadata
US20190156863A1 (en) Recording medium, playback method, and playback device
JP2005318473A (en) Video metadata
US7778526B2 (en) System and method for maintaining DVD-subpicture streams upon conversion to higher compressed data format
JP2005285209A (en) Video metadata
US7760989B2 (en) Recording medium having data structure including graphic data and recording and reproducing methods and apparatuses
US7751685B2 (en) Recording medium having data structure including graphic data and recording and reproducing methods and apparatuses
CN103778929A (en) Blu-ray disc player and method of displaying subtitles in the Blu-ray disc player
JP2005318471A (en) Video metadata
US20090125810A1 (en) Streamed File System for Optical Disc Applications
JP4133981B2 (en) Metadata and video playback device
JP4250574B2 (en) Metadata structure and method of reproducing metadata
JP4008951B2 (en) Apparatus and program for reproducing metadata stream
JP5604810B2 (en) Video information reproducing method, video information reproducing apparatus, and recording medium
JP2006050192A (en) Multiplexing method, information recording medium, and data reproducing method
JP2006041844A (en) Metadata structure and metadata processing method
JP2006080918A (en) METADATA DATA STRUCTURE AND METADATA REPRODUCTION DEVICE AND METHOD
CN101430915B (en) Reproducing apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006711009

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2007557659

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 11817507

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 200680006826.2

Country of ref document: CN

Ref document number: 3842/CHENP/2007

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020077022524

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: RU

WWW Wipo information: withdrawn in national office

Ref document number: RU

WWP Wipo information: published in national office

Ref document number: 2006711009

Country of ref document: EP