WO2006114021A1 - Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable - Google Patents

Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable Download PDF

Info

Publication number
WO2006114021A1
WO2006114021A1 PCT/CN2005/000581 CN2005000581W WO2006114021A1 WO 2006114021 A1 WO2006114021 A1 WO 2006114021A1 CN 2005000581 W CN2005000581 W CN 2005000581W WO 2006114021 A1 WO2006114021 A1 WO 2006114021A1
Authority
WO
WIPO (PCT)
Prior art keywords
subtitle
clock signal
time
data item
caption
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2005/000581
Other languages
English (en)
Chinese (zh)
Inventor
Hongjun Chai
Qiwei Hu
Zhengde Cao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING DIGITAL CHAOTEX INFORMATION TECHNOLOGY Ltd
Original Assignee
BEIJING DIGITAL CHAOTEX INFORMATION TECHNOLOGY Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING DIGITAL CHAOTEX INFORMATION TECHNOLOGY Ltd filed Critical BEIJING DIGITAL CHAOTEX INFORMATION TECHNOLOGY Ltd
Priority to PCT/CN2005/000581 priority Critical patent/WO2006114021A1/fr
Publication of WO2006114021A1 publication Critical patent/WO2006114021A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/44504—Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43074—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles

Definitions

  • the present invention relates to a synchronized subtitle generating method and apparatus, and more particularly to a synchronized subtitle generating method and apparatus for portable devices such as mobile phones, personal digital assistants (PDAs) and the like.
  • Background technique
  • synchronous subtitles An important part of entertainment and educational multimedia content such as karaoke and MTV is the subtitles that are played simultaneously with the music being played.
  • the basic feature of synchronous subtitles is that the color of the displayed text is automatically changed sequentially at a specific time with music or image playback, thereby achieving the purpose of prompting the end user with the lyrics and the singing rhythm.
  • Embedded image subtitles that is, superimposing subtitles on the original image during the production of the media content, and performing overall recording or compression encoding on the new composite image.
  • the subtitles have been fixed in the image as part of the projection screen.
  • Such methods are typically used in analog videotapes, VCD systems, and broadband network video content.
  • the advantage of this method is that no additional storage device and decoding playback device are required to process the subtitles, thereby simplifying the organization of the stored data and the structure of the player, and reducing the cost of the playback device. Its limitations are also obvious: After the production is completed, you can no longer freely change the color, position, display style, etc.
  • This method uses a separate dynamic image to store and display subtitles, so subtitles are not directly integrated into the main screen.
  • the main screen and the specified subtitles are synchronized according to the time code, and the subtitles are superimposed on the appropriate position of the main screen (generally directly below the main screen).
  • the advantages of such a method are: the main picture can correspond to a plurality of subtitles, and the user selects different subtitles for superposition according to usage preferences or language habits, and the user can even select to superimpose and display multiple subtitles simultaneously in the picture; the subtitle position can be based on the user. Preferences or player settings for later adjustments.
  • the color, display style, and the like of the subtitle are still not adjustable, the storage of the subtitle occupies a relatively large amount of additional storage space, and a separate decoding process is required to decompress and display the subtitle.
  • This method is mainly used in the currently popular MPEG4 format compressed video media, in addition to supporting the SUB subtitle mode of a general DVD system, and also supports subtitle data recorded in a plain text format.
  • the subtitle data format is relatively simple and consists of multiple subtitle items. Each subtitle item contains a serial number, start time, end time, and subtitle text. The subtitle item allows more than one line of subtitle text.
  • the advantage of this method is that the subtitles are stored in plain text, which facilitates the later editing and modification, and saves storage space compared with the image mode. Meanwhile, the separation of text subtitles allows the user to specify the position, color, font of the subtitle display during playback. Style and more.
  • the subtitles of this format are closely related to the encoding of the text, and cannot support subtitles mixed in multiple languages.
  • this method is generally only used for subtitle display of movies or ordinary video programs, and cannot be applied to karaoke programs.
  • the special captioning machine after the main display decoding device outputs the display signal of the main screen, uses an independent caption display device or unit, superimposes the caption on the display signal and outputs it to the final display screen.
  • the dedicated subtitle generator makes it easy to synthesize subtitles with different content screens, and can achieve a variety of rich display effects, such as subtitle scrolling, fades, text variants, and more.
  • the cost of the captioning machine is high, the flexibility is small, and the upgrade is difficult, and it is almost impossible to apply to the current mobile device.
  • a method for generating a synchronized subtitle including the steps of: generating a clock signal; and searching for caption data to be displayed at a corresponding current time according to timing information represented by the clock signal; Determining a subtitle color change state at a current time according to timing information represented by the clock signal; outputting a subtitle based on the color change state and the searched caption data; and superimposing the main picture and the subtitle into a final picture.
  • the subtitle data is divided into a plurality of subtitle data items, each subtitle data item including subtitle information displayed during a period of time, and a start time and an end time at which the subtitle data is to be displayed.
  • the desired subtitle data item is determined in the step of finding subtitle data by judging which time period between the start time and the end time of the current data item.
  • the subtitle data items are sequentially stored in the order of play, and the steps of searching for subtitle data are searched one by one according to the order in which the subtitle data items are played, or are searched according to the dichotomy.
  • the subtitle data item also includes one or more placeholders corresponding to the length of time the character is displayed before or after each character to be displayed.
  • the step of determining the color change state determines a character to be color-changed by the caption based on the number of characters included in each caption data item, the start and end time of the caption data item, and the current time.
  • the current subtitle data item is divided into two parts by the determined character that is changing color, and is displayed in different colors or patterns, respectively.
  • a synchronous caption generating device including: a clock signal generating device for generating a clock signal; and a searching device, configured to search for a corresponding current time according to timing information of the clock signal a caption data display device, configured to determine a caption color change state at a current time according to timing information of the clock signal, and output a caption according to the color change state and the searched caption data; and a synthesizing device, configured to The picture and the subtitle are superimposed to form a final picture.
  • the synchronized subtitle generating method and the device for implementing the same according to the present invention are easy to implement, have very low requirements on the storage capacity and processing capability of the system, and are currently suitable for subtitle display methods for portable device processing.
  • FIG. 1 is a block diagram showing the internal structure of a portable device according to a caption generating apparatus according to the present invention
  • FIG. 2 is a flow chart showing the workflow of the caption generating device according to the present invention
  • FIG. 3 is a view showing the use of the binary search method to find a caption data item corresponding to a certain moment in the searching step of FIG. 2, according to an embodiment of the present invention
  • FIG. 4 is a flow chart showing a subtitle display and color change process according to an embodiment of the present invention.
  • FIG. 5 is a block diagram showing the structure of a caption generating apparatus according to an embodiment of the present invention.
  • Fig. 1 shows a block diagram of an internal structure of a portable device according to a caption generating apparatus according to the present invention.
  • a mobile terminal 10 as a portable device includes a user input device 101, a system timer 102, a media playback device 103, an audiovisual decoder 104, a sound device 105, a caption generator 106, and a graphic and character output device. Interface 107.
  • the user can control the operation of the media playback device 103 by inputting various control commands (e.g., stop playback, pause playback, resume playback, and shuffle commands, etc.) through the user input device 101.
  • the media playback device 103 also transmits the command to the subtitle generator 106 in accordance with an instruction from the user input device 101 to operate in synchronization with the media playback device 103.
  • the system timer 102 generates a clock signal that is simultaneously supplied to the media playback device 103 and the subtitle generator 106 for timing and synchronization.
  • the media playback device 103 supplies the encoded image and sound data to the image sound decoder 104 for decoding processing in accordance with a user instruction.
  • the sound signal generated by the decoding by the image sound decoder 104 is supplied to the sound device 105, and the generated image signal is supplied to the graphic and character output device interface 107.
  • the subtitle generator 106 generates subtitle information to be currently displayed based on an instruction from the media playback device 103 and a clock signal from the system timer 102, and outputs to the graphics and character output device interface 107, wherein the subtitle information includes the text of the currently displayed subtitle Information on the discoloration of information and subtitles.
  • the graphic and character output device interface 107 synthesizes the main image from the image sound decoder 104 and the subtitle information from the subtitle generator 106 into a final output composite image, and displays it.
  • the same screen can display multiple lines of subtitles, and at the same time handle the discoloration of at least one line of subtitles;
  • rhythm of the subtitle display conforms to the beat of the corresponding music, and the length of the character discoloration interval should be an integer multiple of a basic beat;
  • the synchronization error of subtitle display is generally allowed to be within plus or minus 1/10 seconds.
  • the caption data is stored in a separate data unit in the portable device independent of the picture content.
  • the storage of subtitle data involves the following data elements: '
  • each line of lyrics is stored as a data item.
  • subtitle text is adopted.
  • UTF-16 (16-bit Unicode encoding)
  • UTF-8 8-bit Unicode encoding
  • UTF-16 when recording plain English text, use UTF-8 encoding; when recording Chinese or Chinese-English mixed text, use UTF-16 encoding.
  • Subtitle start time and end time associated with the data item of the caption text body In order to save storage space, the time is the relative time of time 0 point when playing from the corresponding music.
  • the specific implementation of the present invention can expand the use of other related data, such as the color of the text border, the display effect of the text, and the like.
  • the method of the present invention comprises the steps of: initializing the caption generator 106 while the music corresponding to the caption starts playing.
  • the caption generator 106 accepts and analyzes subtitle data, separates each subtitle data item, initializes the system timer 102, and initializes a character generator (not shown).
  • character generators are typically composed of a font library, a coded information table, a dot matrix renderer, and corresponding interfaces.
  • the system timer 102 generates a uniform clock signal having an interval of less than 1 / 10 seconds after initialization (step S201). On some types of portable devices, this limit can be relaxed appropriately, but should not be greater than the maximum caption synchronization error allowed by the media content.
  • Each clock signal of the clock is input to the subtitle generator 106, driving the drawing and color changing operations of the subtitles at the current time.
  • the subtitle generator 106 After receiving the clock signal, the subtitle generator 106 searches for the subtitle data item that should currently be displayed based on the time from the start of the music playback to the current elapsed time (step S202). Assumed sound The time reading of the music playback start time is t0, the current time reading is tx, and the start time of the subtitle data item is ts, and the end time is te, then a subtitle data item should be found to satisfy the condition ts (tx-t0) Te. Under normal conditions, subtitle data items that satisfy this condition are unique. In order to simplify the operation in the mobile device, the caption generator 106 can select the first caption data item that matches this condition, ignoring other items.
  • the storage order of the subtitles may be set to be consistent with the order in which the subtitles are displayed, and the order numbers starting from 0 are sequentially given to all the data items, and then the following search may be taken.
  • the serial number of the currently played data item is recorded each time it is processed, and the recording sequence number is 0 when initializing.
  • the next clock signal arrives, it is judged whether the data item corresponding to the current record number meets the condition. If the condition is not met, the order determines whether the first item and the second item of data are eligible until the end of the sequence of data items. In this way, when the subtitle data itself is normal, the clock signal can meet the requirements to minimize the number of searches, and the playback process is simplified, and the system resources are less occupied.
  • the caption generator 106 is required to enable random location playback of the content in conjunction with the home screen playback device; i.e., the user can choose to implement the content at any desired location that is not predictable.
  • the subtitle data items have been sorted in chronological order, we can quickly find the data items that meet the requirements in an improved binary search.
  • the specific implementation is shown in the search process shown in Figure 3.
  • the time complexity required for this lookup is log2N, where N is the total number of data items. Using this method, when there are 1000 subtitle data items in the system (this is a large number, the total number of subtitle data items of common karaoke content does not exceed 100, including all repeated paragraphs), the number of seeks required No more than 10.
  • the color change of the subtitle color at the current time is determined according to the current time indicated by the clock signal (step S203).
  • the subtitle generator 106 divides the subtitle text into two groups according to this number, and the character generator or the graphic device transmitted to the system respectively performs character output.
  • the above method is only applicable to the case where the file in the subtitle is discolored at a uniform speed.
  • the body characters in the subtitles change color at an uneven speed, but still match the music beat.
  • a placeholder character is introduced, and characters that are not commonly used in the subtitle body, such as a wavy line ( ⁇ ), are generally used.
  • the placeholder character may be selected according to the implementation. Placeholder characters participate in the calculation of the total number of characters and the number of color-changing words, but are filtered out when the output is displayed. Practice has shown that the rational use of placeholder characters can simulate the discoloration rhythm of various subtitles.
  • the relative duration of the character's pronunciation is determined by the number of subsequent placeholder characters. If the length of a character's pronunciation is three times the basic rhythm, two placeholder characters are required after this character. The rest of the situation is like this.
  • the subtitle generator 106 outputs the subtitle having the determined color change state (step S204). Finally, the main picture and the subtitle are superimposed to form a final picture (step S205).
  • This process can be invoked by calling a character generator provided by the portable device system itself, or a graphical output device.
  • the output process of the subtitle uses the color specified in the data item. In most cases, the text of the text contained in each caption data item is output on one line. It can also be automatically wrapped at the appropriate character width based on the font size provided by the portable device and the width of the displayable area.
  • the caption generator 106 can display one or more data before or after the current caption data item in the appropriate location, depending on the content needs or user selection, or the player's request.
  • Figure 3 illustrates the use of a dichotomy in the lookup step of Figure 2, in accordance with one embodiment of the present invention.
  • the search method finds a detailed flowchart of the subtitle data item corresponding to a certain moment.
  • step S301 initialization is performed in step S301, and two parameters 1 and h are defined, where 1 represents the lower limit of the search range, and h represents the upper limit of the search range such that 1 is equal to 0 and h is equal to the end caption data item.
  • Serial number Note that, as described above, the serial number of the subtitle data item is consecutively numbered in the chronological order in which the subtitle data item is to be displayed.
  • step S302 a sequence number is obtained by calculating (1+h) 12 and taking a subtitle data item corresponding to the sequence number.
  • step S303 since each subtitle data item includes a start time and an end time for displaying the subtitle data item, it can be determined according to the start time and the end time whether the current time tx is within the time range of the subtitle data item. . If it is within the time range of the item, the current subtitle data item is the item that should be displayed currently to be searched, thereby executing step S31 1, ending the current search process and exiting. If it is not within the time range of the item, step S304 is performed to determine whether the current time tx is less than the start time of the item.
  • Step S307 and step S308 both proceed to step S309 to determine whether 1 is less than 11. If the result of the determination is "YES", it indicates that the subtitle data item that should be currently played has not been found, and the process returns to step S302 to continue the above-described search process, otherwise the value of 1 is taken as the currently displayed subtitle data item.
  • a method for finding a current subtitle data item by a dichotomy is described in detail above, by which a desired subtitle data item can be quickly found, reducing computational complexity, and It occupies less hardware resources and is suitable for portable devices.
  • the present invention may be practiced with a variety of conventional methods of simplification, which are included within the scope of the invention as defined by the appended claims.
  • FIG. 4 a caption display and color change process in accordance with one embodiment of the present invention.
  • Figure The flow of 4 is performed after the flow of FIG. 3, and the caption data item currently to be displayed has been found before the flow of FIG. 4 is executed.
  • step S401 is executed to determine the number of characters currently discolored according to the timing information according to the method described above, thereby distinguishing the character to be discolored and the normal character not discolored in the current subtitle data item.
  • step S402 the character to be changed is stored in the color-changing character buffer
  • step S405 is executed to store the normal character that is not discolored in the normal character buffer.
  • the placeholder characters are respectively filtered out from the above two buffers, and the placeholder characters are added in advance to match the beat of the caption display as described above, so as to calculate the discoloration of the captions. Position, the placeholder character is not actually displayed.
  • Steps S403 and S406 may also be performed while filling the corresponding character buffer, that is, steps S402 and S405.
  • Steps S404 and S407 are respectively performed to calculate the position of the text output, and the step can be implemented by a method known in the art.
  • step S408 the characters in the color-changing character buffer and the normal character buffer and the calculated position information are respectively output to the character output device, and the character output device outputs the color in different colors or manners according to the received information. Characters and normal characters. As the music or picture is played, or as time progresses, the number of color-changing characters changes. Therefore, in continuous display, the effect of color change in the karaoke can be obtained.
  • the method of processing the character discoloration described above with reference to Fig. 4 may also have other variations, for example, the placeholder character may be replaced with a time weighting value for each subtitle character.
  • Each subtitle character to be displayed may correspond to a weighting value indicating the time at which the subtitle character is to be displayed. This also makes it possible to obtain subtitle character information that is currently changing color in a manner similar to that described above. Therefore, in addition to the flow shown in Fig. 4, there are many different ways to implement the process of subtitle discoloration.
  • the fields of the caption data are arranged as follows:
  • the start time and end time of the subtitle display Use 32-bit or 16-bit binary integers Storage, if 32-bit integer storage is used, the time unit is 1880 or 1/1024 seconds; if 16-bit integer storage is used, the time unit is recommended to be 1/100 second, which can be applied to a length of 10 minutes and 55 seconds.
  • the music meets the length requirements of most karaoke music requirements.
  • the normal display color of the subtitles and the color after the color change can generally be stored using 24-bit RGB values, 8-bit system-defined palette entry values, 16-bit or 8-bit RGB values, depending on the system.
  • the two fields may be selectively stored or not stored due to the fixed display color, or the display color of the subtitles being customized by the later system.
  • Subtitle body text Unicode encoding (UTF-16 or UTF-8), a string ending with a number 0.
  • UTF-16 or UTF-8 Unicode encoding
  • a string ending with a number 0.
  • an 8-bit or 16-bit string length field can be added before the string, which requires some extra storage space.
  • the data field of fixed length of each data item is preferably arranged in front of the data item, and the variable length field (such as the subtitle body) appears behind the data item, so that the serial number of the data item is facilitated.
  • the order of these data fields can be exchanged and new new data fields can be introduced.
  • multibyte data fields need to be aligned on a 2-byte boundary or a 4-byte boundary.
  • the subtitle data can be separately compressed and stored using a certain compression method, or compressed and stored integrally with the main picture data.
  • the caption generator 106 needs to call the corresponding device or interface to decompress the data before processing the caption data.
  • the subtitle generator 106 can use a separate clock timer or share a certain clock signal with other components of the portable device system. In this case, the portable device system or the home screen player should pass the clock signal to the caption generator 106 as soon as possible, if possible.
  • the subtitle generator 106 displays the subtitles after the main screen is processed, so that the characters are always visibly displayed on the upper layer of the main screen.
  • the caption generator 106 acts as a component of the animation player and receives some time during the animation rendering process. To the clock signal, the display of such subtitles may be obscured by certain parts of the animation.
  • the caption generator 106 can support the pause and resume play functions of the play as needed. After the user chooses to pause the content playback, the other components of the system issue a pause signal to the caption generator 106. The system can turn off the clock signal to the caption generator 106, at which point the system should provide a separate clock count; or the system can continue to send a clock signal to the caption generator 106, which is clocked by the caption generator 106. The caption generator 106 internally sets a pause flag after receiving the pause signal, and thereafter does not process the clock signal until the recovery signal is received.
  • the system issues a resume playback signal to the subtitle generator 106.
  • the subtitle generator 106 receives this signal, clears the internal pause flag, and continues processing and displaying the subtitle as the next clock signal arrives. In this process, attention should be paid to the processing of the time t0 at which the music starts to play. Assuming that the pause time is tp and the recovery time is tr, then the t0 value is modified to t0+tr-tp. Otherwise, if the waiting time of the pause period is not deducted, the subtitles will be out of sync when the playback resumes.
  • the caption generator 106 can support random play as needed.
  • the user can choose to start playing from any location that is not previously predicted by the content.
  • the main screen and the content player should retrieve the time from the music playing device to the subtitle generator 106 at the time specified by the beginning of the music at the specified playback position.
  • the subtitle generator 106 calculates the start time to of the playback according to the current time, the input target time, and stores it, and then searches for the subtitle data item corresponding to the target time and displays it.
  • the system can define the actual display location of the subtitles as desired.
  • the display position can define a reference point coordinate (pixel numerical coordinate or proportional coordinate of the display area) and define an alignment relationship of the outer rectangle of the subtitle display relative to the reference coordinate.
  • the subtitle generator 106 automatically calculates and adjusts the display position to achieve the center alignment effect.
  • the system can also define other subtitle display positioning methods.
  • the movement of the subtitles can be pre-stored as needed for production, or calculated by a time-dependent function.
  • the caption generator 106 Based on the basic display mode, the caption generator 106 based on the present invention can expand other character display effects, such as hollow text, edge color enhancement, shadow, rotation, fade, etc., when the system resource permits. These effects do not change the basic subtitle display and text color rhythm control principles.
  • Fig. 5 shows a schematic structural view of a caption generating device 50 according to an embodiment of the present invention.
  • the main difference between the caption generating device 50 shown in the figure and the caption generator 106 shown in FIG. 1 is that the caption generating device 50 shown in FIG. 5 further includes a clock signal generating device 501 corresponding to FIG.
  • the system timer 102 and also includes a synthesizing device 505 for overlaying the subtitles with the main picture, which corresponds to the graphics and character output device interface 107 of FIG. Since the above two devices are included, the structure of the caption generating device shown in Fig. 5 is more independent and complete. As shown in Fig.
  • the subtitle generating apparatus includes a clock signal generating means 501, a looking means 502, a subtitle memory 503, a color change state determining means 504, and a synthesizing means 505.
  • the clock signal generating means 501 generates a clock signal and supplies it to the finding means 502 and the color changing state determining means 504.
  • the finding means 502 searches the caption memory 503 for the caption data item which should be displayed at the current time based on the clock signal from the clock signal generating means 501, and supplies the found caption data item to the color changing state determining means 504.
  • the color change state determining means 504 is divided into color-changing characters and normal characters based on the clock signal from the clock signal generating means 501 and the caption data item from the search means 502, and will be displayed in different colors, respectively.
  • the caption data item after the color change state is determined is supplied to the synthesizing device 505.
  • the synthesizing means 505 simultaneously receives the main picture to be displayed from the present, and superimposes the subtitle which determines the discoloration state on the main picture, thereby outputting the synthesized picture and displaying it.
  • the subtitle generating device shown in FIG. 5 can also have other variations, such as the word in FIG.
  • the screen memory 503 can be included in the lookup device 502, and the clock signal generated by the clock signal generating device 501 can also be provided externally by the caption generating device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Studio Circuits (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L’invention concerne un procédé de génération synchrone de sous-titres. Le procédé comporte les étapes consistant à : générer un signal d’horloge ; identifier des données de sous-titres à afficher à un instant donné en fonction des informations de synchronisation représentées par le signal d’horloge ; déterminer l’état de changement de couleur des sous-titres à l’instant donné en fonction des informations de synchronisation représentées par le signal d’horloge ; produire les sous-titres en fonction de l’état de changement de couleur et des données de sous-titres ; synthétiser l’image finale en superposant les sous-titres sur l’image principale. L’invention concerne également un dispositif permettant de mettre en œuvre ce procédé de génération synchrone de sous-titres. Le procédé et le dispositif de l’invention peuvent être appliqués à l’affichage de sous-titres de karaoké sur un dispositif portable et ont l’avantage de nécessiter moins d’espace mémoire et de ressources de traitement, de présenter une structure simple et d’être faciles à gérer.
PCT/CN2005/000581 2005-04-27 2005-04-27 Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable Ceased WO2006114021A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2005/000581 WO2006114021A1 (fr) 2005-04-27 2005-04-27 Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2005/000581 WO2006114021A1 (fr) 2005-04-27 2005-04-27 Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable

Publications (1)

Publication Number Publication Date
WO2006114021A1 true WO2006114021A1 (fr) 2006-11-02

Family

ID=37214415

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2005/000581 Ceased WO2006114021A1 (fr) 2005-04-27 2005-04-27 Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable

Country Status (1)

Country Link
WO (1) WO2006114021A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110895457A (zh) * 2018-09-13 2020-03-20 浙江宇视科技有限公司 字符显示方法、装置及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5089899A (en) * 1989-06-29 1992-02-18 Pioneer Electronic Corporation Recording medium playing apparatus which permits changes in the display position of a reproduced image
JPH10282971A (ja) * 1997-04-01 1998-10-23 Daiichi Kosho:Kk カラオケ装置の歌詞表示システムにおける歌唱時機指示方法
CN1489369A (zh) * 2003-08-11 2004-04-14 安凯（广州）软件技术有限公司 用于无线网络和无线手持式设备的卡拉ok制作方法和播放方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5089899A (en) * 1989-06-29 1992-02-18 Pioneer Electronic Corporation Recording medium playing apparatus which permits changes in the display position of a reproduced image
JPH10282971A (ja) * 1997-04-01 1998-10-23 Daiichi Kosho:Kk カラオケ装置の歌詞表示システムにおける歌唱時機指示方法
CN1489369A (zh) * 2003-08-11 2004-04-14 安凯（广州）软件技术有限公司 用于无线网络和无线手持式设备的卡拉ok制作方法和播放方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110895457A (zh) * 2018-09-13 2020-03-20 浙江宇视科技有限公司 字符显示方法、装置及电子设备
CN110895457B (zh) * 2018-09-13 2024-02-02 浙江宇视科技有限公司 字符显示方法、装置及电子设备

Similar Documents

Publication Publication Date Title
US10434420B2 (en) Music game software and input device utilizing a video player
KR102319456B1 (ko) 콘텐츠 재생 방법 및 이를 수행하는 전자 기기
CN106471818B (zh) 电子设备及其控制方法
CN1910696B (zh) 存储介质的再现方法和设备
US20060210245A1 (en) Apparatus and method for simultaneously utilizing audio visual data
KR20070091962A (ko) 애니메이션을 이용한 디엠비 데이터 방송의 나레이션 제공방법 및 이를 구현하기 위한 프로그램이 저장된 컴퓨터로판독 가능한 기록매체
CN103165152B (zh) 播放多媒体文件的方法及装置
KR100604831B1 (ko) 오디오에 부가 영상과 문자를 동기시켜 재생하는오디오/비디오 재생 장치 및 그 방법
KR101577012B1 (ko) 멀티미디어 데이터의 합성방법 및 동영상 재생기
US6249640B1 (en) System and method for rapidly decoding sub-pictures in a DVD player
JP5310808B2 (ja) 字幕付映像再生装置及び字幕付映像再生プログラム
KR102319462B1 (ko) 미디어 콘텐츠 플레이백 제어 방법 및 이를 수행하는 전자 기기
CN107864393A (zh) 视频与字幕同步显示的方法及装置
CA2495871C (fr) Moyen de stockage d'information contenant un flux de graphiques interactifs pour modification de l'etat de reproduction des donnees audiovisuelles, avec la methode et l'appareil de reproduction associes
WO2006114021A1 (fr) Procede et dispositif de generation synchrone de sous-titres utilisables dans un dispositif portable
TW200529202A (en) Storage medium recording text-based subtitle stream, reproducing apparatus and reproducing method for reproducing text-based subtitle stream recorded on the storage medium
KR20090049672A (ko) 자막 선택에 의해 재생지점 선택이 가능한 모바일 컨텐츠재생 장치 및 방법
JP2006270139A (ja) データ再生装置、データ再生方法およびプログラム
JP2004226701A (ja) マーク装置、マーク方法、データ出力装置、及び、データ出力方法
US20090060454A1 (en) Playback apparatus, playback method, and format
CN120075354A (zh) 歌词显示方法、设备及存储介质
KR20150131539A (ko) 콘텐츠 재생 방법 및 이를 수행하는 전자 기기
WO2021235525A1 (fr) Programme de lecture de contenu et dispositif de lecture de contenu
JPH10340091A (ja) 音楽伴奏信号を発生する方法及び装置及び音楽伴奏装置の中でビデオ出力を発生する方法及び装置
JP2009038775A (ja) 字幕付映像再生端末装置、プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

NENP Non-entry into the national phase

Ref country code: RU

WWW Wipo information: withdrawn in national office

Country of ref document: RU

122 Ep: pct application non-entry in european phase

Ref document number: 05743404

Country of ref document: EP

Kind code of ref document: A1