WO2002063490A1 - Method for processing moving image/contents overlay, electornic mail processing method using the same, and computer-readable storage medium for storing program for execution of either of them - Google Patents

Method for processing moving image/contents overlay, electornic mail processing method using the same, and computer-readable storage medium for storing program for execution of either of them Download PDF

Info

Publication number
WO2002063490A1
WO2002063490A1 PCT/KR2002/000169 KR0200169W WO02063490A1 WO 2002063490 A1 WO2002063490 A1 WO 2002063490A1 KR 0200169 W KR0200169 W KR 0200169W WO 02063490 A1 WO02063490 A1 WO 02063490A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving image
contents
overlay
processing method
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2002/000169
Other languages
French (fr)
Inventor
Yong-Hee Kang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to EP02712495A priority Critical patent/EP1358573A4/en
Priority to JP2002563365A priority patent/JP2004519143A/en
Priority to US10/470,887 priority patent/US20040068547A1/en
Publication of WO2002063490A1 publication Critical patent/WO2002063490A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/60—Business processes related to postal services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0242—Determining effectiveness of advertisements
    • G06Q30/0245—Surveys
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0277—Online advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2362—Generation or processing of Service Information [SI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8545—Content authoring for generating interactive applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests

Definitions

  • the present invention relates to a method for processing a moving image/contents overlay, an electronic mail
  • L0 (E-mail) processing method using the same and a computer- readable storage medium for storing a program for execution of either of them, and more particularly to a moving image/contents overlay processing method wherein a service provider appends contents, such as a caption, to a moving
  • L5 image i.e., a video image
  • a database server or at least one of moving images that are shot in real time by a plurality of Web cameras, temporarily stored in a temporary storage unit and then provided in real time over a network, and provides the contents-appended moving image in
  • a user gains access to a server of a service provider over the Internet and requests it to send a desired moving image, such as a movie or music video, stored in a database server or a desired one of moving images that are shot in real time by a 5 plurality of Web cameras, temporarily stored in a temporary storage unit and then provided in real time over a network
  • the service provider server encodes the desired moving image and sends the resulting moving image data to the user. Thereafter, the user receives the compressed moving image
  • the media player decodes the compressed moving image data sent from the service provider server to restore the original moving image, and displays the restored
  • the contents are conventionally mixed with moving image data, as shown in Fig. 1.
  • FIG. 1 is a block diagram of a conventional streaming- based moving image/contents overlay processing method.
  • a server of a service provider edits an original moving image stream file to create a contents (for example, a caption) - overlaid moving image file.
  • the server then encodes the
  • the server creates a contents (for example, a caption) -overlaid moving image file by overlaying contents on an original moving image file, and encodes and sends the created contents- overlaid moving image file, and the user decodes and
  • L0 displays the moving image file sent from the server.
  • the conventional overlay processing method has a disadvantage in that the contents, such as a caption, are distorted due to losses resulting from the encoding and decoding processes. Unfortunately, a severe distortion of
  • the conventional streaming-based moving image/contents overlay processing method has another disadvantage in that the service provider server edits the original moving image file in advance, resulting in there being no room for the
  • Such video E-mail services are adapted to provide messages separately from the moving images .
  • no E-mail services providing message-overlaid moving images have been provided up to the present .
  • the present invention has been made in view of the above problems, and it is an object of the present invention to provide a moving image/contents overlay
  • L0 processing method for processing contents such as a hypertextable character, banner advertisement, photograph, audio, scent, etc., on a moving image separately from the moving image, so that a user can edit the entire contents at his/her discretion.
  • the moving image/contents overlay processing method comprising the steps of a) selecting any one of a plurality of given moving 5 images; b) selecting one or more contents to be overlaid on the selected moving image; c) generating edit information associated with an overlay of the selected contents on the selected moving image; d) creating a script containing the generated edit information and contents data information;
  • the moving image/contents overlay processing method comprising the steps of a) receiving encoded moving
  • the edit information may include overlay position information, overlay form information, moving image/contents synthesis information and reproduction time 5 information.
  • L0 there is provided a method for processing at least one electronic mail using a moving image/contents overlay processing method, comprising the steps of a) inputting an electronic mail address of an electronic mail recipient; b) selecting one of a plurality of given moving images; c)
  • a moving image reproducing method which is executable in a computer connected to at least one electronic mail server over the Internet
  • a method for processing at least one electronic mail using a moving image/contents overlay processing method comprising
  • the edit information may include overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information.
  • FIG. 1 is a block diagram of a conventional streaming- based moving image/contents overlay processing method
  • Fig. 2 is a block diagram of a streaming-based moving image/contents overlay processing method in accordance with 5 the present invention
  • Fig. 3 is a flow chart illustrating the moving image/contents overlay processing method in accordance with the present invention.
  • Fig. 4 is a block diagram of a reproduction processor L0 for the moving image/contents overlay processing method in accordance with the present invention
  • Fig. 5 is a flow chart illustrating an electronic mail processing method using the moving image/contents overlay processing method in accordance with the present invention.
  • Figs . 6a to 6e are views illustrating examples of a moving image/contents overlay process in accordance with the present invention .
  • the moving image/contents overlay processing method comprises a process by a server of a service provider and a process by a user.
  • the service provider server inputs a moving image and contents selected by the Internet access user and generates edit information associated with an overlay of the contents on the moving image. Thereafter, the server encodes the moving image and Webcasts the resulting moving image data to a computer of the user in the form of a video packet. Further, the server creates a script containing the edit information and contents data information, and then Webcasts the created script to the user computer in the form of a script packet .
  • the video packet Webcast from the service provider server is decoded into the original moving image by a video codec in the user computer.
  • the script packet Webcast from the server is analyzed by a script parser, synthesized with the moving image by a synthesizer such that the contents are overlaid on the moving image, and then rendered for reproduction of the contents-overlaid moving image. If the user clicks a hypertext overlaid on the moving image, then a corresponding URL page is opened or an electronic mail (E-mail) is sent thereto.
  • E-mail electronic mail
  • Fig. 3 is a flow chart illustrating the moving image/contents overlay processing method in accordance with the present invention.
  • the moving image/contents overlay processing method according to the present invention comprises a server process including a selection step S100, a contents input step SllO, an edit information generation 5 step S120, a script creation step S130 and a sending step S140.
  • the service provider server inputs any one of a plurality of given moving images, selected by the Internet access user, at the selection step
  • the server also inputs contents to be overlaid on the selected moving image, from the user, at the contents input step SllO.
  • the contents to be overlaid on the moving image include all materials displayable on a computer
  • L5 screen such as a non-linkable character, a hypertextable character linked to an associated homepage, a banner advertisement, a graphic image such as a photograph or picture, an E-mail address, scent information and audio information.
  • the server At the edit information generation step S120, the server generates edit information associated with an overlay of the contents on the moving image.
  • the edit information preferably contains information regarding positions of the moving image where the contents are to be overlaid, overlay
  • the server creates a script containing the edit information generated at the above edit information generation step S120 and contents data information.
  • the server sends moving image data obtained by encoding the moving image, and the script to the user computer.
  • the moving image/contents overlay processing method according to the present invention further comprises a user process including a reception step S200, a synthesis step S210 and a reproduction step S220.
  • the Internet access user computer receives the encoded moving image data and the script sent from the service provider server at the reception step S200.
  • the user computer decodes the encoded moving image data to restore the original moving image, and synthesizes the contents with the restored moving image on the basis of the edit information contained in the script to overlay the contents on the moving image.
  • the reproduction step S220 the user computer reproduces the contents-overlaid moving image synthesized at the above synthesis step S210.
  • the present moving image/contents overlay processing method is performed in a different manner from conventional moving image/contents overlay processing methods. Namely, in the present moving image/contents overlay processing method, without synthesizing contents with a moving image, the service provider server sends separately to the user computer a compressed moving image,
  • contents data information and edit information which contains overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information, such that the user computer overlays the contents on the moving image .
  • the contents can be prevented from being distorted due to losses resulting from encoding and decoding processes for the transfer of data.
  • the contents are not encoded and decoded for compression and decompression thereof, resulting in no
  • Fig. 4 is a block diagram of a reproduction processor for the moving image/contents overlay processing method in accordance with the present invention.
  • the video packet Webcast from the service provider server is decoded and decompressed by a video codec 11.
  • the script Webcast from the server is analyzed by a script parser 12. Video data decompressed by the video codec 11 and contents analyzed by the script
  • parser 12 are synthesized by a synthesizer 14 and then reproduced in a streaming manner by a video render 15.
  • the contents are overlaid on the moving image being displayed. If the user clicks a hypertext among the contents overlaid on the moving image, then a
  • L0 processing method further comprises an audio process of decompressing audio data by an audio codec 13, synthesizing the decompressed audio data with the video data and contents by the synthesizer 14 and reproducing the resulting audio data by an audio render 16.
  • the audio data process is performed to compress and decompress audio data through the encoding and decoding steps in a similar manner to the video data process, and a detailed description thereof will thus be omitted.
  • Fig. 5 is a flow chart illustrating an electronic mail
  • the electronic mail processing method using the moving image/contents overlay processing method according to the present invention comprises an E-mail sending process
  • the service provider server inputs an address of the E-mail recipient entered by an Internet access user and a moving image and contents selected by the Internet access user and generates edit information associated with an overlay of the contents on the moving image. Thereafter, the service provider server encodes the moving image and sends the resulting moving image data to an E-mail server of the E-mail recipient in the form of a video packet. Further, the service provider server creates a script containing the edit information and contents data information, and then sends the created script to the E-mail server of the E-mail recipient in the form of a script packet .
  • a computer of the E- mail recipient receives the video packet from the E-mail server over the Internet and decodes it through a video codec to restore the original moving image.
  • the script packet received from the E-mail server is analyzed by a script parser, synthesized with the moving image by a synthesizer such that the contents are overlaid on the moving image, and then rendered for reproduction of the contents-overlaid moving image. If the user clicks a hypertext overlaid on the moving image, then a corresponding URL page is opened or an E-mail is sent thereto.
  • the E-mail sending process includes an address input step S300, a selection step S310, a contents input step S320, an edit information generation step S330, a script creation step S340, a message creation step S350 and
  • the service provider server inputs the address of the E-mail recipient entered by the Internet access user at the address input step S300.
  • the server also inputs any one of a plurality of given moving images, selected by the Internet
  • the server further inputs contents to be overlaid on the selected moving image, from the user, at the contents input step S320.
  • the service provider server generates edit information
  • the edit information preferably contains information regarding positions of the moving image where the contents are to be overlaid, overlay form information, information regarding syntheses between the moving image and the
  • the server creates a script containing the edit information generated at the above edit information generation step S330 and contents data information.
  • the server creates a mail
  • the service provider server sends the mail message to the E-mail server of the E-mail recipient at the E-mail sending step S360.
  • the E-mail reception process includes an E-mail
  • the E-mail recipient computer receives from the E-mail server the mail message containing the URL information indicative of the locations of the script and moving image
  • the E-mail recipient computer receives the encoded moving image data and the script on the basis of the URL information contained in the mail message.
  • the E-mail recipient computer receives the encoded moving image data and the script on the basis of the URL information contained in the mail message.
  • L5 recipient computer decodes the encoded moving image data and synthesizes the contents with the resulting moving image on the basis of the edit information contained in the script to overlay the contents on the moving image.
  • the E-mail recipient computer decodes the encoded moving image data and synthesizes the contents with the resulting moving image on the basis of the edit information contained in the script to overlay the contents on the moving image.
  • the electronic mail processing method using the moving image/contents overlay processing method according to the present invention is performed in a
  • the service provider server sends separately to the E-mail recipient computer a compressed moving image, and a script including contents data information and edit information, which contains overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information, such that the E-mail recipient computer overlays the contents on the moving image.
  • contents data information and edit information which contains overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information, such that the E-mail recipient computer overlays the contents on the moving image.
  • contents can be prevented from being distorted due to losses resulting from encoding and decoding processes for the transfer of data.
  • a mail message can be overlaid as content on a moving image. Therefore, the E-mail recipient can receive a unique and high-grade mail message.
  • the present invention further provides a computer- readable storage medium for storing programs for execution of the moving image/contents overlay processing method and the electronic mail processing method using the same.
  • the storage medium is a typical storage unit such as a floppy disk, hard disk, CD- ROM or etc.
  • the execution programs are installed or plugged in a computer through the storage medium to execute in the computer the moving image/contents overlay processing method and the electronic mail processing method using the same.
  • the process where the service provider server sends the encoded moving image and the script containing the edit information and contents data information to the user or E- mail recipient computer will hereinafter be described in more detail in conjunction with embodiments.
  • the URLs indicative of the locations of the moving image and script are two parameters in a plugin tag of a program executable in the computer.
  • the server sends the moving image and script from URL locations designated by the two parameters in the plugin tag to the user or E-mail recipient computer. Thereafter, the user or E-mail recipient computer receives and reproduces the moving image and script sent from the service provider server in a streaming or downloading manner.
  • the embodiment 1 is the case where the service provider server sends both the moving image and script to the user or E-mail recipient computer in the downloading manner.
  • the service provider server In response to the video service request from the user or E-mail recipient computer, the service provider server sends the moving image and script from the corresponding URL locations to the user or E-mail recipient computer en masse with reference to the two parameters in the plugin tag.
  • the user or E-mail recipient computer After downloading the moving image and script sent from the service provider server, the user or E-mail recipient computer executes the moving image through a media player. At this time, the contents are overlaid on the corresponding positions of the moving image on the basis of the overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information in the edit information, and the contents data information, contained in the script.
  • the contents to be overlaid on the moving image include all types of data formats supportable by the media player, such as a general character, a linkable hypertext character, an HTML text, an E-mail address, and a graphic image such as a picture or photograph.
  • the embodiment 2 is the case where the service provider server sends both the moving image and script to the user or E-mail recipient computer in the streaming manner.
  • the service provider server In response to the video service request from the user or E-mail recipient computer, the service provider server sends the moving image and script from the corresponding URL locations to the user or E-mail recipient computer on a packet basis with reference to the two parameters in the plugin tag.
  • the user or E-mail recipient computer receives the moving image and script sent from the service provider server
  • the embodiment 3 is the case where the service provider server first sends the script to the user or E-mail recipient computer in the downloading manner and then the moving image to the computer in the streaming manner.
  • the service provider server Upon receiving the video service request from the user or E-mail recipient computer, the service provider server first sends the script from the corresponding URL location to the user or E-mail recipient computer en masse with reference to the corresponding parameter in the plugin tag.
  • service provider server then sends the moving image from the corresponding URL location to the user or E-mail recipient computer on a packet basis with reference to the corresponding parameter in the plugin tag. Thereafter, the user or E-mail recipient computer receives the moving image sent from the service provider server packet-by-packet , and then displays the moving image through a media player therein. At this time, the contents are overlaid on the corresponding positions of the moving image being received packet-by-packet, on the basis of the overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information in the edit information, and the contents data information, contained in the previously downloaded script .
  • the embodiment 4 is the case where the service provider server sends the moving image and script to the user or E-mail recipient computer in the streaming or downloading manner, and the user or E-mail recipient computer displays the contents- overlaid moving image through a media player therein, wherein the overlaid contents are moving images, too.
  • the script stored in the location of the script URL which is one of the two parameters in the plugin tag includes another plugin tag. Accordingly, the user or E-mail recipient computer executes the moving image through the media player and, at this time, the moving image contents are overlaid on the corresponding positions of the moving image on the basis of the overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information in the edit information, and the contents data information, contained in the script.
  • the embodiment 5 is the case where the contents include scent information under the condition that any one of the sending methods in the embodiments 1 to 4 is employed.
  • the service provider server sends to 15 the user or E-mail recipient computer the contents including scent information compatible with, for example, software SENXWare SDS (Scent Design Studio) by Trisenx, Inc., and the user or E-mail recipient computer reproduces the scent information through a dedicated scent generator cartridge 20 therein.
  • scent information compatible with, for example, software SENXWare SDS (Scent Design Studio) by Trisenx, Inc.
  • the selected scent is emitted at a proper time.
  • the embodiment 6 is the case where the contents include audio information under the condition that any one of the sending methods in the embodiments 1 to 4 is employed.
  • the service provider server sends to the user or E-mail recipient computer the contents including voice or music information selected or uploaded by the user at his/her discretion, and the user or E-mail recipient computer reproduces the voice or music information through a dedicated audio player therein.
  • the embodiment 7 is the case where the contents include a variety of materials, such as a hypertext, a graphic image, audio information, scent information, an HTML text, etc., under the condition that any one of the sending methods in the embodiments 1 to 4 is employed.
  • the moving image session may be composed of a first moving image for 10 minutes, a first still image for 1 minute, the first still image on the first moving image for the next 10 minutes, the first still image for the next 1 minute, a second moving image for the next 10 minutes, and a second still image for the next 1 minute, as shown in Fig. 6a.
  • the audio information may be composed of first audio for 10 minutes, second audio for 1 minute, a combination of the first audio and the second audio for the next 10 minutes, the second audio for the next 1 minute, third audio for the next 10 minutes, and the second audio for the next 1 minute, as shown in Fig. 6b.
  • the scent information may be composed of a herb scent emitted only while the first still image is overlaid on the first moving image after 11 minutes, as shown in Fig. 6c.
  • the text which is the user's message, is displayed on a certain area while the herb scent is emitted, as shown in Fig. 6d.
  • the hypertext is composed of different contents at different times, as shown in Fig. 6e .
  • the hypertext is a banner advertisement
  • the service provider not the user, may edit and insert the hypertext freely with no user's permission in compensation for the service provision.
  • optimum advertisements for example, an A company advertisement, B company advertisement and C company advertisement in order
  • text and still image can be simply displayed, various display positions or sizes may be applied thereto. It will also be understood that the text and still image may be subjected to a variety of effects such as scroll, marquee, transparent process, semitransparent process, screen separation and so forth.
  • the present invention provides a moving image/contents overlay processing method wherein a service provider server sends a moving image and contents separately such that a user or E- mail recipient computer overlays the contents on the moving image, and an electronic mail processing method using the same.
  • the contents are not distorted, so that they can be distinct.
  • an E-mail message can be naturally overlaid on the moving image. Therefore, the user can freely transfer a unique and high- grade editable mail message.
  • contents such as audio or scent can be applied to a mail message, resulting in an increase in three-dimensional effect of message transfer.
  • interactive contents can be overlaid on the moving image. As a result, in the case where the interactive contents are applied to moving image advertisements, advertising effects can be enhanced.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Tourism & Hospitality (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Systems (AREA)

Abstract

A method for processing a moving image/contents overlay, an electronic mail processing method using the same, and a computer-readable storage medium for storing a program for execution of either of them. Without synthesizing contents with a moving image, a service provider server sends separately to a computer of a user or an electronic mail server a compressed moving image, and a script including contents data information and edit information from the user, such that the user computer or an electronic mail recipient computer overlays the contents on the moving image at positions desired by the user and in forms desired by the user. As a result, the contents can be prevented from being distorted due to losses resulting from encoding and decoding processes. An electronic mail message can be naturally overlaid on the moving image.

Description

METHOD FOR PROCESSING MOVING IMAGE/CONTENTS OVERLAY, ELECTRONIC MAIL PROCESSING METHOD USING THE SAME, AND COMPUTER-READABLE STORAGE MEDIUM FOR STORING PROGRAM FOR EXECUTION OF EITHER OF THEM 5
Technical Field
The present invention relates to a method for processing a moving image/contents overlay, an electronic mail
L0 (E-mail) processing method using the same, and a computer- readable storage medium for storing a program for execution of either of them, and more particularly to a moving image/contents overlay processing method wherein a service provider appends contents, such as a caption, to a moving
L5 image (i.e., a video image) stored in a database server or at least one of moving images that are shot in real time by a plurality of Web cameras, temporarily stored in a temporary storage unit and then provided in real time over a network, and provides the contents-appended moving image in
20 an on-demand manner, and a video E-mail processing method for transmitting and receiving video mails using the same.
Background Art
25 In a conventional on-demand video processing method, if a user gains access to a server of a service provider over the Internet and requests it to send a desired moving image, such as a movie or music video, stored in a database server or a desired one of moving images that are shot in real time by a 5 plurality of Web cameras, temporarily stored in a temporary storage unit and then provided in real time over a network, then the service provider server encodes the desired moving image and sends the resulting moving image data to the user. Thereafter, the user receives the compressed moving image
L0 data sent from the service provider server in a streaming or downloading manner and views it through a media player run in his/her computer. The media player decodes the compressed moving image data sent from the service provider server to restore the original moving image, and displays the restored
L5 moving image to the user.
On the other hand, for provision of contents, such as a caption, to the user in addition to the above video provision service, the contents are conventionally mixed with moving image data, as shown in Fig. 1.
20 Fig. 1 is a block diagram of a conventional streaming- based moving image/contents overlay processing method. A server of a service provider edits an original moving image stream file to create a contents (for example, a caption) - overlaid moving image file. The server then encodes the
25 created contents-overlaid moving image file and sends the resulting moving image file to a user. Thereafter, the user receives the moving image file sent from the server over the Internet and decodes and displays it through a media player. In the above-mentioned conventional streaming-based 5 moving image/contents overlay processing method, the server creates a contents (for example, a caption) -overlaid moving image file by overlaying contents on an original moving image file, and encodes and sends the created contents- overlaid moving image file, and the user decodes and
L0 displays the moving image file sent from the server. However, the conventional overlay processing method has a disadvantage in that the contents, such as a caption, are distorted due to losses resulting from the encoding and decoding processes. Unfortunately, a severe distortion of
L5 the contents makes it hard to read the contents.
The conventional streaming-based moving image/contents overlay processing method has another disadvantage in that the service provider server edits the original moving image file in advance, resulting in there being no room for the
20 user to edit the original moving image file at his/her discretion.
On the other hand, many video E-mail services have been provided to provide E-mails attached with moving images to recipients such that the moving images are reproduced in
25 a streaming manner. Such video E-mail services are adapted to provide messages separately from the moving images . In this regard, no E-mail services providing message-overlaid moving images have been provided up to the present .
5 Disclosure of the Invention
Therefore, the present invention has been made in view of the above problems, and it is an object of the present invention to provide a moving image/contents overlay
L0 processing method for processing contents, such as a hypertextable character, banner advertisement, photograph, audio, scent, etc., on a moving image separately from the moving image, so that a user can edit the entire contents at his/her discretion.
L5 It is another object of the present invention to provide an electronic mail processing method using a moving image/contents overlay processing method which processes contents, such as a hypertextable character, banner advertisement, photograph, audio, scent, etc., on a moving
20 image separately from the moving image, so that a user can edit the entire contents at his/her discretion.
In accordance with one aspect of the present invention, the above and other objects can be accomplished by the provision of a method for processing a moving
25 image/contents overlay in a video processing method which is executable in a video service provision computer connected to at least one user computer over the Internet, the moving image/contents overlay processing method comprising the steps of a) selecting any one of a plurality of given moving 5 images; b) selecting one or more contents to be overlaid on the selected moving image; c) generating edit information associated with an overlay of the selected contents on the selected moving image; d) creating a script containing the generated edit information and contents data information;
L0 and e) sending moving image data obtained by encoding the selected moving image, and the created script to the user computer.
In accordance with another aspect of the present invention, there is provided a method for processing a
L5 moving image/contents overlay in a moving image reproducing method which is executable in a user computer connected to at least one video service provision computer over the Internet, the moving image/contents overlay processing method comprising the steps of a) receiving encoded moving
20 image data and a script sent from the video service provision computer; b) decoding the received, encoded moving image data to restore an original moving image, and synthesizing contents with the restored moving image on the basis of edit information contained in the received script
25 to overlay the contents on the moving image; and c) reproducing the contents-overlaid moving image.
Preferably, the edit information may include overlay position information, overlay form information, moving image/contents synthesis information and reproduction time 5 information.
In accordance with another aspect of the present invention, in a video electronic mail processing method which is executable in a video service provision computer connected to at least one user computer over the Internet,
L0 there is provided a method for processing at least one electronic mail using a moving image/contents overlay processing method, comprising the steps of a) inputting an electronic mail address of an electronic mail recipient; b) selecting one of a plurality of given moving images; c)
L5 selecting one or more contents to be overlaid on the selected moving image; d) generating edit information associated with an overlay of the selected contents on the selected moving image; e) creating a script containing the generated edit information and contents data information; f)
20 creating a mail message containing URL information indicative of locations of the script and moving image; and g) sending the created mail message to an electronic mail server of the electronic mail recipient .
In accordance with yet another aspect of the present
25 invention, in a moving image reproducing method which is executable in a computer connected to at least one electronic mail server over the Internet, there is provided a method for processing at least one electronic mail using a moving image/contents overlay processing method, comprising
5 the steps of a) receiving from the electronic mail server a mail message containing URL information indicative of locations of a script and a moving image; b) receiving encoded moving image data and the script on the basis of the URL information contained in the mail message; c) decoding
L0 the received, encoded moving image data to restore the moving image, and synthesizing contents with the moving image on the basis of edit information contained in the received script to overlay the contents on the moving image; and d) reproducing the contents-overlaid moving image.
L5 Preferably, the edit information may include overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information.
20 Brief Description of the Drawings
The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in 25 conjunction with the accompanying drawings, in which: Fig. 1 is a block diagram of a conventional streaming- based moving image/contents overlay processing method;
Fig. 2 is a block diagram of a streaming-based moving image/contents overlay processing method in accordance with 5 the present invention;
Fig. 3 is a flow chart illustrating the moving image/contents overlay processing method in accordance with the present invention;
Fig. 4 is a block diagram of a reproduction processor L0 for the moving image/contents overlay processing method in accordance with the present invention;
Fig. 5 is a flow chart illustrating an electronic mail processing method using the moving image/contents overlay processing method in accordance with the present invention; L5 and
Figs . 6a to 6e are views illustrating examples of a moving image/contents overlay process in accordance with the present invention .
20 Best Mode for Carrying Out the Invention
With reference to Fig. 2, there is shown in block form a streaming-based moving image/contents overlay processing method in accordance with the present invention. 25 The moving image/contents overlay processing method according to the present invention comprises a process by a server of a service provider and a process by a user.
In the server process, the service provider server inputs a moving image and contents selected by the Internet access user and generates edit information associated with an overlay of the contents on the moving image. Thereafter, the server encodes the moving image and Webcasts the resulting moving image data to a computer of the user in the form of a video packet. Further, the server creates a script containing the edit information and contents data information, and then Webcasts the created script to the user computer in the form of a script packet .
In the user process, the video packet Webcast from the service provider server is decoded into the original moving image by a video codec in the user computer. The script packet Webcast from the server is analyzed by a script parser, synthesized with the moving image by a synthesizer such that the contents are overlaid on the moving image, and then rendered for reproduction of the contents-overlaid moving image. If the user clicks a hypertext overlaid on the moving image, then a corresponding URL page is opened or an electronic mail (E-mail) is sent thereto.
Fig. 3 is a flow chart illustrating the moving image/contents overlay processing method in accordance with the present invention. As shown in Fig. 3, the moving image/contents overlay processing method according to the present invention comprises a server process including a selection step S100, a contents input step SllO, an edit information generation 5 step S120, a script creation step S130 and a sending step S140.
In detail, in the server process, the service provider server inputs any one of a plurality of given moving images, selected by the Internet access user, at the selection step
L0 S100. The server also inputs contents to be overlaid on the selected moving image, from the user, at the contents input step SllO.
Note that the contents to be overlaid on the moving image include all materials displayable on a computer
L5 screen, such as a non-linkable character, a hypertextable character linked to an associated homepage, a banner advertisement, a graphic image such as a photograph or picture, an E-mail address, scent information and audio information.
20 At the edit information generation step S120, the server generates edit information associated with an overlay of the contents on the moving image. The edit information preferably contains information regarding positions of the moving image where the contents are to be overlaid, overlay
25 form information, information regarding syntheses between the moving image and the contents, and reproduction time information. At the script creation step S130, the server creates a script containing the edit information generated at the above edit information generation step S120 and contents data information. At the sending step S140, the server sends moving image data obtained by encoding the moving image, and the script to the user computer.
The moving image/contents overlay processing method according to the present invention further comprises a user process including a reception step S200, a synthesis step S210 and a reproduction step S220.
In detail, in the user process, the Internet access user computer receives the encoded moving image data and the script sent from the service provider server at the reception step S200. At the synthesis step S210, the user computer decodes the encoded moving image data to restore the original moving image, and synthesizes the contents with the restored moving image on the basis of the edit information contained in the script to overlay the contents on the moving image. At the reproduction step S220, the user computer reproduces the contents-overlaid moving image synthesized at the above synthesis step S210.
As described above, the present moving image/contents overlay processing method is performed in a different manner from conventional moving image/contents overlay processing methods. Namely, in the present moving image/contents overlay processing method, without synthesizing contents with a moving image, the service provider server sends separately to the user computer a compressed moving image,
5 and a script including contents data information and edit information, which contains overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information, such that the user computer overlays the contents on the moving image . As
L0 a result, the contents can be prevented from being distorted due to losses resulting from encoding and decoding processes for the transfer of data. In other words, according to the present invention, the contents are not encoded and decoded for compression and decompression thereof, resulting in no
L5 data loss. Therefore, the contents with no distortion can be overlaid on the moving image.
Fig. 4 is a block diagram of a reproduction processor for the moving image/contents overlay processing method in accordance with the present invention.
20 As shown in Fig. 4, the video packet Webcast from the service provider server is decoded and decompressed by a video codec 11. The script Webcast from the server is analyzed by a script parser 12. Video data decompressed by the video codec 11 and contents analyzed by the script
25 parser 12 are synthesized by a synthesizer 14 and then reproduced in a streaming manner by a video render 15.
As a result, the contents are overlaid on the moving image being displayed. If the user clicks a hypertext among the contents overlaid on the moving image, then a
5 corresponding URL page is opened or an E-mail is sent thereto. In the case where the user clicks a banner bar among the contents overlaid on the moving image, then an associated advertisement page is opened.
As shown in Fig. 4, the moving image/contents overlay
L0 processing method according to the present invention further comprises an audio process of decompressing audio data by an audio codec 13, synthesizing the decompressed audio data with the video data and contents by the synthesizer 14 and reproducing the resulting audio data by an audio render 16.
L5 The audio data process is performed to compress and decompress audio data through the encoding and decoding steps in a similar manner to the video data process, and a detailed description thereof will thus be omitted.
Fig. 5 is a flow chart illustrating an electronic mail
20 processing method using the moving image/contents overlay processing method in accordance with the present invention.
The electronic mail processing method using the moving image/contents overlay processing method according to the present invention comprises an E-mail sending process
25 performed by a server of a service provider, and an E-mail reception process performed by an E-mail recipient.
In the E-mail sending process, the service provider server inputs an address of the E-mail recipient entered by an Internet access user and a moving image and contents selected by the Internet access user and generates edit information associated with an overlay of the contents on the moving image. Thereafter, the service provider server encodes the moving image and sends the resulting moving image data to an E-mail server of the E-mail recipient in the form of a video packet. Further, the service provider server creates a script containing the edit information and contents data information, and then sends the created script to the E-mail server of the E-mail recipient in the form of a script packet . In the E-mail reception process, a computer of the E- mail recipient receives the video packet from the E-mail server over the Internet and decodes it through a video codec to restore the original moving image. The script packet received from the E-mail server is analyzed by a script parser, synthesized with the moving image by a synthesizer such that the contents are overlaid on the moving image, and then rendered for reproduction of the contents-overlaid moving image. If the user clicks a hypertext overlaid on the moving image, then a corresponding URL page is opened or an E-mail is sent thereto. In detail, the E-mail sending process includes an address input step S300, a selection step S310, a contents input step S320, an edit information generation step S330, a script creation step S340, a message creation step S350 and
5 an E-mail sending step S360.
The service provider server inputs the address of the E-mail recipient entered by the Internet access user at the address input step S300. The server also inputs any one of a plurality of given moving images, selected by the Internet
L0 access user, at the selection step S310. The server further inputs contents to be overlaid on the selected moving image, from the user, at the contents input step S320.
At the edit information generation step S330, the service provider server generates edit information
L5 associated with an overlay of the contents on the moving image. The edit information preferably contains information regarding positions of the moving image where the contents are to be overlaid, overlay form information, information regarding syntheses between the moving image and the
20 contents, and reproduction time information. At the script creation step S340, the server creates a script containing the edit information generated at the above edit information generation step S330 and contents data information. At the message creation step S350, the server creates a mail
25 message containing URL information indicative of the locations of the script and moving image. Then, the service provider server sends the mail message to the E-mail server of the E-mail recipient at the E-mail sending step S360.
The E-mail reception process includes an E-mail
5 reception step S400, a moving image/script reception step S410, a synthesis step S420 and a reproduction step S430.
The E-mail recipient computer receives from the E-mail server the mail message containing the URL information indicative of the locations of the script and moving image
L0 at the E-mail reception step S400. At the moving image/script reception step S410, the E-mail recipient computer receives the encoded moving image data and the script on the basis of the URL information contained in the mail message. At the synthesis step S420, the E-mail
L5 recipient computer decodes the encoded moving image data and synthesizes the contents with the resulting moving image on the basis of the edit information contained in the script to overlay the contents on the moving image. At the reproduction step S430, the E-mail recipient computer
20 reproduces the contents-overlaid moving image synthesized at the above synthesis step S420.
As described above, the electronic mail processing method using the moving image/contents overlay processing method according to the present invention is performed in a
25 different manner from conventional electronic mail processing methods. That is, in the present electronic mail processing method, without synthesizing contents with a moving image, the service provider server sends separately to the E-mail recipient computer a compressed moving image, and a script including contents data information and edit information, which contains overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information, such that the E-mail recipient computer overlays the contents on the moving image. As a result, the contents can be prevented from being distorted due to losses resulting from encoding and decoding processes for the transfer of data. Further, for sending of an E-mail, a mail message can be overlaid as content on a moving image. Therefore, the E-mail recipient can receive a unique and high-grade mail message.
The present invention further provides a computer- readable storage medium for storing programs for execution of the moving image/contents overlay processing method and the electronic mail processing method using the same. In the present invention, the storage medium is a typical storage unit such as a floppy disk, hard disk, CD- ROM or etc. The execution programs are installed or plugged in a computer through the storage medium to execute in the computer the moving image/contents overlay processing method and the electronic mail processing method using the same. The process where the service provider server sends the encoded moving image and the script containing the edit information and contents data information to the user or E- mail recipient computer will hereinafter be described in more detail in conjunction with embodiments.
The URLs indicative of the locations of the moving image and script are two parameters in a plugin tag of a program executable in the computer.
If the user or E-mail recipient computer requests the video service from the service provider server, then the server sends the moving image and script from URL locations designated by the two parameters in the plugin tag to the user or E-mail recipient computer. Thereafter, the user or E-mail recipient computer receives and reproduces the moving image and script sent from the service provider server in a streaming or downloading manner.
<Embodiment 1>
The embodiment 1 is the case where the service provider server sends both the moving image and script to the user or E-mail recipient computer in the downloading manner.
In response to the video service request from the user or E-mail recipient computer, the service provider server sends the moving image and script from the corresponding URL locations to the user or E-mail recipient computer en masse with reference to the two parameters in the plugin tag.
After downloading the moving image and script sent from the service provider server, the user or E-mail recipient computer executes the moving image through a media player. At this time, the contents are overlaid on the corresponding positions of the moving image on the basis of the overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information in the edit information, and the contents data information, contained in the script.
The contents to be overlaid on the moving image include all types of data formats supportable by the media player, such as a general character, a linkable hypertext character, an HTML text, an E-mail address, and a graphic image such as a picture or photograph.
<Embodiment 2>
The embodiment 2 is the case where the service provider server sends both the moving image and script to the user or E-mail recipient computer in the streaming manner.
In response to the video service request from the user or E-mail recipient computer, the service provider server sends the moving image and script from the corresponding URL locations to the user or E-mail recipient computer on a packet basis with reference to the two parameters in the plugin tag.
The user or E-mail recipient computer receives the moving image and script sent from the service provider server
5 packet-by-packet, and then executes the moving image through a media player. At this time, the contents are overlaid on the corresponding positions of the moving image being received packet-by-packet, on the basis of the overlay position information, overlay form information, moving image/contents
L0 synthesis information and reproduction time information in the edit information, and the contents data information, contained in the script .
<Embodiment 3>
L5
The embodiment 3 is the case where the service provider server first sends the script to the user or E-mail recipient computer in the downloading manner and then the moving image to the computer in the streaming manner.
20 Upon receiving the video service request from the user or E-mail recipient computer, the service provider server first sends the script from the corresponding URL location to the user or E-mail recipient computer en masse with reference to the corresponding parameter in the plugin tag. The
25 service provider server then sends the moving image from the corresponding URL location to the user or E-mail recipient computer on a packet basis with reference to the corresponding parameter in the plugin tag. Thereafter, the user or E-mail recipient computer receives the moving image sent from the service provider server packet-by-packet , and then displays the moving image through a media player therein. At this time, the contents are overlaid on the corresponding positions of the moving image being received packet-by-packet, on the basis of the overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information in the edit information, and the contents data information, contained in the previously downloaded script .
<Embodiment 4>
The embodiment 4 is the case where the service provider server sends the moving image and script to the user or E-mail recipient computer in the streaming or downloading manner, and the user or E-mail recipient computer displays the contents- overlaid moving image through a media player therein, wherein the overlaid contents are moving images, too.
That is, in this embodiment, the script stored in the location of the script URL which is one of the two parameters in the plugin tag includes another plugin tag. Accordingly, the user or E-mail recipient computer executes the moving image through the media player and, at this time, the moving image contents are overlaid on the corresponding positions of the moving image on the basis of the overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information in the edit information, and the contents data information, contained in the script.
<Embodiment 5>
L0
The embodiment 5 is the case where the contents include scent information under the condition that any one of the sending methods in the embodiments 1 to 4 is employed.
In this embodiment, the service provider server sends to 15 the user or E-mail recipient computer the contents including scent information compatible with, for example, software SENXWare SDS (Scent Design Studio) by Trisenx, Inc., and the user or E-mail recipient computer reproduces the scent information through a dedicated scent generator cartridge 20 therein.
Namely, if the user selects a scent appropriate to the moving image provided from the sender, the selected scent is emitted at a proper time.
25 <Embodiment 6> The embodiment 6 is the case where the contents include audio information under the condition that any one of the sending methods in the embodiments 1 to 4 is employed. In this embodiment, the service provider server sends to the user or E-mail recipient computer the contents including voice or music information selected or uploaded by the user at his/her discretion, and the user or E-mail recipient computer reproduces the voice or music information through a dedicated audio player therein.
<Embodiment 7>
The embodiment 7 is the case where the contents include a variety of materials, such as a hypertext, a graphic image, audio information, scent information, an HTML text, etc., under the condition that any one of the sending methods in the embodiments 1 to 4 is employed.
For example, in the case where the user intends to edit one moving image session for 33 minutes, the moving image session may be composed of a first moving image for 10 minutes, a first still image for 1 minute, the first still image on the first moving image for the next 10 minutes, the first still image for the next 1 minute, a second moving image for the next 10 minutes, and a second still image for the next 1 minute, as shown in Fig. 6a. At this time, the audio information may be composed of first audio for 10 minutes, second audio for 1 minute, a combination of the first audio and the second audio for the next 10 minutes, the second audio for the next 1 minute, third audio for the next 10 minutes, and the second audio for the next 1 minute, as shown in Fig. 6b. The scent information may be composed of a herb scent emitted only while the first still image is overlaid on the first moving image after 11 minutes, as shown in Fig. 6c. The text, which is the user's message, is displayed on a certain area while the herb scent is emitted, as shown in Fig. 6d. The hypertext is composed of different contents at different times, as shown in Fig. 6e . Provided that the hypertext is a banner advertisement, the service provider, not the user, may edit and insert the hypertext freely with no user's permission in compensation for the service provision. It will be understood that optimum advertisements (for example, an A company advertisement, B company advertisement and C company advertisement in order) may be previously programmed to be provided in such a situation that a viewer is interested in the entire one-session moving image edited by the user.
Although the text and still image can be simply displayed, various display positions or sizes may be applied thereto. It will also be understood that the text and still image may be subjected to a variety of effects such as scroll, marquee, transparent process, semitransparent process, screen separation and so forth.
The above embodiments have been disclosed to generate edit information associated with various types of contents under the control of the user. Alternatively, if there is no edit information input from the user, the service provider server itself may randomly generate and send edit information.
Industrial Applicability
As apparent from the above description, the present invention provides a moving image/contents overlay processing method wherein a service provider server sends a moving image and contents separately such that a user or E- mail recipient computer overlays the contents on the moving image, and an electronic mail processing method using the same. According to the present invention, the contents are not distorted, so that they can be distinct. Also, an E-mail message can be naturally overlaid on the moving image. Therefore, the user can freely transfer a unique and high- grade editable mail message. Further, contents such as audio or scent can be applied to a mail message, resulting in an increase in three-dimensional effect of message transfer. Furthermore, interactive contents can be overlaid on the moving image. As a result, in the case where the interactive contents are applied to moving image advertisements, advertising effects can be enhanced.
Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims .

Claims

Claims :
1. A method for processing a moving image/contents overlay in a video processing method which is executable in a video service provision computer connected to at least one user computer over the Internet, said moving image/contents overlay processing method comprising the steps of: a) selecting any one of a plurality of given moving images ; b) selecting one or more contents to be overlaid on the selected moving image; c) generating edit information associated with an overlay of the selected contents on said selected moving image; d) creating a script containing the generated edit information and contents data information; and e) sending moving image data obtained by encoding said selected moving image, and the created script to said user computer .
2. A method for processing a moving image/contents overlay in a moving image reproducing method which is executable in a user computer connected to at least one video service provision computer over the Internet, said moving image/contents overlay processing method comprising the steps of : a) receiving encoded moving image data and a script sent from said video service provision computer; b) decoding the received, encoded moving image data to restore an original moving image, and synthesizing contents with the restored moving image on the basis of edit information contained in the received script to overlay the contents on said moving image; and c) reproducing the contents-overlaid moving image.
3. The moving image/contents overlay processing method as set forth in claim 1 or 2, wherein said edit information includes overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information.
4. The moving image/contents overlay processing method as set forth in claim 1 or 2, wherein said contents include a text or a hypertextable character linked to an associated homepage .
5. The moving image/contents overlay processing method as set forth in claim 1 or 2, wherein said contents include a banner advertisement.
6. The moving image/contents overlay processing method as set forth in claim 1 or 2, wherein said contents include a graphic image, said graphic image being a photograph or picture .
7. The moving image/contents overlay processing method as set forth in claim 1 or 2, wherein said contents include scent information.
8. The moving image/contents overlay processing method as set forth in claim 1 or 2, wherein said contents include audio information.
9. A computer-readable storage medium for storing a program for execution of the moving image/contents overlay processing method as set forth in claim 1 or 2.
10. In a video electronic mail processing method which is executable in a video service provision computer connected to at least one user computer over the Internet, a method for processing at least one electronic mail using a moving image/contents overlay processing method, comprising the steps of: a) inputting an electronic mail address of an electronic mail recipient; b) selecting one of a plurality of given moving images ; c) selecting one or more contents to be overlaid on the selected moving image; d) generating edit information associated with an overlay of the selected contents on said selected moving image; e) creating a script containing the generated edit information and contents data information; f) creating a mail message containing URL information indicative of locations of said script and moving image; and g) sending the created mail message to an electronic mail server of said electronic mail recipient .
11. In a moving image reproducing method which is executable in a computer connected to at least one electronic mail server over the Internet, a method for processing at least one electronic mail using a moving image/contents overlay processing method, comprising the steps of: a) receiving from said electronic mail server a mail message containing URL information indicative of locations of a script and a moving image; b) receiving encoded moving image data and the script on the basis of said URL information contained in said mail message; c) decoding the received, encoded moving image data to restore said moving image, and synthesizing contents with said moving image on the basis of edit information contained in the received script to overlay the contents on said moving image; and d) reproducing the contents-overlaid moving image.
12. The electronic mail processing method as set forth in claim 10 or 11, wherein said edit information includes overlay position information, overlay form information, moving image/contents synthesis information and reproduction time information.
13. The electronic mail processing method as set forth in claim 10 or 11, wherein said contents include a text or a hypertextable character linked to an associated homepage.
14. The electronic mail processing method as set forth in claim 10 or 11, wherein said contents include a banner advertisement .
15. The electronic mail processing method as set forth in claim 10 or 11, wherein said contents include a graphic image, said graphic image being a photograph or picture.
16. The electronic mail processing method as set forth in claim 10 or 11, wherein said contents include scent information.
17. The electronic mail processing method as set forth in claim 10 or 11, wherein said contents include audio information.
18. A computer-readable storage medium for storing a program for execution of the electronic mail processing method as set forth in claim 10 or 11.
PCT/KR2002/000169 2001-02-06 2002-02-06 Method for processing moving image/contents overlay, electornic mail processing method using the same, and computer-readable storage medium for storing program for execution of either of them Ceased WO2002063490A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP02712495A EP1358573A4 (en) 2001-02-06 2002-02-06 METHOD FOR PROCESSING MOVABLE IMAGES / CONTENT WITH OVERLAY, EMAIL PROCESSING METHOD THEREFOR, AND COMPUTER-READABLE STORAGE MEDIUM FOR STORING A PROGRAM FOR THE EXECUTION OF ANY
JP2002563365A JP2004519143A (en) 2001-02-06 2002-02-06 Method for processing overlay of moving image and content, method for processing e-mail using the same, and computer-readable recording medium storing program for executing the method
US10/470,887 US20040068547A1 (en) 2001-02-06 2002-02-06 Method for processing moving image/contents overlay, electronic mail processing method using the same, and computer-readable storage medium for storing program for execution of either of them

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020010005679A KR20020065250A (en) 2001-02-06 2001-02-06 Processing Method for overlaying Contents on Moving Picture and Processing Method for Electronic Mail using the same and A computer-readable Storage Medium for executing the above Method
KR2001/5679 2001-02-06

Publications (1)

Publication Number Publication Date
WO2002063490A1 true WO2002063490A1 (en) 2002-08-15

Family

ID=19705392

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2002/000169 Ceased WO2002063490A1 (en) 2001-02-06 2002-02-06 Method for processing moving image/contents overlay, electornic mail processing method using the same, and computer-readable storage medium for storing program for execution of either of them

Country Status (6)

Country Link
US (1) US20040068547A1 (en)
EP (1) EP1358573A4 (en)
JP (1) JP2004519143A (en)
KR (1) KR20020065250A (en)
CN (1) CN1491393A (en)
WO (1) WO2002063490A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004341740A (en) * 2003-05-14 2004-12-02 Sharp Corp Email receiver
EP3881870A1 (en) * 2020-03-20 2021-09-22 Noustique Perfumes, S.L. Methods and systems for dispensing a customized fragrance

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7493359B2 (en) * 2004-12-17 2009-02-17 International Business Machines Corporation E-mail role templates for classifying e-mail
US20090024922A1 (en) * 2006-07-31 2009-01-22 David Markowitz Method and system for synchronizing media files
US20090106397A1 (en) * 2007-09-05 2009-04-23 O'keefe Sean Patrick Method and apparatus for interactive content distribution
KR101648711B1 (en) * 2008-01-14 2016-08-24 삼성전자주식회사 Apparatus for processing moving image ancillary information using script and method thereof
US9111287B2 (en) * 2009-09-30 2015-08-18 Microsoft Technology Licensing, Llc Video content-aware advertisement placement
KR101537281B1 (en) * 2013-12-23 2015-07-22 휴텍 주식회사 Web-view based method providing interactive contents, and computer-readable recording medium for the same

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000049986A (en) * 2000-05-10 2000-08-05 안우길 Messaging service system and method for processing the same
KR20000054715A (en) * 2000-06-20 2000-09-05 김광섭 Method and system for servicing by using the internet, method for producing and transmitting moving picture files and recording medium thereof
KR20000054674A (en) * 2000-06-16 2000-09-05 정철현 internet e-mail service with video and audio
KR20000053723A (en) * 2000-03-03 2000-09-05 강원일 Moving picture mailing method

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0673581B2 (en) * 1992-12-09 2009-07-22 Sedna Patent Services, LLC Set top terminal for cable television delivery systems
US6234455B1 (en) * 1994-06-30 2001-05-22 Gotz-Ulrich Wittek Device and process for delivering substances for dispersal in the air
US5949522A (en) * 1996-07-03 1999-09-07 Manne; Joseph S. Multimedia linked scent delivery system
GB2327837B (en) * 1997-07-29 1999-09-15 Microsoft Corp Providing enhanced content with broadcast video
CA2311920C (en) * 1997-08-08 2005-05-03 Qorvis Media Group, Inc. A reconfigurable audiovisual previewing system and method of operation
ATE236488T1 (en) * 1998-06-04 2003-04-15 Roberto Trinca METHOD AND DEVICE FOR CONDUCTING VIDEO CONFERENCES WITH THE SIMULTANEOUS INSERTION OF ADDITIONAL INFORMATION AND MOVIES USING TELEVISION MODALITIES
US6136277A (en) * 1998-08-12 2000-10-24 Nardini; Joseph Fragrance dispersion system
US7003719B1 (en) * 1999-01-25 2006-02-21 West Publishing Company, Dba West Group System, method, and software for inserting hyperlinks into documents
US6895166B1 (en) * 1999-03-15 2005-05-17 Computer Prompting And Captioning Co. Method and apparatus for encoding control data in a video data system
JP2001045448A (en) * 1999-07-30 2001-02-16 Nec Corp Video data synchronization method for digital TV broadcasting
US7188186B1 (en) * 1999-09-03 2007-03-06 Meyer Thomas W Process of and system for seamlessly embedding executable program code into media file formats such as MP3 and the like for execution by digital media player and viewing systems
US20010030710A1 (en) * 1999-12-22 2001-10-18 Werner William B. System and method for associating subtitle data with cinematic material
US20010052019A1 (en) * 2000-02-04 2001-12-13 Ovt, Inc. Video mail delivery system
US6901207B1 (en) * 2000-03-30 2005-05-31 Lsi Logic Corporation Audio/visual device for capturing, searching and/or displaying audio/visual material
US6602475B1 (en) * 2000-06-14 2003-08-05 Multisen Technology, Inc. Multimedia and scent storage medium and playback apparatus having electrostatic scent release

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000053723A (en) * 2000-03-03 2000-09-05 강원일 Moving picture mailing method
KR20000049986A (en) * 2000-05-10 2000-08-05 안우길 Messaging service system and method for processing the same
KR20000054674A (en) * 2000-06-16 2000-09-05 정철현 internet e-mail service with video and audio
KR20000054715A (en) * 2000-06-20 2000-09-05 김광섭 Method and system for servicing by using the internet, method for producing and transmitting moving picture files and recording medium thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1358573A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004341740A (en) * 2003-05-14 2004-12-02 Sharp Corp Email receiver
EP3881870A1 (en) * 2020-03-20 2021-09-22 Noustique Perfumes, S.L. Methods and systems for dispensing a customized fragrance

Also Published As

Publication number Publication date
US20040068547A1 (en) 2004-04-08
JP2004519143A (en) 2004-06-24
EP1358573A4 (en) 2004-04-28
KR20020065250A (en) 2002-08-13
CN1491393A (en) 2004-04-21
EP1358573A1 (en) 2003-11-05

Similar Documents

Publication Publication Date Title
US8694665B2 (en) System and method for embedding supplementary data into digital media files
US7050603B2 (en) Watermark encoded video, and related methods
US9454775B2 (en) Systems and methods for rendering content
US8108827B2 (en) XML-based textual specification for rich-media content creation-systems and program products
US8990673B2 (en) System and method for providing digital content
JP2010510723A (en) Apparatus and method for providing access to related data related to primary media data
JP2008501255A (en) Synchronize broadcast content with corresponding network content
EP1126721B1 (en) System for generating and playback of annotated multimedia presentations
US7149770B1 (en) Method and system for client-server interaction in interactive communications using server routes
JP2004234259A (en) Communication relay method, communication relay device, communication relay program, and computer-readable recording medium storing communication relay program
KR20100113078A (en) Method to display a video in an email
US20040068547A1 (en) Method for processing moving image/contents overlay, electronic mail processing method using the same, and computer-readable storage medium for storing program for execution of either of them
CA2319820A1 (en) Method and system for client-server interaction in interactive communications
KR100358531B1 (en) Method for Inserting and Playing Extended Contents to Multimedia File
US20020089646A1 (en) Web movie system
KR20020024719A (en) A multimedia advertising system and a multimedia advertising method using the interactivity of objects through the network
JP2006295799A (en) Content reproduction apparatus and content reproduction system
JP2001086471A (en) Multimedia content production equipment
JP2002007863A (en) How to recruit performers for promotional videos and how to create promotional videos
JP2005198271A (en) Download servicing method and system for real character type dynamic image information object
Birkmaier A Visual Compositing Syntax for Ancillary Data Broadcasting
KR20050035556A (en) Multimedia service execution method in mobile communication terminal
JP2003219387A (en) Streaming data creation support method and creation support program
KR20040021921A (en) Selling method for music character using of computer network and its system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 10470887

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 028046013

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2002712495

Country of ref document: EP

Ref document number: 2002563365

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2002712495

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 2002712495

Country of ref document: EP