WO2024002132A1 - 多媒体数据处理方法、装置、设备、存储介质和程序产品 - Google Patents

多媒体数据处理方法、装置、设备、存储介质和程序产品 Download PDF

Info

Publication number
WO2024002132A1
WO2024002132A1 PCT/CN2023/103070 CN2023103070W WO2024002132A1 WO 2024002132 A1 WO2024002132 A1 WO 2024002132A1 CN 2023103070 W CN2023103070 W CN 2023103070W WO 2024002132 A1 WO2024002132 A1 WO 2024002132A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
multimedia
editor
draft
draft data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/103070
Other languages
English (en)
French (fr)
Inventor
黄展鹏
黄光得
邬恒安
杨荣涛
罗婷
杨逸瀚
韩勖越
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to JP2024564690A priority Critical patent/JP7739643B2/ja
Priority to EP23830307.7A priority patent/EP4496324A4/en
Priority to US18/396,140 priority patent/US12136444B2/en
Publication of WO2024002132A1 publication Critical patent/WO2024002132A1/zh
Priority to US18/923,258 priority patent/US12614569B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/036—Insert-editing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure

Definitions

  • the present disclosure relates to the field of video processing technology, and in particular, to a multimedia data processing method, device, equipment, storage medium and program product.
  • Video shooting products currently on the market can support shooting a video or segmented video. Segmented shooting refers to shooting multiple video clips in stages during the shooting process, and finally obtaining a complete video including multiple video clips.
  • embodiments of the present disclosure provide a multimedia data processing method, including:
  • first multimedia draft data wherein the first multimedia draft data is generated based on a segmented shooting operation triggered on the camera, and at least one piece of video material collected by the segmented shooting operation is used.
  • the first multimedia draft data is generated based on a segmented shooting operation triggered on the camera, and at least one piece of video material collected by the segmented shooting operation is used.
  • the at least one video track segment is displayed on the video editing track of the first editor; the at least one video track segment is displayed on the video editing track of the first editor.
  • the time period occupied on the video editing track is consistent with the corresponding collection time progress interval of the at least one video material in the segmented shooting operation;
  • the first multimedia draft data is updated to obtain second multimedia draft data, and the second The multimedia draft data includes instruction information for indicating the video editing operation triggered on the first editor;
  • a target video is generated based on the second multimedia draft data.
  • an embodiment of the present disclosure provides a multimedia data processing device, including:
  • a first draft data acquisition module configured to acquire first multimedia draft data, wherein the first multimedia draft data is generated based on a segmented shooting operation triggered on the camera, and the segmented shooting Operate the collected at least one piece of video material to form at least one video track segment in the first multimedia draft data;
  • the first draft data import module is used to import the first multimedia draft data in the first editor, so that The at least one video track segment is displayed on the video editing track of the first editor; the time period occupied by the at least one video track segment on the video editing track is consistent with the time period of the at least one video material in the segment. The corresponding collection time progress intervals in the segment shooting operation are consistent;
  • a first draft data update module configured to update the first multimedia draft data in response to triggering a video editing operation for the at least one video track segment on the first editor to obtain a second multimedia draft data.
  • Media draft data, the second multimedia draft data includes instruction information for indicating the video editing operation triggered on the first editor;
  • a target video generation module configured to generate a target video based on the second multimedia draft data in response to a triggering operation of video synthesis.
  • an embodiment of the present disclosure provides an electronic device, where the electronic device includes:
  • processors one or more processors
  • a storage device for storing one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the multimedia data processing method as described in any one of the above first aspects.
  • embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the multimedia data processing method as described in any one of the above-mentioned first aspects is implemented.
  • inventions of the present disclosure provide a computer program product.
  • the computer program product includes a computer program or instructions.
  • the computer program or instructions are executed by a processor, the multimedia data as described in any one of the above first aspects is implemented. Approach.
  • Embodiments of the present disclosure provide a multimedia data processing method, device, equipment, storage medium and program product.
  • the method includes: obtaining first multimedia draft data, wherein the first multimedia draft data is based on the shooting process. generated by a segmented shooting operation triggered on the device, and at least one segment of video material collected by the segmented shooting operation is used to form at least one video track segment in the first multimedia draft data; importing the first segment in the first editor Multimedia draft data, such that at least one video track segment is displayed on the video editing track of the first editor; the time period occupied by the at least one video track segment on the video editing track is consistent with the at least one video material in the segment shooting operation The corresponding collection time progress intervals are consistent; in response to triggering a video editing operation for at least one video track segment on the first editor, the first multimedia draft data is updated to obtain the second multimedia draft data,
  • the second multimedia draft data includes instruction information for indicating the video editing operation triggered on the first editor; in response to the trigger operation of video synthesis, the target video
  • Figure 1 shows an architecture diagram of a multimedia data processing scenario provided by an embodiment of the present disclosure.
  • Figure 2 is a schematic flow chart of a multimedia data processing method in an embodiment of the present disclosure
  • Figure 3 is a schematic flowchart of a segmented shooting operation in an embodiment of the present disclosure
  • Figure 4 is a schematic page diagram of the second editor in an embodiment of the present disclosure.
  • Figure 5 is a schematic structural diagram of a multimedia data processing device in an embodiment of the present disclosure.
  • FIG. 6 is a schematic structural diagram of an electronic device in an embodiment of the present disclosure.
  • the term “include” and its variations are open-ended, ie, “including but not limited to.”
  • the term “based on” means “based at least in part on.”
  • the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; and the term “some embodiments” means “at least some embodiments”. Relevant definitions of other terms will be given in the description below.
  • Client an application running in the terminal to provide various services, such as video editing client, video shooting client, etc.
  • Response is used to represent the conditions or states on which the performed operations depend.
  • the dependent conditions or states are met, the one or more operations performed can be in real time or with a set delay; in the absence of In the case of special instructions, there is no restriction on the order in which the multiple operations are performed.
  • Video shooting products currently on the market can support shooting a video or segmented video. Segmented shooting refers to shooting multiple video clips in stages during the shooting process, and finally obtaining a complete video including multiple video clips.
  • embodiments of the present disclosure provide a multimedia data processing method, device, equipment, storage medium and program product, which performs video editing operations on one or more video track segments obtained by segment shooting to improve Video quality, improve user experience.
  • Figure 1 shows an architectural diagram of a multimedia data processing scenario provided by an embodiment of the present disclosure.
  • the architecture diagram may include at least one electronic device 101 on the client side and at least one server 102 on the server side.
  • the electronic device 101 can establish a connection with the server 102 and exchange information through a network protocol such as Hyper Text Transfer Protocol over Secure Socket Layer (HTTPS).
  • HTTPS Hyper Text Transfer Protocol over Secure Socket Layer
  • the electronic device may be a mobile terminal, a fixed terminal or a portable terminal, such as a mobile phone, a site, a unit, a device, a multimedia computer, a multimedia tablet, an Internet node, a communicator, a desktop computer, a laptop computer, a notebook computer, Netbook computers, tablet computers, personal communications system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio/video players, digital cameras/camcorders, positioning devices, television receivers, radio broadcast receivers, e-books devices, gaming devices, or any combination thereof, including accessories and peripherals for such devices or any combination thereof.
  • the server may be a physical server or a cloud server, and the server may be a server or a server cluster.
  • the electronic device 101 can receive the user's acquisition request for the first multimedia draft data.
  • the first multimedia draft data can be obtained, and will be imported into the first editor, so that the video track segment is displayed on the video editing track of the first editor in the electronic device 101; at the same time
  • the electronic device 101 updates the first multimedia draft data to obtain the second multimedia draft data.
  • the electronic device 101 generates a target video based on the second multimedia draft data in response to the user's triggering operation of video synthesis. It can be seen that by performing video editing operations on one or more video track segments obtained by segment shooting, the video quality and user experience can be improved.
  • the electronic device 101 may, after receiving the user's acquisition request for the first multimedia draft data, send the multimedia draft data acquisition request carrying the draft data identifier to the server 102 .
  • the server 102 may respond to the acquisition request, acquire the first multimedia draft data, and send the first multimedia draft data to the electronic device 101.
  • Multimedia draft data so that the electronic device 101 can import the first multimedia draft data in the first editor and display the video track segment on the video editing track of the first editor, and at the same time, the electronic device 101 responds to the user's operation at the first editor.
  • a video editing operation for the video track segment is triggered on an editor, the first multimedia draft data is updated, and the second multimedia draft data is obtained.
  • the electronic device 101 responds to the user's video synthesis An operation is triggered to generate a target video based on the second multimedia draft data. To further improve the quality of the produced video and reduce the data processing volume of the electronic device 101.
  • FIG 2 is a flow chart of a multimedia data processing method in an embodiment of the present disclosure. This embodiment can be applied to the situation of editing multiple video track segments obtained by segment shooting.
  • This method can be executed by a multimedia data processing device.
  • the multimedia data processing device can be implemented in the form of software and/or hardware, and the multimedia data processing method can be applied to the electronic device described in Figure 1.
  • the multimedia data processing method provided by the embodiment of the present disclosure mainly includes steps S101-S104.
  • the multimedia draft data in the embodiments of the disclosure may include video data, audio data, image data, etc.
  • the multimedia data processing method provided by the embodiments of the disclosure may be applied to editing video data, audio data, image data, etc.
  • the embodiments of the present disclosure are introduced using a scenario applied to video data editing.
  • the first multimedia draft data is generated based on a segmented shooting operation triggered on the camera.
  • the camera may refer to a component used for shooting in the video shooting client running in the electronic device 101, and the camera may include a snapshot mode, a segmented shooting mode, etc.
  • the segmented shooting mode refers to shooting multiple video materials in segments during the shooting process, and finally obtaining a complete video including multiple video materials.
  • the user pauses the shooting once each time. operation (such as clicking the pause shooting button in the shooting interface), the shooting process can be controlled to pause and a piece of video material is generated. That is, since the last paused shooting operation, if the user continues shooting (such as clicking Continue in the shooting interface Shooting button), a piece of video material is generated from the video captured by the device from the time when the shooting operation is continued to the time when the shooting operation is paused.
  • the segmented shooting page 32 in response to a trigger operation on the segmented shooting entry control 31 in the shooter, the segmented shooting page 32 is displayed in the shooter, wherein the segmented shooting Page 32 includes the preview screen collected by the camera.
  • the segmented shooting page 32 also includes at least 3 video duration selection controls, such as: 3min, 60s, 15s, where the video duration is the target video after synthesizing multiple video materials. of duration. Further, the segmented shooting page 32 also includes a shooting control 33.
  • the shooting completion control 34 is displayed in 32 .
  • the shooting process if the trigger operation on the shooting control 33 is responded to, the shooting will be suspended and the shooting of the video material of this segment will be completed.
  • the segmented shooting page 32 displays the video material deletion control 35. If the trigger operation of the video material deletion control 35 is responded to, the most recently captured video material can be deleted.
  • the collection of the first multimedia draft data is completed.
  • the collection and saving of the first multimedia draft data is completed.
  • the first multimedia draft data may be stored locally or in a server corresponding to the client, which is no longer specifically limited in the embodiments of the present disclosure.
  • obtaining the first multimedia draft data can be understood as the first multimedia draft data collected after the above-mentioned segmented shooting operation, and can also be understood as obtaining the stored first multimedia data. .
  • the multiple editing controls may include a segment adjustment control 41, a subtitle adding control 42, an audio adding control 43, and a text adding control 44.
  • the second editor also includes: a video clip saving control 45 and a first editor entry control 46.
  • the video playback progress can be viewed through the video playback progress bar 48 on the editing page 40, and fast forward or rewind operations can be performed.
  • the video track segment currently being played can be viewed through the video track segment identification on the editing page 40.
  • the segment adjustment page in response to the triggering operation of the segment adjustment control 41, the segment adjustment page is entered, and the first video material is selected by default in the segment adjustment page.
  • the playback speed, volume, and other parameters of the first video material can be adjusted. Whether to reshoot, replace one of the frames, delete a certain frame and other editing operations. Any of the above editing operations can be performed on each video material. After completing the multi-segment splicing, return to editing page 40.
  • the subtitle adding page in response to the triggering operation of the subtitle adding control 42, the subtitle adding page is entered, in which the recognition and editing of subtitle functions are in the same panel, and the editing panel is multi-track; the subtitle adding page is entered to start recognition of speech recognition, After the recognition is successful, the subtitle editing panel is displayed. You can select any subtitle and perform batch editing, editing, copying, deletion and other editing operations. After subtitle editing, return to the editing page 40.
  • the audio adding page in response to the triggering operation of the audio adding control 43, the audio adding page is entered.
  • the creation and editing of the recording function are on the same page, which is multi-track; enter the audio adding page, and the default recording track is empty; click Press or hold the recording button to start recording and generate a recording track; when the recording is completed, you can continue recording without selecting the recording track; by selecting any recording track, you can perform editing operations such as volume adjustment and deletion of recordings. After finishing editing the recording, return to editing page 40.
  • the text adding page in response to a triggering operation on the text adding control 44, the text adding page is entered.
  • the adding panel of the text function is separated from the editing panel, and the editing panel is multi-track; the text adding page and the in-end text are easily added.
  • the panels are consistent and support changing text content, style, alignment, font, and color; enter the text editing panel, and the newly added text track will be selected by default; you can modify the text, cover it, copy, delete and other editing operations. After finishing text editing, return to editing page 40.
  • the second editor is not used to edit the first multimedia draft data and directly responds to the triggering operation of the video clip saving control 45, the first multimedia draft data that has not been simply edited will be to save.
  • obtaining the first multimedia draft data can be understood as the first multimedia draft data collected after the above-mentioned segmented shooting operation, and can also be understood as obtaining the stored first multimedia data. .
  • a draft page is set in the second editor.
  • the draft page includes multiple videos.
  • the first multimedia draft data corresponding to the video is imported. to the second editor.
  • the camera, the second editor and the first editor are in the same client, that is, they are components that implement different functions in the same client.
  • the shooter and the second editor are in the first client, and the first editor is in the second client.
  • the second editor includes a view model that can support editing, and the view model that can support editing is used to receive a video editing operation triggered on the second editor.
  • the shooting page in the camera and the editing page in the second editor are two pages that communicate with each other.
  • the shooting page supports the updating and saving of multimedia draft data.
  • the editing page supports the playback and saving of multimedia draft data drafts.
  • the shooting page and editing page are two independent fragments.
  • the draft editor (SessiongManager) is encapsulated in ActivityViewModel: EditSupportViewModel to facilitate communication between the shooting page and the editing page.
  • the shooting page operates the draft through EditSupportViewModel.
  • the photographer is registered in the first Activiy component
  • the second editor is registered in the second Activiy component.
  • the photographer and the second editor are respectively registered in two independent Activeiy components.
  • the second Activeiy component hosts the WrapperPreviewrFragment.
  • the first Activity component includes a view model capable of supporting drafts, and the view model capable of supporting drafts is used to encapsulate at least one collected video material into first multimedia draft data.
  • DraftManager is used alone to manage the draft generation processing of the shooting page.
  • view model DraftSupportViewModel
  • multimedia draft data can be saved.
  • the video editing operation triggered on the second editor is a session editing operation, and the video editing operation triggered on the second editor is processed through a view model that can support editing. Encapsulate and manage.
  • the method further includes: in response to triggering the draft save control in the shooter, so that the shooter saves the collected The video material is saved in the form of a draft, and the first multimedia draft data is obtained.
  • PreviewWapperFragment uses EditoSupportViewModel to encapsulate sessionManager to manage the preview and saving of the entire draft.
  • the draft associated with the shooting page is associated with the draft id.
  • the collection time interval corresponding to the first video material is The period from when the shooting operation is triggered to when the pause operation is triggered. After the shooting operation is triggered again, the previous video material will be followed by the next video material until the pause operation is triggered again and the second video material is collected. The collection time interval corresponding to the first video material is from the time when the shooting operation is triggered again to This period of time triggers the pause operation again.
  • the collection time progress interval corresponding to each video material may be the same or different, and is no longer specifically limited in the embodiments of the present disclosure.
  • the collection time interval corresponding to the video material is displayed in the form of a progress bar around the shooting control 33 .
  • the time period occupied by the video track segment on the video editing track is consistent with the corresponding collection time progress interval of the video material in the segmented shooting operation.
  • the corresponding collection time progress interval of the first video material in the segmented shooting operation is 0 to 10 seconds.
  • the first video track segment generated by the first video material occupies a time period on the video editing track of 0 to 10 seconds
  • the corresponding collection time progress interval of the second video material in the segmented shooting operation is 11 to 16 seconds.
  • the second video track segment generated by the second video material occupies 10 seconds on the video editing track.
  • the time period is 11 to 16 seconds; and so on, one-to-one correspondence.
  • the total duration of the entire video material is consistent with the total duration of the video editing track.
  • the acquired first multimedia draft data is imported into the first editor, so that editing in the first editor
  • the first video corresponding to the first multimedia draft data is played on the page, or the cover image corresponding to the first video is displayed.
  • the calling operation for the first editor may be a triggering operation for an interface of the first editor provided in the camera, or may be a triggering operation for an interface of a second editor provided in the camera. Further, in the first editor you can Perform complex editing on the first multimedia draft data, or directly save the first multimedia draft data.
  • an interface of the first editor may be set in the camera, and the interface of the first editor may be received.
  • a triggering operation of the interface of the editor in response to triggering a calling operation for the first editor.
  • the camera and the second editor are in the first client, and the first editor is in the second client.
  • the method further includes: the second client receives the first A call request sent by the client, the call request is used to request to import the first multimedia draft into the first editor; the second client displays the prompt information corresponding to the call request, and responds to the prompt The information confirmation operation is to import the first multimedia draft in the first editor.
  • the first editor in the second client receives the message sent by the first client.
  • prompt information is displayed in the first editor; in response to a confirmation operation for the prompt information, the first multimedia draft data is imported in the first editor.
  • the first client in response to a triggering operation on the first editor entry control of the first client, the first client sends a calling request to the second client.
  • the first editor entry control can be set in the shooter or in the second editor, which is no longer specifically limited in the embodiment of the present disclosure.
  • the prompt information is used to provide the user with whether the first multimedia draft data is received from the first client.
  • the confirmation operation for the prompt information refers to the operation of confirming receipt of the first multimedia draft data from the first client.
  • the method before importing the first multimedia draft data in the first editor, the method further includes: in the first editor, in response to a confirmation operation for importing the third-party draft, determining that the The first draft protocol used by the first multimedia draft data, the first draft protocol is the draft protocol supported by the second editor; if the first draft protocol is the same as the first draft protocol supported by the first editor, The two draft protocols are different. According to the draft protocol conversion rules, the draft protocol adopted by the first multimedia draft data is converted from the first draft protocol to the second draft protocol.
  • the draft protocol applied to each client may be different.
  • the first draft protocol used by the first multimedia draft data is determined in the first editor; wherein the first draft protocol is the camera and the third draft protocol.
  • Two editors support draft protocols.
  • the draft protocol used by the first multimedia draft data is changed from the first draft protocol. Convert to the second draft protocol so that the first editor can subsequently perform a clipping operation on the first multimedia draft data.
  • the indication information includes the time period occupied by the frequency track segments corresponding to the video editing operation and which interval of the video material each track segment belongs to. Specifically, when the video editing track imports a draft, the video material and corresponding editing operations are displayed on the video editing track according to the instruction information.
  • the method of performing a video editing operation on the video track segment on the first editor is no longer specifically limited in the embodiment of the present disclosure.
  • the replay may be triggered.
  • Shooting instruction operation in response to the reshooting instruction operation, return to the camera, and reshoot one or more video materials.
  • the process of reshooting video material mainly includes: in response to a reshoot instruction operation triggered on the video editing track for the target video track segment, displaying a retake interface of the first multimedia draft data in the shooter; At least one video track segment includes a target video track segment, and the target video material in the at least one video material is used to form the target video track; in the reshooting interface, the at least one video material except the target Other video materials other than the video material are restored to the corresponding collection time progress interval in the segmented shooting operation, and the target collection time progress area corresponding to the target video material in the segmented shooting operation is vacant; in response to Perform a reshooting operation in the target collection time progress area on the segmented shooting interface to obtain the retaken video material; by replacing the target video material with the retaken video material in the at least one video material, Update the first multimedia draft data so that the video material used to form the target video track segment is replaced from the target video material with the remake video material; import the
  • the reshooting instruction operation is performed to trigger the reshooting of the video material, so that the user can reshoot the unsatisfactory video material at any time.
  • the triggering operation of video synthesis may refer to the triggering operation of the export control in the page.
  • the export method can be to save the target video locally, or to share it to other video sharing platforms or websites. No specific limitations will be made in the embodiments of this disclosure.
  • the present disclosure relates to a multimedia data processing method, device, equipment, storage medium and program product, including: obtaining first multimedia draft data, wherein the first multimedia draft data is generated based on a segmented shooting operation, The video materials collected by the segmented shooting operation are used to form video track segments in the first multimedia draft data; the first multimedia draft data is imported into the first editor, so that the video editing in the first editor Displaying the video track segment on the track; in response to triggering a video editing operation for the video track segment on the first editor, updating the first multimedia draft data to obtain second multimedia draft data; in response to the video synthesis Trigger an operation to generate a target video based on the second multimedia draft data.
  • Embodiments of the present disclosure perform video editing operations on one or more video track segments obtained by segment shooting to improve video quality and user experience.
  • FIG. 5 is a flow chart of a multimedia data processing device in an embodiment of the present disclosure. This embodiment can be applied to the situation of editing multiple video track segments obtained by segment shooting.
  • the multimedia data processing device can use software and / Or implemented in hardware, the multimedia data processing method can be applied to the electronic device described in FIG. 1 .
  • the multimedia data processing device 50 mainly includes: a first draft data acquisition module 51 , a first draft data import module 52 , a first draft data update module 53 and a target video generation module 54 .
  • the first draft data acquisition module 51 is used to acquire first multimedia draft data, wherein the first multimedia draft data is generated based on the segmented shooting operation triggered on the camera, and the At least one piece of video material collected by the segmented shooting operation is used to form at least one video track segment in the first multimedia draft data;
  • the first draft data import module 52 is used to import the first multimedia draft data in the first editor, so that the at least one video track segment is displayed on the video editing track of the first editor;
  • the time period occupied by the at least one video track segment on the video editing track is consistent with the corresponding collection time progress interval of the at least one video material in the segmented shooting operation;
  • the first draft data update module 53 is configured to update the first multimedia draft data in response to triggering a video editing operation for the at least one video track segment on the first editor to obtain a second Multimedia draft data, the second multimedia draft data includes instruction information for indicating the video editing operation triggered on the first editor;
  • the target video generation module 54 is configured to generate a target video based on the second multimedia draft data in response to a triggering operation of video synthesis.
  • the first multimedia draft data is generated based on a segmented shooting operation triggered on the shooter and a video editing operation triggered on the second editor, and the first multimedia draft data
  • the draft data includes at least one piece of video material collected based on the segmented shooting operation and indication information used to indicate the video editing operation triggered on the second editor.
  • the number of types of video editing operations that can be triggered on the second editor is less than the number of types of video editing operations that can be triggered on the first editor.
  • the second editor includes a view model that can support editing, and the view model that can support editing is used to receive a video editing operation triggered on the second editor.
  • the camera and the second editor are in the first client, and the first editor is in the second client.
  • the device further includes: a call request receiving module, configured to The second client receives the calling request sent by the first client, the calling request is used to request to import the first multimedia draft into the first editor; the first draft data import module 52 also The method is used for the second client to display prompt information corresponding to the call request, and in response to a confirmation operation of the prompt information, import the first multimedia draft data into the first editor.
  • the first draft data import module 52 is also used to import Before the first multimedia draft data, the first draft protocol used by the first multimedia draft data is determined in the first editor in response to a confirmation operation for importing a third-party draft, and the first draft protocol is determined.
  • the draft protocol is a draft protocol supported by the second editor; if the first draft protocol is different from the second draft protocol supported by the first editor, according to the draft protocol conversion rules, the first multimedia draft data
  • the adopted draft agreement is converted from the first draft agreement to the second draft agreement.
  • the photographer is registered in the first Activiy component
  • the second editor is registered in the second Activiy component.
  • the first Activity component includes a view model capable of supporting drafts, and the view model capable of supporting drafts is used to encapsulate at least one collected video material into first multimedia draft data.
  • the video editing operation triggered on the second editor is a session editing operation, and the video editing operation triggered on the second editor is processed through a view model that can support editing. Encapsulate and manage.
  • the method further includes: a reshooting operation triggering module, configured to respond to a reshooting instruction operation triggered on the video editing track for a target video track segment, displaying the first multiple shots in the shooter.
  • a reshooting interface for media draft data the at least one video track segment includes a target video track segment, and the target video material in the at least one video material is used to form the target video track; in the reshooting interface, Other video materials in the at least one video material except the target video material are restored to the corresponding collection time progress interval in the segmented shooting operation, and the target video material corresponds to the segmented shooting operation.
  • the target acquisition time progress area is left vacant; a reshooting material acquisition module, configured to acquire reshooting video material in response to the reshooting operation of the target acquisition time progress area on the segmented shooting interface; a video material replacement module, for updating the first multimedia draft data by replacing the target video material with the remake video material in the at least one video material so that the video used to form the target video track segment The material is replaced from the target video material with the reshot video material; the first draft data import module is also used to import the updated first multimedia draft data into the first editor.
  • the multimedia data processing device provided by the embodiments of the present disclosure can execute the steps performed in the multimedia data processing method provided by the method embodiments of the present disclosure. The execution steps and beneficial effects will not be described again here.
  • FIG. 6 is a schematic structural diagram of an electronic device in an embodiment of the present disclosure.
  • the electronic device 600 in the embodiment of the present disclosure may include, but is not limited to, mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals ( Mobile terminals such as car navigation terminals), wearable terminal devices, etc., and fixed terminals such as digital TVs, desktop computers, smart home devices, etc.
  • the electronic device shown in FIG. 6 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
  • the electronic device 600 may include a processing device (eg, central processing unit, graphics processor, etc.) 601, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 602 or from a storage device 608.
  • the program in the memory (RAM) 603 performs various appropriate actions and processing to implement the multimedia data processing method according to the embodiments of the present disclosure.
  • various programs and data required for the operation of the terminal device 600 are also stored.
  • the processing device 601, ROM 602 and RAM 603 are connected to each other via a bus 604.
  • An input/output (I/O) interface 605 is also connected to bus 604.
  • the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 607 such as a computer; a storage device 608 including a magnetic tape, a hard disk, etc.; and a communication device 609.
  • the communication device 609 may allow the terminal device 600 to communicate wirelessly or wiredly with other devices to exchange data.
  • FIG. 6 shows the terminal device 600 having various means, it should be understood that implementation or possession of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.
  • embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, the computer program including program code for executing the method shown in the flowchart, thereby achieving the above The multimedia data processing method.
  • the computer program may be downloaded and installed from the network via communication device 609, or from storage device 608, or from ROM 602. When the computer program is executed by the processing device 601, the above functions defined in the method of the embodiment of the present disclosure are performed.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmd read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.
  • the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium.
  • Communications e.g., communications network
  • communications networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.
  • the computer-readable medium carries one or more programs.
  • the terminal device obtains the first multimedia draft data, wherein the first multimedia draft data
  • the draft data is generated based on a segmented shooting operation triggered on the camera.
  • At least one piece of video material collected by the segmented shooting operation is used to form at least one video track segment in the first multimedia draft data.
  • the terminal device may also perform other steps described in the above embodiments.
  • Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages—such as "C” or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider such as an Internet service provider through Internet connection
  • each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two boxes represented one after another While they may actually be executed essentially in parallel, they may sometimes be executed in reverse order, depending on the functionality involved.
  • each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.
  • the units involved in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of a unit does not constitute a limitation on the unit itself under certain circumstances.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs Systems on Chips
  • CPLD Complex Programmable Logical device
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing.
  • machine-readable storage media would include electrical connections based on one or more wires, laptop disks, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM portable compact disk read-only memory
  • magnetic storage device or any suitable combination of the above.
  • the present disclosure provides a multimedia data processing method, including: obtaining first multimedia draft data, wherein the first multimedia draft data is based on Generated by a triggered segmented shooting operation, at least one piece of video material collected by the segmented shooting operation is used to form at least one video track segment in the first multimedia draft data; imported in the first editor
  • the first multimedia draft data is such that the at least one video track segment is displayed on the video editing track of the first editor; the time occupied by the at least one video track segment on the video editing track The segment is consistent with the collection time progress interval corresponding to the at least one video material in the segmented shooting operation; in response to triggering a video editing operation for the at least one video track segment on the first editor,
  • the first multimedia draft data is updated to obtain second multimedia draft data.
  • the second multimedia draft data includes a message indicating the video editing operation triggered on the first editor. Instruction information; in response to a triggering operation of video synthesis, generate a target video based on the second multimedia draft data.
  • the present disclosure provides a multimedia data processing method, wherein the first multimedia draft data is based on the segmented shooting operation triggered on the shooter and the third The first multimedia draft data is generated by a video editing operation triggered on the second editor.
  • the first multimedia draft data includes at least a piece of video material collected based on the segmented shooting operation and is used to indicate the video editing operation triggered on the second editor. Instructions for video editing operations.
  • the present disclosure provides a multimedia data processing method, wherein the number of types of video editing operations that can be triggered on the second editor is less than the number of types of video editing operations that can be triggered on the first editor. The type of video editing operation triggered.
  • the present disclosure provides a multimedia data processing method, wherein the second editor includes a view model that can support editing, and the view model that can support editing is used to receive the Describe the video editing operation triggered on the second editor.
  • the present disclosure provides a multimedia data processing method, wherein the shooter and the second editor are in the first client, and the first editor is in the second client. It also includes: the second client receiving a calling request sent by the first client, the calling request being used to request to import the first multimedia draft into the first editor; the second client Prompt information corresponding to the call request is displayed, and in response to a confirmation operation of the prompt information, the first multimedia draft data is imported into the first editor.
  • the present disclosure provides a multimedia data processing method, wherein before importing the first multimedia draft data in the first editor, the method further includes: In response to the confirmation operation for the third-party draft import, the first draft protocol used by the first multimedia draft data is determined, and the first draft protocol is a draft protocol supported by the second editor; if The first draft protocol is different from the second draft protocol supported by the first editor. According to the draft protocol conversion rules, the draft protocol used by the first multimedia draft data is converted from the first draft protocol to the Second draft agreement.
  • the present disclosure provides a multimedia data processing method, wherein the shooter is registered in the first Activity component, and the second editor is registered in the second Activity component.
  • the present disclosure provides a multimedia data processing method, wherein the first Activity component includes a view model that can support drafts, and the view model that can support drafts is used to process the collected data. At least one video material is encapsulated into first multimedia draft data.
  • the present disclosure provides a multimedia data processing method, wherein the video editing operation triggered on the second editor is a session editing operation, and the video editing operation triggered on the second editor Encapsulate and manage the triggered video editing operations through a view model that supports editing.
  • the present disclosure provides a multimedia data processing method, which further includes: in response to a retake instruction operation triggered on the video editing track for a target video track segment, the A retake interface showing the first multimedia draft data in the shooter; the at least one video track segment includes a target video track segment, and the target video material in the at least one video material is used to form the target video track; in In the reshooting interface, other video materials in the at least one video material except the target video material are restored to the corresponding collection time progress interval in the segmented shooting operation, and the target video material is in the The corresponding target acquisition time progress area in the segmented shooting operation is vacant; in response to the reshooting operation of the target acquisition time progress area on the segmented shooting interface, the reshot video material is obtained; by selecting the at least one In the video material, the target video element is Replace the material with the retaken video material, and update the first multimedia draft data so that the video material used to form the target video track
  • the present disclosure provides a multimedia data processing device, including: a first draft data acquisition module, configured to acquire first multimedia draft data, wherein the first multimedia data processing device The volume draft data is generated based on a segmented shooting operation triggered on the camera. At least one piece of video material collected by the segmented shooting operation is used to form at least one video track in the first multimedia draft data.
  • a first draft data import module configured to import the first multimedia draft data in a first editor, so that the at least one video track segment is displayed on the video editing track of the first editor ;
  • the time period occupied by the at least one video track segment on the video editing track is consistent with the corresponding collection time progress interval of the at least one video material in the segmented shooting operation;
  • the first draft data update module In response to triggering a video editing operation for the at least one video track segment on the first editor, update the first multimedia draft data to obtain second multimedia draft data, the The second multimedia draft data includes instruction information for indicating the video editing operation triggered on the first editor;
  • a target video generation module configured to respond to the triggering operation of video synthesis, based on the second Multimedia draft data to generate target videos.
  • the present disclosure provides a multimedia data processing device, wherein the first multimedia draft data is based on a segmented shooting operation triggered on the shooter and a second editor. Generated by a triggered video editing operation, the first multimedia draft data includes at least a piece of video material collected based on the segmented shooting operation and a parameter used to indicate the triggered video editing operation on the second editor. Instructions.
  • the present disclosure provides a multimedia data processing apparatus, wherein the number of types of video editing operations that can be triggered on the second editor is less than the number of types of video editing operations that can be triggered on the first editor. The type of video editing operation triggered.
  • the present disclosure provides a multimedia data processing device, wherein the second editor includes a view model that can support editing, and the view model that can support editing is used to receive the Describe the video editing operation triggered on the second editor.
  • the present disclosure provides a multimedia data processing device, wherein the shooter and the second editor are in the first client, and the first editor is in the second client.
  • the device further includes: a call request receiving module, configured for the second client to receive a call request sent by the first client, where the call request is used to request to import the first multimedia draft into the The first editor; the first draft data import module is also used for the second client to display the prompt information corresponding to the call request, and in response to the confirmation operation of the prompt information, import the first multimedia in the first editor body draft data.
  • the present disclosure provides a multimedia data processing device, wherein the first draft data import module is also used to import the first multimedia draft data in the first editor. before, in the first In response to the confirmation operation for the third-party draft import, the editor determines the first draft protocol used by the first multimedia draft data, and the first draft protocol is a draft protocol supported by the second editor; If the first draft protocol is different from the second draft protocol supported by the first editor, according to the draft protocol conversion rules, the draft protocol used by the first multimedia draft data is converted from the first draft protocol to The second draft agreement.
  • the present disclosure provides a multimedia data processing device, wherein the camera is registered in a first Activity component, and the second editor is registered in a second Activity component.
  • the present disclosure provides a multimedia data processing device, wherein the first Activity component includes a view model that can support drafts, and the view model that can support drafts is used to process the collected data. At least one video material is encapsulated into first multimedia draft data.
  • the present disclosure provides a multimedia data processing device, wherein the video editing operation triggered on the second editor is a session editing operation, and the video editing operation triggered on the second editor Encapsulate and manage the triggered video editing operations through a view model that supports editing.
  • the present disclosure provides a multimedia data processing device, which further includes: a retake operation triggering module, configured to respond to triggering a target video track segment on the video editing track.
  • a retake operation triggering module configured to respond to triggering a target video track segment on the video editing track.
  • the retake instruction operation the retake interface of the first multimedia draft data is displayed in the shooter; the at least one video track segment includes a target video track segment, and the target video material in the at least one video material is used for The target video track is formed; in the reshoot interface, other video materials in the at least one video material except the target video material are restored to the corresponding collection time progress interval in the segmented shooting operation.
  • the target collection time progress area corresponding to the target video material in the segmented shooting operation is vacant; the reshooting material acquisition module is used to respond to the target collection time progress area on the segmented shooting interface.
  • a reshooting operation is performed to obtain retaken video material;
  • a video material replacement module is used to update the first multimedia draft by replacing the target video material with the retaken video material in the at least one video material. data, so that the video material used to form the target video track segment is replaced from the target video material with the remake video material; a first draft data import module, also used to import updates in the first editor The first multimedia draft data after.
  • the present disclosure provides an electronic device, including:
  • processors one or more processors
  • Memory used to store one or more programs
  • the one or more processors are caused to implement any of the multimedia data processing methods provided by this disclosure.
  • the present disclosure provides a computer-readable storage medium having a computer program stored thereon.
  • the program is executed by a processor, the multimedia data as described in any one provided by the present disclosure is implemented. Approach.
  • Embodiments of the present disclosure also provide a computer program product.
  • the computer program product includes a computer program or instructions. Let the computer program or instruction implement the multimedia data processing method as described above when executed by the processor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本公开涉及一种多媒体数据处理方法、装置、设备、存储介质和程序产品，包括：获取第一多媒体草稿数据，其中，第一多媒体草稿数据是基于分段拍摄操作而生成的，分段拍摄操作采集到的视频素材用于形成第一多媒体草稿数据中的视频轨道片段；在第一编辑器中导入第一多媒体草稿数据，以使得在第一编辑器的视频编辑轨道上显示视频轨道片段；响应于在第一编辑器上触发针对视频轨道片段的视频编辑操作，对第一多媒体草稿数据进行更新，得到第二多媒体草稿数据；响应于视频合成的触发操作，基于第二多媒体草稿数据，生成目标视频。

Description

多媒体数据处理方法、装置、设备、存储介质和程序产品
本申请是以中国申请号为202210772811.8，申请日为2022年6月30日的申请为基础，并主张其优先权，该中国申请的公开内容在此作为整体引入本申请中。
技术领域
本公开涉及视频处理技术领域，尤其涉及一种多媒体数据处理方法、装置、设备、存储介质和程序产品。
背景技术
目前市面上的视频拍摄产品可支持拍摄一段视频或分段拍摄视频，分段拍摄指拍摄过程中分阶段拍摄多个视频片段，最后得到一段包括多个视频片段的完整的视频。
发明内容
根据本公开的一些实施例，第一方面，本公开实施例提供一种多媒体数据处理方法，包括：
获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；
在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；
响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；
响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
第二方面，本公开实施例提供一种多媒体数据处理装置，包括：
第一草稿数据获取模块，用于获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；
第一草稿数据导入模块，用于在第一编辑器中导入所述第一多媒体草稿数据，以使得 在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；
第一草稿数据更新模块，用于响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；
目标视频生成模块，用于响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
第三方面，本公开实施例提供一种电子设备，所述电子设备包括：
一个或多个处理器；
存储装置，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如上述第一方面中任一项所述的多媒体数据处理方法。
第四方面，本公开实施例提供一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如上述第一方面中任一项所述的多媒体数据处理方法。
第五方面，本公开实施例提供一种计算机程序产品，该计算机程序产品包括计算机程序或指令，该计算机程序或指令被处理器执行时实现如上述第一方面中任一项所述的多媒体数据处理方法。
本公开实施例提供了一种多媒体数据处理方法、装置、设备、存储介质和程序产品，所述方法包括：获取第一多媒体草稿数据，其中，第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，分段拍摄操作采集到的至少一段视频素材用于形成第一多媒体草稿数据中的至少一个视频轨道片段；在第一编辑器中导入第一多媒体草稿数据，以使得在第一编辑器的视频编辑轨道上显示至少一个视频轨道片段；至少一个视频轨道片段在视频编辑轨道上占据的时间段与至少一个视频素材在分段拍摄操作中对应的采集时间进度区间相一致；响应于在第一编辑器上触发针对至少一个视频轨道片段的视频编辑操作，对第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，第二多媒体草稿数据包括用于指示第一编辑器上所触发的视频编辑操作的指示信息；响应于视频合成的触发操作，基于第二多媒体草稿数据，生成目标视频。
附图说明
结合附图并参考以下具体实施方式，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。贯穿附图中，相同或相似的附图标记表示相同或相似的元素。应当理解 附图是示意性的，原件和元素不一定按照比例绘制。
图1示出了本公开实施例提供的一多媒体数据处理场景的架构图
图2为本公开实施例中的一种多媒体数据处理方法的流程示意图；
图3为本公开实施例中的分段拍摄操作的流程示意图；
图4为本公开实施例中的第二编辑器的页面示意图；
图5为本公开实施例中的一种多媒体数据处理装置的结构示意图；
图6为本公开实施例中的一种电子设备的结构示意图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
对本公开实施例进行进一步详细说明之前，对本公开实施例中涉及的名词和术语进行说明，本公开实施例中涉及的名词和术语适用于如下的解释。
客户端，终端中运行的用于提供各种服务的应用程序，例如视频剪辑客户端、视频拍摄客户端等等。
响应于，用于表示所执行的操作所依赖的条件或者状态，当满足所依赖的条件或状态时，所执行的一个或多个操作可以是实时的，也可以具有设定的延迟；在没有特别说明的情况下，所执行的多个操作不存在执行先后顺序的限制。
目前市面上的视频拍摄产品可支持拍摄一段视频或分段拍摄视频，分段拍摄指拍摄过程中分阶段拍摄多个视频片段，最后得到一段包括多个视频片段的完整的视频。
在现有的分段拍摄视频的方案中，可以在分段拍摄视频的过程中，或者分段拍摄完毕，得到完整视频后，对拍摄得到的视频进行简单的编辑操作，例如：添加贴纸、添加美颜功能、添加滤镜等。现有的对分段拍摄得到的视频片段只能够进行简单的编辑操作，导致得到的目标视频质量低，用户体验差。
为了解决上述技术问题，本公开实施例提供了一种多媒体数据处理方法、装置、设备、存储介质和程序产品，通过对分段拍摄得到的一个或多个视频轨道片段进行视频编辑操作，以提高视频质量，提高用户体验。
图1示出了本公开实施例提供的一种多媒体数据处理场景的架构图。
如图1所示，该架构图中可以包括客户端的至少一个电子设备101以及服务端的至少一个服务器102。电子设备101可以通过网络协议如超文本传输安全协议(Hyper Text Transfer Protocol over Secure Socket Layer,HTTPS)与服务器102建立连接并进行信息交互。其中，所述电子设备可以是移动终端、固定终端或便携式终端，例如移动手机、站点、单元、设备、多媒体计算机、多媒体平板、互联网节点、通信器、台式计算机、膝上型计算机、笔记本计算机、上网本计算机、平板计算机、个人通信系统(PCS)设备、个人导航设备、个人数字助理(PDA)、音频/视频播放器、数码相机/摄像机、定位设备、电视接收器、无线电广播接收器、电子书设备、游戏设备或者其任意组合，包括这些设备的配件和外设或者其任意组合。所述服务器可以是实体服务器，也可以是云服务器，服务器可以是一个服务器，或者服务器集群。
在本公开实施例中，为了降低制作视频的时间成本以及提高制作的视频质量，电子设备101能够接收用户针对第一多媒体草稿数据的获取请求，在电子设备101接收到该获取请求之后，可以获取第一多媒体草稿数据，并将在第一编辑器中导入第一多媒体草稿数据，以使得在电子设备101中的第一编辑器的视频编辑轨道上显示视频轨道片段；同时电子设备101响应于用户在第一编辑器上触发针对视频轨道片段的视频编辑操作，对第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，在视频剪辑操作完成后，电子设备101响应于用户视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。可见通过对分段拍摄得到的一个或多个视频轨道片段进行视频编辑操作，以提高视频质量，提高用户体验。
可选地，基于上述架构，电子设备101可以接收用户针对第一多媒体草稿数据的获取请求之后，向服务器102发送携带有草稿数据标识的多媒体草稿数据的获取请求。服务器102可以在接收到电子设备101发送的携带有草稿数据标识的多媒体草稿数据的获取请求之后，响应于该获取请求，获取第一多媒体草稿数据，向电子设备101发送第一 多媒体草稿数据，从而使电子设备101可以在第一编辑器中导入第一多媒体草稿数据，并在第一编辑器的视频编辑轨道上显示视频轨道片段，同时电子设备101响应于用户在第一编辑器上触发针对视频轨道片段的视频编辑操作，对第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，在视频剪辑操作完成后，电子设备101响应于用户视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。以进一步提高制作的视频质量并且降低电子设备101的数据处理量。
下面将结合附图，对本申请实施例提出的多媒体数据处理方法进行详细介绍。
图2为本公开实施例中的一种多媒体数据处理方法的流程图，本实施例可适用于对分段拍摄得到的多个视频轨道片段进行编辑的情况，该方法可以由多媒体数据处理装置执行，该多媒体数据处理装置可以采用软件和/或硬件的方式实现，该多媒体数据处理方法可应用于图1中所述的电子设备中。
如图2所示，本公开实施例提供的多媒体数据处理方法主要包括步骤S101-S104。
S101、获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段。
其中，本公开实施例中的多媒体草稿数据可以包括视频数据、音频数据和图像数据等，本公开实施例提供的多媒体数据处理方法可以应用于对视频数据、音频数据和图像数据等的剪辑。为了便于理解，本公开实施例以应用于视频数据剪辑的场景进行介绍。
在本公开的一个实施方式中，基于在拍摄器上触发的分段拍摄操作生成第一多媒体草稿数据。其中，所述拍摄器可以是指电子设备101中运行的视频拍摄客户端中用于拍摄的组件，该拍摄器可以包括快拍模式、分段拍摄模式等。
在本实施例中，分段拍摄模式是指拍摄过程中分段拍摄多个视频素材，最后得到一段包括多个视频素材的完整视频，在进行分段拍摄过程中，用户每次进行一次暂停拍摄操作(例如点击拍摄界面中的暂停拍摄按钮)，则可控制拍摄过程暂停，并生成一段视频素材，也即从上次暂停拍摄操作后，若用户进行了继续拍摄操作(例如点击拍摄界面中继续拍摄按钮)，则从继续拍摄操作的时刻起到本次暂停拍摄操作的时刻之间的设备拍摄的视频，生成一段视频素材。
在本公开的一个实施方式中，如图3所示，响应于对拍摄器中分段拍摄入口控件31的触发操作，使得在拍摄器中显示分段拍摄页面32，其中，所述分段拍摄页面32中包括摄像机采集到的预览画面，分段拍摄页面32中还包括至少3个视频时长选择控件，例如：3min，60s，15s，其中，该视频时长为多个视频素材合成之后的目标视频的时长。进一步的，分段拍摄页面32中还包括拍摄控件33，响应于拍摄控件33的触发操作，开始拍摄视频，并且拍摄控件33的周边显示该视频素材对应的采集时间进度区间，且在分段拍摄页面 32中显示拍摄完成控件34。在视频拍摄过程中，如果响应到对拍摄控件33的触发操作，则暂停拍摄，完成此片段视频素材的拍摄。此时，分段拍摄页面32显示视频素材删除控件35，如果响应到对视频素材删除控件35的触发操作，则可以删除最近一次拍摄到的视频素材。响应于对所述拍摄完成控件34的触发操作，完成第一多媒体草稿数据的采集。
需要说明的是，本公开实施例中仅对分段拍摄的方式进行说明，本实施例中，并不限定分段拍摄视频的具体方式。
在本公开的一个实施方式中，响应于对所述拍摄完成控件34的触发操作，完成第一多媒体草稿数据的采集并保存。其中，第一多媒体草稿数据可以保存在本地，也可以存储在客户端对应的服务器中，本公开实施例中不再具体限定。
在本公开实施例中，获取第一多媒体草稿数据可以理解为通过上述分段拍摄操作后采集到的第一多媒体草稿数据，还可以理解为获取已储存的第一多媒体数据。
在本公开的一个实施方式中，响应于用户对拍摄器中拍摄完成控件的触发操作，跳转至第二编辑器的编辑页面40；如图4所示，在第二编辑器的编辑页面40中显示多个编辑控件，多个编辑控件可以包括片段调整控件41、字幕添加控件42、音频添加控件43以及文本添加控件44。第二编辑器中还包括：视频片段保存控件45和第一编辑器入口控件46。
进一步的，通过编辑页面40上视频播放进度条48可以查看视频播放进度，以及进行快进或者后退操作。通过编辑页面40上的视频轨道片段标识可以查看到当前正在播放的第几个视频轨道片段。
在本公开实施例中，响应于对片段调整控件41的触发操作，进入片段调整页面，在片段调整页面中默认选择第一段视频素材，可以对第一段视频素材，进行播放速度、音量、是否重拍、替换其中一帧画面、删除某帧画面等剪辑操作。针对每个视频素材均可进行上述任意一项剪辑操作。完成多段拼接后，返回到编辑页面40。
在本公开实施例中，响应于对字幕添加控件42的触发操作，进入字幕添加页面，其中，字幕功能的识别和编辑为同一面板，编辑面板为多轨道；进入字幕添加页面开始识别语音识别，识别成功后展示字幕编辑面板，可以选中任意字幕，进行批量编辑、编辑、复制、删除等剪辑操作，字幕编辑后，返回到编辑页面40。
在本公开实施例中，响应于对音频添加控件43的触发操作，进入音频添加页面，录音功能的创建和编辑在同一页面，为多轨道；进入进入音频添加页面，默认录音轨道为空；点按或长按录音按钮开始录音，生成录音轨道；录音完成时不选中录音轨道，可继续录音；选中任意录音轨道，可以进行音量调整、删除录音等剪辑操作。完成录音编辑后，返回到编辑页面40。
在本公开实施例中，响应于对文本添加控件44的触发操作，进入文本添加页面。文本功能的添加面板与编辑面板分离，编辑面板为多轨道；文本添加页面与端内文本简易添加 面板一致，支持改变文本内容、样式、对齐、字体、颜色；进入文本编辑面板，默认选中新添加的文本轨道；可以对文本进行样式修改、铺满、复制、删除等剪辑操作。完成文本编辑后，返回到编辑页面40。
本实施例中，如果未使用第二编辑器对第一多媒体草稿数据进行编辑，直接响应到对视频片段保存控件45的触发操作，则将未经过简单编辑的第一多媒体草稿数据进行保存。
在本公开实施例中，获取第一多媒体草稿数据可以理解为通过上述分段拍摄操作后采集到的第一多媒体草稿数据，还可以理解为获取已储存的第一多媒体数据。
在本公开的一个实施方式中，在第二编辑器中设置草稿页面，上述草稿页面中包括多个视频，响应于对该视频的触发操作，将该视频对应的第一多媒体草稿数据导入至第二编辑器。
在本公开的一个实施方式中，所述拍摄器、所述第二编辑器和第一编辑器处于同一个客户端中，即是同一个客户端中实现不同的功能的组件。所述拍摄器和所述第二编辑器处于第一个客户端中，所述第一编辑器处于第二客户端中。
在本公开的一个实施方式中，所述第二编辑器中包括可支持编辑的视图模型，可支持编辑的视图模型用于接收在所述第二编辑器上所触发的视频编辑操作。
在本公开实施例中，拍摄器中的拍摄页面与第二编辑器中的编辑页面是一个数据互通的两个页面，拍摄页面支持多媒体草稿数据的更新与保存。编辑页面支持多媒体草稿数据草稿的播放，保存。拍摄页面与编辑页面为两个独立的fragment。具体的，依赖原本拍摄activity组件，封装草稿编辑(SessiongManager)在ActivityViewModel：EditSupportViewModel当中，方便拍摄页面与编辑页面通信，拍摄页通过EditSupportViewModel操作草稿。
在本公开的一个实施方式中，所述拍摄器注册在第一Activiy组件中，所述第二编辑器注册在第二Activiy组件中。
在本公开实施例中，拍摄器和第二编辑器分别注册在两个独立的Activiy组件中。第二Activiy组件承载WrapperPreviewrFragment。
在本公开的一个实施方式中，所述第一Activiy组件包括可支持草稿的视图模型，可支持草稿的视图模型用于将采集到的至少一个视频素材封装成第一多媒体草稿数据。
由于拍摄器仅仅需要保存草稿逻辑，目前不需要编辑相关操作，单独使用DraftManager管理拍摄页的草稿生成处理。通过可支持草稿的视图模型(DraftSupportViewModel)封装，可实现将多媒体草稿数据进行保存。
在本公开的一个实施方式中，在所述第二编辑器上所触发的视频编辑操作为会话编辑操作，在所述第二编辑器上通过可支持编辑的视图模型对所触发的视频编辑操作进行封装和管理。
响应于对拍摄器中拍摄完成控件的触发操作，跳转至第二Activiy组件，直接向第二 Activiy组件传递拍摄相关信息，WrapperPreviewrFragment根据包装页生成会话编辑。
在本公开的一个实施方式中，所述第一Activiy组件草稿保存控件；所述方法还包括：响应于在所述拍摄器中触发所述草稿保存控件，以使所述拍摄器将采集到的视频素材以草稿的形式进行保存，得到第一多媒体草稿数据。
在本公开的一个实施方式中，在返回拍摄器时，通过startActivityForResult返回通信，拍摄页恢复拍摄状态。
PreviewWapperFragment则使用EditoSupportViewModel封装sessionManager管理整套草稿的预览与保存。与拍摄页的草稿关联通过草稿id关联。
S102、在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致。
其中，由上述实施例中的表述可知，分段拍摄操作过程中，触发拍摄操作后，开始拍摄，触发暂停操作后，采集到第一个视频素材，第一个视频素材对应的采集时间区间是从触发拍摄操作到触发暂停操作的这个时间段。再次触发拍摄操作后，会接着上一个视频素材接着拍摄下一个视频素材，直至再次触发暂停操作，采集到第二个视频素材，第一个视频素材对应的采集时间区间是从再次触发拍摄操作到再次触发暂停操作的这个时间段。其中，每个视频素材对应的采集时间进度区间可以相同，也可以不同，本公开实施例不再具体限定。
如图3所示，在一个视频素材采集结束后，在拍摄控件33的周围以进度条的形式展示该视频素材对应的采集时间区间。
在本公开实施例中，视频轨道片段在所述视频编辑轨道上占据的时间段与视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致。例如：第一段视频素材在分段拍摄操作中对应的采集时间进度区间为0到10秒，那么，第一段视频素材生成的第一视频轨道片段，在视频编辑轨道上占据的时间段是0到10秒；第二段视频素材在分段拍摄操作中对应的采集时间进度区间为11到16秒，那么，第二段视频素材生成的第二视频轨道片段，在视频编辑轨道上占据的时间段是11到16秒；以此类推，一一对应。整个视频素材的总时长与视频编辑轨道的总时长一致。
在本公开的一个实施方式中，响应于触发针对所述第一编辑器的调用操作，将获取到的第一多媒体草稿数据导入至第一编辑器，以使得在第一编辑器的编辑页面中播放该第一多媒体草稿数据对应的第一视频，或者，显示第一视频对应的封面图。针对所述第一编辑器的调用操作，可以是针对设置在拍摄器中的第一编辑器的接口进行触发操作，还可以是针对设置在拍摄器中的第二编辑器的接口进行触发操作。进一步的，在第一编辑器中可以 对第一多媒体草稿数据进行复杂编辑，或者，直接将第一多媒体草稿数据进行保存。
在本公开的一个实施方式中，在拍摄器和第一编辑器是设置于不同客户端中的功能组件的情况下，可以在拍摄器中设置第一编辑器的接口，接收到对第一编辑器的接口的触发操作，响应于触发针对所述第一编辑器的调用操作。
在本公开的一个实施方式中，所述拍摄器和第二编辑器是在第一客户端内，第一编辑器是在第二客户端内，还包括：所述第二客户端接收第一客户端发送的调用请求，所述调用请求用于请求将所述第一多媒体草稿导入到所述第一编辑器；第二客户端展示所述调用请求对应的提示信息，并响应于提示信息的确认操作，在第一编辑器中导入第一多媒体草稿。
在本公开实施例中，在拍摄器和第一编辑器是设置于不同客户端中的功能组件的情况下，在所述第二客户端中的第一编辑器中接收第一客户端发送的调用请求时，在第一编辑器中显示提示信息；在第一编辑器中响应于针对提示信息的确认操作，在第一编辑器中导入所述第一多媒体草稿数据。
其中，响应于对第一客户端的第一编辑器入口控件的触发操作，第一客户端向第二客户端发送调用请求。第一编辑器入口控件可以设置在拍摄器中，也可以设置在第二编辑器中，本公开实施例中不再具体限定。
所述提示信息用于提供用户第一多媒体草稿数据来自于第一客户端，是否接收该第一多媒体草稿数据。针对提示信息的确认操作是指确定接收来自于第一客户端的第一多媒体草稿数据的操作。
在本公开的一个实施方式中，在第一编辑器中导入所述第一多媒体草稿数据之前，还包括：在第一编辑器中响应于针对第三方草稿导入的确认操作，确定所述第一多媒体草稿数据所采用的第一草稿协议，所述第一草稿协议为所述第二编辑器支持的草稿协议；若所述第一草稿协议与所述第一编辑器支持的第二草稿协议不同，按照草稿协议转换规则，将第一多媒体草稿数据所采用的草稿协议从所述第一草稿协议转换为所述第二草稿协议。
在本公开实施例中，由于拍摄器和第一编辑器是设置于不同客户端中的功能组件，每个客户端应用于的草稿协议可能是不相同的。在本公开实施中，在第一编辑器中响应于针对第三方草稿导入的确认操作，确定第一多媒体草稿数据所采用的第一草稿协议；其中，第一草稿协议是拍摄器和第二编辑器支持的草稿协议。
如果第一草稿协议与第一编辑器中支持的第二草稿协议不同时，按照预设的草稿草稿协议转换规则，将第一多媒体草稿数据所采用的草稿协议从所述第一草稿协议转换为所述第二草稿协议，以便于后续第一编辑器对第一多媒体草稿数据进行剪辑操作。
S103、响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草 稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息。
其中，指示信息包括视频编辑操作对应的频轨道片段占据的时间段以及每个轨道片段是哪个视频素材中的哪个区间。具体的，在视频编辑轨道导入草稿时，根据指示信息将视频素材及相应的编辑操作展示在视频编辑轨道上。
在第一编辑器上对视频轨道片段进行视频剪辑操作的方式，本公开实施例中不再具体限定。
在本公开的一个实施方式中，在使用第一编辑器对视频轨道片段进行视频剪辑操作的过程中，或者在使用第二编辑器对视频轨道片段进行视频剪辑操作的过程中，均可以触发重拍指示操作，响应于该重拍指示操作，返回拍摄器中，重新拍摄一个或多个视频素材。视频素材重拍的过程主要包括：响应于在所述视频编辑轨道上针对目标视频轨道片段触发的重拍指示操作，所述拍摄器中展示第一多媒体草稿数据的重拍界面；所述至少一个视频轨道片段包括目标视频轨道片段，所述至少一个视频素材中的目标视频素材用于形成所述目标视频轨道；在所述重拍界面中，所述至少一个视频素材中除所述目标视频素材之外的其他视频素材被还原到所述分段拍摄操作中对应的采集时间进度区间，所述目标视频素材在所述分段拍摄操作中对应的目标采集时间进度区域被空置；响应于在所述分段拍摄界面上所述目标采集时间进度区域的重拍操作，获取重拍视频素材；通过在所述至少一个视频素材中将所述目标视频素材替换为所述重拍视频素材，更新所述第一多媒体草稿数据，以使得用于形成所述目标视频轨道片段的视频素材从所述目标视频素材被替换为重拍视频素材；在所述第一编辑器中导入更新后的所述第一多媒体草稿数据。
在本公开实施例中，在视频剪辑过程中，通过对触发重拍指示操作是，实现视频素材的重新拍摄，使得用户可以对不满意的视频素材随时进行重拍。
S104、响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
在本公开实施例中，视频合成的触发操作可以是指对页面中导出控件的触发操作。其中，导出方式可以是目标视频在本地保存，也可以是分享至其他视频共享平台或者网站。本公开实施例中不再进行具体限定。
本公开涉及一种多媒体数据处理方法、装置、设备、存储介质和程序产品，包括：获取第一多媒体草稿数据，其中，第一多媒体草稿数据是基于分段拍摄操作而生成的，分段拍摄操作采集到的视频素材用于形成第一多媒体草稿数据中的视频轨道片段；在第一编辑器中导入第一多媒体草稿数据，以使得在第一编辑器的视频编辑轨道上显示视频轨道片段；响应于在第一编辑器上触发针对视频轨道片段的视频编辑操作，对第一多媒体草稿数据进行更新，得到第二多媒体草稿数据；响应于视频合成的触发操作，基于第二多媒体草稿数据，生成目标视频。本公开实施例通过对分段拍摄得到的一个或多个视频轨道片段进行视频编辑操作，以提高视频质量，提高用户体验。
图5为本公开实施例中的一种多媒体数据处理装置的流程图，本实施例可适用于对分段拍摄得到的多个视频轨道片段进行编辑的情况，该多媒体数据处理装置可以采用软件和/或硬件的方式实现，该多媒体数据处理方法可应用于图1中所述的电子设备中。
如图5所示，本公开实施例提供的多媒体数据处理装置50主要包括：第一草稿数据获取模块51、第一草稿数据导入模块52、第一草稿数据更新模块53和目标视频生成模块54。
其中，第一草稿数据获取模块51，用于获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；
第一草稿数据导入模块52，用于在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；
第一草稿数据更新模块53，用于响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；
目标视频生成模块54，用于响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
在本公开的一个实施方式中，所述第一多媒体草稿数据是基于拍摄器上触发的分段拍摄操作和第二编辑器上触发的视频编辑操作生成的，所述第一多媒体草稿数据包括基于所述分段拍摄操作采集到的至少一段视频素材以及用于指示所述第二编辑器上所触发的视频编辑操作的指示信息。
在本公开的一个实施方式中，所述第二编辑器上可触发的视频编辑操作的类型数量少于所述第一编辑器上可触发的视频编辑操作的类型。
在本公开的一个实施方式中，所述第二编辑器中包括可支持编辑的视图模型，可支持编辑的视图模型用于接收在所述第二编辑器上所触发的视频编辑操作。
在本公开的一个实施方式中，所述拍摄器和第二编辑器是在第一客户端内，第一编辑器在第二客户端内，所述装置还包括：调用请求接收模块，用于所述第二客户端接收第一客户端发送的调用请求，所述调用请求用于请求将所述第一多媒体草稿导入到所述第一编辑器；第一草稿数据导入模块52，还用于第二客户端展示所述调用请求对应的提示信息，并响应于提示信息的确认操作，在第一编辑器中导入第一多媒体草稿数据。
在本公开的一个实施方式中，第一草稿数据导入模块52，还用于在第一编辑器中导入 所述第一多媒体草稿数据之前，在第一编辑器中响应于针对第三方草稿导入的确认操作，确定所述第一多媒体草稿数据所采用的第一草稿协议，所述第一草稿协议为所述第二编辑器支持的草稿协议；若所述第一草稿协议与所述第一编辑器支持的第二草稿协议不同，按照草稿协议转换规则，将第一多媒体草稿数据所采用的草稿协议从所述第一草稿协议转换为所述第二草稿协议。
在本公开的一个实施方式中，所述拍摄器注册在第一Activiy组件中，所述第二编辑器注册在第二Activiy组件中。
在本公开的一个实施方式中，所述第一Activiy组件包括可支持草稿的视图模型，可支持草稿的视图模型用于将采集到的至少一个视频素材封装成第一多媒体草稿数据。
在本公开的一个实施方式中，在所述第二编辑器上所触发的视频编辑操作为会话编辑操作，在所述第二编辑器上通过可支持编辑的视图模型对所触发的视频编辑操作进行封装和管理。
在本公开的一个实施方式中，还包括：重拍操作触发模块，用于响应于在所述视频编辑轨道上针对目标视频轨道片段触发的重拍指示操作，所述拍摄器中展示第一多媒体草稿数据的重拍界面；所述至少一个视频轨道片段包括目标视频轨道片段，所述至少一个视频素材中的目标视频素材用于形成所述目标视频轨道；在所述重拍界面中，所述至少一个视频素材中除所述目标视频素材之外的其他视频素材被还原到所述分段拍摄操作中对应的采集时间进度区间，所述目标视频素材在所述分段拍摄操作中对应的目标采集时间进度区域被空置；重拍素材获取模块，用于响应于在所述分段拍摄界面上所述目标采集时间进度区域的重拍操作，获取重拍视频素材；视频素材替换模块，用于通过在所述至少一个视频素材中将所述目标视频素材替换为所述重拍视频素材，更新所述第一多媒体草稿数据，以使得用于形成所述目标视频轨道片段的视频素材从所述目标视频素材被替换为重拍视频素材；第一草稿数据导入模块，还用于在所述第一编辑器中导入更新后的所述第一多媒体草稿数据。
本公开实施例提供的多媒体数据处理装置，可执行本公开方法实施例所提供的多媒体数据处理方法中所执行的步骤，具备执行步骤和有益效果此处不再赘述。
图6为本公开实施例中的一种电子设备的结构示意图。下面具体参考图6，其示出了适于用来实现本公开实施例中的电子设备600的结构示意图。本公开实施例中的电子设备600可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)、可穿戴终端设备等等的移动终端以及诸如数字TV、台式计算机、智能家居设备等等的固定终端。图6示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图6所示，电子设备600可以包括处理装置(例如中央处理器、图形处理器等)601，其可以根据存储在只读存储器(ROM)602中的程序或者从存储装置608加载到随机访问存储器(RAM)603中的程序而执行各种适当的动作和处理以实现如本公开所述的实施例的多媒体数据处理方法。在RAM 603中，还存储有终端设备600操作所需的各种程序和数据。处理装置601、ROM 602以及RAM 603通过总线604彼此相连。输入/输出(I/O)接口605也连接至总线604。
通常，以下装置可以连接至I/O接口605：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置606；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置607；包括例如磁带、硬盘等的存储装置608；以及通信装置609。通信装置609可以允许终端设备600与其他设备进行无线或有线通信以交换数据。虽然图6示出了具有各种装置的终端设备600，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码，从而实现如上所述的多媒体数据处理方法。在这样的实施例中，该计算机程序可以通过通信装置609从网络上被下载和安装，或者从存储装置608被安装，或者从ROM 602被安装。在该计算机程序被处理装置601执行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(“LAN”)，广域网(“WAN”)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该终端设备执行时，使得该终端设备：获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
可选的，当上述一个或者多个程序被该终端设备执行时，该终端设备还可以执行上述实施例所述的其他步骤。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实 际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，包括：获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，所述第一多媒体草稿数据是基于所述拍摄器上触发的所述分段拍摄操作和第二编辑器上触发的视频编辑操作生成的，所述第一多媒体草稿数据包括基于所述分段拍摄操作采集到的至少一段视频素材以及用于指示所述第二编辑器上所触发的视频编辑操作的指示信息。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，所述第二编辑器上可触发的视频编辑操作的类型数量少于所述第一编辑器上可触发的视频编辑操作的类型。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，所述第二编辑器中包括可支持编辑的视图模型，可支持编辑的视图模型用于接收在所述第二编辑器上所触发的视频编辑操作。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，所述拍摄器和第二编辑器是在第一客户端内，第一编辑器在第二客户端内，还包括：所述第二客户端接收第一客户端发送的调用请求，所述调用请求用于请求将所述第一多媒体草稿导入到所述第一编辑器；第二客户端展示所述调用请求对应的提示信息，并响应于提示信息的确认操作，在第一编辑器中导入第一多媒体草稿数据。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，在第一编辑器中导入所述第一多媒体草稿数据之前，还包括：在第一编辑器中响应于针对第三方草稿导入的确认操作，确定所述第一多媒体草稿数据所采用的第一草稿协议，所述第一草稿协议为所述第二编辑器支持的草稿协议；若所述第一草稿协议与所述第一编辑器支持的第二草稿协议不同，按照草稿协议转换规则，将第一多媒体草稿数据所采用的草稿协议从所述第一草稿协议转换为所述第二草稿协议。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，所述拍摄器注册在第一Activiy组件中，所述第二编辑器注册在第二Activiy组件中。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，所述第一Activiy组件包括可支持草稿的视图模型，可支持草稿的视图模型用于将采集到的至少一个视频素材封装成第一多媒体草稿数据。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，在所述第二编辑器上所触发的视频编辑操作为会话编辑操作，在所述第二编辑器上通过可支持编辑的视图模型对所触发的视频编辑操作进行封装和管理。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理方法，其中，还包括：响应于在所述视频编辑轨道上针对目标视频轨道片段触发的重拍指示操作，所述拍摄器中展示第一多媒体草稿数据的重拍界面；所述至少一个视频轨道片段包括目标视频轨道片段，所述至少一个视频素材中的目标视频素材用于形成所述目标视频轨道；在所述重拍界面中，所述至少一个视频素材中除所述目标视频素材之外的其他视频素材被还原到所述分段拍摄操作中对应的采集时间进度区间，所述目标视频素材在所述分段拍摄操作中对应的目标采集时间进度区域被空置；响应于在所述分段拍摄界面上所述目标采集时间进度区域的重拍操作，获取重拍视频素材；通过在所述至少一个视频素材中将所述目标视频素 材替换为所述重拍视频素材，更新所述第一多媒体草稿数据，以使得用于形成所述目标视频轨道片段的视频素材从所述目标视频素材被替换为重拍视频素材；在所述第一编辑器中导入更新后的所述第一多媒体草稿数据。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，包括：第一草稿数据获取模块，用于获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；第一草稿数据导入模块，用于在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；第一草稿数据更新模块，用于响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；目标视频生成模块，用于响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，所述第一多媒体草稿数据是基于拍摄器上触发的分段拍摄操作和第二编辑器上触发的视频编辑操作生成的，所述第一多媒体草稿数据包括基于所述分段拍摄操作采集到的至少一段视频素材以及用于指示所述第二编辑器上所触发的视频编辑操作的指示信息。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，所述第二编辑器上可触发的视频编辑操作的类型数量少于所述第一编辑器上可触发的视频编辑操作的类型。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，所述第二编辑器中包括可支持编辑的视图模型，可支持编辑的视图模型用于接收在所述第二编辑器上所触发的视频编辑操作。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，所述拍摄器和第二编辑器是在第一客户端内，第一编辑器在第二客户端内，所述装置还包括：调用请求接收模块，用于所述第二客户端接收第一客户端发送的调用请求，所述调用请求用于请求将所述第一多媒体草稿导入到所述第一编辑器；第一草稿数据导入模块，还用于第二客户端展示所述调用请求对应的提示信息，并响应于提示信息的确认操作，在第一编辑器中导入第一多媒体草稿数据。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，第一草稿数据导入模块，还用于在第一编辑器中导入所述第一多媒体草稿数据之前，在第一 编辑器中响应于针对第三方草稿导入的确认操作，确定所述第一多媒体草稿数据所采用的第一草稿协议，所述第一草稿协议为所述第二编辑器支持的草稿协议；若所述第一草稿协议与所述第一编辑器支持的第二草稿协议不同，按照草稿协议转换规则，将第一多媒体草稿数据所采用的草稿协议从所述第一草稿协议转换为所述第二草稿协议。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，所述拍摄器注册在第一Activiy组件中，所述第二编辑器注册在第二Activiy组件中。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，所述第一Activiy组件包括可支持草稿的视图模型，可支持草稿的视图模型用于将采集到的至少一个视频素材封装成第一多媒体草稿数据。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，在所述第二编辑器上所触发的视频编辑操作为会话编辑操作，在所述第二编辑器上通过可支持编辑的视图模型对所触发的视频编辑操作进行封装和管理。
根据本公开的一个或多个实施例，本公开提供了一种多媒体数据处理装置，其中，还包括：重拍操作触发模块，用于响应于在所述视频编辑轨道上针对目标视频轨道片段触发的重拍指示操作，所述拍摄器中展示第一多媒体草稿数据的重拍界面；所述至少一个视频轨道片段包括目标视频轨道片段，所述至少一个视频素材中的目标视频素材用于形成所述目标视频轨道；在所述重拍界面中，所述至少一个视频素材中除所述目标视频素材之外的其他视频素材被还原到所述分段拍摄操作中对应的采集时间进度区间，所述目标视频素材在所述分段拍摄操作中对应的目标采集时间进度区域被空置；重拍素材获取模块，用于响应于在所述分段拍摄界面上所述目标采集时间进度区域的重拍操作，获取重拍视频素材；视频素材替换模块，用于通过在所述至少一个视频素材中将所述目标视频素材替换为所述重拍视频素材，更新所述第一多媒体草稿数据，以使得用于形成所述目标视频轨道片段的视频素材从所述目标视频素材被替换为重拍视频素材；第一草稿数据导入模块，还用于在所述第一编辑器中导入更新后的所述第一多媒体草稿数据。
根据本公开的一个或多个实施例，本公开提供了一种电子设备，包括：
一个或多个处理器；
存储器，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如本公开提供的任一所述的多媒体数据处理方法。
根据本公开的一个或多个实施例，本公开提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本公开提供的任一所述的多媒体数据处理方法。
本公开实施例还提供了一种计算机程序产品，该计算机程序产品包括计算机程序或指 令，该计算机程序或指令被处理器执行时实现如上所述的多媒体数据处理方法。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (14)

  1. 一种多媒体数据处理方法，包括：
    获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；
    在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；
    响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑操作的指示信息；以及
    响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
  2. 根据权利要求1所述的方法，其中所述第一多媒体草稿数据是基于所述拍摄器上触发的所述分段拍摄操作和第二编辑器上触发的视频编辑操作生成的，所述第一多媒体草稿数据包括基于所述分段拍摄操作采集到的至少一段视频素材以及用于指示所述第二编辑器上所触发的视频编辑操作的指示信息。
  3. 根据权利要求2所述的方法，其中所述第二编辑器上可触发的视频编辑操作的类型数量少于所述第一编辑器上可触发的视频编辑操作的类型。
  4. 根据权利要求1所述的方法，其中所述第二编辑器中包括可支持编辑的视图模型，可支持编辑的视图模型用于接收在所述第二编辑器上所触发的视频编辑操作。
  5. 根据权利要求2所述的方法，其中所述拍摄器和第二编辑器是在第一客户端内，第一编辑器是在第二客户端内，所述方法还包括：
    所述第二客户端接收第一客户端发送的调用请求，所述调用请求用于请求将所述第一多媒体草稿导入到所述第一编辑器；以及
    第二客户端展示所述调用请求对应的提示信息，并响应于提示信息的确认操作，在第一编辑器中导入第一多媒体草稿数据。
  6. 根据权利要求5所述的方法，其中在第一编辑器中导入所述第一多媒体草稿数据之前，还包括：
    在第一编辑器中响应于针对第三方草稿导入的确认操作，确定所述第一多媒体草稿数据所采用的第一草稿协议，所述第一草稿协议为所述第二编辑器支持的草稿协议；以及
    若所述第一草稿协议与所述第一编辑器支持的第二草稿协议不同，按照草稿协议转换 规则，将第一多媒体草稿数据所采用的草稿协议从所述第一草稿协议转换为所述第二草稿协议。
  7. 根据权利要求1所述的方法，其中所述拍摄器注册在第一Activiy组件中，所述第二编辑器注册在第二Activiy组件中。
  8. 根据权利要求7所述的方法，其中所述第一Activiy组件包括可支持草稿的视图模型，可支持草稿的视图模型用于将采集到的至少一个视频素材封装成第一多媒体草稿数据。
  9. 根据权利要求7所述的方法，其中在所述第二编辑器上所触发的视频编辑操作为会话编辑操作，在所述第二编辑器上通过可支持编辑的视图模型对所触发的视频编辑操作进行封装和管理。
  10. 根据权利要求1所述的方法，其中所述方法还包括：
    响应于在所述视频编辑轨道上针对目标视频轨道片段触发的重拍指示操作，所述拍摄器中展示第一多媒体草稿数据的重拍界面；所述至少一个视频轨道片段包括目标视频轨道片段，所述至少一个视频素材中的目标视频素材用于形成所述目标视频轨道；在所述重拍界面中，所述至少一个视频素材中除所述目标视频素材之外的其他视频素材被还原到所述分段拍摄操作中对应的采集时间进度区间，所述目标视频素材在所述分段拍摄操作中对应的目标采集时间进度区域被空置；
    响应于在所述分段拍摄界面上所述目标采集时间进度区域的重拍操作，获取重拍视频素材；
    通过在所述至少一个视频素材中将所述目标视频素材替换为所述重拍视频素材，更新所述第一多媒体草稿数据，以使得用于形成所述目标视频轨道片段的视频素材从所述目标视频素材被替换为重拍视频素材；以及
    在所述第一编辑器中导入更新后的所述第一多媒体草稿数据。
  11. 一种多媒体数据处理装置，包括：
    第一草稿数据获取模块，被配置为获取第一多媒体草稿数据，其中，所述第一多媒体草稿数据是基于在拍摄器上触发的分段拍摄操作而生成的，所述分段拍摄操作采集到的至少一段视频素材用于形成所述第一多媒体草稿数据中的至少一个视频轨道片段；
    第一草稿数据导入模块，被配置为在第一编辑器中导入所述第一多媒体草稿数据，以使得在所述第一编辑器的视频编辑轨道上显示所述至少一个视频轨道片段；所述至少一个视频轨道片段在所述视频编辑轨道上占据的时间段与所述至少一个视频素材在所述分段拍摄操作中对应的采集时间进度区间相一致；
    第一草稿数据更新模块，被配置为响应于在所述第一编辑器上触发针对所述至少一个视频轨道片段的视频编辑操作，对所述第一多媒体草稿数据进行更新，得到第二多媒体草稿数据，所述第二多媒体草稿数据包括用于指示所述第一编辑器上所触发的所述视频编辑 操作的指示信息；以及
    目标视频生成模块，被配置为响应于视频合成的触发操作，基于所述第二多媒体草稿数据，生成目标视频。
  12. 一种电子设备，所述电子设备包括：
    一个或多个处理器；
    存储装置，用于存储一个或多个程序；
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-10中任一项所述的方法。
  13. 一种计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现如权利要求1-10中任一项所述的方法。
  14. 一种计算机程序产品，该计算机程序产品包括计算机程序或指令，该计算机程序或指令被处理器执行时实现如权利要求1-10中任一项所述的方法。
PCT/CN2023/103070 2022-06-30 2023-06-28 多媒体数据处理方法、装置、设备、存储介质和程序产品 Ceased WO2024002132A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2024564690A JP7739643B2 (ja) 2022-06-30 2023-06-28 マルチメディアデータ処理方法、装置、機器、記憶媒体及びプログラム製品
EP23830307.7A EP4496324A4 (en) 2022-06-30 2023-06-28 MULTIMEDIA DATA PROCESSING METHOD AND APPARATUS, DEVICE, STORAGE MEDIUM AND PROGRAM PRODUCT
US18/396,140 US12136444B2 (en) 2022-06-30 2023-12-26 Method, apparatus, device, storage medium and program product for processing multimedia data
US18/923,258 US12614569B2 (en) 2022-06-30 2024-10-22 Method, apparatus, device, storage medium and program product for processing multimedia data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210772811.8 2022-06-30
CN202210772811.8A CN117376635A (zh) 2022-06-30 2022-06-30 多媒体数据处理方法、装置、设备、存储介质和程序产品

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/396,140 Continuation US12136444B2 (en) 2022-06-30 2023-12-26 Method, apparatus, device, storage medium and program product for processing multimedia data

Publications (1)

Publication Number Publication Date
WO2024002132A1 true WO2024002132A1 (zh) 2024-01-04

Family

ID=89383084

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/103070 Ceased WO2024002132A1 (zh) 2022-06-30 2023-06-28 多媒体数据处理方法、装置、设备、存储介质和程序产品

Country Status (5)

Country Link
US (2) US12136444B2 (zh)
EP (1) EP4496324A4 (zh)
JP (1) JP7739643B2 (zh)
CN (1) CN117376635A (zh)
WO (1) WO2024002132A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117376635A (zh) * 2022-06-30 2024-01-09 北京字跳网络技术有限公司 多媒体数据处理方法、装置、设备、存储介质和程序产品
JP2025527039A (ja) * 2023-07-26 2025-08-18 北京字跳▲網▼絡技▲術▼有限公司 ビデオ編集方法、装置、デバイスおよび媒体
CN118450202A (zh) * 2024-04-24 2024-08-06 北京字跳网络技术有限公司 一种视频处理方法、装置、设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019213809A1 (zh) * 2018-05-07 2019-11-14 深圳市大疆创新科技有限公司 视频处理方法、系统、终端设备、可移动装置的系统
CN112153288A (zh) * 2020-09-25 2020-12-29 北京字跳网络技术有限公司 用于发布视频或图像的方法、装置、设备和介质
CN112218154A (zh) * 2019-07-12 2021-01-12 腾讯科技（深圳）有限公司 视频的获取方法和装置、存储介质及电子装置
CN113411490A (zh) * 2021-05-11 2021-09-17 北京达佳互联信息技术有限公司 多媒体作品的发布方法、装置、电子设备及存储介质

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8818175B2 (en) 2010-03-08 2014-08-26 Vumanity Media, Inc. Generation of composited video programming
JP6004283B2 (ja) * 2012-02-09 2016-10-05 パナソニックＩｐマネジメント株式会社 マルチメディアコンテンツ編集サーバ、マルチメディアコンテンツ編集方法、プログラム及び集積回路
CN108024083A (zh) 2017-11-28 2018-05-11 北京川上科技有限公司 处理视频的方法、装置、电子设备和计算机可读存储介质
EP3817371B1 (en) * 2019-10-28 2025-01-22 Axis AB Method and system for composing a video material
CN114025087A (zh) 2021-10-29 2022-02-08 北京字跳网络技术有限公司 视频拍摄方法、设备、存储介质及程序产品
CN117376635A (zh) * 2022-06-30 2024-01-09 北京字跳网络技术有限公司 多媒体数据处理方法、装置、设备、存储介质和程序产品

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019213809A1 (zh) * 2018-05-07 2019-11-14 深圳市大疆创新科技有限公司 视频处理方法、系统、终端设备、可移动装置的系统
CN112218154A (zh) * 2019-07-12 2021-01-12 腾讯科技（深圳）有限公司 视频的获取方法和装置、存储介质及电子装置
CN112153288A (zh) * 2020-09-25 2020-12-29 北京字跳网络技术有限公司 用于发布视频或图像的方法、装置、设备和介质
CN113411490A (zh) * 2021-05-11 2021-09-17 北京达佳互联信息技术有限公司 多媒体作品的发布方法、装置、电子设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4496324A4 *

Also Published As

Publication number Publication date
US20250046344A1 (en) 2025-02-06
JP7739643B2 (ja) 2025-09-16
US20240127863A1 (en) 2024-04-18
CN117376635A (zh) 2024-01-09
EP4496324A4 (en) 2025-07-16
US12136444B2 (en) 2024-11-05
US12614569B2 (en) 2026-04-28
JP2025516284A (ja) 2025-05-27
EP4496324A1 (en) 2025-01-22

Similar Documents

Publication Publication Date Title
WO2024002132A1 (zh) 多媒体数据处理方法、装置、设备、存储介质和程序产品
WO2021249168A1 (zh) 视频处理方法、装置、电子设备及计算机可读存储介质
WO2020062683A1 (zh) 视频获取方法、装置、终端和介质
CN113038234B (zh) 视频的处理方法、装置、电子设备和存储介质
WO2023202360A1 (zh) 视频预览方法、装置、可读介质及电子设备
WO2023179424A1 (zh) 弹幕添加方法、装置、电子设备和存储介质
US20240339132A1 (en) Video generation method and apparatus, and electronic device and medium
US12200351B2 (en) Photographing method and apparatus, electronic device, and storage medium
WO2023191711A1 (zh) 基于端云协同的图像处理方法、装置、设备及存储介质
US12603112B2 (en) Video generation method, apparatus, device, and storage medium
WO2021089002A1 (zh) 多媒体信息处理方法、装置、电子设备及介质
WO2023185511A1 (zh) 一种视频生成方法、装置、电子设备和存储介质
EP4704431A1 (en) Media content posting method and apparatus, and device and storage medium
CN117793478A (zh) 讲解信息生成方法、装置、设备、介质和程序产品
WO2024099376A1 (zh) 视频编辑方法、装置、设备及介质
WO2023216941A1 (zh) 视频记录的展示方法、装置、电子设备、介质和程序产品
CN118170297A (zh) 特效编辑方法、装置、电子设备、存储介质及程序产品
CN114520928B (zh) 显示信息生成方法、信息显示方法、装置和电子设备
CN116820311A (zh) 封面的设置方法、装置、电子设备和存储介质
EP4465640A1 (en) Method and apparatus for multimedia resource processing, device, medium, and program product
WO2025055962A1 (zh) 一种视频编辑方法、装置、电子设备及存储介质
WO2023177350A2 (zh) 视频编辑方法、装置、设备及存储介质
CN121334419A (zh) 一种视频生成方法、装置、设备、介质及程序产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23830307

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023830307

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2023830307

Country of ref document: EP

Effective date: 20241017

WWE Wipo information: entry into national phase

Ref document number: 2024564690

Country of ref document: JP

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112024022564

Country of ref document: BR

WWE Wipo information: entry into national phase

Ref document number: 11202407393S

Country of ref document: SG

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 112024022564

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20241029