WO2019184822A1 - 多媒体文件处理方法和装置、存储介质及电子装置 - Google Patents
多媒体文件处理方法和装置、存储介质及电子装置 Download PDFInfo
- Publication number
- WO2019184822A1 WO2019184822A1 PCT/CN2019/079269 CN2019079269W WO2019184822A1 WO 2019184822 A1 WO2019184822 A1 WO 2019184822A1 CN 2019079269 W CN2019079269 W CN 2019079269W WO 2019184822 A1 WO2019184822 A1 WO 2019184822A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- source
- media file
- processing
- slice
- slice media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2181—Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/435—Filtering based on additional data, e.g. user or group profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
Definitions
- the present application relates to the field of computers, and in particular, to a multimedia file processing method and apparatus, a storage medium, and an electronic device.
- the related art provides an intelligent processing method for a multimedia file to be transmitted. For example, identifying a data frame picture in the acquired source multimedia file, acquiring an important area in the data frame picture, maintaining high definition of the important area, and reducing the definition of the other area, thereby reducing multimedia The purpose of the file's transport stream.
- intelligent analysis can only be performed on the entire source multimedia file, and further processing can be performed on the source multimedia file after obtaining the result of the intelligent analysis on the entire source multimedia file.
- intelligent analysis usually requires deep learning of multimedia files, and the learning process is very time consuming, which causes the processing speed of multimedia files to be greatly affected, thereby causing a problem of low processing efficiency for multimedia files.
- the embodiment of the present invention provides a multimedia file processing method and apparatus, a storage medium, and an electronic device, so as to at least solve the technical problem that the processing efficiency of the multimedia file processing method provided by the related art is low.
- a file processing method including: a transcoding device acquiring a source slice media file in a source multimedia file to be processed; and a transcoding device acquiring a slice preprocessing matching the source slice media file a result, wherein the slice preprocessing result is used to indicate a storage address of the screen region processing result that matches the source slice media file in the preprocessing device; and the transcoding device acquires the screen region processing result that matches the source slice media file from the storage address; The transcoding device processes the source slice media file according to the screen area processing result, and obtains the processed target slice media file.
- a file processing method including: a pre-processing device acquiring a source slice media file in a source multimedia file to be processed; and a pre-processing device acquiring, corresponding to the source slice media file, a pre-processing task; the pre-processing device acquires a picture region processing result that matches the source slice media file according to the foregoing slice pre-processing task; the pre-processing device sends the picture region processing result to the transcoding device, so that the transcoding device is configured according to the The above-mentioned picture area processing result processes the source slice media file to obtain a processed target slice media file.
- a file processing apparatus which is applied to a transcoding device, and includes: a first acquiring unit, configured to acquire a source slice media file in a source multimedia file to be processed; a second obtaining unit, configured to obtain a slice preprocessing result that matches the source slice media file, where the slice preprocessing result is used to indicate a storage address of a screen region processing result that matches the source slice media file in the preprocessing device
- the third obtaining unit is configured to obtain, according to the storage address, the screen region processing result that matches the source slice media file
- the processing unit is configured to process the source slice media file according to the screen region processing result, and obtain the processed The target slice media file.
- the processing unit includes: an obtaining module, configured to acquire a key area in a frame picture included in the source slice media file according to the processing result of the picture area; and an execution module, configured to perform a first operation on the key area, The second frame operation is performed on the area other than the above-mentioned key area in the frame picture included in the source slice media file, wherein the first operation and the second operation are different operations.
- the execution module includes: a first execution sub-module, configured to perform an encoding processing operation on the key area according to a first code rate; and a second execution sub-module configured to perform the foregoing on the frame picture other than the key area
- the other area performs an encoding processing operation at a second code rate; wherein the first code rate is higher than the second code rate.
- the device further includes: a merging unit configured to process the source slice media file according to the processing result of the screen region to obtain a processed target slice media file, and then include each of the source multimedia files The target slice media files respectively corresponding to the source slice media files are merged to obtain a target multimedia file corresponding to the source multimedia file, and the sending unit is configured to send the target multimedia file to the playback client for playing.
- a merging unit configured to process the source slice media file according to the processing result of the screen region to obtain a processed target slice media file, and then include each of the source multimedia files
- the target slice media files respectively corresponding to the source slice media files are merged to obtain a target multimedia file corresponding to the source multimedia file
- the sending unit is configured to send the target multimedia file to the playback client for playing.
- a file processing apparatus which is applied to a preprocessing device, and includes: a first acquiring unit, configured to acquire a source slice media file in a source multimedia file to be processed; a second obtaining unit, configured to be a slice preprocessing task corresponding to the source slice media file, and a third acquiring unit configured to acquire a screen region processing result that matches the source slice media file according to the slice preprocessing task; sending unit, setting And transmitting the result of the processing of the screen area to the transcoding device, so that the transcoding device processes the source slice media file according to the processing result of the screen area to obtain the processed target slice media file.
- the third acquiring unit includes: an identifying module configured to perform key area identification on the frame picture included in the source slice media file according to the preprocessing task; and the saving module is configured to save the identified image area processing result.
- the sending unit includes: an obtaining module, configured to acquire an obtaining request sent by the transcoding device, where the acquiring request carries a storage address for indicating a result of processing the screen area; and a sending module is configured to set the storage address
- the above-mentioned screen area processing result is transmitted to the above-described transcoding device.
- a storage medium having a computer program stored therein, wherein the computer program is configured to execute the file processing method described above at runtime.
- an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the above by using a computer program File processing method.
- a file processing system including: a control device configured to slice a source multimedia file to be processed to obtain a source slice media file; and a preprocessing device configured to acquire the source a slice media file and a slice pre-processing task corresponding to the source slice media file; and configured to obtain a screen region processing result that matches the source slice media file according to the slice pre-processing task; and the transcoding device is configured to acquire the source slice a media file and a slice preprocessing result matching the source slice media file, wherein the slice preprocessing result is used to indicate a storage address of the screen region processing result in the preprocessing device; and is further configured to acquire and retrieve from the storage address And the result of the processing of the picture region matched by the source slice media file; and the method for processing the source slice media file according to the processing result of the screen region to obtain a processed target slice media file.
- the source slice media file in the source multimedia file to be processed is obtained by the transcoding device; the transcoding device obtains a slice preprocessing result that matches the source slice media file, where the slice preprocessing result is used to indicate The processing result of the picture area processing result matching the source slice media file in the preprocessing device; the transcoding device acquires the picture area processing result that matches the source slice media file from the storage address; the transcoding device slices the source according to the picture area processing result
- the method of processing the media file to obtain the processed target slice media file achieves the result of acquiring the screen area matching result of the source slice media file, and directly processing the source slice media file according to the screen area processing result.
- the source multimedia file to be processed is sliced to obtain a source slice media file, and the plurality of source slice media files are synchronously processed by the distributed transcoding device and the distributed preprocessing device, thereby overcoming the related technology only for the entire source multimedia file.
- the problem of low processing efficiency caused by intelligent analysis is realized, thereby improving the efficiency of intelligent processing of source multimedia files.
- FIG. 1 is a schematic diagram of an application environment of an optional multimedia file processing method according to an embodiment of the present application
- FIG. 2 is a schematic flowchart of an optional multimedia file processing method according to an embodiment of the present application.
- FIG. 3 is a schematic diagram of an optional multimedia file processing method according to an embodiment of the present application.
- FIG. 4 is a schematic diagram of another optional multimedia file processing method according to an embodiment of the present application.
- FIG. 5 is a schematic diagram of still another optional multimedia file processing method according to an embodiment of the present application.
- FIG. 6 is a schematic diagram of still another optional multimedia file processing method according to an embodiment of the present application.
- FIG. 7 is a schematic diagram of still another optional multimedia file processing method according to an embodiment of the present application.
- FIG. 8 is a schematic diagram of another optional multimedia file processing method according to an embodiment of the present application.
- FIG. 9 is a schematic structural diagram of an optional multimedia file processing apparatus according to an embodiment of the present application.
- FIG. 10 is a schematic structural diagram of another optional multimedia file processing apparatus according to an embodiment of the present application.
- FIG. 11 is a schematic diagram of an optional multimedia file processing system according to an embodiment of the present application.
- FIG. 12 is a schematic structural diagram of an optional electronic device according to an embodiment of the present application.
- a multimedia file processing method is provided.
- the foregoing multimedia file processing method may be, but is not limited to, applied to a multimedia file processing system, and an application environment of the system is shown in FIG. 1 .
- the server 106 cuts the source multimedia file into a source slice media file, and sends the original slice media file to the pre-processing device 102 and the transcoding device 104.
- the pre-processing device 102 acquires the slice pre-processing task corresponding to the source-slice media file in step S102, and obtains the screen region processing result that matches the original slice media file according to the slice pre-processing task in step S104, and performs the screen region processing result in step S106.
- the transcoding device 104 acquires the source slice media file in step S108, and obtains the screen region processing result in step S110.
- the source tile media file is processed according to the screen region processing result in step S112 to obtain the processed target slice media file.
- the target slice media file is sent to the server 106 in step S114.
- the server 106 combines the target slice media files into the target multimedia file, and sends the target media file to the terminal 108.
- the terminal 108 plays the target multimedia file and plays it.
- the preprocessing device performs preprocessing on the source slice media file to obtain a slice preprocessing result, where the slice preprocessing result is used to indicate that the screen region processing result that matches the source slice media file is in the preprocessing device.
- the storage address; the transcoding device processes each source slice media file according to the processing result of the picture region obtained from the storage address in the preprocessing device, and obtains the processed target slice file, thereby realizing the source to be processed.
- the multimedia file is sliced to obtain the source slice media file, and the plurality of source slice media files are synchronously processed by the distributed hardware device (such as the transcoding device and the preprocessing device) to overcome the related technology that only intelligently targets the entire source multimedia file.
- the analysis results in low processing efficiency, thereby improving the efficiency of intelligent processing of source multimedia files.
- the foregoing multimedia file processing system may include, but is not limited to, a hardware device such as a transcoding device, a preprocessing device, and a control device, where the hardware device may include but is not limited to a hardware device with data processing capability.
- the above network may include, but is not limited to, at least one of the following: a wide area network, a metropolitan area network, and a local area network. The above is only an example, and the embodiment does not limit this.
- the method may include:
- the transcoding device acquires a source slice media file in the source multimedia file to be processed.
- the transcoding device obtains a slice pre-processing result that matches the source slice media file, where the slice pre-processing result is used to indicate a storage address of a screen region processing result that matches the source slice media file in the pre-processing device, and the pre-processing device Used to obtain the result of the screen area processing;
- the transcoding device acquires a picture area processing result that matches the source slice media file from the storage address.
- the transcoding device processes the source slice media file according to the screen region processing result, and obtains the processed target slice media file.
- the foregoing multimedia file processing method may be, but is not limited to, being applied to a scenario for efficiently transcoding a multimedia file.
- the control device sends the source slice media file in the source multimedia file to the transcoding device and the preprocessing device, and the preprocessing device performs preprocessing on the source slice media file to obtain a slice preprocessing result, where the slice preprocessing result is used to indicate The processing result of the picture area processing result matching the source slice media file in the preprocessing device; the transcoding device processes each source slice media file according to the picture area processing result obtained from the storage address in the preprocessing device After the processed target slice file is obtained, the source multimedia file to be processed is sliced, the source slice media file is obtained, and the plurality of source slice media files are performed by the distributed hardware device (such as the transcoding device and the preprocessing device). Synchronous processing to overcome the problem of low processing efficiency caused by intelligent analysis only for the entire source multimedia file in the related art, thereby improving the efficiency of intelligent processing of the source multimedia file.
- the source slice media file in the source multimedia file to be processed may be obtained by the following steps: the split server divides the source multimedia file to be processed into multiple source slice media files.
- the split server is configured to cut the source multimedia file into a source slice media file, and send the original slice media file to the pre-processing device and the transcoding device.
- the above slice may, but is not limited to, slice the source multimedia file according to a predetermined duration.
- a source multimedia file with a length of 10 minutes and 50 seconds starts from 0 minutes and 0 seconds of the source multimedia file, and is sliced every two minutes to cut the source multimedia file into 5 segments and two minutes of sliced media files and a length of 50.
- the sliced media file of the second; or the average segmentation method, the source multimedia file of 10 minutes and 50 seconds is equally divided into 5 segments, each segment being 2 minutes and 10 seconds long.
- the method for slicing the source media file according to the method of the predetermined duration or the average segment is only an example.
- the method for the source file slicing and the duration of the slice media file are not limited herein.
- control device may further send the slice pre-processing task corresponding to the source slice media file to the pre-processing device, and the pre-processing device according to the pre-processing The task performs key area recognition on the frame picture included in the source slice media file, and saves the recognized picture area processing result.
- control device may further determine, from the pre-processing device cluster, the pre-processing device corresponding to the source slice media file before sending the slice pre-processing task to the pre-processing device.
- control device before determining, by the pre-processing device cluster, the pre-processing device corresponding to the source-slice media file, the control device further includes: the control device sets a plurality of pre-processing devices to form a pre-processing device cluster, where the multiple pre-processing devices are pre- The processing device cluster is in a side-by-side relationship.
- control device may further include: determining, by the control device, the pre-processing device corresponding to the file type according to the file type of the slice media file.
- the preprocessing device that selects the subtitle processing processes the source slice file including the subtitle, and the preprocessing device pair that selects the video processing does not include The source slice file of the subtitle is processed.
- the transcoding device processes the source slice media file according to the screen region processing result
- the obtained target slice media file may include: the transcoding device acquires the frame image included in the source slice media file according to the screen region processing result. Key area; the transcoding device performs the first operation on the critical area and performs the second operation on other areas except the critical area.
- the transcoding device processes the source slice media file according to the processing result of the screen area
- the obtained target slice media file may include: the transcoding device acquires the key time period included in the source slice media file according to the processing result of the screen area, The first operation is performed on the critical time period, and the second operation is performed on other time periods except the critical time period.
- the critical time period may be one or more segments in the source slice media file
- the first operation may be to increase the code rate
- the second operation may be to reduce the code rate.
- the screen area processing result indicates the 3rd to 7th second of the source slice media file
- the 11th second to the 14th second is the key time period
- the other time periods are non-critical time segments
- the source slice file can be Files from the 3rd to 7th and 11th to 14th are increased in bit rate, and files in other non-critical time periods are reduced in bit rate.
- first operation is to improve the code rate
- second operation is to reduce the code rate, which is only an optional operation, which is not specifically limited in this embodiment.
- the source slice media file in the source multimedia file to be processed and the slice pre-processing result matched with the source slice media file are obtained by the transcoding device, and the storage address is obtained according to the storage address indicated in the slice pre-processing result.
- Each source slice media file in the file is processed to obtain a target slice media file, and the purpose of intelligently analyzing and processing each slice media file in the source multimedia file is realized. Therefore, the problem that the entire source multimedia file can only be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- the method before the transcoding device obtains the source slice media file in the source multimedia file to be processed, the method further includes:
- the control device acquires a slice pre-processing task corresponding to the source slice media file.
- the control device sends a slice pre-processing task corresponding to the source slice media file to the pre-processing device, so that the pre-processing device performs key area recognition on the frame picture included in the source slice media file according to the pre-processing task, and saves and recognizes The screen area is processed.
- the foregoing slice preprocessing task may be: analyzing a picture in each frame of the source slice media file, obtaining a key area of the picture in each frame, and saving the key area in the picture area processing result.
- Figure 3 shows a frame in a source slice media file.
- the source slice media file is 20 minutes long.
- each frame in the source slice media file is analyzed according to the slice pre-processing task, and the key areas in each frame are analyzed.
- the key areas are identified in Figure 3 using a dashed box.
- the key areas identified in each frame are saved to the screen area processing result.
- the basis for determining the key area is not specifically limited in this embodiment.
- the key area may be determined by the color, shape, specific image, or the like of the image in the source slice media file, or the area with the subtitle may be determined as a key area or the like.
- a slice pre-processing task corresponding to the source slice media file is obtained, and the pre-processing device performs key on the frame picture in the source slice file.
- the area is identified, so that in the process of processing the source slice file, the processing strategy of the source slice file is determined, and the effect of flexible processing of the source slice media file is realized.
- the method before sending the slice pre-processing task corresponding to the source slice media file to the pre-processing device, the method further includes:
- the control device determines, from the pre-processing device cluster, a pre-processing device corresponding to the source-slice media file, where the ratio of the number of source-slice media files in the source multimedia file to the number of pre-processing devices in the pre-processing device cluster N: M, N is a natural number greater than 1, and M is a natural number greater than 1.
- the ratio of the number of the source-slice media files to the number of pre-processing devices in the pre-processing device cluster is N: M may be one source-slice media file corresponding to one pre-processing device; or multiple source-slice media files correspond to A preprocessing device.
- the preprocessing device corresponding to determining the source slice media file from the preprocessing device cluster may be: distributing N source slice media files to the M preprocessing devices.
- the four source slice media files are shown in FIG.
- the four source slice media files are allocated, they are assigned to the preprocessing device 1 and the preprocessing device 2 in order. That is, the source slice media file 1 is assigned to the preprocessing device 1; the source slice media file 2 is assigned to the preprocessing device 2; the source slice media file 3 is assigned to the preprocessing device 1; and the source slice media file 4 is assigned to the preprocess Processing device 2. If the media file 5 is sliced actively, it is assigned to the source slice media file 1.
- the number of source slice media files and the number of preprocessing devices are not specifically limited.
- the preprocessing device corresponding to determining the source slice media file from the preprocessing device cluster may be: when each source slice media file is allocated, the source slice media file is allocated to the current source slice media file with the least pre Processing equipment.
- the pre-processing device 1 actively slices the media files 1, 3, and the active slice media 2 in the pre-processing device 2.
- the source tile media file 4 is assigned to the preprocessing device 2 with less source tile media files.
- the source slice media file 5 is allocated, since the number of source slice media files in the preprocessing device 1 and the preprocessing device 2 is identical, a method of sequential allocation or random allocation may be employed.
- the number of source slice media files and the number of preprocessing devices are not specifically limited.
- the method for allocating the source slice media file is only an optional example, which is not specifically limited in this embodiment.
- the preprocessing device corresponding to the source slice media file is determined from the preprocessing device cluster, thereby ensuring that each source slice media file has a preprocessing device for processing, and There are multiple devices, which improves the processing efficiency of the source slice media files.
- the transcoding device processes the source slice media file according to the processing result of the picture area, and the processed target slice media file includes:
- the transcoding device acquires a key area in a frame picture included in the source slice media file according to the processing result of the picture area;
- the transcoding device performs a first operation on the key area, and performs a second operation on the area other than the critical area in the frame picture included in the source slice media file, where the first operation and the second operation are different operations.
- the foregoing operation may be to change a code rate of a key area in the source slice media file, or to render a key area, and the like.
- the first operation is to render the image of the above key area using the first parameter
- the second operation is to render the image of the above key area using the second parameter.
- the first parameter is different from the second parameter.
- the first parameter and the second parameter may include parameters such as color, saturation, and the like of the image.
- each frame in the source tile media file may contain the same or different key regions.
- a position such as a person, a car, and the like is determined as a key area, and an area in which a subtitle is displayed is determined as a key area, starting with a dotted circle.
- the area from the dotted circle is determined as other areas, indicated by hatching.
- the method for determining a critical area is not specifically limited in this embodiment.
- the key area may be determined by the color, shape, specific image, or the like of the image in the source slice media file.
- the key area in the frame picture included in the source slice media file is obtained by the transcoding device according to the picture area processing result, and the first operation is performed on the key area, and the second operation is performed on the other area, thereby implementing the Different areas in the source slice media file perform different operations, which improves the flexibility of processing the source slice media files.
- the transcoding device performs the first operation on the key area, and performing the second operation on the area other than the critical area in the frame picture included in the source slice media file includes:
- the transcoding device performs an encoding processing operation on the key area according to the first code rate.
- the transcoding device performs an encoding processing operation on the second frame rate according to the other areas except the key area in the frame picture.
- the first code rate is higher than the second code rate.
- the first code rate may be a super clear code rate
- the second code rate may be a high definition code rate.
- the description will continue with FIG. 6. Key and non-critical areas have been identified in Figure 6. At this time, the code rate in the key area is adjusted to the super clear code rate, and the code rate in the other areas is adjusted to the high-definition code rate, thereby making the characters, cars, and subtitles in the key area clearer, and at the same time The code rate is cleared, which reduces the volume of the source slice media file.
- the encoding processing operation is performed on the key area according to the first code rate by the transcoding device; the encoding processing operation is performed on the other areas except the key area in the frame picture according to the second code rate, thereby realizing the source slice.
- the different areas in the media file perform different operations to make the display rate of different areas different, which improves the flexibility of processing the source slice media files.
- the method further includes:
- the transcoding device combines the target slice media files corresponding to the respective source slice media files included in the source multimedia file to obtain a target multimedia file corresponding to the source multimedia file.
- the transcoding device sends the target multimedia file to the playing client for playing.
- the foregoing combining the target slice media files may determine the order of the target slice media files according to the start time of the respective target slice media files, and merge the plurality of target slice media files into the order according to the target slice media files.
- the three target slice media files there are three target slice media files numbered 1, 2, and 3.
- the starting time of the three target slice media files is 0 minutes 0 seconds, 4 minutes 0 seconds, 2 minutes 0 seconds, respectively, so the correct order of the three target slice media files should be 1, 3, 2.
- the three target slice media files are merged into one target multimedia file, and the target multimedia file is sent to the playback client for playback.
- the target slice media file corresponding to each source slice media file included in the source multimedia file is merged by the transcoding device to obtain a target multimedia file corresponding to the source multimedia file, and the target multimedia file is sent.
- the playback client is played to ensure that after the process of processing the source slice media file, the complete target multimedia file can be obtained, and the processing accuracy of the source slice media file is improved.
- the above multimedia file processing method will be described in detail below with reference to FIG. As shown in Fig. 7, in the related art, the portion enclosed by the broken line frame is not included.
- the source multimedia file is obtained, the source slice media file 1 to the source slice media file n are obtained according to the source multimedia file, where n is a natural number greater than 1.
- the source slice media file 1-n is sent to the transcoding device 1-n, and the source slice media file 1-n is transcoded by the transcoding device 1-n to obtain the transcoded media file 1-n, and will be transferred.
- the media files 1-n are merged into the transcoded multimedia files.
- this method only transcoding of the source multimedia file is done.
- the obtained source slice media file 1-n is sent to the pre-processing device 1 to the pre-processing device m through the steps in the dotted line frame.
- m is a natural number greater than one.
- the pre-processing device 1-m receives the slice pre-processing task 1 to the slice pre-processing task n allocated for each source slice media file, and analyzes the source slice media file 1-n according to the received slice pre-processing task 1-n. The result of the screen area processing of each source slice media file. After the picture area processing result of each source slice media file is acquired, the picture area processing result 1-n is transmitted to the transcoding device 1-n.
- the transcoding device 1-n transcodes the source slice media files 1-n according to the picture area processing result 1-n to obtain the target slice media files 1-n, and merges the target slice media files to obtain the target multimedia file.
- the number of the above transcoding devices may not be n.
- the following two situations are met:
- the meta-slice media files are directly processed by the transcoding device; when the number of source-slice media files is greater than the number of transcoding devices, the redundant source-slice media files are queued for processing. .
- each source slice file obtains a picture area processing result
- each source slice media file in the source multimedia file can be processed according to the picture area processing result, and the target slice media file is obtained, and the pair is realized.
- Each sliced media file in the source multimedia file is intelligently analyzed and processed. Therefore, the problem that the entire source multimedia file can only be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
- the technical solution of the present application which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM).
- the instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, or network device, etc.) to perform the methods of various embodiments of the present application.
- a multimedia file processing method is also provided.
- the foregoing multimedia file processing method may be applied to, but not limited to, the application environment shown in FIG. 1 .
- the foregoing method is applied to a preprocessing device, where the method includes:
- the preprocessing device acquires a source slice media file in the source multimedia file to be processed.
- the pre-processing device acquires a slice pre-processing task corresponding to the source slice media file.
- the preprocessing device acquires a picture area processing result that matches the source slice media file according to the slice preprocessing task.
- the pre-processing device sends the processing result of the picture area to the transcoding device, so that the transcoding device processes the source slice media file according to the processing result of the picture area, and obtains the processed target slice media file.
- the above multimedia file processing method may be, but is not limited to, applied to a scenario in which a video file is processed.
- the preprocessing device acquires a source slice media file in the source multimedia file to be processed, and a slice preprocessing task corresponding to the source slice media file, and acquires a screen region processing result that matches the source slice media file according to the slice preprocessing task;
- the processing result of the above screen area is sent to the transcoding device, and the transcoding device processes the source slice media file according to the processing result of the screen area to obtain the processed target slice media file.
- the source slice media file in the source multimedia file to be processed may be obtained by the following steps: the split server divides the source multimedia file to be processed into a plurality of source slice media files according to a slice rule.
- the split server is configured to cut the source multimedia file into a source slice media file, and send the original slice media file to the pre-processing device and the transcoding device.
- the foregoing tiling rule may be to slice the media file according to a predetermined duration.
- a source multimedia file with a length of 10 minutes and 50 seconds starts from 0 minutes and 0 seconds of the source multimedia file, and is sliced every two minutes to cut the source multimedia file into 5 segments and two minutes of sliced media files and a length of 50.
- the sliced media file of the second; or the average segmentation method, the source multimedia file of 10 minutes and 50 seconds is equally divided into 5 segments, each segment being 2 minutes and 10 seconds long.
- the method for slicing the source media file according to the method of the predetermined duration or the average segment is only an example.
- the method for the source file slicing and the duration of the slice media file are not limited herein.
- the key areas on each of the above frames may be the same or different.
- the sending of the screen area processing result to the transcoding device includes: the preprocessing device acquiring the acquisition request sent by the transcoding device, wherein the obtaining request carries a storage address for indicating a processing result of the screen area; the preprocessing device is to be stored The result of the screen area processing in the address is sent to the transcoding device.
- the sending the screen area processing result to the transcoding device includes: the preprocessing device performs key area identification on the source slice media file according to the preprocessing task, and obtains the screen area processing result, and directly processes the screen area processing result. Send to the transcoding device.
- the method before acquiring the source slice media file in the source multimedia file to be processed, the method further includes: the control device determining, from the pre-processing device cluster, a pre-processing device corresponding to the source slice media file, where the source multimedia file is The ratio of the number of source slice media files to the number of pre-processing devices in the pre-processing device cluster is N:M, N is a natural number greater than 1, and M is a natural number greater than 1.
- the ratio of the number of the source slice media files to the number of preprocessing devices in the preprocessing device cluster is N:M, where one source slice media file corresponds to one preprocessing device; or multiple source slice media.
- the file corresponds to a preprocessing device.
- the source slice media file in the source multimedia file to be processed and the slice pre-processing task corresponding to the source slice media file are obtained by the pre-processing device, and the source slice media file is matched according to the slice pre-processing task.
- the result of processing the picture area, and processing the result of the picture area processing by the transcoding device to obtain the target slice media file thereby realizing the purpose of intelligently analyzing and processing each slice media file in the source multimedia file.
- the invention solves the problem that only the entire source multimedia file can be intelligently analyzed in the related art, and the processing efficiency of processing the source multimedia file is improved.
- the preprocessing device obtains the picture region processing result that matches the source slice media file according to the slice preprocessing task, including:
- the pre-processing device performs key area identification on the frame picture included in the source slice media file according to the pre-processing task;
- the preprocessing device saves the obtained screen area processing result.
- each frame in the source tile media file may contain the same or different key regions.
- the source slice media file is identified according to the pre-processing task, it is recognized that the picture in FIG. 6 includes two person images and one car image and corresponding subtitles, and the character image and the car image and the subtitle are The location is determined as a key area, and the recognition result is saved to the screen area processing result.
- the key area in the source slice media file is identified by the pre-processing device and saved, and the result of the screen area processing is obtained, thereby achieving the purpose of performing different operations on different areas in the source slice media file, and improving the source.
- the preprocessing device sends the picture area processing result to the transcoding device, including:
- the pre-processing device acquires an acquisition request sent by the transcoding device, where the acquisition request carries a storage address for indicating a processing result of the screen region;
- the preprocessing device sends the processing result of the picture area in the storage address to the transcoding device.
- the screen region processing result is saved, and the storage address storing the processing result of the screen region is sent to the server.
- the pre-processing device obtains the acquisition request sent by the transcoding device, and obtains the screen region processing result according to the storage address of the screen region processing result in the acquisition request, thereby implementing the storage address of storing the screen region processing result on the server. , reducing the burden on the pre-processing equipment.
- the method before acquiring the source slice media file in the source multimedia file to be processed, the method further includes:
- the control device determines, from the pre-processing device cluster, a pre-processing device corresponding to the source-slice media file, where the ratio of the number of source-slice media files in the source multimedia file to the number of pre-processing devices in the pre-processing device cluster N: M, N is a natural number greater than 1, and M is a natural number greater than 1.
- the preprocessing device corresponding to determining the source slice media file from the preprocessing device cluster may be: distributing N source slice media files to the M preprocessing devices.
- the four source slice media files are shown in FIG.
- the four source slice media files are allocated, they are assigned to the preprocessing device 1 and the preprocessing device 2 in order. That is, the source slice media file 1 is assigned to the preprocessing device 1; the source slice media file 2 is assigned to the preprocessing device 2; the source slice media file 3 is assigned to the preprocessing device 1; and the source slice media file 4 is assigned to the preprocess Processing device 2. If the media file 5 is sliced actively, it is assigned to the source slice media file 1.
- the number of source slice media files and the number of preprocessing devices are not specifically limited.
- the preprocessing device corresponding to determining the source slice media file from the preprocessing device cluster may be: when each source slice media file is allocated, the source slice media file is allocated to the current source slice media file with the least pre Processing equipment.
- the pre-processing device 1 actively slices the media files 1, 3, and the active slice media 2 in the pre-processing device 2.
- the source tile media file 4 is assigned to the preprocessing device 2 with less source tile media files.
- the source slice media file 5 is allocated, since the number of source slice media files in the preprocessing device 1 and the preprocessing device 2 is identical, a method of sequential allocation or random allocation may be employed.
- the number of source slice media files and the number of preprocessing devices are not specifically limited.
- the method for allocating the source slice media file is only an optional example, which is not specifically limited in this embodiment.
- the preprocessing device corresponding to the source slice media file is determined from the preprocessing device cluster by the control device, thereby ensuring that each source slice media file has a preprocessing device for processing, and There are multiple pre-processing devices, which improves the processing efficiency of the source slice media files.
- the above multimedia file processing method will be described in detail below with reference to FIG. As shown in Fig. 7, in the related art, the portion enclosed by the broken line frame is not included.
- the source multimedia file is obtained, the source slice media file 1 to the source slice media file n are obtained according to the source multimedia file, where n is a natural number greater than 1.
- the source slice media file 1-n is sent to the transcoding device 1-n, and the source slice media file 1-n is transcoded by the transcoding device 1-n to obtain the transcoded media file 1-n, and will be transferred.
- the media files 1-n are merged into the transcoded multimedia files.
- this method only transcoding of the source multimedia file is done.
- the obtained source slice media file 1-n is sent to the pre-processing device 1 to the pre-processing device m through the steps in the dotted line frame.
- m is a natural number greater than one.
- the pre-processing device 1-m receives the slice pre-processing task 1 to the slice pre-processing task n allocated for each source slice media file, and analyzes the source slice media file 1-n according to the received slice pre-processing task 1-n. The result of the screen area processing of each source slice media file. After the picture area processing result of each source slice media file is acquired, the picture area processing result 1-n is transmitted to the transcoding device 1-n.
- the transcoding device 1-n transcodes the source slice media files 1-n according to the picture area processing result 1-n to obtain the target slice media files 1-n, and merges the target slice media files to obtain the target multimedia file.
- the number of the above transcoding devices may not be n.
- the following two situations are met:
- the meta-slice media files are directly processed by the transcoding device; when the number of source-slice media files is greater than the number of transcoding devices, the redundant source-slice media files are queued for processing. .
- each source slice file obtains a picture area processing result
- each source slice media file in the source multimedia file can be processed according to the picture area processing result, and the target slice media file is obtained, and the pair is realized.
- Each sliced media file in the source multimedia file is intelligently analyzed and processed. Therefore, the problem that only the entire source multimedia file can be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- a multimedia file processing apparatus for implementing the above multimedia file processing method is further provided, wherein the multimedia file processing apparatus may be a transcoding device or disposed in a transcoding device, as shown in FIG. 9.
- the above multimedia file processing apparatus includes:
- the first obtaining unit 902 is configured to acquire a source slice media file in the source multimedia file to be processed.
- the second obtaining unit 904 is configured to obtain a slice preprocessing result that matches the source slice media file, where the slice preprocessing result is used to indicate that the screen region processing result that matches the source slice media file is stored in the preprocessing device. address;
- the third obtaining unit 906 is configured to obtain, from the storage address, a screen region processing result that matches the source slice media file;
- the processing unit 908 is configured to process the source slice media file according to the screen region processing result to obtain the processed target slice media file.
- the above multimedia file processing apparatus may be, but is not limited to, applied to a scene in which a video file is processed.
- the transcoding device obtains the source slice media file in the source multimedia file, and processes each source slice media file according to the processing result of the screen area to obtain the processed target slice file, thereby implementing the source slice media file for each source.
- the invention solves the problem that the related technology can only perform intelligent analysis on the entire source multimedia file, and improves the intelligent analysis efficiency of the source multimedia file and the processing efficiency of the source multimedia file.
- the source slice media file in the source multimedia file to be processed may be obtained by the following steps:
- the split server divides the source multimedia file to be processed into a plurality of source slice media files according to a slice rule.
- the split server is configured to cut the source multimedia file into a source slice media file, and send the original slice media file to the pre-processing device and the transcoding device.
- the foregoing tiling rule may be to slice the media file according to a predetermined duration.
- a source multimedia file with a length of 10 minutes and 50 seconds starts from 0 minutes and 0 seconds of the source multimedia file, and is sliced every two minutes to cut the source multimedia file into 5 segments and two minutes of sliced media files and a length of 50.
- the sliced media file of the second; or the average segmentation method, the source multimedia file of 10 minutes and 50 seconds is equally divided into 5 segments, each segment being 2 minutes and 10 seconds long.
- the method for slicing the source media file according to the method of the predetermined duration or the average segment is only an example.
- the method for the source file slicing and the duration of the slice media file are not limited herein.
- control device may further acquire a slice pre-processing task corresponding to the source slice media file, and send the source slice media file and the slice pre-processing task to the The pre-processing device performs key area recognition on the frame picture included in the source slice media file according to the pre-processing task, and saves the obtained picture area processing result.
- control device may further determine, from the pre-processing device cluster, the pre-processing device corresponding to the source slice media file before the source-slice media file and the slice pre-processing task are sent to the pre-processing device.
- control device before determining, by the pre-processing device cluster, the pre-processing device corresponding to the source-slice media file, the control device further includes: the control device sets a plurality of pre-processing devices to form a pre-processing device cluster, where the multiple pre-processing devices are pre- The processing device cluster is in a side-by-side relationship.
- control device may further include: determining, by the control device, the pre-processing device corresponding to the file type according to the file type of the slice media file.
- the preprocessing device that selects the subtitle processing processes the source slice file including the subtitle, and the preprocessing device pair that selects the video processing does not include The source slice file of the subtitle is processed.
- the source slice media file is processed according to the screen region processing result
- the obtained target slice media file may include: the transcoding device acquiring the key region in the frame image included in the source slice media file according to the screen region processing result; Perform the first operation on the critical area and perform the second operation on the other areas except the critical area.
- the source slice media file is processed according to the screen region processing result
- the obtained target slice media file may include: the transcoding device acquires the key time segment included in the source slice media file according to the screen region processing result, and the critical time The segment performs the first operation and performs a second operation on other time periods than the critical time period.
- the critical time period may be one or more segments in the source slice media file
- the first operation may be to increase the code rate
- the second operation may be to reduce the code rate.
- the screen area processing result indicates the 3rd to 7th second of the source slice media file
- the 11th second to the 14th second is the key time period
- the other time periods are non-critical time segments
- the source slice file can be Files from the 3rd to 7th and 11th to 14th are increased in bit rate, and files in other non-critical time periods are reduced in bit rate.
- first operation is to improve the code rate
- second operation is to reduce the code rate, which is only an optional operation, which is not specifically limited in this embodiment.
- the source slice media file in the source multimedia file to be processed and the slice pre-processing result matched with the source slice media file are obtained by the transcoding device, and the storage address is obtained according to the storage address indicated in the slice pre-processing result.
- Each source slice media file in the file is processed to obtain a target slice media file, and the purpose of intelligently analyzing and processing each slice media file in the source multimedia file is realized. Therefore, the problem that the entire source multimedia file can only be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- the foregoing apparatus further includes:
- the fourth obtaining unit is configured to acquire a slice pre-processing task corresponding to the source slice media file before acquiring the source slice media file in the source multimedia file to be processed;
- the first sending unit is configured to send the source slice media file and the slice pre-processing task to the pre-processing device, so that the pre-processing device performs key area recognition on the frame picture included in the source slice media file according to the pre-processing task, and saves and identifies The obtained picture area processing result.
- the slice preprocessing task corresponding to the source slice media file is obtained and passed.
- the pre-processing device performs key area identification on the frame picture in the source slice file, so that in the process of processing the source slice file, the processing strategy of the source slice file is determined, and the effect of flexible processing on the source slice media file is realized.
- the foregoing apparatus further includes:
- a determining unit configured to: before sending the source slice media file and the slice preprocessing task to the preprocessing device, determine, from the preprocessing device cluster, a preprocessing device corresponding to the source slice media file, where the source in the source multimedia file
- the ratio of the number of sliced media files to the number of pre-processing devices in the pre-processing device cluster is N:M, N is a natural number greater than 1, and M is a natural number greater than 1.
- the preprocessing device corresponding to the source slice media file is determined from the preprocessing device cluster, thereby ensuring that each source slice media file has a preprocessing device for processing, and There are multiple devices, which improves the processing efficiency of the source slice media files.
- the foregoing processing unit includes:
- Obtaining a module configured to obtain a key area in a frame picture included in the source slice media file according to the picture area processing result
- the execution module is configured to perform a first operation on the key area, and perform a second operation on the area other than the critical area in the frame picture included in the source slice media file, where the first operation and the second operation are different operations.
- the key area in the frame picture included in the source slice media file is obtained according to the screen area processing result, and the first operation is performed on the key area, and the second operation is performed on the other area, thereby realizing the source slice media.
- Different areas of the file perform different operations, improving the flexibility of processing source-slice media files.
- the foregoing execution module includes:
- a first execution submodule configured to perform an encoding processing operation on the key area according to the first code rate
- a second execution sub-module configured to perform an encoding processing operation according to a second code rate on other areas except the key area in the frame picture
- the first code rate is higher than the second code rate.
- the encoding processing operation is performed according to the first code rate for the key area; the encoding processing operation is performed according to the second code rate for the other areas except the key area in the frame picture, thereby realizing the source slice media file.
- the different areas perform different operations to make the display rate of different areas different, which improves the flexibility of processing the source slice media files.
- the foregoing apparatus further includes:
- the merging unit is configured to process the source slice media file according to the processing result of the screen area, and obtain the target slice media file corresponding to each source slice media file included in the source multimedia file after the processed target slice media file is obtained. Performing a merge to obtain a target multimedia file corresponding to the source multimedia file;
- the second sending unit is configured to send the target multimedia file to the playing client for playing.
- the target multimedia file corresponding to the source multimedia file is obtained, and the target multimedia file is sent to the playback client.
- the terminal plays, thereby ensuring that after the process of processing the source slice media file, the complete target multimedia file can be obtained, and the processing accuracy of the source slice media file is improved.
- the above multimedia file processing apparatus will be described in detail below with reference to FIG. As shown in Fig. 7, in the related art, the portion enclosed by the broken line frame is not included.
- the source multimedia file is obtained, the source slice media file 1 to the source slice media file n are obtained according to the source multimedia file, where n is a natural number greater than 1.
- the source slice media file 1-n is sent to the transcoding device 1-n, and the source slice media file 1-n is transcoded by the transcoding device 1-n to obtain the transcoded media file 1-n, and will be transferred.
- the media files 1-n are merged into the transcoded multimedia files.
- this method only transcoding of the source multimedia file is done.
- the obtained source slice media file 1-n is sent to the pre-processing device 1 to the pre-processing device m through the steps in the dotted line frame.
- m is a natural number greater than one.
- the pre-processing device 1-m receives the slice pre-processing task 1 to the slice pre-processing task n allocated for each source slice media file, and analyzes the source slice media file 1-n according to the received slice pre-processing task 1-n. The result of the screen area processing of each source slice media file. After the picture area processing result of each source slice media file is acquired, the picture area processing result 1-n is transmitted to the transcoding device 1-n.
- the transcoding device 1-n transcodes the source slice media files 1-n according to the picture area processing result 1-n to obtain the target slice media files 1-n, and merges the target slice media files to obtain the target multimedia file.
- the number of the above transcoding devices may not be n.
- the following two situations are met:
- the meta-slice media files are directly processed by the transcoding device; when the number of source-slice media files is greater than the number of transcoding devices, the redundant source-slice media files are queued for processing. .
- each source slice file obtains a picture area processing result
- each source slice media file in the source multimedia file can be processed according to the picture area processing result, and the target slice media file is obtained, and the pair is realized.
- Each sliced media file in the source multimedia file is intelligently analyzed and processed. Therefore, the problem that the entire source multimedia file can only be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- modules and units may be, but are not limited to, the same device or different devices, which is not specifically limited in this embodiment.
- a multimedia file processing apparatus for implementing the above multimedia file processing method is further provided, wherein the multimedia file processing apparatus may be a pre-processing device or disposed in a pre-processing device, as shown in FIG.
- the above multimedia file processing apparatus includes:
- the first obtaining unit 1002 is configured to acquire a source slice media file in the source multimedia file to be processed
- the second obtaining unit 1004 is configured to acquire a slice pre-processing task corresponding to the source slice media file.
- the third obtaining unit 1006 is configured to obtain, according to the slice pre-processing task, a picture region processing result that matches the source slice media file;
- the sending unit 1008 is configured to send the screen area processing result to the transcoding device, so that the transcoding device processes the source slice media file according to the screen area processing result, and obtains the processed target slice media file.
- the above multimedia file processing apparatus may be, but is not limited to, applied to a scene in which a video file is processed.
- the preprocessing device acquires a source slice media file in the source multimedia file to be processed, and a slice preprocessing task corresponding to the source slice media file, and acquires a screen region processing result that matches the source slice media file according to the slice preprocessing task;
- the processing result of the above screen area is sent to the transcoding device, and the transcoding device processes the source slice media file according to the processing result of the screen area to obtain the processed target slice media file.
- the source slice media file in the source multimedia file to be processed may be obtained by the following steps:
- the source multimedia file to be processed is divided into a plurality of source slice media files according to a slice rule.
- the foregoing tiling rule may be to slice the media file according to a predetermined duration.
- a source multimedia file with a length of 10 minutes and 50 seconds starts from 0 minutes and 0 seconds of the source multimedia file, and is sliced every two minutes to cut the source multimedia file into 5 segments and two minutes of sliced media files and a length of 50.
- the sliced media file of the second; or the average segmentation method, the source multimedia file of 10 minutes and 50 seconds is equally divided into 5 segments, each segment being 2 minutes and 10 seconds long.
- the method for slicing the source media file according to the method of the predetermined duration or the average segment is only an example.
- the method for the source file slicing and the duration of the slice media file are not limited herein.
- the key areas on each of the above frames may be the same or different.
- the sending the screen area processing result to the transcoding device includes: the pre-processing device acquiring the acquisition request sent by the transcoding device, where the obtaining request carries a storage address for indicating a processing result of the screen area;
- the screen area processing result is sent to the transcoding device.
- the sending the screen area processing result to the transcoding device includes: after the preprocessing module performs key area identification on the source slice media file according to the preprocessing task, and the screen area processing result is obtained, the preprocessing device directly processes the screen area processing result. Send to the transcoding device.
- the method before acquiring the source slice media file in the source multimedia file to be processed, the method further includes: determining, from the pre-processing device cluster, a pre-processing device corresponding to the source slice media file, where the source in the source multimedia file
- the ratio of the number of sliced media files to the number of pre-processing devices in the pre-processing device cluster is N:M, N is a natural number greater than 1, and M is a natural number greater than 1.
- the ratio of the number of the source-slice media files to the number of pre-processing devices in the pre-processing device cluster is N: M may be one source-slice media file corresponding to one pre-processing device; one source-slice media file corresponds to multiple The preprocessing device; or the plurality of source slice media files correspond to one preprocessing device.
- the source slice media file in the source multimedia file to be processed and the slice pre-processing task corresponding to the source slice media file are obtained, and the image region matching the source slice media file is obtained according to the slice pre-processing task.
- the result is processed, and the processing result of the picture area is processed by the transcoding device to obtain the target slice media file, thereby realizing the purpose of intelligently analyzing and processing each slice media file in the source multimedia file.
- the invention solves the problem that only the entire source multimedia file can be intelligently analyzed in the related art, and the processing efficiency of processing the source multimedia file is improved.
- the foregoing third obtaining unit includes:
- the identification module is configured to perform key area identification on the frame picture included in the source slice media file according to the pre-processing task;
- the save module is set to save the recognition result of the screen area obtained.
- the key area in the source slice media file is identified and saved, and the result of the screen area processing is obtained, thereby achieving the purpose of performing different operations on different areas in the source slice media file, and improving the source slice media file.
- the sending unit includes:
- the obtaining module is configured to obtain an obtaining request sent by the transcoding device, where the obtaining request carries a storage address for indicating a processing result of the screen area;
- the sending module is configured to send the processing result of the screen area in the storage address to the transcoding device.
- the storage address of the processing result of the screen region is stored on the server, thereby reducing the storage address. The burden of preprocessing equipment.
- the foregoing apparatus further includes:
- the determining unit is configured to: before acquiring the source slice media file in the source multimedia file to be processed and the slice pre-processing task corresponding to the source slice media file, determine, from the pre-processing device cluster, a pre-corresponding to the source slice media file
- the processing device wherein the ratio of the number of source slice media files in the source multimedia file to the number of pre-processing devices in the pre-processing device cluster is N:M, N is a natural number greater than 1, and M is a natural number greater than 1.
- the preprocessing device corresponding to the source slice media file is determined from the preprocessing device cluster, thereby ensuring that each source slice media file has a preprocessing device for processing, and There are multiple devices, which improves the processing efficiency of the source slice media files.
- the above multimedia file processing apparatus will be described in detail below with reference to FIG. As shown in Fig. 7, in the related art, the portion enclosed by the broken line frame is not included.
- the source multimedia file is obtained, the source slice media file 1 to the source slice media file n are obtained according to the source multimedia file, where n is a natural number greater than 1.
- the source slice media file 1-n is sent to the transcoding device 1-n, and the source slice media file 1-n is transcoded by the transcoding device 1-n to obtain the transcoded media file 1-n, and will be transferred.
- the media files 1-n are merged into the transcoded multimedia files.
- this method only transcoding of the source multimedia file is done.
- the obtained source slice media file 1-n is sent to the pre-processing device 1 to the pre-processing device m through the steps in the dotted line frame.
- m is a natural number greater than one.
- the pre-processing device 1-m receives the slice pre-processing task 1 to the slice pre-processing task n allocated for each source slice media file, and analyzes the source slice media file 1-n according to the received slice pre-processing task 1-n. The result of the screen area processing of each source slice media file. After the picture area processing result of each source slice media file is acquired, the picture area processing result 1-n is transmitted to the transcoding device 1-n.
- the transcoding device 1-n transcodes the source slice media files 1-n according to the picture area processing result 1-n to obtain the target slice media files 1-n, and merges the target slice media files to obtain the target multimedia file.
- the number of the above transcoding devices may not be n.
- the following two situations are met:
- the meta-slice media files are directly processed by the transcoding device; when the number of source-slice media files is greater than the number of transcoding devices, the redundant source-slice media files are queued for processing. .
- each source slice file obtains a picture area processing result
- each source slice media file in the source multimedia file can be processed according to the picture area processing result, and the target slice media file is obtained, and the pair is realized.
- Each sliced media file in the source multimedia file is intelligently analyzed and processed. Therefore, the problem that the entire source multimedia file can only be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- modules and units may be, but are not limited to, the same device or different devices, which is not specifically limited in this embodiment.
- a multimedia file processing system is further provided. As shown in FIG. 11, the multimedia file processing system includes:
- the control device 1102 is configured to slice the source multimedia file to be processed to obtain a source slice media file.
- the pre-processing device 1104 is configured to acquire a source slice media file and a slice pre-processing task corresponding to the source slice media file, and further configured to acquire a picture region processing result that matches the source slice media file according to the slice pre-processing task;
- the transcoding device 1106 is configured to obtain a source slice media file and a slice pre-processing result that matches the source slice media file, where the slice pre-processing result is used to indicate a storage address of the screen region processing result in the pre-processing device; Obtaining a screen region processing result that matches the source slice media file from the storage address; and further processing the source slice media file according to the screen region processing result to obtain the processed target slice media file.
- the above multimedia file processing system may be, but is not limited to, applied to a scene in which a video file is processed.
- the transcoding device obtains the source slice media file in the source multimedia file, and processes each source slice media file according to the processing result of the screen area to obtain the processed target slice file, thereby implementing the source slice media file for each source.
- the invention solves the problem that the related technology can only perform intelligent analysis on the entire source multimedia file, and improves the intelligent analysis efficiency of the source multimedia file and the processing efficiency of the source multimedia file.
- the above multimedia file processing system will be described in detail below with reference to FIG. As shown in Fig. 7, in the related art, the portion enclosed by the broken line frame is not included.
- the source multimedia file is obtained, the source slice media file 1 to the source slice media file n are obtained according to the source multimedia file, where n is a natural number greater than 1. Then, the source slice media file 1-n is sent to the transcoding device 1-n, and the source slice media file 1-n is transcoded by the transcoding device 1-n to obtain the transcoded media file 1-n, and will be transferred. After the code, the media files 1-n are merged into the transcoded multimedia files.
- this method only transcoding of the source multimedia file is done.
- the obtained source slice media file 1-n is sent to the pre-processing device 1 to the pre-processing device m through the steps in the dotted line frame.
- m is a natural number greater than one.
- the pre-processing device 1-m receives the slice pre-processing task 1 to the slice pre-processing task n allocated for each source slice media file, and analyzes the source slice media file 1-n according to the received slice pre-processing task 1-n. The result of the screen area processing of each source slice media file. After the picture area processing result of each source slice media file is acquired, the picture area processing result 1-n is transmitted to the transcoding device 1-n.
- the transcoding device 1-n transcodes the source slice media files 1-n according to the picture area processing result 1-n to obtain the target slice media files 1-n, and merges the target slice media files to obtain the target multimedia file.
- the number of the above transcoding devices may not be n.
- the following two situations are met:
- the meta-slice media files are directly processed by the transcoding device; when the number of source-slice media files is greater than the number of transcoding devices, the redundant source-slice media files are queued for processing. .
- each source slice file obtains a picture area processing result
- each source slice media file in the source multimedia file can be processed according to the picture area processing result, and the target slice media file is obtained, and the pair is realized.
- Each sliced media file in the source multimedia file is intelligently analyzed and processed. Therefore, the problem that the entire source multimedia file can only be intelligently analyzed in the related art is solved, and the processing efficiency of processing the source multimedia file is improved.
- a storage medium having stored therein a computer program, wherein the computer program is configured to execute all or part of any one of the foregoing method embodiments at runtime step.
- the above storage medium may be configured to store a computer program for performing the following steps:
- S2 Obtain a slice pre-processing result that matches the source slice media file, where the slice pre-processing result is used to indicate a storage address of the picture region processing result that matches the source slice media file in the pre-processing device;
- the above storage medium may be configured to store a computer program for performing the following steps:
- S4 Send the screen area processing result to the transcoding device, so that the transcoding device processes the source slice media file according to the screen area processing result, and obtains the processed target slice media file.
- the storage medium is further configured to store a computer program for performing the steps included in the method in the above embodiments, which will not be described in detail in this embodiment.
- an electronic device for implementing the above multimedia file processing method includes: a memory and a processor, where the computer program is stored in the memory.
- the processor is arranged to perform the steps of any of the above method embodiments by a computer program.
- the foregoing electronic device may be located in at least one network device of the plurality of network devices of the computer network.
- the foregoing processor may be configured to perform the following steps by using a computer program:
- S2 Obtain a slice pre-processing result that matches the source slice media file, where the slice pre-processing result is used to indicate a storage address of the picture region processing result that matches the source slice media file in the pre-processing device;
- the above processor may be configured to perform the following steps by a computer program:
- S4 Send the screen area processing result to the transcoding device, so that the transcoding device processes the source slice media file according to the screen area processing result, and obtains the processed target slice media file.
- FIG. 12 is only schematic, and the electronic device can also be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palm computer, and a mobile Internet device (Mobile). Terminal devices such as Internet Devices, MID) and PAD.
- FIG. 12 does not limit the structure of the above electronic device.
- the electronic device may also include more or less components (such as a network interface, etc.) than shown in FIG. 12, or have a different configuration than that shown in FIG.
- the memory 1204 can be used to store software programs and modules, such as the multimedia file processing method, apparatus, and program instructions/modules corresponding to the system in the embodiment of the present application.
- the processor 1202 runs the software programs and modules stored in the memory 1204. Thereby, various functional applications and data processing are performed, that is, the above-described multimedia file processing method is implemented.
- Memory 1204 can include high speed random access memory, and can also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
- memory 1204 can further include memory remotely located relative to processor 1202, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- the user interface 1206 described above is for receiving or transmitting data via a network.
- Specific examples of the above network may include a wired network and a wireless network.
- the user interface 1206 includes a Network Interface Controller (NIC) that can be connected to other network devices and routers via a network cable to communicate with the Internet or a local area network.
- NIC Network Interface Controller
- user interface 1206 is a Radio Frequency (RF) module for communicating with the Internet wirelessly.
- RF Radio Frequency
- the storage medium may include a flash disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like.
- the integrated unit in the above embodiment if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in the above-described computer readable storage medium.
- the technical solution of the present application may be embodied in the form of a software product, or the whole or part of the technical solution, which is stored in the storage medium, including
- the instructions are used to cause one or more computer devices (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.
- the disclosed client may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the unit is only a logical function division.
- multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
- the source slice media file in the source multimedia file to be processed is obtained, and a slice pre-processing result matching the source slice media file is obtained, where the slice pre-processing result is used to indicate that the source slice media file is matched.
- the screen area processing result is a storage address in the preprocessing device; the screen area processing result matching the source slice media file is obtained from the storage address; the source slice media file is processed according to the screen area processing result, and the processed target slice medium is obtained.
- the source multimedia file to be processed is sliced to obtain a source slice media file, and the plurality of source slice media files are synchronously processed by the distributed transcoding device and the distributed preprocessing device, thereby overcoming the related technology only for the entire source multimedia file.
- the problem of low processing efficiency caused by intelligent analysis is realized, thereby improving the efficiency of intelligent processing of source multimedia files.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Image Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请公开一种多媒体文件处理方法和装置、存储介质及电子装置。其中,该方法包括:转码设备获取待处理的源多媒体文件中的源切片媒体文件;转码设备获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;转码设备从存储地址获取与源切片媒体文件匹配的画面区域处理结果;转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。本申请解决了相关技术提供的多媒体文件处理方法存在的处理效率较低的技术问题。
Description
本申请要求于2018年03月28日提交中国专利局、优先权号为2018102651912、申请名称为“多媒体文件处理方法和装置、存储介质及电子装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及计算机领域,具体而言,涉及一种多媒体文件处理方法和装置、存储介质及电子装置。
为了降低高清晰度的多媒体文件的传输码流,相关技术提供了一种针对待传输的多媒体文件的智能化处理方法。例如,对获取到的源多媒体文件中的数据帧画面进行识别,获取该数据帧画面中重要的区域,保持上述重要的区域的高清晰度,而对其他区域降低其清晰度,从而达到降低多媒体文件的传输码流的目的。
然而,在上述智能化处理过程中,只能针对整个源多媒体文件进行智能化分析,在获取到关于整个源多媒体文件的智能化分析的结果之后,才可以对源多媒体文件执行进一步处理。其中,智能化分析通常需要对多媒体文件进行深度学习,学习过程非常耗时,导致对多媒体文件的处理速度受到很大影响,从而造成对多媒体文件的处理效率较低的问题。
针对上述的问题,目前尚未提出有效的解决方案。
发明内容
本申请实施例提供了一种多媒体文件处理方法和装置、存储介质及电子装置,以至少解决相关技术提供的多媒体文件处理方法存在的处理效率 较低的技术问题。
根据本申请实施例的一个方面,提供了一种文件处理方法,包括:转码设备获取待处理的源多媒体文件中的源切片媒体文件;转码设备获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;转码设备从存储地址获取与源切片媒体文件匹配的画面区域处理结果;转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
根据本申请实施例的另一个方面,还提供了一种文件处理方法,包括:预处理设备获取待处理的源多媒体文件中的源切片媒体文件;预处理设备获取与上述源切片媒体文件对应的切片预处理任务;预处理设备根据上述切片预处理任务获取与上述源切片媒体文件匹配的画面区域处理结果;预处理设备将上述画面区域处理结果发送给转码设备,以使上述转码设备根据上述画面区域处理结果对上述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
根据本申请实施例的又一方面,还提供了一种文件处理装置,应用于转码设备中,包括:第一获取单元,设置为获取待处理的源多媒体文件中的源切片媒体文件;第二获取单元,设置为获取与上述源切片媒体文件匹配的切片预处理结果,其中,上述切片预处理结果用于指示与上述源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;第三获取单元,设置为从上述存储地址获取与上述源切片媒体文件匹配的上述画面区域处理结果;处理单元,设置为根据上述画面区域处理结果对上述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
其中,上述处理单元包括:获取模块,设置为根据上述画面区域处理结果获取上述源切片媒体文件所包含的帧画面中的关键区域;执行模块,设置为对上述关键区域执行第一操作,对上述源切片媒体文件所包含的上述帧画面中除上述关键区域之外的其他区域执行第二操作,其中,上述第 一操作与上述第二操作为不同操作。
其中,上述执行模块包括:第一执行子模块,设置为对上述关键区域按照第一码率执行编码处理操作;第二执行子模块,设置为对上述帧画面中除上述关键区域之外的上述其他区域按照第二码率执行编码处理操作;其中,上述第一码率高于上述第二码率。
其中,上述装置还包括:合并单元,设置为在上述根据上述画面区域处理结果对上述源切片媒体文件进行处理,得到处理后的目标切片媒体文件之后,将与上述源多媒体文件中所包含的各个源切片媒体文件分别对应的上述目标切片媒体文件进行合并,得到与上述源多媒体文件对应的目标多媒体文件;发送单元,设置为将上述目标多媒体文件发送至播放客户端进行播放。
根据本申请实施例的又一方面,还提供了一种文件处理装置,应用于预处理设备中,包括:第一获取单元,设置为获取待处理的源多媒体文件中的源切片媒体文件;第二获取单元,设置为与上述源切片媒体文件对应的切片预处理任务;第三获取单元,设置为根据上述切片预处理任务获取与上述源切片媒体文件匹配的画面区域处理结果;发送单元,设置为将上述画面区域处理结果发送给转码设备,以使上述转码设备根据上述画面区域处理结果对上述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
其中,上述第三获取单元包括:识别模块,设置为根据上述预处理任务对上述源切片媒体文件所包含的帧画面进行关键区域识别;保存模块,设置为保存识别得到的上述画面区域处理结果。
其中,上述发送单元包括:获取模块,设置为获取上述转码设备发送的获取请求,其中,上述获取请求中携带有用于指示上述画面区域处理结果的存储地址;发送模块,设置为将上述存储地址中的上述画面区域处理结果发送给上述转码设备。
根据本申请实施例的又一方面,还提供了一种存储介质,该存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述文件处理方法。
根据本申请实施例的又一方面,还提供了一种电子装置,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,上述处理器通过计算机程序执行上述的文件处理方法。
根据本申请实施例的又一方面,还提供了一种文件处理系统,包括:控制设备,设置为对待处理的源多媒体文件进行切片,得到源切片媒体文件;预处理设备,设置为获取上述源切片媒体文件及与上述源切片媒体文件对应的切片预处理任务;还设置为根据上述切片预处理任务获取与上述源切片媒体文件匹配的画面区域处理结果;转码设备,设置为获取上述源切片媒体文件及与上述源切片媒体文件匹配的切片预处理结果,其中,上述切片预处理结果用于指示在上述预处理设备中上述画面区域处理结果的存储地址;还用于从上述存储地址获取与上述源切片媒体文件匹配的上述画面区域处理结果;还用于根据上述画面区域处理结果对上述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
在本申请实施例中,通过转码设备获取待处理的源多媒体文件中的源切片媒体文件;转码设备获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;转码设备从存储地址获取与源切片媒体文件匹配的画面区域处理结果;转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件的方法,达到了获取与源切片媒体文件匹配的画面区域处理结果,并根据画面区域处理结果直接对源切片媒体文件进行处理的目的。通过对待处理的源多媒体文件进行切片,得到源切片媒体文件,通过分布式转码设备和分布式预处理设备对多个源切片媒体文件进行同步处理,克服了相关技术中仅仅针对整个源多媒体文件进行智能化分析所导致的处理效率较低的问题,从而实现提高对源 多媒体文件智能化处理的效率。
此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:
图1是根据本申请实施例的一种可选的多媒体文件处理方法的应用环境的示意图;
图2是根据本申请实施例的一种可选的多媒体文件处理方法的流程示意图;
图3是根据本申请实施例的一种可选的多媒体文件处理方法的示意图;
图4是根据本申请实施例的另一种可选的多媒体文件处理方法的示意图;
图5是根据本申请实施例的又一种可选的多媒体文件处理方法的示意图;
图6是根据本申请实施例的又一种可选的多媒体文件处理方法的示意图;
图7是根据本申请实施例的又一种可选的多媒体文件处理方法的示意图;
图8是根据本申请实施例的另一种可选的多媒体文件处理方法的示意图;
图9是根据本申请实施例的一种可选的多媒体文件处理装置的结构示意图;
图10是根据本申请实施例的另一种可选的多媒体文件处理装置的结构示意图;
图11是根据本申请实施例的一种可选的多媒体文件处理系统的示意图
图12是根据本申请实施例的一种可选的电子装置的结构示意图。
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分的实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。
需要说明的是,本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
根据本申请实施例的一个方面,提供了一种多媒体文件处理方法。可选地,上述多媒体文件处理方法可以但不限于应用于多媒体文件处理系统,该系统的应用环境如图1所示。其中,在该应用环境中:服务器106将源多媒体文件切成源切片媒体文件,并将原切片媒体文件发送给预处理设备102和转码设备104。预处理设备102通过步骤S102获取与源切片媒体文件对应的切片预处理任务,并通过步骤S104根据切片预处理任务获取与原切片媒体文件匹配的画面区域处理结果,通过步骤S106将画面区域处理结果发送给转码设备104。转码设备104通过步骤S108获取源切片媒体文件,并通过步骤S110获取到画面区域处理结果,通过步骤S112根据 画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。并通过步骤S114将目标切片媒体文件发送给服务器106,服务器106将目标切片媒体文件组合为目标多媒体文件,并发送给终端108,终端108接收到目标多媒体文件后播放。
在本实施例中,预处理设备对源切片媒体文件进行预处理,得到切片预处理结果,其中,该切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;转码设备根据上述从预处理设备中的存储地址获取到的画面区域处理结果,对每一个源切片媒体文件进行处理,得到处理后的目标切片文件,从而实现了对待处理的源多媒体文件进行切片,得到源切片媒体文件,通过分布式硬件设备(如转码设备和预处理设备)对多个源切片媒体文件进行同步处理,以克服相关技术中仅仅针对整个源多媒体文件进行智能化分析所导致的处理效率较低的问题,从而实现提高对源多媒体文件智能化处理的效率。
可选地,在本实施例中,上述多媒体文件处理系统可以包括但不限于:转码设备、预处理设备、控制设备等硬件设备,上述硬件设备可以包括但不限于具有数据处理能力的硬件设备。上述网络可以包括但不限于以下至少之一:广域网、城域网、局域网。上述只是一种示例,本实施例对此不做任何限定。
可选地,在本实施例中,如图2所示,该方法可以包括:
S202,转码设备获取待处理的源多媒体文件中的源切片媒体文件;
S204,转码设备获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示在预处理设备中与源切片媒体文件匹配的画面区域处理结果的存储地址,预处理设备用于获取画面区域处理结果;
S206,转码设备从存储地址获取与源切片媒体文件匹配的画面区域处理结果;
S208,转码设备根据画面区域处理结果对源切片媒体文件进行处理, 得到处理后的目标切片媒体文件。
可选地,上述多媒体文件处理方法可以但不限于应用于对多媒体文件进行高效转码发送的场景中。控制设备将源多媒体文件中的源切片媒体文件发送给转码设备和预处理设备,预处理设备对源切片媒体文件进行预处理,得到切片预处理结果,其中,该切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;转码设备根据上述从预处理设备中的存储地址获取到的画面区域处理结果,对每一个源切片媒体文件进行处理,得到处理后的目标切片文件,从而实现了对待处理的源多媒体文件进行切片,得到源切片媒体文件,通过分布式硬件设备(如转码设备和预处理设备)对多个源切片媒体文件进行同步处理,以克服相关技术中仅仅针对整个源多媒体文件进行智能化分析所导致的处理效率较低的问题,从而实现提高对源多媒体文件智能化处理的效率。
可选地,上述待处理的源多媒体文件中的源切片媒体文件可以通过以下步骤获取:拆分服务器将待处理的源多媒体文件切分成多个源切片媒体文件。
其中,上述拆分服务器用于将源多媒体文件切成源切片媒体文件,并将原切片媒体文件发送给预处理设备与转码设备。
可选地,上述切片可以但不限于按照预定时长对源多媒体文件进行切片。例如,一个长10分50秒的源多媒体文件,从源多媒体文件的0分0秒处开始,每隔两分钟切片一次,将源多媒体文件切成5段两分钟的切片媒体文件和一段长50秒的切片媒体文件;或者按照平均分段的方法,将长10分50秒的源多媒体文件平均分成5段,每一段长2分10秒。
需要说明的是,上述按照预定时长或者平均分段的方法对源媒体文件进行切片仅仅为一种示例,具体对源文件切片的方法及切片媒体文件的时长本实施例在此不做限定。
可选地,在转码设备获取待处理的源多媒体文件中的源切片媒体文件 之前,控制设备还可以将源切片媒体文件对应的切片预处理任务发送给预处理设备,预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别,并保存识别得到的画面区域处理结果。
可选地,在将切片预处理任务发送预处理设备之前控制设备还可以从预处理设备集群中确定源切片媒体文件对应的预处理设备。
可选地,在从预处理设备集群中确定源切片媒体文件对应的预处理设备之前,还可以包括:控制设备设置多台预处理设备组成预处理设备集群,其中,多台预处理设备在预处理设备集群中处于并列关系。
可选地,在从预处理设备集群中确定源切片媒体文件对应的预处理设备之前,还可以包括,控制设备根据切片媒体文件的文件类型,确定与文件类型对应的预处理设备。
例如,源切片文件的文件类型为包含字幕类型与不包含字幕类型,则选择对字幕进行处理的预处理设备对包含字幕的源切片文件进行处理,选择对视频进行处理的预处理设备对不包含字幕的源切片文件进行处理。
需要说明的是,上述从预处理设备集群中确定源切片媒体文件对应的预处理设备的方法仅为一种可选的示例,并不构成对本申请权利要求的限定。
可选地,转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件可以包括:转码设备根据画面区域处理结果获取源切片媒体文件包含的帧画面中的关键区域;转码设备对关键区域执行第一操作,对除关键区域外的其他区域执行第二操作。
可选地,转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件可以包括:转码设备根据画面区域处理结果获取源切片媒体文件包含的关键时间段,对关键时间段执行第一操作,对除关键时间段外的其他时间段执行第二操作。
可选地,关键时间段可以为源切片媒体文件中的一段或几段,第一操 作可以为提高码率,第二操作可以为降低码率。例如,画面区域处理结果中指示源切片媒体文件的第3秒到第7秒,第11秒到第14秒为关键时间段,其他时间段为非关键时间段,则可以将源切片文件中的第3秒到第7秒与第11秒到14秒的文件提高码率,其他非关键时间段的文件降低码率。
需要说明的是,上述第一操作为提高码率,第二操作为降低码率仅为一种可选的操作,本实施例对此不做具体限定。
通过本申请实施例,通过转码设备获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件匹配的切片预处理结果,根据切片预处理结果中指示的存储地址获取与源切片媒体文件匹配的画面区域处理结果,并根据画面区域处理结果对源切片媒体文件进行处理的方法,通过为每一个源切片文件获得一个画面区域处理结果,从而可以根据画面区域处理结果对源多媒体文件中的每一个源切片媒体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
作为一种可选的实施方案,在转码设备获取待处理的源多媒体文件中的源切片媒体文件之前,还包括:
S1,控制设备获取与源切片媒体文件对应的切片预处理任务;
S2,控制设备将与源切片媒体文件对应的切片预处理任务发送至预处理设备,以使预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别,并保存识别得到的画面区域处理结果。
可选地,上述切片预处理任务可以为对源切片媒体文件的每一帧中的画面进行分析,得到每一帧中的画面的关键区域,并将关键区域保存在画面区域处理结果中。
例如,结合图3进行说明。图3为一个源切片媒体文件中的一帧。如图3所示,源切片媒体文件长20分钟。在接收到源切片媒体文件与切片 预处理任务后,根据切片预处理任务,对源切片媒体文件中的每一帧进行分析,分析每一帧中的关键区域。图3中使用虚线框标识了关键区域。并将每一帧识别出的关键区域保存到画面区域处理结果中。
需要说明的是,对于确定关键区域的依据,本实施例不做具体限定。例如,可以通过源切片媒体文件中的图像的颜色、形状、特定图像等来确定关键区域,或者将带有字幕的区域确定为关键区域等。
通过本实施例,通过在获取待处理的源多媒体文件中的源切片媒体文件之前,获取与源切片媒体文件对应的切片预处理任务,并通过预处理设备对源切片文件中的帧画面进行关键区域识别,从而在对源切片文件进行处理的过程中,确定对源切片文件的处理策略,实现了对源切片媒体文件进行灵活处理的效果。
作为一种可选的实施方案,在将与源切片媒体文件对应的切片预处理任务发送至预处理设备之前,还包括:
S1,控制设备从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,其中,源多媒体文件中的源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
可选地,上述源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M可以为一个源切片媒体文件对应一个预处理设备;或者多个源切片媒体文件对应一个预处理设备。
可选地,上述从预处理设备集群中确定源切片媒体文件对应的预处理设备可以为:将N个源切片媒体文件平均分配给M个预处理设备。
例如,结合图4进行说明,图4中显示有4个源切片媒体文件。当对4个源切片媒体文件进行分配时,按照顺序分配给预处理设备1与预处理设备2。即,将源切片媒体文件1分配给预处理设备1;将源切片媒体文件2分配给预处理设备2;将源切片媒体文件3分配给预处理设备1;将 源切片媒体文件4分配给预处理设备2。如果有源切片媒体文件5,则又分配给源切片媒体文件1。
需要说明的是,本实施例对源切片媒体文件的数量与预处理设备的数量不做具体限定。
可选地,上述从预处理设备集群中确定源切片媒体文件对应的预处理设备可以为:在分配每一个源切片媒体文件时,将该源切片媒体文件分配给当前源切片媒体文件最少的预处理设备。
例如,结合图5进行说明,预处理设备1中有源切片媒体文件1、3,预处理设备2中有源切片媒体2。当要分配源切片媒体文件4时,将源切片媒体文件4分配给源切片媒体文件少的预处理设备2。在分配源切片媒体文件5时,由于预处理设备1与预处理设备2中的源切片媒体文件数目一致,因此可以采用顺序分配或者随机分配的方法。
需要说明的是,本实施例对源切片媒体文件的数量与预处理设备的数量不做具体限定。上述源切片媒体文件的分配方法仅为一种可选示例,本实施例对此不做具体限定。
通过本申请实施例,通过从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,从而保证了每一个源切片媒体文件都会有一个预处理设备对其进行处理,且由于预处理设备有多个,从而提高了对源切片媒体文件的处理效率。
作为一种可选的实施方案,转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件包括:
S1,转码设备根据画面区域处理结果获取源切片媒体文件所包含的帧画面中的关键区域;
S2,转码设备对关键区域执行第一操作,对源切片媒体文件所包含的帧画面中除关键区域之外的其他区域执行第二操作,其中,第一操作与第二操作为不同操作。
可选地,上述操作可以为改变源切片媒体文件中的关键区域的码率,或者为对关键区域进行渲染等。例如,第一操作为使用第一参数对上述关键区域的图像进行渲染;第二操作为使用第二参数对上述关键区域的图像进行渲染。其中,第一参数与第二参数不同。
可选地,上述第一参数与第二参数可以包括图像的颜色、饱和度等参数。
可选地,源切片媒体文件中的每一帧可以包含相同或不同的关键区域。
具体结合图6进行说明。如图6所示,在一个源切片媒体文件的一帧中,将显示有人、汽车等位置确定为关键区域,以及将显示字幕的区域确定为关键区域,用虚线圈起。将除虚线圈起的区域确定为其他区域,用阴影表示。从而可以对关键区域执行第一操作,对其他区域执行第二操作。
需要说明的是,对于确定关键区域的方法,本实施例不做具体限定。例如可以为:通过源切片媒体文件中的图像的颜色、形状、特定图像等来确定关键区域。
通过本实施例,通过转码设备根据画面区域处理结果获取源切片媒体文件所包含的帧画面中的关键区域,并对关键区域执行第一操作,对其他区域执行第二操作,从而实现了对源切片媒体文件中的不同区域执行不同操作的目的,提高了对源切片媒体文件进行处理的灵活性。
作为一种可选的实施方案,转码设备对关键区域执行第一操作,对源切片媒体文件所包含的帧画面中除关键区域之外的其他区域执行第二操作包括:
S1,转码设备对关键区域按照第一码率执行编码处理操作;
S2,转码设备对帧画面中除关键区域之外的其他区域按照第二码率执行编码处理操作;
其中,第一码率高于第二码率。
可选地,上述第一码率可以为超清码率,上述第二码率可以为高清码率。例如,继续结合图6进行说明。图6中已经确定出了关键区域与非关键区域。此时,将关键区域中的码率调整为超清码率,将其他区中的码率调整为高清码率,从而使关键区域中的人物、汽车与字幕更加清楚,同时由于其他区域为非超清码率,从而减小了源切片媒体文件的体积。
通过本实施例,通过转码设备对关键区域按照第一码率执行编码处理操作;对帧画面中除关键区域之外的其他区域按照第二码率执行编码处理操作,从而实现了对源切片媒体文件中的不同区域执行不同操作,以使不同区域的显示码率不同的目的,提高了对源切片媒体文件进行处理的灵活性。
作为一种可选的实施方案,在根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件之后,还包括:
S1,转码设备将与源多媒体文件中所包含的各个源切片媒体文件分别对应的目标切片媒体文件进行合并,得到与源多媒体文件对应的目标多媒体文件;
S2,转码设备将目标多媒体文件发送至播放客户端进行播放。
可选地,上述对目标切片媒体文件进行合并可以为根据各个目标切片媒体文件的起始时刻,确定目标切片媒体文件的顺序,根据目标切片媒体文件的顺序,将多个目标切片媒体文件合并成一个完整的目标多媒体文件,并将目标多媒体文件发送给播放客户端进行播放。
例如,有三个目标切片媒体文件,编号为1、2、3。三个目标切片媒体文件的起始时刻分别是0分0秒、4分0秒、2分0秒,因此,三个目标切片媒体文件的正确顺序应该为1、3、2。根据上述顺序,将三个目标切片媒体文件合并成一个目标多媒体文件,并将目标多媒体文件发送给播放客户端进行播放。
通过本实施例,通过转码设备将与源多媒体文件中所包含的各个源切 片媒体文件分别对应的目标切片媒体文件进行合并,得到与源多媒体文件对应的目标多媒体文件,并将目标多媒体文件发送至播放客户端进行播放,从而保证了在对源切片媒体文件进行处理的过程之后,可以得到完整的目标多媒体文件,提高了源切片媒体文件的处理准确度。
以下结合图7,对上述多媒体文件处理方法做整体说明。如图7所示,在相关技术中,不包含由虚线框所围住的部分。当获取到源多媒体文件时,根据源多媒体文件获取源切片媒体文件1到源切片媒体文件n,其中n为大于1的自然数。之后将源切片媒体文件1-n发送给转码设备1-n,由转码设备1-n对源切片媒体文件1-n进行转码,得到转码后媒体文件1-n,并将转码后媒体文件1-n合并为转码后多媒体文件。然而,使用该方法,仅仅做到了对源多媒体文件的转码。而本申请中,在获取到源切片媒体文件1-n后,通过虚线框中的步骤,将获取到的源切片媒体文件1-n发送到预处理设备1到预处理设备m中。其中,m为大于1的自然数。预处理设备1-m接收为每一个源切片媒体文件分配的切片预处理任务1到切片预处理任务n,并根据接收到的切片预处理任务1-n分析源切片媒体文件1-n,获得每一个源切片媒体文件的画面区域处理结果。当获取到每一个源切片媒体文件的画面区域处理结果后,将画面区域处理结果1-n发送到转码设备1-n。转码设备1-n根据画面区域处理结果1-n对源切片媒体文件1-n进行转码,得到目标切片媒体文件1-n,并将目标切片媒体文件进行合并,得到目标多媒体文件。
需要说明的是,上述转码设备可以不为n个,当上述转码设备不为n个时,有以下两种情况:
当源切片媒体文件数量小于等于转码设备数量时,直接通过转码设备对元切片媒体文件进行处理;当源切片媒体文件数量大于转码设备数量时,则多余的源切片媒体文件排队等待处理。
通过上述步骤,由于每一个源切片文件都获得了一个画面区域处理结果,从而可以根据画面区域处理结果对源多媒体文件中的每一个源切片媒 体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于可选实施例,所涉及的动作和模块并不一定是本申请所必须的。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例的方法。
根据本申请实施例的另一个方面,还提供了一种多媒体文件处理方法。可选地,上述多媒体文件处理方法可以但不限于应用于如图1所示的应用环境中,本实施例对上述执行动作的主体类型不做具体限定。
可选地,如图8所示,将上述方法应用到预处理设备中,该方法包括:
S802,预处理设备获取待处理的源多媒体文件中的源切片媒体文件;
S804,预处理设备获取源切片媒体文件对应的切片预处理任务;
S806,预处理设备根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;
S808,预处理设备将画面区域处理结果发送给转码设备,以使转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,上述多媒体文件处理方法可以但不限于应用于对视频文件进行处理的场景中。预处理设备获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件对应的切片预处理任务,并根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;将上述画面区域处理结果发送给转码设备,使转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,上述待处理的源多媒体文件中的源切片媒体文件可以通过以下步骤获取:拆分服务器将待处理的源多媒体文件按照切片规则切分成多段源切片媒体文件。
其中,上述拆分服务器用于将源多媒体文件切成源切片媒体文件,并将原切片媒体文件发送给预处理设备与转码设备。
可选地,上述切片规则可以为按照预定时长对媒体文件进行切片。例如,一个长10分50秒的源多媒体文件,从源多媒体文件的0分0秒处开始,每隔两分钟切片一次,将源多媒体文件切成5段两分钟的切片媒体文件和一段长50秒的切片媒体文件;或者按照平均分段的方法,将长10分50秒的源多媒体文件平均分成5段,每一段长2分10秒。
需要说明的是,上述按照预定时长或者平均分段的方法对源媒体文件进行切片仅仅为一种示例,具体对源文件切片的方法及切片媒体文件的时长本实施例在此不做限定。
可选地,在根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果包括:预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别,保存识别得到的画面区域处理结果。
可选地,上述每一帧上的关键区域可以相同也可以不同。
可选地,将画面区域处理结果发送给转码设备包括:预处理设备获取转码设备发送的获取请求,其中,获取请求中携带有用于指示画面区域处理结果的存储地址;预处理设备将存储地址中的画面区域处理结果发送给转码设备。
可选地,将画面区域处理结果发送给转码设备包括:预处理设备在预处理模块根据预处理任务对源切片媒体文件进行关键区域识别,得到画面区域处理结果后,直接将画面区域处理结果发送给转码设备。
可选地,在获取待处理的源多媒体文件中的源切片媒体文件之前,还包括:控制设备从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,其中,源多媒体文件中的源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
可选地,上述源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,这里可以为一个源切片媒体文件对应一个预处理设备;或者多个源切片媒体文件对应一个预处理设备。
通过本申请实施例,通过预处理设备获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件对应的切片预处理任务,并根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果,并通过转码设备对画面区域处理结果进行处理得到目标切片媒体文件,从而实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
作为一种可选的实施方案,预处理设备根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果包括:
S1,预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别;
S2,预处理设备保存识别得到的画面区域处理结果。
可选地,源切片媒体文件中的每一帧可以包含相同或不同的关键区域。
例如,结合图6进行说明。如图6所示,根据预处理任务对源切片媒体文件进行识别时,识别出图6中的画面中包含两个人物图像与一个汽车图像以及相应的字幕,则将人物图像与汽车图像以及字幕所在的位置确定为关键区域,并将识别结果保存到画面区域处理结果中。
通过本申请实施例,通过预处理设备识别源切片媒体文件中的关键区域并保存,得到画面区域处理结果,从而实现了对源切片媒体文件中的不同区域执行不同操作的目的,提高了对源切片媒体文件进行处理的灵活性。
作为一种可选的实施方案,预处理设备将画面区域处理结果发送给转码设备包括:
S1,预处理设备获取转码设备发送的获取请求,其中,获取请求中携带有用于指示画面区域处理结果的存储地址;
S2,预处理设备将存储地址中的画面区域处理结果发送给转码设备。
例如,当预处理设备得到画面区域处理结果后,将该画面区域处理结果保存,并将保存该画面区域处理结果的存储地址发送给服务器。由转码设备从服务器获取上述存储地址,并根据上述存储地址向预处理设备发送请求,请求获取存储在预处理设备中的画面区域处理结果。
通过本实施例,通过预处理设备获取转码设备发送的获取请求,并根据获取请求中的画面区域处理结果的存储地址获取画面区域处理结果,从而实现在服务器上存储画面区域处理结果的存储地址,减轻了预处理设备的负担。
作为一种可选的实施方案,在获取待处理的源多媒体文件中的源切片媒体文件之前,还包括:
S1,控制设备从预处理设备集群中确定出与源切片媒体文件对应的预 处理设备,其中,源多媒体文件中的源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
可选地,上述从预处理设备集群中确定源切片媒体文件对应的预处理设备可以为:将N个源切片媒体文件平均分配给M个预处理设备。
例如,结合图4进行说明,图4中显示有4个源切片媒体文件。当对4个源切片媒体文件进行分配时,按照顺序分配给预处理设备1与预处理设备2。即,将源切片媒体文件1分配给预处理设备1;将源切片媒体文件2分配给预处理设备2;将源切片媒体文件3分配给预处理设备1;将源切片媒体文件4分配给预处理设备2。如果有源切片媒体文件5,则又分配给源切片媒体文件1。
需要说明的是,本实施例对源切片媒体文件的数量与预处理设备的数量不做具体限定。
可选地,上述从预处理设备集群中确定源切片媒体文件对应的预处理设备可以为:在分配每一个源切片媒体文件时,将该源切片媒体文件分配给当前源切片媒体文件最少的预处理设备。
例如,结合图5进行说明,预处理设备1中有源切片媒体文件1、3,预处理设备2中有源切片媒体2。当要分配源切片媒体文件4时,将源切片媒体文件4分配给源切片媒体文件少的预处理设备2。在分配源切片媒体文件5时,由于预处理设备1与预处理设备2中的源切片媒体文件数目一致,因此可以采用顺序分配或者随机分配的方法。
需要说明的是,本实施例对源切片媒体文件的数量与预处理设备的数量不做具体限定。上述源切片媒体文件的分配方法仅为一种可选示例,本实施例对此不做具体限定。
通过本申请实施例,通过控制设备从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,从而保证了每一个源切片媒体文件都会有 一个预处理设备对其进行处理,且由于预处理设备有多个,从而提高了对源切片媒体文件的处理效率。
以下结合图7,对上述多媒体文件处理方法做整体说明。如图7所示,在相关技术中,不包含由虚线框所围住的部分。当获取到源多媒体文件时,根据源多媒体文件获取源切片媒体文件1到源切片媒体文件n,其中n为大于1的自然数。之后将源切片媒体文件1-n发送给转码设备1-n,由转码设备1-n对源切片媒体文件1-n进行转码,得到转码后媒体文件1-n,并将转码后媒体文件1-n合并为转码后多媒体文件。然而,使用该方法,仅仅做到了对源多媒体文件的转码。而本申请中,在获取到源切片媒体文件1-n后,通过虚线框中的步骤,将获取到的源切片媒体文件1-n发送到预处理设备1到预处理设备m中。其中,m为大于1的自然数。预处理设备1-m接收为每一个源切片媒体文件分配的切片预处理任务1到切片预处理任务n,并根据接收到的切片预处理任务1-n分析源切片媒体文件1-n,获得每一个源切片媒体文件的画面区域处理结果。当获取到每一个源切片媒体文件的画面区域处理结果后,将画面区域处理结果1-n发送到转码设备1-n。转码设备1-n根据画面区域处理结果1-n对源切片媒体文件1-n进行转码,得到目标切片媒体文件1-n,并将目标切片媒体文件进行合并,得到目标多媒体文件。
需要说明的是,上述转码设备可以不为n个,当上述转码设备不为n个时,有以下两种情况:
当源切片媒体文件数量小于等于转码设备数量时,直接通过转码设备对元切片媒体文件进行处理;当源切片媒体文件数量大于转码设备数量时,则多余的源切片媒体文件排队等待处理。
通过上述步骤,由于每一个源切片文件都获得了一个画面区域处理结果,从而可以根据画面区域处理结果对源多媒体文件中的每一个源切片媒体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中 仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
根据本申请实施例的又一方面,还提供了一种实现上述多媒体文件处理方法的多媒体文件处理装置,其中,上述多媒体文件处理装置可以为转码设备或者设置于转码设备中,如图9所示,上述多媒体文件处理装置包括:
第一获取单元902,设置为获取待处理的源多媒体文件中的源切片媒体文件
第二获取单元904,设置为获取与源切片媒体文件匹配的切片预处理结果,其中,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;
第三获取单元906,设置为从存储地址获取与源切片媒体文件匹配的画面区域处理结果;
处理单元908,设置为根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,上述多媒体文件处理装置可以但不限于应用于对视频文件进行处理的场景中。转码设备通过获取源多媒体文件中的源切片媒体文件,并根据画面区域处理结果对每一个源切片媒体文件进行处理,得到处理后的目标切片文件,从而实现了对每一个源切片媒体文件进行深度学习并处理的目的。解决了相关技术中仅仅能够针对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件的智能化分析效率与对源多媒体文件的处理效率。
可选地,上述待处理的源多媒体文件中的源切片媒体文件可以通过以下步骤获取:
拆分服务器将待处理的源多媒体文件按照切片规则切分成多段源切片媒体文件。
其中,上述拆分服务器用于将源多媒体文件切成源切片媒体文件,并将原切片媒体文件发送给预处理设备与转码设备。
可选地,上述切片规则可以为按照预定时长对媒体文件进行切片。例如,一个长10分50秒的源多媒体文件,从源多媒体文件的0分0秒处开始,每隔两分钟切片一次,将源多媒体文件切成5段两分钟的切片媒体文件和一段长50秒的切片媒体文件;或者按照平均分段的方法,将长10分50秒的源多媒体文件平均分成5段,每一段长2分10秒。
需要说明的是,上述按照预定时长或者平均分段的方法对源媒体文件进行切片仅仅为一种示例,具体对源文件切片的方法及切片媒体文件的时长本实施例在此不做限定。
可选地,在获取待处理的源多媒体文件中的源切片媒体文件之前,控制设备还可以获取与源切片媒体文件对应的切片预处理任务,并将源切片媒体文件与切片预处理任务发送给预处理设备,预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别,并保存识别得到的画面区域处理结果。
可选地,在将源切片媒体文件与切片预处理任务发送预处理设备之前控制设备还可以从预处理设备集群中确定源切片媒体文件对应的预处理设备。
可选地,在从预处理设备集群中确定源切片媒体文件对应的预处理设备之前,还可以包括:控制设备设置多台预处理设备组成预处理设备集群,其中,多台预处理设备在预处理设备集群中处于并列关系。
可选地,在从预处理设备集群中确定源切片媒体文件对应的预处理设备之前,还可以包括:控制设备根据切片媒体文件的文件类型,确定与文件类型对应的预处理设备。
例如,源切片文件的文件类型为包含字幕类型与不包含字幕类型,则选择对字幕进行处理的预处理设备对包含字幕的源切片文件进行处理,选择对视频进行处理的预处理设备对不包含字幕的源切片文件进行处理。
需要说明的是,上述从预处理设备集群中确定源切片媒体文件对应的预处理设备的方法仅为一种可选的示例,并不构成对本申请权利要求的限定。
可选地,根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件可以包括:转码设备根据画面区域处理结果获取源切片媒体文件包含的帧画面中的关键区域;对关键区域执行第一操作,对除关键区域外的其他区域执行第二操作。
可选地,根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件可以包括:转码设备根据画面区域处理结果获取源切片媒体文件包含的关键时间段,对关键时间段执行第一操作,对除关键时间段外的其他时间段执行第二操作。
可选地,关键时间段可以为源切片媒体文件中的一段或几段,第一操作可以为提高码率,第二操作可以为降低码率。例如,画面区域处理结果中指示源切片媒体文件的第3秒到第7秒,第11秒到第14秒为关键时间段,其他时间段为非关键时间段,则可以将源切片文件中的第3秒到第7秒与第11秒到14秒的文件提高码率,其他非关键时间段的文件降低码率。
需要说明的是,上述第一操作为提高码率,第二操作为降低码率仅为一种可选的操作,本实施例对此不做具体限定。
通过本申请实施例,通过转码设备获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件匹配的切片预处理结果,根据切片预处理结果中指示的存储地址获取与源切片媒体文件匹配的画面区域处理结果,并根据画面区域处理结果对源切片媒体文件进行处理的方法,通过为每一个源切片文件获得一个画面区域处理结果,从而可以根据画面区域 处理结果对源多媒体文件中的每一个源切片媒体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
作为一种可选的实施方案,上述装置还包括:
第四获取单元,设置为在获取待处理的源多媒体文件中的源切片媒体文件之前,获取与源切片媒体文件对应的切片预处理任务;
第一发送单元,设置为将源切片媒体文件与切片预处理任务发送至预处理设备,以使预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别,并保存识别得到的画面区域处理结果。
通过本实施例,通过在获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件匹配的切片预处理结果之前,获取与源切片媒体文件对应的切片预处理任务,并通过预处理设备对源切片文件中的帧画面进行关键区域识别,从而在对源切片文件进行处理的过程中,确定对源切片文件的处理策略,实现了对源切片媒体文件进行灵活处理的效果。
作为一种可选的实施方案,上述装置还包括:
确定单元,设置为在将源切片媒体文件与切片预处理任务发送至预处理设备之前,从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,其中,源多媒体文件中的源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
通过本申请实施例,通过从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,从而保证了每一个源切片媒体文件都会有一个预处理设备对其进行处理,且由于预处理设备有多个,从而提高了对源切片媒体文件的处理效率。
作为一种可选的实施方案,上述处理单元包括:
获取模块,设置为根据画面区域处理结果获取源切片媒体文件所包含的帧画面中的关键区域;
执行模块,设置为对关键区域执行第一操作,对源切片媒体文件所包含的帧画面中除关键区域之外的其他区域执行第二操作,其中,第一操作与第二操作为不同操作。
通过本实施例,通过根据画面区域处理结果获取源切片媒体文件所包含的帧画面中的关键区域,并对关键区域执行第一操作,对其他区域执行第二操作,从而实现了对源切片媒体文件中的不同区域执行不同操作的目的,提高了对源切片媒体文件进行处理的灵活性。
作为一种可选的实施方案,上述执行模块包括:
第一执行子模块,设置为对关键区域按照第一码率执行编码处理操作;
第二执行子模块,设置为对帧画面中除关键区域之外的其他区域按照第二码率执行编码处理操作;
其中,第一码率高于第二码率。
通过本实施例,通过对关键区域按照第一码率执行编码处理操作;对帧画面中除关键区域之外的其他区域按照第二码率执行编码处理操作,从而实现了对源切片媒体文件中的不同区域执行不同操作,以使不同区域的显示码率不同的目的,提高了对源切片媒体文件进行处理的灵活性。
作为一种可选的实施方案,上述装置还包括:
合并单元,设置为在根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件之后,将与源多媒体文件中所包含的各个源切片媒体文件分别对应的目标切片媒体文件进行合并,得到与源多媒体文件对应的目标多媒体文件;
第二发送单元,设置为将目标多媒体文件发送至播放客户端进行播放。
通过本实施例,通过将与源多媒体文件中所包含的各个源切片媒体文 件分别对应的目标切片媒体文件进行合并,得到与源多媒体文件对应的目标多媒体文件,并将目标多媒体文件发送至播放客户端进行播放,从而保证了在对源切片媒体文件进行处理的过程之后,可以得到完整的目标多媒体文件,提高了源切片媒体文件的处理准确度。
以下结合图7,对上述多媒体文件处理装置做整体说明。如图7所示,在相关技术中,不包含由虚线框所围住的部分。当获取到源多媒体文件时,根据源多媒体文件获取源切片媒体文件1到源切片媒体文件n,其中n为大于1的自然数。之后将源切片媒体文件1-n发送给转码设备1-n,由转码设备1-n对源切片媒体文件1-n进行转码,得到转码后媒体文件1-n,并将转码后媒体文件1-n合并为转码后多媒体文件。然而,使用该方法,仅仅做到了对源多媒体文件的转码。而本申请中,在获取到源切片媒体文件1-n后,通过虚线框中的步骤,将获取到的源切片媒体文件1-n发送到预处理设备1到预处理设备m中。其中,m为大于1的自然数。预处理设备1-m接收为每一个源切片媒体文件分配的切片预处理任务1到切片预处理任务n,并根据接收到的切片预处理任务1-n分析源切片媒体文件1-n,获得每一个源切片媒体文件的画面区域处理结果。当获取到每一个源切片媒体文件的画面区域处理结果后,将画面区域处理结果1-n发送到转码设备1-n。转码设备1-n根据画面区域处理结果1-n对源切片媒体文件1-n进行转码,得到目标切片媒体文件1-n,并将目标切片媒体文件进行合并,得到目标多媒体文件。
需要说明的是,上述转码设备可以不为n个,当上述转码设备不为n个时,有以下两种情况:
当源切片媒体文件数量小于等于转码设备数量时,直接通过转码设备对元切片媒体文件进行处理;当源切片媒体文件数量大于转码设备数量时,则多余的源切片媒体文件排队等待处理。
通过上述步骤,由于每一个源切片文件都获得了一个画面区域处理结果,从而可以根据画面区域处理结果对源多媒体文件中的每一个源切片媒 体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
需要说明的是,上述模块与单元可以但不限于存在相同的设备或者不同的设备中,本实施例对此不做具体限定。
根据本申请实施例的又一方面,还提供了一种实现上述多媒体文件处理方法的多媒体文件处理装置,其中,上述多媒体文件处理装置可以为预处理设备或者设置于预处理设备中,如图10所示,上述多媒体文件处理装置包括:
第一获取单元1002,设置为获取待处理的源多媒体文件中的源切片媒体文件;
第二获取单元1004,设置为获取与源切片媒体文件对应的切片预处理任务;
第三获取单元1006,设置为根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;
发送单元1008,设置为将画面区域处理结果发送给转码设备,以使转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,上述多媒体文件处理装置可以但不限于应用于对视频文件进行处理的场景中。预处理设备获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件对应的切片预处理任务,并根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;将上述画面区域处理结果发送给转码设备,使转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,上述待处理的源多媒体文件中的源切片媒体文件可以通过以下步骤获取:
将待处理的源多媒体文件按照切片规则切分成多段源切片媒体文件。
可选地,上述切片规则可以为按照预定时长对媒体文件进行切片。例如,一个长10分50秒的源多媒体文件,从源多媒体文件的0分0秒处开始,每隔两分钟切片一次,将源多媒体文件切成5段两分钟的切片媒体文件和一段长50秒的切片媒体文件;或者按照平均分段的方法,将长10分50秒的源多媒体文件平均分成5段,每一段长2分10秒。
需要说明的是,上述按照预定时长或者平均分段的方法对源媒体文件进行切片仅仅为一种示例,具体对源文件切片的方法及切片媒体文件的时长本实施例在此不做限定。
可选地,在根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果包括:预处理设备根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别,保存识别得到的画面区域处理结果。
可选地,上述每一帧上的关键区域可以相同也可以不同。
可选地,将画面区域处理结果发送给转码设备包括:预处理设备获取转码设备发送的获取请求,其中,获取请求中携带有用于指示画面区域处理结果的存储地址;将存储地址中的画面区域处理结果发送给转码设备。
可选地,将画面区域处理结果发送给转码设备包括:在预处理模块根据预处理任务对源切片媒体文件进行关键区域识别,得到画面区域处理结果后,预处理设备直接将画面区域处理结果发送给转码设备。
可选地,在获取待处理的源多媒体文件中的源切片媒体文件之前,还包括:从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,其中,源多媒体文件中的源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
可选地,上述源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M可以为一个源切片媒体文件对应一个预处理设备;一个源切片媒体文件对应多个预处理设备;或者多个源切片媒体文件对应一个预处理设备。
通过本申请实施例,通过获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件对应的切片预处理任务,并根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果,并通过转码设备对画面区域处理结果进行处理得到目标切片媒体文件,从而实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
作为一种可选的实施方案,上述第三获取单元包括:
识别模块,设置为根据预处理任务对源切片媒体文件所包含的帧画面进行关键区域识别;
保存模块,设置为保存识别得到的画面区域处理结果。
通过本申请实施例,通过识别源切片媒体文件中的关键区域并保存,得到画面区域处理结果,从而实现了对源切片媒体文件中的不同区域执行不同操作的目的,提高了对源切片媒体文件进行处理的灵活性。
作为一种可选的实施方案,上述发送单元包括:
获取模块,设置为获取转码设备发送的获取请求,其中,获取请求中携带有用于指示画面区域处理结果的存储地址;
发送模块,设置为将存储地址中的画面区域处理结果发送给转码设备。
通过本实施例,通过获取转码设备发送的获取请求,并根据获取请求中的画面区域处理结果的存储地址获取画面区域处理结果,从而实现在服务器上存储画面区域处理结果的存储地址,减轻了预处理设备的负担。
作为一种可选的实施方案,上述装置还包括:
确定单元,设置为在获取待处理的源多媒体文件中的源切片媒体文件,及与源切片媒体文件对应的切片预处理任务之前,从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,其中,源多媒体文件中的源切片媒体文件的数量与预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
通过本申请实施例,通过从预处理设备集群中确定出与源切片媒体文件对应的预处理设备,从而保证了每一个源切片媒体文件都会有一个预处理设备对其进行处理,且由于预处理设备有多个,从而提高了对源切片媒体文件的处理效率。
以下结合图7,对上述多媒体文件处理装置做整体说明。如图7所示,在相关技术中,不包含由虚线框所围住的部分。当获取到源多媒体文件时,根据源多媒体文件获取源切片媒体文件1到源切片媒体文件n,其中n为大于1的自然数。之后将源切片媒体文件1-n发送给转码设备1-n,由转码设备1-n对源切片媒体文件1-n进行转码,得到转码后媒体文件1-n,并将转码后媒体文件1-n合并为转码后多媒体文件。然而,使用该方法,仅仅做到了对源多媒体文件的转码。而本申请中,在获取到源切片媒体文件1-n后,通过虚线框中的步骤,将获取到的源切片媒体文件1-n发送到预处理设备1到预处理设备m中。其中,m为大于1的自然数。预处理设备1-m接收为每一个源切片媒体文件分配的切片预处理任务1到切片预处理任务n,并根据接收到的切片预处理任务1-n分析源切片媒体文件1-n,获得每一个源切片媒体文件的画面区域处理结果。当获取到每一个源切片媒体文件的画面区域处理结果后,将画面区域处理结果1-n发送到转码设备1-n。转码设备1-n根据画面区域处理结果1-n对源切片媒体文件1-n进行转码,得到目标切片媒体文件1-n,并将目标切片媒体文件进行合并,得到目标多媒体文件。
需要说明的是,上述转码设备可以不为n个,当上述转码设备不为n 个时,有以下两种情况:
当源切片媒体文件数量小于等于转码设备数量时,直接通过转码设备对元切片媒体文件进行处理;当源切片媒体文件数量大于转码设备数量时,则多余的源切片媒体文件排队等待处理。
通过上述步骤,由于每一个源切片文件都获得了一个画面区域处理结果,从而可以根据画面区域处理结果对源多媒体文件中的每一个源切片媒体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
需要说明的是,上述模块与单元可以但不限于存在相同的设备或者不同的设备中,本实施例对此不做具体限定。
根据本申请实施例的又一方面,还提供了一种多媒体文件处理系统,如图11所示,该多媒体文件处理系统包括:
控制设备1102,设置为对待处理的源多媒体文件进行切片,得到源切片媒体文件;
预处理设备1104,设置为获取源切片媒体文件及与源切片媒体文件对应的切片预处理任务;还设置为根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;
转码设备1106,设置为获取源切片媒体文件及与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示在预处理设备中画面区域处理结果的存储地址;还用于从存储地址获取与源切片媒体文件匹配的画面区域处理结果;还用于根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,上述多媒体文件处理系统可以但不限于应用于对视频文件进行处理的场景中。转码设备通过获取源多媒体文件中的源切片媒体文件,并根据画面区域处理结果对每一个源切片媒体文件进行处理,得到处理后的目标切片文件,从而实现了对每一个源切片媒体文件进行深度学习并处理的目的。解决了相关技术中仅仅能够针对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件的智能化分析效率与对源多媒体文件的处理效率。
以下结合图7,对上述多媒体文件处理系统做整体说明。如图7所示,在相关技术中,不包含由虚线框所围住的部分。当获取到源多媒体文件时,根据源多媒体文件获取源切片媒体文件1到源切片媒体文件n,其中n为大于1的自然数。之后将源切片媒体文件1-n发送给转码设备1-n,由转码设备1-n对源切片媒体文件1-n进行转码,得到转码后媒体文件1-n,并将转码后媒体文件1-n合并为转码后多媒体文件。然而,使用该方法,仅仅做到了对源多媒体文件的转码。而本申请中,在获取到源切片媒体文件1-n后,通过虚线框中的步骤,将获取到的源切片媒体文件1-n发送到预处理设备1到预处理设备m中。其中,m为大于1的自然数。预处理设备1-m接收为每一个源切片媒体文件分配的切片预处理任务1到切片预处理任务n,并根据接收到的切片预处理任务1-n分析源切片媒体文件1-n,获得每一个源切片媒体文件的画面区域处理结果。当获取到每一个源切片媒体文件的画面区域处理结果后,将画面区域处理结果1-n发送到转码设备1-n。转码设备1-n根据画面区域处理结果1-n对源切片媒体文件1-n进行转码,得到目标切片媒体文件1-n,并将目标切片媒体文件进行合并,得到目标多媒体文件。
需要说明的是,上述转码设备可以不为n个,当上述转码设备不为n个时,有以下两种情况:
当源切片媒体文件数量小于等于转码设备数量时,直接通过转码设备对元切片媒体文件进行处理;当源切片媒体文件数量大于转码设备数量时, 则多余的源切片媒体文件排队等待处理。
通过上述步骤,由于每一个源切片文件都获得了一个画面区域处理结果,从而可以根据画面区域处理结果对源多媒体文件中的每一个源切片媒体文件进行处理,得到目标切片媒体文件,实现了对源多媒体文件中的每一个切片媒体文件进行智能化分析并处理的目的。从而解决了相关技术中仅仅能够对整个源多媒体文件进行智能化分析的问题,提高了对源多媒体文件进行处理的处理效率。
根据本申请实施例的又一方面,还提供了一种存储介质,该存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述任一项方法实施例中的全部或部分步骤。
可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的计算机程序:
S1,获取待处理的源多媒体文件中的源切片媒体文件;
S2,获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;
S3,从存储地址获取与源切片媒体文件匹配的画面区域处理结果;
S4,根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的计算机程序:
S1,获取待处理的源多媒体文件中的源切片媒体文件;
S2,获取与源切片媒体文件对应的切片预处理任务;
S3,根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;
S4,将画面区域处理结果发送给转码设备,以使转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,存储介质还被设置为存储用于执行上述实施例中的方法中所包括的步骤的计算机程序,本实施例中对此不再赘述。
根据本申请实施例的又一个方面,还提供了一种用于实施上述多媒体文件处理方法的电子装置,如图12所示,该装置包括:存储器和处理器,该存储器中存储有计算机程序,该处理器被设置为通过计算机程序执行上述任一项方法实施例中的步骤。
可选地,在本实施例中,上述电子装置可以位于计算机网络的多个网络设备中的至少一个网络设备。
可选地,在本实施例中,上述处理器可以被设置为通过计算机程序执行以下步骤:
S1,获取待处理的源多媒体文件中的源切片媒体文件;
S2,获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;
S3,从存储地址获取与源切片媒体文件匹配的画面区域处理结果;
S4,根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
或者,在本实施例中,上述处理器可以被设置为通过计算机程序执行以下步骤:
S1,获取待处理的源多媒体文件中的源切片媒体文件;
S2,获取与源切片媒体文件对应的切片预处理任务;
S3,根据切片预处理任务获取与源切片媒体文件匹配的画面区域处理结果;
S4,将画面区域处理结果发送给转码设备,以使转码设备根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
可选地,本领域普通技术人员可以理解,图12所示的结构仅为示意,电子装置也可以是智能手机(如Android手机、iOS手机等)、平板电脑、掌上电脑以及移动互联网设备(Mobile Internet Devices,MID)、PAD等终端设备。图12其并不对上述电子装置的结构造成限定。例如,电子装置还可包括比图12中所示更多或者更少的组件(如网络接口等),或者具有与图12所示不同的配置。
其中,存储器1204可用于存储软件程序以及模块,如本申请实施例中的多媒体文件处理方法、装置和系统对应的程序指令/模块,处理器1202通过运行存储在存储器1204内的软件程序以及模块,从而执行各种功能应用以及数据处理,即实现上述的多媒体文件处理方法。存储器1204可包括高速随机存储器,还可以包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器1204可进一步包括相对于处理器1202远程设置的存储器,这些远程存储器可以通过网络连接至终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
上述的用户接口1206用于经由一个网络接收或者发送数据。上述的网络具体实例可包括有线网络及无线网络。在一个实例中,用户接口1206包括一个网络适配器(Network Interface Controller,NIC),其可通过网线与其他网络设备与路由器相连从而可与互联网或局域网进行通讯。在一个实例中,用户接口1206为射频(Radio Frequency,RF)模块,其用于通 过无线方式与互联网进行通讯。
可选地,在本实施例中,本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令终端设备相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、只读存储器(Read-Only Memory,ROM)、随机存取器(Random Access Memory,RAM)、磁盘或光盘等。
上述本申请实施例顺序仅仅为了描述,不代表实施例的优劣。
上述实施例中的集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在上述计算机可读取的存储介质中。基于这样的理解,本申请的技术方案本质上或者说对相关技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在存储介质中,包括若干指令用以使得一台或多台计算机设备(可为个人计算机、服务器或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。
在本申请的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中,应该理解到,所揭露的客户端,可通过其它的方式实现。其中,以上所描述的装置实施例仅仅是示意性的,例如所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,单元或模块的间接耦合或通信连接,可以是电性或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的 部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
以上所述仅是本申请的可选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本申请的保护范围。
在本申请实施例中,通过获取待处理的源多媒体文件中的源切片媒体文件;获取与源切片媒体文件匹配的切片预处理结果,其中,切片预处理结果用于指示与源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;从存储地址获取与源切片媒体文件匹配的画面区域处理结果;根据画面区域处理结果对源切片媒体文件进行处理,得到处理后的目标切片媒体文件的方法,达到了获取与源切片媒体文件匹配的画面区域处理结果,并根据画面区域处理结果直接对源切片媒体文件进行处理的目的。通过对待处理的源多媒体文件进行切片,得到源切片媒体文件,通过分布式转码设备和分布式预处理设备对多个源切片媒体文件进行同步处理,克服了相关技术中仅仅针对整个源多媒体文件进行智能化分析所导致的处理效率较低的问题,从而实现提高对源多媒体文件智能化处理的效率。
Claims (15)
- 一种多媒体文件处理方法,包括:转码设备获取待处理的源多媒体文件中的源切片媒体文件;所述转码设备获取与所述源切片媒体文件匹配的切片预处理结果,其中,所述切片预处理结果用于指示与所述源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;所述转码设备从所述存储地址获取与所述源切片媒体文件匹配的所述画面区域处理结果;所述转码设备根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
- 根据权利要求1所述的方法,其中,在所述转码设备获取待处理的源多媒体文件中的源切片媒体文件之前,还包括:控制设备将与所述源切片媒体文件对应的切片预处理任务发送至所述预处理设备,以使所述预处理设备根据所述预处理任务对所述源切片媒体文件所包含的帧画面进行关键区域识别,并保存识别得到的所述画面区域处理结果。
- 根据权利要求2所述的方法,其中,在所述控制设备将与所述源切片媒体文件对应的切片预处理任务发送至所述预处理设备之前,还包括:所述控制设备从预处理设备集群中确定出与所述源切片媒体文件对应的所述预处理设备,其中,所述源多媒体文件中的源切片媒体文件的数量与所述预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
- 根据权利要求1所述的方法,其中,所述转码设备根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒 体文件包括:所述转码设备根据所述画面区域处理结果获取所述源切片媒体文件所包含的帧画面中的关键区域;所述转码设备对所述关键区域执行第一操作,对所述源切片媒体文件所包含的所述帧画面中除所述关键区域之外的其他区域执行第二操作,其中,所述第一操作与所述第二操作为不同操作。
- 根据权利要求4所述的方法,其中,所述转码设备对所述关键区域执行第一操作,对所述源切片媒体文件所包含的所述帧画面中除所述关键区域之外的其他区域执行第二操作包括:所述转码设备对所述关键区域按照第一码率执行编码处理操作;所述转码设备对所述帧画面中除所述关键区域之外的所述其他区域按照第二码率执行编码处理操作;其中,所述第一码率高于所述第二码率。
- 根据权利要求1至5中任一项所述的方法,其中,在所述根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒体文件之后,还包括:所述转码设备将与所述源多媒体文件中所包含的各个源切片媒体文件分别对应的所述目标切片媒体文件进行合并,得到与所述源多媒体文件对应的目标多媒体文件;所述转码设备将所述目标多媒体文件发送至播放客户端进行播放。
- 一种多媒体文件处理方法,包括:预处理设备获取待处理的源多媒体文件中的源切片媒体文件;所述预处理设备获取与所述源切片媒体文件对应的切片预处理 任务;所述预处理设备根据所述切片预处理任务获取与所述源切片媒体文件匹配的画面区域处理结果;所述预处理设备将所述画面区域处理结果发送给转码设备,以使所述转码设备根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
- 根据权利要求7所述的方法,其中,所述预处理设备根据所述切片预处理任务获取与所述源切片媒体文件匹配的画面区域处理结果包括:所述预处理设备根据所述预处理任务对所述源切片媒体文件所包含的帧画面进行关键区域识别;所述预处理设备保存识别得到的所述画面区域处理结果。
- 根据权利要求7所述的方法,其中,所述预处理设备将所述画面区域处理结果发送给转码设备包括:所述预处理设备获取所述转码设备发送的获取请求,其中,所述获取请求中携带有用于指示所述画面区域处理结果的存储地址;所述预处理设备根据所述存储地址获取所述画面区域处理结果,并发送给所述转码设备。
- 根据权利要求7所述的方法,其中,在所述预处理设备获取待处理的源多媒体文件中的源切片媒体文件之前,还包括:控制设备从预处理设备集群中确定出与所述源切片媒体文件对应的所述预处理设备,其中,所述源多媒体文件中的源切片媒体文件的数量与所述预处理设备集群中的预处理设备的数量之比为N:M,N为大于1的自然数,M为大于1的自然数。
- 一种多媒体文件处理系统,包括:控制设备,设置为对待处理的源多媒体文件进行切片,得到源切 片媒体文件;预处理设备,设置为获取所述源切片媒体文件及与所述源切片媒体文件对应的切片预处理任务;还设置为根据所述切片预处理任务获取与所述源切片媒体文件匹配的画面区域处理结果;转码设备,设置为获取所述源切片媒体文件及与所述源切片媒体文件匹配的切片预处理结果,其中,所述切片预处理结果用于指示在所述预处理设备中所述画面区域处理结果的存储地址;还用于从所述存储地址获取与所述源切片媒体文件匹配的所述画面区域处理结果;还用于根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
- 一种多媒体文件处理装置,包括:第一获取单元,设置为获取待处理的源多媒体文件中的源切片媒体文件;第二获取单元,设置为获取与所述源切片媒体文件匹配的切片预处理结果,其中,所述切片预处理结果用于指示与所述源切片媒体文件匹配的画面区域处理结果在预处理设备中的存储地址;第三获取单元,设置为从所述存储地址获取与所述源切片媒体文件匹配的所述画面区域处理结果;处理单元,设置为根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
- 一种多媒体文件处理装置,包括:第一获取单元,设置为获取待处理的源多媒体文件中的源切片媒体文件;第二获取单元,设置为与所述源切片媒体文件对应的切片预处理任务;第三获取单元,设置为根据所述切片预处理任务获取与所述源切片媒体文件匹配的画面区域处理结果;发送单元,设置为将所述画面区域处理结果发送给转码设备,以使所述转码设备根据所述画面区域处理结果对所述源切片媒体文件进行处理,得到处理后的目标切片媒体文件。
- 一种存储介质,所述存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行所述权利要求1至6或7至10任一项中所述的方法。
- 一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器被设置为通过所述计算机程序执行所述权利要求1至6或7至10任一项中所述的方法。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP19774968.2A EP3745734A4 (en) | 2018-03-28 | 2019-03-22 | MULTIMEDIA FILE PROCESSING METHOD AND DEVICE, STORAGE MEDIA AND ELECTRONIC DEVICE |
| US16/900,579 US11412270B2 (en) | 2018-03-28 | 2020-06-12 | Method and apparatus for processing multimedia file, storage medium, and electronic apparatus |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810265191.2 | 2018-03-28 | ||
| CN201810265191.2A CN108600863A (zh) | 2018-03-28 | 2018-03-28 | 多媒体文件处理方法和装置、存储介质及电子装置 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/900,579 Continuation US11412270B2 (en) | 2018-03-28 | 2020-06-12 | Method and apparatus for processing multimedia file, storage medium, and electronic apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019184822A1 true WO2019184822A1 (zh) | 2019-10-03 |
Family
ID=63624988
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/079269 Ceased WO2019184822A1 (zh) | 2018-03-28 | 2019-03-22 | 多媒体文件处理方法和装置、存储介质及电子装置 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11412270B2 (zh) |
| EP (1) | EP3745734A4 (zh) |
| CN (1) | CN108600863A (zh) |
| WO (1) | WO2019184822A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115589489A (zh) * | 2022-10-19 | 2023-01-10 | 抖音视界有限公司 | 视频转码方法、装置、设备、存储介质及视频点播系统 |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108600863A (zh) | 2018-03-28 | 2018-09-28 | 腾讯科技(深圳)有限公司 | 多媒体文件处理方法和装置、存储介质及电子装置 |
| CN109587517B (zh) * | 2018-12-07 | 2022-02-18 | 咪咕视讯科技有限公司 | 一种多媒体文件的播放方法及装置、服务器及存储介质 |
| FR3098672B1 (fr) * | 2019-07-09 | 2022-01-21 | Quortex | système de distribution d’un contenu audiovisuel |
| CN111246315B (zh) * | 2020-01-21 | 2022-06-03 | 咪咕视讯科技有限公司 | 视频交互方法、系统、边缘节点、客户端及存储介质 |
| CN111277827B (zh) | 2020-02-24 | 2022-12-20 | 腾讯科技(深圳)有限公司 | 一种视频数据处理方法、装置、设备以及可读存储介质 |
| CN114546223A (zh) * | 2022-01-25 | 2022-05-27 | 吕贺 | 文件控制方法、装置、电子设备及计算机可读存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015190893A1 (ko) * | 2014-06-13 | 2015-12-17 | 삼성전자 주식회사 | 멀티미디어 데이터를 관리하는 방법 및 장치 |
| CN105306960A (zh) * | 2015-10-18 | 2016-02-03 | 北京航空航天大学 | 一种用于传输高质量在线课程视频的动态自适应流系统 |
| CN106791928A (zh) * | 2016-12-29 | 2017-05-31 | 上海幻电信息科技有限公司 | 一种自适应的高性能视频转码系统和方法 |
| CN108600863A (zh) * | 2018-03-28 | 2018-09-28 | 腾讯科技(深圳)有限公司 | 多媒体文件处理方法和装置、存储介质及电子装置 |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE69837003T2 (de) * | 1997-02-12 | 2007-10-18 | Mediatek Inc. | Vorrichtung und verfahren zur optimierung der bitratensteurung in einem kodiersystem |
| US6275536B1 (en) * | 1999-06-23 | 2001-08-14 | General Instrument Corporation | Implementation architectures of a multi-channel MPEG video transcoder using multiple programmable processors |
| US20010047517A1 (en) * | 2000-02-10 | 2001-11-29 | Charilaos Christopoulos | Method and apparatus for intelligent transcoding of multimedia data |
| US6948127B1 (en) * | 2001-12-10 | 2005-09-20 | Cisco Technology, Inc. | Interface for compressed video data analysis |
| US20130114703A1 (en) * | 2005-03-31 | 2013-05-09 | Euclid Discoveries, Llc | Context Based Video Encoding and Decoding |
| US8358700B2 (en) * | 2008-06-03 | 2013-01-22 | Omnivision Technologies, Inc. | Video coding apparatus and method for supporting arbitrary-sized regions-of-interest |
| US8605791B2 (en) * | 2008-11-21 | 2013-12-10 | Nvidia Corporation | Video processor using an optimized slicemap representation |
| US8396114B2 (en) * | 2009-01-29 | 2013-03-12 | Microsoft Corporation | Multiple bit rate video encoding using variable bit rate and dynamic resolution for adaptive video streaming |
| US20100232504A1 (en) * | 2009-03-13 | 2010-09-16 | The State of Oregon acting by and through the State Board of Higher Education on behalf of the | Supporting region-of-interest cropping through constrained compression |
| US9338467B1 (en) * | 2010-07-19 | 2016-05-10 | Google Inc. | Parallel video transcoding |
| US20120230398A1 (en) * | 2011-03-10 | 2012-09-13 | Christopher Andrew Segall | Video decoder parallelization including slices |
| US9712835B2 (en) * | 2011-03-29 | 2017-07-18 | Lyrical Labs LLC | Video encoding system and method |
| US9049464B2 (en) * | 2011-06-07 | 2015-06-02 | Qualcomm Incorporated | Multiple description coding with plural combined diversity |
| US20130104177A1 (en) * | 2011-10-19 | 2013-04-25 | Google Inc. | Distributed real-time video processing |
| EP2680527A1 (en) * | 2012-06-28 | 2014-01-01 | Alcatel-Lucent | Adaptive streaming aware node, encoder and client enabling smooth quality transition |
| US9491457B2 (en) * | 2012-09-28 | 2016-11-08 | Qualcomm Incorporated | Signaling of regions of interest and gradual decoding refresh in video coding |
| KR101987820B1 (ko) * | 2012-10-05 | 2019-06-11 | 삼성전자주식회사 | 고 해상도 컨텐츠를 처리하는 컨텐츠 처리 장치 및 그 방법 |
| CN103152606B (zh) * | 2013-03-19 | 2016-01-13 | 华为技术有限公司 | 视频文件处理方法及装置、系统 |
| US9749627B2 (en) * | 2013-04-08 | 2017-08-29 | Microsoft Technology Licensing, Llc | Control data for motion-constrained tile set |
| US20150067753A1 (en) * | 2013-08-29 | 2015-03-05 | F5 Networks, Inc. | Generating frame chunking for video fast starts |
| US9417921B2 (en) * | 2014-07-31 | 2016-08-16 | Istreamplanet Co. | Method and system for a graph based video streaming platform |
| US10123028B2 (en) * | 2014-09-17 | 2018-11-06 | Mediatek Inc. | Syntax parsing apparatus with multiple syntax parsing circuits for processing multiple image regions within same frame or processing multiple frames and related syntax parsing method |
| US10341561B2 (en) * | 2015-09-11 | 2019-07-02 | Facebook, Inc. | Distributed image stabilization |
| US10375156B2 (en) * | 2015-09-11 | 2019-08-06 | Facebook, Inc. | Using worker nodes in a distributed video encoding system |
| CN105323593B (zh) * | 2015-10-29 | 2018-12-04 | 北京易视云科技有限公司 | 一种多媒体转码调度方法和装置 |
| CN106254868B (zh) * | 2016-08-19 | 2019-08-27 | 浙江宇视科技有限公司 | 视频编码码率控制方法、装置及系统 |
| CN106550240A (zh) * | 2016-12-09 | 2017-03-29 | 武汉斗鱼网络科技有限公司 | 一种带宽节省方法和系统 |
| US10638135B1 (en) * | 2018-01-29 | 2020-04-28 | Amazon Technologies, Inc. | Confidence-based encoding |
| US10951902B2 (en) * | 2019-06-12 | 2021-03-16 | Rovi Guides, Inc. | Systems and methods for multiple bit rate content encoding |
-
2018
- 2018-03-28 CN CN201810265191.2A patent/CN108600863A/zh active Pending
-
2019
- 2019-03-22 EP EP19774968.2A patent/EP3745734A4/en not_active Ceased
- 2019-03-22 WO PCT/CN2019/079269 patent/WO2019184822A1/zh not_active Ceased
-
2020
- 2020-06-12 US US16/900,579 patent/US11412270B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015190893A1 (ko) * | 2014-06-13 | 2015-12-17 | 삼성전자 주식회사 | 멀티미디어 데이터를 관리하는 방법 및 장치 |
| CN105306960A (zh) * | 2015-10-18 | 2016-02-03 | 北京航空航天大学 | 一种用于传输高质量在线课程视频的动态自适应流系统 |
| CN106791928A (zh) * | 2016-12-29 | 2017-05-31 | 上海幻电信息科技有限公司 | 一种自适应的高性能视频转码系统和方法 |
| CN108600863A (zh) * | 2018-03-28 | 2018-09-28 | 腾讯科技(深圳)有限公司 | 多媒体文件处理方法和装置、存储介质及电子装置 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3745734A4 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115589489A (zh) * | 2022-10-19 | 2023-01-10 | 抖音视界有限公司 | 视频转码方法、装置、设备、存储介质及视频点播系统 |
| CN115589489B (zh) * | 2022-10-19 | 2024-04-19 | 抖音视界有限公司 | 视频转码方法、装置、设备、存储介质及视频点播系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20200344497A1 (en) | 2020-10-29 |
| EP3745734A1 (en) | 2020-12-02 |
| CN108600863A (zh) | 2018-09-28 |
| EP3745734A4 (en) | 2020-12-02 |
| US11412270B2 (en) | 2022-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019184822A1 (zh) | 多媒体文件处理方法和装置、存储介质及电子装置 | |
| US12015770B2 (en) | Method for encoding video data, device, and storage medium | |
| US10516903B2 (en) | Method and apparatus for transmitting video data | |
| EP3099074B1 (en) | Systems, devices and methods for video coding | |
| CN110049324A (zh) | 视频编码方法、系统、设备及计算机可读存储介质 | |
| KR102417055B1 (ko) | 비디오 스트림의 후속 프로세싱을 위한 방법 및 디바이스 | |
| EP3734980A1 (en) | Video playback method and terminal, server and storage medium | |
| US11438645B2 (en) | Media information processing method, related device, and computer storage medium | |
| KR20180105690A (ko) | 통신 장치, 통신 제어 방법, 및 컴퓨터 프로그램 | |
| EP3073754A1 (en) | Systems and methods for video play control | |
| CN111669577A (zh) | 一种硬件解码检测方法、装置、电子设备及存储介质 | |
| CN111327921A (zh) | 视频数据处理方法及设备 | |
| US20240096087A1 (en) | Video processing collaboration method, apparatus, device, and storage medium | |
| CN112543373A (zh) | 一种转码控制方法、装置及电子设备 | |
| GB2575388A (en) | Method, apparatus and system for discovering and displaying information related to video content | |
| CN116781973B (zh) | 视频编解码方法、装置、存储介质和电子设备 | |
| CN110996137B (zh) | 一种视频处理方法及装置 | |
| CN112650596B (zh) | 目标数据的跨进程共享方法、装置、设备及存储介质 | |
| CN108989905A (zh) | 媒体流控制方法、装置、计算设备及存储介质 | |
| CN108683900B (zh) | 一种图像数据处理方法及装置 | |
| WO2017096891A1 (zh) | 多路视频数据的播放方法、设备及系统 | |
| US10154292B2 (en) | Information pushing method and system, cloud server and information server | |
| CN111343475B (zh) | 数据处理方法和装置、直播服务器及存储介质 | |
| CN116405704A (zh) | 一种直播数据推流方法、系统、计算机设备及介质 | |
| CN113411544A (zh) | 视频分片文件的发送方法及装置、存储介质及电子装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19774968 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2019774968 Country of ref document: EP Effective date: 20200827 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWW | Wipo information: withdrawn in national office |
Ref document number: 2019774968 Country of ref document: EP |