WO2023160186A1 - 视频的处理方法、电子设备和可读存储介质 - Google Patents

视频的处理方法、电子设备和可读存储介质 Download PDF

Info

Publication number
WO2023160186A1
WO2023160186A1 PCT/CN2022/140626 CN2022140626W WO2023160186A1 WO 2023160186 A1 WO2023160186 A1 WO 2023160186A1 CN 2022140626 W CN2022140626 W CN 2022140626W WO 2023160186 A1 WO2023160186 A1 WO 2023160186A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
interface
image
thumbnail
electronic device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2022/140626
Other languages
English (en)
French (fr)
Inventor
徐嘉劲
暴文莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to US18/546,711 priority Critical patent/US12541286B2/en
Priority to EP22922535.4A priority patent/EP4274242B1/en
Publication of WO2023160186A1 publication Critical patent/WO2023160186A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/735—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure

Definitions

  • the present application relates to the technical field of smart terminals, and in particular to a video processing method, electronic equipment, and a readable storage medium.
  • the present application provides a video processing method, an electronic device, and a readable storage medium, which can improve the convenience for users to view videos and images associated with the videos.
  • a video processing method including: displaying a first interface of a camera application, where the first interface of the camera application includes: a first preview image and a first control; responding to a first operation acting on the first control , the electronic device starts to record the first video and displays the second interface of the camera application, the second interface of the camera application includes: a second preview image and a second control; responding to the first action on the second control during the recording of the first video
  • the second operation is that the electronic device obtains the first image; after the recording of the first video is completed, the first interface of the gallery application is displayed, and the first interface of the gallery application includes: the first thumbnail corresponding to the first video and the first thumbnail corresponding to the first image Two thumbnails; in response to a third operation acting on the first thumbnail, displaying a second interface of the gallery application, wherein the second interface of the gallery application includes: the first thumbnail and a third thumbnail of the second image,
  • the second image is an image automatically obtained from the first video.
  • the electronic device when the electronic device turns on the "one record multiple" function, the electronic device automatically generates an image associated with the recorded video, and the image can be used as a wonderful photo of the video.
  • thumbnails of manually recorded videos and manually captured images are displayed, and the images associated with the videos are displayed after the electronic device detects a selection operation on the videos.
  • the second interface of the gallery application further includes the first video.
  • the first video in response to the third operation acting on the first thumbnail, is played silently in the second interface of the gallery application, and the second interface of the gallery application further includes: a progress bar, a third control and
  • the above method further includes: in response to the fourth operation acting on the third control, pausing the playback of the first video; in response to the fifth operation acting on the fourth control, playing the sound of the first video; and in response to acting on the progress bar
  • the sixth operation is to adjust the playback progress of the first video.
  • the above method further includes: displaying the gallery application in response to the seventh operation acting on the third thumbnail
  • the third interface of the gallery application includes: a first thumbnail, a second image, and a third thumbnail.
  • the first thumbnail is larger than the third thumbnail; and in the third interface of the gallery application, the third thumbnail is larger than the first thumbnail.
  • the above method further includes: displaying a fourth interface of the gallery application, where the fourth interface of the gallery application includes the first folder; in response to the eighth operation acting on the first folder, displaying the fourth interface of the gallery application Five interfaces, the fifth interface of the gallery application includes the third thumbnail; in response to the ninth operation acting on the third thumbnail, the sixth interface of the gallery application is displayed, and after the first video recording is completed, the sixth interface of the gallery application automatically Include the second image.
  • the sixth interface of the gallery application further includes: a first thumbnail image and a third thumbnail image.
  • the fourth interface of the gallery application further includes a second folder
  • the above method further includes: in response to the tenth operation acting on the second folder, displaying the seventh interface of the gallery application, in the first video After the recording is completed, the seventh interface automatically includes the second thumbnail.
  • the second interface of the camera application further includes a fifth control
  • the electronic device starts recording the first video and displays the second interface of the camera application in response to the first operation acting on the first control
  • the above-mentioned The method further includes: in response to the eleventh operation acting on the fifth control, the electronic device finishes recording the first video and displays the first interface of the camera application, and the first interface of the camera application also includes a sixth control; in response to acting on the sixth control
  • the twelfth operation is to display the second interface of the gallery application.
  • the above method further includes: in response to the electronic device being in the first shooting shooting the first video in the second shooting mode, and acquire the second image during the recording of the first video; in response to the electronic device shooting the second video in the second shooting mode, during the recording of the second video, it does not automatically start from the second video Get images from video.
  • the above method before displaying the second interface of the gallery application in response to the third operation acting on the first thumbnail, the above method further includes: parsing the first video corresponding to the first thumbnail to obtain the first video Corresponding group identifier: searching for an image having the same group identifier as that of the first video, and determining that the found image is the second image.
  • the file header information of the first video includes tag information, and the tag information includes the group identifier of the first video; and the image file of the second image includes the group identifier of the second image, and the group identifier of the second image It is the same as the group ID of the first video.
  • the database includes a first field, and the first field includes a group identifier of the first video and a group identifier of the second image.
  • the database includes a second field, and the second field corresponding to the first video is used to describe the number of images having the same group identifier as the first video.
  • the file header information of the first video includes the first identifier
  • the image file of the third image includes the second identifier
  • the first identifier is associated with the second identifier
  • the second interface of the gallery application A fourth thumbnail of the third image is also included.
  • the first identifier is the same as the second identifier.
  • the present application provides an electronic device, including: one or more processors, a memory, a camera and a display; the memory, the camera and the display are coupled with one or more processors, and the memory is used to store computer programs Code, the computer program code includes computer instructions, and when one or more processors execute the computer instructions, the electronic device executes the video processing method according to any one of the first aspect.
  • the present application provides a computer-readable storage medium for storing a computer program.
  • the computer program When the computer program is executed by an electronic device, the electronic device implements the video processing method according to any one of the first aspect.
  • the present application provides a computer program product.
  • the computer program product When the computer program product is run on a computer, the computer is made to execute the video processing method according to any one of the first aspect.
  • FIG. 1 is a schematic structural diagram of an example of a terminal device 100 provided in an embodiment of the present application
  • FIG. 2 is a block diagram of the software structure of the terminal device 100 provided by the embodiment of the present application.
  • Fig. 3a is a schematic diagram of the first graphical user interface provided by the embodiment of the present application.
  • Fig. 3b is a schematic diagram of the second graphical user interface provided by the embodiment of the present application.
  • Fig. 3c is a schematic diagram of a third graphical user interface provided by the embodiment of the present application.
  • Fig. 3d is a schematic diagram of a fourth graphical user interface provided by an embodiment of the present application.
  • Fig. 4a is a schematic diagram of a fifth graphical user interface provided by an embodiment of the present application.
  • Fig. 4b is a schematic diagram of a sixth graphical user interface provided by the embodiment of the present application.
  • Fig. 4c is a schematic diagram of the seventh graphical user interface provided by the embodiment of the present application.
  • Fig. 4d is a schematic diagram of the eighth graphical user interface provided by the embodiment of the present application.
  • Fig. 4e is a schematic diagram of a ninth graphical user interface provided by an embodiment of the present application.
  • Fig. 5 is an interactive diagram of an electronic device recording video in the "one record multiple" mode provided by the embodiment of the present application;
  • FIG. 6 is a schematic diagram of associatively storing one-record multiple videos and wonderful photos in ML according to the embodiment of the present application;
  • FIG. 7 is an interaction diagram of a user viewing a video in an embodiment of the present application.
  • Fig. 8 is an interaction diagram of an electronic device sharing video and images according to an embodiment of the present application.
  • Fig. 9a is a schematic diagram of a tenth graphical user interface provided by the embodiment of the present application.
  • Fig. 9b is a schematic diagram of the eleventh graphical user interface provided by the embodiment of the present application.
  • Fig. 9c is a schematic diagram of a twelfth graphical user interface provided by the embodiment of the present application.
  • Fig. 10 is a schematic diagram of an abstract flow chart provided by the embodiment of the present application.
  • FIG. 11 is a flowchart of a video processing method provided by an embodiment of the present application.
  • first”, “second”, and “third” are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as “first”, “second” and “third” may explicitly or implicitly include one or more of these features.
  • the video processing method provided by the embodiment of the present application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) devices, notebook computers, super mobile personal On terminal equipment such as a computer (ultra-mobile personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA), the embodiment of the present application does not impose any restrictions on the specific type of terminal equipment.
  • FIG. 1 is a schematic structural diagram of a terminal device 100 provided in an embodiment of the present application.
  • the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
  • the structure shown in the embodiment of the present application does not constitute a specific limitation on the terminal device 100 .
  • the terminal device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller may be the nerve center and command center of the terminal device 100 .
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the terminal device 100 .
  • the terminal device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the terminal device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the terminal device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • the terminal device 100 may implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
  • the SIM card interface 195 is used for connecting a SIM card.
  • the SIM card can be connected and separated from the terminal device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
  • the terminal device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards may be the same or different.
  • the SIM card interface 195 is also compatible with different types of SIM cards.
  • the SIM card interface 195 is also compatible with external memory cards.
  • the terminal device 100 interacts with the network through the SIM card to implement functions such as calling and data communication.
  • the terminal device 100 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100 .
  • the software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
  • an Android system with a layered architecture is taken as an example to illustrate the software structure of the terminal device 100 .
  • FIG. 2 is a block diagram of a software structure of a terminal device 100 according to an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer from top to bottom.
  • the application layer can consist of a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide the communication function of the terminal device 100 .
  • the management of call status including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is issued, the terminal device vibrates, and the indicator light flashes, etc.
  • Android runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the user uses the camera function in the mobile phone to shoot a video
  • he may also want to obtain some pictures associated with the video, such as wonderful pictures in the video.
  • some pictures associated with the video such as wonderful pictures in the video.
  • a wonderful picture can be extracted from the video, so as to obtain a picture related to the video.
  • the video and the image associated with the video are associated during storage, so that when the user plays the video, the video and the picture associated with the video can be Correlative display is performed, thereby achieving the effect of being convenient for users to view.
  • FIG. 3 a - FIG. 3 c are schematic diagrams of a function of enabling one-record multiple access according to an embodiment of the present application.
  • the user interface 30a is the main interface of the electronic device 100, and the main interface includes a camera icon 31 and other function icons.
  • the electronic device 100 detects a click operation on the camera icon 31, and in response to the above operation, displays a user interface 30b as shown in FIG. 3b.
  • the user interface 30b is the shooting interface of the electronic device 100, and the user interface 30b includes a preview area 311, a zoom ratio adjustment control 313, a function area 314, a gallery control 315, a virtual shutter control 316, an echo control 317, and a function indication icon 318 and setting controls 319 .
  • the preview area 311 is used to display the real-time preview images captured by the camera.
  • the zoom ratio adjustment control 313 is used to adjust the zoom ratio of the preview image in the preview area 311, wherein 1X is a zoom ratio of 1, 2X is a zoom ratio of 2, 3X is a zoom ratio of 3, and so on.
  • the zoom factor is positively correlated with the focal length of the picture.
  • the echo control 317 is used to switch between the front camera and the rear camera of the electronic device 100.
  • the electronic device 100 When the electronic device 100 is currently working with a rear camera, it detects the click operation of the user on the echo control 317, and responds to the operation, the electronic device 100 switches the working camera to the front camera, at this time, in the preview area 311, the preview image obtained by the front camera is displayed, and the preview image obtained by the rear camera is not displayed; when the electronic device 100 is currently working on the camera In the case of the front camera, the click operation of the user on the echo control 317 is detected, and in response to the operation, the electronic device 100 switches the working camera to the rear camera, and at this time, in the preview area 311, the display of the rear camera The acquired preview image does not display the preview image acquired by the front camera.
  • the function area 314 includes the function modes currently supported by the camera application, and the function area 314 includes a "night view” control 3141, a "portrait” control 3142, a “photograph” control 3143, a "video recording” control 3144, a “multi-lens video recording” control 3145, a “more “ control 3146 and function indicator icon 318.
  • the function indication icon 318 is used to indicate the current shooting mode of the electronic device.
  • the zoom magnification adjustment control 313 is used to adjust the zoom magnification of the preview image.
  • the electronic device 100 detects an input operation (for example, sliding up) on the zoom magnification adjustment control 313, in response to the input operation, the electronic device can increase the zoom of the preview image. magnification.
  • the electronic device detects a click operation on the setting control 319, and in response to the operation, the electronic device 100 displays the user interface 30c as shown in FIG. 3c.
  • the user interface 30c includes various control items for shooting parameters and shooting functions, among which there is a one-record-multiple control item 34 .
  • the user operates the switch 341 of the one-record-multiple-get control item 34 to change the one-record-multiple-get function in the switch state.
  • the one-record-multiple function of the electronic device 100 is turned off, and the user operates the switch 341 of the one-record-multiple control item 34 to enable the one-record-multiple function of the electronic device 100 .
  • the above-mentioned one-record-multiple-get function can be to extract one or more frames of pictures from the video shot by the electronic device in real time during the process of shooting the video by the electronic device as the pictures associated with the video, so as to record the video on the electronic device After the end, you can get a shooting function of the video and the picture associated with the video at the same time.
  • One or more frames of pictures extracted from the video are determined by the electronic device according to a preset algorithm, and the extracted one or more frames of pictures can be scored according to a preset algorithm for each frame of pictures in the video, and based on the scoring results
  • the selected top N pictures, the selected top N pictures can be used as the wonderful photos of the video, that is, the images associated with the video.
  • the electronic device 100 detects a click operation on the virtual shutter control 316, and in response to the operation, the electronic device 100 displays the user interface 30d as shown in FIG. 3d, and starts recording a video.
  • the user interface 30d is a video recording interface of the electronic device 100, which includes a shooting preview area 321, a recording time 322, a zoom ratio adjustment control 324, a pause recording control 325, a stop recording control 326 and a photographing control 327.
  • the shooting preview area 321 is used to display the preview image currently taken in real time
  • the recording time 322 is used to indicate the shooting duration of the current video.
  • the recording time of the current video is 25s.
  • the zoom magnification adjustment control 324 displays the zoom magnification of the current preview picture, and the current zoom magnification is 1 times the zoom magnification.
  • the pause recording control 325 is used for the user to pause the current video recording in FIG. 4a.
  • the stop recording control 326 is used for the user to stop recording the video. As shown in FIG.
  • the electronic device 100 when the electronic device 100 detects a click operation on the stop recording control 326, in response to the operation, the electronic device 100 stops recording the video, and obtains the video B , and save the video and pictures B2, B3, and B4 associated with the video.
  • the camera control 327 is used to take pictures during video recording.
  • the electronic device 100 detects a click operation on the camera control 327, in response to the operation, the electronic device 100 takes a picture to obtain an image B1.
  • FIGS. 3 a - 3 c illustrate that the electronic device 100 enables the function of “multiple recordings for one recording”, and FIG. 3 d illustrates recording video by the electronic device 100 .
  • FIGS. 4a-4e the playback of the one-record multiple-get video will be described.
  • the one-record multiple-get video is a video captured by the electronic device 100 when the one-record multiple-get function is turned on.
  • the user interface 30a is the main interface of the electronic device 100, and the main interface includes a gallery icon 32 and other application icons.
  • the electronic device 100 detects a click operation on the gallery icon 32, and in response to the operation, the electronic device 100 displays a user interface 40a as shown in FIG. 4a.
  • the user interface 40a is a gallery display interface, and the gallery display interface includes thumbnails of videos and photos, and the thumbnails of videos and photos are arranged from recent to far by date.
  • the user interface 40a includes: a thumbnail image 41 corresponding to the image A, a thumbnail image 42 corresponding to the video B, a thumbnail image 43 corresponding to the image B1, and a thumbnail image 44 corresponding to the video C, wherein the thumbnail image 42 includes a time information 421,
  • the time information 421 is used to indicate that the duration of the video B is 00:08; on the thumbnail 42, it also includes an "AI" mark 422, and the "AI" mark 422 is used to indicate that the video B is a record of multiple videos, that is, electronic When the device is shooting video B, the "one record, multiple” function is turned on.
  • the thumbnail 44 does not have an "AI” logo, that is, the electronic device 100 does not enable the "one record multiple” function when shooting the video C.
  • the electronic device 100 detects a click operation on the thumbnail 42, and in response to the operation, the electronic device 100 displays the user interface 40b as shown in FIG. 4b.
  • the user interface 40b is a display interface 1 for a multi-recorded video B.
  • User interface 40b includes: display area 401, playback progress bar 402, share control 403, collection control 404, edit control 405, delete control 406, "more" function control 407, return control 408, shooting time 409 of video B, and Thumbnail display area 410 .
  • the playback progress bar 402 also includes a playback stop control 4021 , a sound switch 4022 and a progress control control 4023 .
  • the video B is in the playing state, and when the electronic device 100 detects an operation on the stop playing control 4021, in response to the operation, the electronic device 100 pauses playing the video B.
  • the video B is in the mute state, when the electronic device 100 detects an operation on the sound switch 4022, in response to the operation, the electronic device 100 turns on the sound of the video B.
  • video B is played to 00:05, the electronic device detects a drag operation on the progress control control 4023, and in response to the operation, the electronic device 100 jumps to the position where the progress control control 4023 is located to play.
  • the thumbnail display area 410 includes a thumbnail 4101 of video B, a thumbnail 4102 of image B2 associated with video B, a thumbnail 4103 of image B3 associated with video B, and a thumbnail 4104 of image B4 associated with video B.
  • the size of the thumbnail 4101 corresponding to the currently displayed video B is larger than that of the thumbnail 4102 , the thumbnail 4103 and the thumbnail 4104 .
  • the electronic device 100 detects a click operation on the thumbnail 4103, and in response to the operation, the electronic device 100 displays a user interface 40c as shown in FIG. 4c.
  • the image B3 corresponding to the thumbnail 4103 is displayed in the display area 401 of the user interface 40c.
  • the thumbnail image 4103 is larger in size than the thumbnail image 4101 , the thumbnail image 4102 , and the thumbnail image 4104 .
  • the electronic device 100 if the electronic device 100 detects a click operation on the thumbnail 4102, the electronic device 100 displays the image B2 in the display area 401; if the electronic device 100 detects a click on the thumbnail 4104 operation, the electronic device 100 displays the image B4 in the display area 401 .
  • the electronic device 100 detects a click operation on the album control 46, and in response to the operation, the electronic device displays a user interface 40d as shown in FIG. 4d.
  • Fig. 4d shows the photo album display interface of the gallery, and the photo album display interface displays photos and videos saved in the mobile phone in the form of folders.
  • the photo album display interface shown in FIG. 4 d includes: a camera folder 461 , a folder of all photos 462 , a folder of videos 463 , and a folder 464 of multiple recordings.
  • the photo album display interface may also include other folders, and this application does not limit the folders displayed on the camera display interface.
  • the camera folder 461 can include the photos and videos taken by the mobile phone through the camera
  • the all photo folder 462 can include the photos and videos saved by the mobile phone
  • the video folder 463 can include the videos saved by the mobile phone
  • the one-record-multiple folder 464 can include electronic files. The image acquired by the device 100 in the one-record-multiple-get mode.
  • the electronic device 100 detects a click operation on the one-record folder 464, and the electronic device displays the user interface 40e as shown in FIG. 4e.
  • the user interface 40e is a display interface of the one-record multiple folder.
  • the user interface 40e includes a thumbnail 4612 of the image B2, a thumbnail 4613 of the image B3, and a thumbnail 4614 of the image B4.
  • the size of the thumbnail 4612, the thumbnail 4613 and the thumbnail 4614 are the same, and in some other examples, the size of the thumbnail 4612, the thumbnail 4613 and the thumbnail 4614 may be different, and the arrangement order may also be Unlike this example.
  • Figure 5 is an interactive diagram of an electronic device recording video in one-record multiple-get mode according to an embodiment of the present application. In conjunction with Figure 5, Describe how the electronic device records video in the one-record-multiple-get mode. In the following example, the electronic device has enabled the "one-record multiple-get" function.
  • the above steps can be performed in the user interface 30b.
  • the electronic device detects a click operation on the virtual shutter control 316, and in response to the operation, the electronic device starts recording a video.
  • the Camera sends the captured video frames to the BestMoment algorithm in real time, and the BestMoment algorithm is used to obtain the time points of BestShots in the video.
  • the BestMoment algorithm can filter out the time points of BestShots according to parameters such as illumination parameters and depth-of-field parameters of each frame of the video in the video.
  • the BestShots time point is the wonderful moment calculated by the BestMoment algorithm, and the time point can be represented by a timestamp.
  • the BestMoment algorithm returns the obtained BestShots time point to the camera analysis service.
  • the camera analysis service extracts wonderful photos from the video according to the BestShots time point, so as to obtain the image associated with the video.
  • the BestMoment algorithm can return multiple BestShots time points to the camera analysis service, and the camera analysis service can filter out N time points from the multiple BestShots time points returned by the BestMoment algorithm, and based on the selected N time points Extract great photos from videos.
  • a number threshold N can be set in the camera analysis service, and when the number of BestShots time points returned by the BestMoment algorithm is greater than the above number threshold N, N wonderful photos are selected from the BestShots time points returned by the BestMoment algorithm Time point, the screening method can be to score the pictures corresponding to the BestShots time point, and select the top N time points as the time points of the wonderful photos; when the number of BestShots time points returned by the BestMoment algorithm is less than the above threshold N Next, you can directly use the BestShots time point returned by the BestMoment algorithm as the time point of the wonderful photo.
  • the BestMoment algorithm may also return 0 BestShots time points to the camera analysis service. That is to say, the BestMoment algorithm did not filter out the BestShots time point from the video. In this case, although the "One Recording" function is turned on, the video does not have associated wonderful photos.
  • video files in MPEG-4 format have file header information.
  • the file header information of video in MPEG-4 format may mainly include three parts: General, Video, and Audio.
  • the general information of the video can be included in General, such as: video size (File size), video duration (Duration), total bit rate (Overall bit rate), encoding date (Encoded date) and Android system version (com.android. version) etc.;
  • the video information in the video file can be included in the Video
  • the sound information in the video file can be included in the Audio.
  • Tag information can be added after the file header information. For example:
  • the above Tag information mainly includes: video duration, group ID, whether to enable background music, camera switching information, exciting moments, and video types, etc., which will be described below.
  • lensInformations is used to describe the lens switching information
  • magicMoment is used to describe the wonderful photos in the video.
  • “bestShots” is the bestShots time point output by the BestMonment algorithm.
  • “wonderPhotoCnt”:3 means that 3 wonderful photos are selected in this example; in this In the example, “bestShots” includes 20 timestamps, that is, the BestMoment algorithm returns 20 BestShots time points to the camera analysis service; "wonderPhotoCnt”: 3, that is, the camera analysis service selects 3 wonderful photos;
  • type “MagicMomentMovie” is used to describe the video type as a multi-record video.
  • the associated field of the wonderful photo can be added to the Exif information of the wonderful photo, for example:
  • composition YCbcr
  • JPEG thumbnail starting position offset: 996
  • JPEG thumbnail data length length: 10529
  • Thumbnail image 256x 144
  • MP MediaProvider
  • the server After adding the suffix Tag to the video and adding the associated field in the Exif of the wonderful photo, the server writes the information of the video and the wonderful photo into the MP of the electronic device.
  • the server also stores videos and exciting photos to the storage system of the electronic device.
  • ML MediaLibrary
  • the MP After the Server writes the video and wonderful photo information into the MP, the MP broadcasts the event of writing new data. The broadcast triggers the Server to obtain the video and wonderful photo information, and the Server obtains The video and highlight photo information includes the storage path and file name of the video and highlight photo.
  • Server inserts the information of videos and wonderful photos obtained from ML into ML.
  • the gallery parsing service reads the video and the wonderful photo from the storage system of the electronic device according to the storage path and the file name of the video and the wonderful photo.
  • the gallery parsing service parses the obtained videos and highlights to obtain associated fields of the videos and highlights.
  • the aforementioned associated fields may be the group ID written in the header information of the video file and the group ID written in the Exif of the wonderful photo.
  • the gallery parsing service writes the associated fields into ML, and can update the group ID field in ML according to the group IDs of videos and highlights.
  • FIG. 6 is a schematic diagram of associatively storing one-record multiple videos and wonderful photos in ML according to an embodiment of the present application.
  • the _id field is used to store the primary key of the image file (video or image);
  • the _data field is used to store the storage path of the image file;
  • the _size is used to store the size of the image file, and
  • the _dispaly_name field is used to store the display of the image file name.
  • the wonder_photo_count field is used to store the number of wonderful photos corresponding to the video.
  • the ai_video_group_id fields of the 7th row of video and the 8th row of image are the same, that is, the 7th row of video and the 8th row of image are the same group of images, and the 8th row of image is the wonderful photo in the 7th row of video ;
  • the wonder_photo_count field indicates that the video on the 7th row has one associated image.
  • the video in the third row and the image in the fourth row are the same group of images, that is, the image in the fourth row is a wonderful photo in the video in the third row
  • the wonder_photo_count field indicates that the video in the third row has an associated image.
  • the wonder_photo_count field in lines 1, 2, 5, and 6 is 0, indicating that the one-record multiple videos in lines 1, 2, 5, and 6 do not have associated images.
  • the video in row 9 is "(null)" in the ai_video_group_id field, that is, the video in row 9 is not a multi-record video.
  • the ML also includes more fields not shown in FIG. 6 , and the structure of the database in 6 is only for example and not limited thereto.
  • Fig. 7 is an interactive diagram of a user viewing a video according to an embodiment of the present application. The following is for the user Check out the video for an explanation.
  • a user views a video.
  • One record multiple videos can be displayed together with other videos and images in the gallery display interface of the electronic device.
  • the electronic device 100 detects a click operation on the gallery icon 32 and enters the gallery of the electronic device 100 .
  • the electronic device 100 displays a user interface 40 a as shown in FIG. 4 a
  • the user interface 40 a is a gallery display interface of the electronic device 100 .
  • thumbnails of videos and images are displayed, including thumbnails of multi-recorded videos, and the user can click the thumbnail corresponding to the multi-recorded video to be viewed to send a viewing request to the gallery,
  • the electronic device 100 continues to perform the following steps after receiving the user's operation of viewing the video.
  • the Gallery notifies the Server of receiving the video viewing request, so as to trigger the ML to search for images associated with the video through clustering.
  • the aforementioned associated field may be the ai_video_group_id field as shown in FIG. 6 , and the one-record-multiple video and associated images have the same ai_video_group_id field.
  • the server searches for images with the same ai_video_group_id according to the ai_video_group_id field of the multi-record video selected by the user, and clusters the multi-record video selected by the user and the found images as a group.
  • the server pushes the multi-recorded video selected by the user and the found images to the gallery, and displays them in the gallery.
  • a user interface 40b as shown in FIG. 4b can be used as an example.
  • the electronic device A sends the video B, the image B2, the image B3 and the image B4 to the electronic device B.
  • electronic device B receives video B, image B2, image B3, and image B4, it can analyze the Tag information in video B, and the associated fields in image B2, image B3, and image B4, and according to the analyzed Tag information, and associated fields in image B2, image B3, and image B4 associate video B with image B2, image B3, and image B4, so that video B can be displayed as shown in FIG. 4b.
  • Electronic device A sends the above-mentioned video B, image B2, image B3, and image B4 to electronic device C, and after electronic device C receives video B, image B2, image B3, and image B4, it cannot parse the Tag information in video B, and
  • the associated fields in image B2, image B3, and image B4 can respectively display video B, image B2, image B3, and image B4, and the following uses Fig. 9a to Fig. 9c as examples for illustration.
  • the electronic device C stores the received video B, image B2, image B3 and image B4 in the gallery.
  • electronic device C displays a user interface 90a as shown in FIG. 9a, and user interface 90a is the gallery interface of electronic device C.
  • the gallery control 92 has been selected, and the user interface 90a includes: a thumbnail image 911 of the video B, a thumbnail image 912 of the image B2, a thumbnail image 913 of the image B3, and a thumbnail image 914 of the image B4.
  • the user selects the thumbnail 911 of the video B in the user interface 90a, and the electronic device C displays the user interface 90b as shown in FIG. 9b.
  • the user interface 90b is the playback interface of the video B.
  • the user interface 90b includes: a return control 93, a display area 94, a progress bar 951, a pause control 952, a play time 953, a total time 954, and a thumbnail display area 96.
  • the electronic device C detects the click operation for the return control 93, and in response to the operation, the electronic device C returns to the user interface 90a; the display area 94 is used to play the video B; the progress bar 951 is used to display the playback progress of the video B; the electronic device C detects In response to an operation on the pause control 952, the electronic device C stops playing the video B.
  • the thumbnail display area 96 can be used to display thumbnails of other videos in the gallery, and can also be used to display thumbnails of other images and videos in the gallery.
  • the electronic device C detects a click operation on the thumbnail 913, and the electronic device C displays the user interface 90c as shown in FIG. 9c.
  • the user interface 90c is the display interface of the image B3.
  • the user interface 90c includes: a return control 93 , a display area 94 , a share control 971 , a favorite control 972 , an edit control 973 , a delete control 974 and a “more” function control 975 .
  • FIG. 10 is a schematic diagram of an abstract flowchart according to an embodiment of the present application.
  • the electronic device displays a camera interface (CameraView) through the VideoBrowerView function, and the user performs video recording on the camera interface of the electronic device.
  • the electronic device records video (CreateMultimedia) based on the video recording service (CreateMultidiaServer), and adds video tags (InserVideoTag) and/or image tags (InsertImageExif) based on the tagging service (AddTagServer) in real time; Encode (EncodeVideoAndTag).
  • the electronic device then calls the data interface (DataInterface) to insert the data (InsertData), inserts the encoded video into the image set (Album db) of the main database (MediaProvider), and the electronic device also passes the encoded video through the storage service (StorageServer) Stored in Read-OnlyMemory.
  • DataInterface data interface
  • StorageServer StorageServer
  • the gallery database MediaLibrary
  • MagneticShot db can get wonderful photo data (MagicShot db) from the main database.
  • FIG. 11 it is a flowchart of a video processing method provided by an embodiment of the present application.
  • the method can be applied to the electronic device shown in FIG. 1 , and as shown in FIG. 11 , it mainly includes the following steps.
  • the above-mentioned first interface of the camera application may be a shooting interface of the electronic device under the camera application.
  • the first interface of the above-mentioned camera application may be the user interface 30b
  • the first preview image may be the image displayed in the preview area 311 of the user interface 30b
  • the first control may be the virtual shutter control 316 .
  • the electronic device In response to the first operation acting on the first control, the electronic device starts recording a first video and displays a second interface of the camera application, where the second interface of the camera application includes: a second preview image and a second control.
  • the above-mentioned first operation may be a click operation on the virtual shutter control 316 .
  • the second interface of the above-mentioned camera application may be as shown in the user interface 30d of FIG.
  • the electronic device obtains the first image.
  • the second operation acting on the second control may be a click operation on the camera control 327 .
  • the first image is obtained by taking pictures during the recording of the first video by the electronic video.
  • the first interface of the above-mentioned gallery application may be a user interface 40a as shown in FIG. 4a.
  • the first video can be the video B in the above-mentioned embodiment
  • the first thumbnail corresponding to the first video can be the thumbnail 42 corresponding to the video B
  • the first image can be the image B1 in the above-mentioned embodiment
  • the first image corresponds to
  • the second thumbnail image may be the thumbnail image 43 .
  • the above third operation may be an operation of clicking the thumbnail 42 .
  • the second interface of the above-mentioned gallery application can be the user interface 40b as shown in FIG. 4b, the second image can be the image B3 in the above-mentioned embodiment, and the second image can also be obtained by fusing multiple frames of video in the first video Image.
  • the third thumbnail of the second image may be a thumbnail 4103 .
  • the second interface of the above-mentioned gallery application can also be different from the user interface 40b.
  • the first thumbnail and the third thumbnail can be displayed in the second interface of the gallery application.
  • the electronic device detects an operation on the first thumbnail, In response to this operation, the user interface 40b is displayed again.
  • the electronic device when the electronic device turns on the "one record multiple" function, the electronic device automatically generates an image associated with the recorded video, and the image can be used as a wonderful photo of the video.
  • the gallery display interface of the photo album application thumbnails of manually recorded videos and manually captured images are displayed, and the images associated with the videos are displayed after the electronic device detects an operation on the videos.
  • the second interface of the gallery application further includes the first video.
  • the first video may be the video displayed in 401 .
  • the first video in response to the third operation acting on the first thumbnail, is played silently in the second interface of the gallery application, and the second interface of the gallery application further includes: a progress bar, a third control and the fourth control, the method further includes: responding to the fourth operation acting on the third control, pausing the playing of the first video; responding to the fifth operation acting on the fourth control, playing the sound of the first video; and responding to the progress
  • the sixth operation of the bar is to adjust the playback progress of the first video.
  • the third control may be the stop playback control 4021
  • the fourth control may be the sound switch 4022
  • the progress bar may have a progress control control 4023
  • the electronic device detects that the progress is not correct. Control the dragging operation of the control control 4023, and in response to this operation, the electronic device 100 jumps to the position where the progress control control 4023 is located to play.
  • the above method further includes: in response to the seventh operation acting on the third thumbnail, displaying The third interface of the gallery application, the third interface of the gallery application includes: a first thumbnail, a second image, and a third thumbnail.
  • the above-mentioned seventh operation may be a click operation on the thumbnail 4613 .
  • the third interface of the gallery application may be a user interface 40c as shown in FIG. 4c, and may also be a user interface independently displaying the second image.
  • the first thumbnail is larger than the third thumbnail; and in the third interface of the gallery application, the third thumbnail is larger than the first thumbnail.
  • the above method further includes: displaying the fourth interface of the gallery application, where the fourth interface of the gallery application includes the first folder; in response to the eighth operation acting on the first folder, displaying the gallery application
  • the fifth interface of the gallery application the fifth interface of the gallery application includes the third thumbnail; in response to the ninth operation acting on the third thumbnail, the sixth interface of the gallery application is displayed, after the first video recording is completed, the sixth interface of the gallery application
  • the interface automatically includes the second image.
  • the fourth interface of the above-mentioned gallery application may be a user interface 40d as shown in FIG. 4d.
  • the above-mentioned first folder may be a one-record-multiple folder 464 .
  • the above-mentioned eighth operation may be a click operation on the one-record folder 464 .
  • the above-mentioned ninth operation may be an operation on the third thumbnail image, and in response to the ninth operation, the second image is displayed on the sixth interface of the gallery application.
  • the sixth interface of the gallery application further includes: a first thumbnail image and a third thumbnail image.
  • the sixth interface of the gallery application may be the user interface 40e shown in FIG. 4e, and the third thumbnail image may be the thumbnail image 4613 in the user interface 40e.
  • the fourth interface of the gallery application further includes a second folder
  • the above method further includes: in response to the tenth operation acting on the second folder, displaying the seventh interface of the gallery application, in the After the video recording is completed, the seventh interface automatically includes the second thumbnail.
  • the above-mentioned second folder may be the camera folder 461 in the user interface 40d.
  • the electronic device detects an operation on the camera folder 461 and displays thumbnails of images manually captured by the electronic device, such as the second thumbnail.
  • the second interface of the camera application further includes a fifth control
  • the above method further includes: in response to the eleventh operation acting on the fifth control, the electronic device finishes recording the first video and displays the first interface of the camera application, and the first interface of the camera application further includes a sixth control; in response to the eleventh operation acting on the fifth control
  • the twelfth operation of the six controls is to display the second interface of the gallery application.
  • the above-mentioned fifth control may be the stop recording control 326 in the user interface 30d.
  • the electronic device ends the recording of the first video and displays the user interface 30b as shown in FIG. 3b.
  • the sixth control It may be a gallery control 315 in the user interface 30b, and in response to a click operation on the gallery control 315, the electronic device displays the user interface 40b.
  • the above method further includes: responding to the electronic device being in the first Shoot the first video in the first shooting mode, and acquire the second image during the recording of the first video; in response to the second video being shot in the second shooting mode of the electronic device, during the recording of the second video, the Get the image from the second video.
  • the above-mentioned first shooting mode may be the "one record multiple” mode, and the way to enable the "one record multiple” mode may be as shown in FIG. 3c, which will not be repeated here.
  • the above method before displaying the second interface of the gallery application in response to the third operation acting on the first thumbnail, the above method further includes: parsing the first video corresponding to the first thumbnail to obtain the second video A group identifier corresponding to a video; searching for an image having the same group identifier as that of the first video, and determining that the found image is the second image.
  • the method for the user to view the video can be as shown in FIG. 7 .
  • Finding an image with the same group identifier as the first video and determining that the found image is the second image can be as shown in step 704 , which will not be repeated here.
  • the file header information of the first video includes tag information, and the tag information includes the group identifier of the first video; and the image file of the second image includes the group identifier of the second image, and the group identifier of the second image
  • the group identifier is the same as the group identifier of the first video.
  • Tag information can be added at the end of the file header information of the first video, and the tag information includes the group identification of the first video; and the group identification of the second image is added in the image file of the second image, the group identification of the second image is the same
  • the steps in which the group identifiers of a video are the same can be shown as S505 to S512 in FIG. 5 , and will not be repeated here.
  • the database includes a first field, and the first field includes a group identifier of the first video and a group identifier of the second image.
  • the above-mentioned first field may be ai_video_group_id as shown in FIG. 6 , and how it is specifically shown in FIG. 6 will not be repeated here.
  • the database includes a second field, and the second field corresponding to the first video is used to describe the number of images having the same group identifier as the first video.
  • the above-mentioned second field may be wonder_photo_count as shown in FIG. 6 , and how it is specifically shown in FIG. 6 will not be repeated here.
  • the file header information of the first video includes the first identifier
  • the image file of the third image includes the second identifier
  • the first identifier is associated with the second identifier
  • the second identifier of the gallery application The interface also includes a fourth thumbnail of the third image.
  • the above-mentioned first identifier of the first video may be a group identifier of the first video
  • the second identifier of the third image may be a group identifier of the third image. If the second identification of the third image is changed in the database to be related to the first identification, when the second interface of the gallery application is displayed, the fourth thumbnail of the third image will be displayed in the second interface of the gallery application , similarly, the fourth thumbnail of the third image will also be displayed on the first interface of the gallery application.
  • the first identifier is the same as the second identifier.
  • An embodiment of the present application also provides an electronic device, including the above-mentioned processor.
  • the electronic device provided in this embodiment may be the terminal device 100 shown in FIG. 1 , and is configured to execute the above video processing method.
  • the electronic device may include a processing module, a memory module, and a memory module.
  • the processing module can be used to control and manage the actions of the terminal device, for example, can be used to support the terminal device to execute the steps performed by the display unit, the detection unit and the processing unit.
  • the storage module can be used to support the terminal device to execute and store program codes and data.
  • the storage module can be used to support the communication between the terminal device and other devices.
  • the processing module may be a processor or a controller. It can implement or execute the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processor can also be a combination of computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (digital signal processing, DSP) and a microprocessor, and the like.
  • the storage module may be a memory.
  • the communication module may be a device that interacts with other terminal devices, such as a radio frequency circuit, a Bluetooth chip, and a Wi-Fi chip.
  • the terminal device involved in this embodiment may be a device having the structure shown in FIG. 1 .
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores instructions, and when it is run on a computer or a processor, the computer or the processor executes one of the above-mentioned methods or multiple steps.
  • the computer-readable storage medium may be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, among others.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, among others.
  • the embodiment of the present application also provides a computer program product including instructions.
  • Another embodiment of the present application also provides a computer program product. When the computer program product is run on the computer or the processor, the computer or the processor is made to perform one or more steps in any one of the above methods.
  • the electronic equipment, computer-readable storage medium, and computer program product provided in this embodiment are all used to execute the corresponding method provided above. Therefore, the beneficial effects that it can achieve can refer to the corresponding method provided above. The beneficial effects in the method will not be repeated here.
  • the disclosed devices and methods may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components can be combined or It may be integrated into another device, or some features may be omitted, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • a unit described as a separate component may or may not be physically separated, and a component shown as a unit may be one physical unit or multiple physical units, which may be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • an integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium Among them, several instructions are included to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods in various embodiments of the present application.
  • the aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请实施例提供了一种视频的处理方法、电子设备及计算机可读存储介质，该视频的处理方法包括：显示相机应用的第一界面，相机应用的第一界面包括第一控件；响应作用于第一控件的第一操作，开始录制第一视频并显示相机应用的第二界面，相机应用的第二界面包括第二控件；响应作用于第二控件的第二操作，电子设备得到第一图像；在第一视频录制完成后显示图库应用的第一界面，图库应用的第一界面包括：第一视频对应的第一缩略图和第一图像对应的第二缩略图；响应作用于第一缩略图的第三操作，显示图库应用的第二界面，图库应用的第二界面包括：第一缩略图和第二图像的第三缩略图，第二图像为从第一视频中自动获取的图像。以上方法可以提升用户体验。

Description

视频的处理方法、电子设备和可读存储介质
本申请要求于2022年02月28日提交中国国家知识产权局、申请号为202210191809.1、发明名称为“视频的处理方法、电子设备和可读存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及智能终端技术领域，具体涉及一种视频的处理方法、电子设备和可读存储介质。
背景技术
如今，随着智能终端技术的不断发展，越来越多的用户喜欢使用手机中的相机功能进行拍照和摄像，以此来记录生活中的点点滴滴。但目前手机所提供的功能仍然无法满足用户对趣味性的要求。
发明内容
本申请提供了一种视频的处理方法、电子设备和可读存储介质，能够提高用户查看视频和与视频关联的图像的便捷程度。
第一方面，提供了一种视频的处理方法，包括：显示相机应用的第一界面，相机应用的第一界面包括：第一预览图像和第一控件；响应作用于第一控件的第一操作，电子设备开始录制第一视频并显示相机应用的第二界面，相机应用的第二界面包括：第二预览图像和第二控件；响应在录制第一视频的过程中作用于第二控件的第二操作，电子设备得到第一图像；在第一视频录制完成后，显示图库应用的第一界面，图库应用的第一界面包括：第一视频对应的第一缩略图和第一图像对应的第二缩略图；响应作用于第一缩略图的第三操作，显示图库应用的第二界面，其中，图库应用的第二界面包括：所述第一缩略图和第二图像的第三缩略图，第二图像为从第一视频中自动获取的图像。
在本申请的上述实施例中，在电子设备开启“一录多得”功能的情况下，电子设备自动生成与录像得到的视频相关联的图像，该图像可以作为视频的精彩照片。在图库应用的相册显示界面中，显示手动录制的视频和手动拍摄的图像的缩略图，在电子设备检测到对视频的选中操作后，再显示与视频关联的图像。通过这样的展示方式，避免了与视频关联的图像对图库显示界面的干扰，又可以展示出视频和与其关联的图像之间的关联关系，从而达到了便于用户查看的目标。
在一个可能的实施方式中，图库应用的第二界面还包括第一视频。
在一个可能的实施方式中，响应作用于第一缩略图的第三操作，第一视频在图库应用的第二界面中静音播放，图库应用的第二界面还包括：进度条、第三控件和第四控件，上述方法还包括：响应作用于第三控件的第四操作，暂停播放第一视频；响应作用于第四控件的第五操作，播放第一视频的声音；和响应作用于进度条的第六操作，调整第一视频的播放进度。
在一个可能的实施方式中，在响应作用于第一缩略图的第三操作，显示图库应用的第二界面之后，上述方法还包括：响应作用于第三缩略图的第七操作，显示图库应用的第三 界面，图库应用的第三界面包括：第一缩略图、第二图像和第三缩略图。
在一个可能的实施方式中，在图库应用的第二界面中，第一缩略图大于第三缩略图；且在图库应用的第三界面中，第三缩略图大于第一缩略图。
在一个可能的实施方式中，上述方法还包括：显示图库应用的第四界面，图库应用的第四界面包括第一文件夹；响应作用于第一文件夹的第八操作，显示图库应用的第五界面，图库应用的第五界面包括第三缩略图；响应作用于第三缩略图的第九操作，显示图库应用的第六界面，在第一视频录制完成后，图库应用的第六界面自动包括第二图像。
在一个可能的实施方式中，图库应用的第六界面还包括：第一缩略图和第三缩略图。
在一个可能的实施方式中，图库应用的第四界面还包括第二文件夹，上述方法还包括：响应作用于第二文件夹的第十操作，显示图库应用的第七界面，在第一视频录制完成后，第七界面自动包括第二缩略图。
在一个可能的实施方式中，相机应用的第二界面还包括第五控件，在响应作用于第一控件的第一操作，电子设备开始录制第一视频并显示相机应用的第二界面之后，上述方法还包括：响应作用于第五控件的第十一操作，电子设备结束录制第一视频并显示相机应用的第一界面，相机应用的第一界面还包括第六控件；响应作用于第六控件的第十二操作，显示图库应用的第二界面。
在一个可能的实施方式中，在响应作用于第一控件的第一操作，电子设备开始录制第一视频并显示相机应用的第二界面之前，上述方法还包括：响应于电子设备处于第一拍摄模式下拍摄第一视频，在录制第一视频的过程中，获取第二图像；响应于电子设备处于第二拍摄模式下拍摄第二视频，在录制第二视频的过程中，不自动从第二视频中获取图像。
在一个可能的实施方式中，在响应作用于第一缩略图的第三操作，显示图库应用的第二界面之前，上述方法还包括：解析第一缩略图对应的第一视频，得到第一视频对应的分组标识；查找与第一视频具有相同分组标识的图像，并确定查找到的图像为第二图像。
在一个可能的实施方式中，第一视频的文件头信息包括标签信息，标签信息包括第一视频的分组标识；以及第二图像的图像文件包括第二图像的分组标识，第二图像的分组标识与第一视频的分组标识相同。
在一个可能的实施方式中，数据库中包括第一字段，第一字段包括第一视频的分组标识和第二图像的分组标识。
在一个可能的实施方式中，数据库中包括第二字段，第一视频对应的第二字段用于描述与第一视频具有相同分组标识的图像的数量。
在一个可能的实施方式中，第一视频的文件头信息中包括第一标识，第三图像的图像文件中包括第二标识，第一标识与第二标识相关联，图库应用的第二界面中还包括第三图像的第四缩略图。
在一个可能的实施方式中，第一标识与第二标识相同。
第二方面，本申请提供了一种电子设备，包括：一个或多个处理器、存储器，摄像头和显示屏；存储器、摄像头和显示屏与一个或多个处理器耦合，存储器用于存储计算机程序代码，计算机程序代码包括计算机指令，当一个或多个处理器执行计算机指令时，电子设备执行如第一方面任意一项的视频的处理方法。
第三方面，本申请提供了一种计算机可读存储介质，用于存储计算机程序，计算机程序被电子设备执行时，使得所述电子设备实现如第一方面中任意一项的视频的处理方法。
第四方面，本申请提供了一种计算机程序产品，当计算机程序产品在计算机上运行时，使得计算机执行如第一方面中任意一项的视频的处理方法。
附图说明
图1是本申请实施例提供的一例终端设备100的结构示意图；
图2是本申请实施例提供的终端设备100的软件结构框图；
图3a是本申请实施例提供的第一种图形用户界面的示意图；
图3b是本申请实施例提供的第二种图形用户界面的示意图；
图3c是本申请实施例提供的第三种图形用户界面的示意图；
图3d是本申请实施例提供的第四种图形用户界面的示意图；
图4a是本申请实施例提供的第五种图形用户界面的示意图；
图4b是本申请实施例提供的第六种图形用户界面的示意图；
图4c是本申请实施例提供的第七种图形用户界面的示意图；
图4d是本申请实施例提供的第八种图形用户界面的示意图；
图4e是本申请实施例提供的第九种图形用户界面的示意图；
图5是本申请实施例提供的一种电子设备在“一录多得”模式下录制视频的交互图；
图6是本申请实施例的这一种在ML中关联存储一录多得视频和精彩照片的示意图；
图7是本申请实施例的一种用户查看视频的交互图；
图8是本申请实施例的一种电子设备分享视频和图像的交互图；
图9a是本申请实施例提供的第十种图形用户界面的示意图；
图9b是本申请实施例提供的第十一种图形用户界面的示意图；
图9c是本申请实施例提供的第十二种图形用户界面的示意图；
图10是本申请实施例提供的一种抽象流程图示意图；
图11是本申请实施例提供的一种视频的处理方法的流程图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；本文中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”、“第三”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”、“第三”的特征可以明示或者隐含地包括一个或者更多个该特征。
本申请实施例提供的视频的处理方法可以应用于手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等终端设备上，本申请实施例对终端设备的具体类型 不作任何限制。
示例性的，图1是本申请实施例提供的一例终端设备100的结构示意图。终端设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
可以理解的是，本申请实施例示意的结构并不构成对终端设备100的具体限定。在本申请另一些实施例中，终端设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
其中，控制器可以是终端设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对终端设备100的结构限定。在本申请另一些实施例中，终端设备100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
在一些实施例中，终端设备100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得终端设备100可以通过无线通信技术与网络以及其它设备通信。所 述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
终端设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，终端设备100可以包括1个或N个显示屏194，N为大于1的正整数。
终端设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。
终端设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195，或从SIM卡接口195拔出，实现和终端设备100的接触和分离。终端设备100可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡，Micro SIM卡，SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同，也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。终端设备100通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，终端设备100采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在终端设备100中， 不能和终端设备100分离。
终端设备100的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的Android系统为例，示例性说明终端设备100的软件结构。
图2是本申请实施例的终端设备100的软件结构框图。分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层，安卓运行时(Android runtime)和系统库，以及内核层。应用程序层可以包括一系列应用程序包。
如图2所示，应用程序包可以包括相机，图库，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图2所示，应用程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供终端设备100的通信功能。例如通话状态的管理(包括接通，挂断等)。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，终端设备振动，指示灯闪烁等。
Android runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(media libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。
用户在使用手机中的相机功能拍摄视频时，可能还想获得一些与视频相关联的图片，例如视频中的精彩画面等。在用户拍摄视频的过程中，或在用户拍摄视频之后，可以从视频中抽取出精彩画面，从而得到与视频相关的图片。为了便于用户查看，获得更好的显示效果，在本申请实施例中，将视频和与视频关联的图像在存储时进行关联，从而在用户播放视频时，能够将视频和与视频相关联的图片进行关联显示，进而达到了便于用户查看的效果。
首先结合图3a-图3c对本申请实施例提供的视频的处理方法的应用场景进行说明。图3a-图3c是本申请实施例的一种开启一录多得功能的示意图。
如图3a所示，用户界面30a为电子设备100的主界面，在该主界面中包括相机图标31以及其它功能图标。电子设备100检测到针对相机图标31的点击操作，响应于上述操作，显示如图3b所示的用户界面30b。
用户界面30b为电子设备100的拍摄界面，在用户界面30b中，包括预览区域311、变焦倍率调节控件313、功能区域314、图库控件315、虚拟快门控件316、回显控件317、功能指示图标318以及设置控件319。预览区域311用于显示相机拍摄的实时预览图像。变焦倍率调节控件313用于调节预览区域311中预览图片的变焦倍数，其中，1X为1倍变焦倍数，2X为2倍变焦倍数，3X为3倍变焦倍数……以此类推。变焦倍数与图片的焦距呈正相关，变焦倍数越大，图片的焦距越大，拍摄图片中拍摄对象就越大，由图3b可知，当前预览图片的变焦倍数为1倍变焦倍数。回显控件317用于切换电子设备100的前置摄像头和后置摄像头，当电子设备100当前工作的摄像头为后置摄像头的情况下，检测到用户对回显控件317的单击操作，响应该操作，电子设备100将工作摄像头切换为前置摄像头，此时，在预览区域311中，显示前置摄像头获取的预览图像，不显示后置摄像头获取的预览图像；当电子设备100当前工作的摄像头为前置摄像头的情况下，检测到用户对回显控件317的单击操作，响应该操作，电子设备100将工作摄像头切换为后置摄像头，此时，在预览区域311中，显示后置摄像头获取的预览图像，不显示前置摄像头获取的预览图像。当电子设备100检测到针对图库控件315的输入操作后，电子设备100会显示图库界面，从而使得用户可以浏览电子设备100存储的视频或图像。功能区域314包括相机应用当前支持的功能模式，功能区域314包括“夜景”3141、“人像”控件3142、“拍照”控件3143、“录像”控件3144、“多镜录像”控件3145、“更多”控件3146以及功能指示图标318。其中，功能指示图标318用于指示电子设备当前所处的拍摄模式，如图3b所示，功能指示图标318在“录像”控件3144的下方，电子设备100当前的拍摄模式为录像模式。变焦倍 率调节控件313用于调节预览图片的变焦倍率，当电子设备100检测到针对变焦倍率调节控件313的输入操作(例如，上滑)，响应该输入操作，电子设备可以增大预览图片的变焦倍率。
在用户界面30b中，电子设备检测到针对设置控件319的点击操作，响应于该操作，电子设备100显示如图3c所示的用户界面30c。在用户界面30c中，包括多种对拍摄参数和拍摄功能的控制项，其中具有一项一录多得控制项34。用户对一录多得控制项34的开关341进行操作，从而可以改变一录多得功能在开关状态。在用户界面30c中，电子设备100的一录多得功能为关闭状态，用户对一录多得控制项34的开关341进行操作，即可开启电子设备100的一录多得功能。
上述的一录多得功能，可以是在电子设备在拍摄视频的过程中，实时的从电子设备拍摄的视频中抽取一帧或多帧图片作为与视频相关联的图片，从而在电子设备拍摄视频结束后，可以同时得到视频和与视频相关联的图片的一种拍摄功能。从视频中抽取的一帧或多帧图片是电子设备根据预设算法确定的，抽取的一帧或多帧图片可以是根据预设算法对视频中的每帧图片进行打分，并根据打分结果所选择的top N个图片，所选择的top N个图片可以作为视频的精彩照片，即与视频关联的图像。
应当理解的是，上述图3a-图3c仅是对电子设备100开启“一录多得”功能的示例性描述，不应该对本申请实施例的保护范围构成限制，本申请实施例对电子设备100开启“一录多得”功能的方式不做任何限制。
在用户界面30b中，电子设备100检测到针对虚拟快门控件316的点击操作，响应于该操作，电子设备100显示如图3d所示的用户界面30d，并开始录制视频。用户界面30d为电子设备100的视频录制界面，该视频录制界面中包括拍摄预览区域321、录制时间322、变焦倍率调节控件324、暂停录制控件325、停止录制控件326和拍照控件327。其中，拍摄预览区域321用于实时显示当前拍摄的预览图像，录制时间322用于表示当前视频的拍摄时长，在用户界面30d中，当前视频的录制时间为25s。变焦倍率调节控件324显示当前预览图片的变焦倍率，当前的变焦倍率为1倍变焦倍率。变焦倍率调节控件324的相关叙述请参见上述图3b中变焦倍率调节控件313的相关描述，此处不再赘述。暂停录制控件325用于用户暂停图4a当前视频录制，当电子设备100检测到针对暂停录制控件325的点击操作后，响应于该操作，电子设备100暂停录制视频。停止录制控件326用于用户停止录制视频，如图3d所示，当电子设备100检测到针对停止录制控件326的单击操作后，响应于该操作，电子设备100停止录制该视频，得到视频B，并且保存该视频以及与该视频关联的图片B2、B3和B4。拍照控件327用于将录制视频的过程中进行拍照，当电子设备100检测到针对拍照控件327的单击操作后，响应于该操作，电子设备100进行拍照，得到图像B1。
上述图3a-图3c对电子设备100开启“一录多得”功能进行了说明，图3d对电子设备100录制视频进行了说明。下面，结合图4a-图4e，对一录多得视频的播放进行描述，一录多得视频为电子设备100在开启一录多得功能的情况下拍摄得到的视频。
如图3a所示，用户界面30a为电子设备100的主界面，该主界面包括图库图标32和 其它应用图标。电子设备100检测到针对图库图标32的点击操作，响应于该操作，电子设备100显示如图4a所示的用户界面40a。
如图4a所示，用户界面40a为图库显示界面，该图库显示界面包括视频和照片的缩略图，视频和照片的缩略图按照日期由近至远排列。用户界面40a包括：图像A对应的缩略图41、视频B对应的缩略图42、图像B1对应的缩略图43和视频C对应的缩略图44，其中，在缩略图42上包括一时间信息421，时间信息421用于表示视频B的时长为00:08；在缩略图42上，还包括“AI”标识422，“AI”标识422用于表示视频B为一录多得视频，也即，电子设备在拍摄视频B时开启了“一录多得”功能。缩略图44上不具有“AI”标识，也即电子设备100在拍摄视频C时未开启“一录多得”功能。
在用户界面40a中，电子设备100检测到针对缩略图42的点击操作，响应于该操作，电子设备100显示如图4b所示的用户界面40b。用户界面40b为一录多得视频B的显示界面1。用户界面40b包括：显示区域401、播放进度条402、分享控件403、收藏控件404、编辑控件405、删除控件406、“更多”功能控件407、返回控件408、视频B的拍摄时间409，以及缩略图显示区域410。在播放进度条402中，还包括停止播放控件4021、声音开关4022以及进度控制控件4023。在用户界面40b中，视频B处于播放状态，当电子设备100检测到针对停止播放控件4021的操作时，响应于该操作，电子设备100暂停播放视频B。在用户界面40b中，视频B处于静音状态，当电子设备100检测到针对声音开关4022的操作时，响应于该操作，电子设备100开启视频B的声音。在用户界面40b中，视频B播放至00：05处，电子设备检测到针对进度控制控件4023的拖动操作，响应于该操作，电子设备100跳转至进度控制控件4023所在的位置进行播放。缩略图显示区域410包括视频B的缩略图4101、与视频B关联的图像B2的缩略图4102、与视频B关联的图像B3的缩略图4103以及与视频B关联的图像B4的缩略图4104。其中，当前显示的视频B对应的缩略图4101的大小大于缩略图4102、缩略图4103和缩略图4104。
电子设备100检测到针对缩略图4103的点击操作，响应于该操作，电子设备100显示如图4c所示的用户界面40c。在用户界面40c的显示区域401中显示缩略图4103对应的图像B3。缩略图4103的大小大于缩略图4101、缩略图4102和缩略图4104。
可以理解的是，在用户界面40b中，如果电子设备100检测到针对缩略图4102的点击操作，则电子设备100在显示区域401中显示图像B2；如果电子设备100检测到针对缩略图4104的点击操作，则电子设备100在显示区域401中显示图像B4。
仍在用户界面40a中，电子设备100检测到针对相册控件46的点击操作，响应该操作，电子设备显示如图4d所示的用户界面40d。图4d展示了图库的相册展示界面，该相册展示界面以文件夹的形式展示手机保存的照片及视频。示例性的，图4d展示的相册展示界面包括：相机文件夹461、所有照片文件夹462、视频文件夹463以及一录多得文件夹464。当然，相册展示界面还可以包括其他文件夹，本申请并不限制相机展示界面展示的文件夹。相机文件夹461可以包括手机通过摄像头拍摄的照片和视频，所有照片文件夹462可以包括手机保存的照片和视频，视频文件夹463可以包括手机保存的视频，一录多得文件夹464可以包括电子设备100在一录多得模式下，获取的图像。
在用户界面40d中，电子设备100检测到针对一录多得文件夹464的点击操作，电子 设备显示如图4e所示的用户界面40e。用户界面40e为一录多得文件夹的展示界面。用户界面40e中包括图像B2的缩略图4612、图像B3的缩略图4613以及图像B4的缩略图4614。在该示例中，缩略图4612、缩略图4613以及缩略图4614的大小相同，在一些其他的示例中，缩略图4612、缩略图4613以及缩略图4614的大小可以有所区别，且排列顺序也可以与该示例不同。
上述图4a至图4e对一录多得视频的播放进行了说明，图5是根据本申请实施例的一种电子设备在一录多得的模式下录制视频的交互图，下面结合图5，对电子设备在一录多得模式下录制视频的方式进行描述，在下述示例中，电子设备已开启了“一录多得”功能。
S501，开始录制视频。
上述步骤可以在用户界面30b中执行。电子设备检测到针对虚拟快门控件316的点击操作，响应于该操作，电子设备开始录制视频。
S502，将拍摄的视频帧实时发送至BestMoment算法。
上述步骤中，Camera将拍摄的视频帧实时发送至BestMoment算法，BestMoment算法用于获取视频中BestShots的时间点。
示例性的，BestMoment算法可以根据视频中每帧图像的光照参数、景深参数等参数筛选出BestShots的时间点。
S503，确定BestShots时间点。
BestShots时间点即为通过BestMoment算法运算得到的精彩时刻，该时间点可以通过时间戳表示。
S504，返回BestShots时间点。
在上述步骤中，BestMoment算法将获取的BestShots时间点返回至相机解析服务。
S505，根据BestShots时间点抽取关键帧作为精彩照片。
相机解析服务根据BestShots时间点，从视频中抽取出精彩照片，从而得到与视频关联的图像。
在一些情况下，BestMoment算法可以向相机解析服务返回多个BestShots时间点，相机解析服务可以在BestMoment算法返回的多个BestShots时间点中筛选出N个时间点，并根据筛选得到的N个时间点从视频中抽取精彩照片。
示例性的，相机解析服务中可以设置一个数量阈值N，在BestMoment算法返回的BestShots时间点的数量大于上述数量阈值N的情况下，从BestMoment算法返回的BestShots时间点中筛选出N个精彩照片的时间点，筛选的方法可以是对BestShots时间点对应的图片进行打分，并选择得分Top N个时间点作为精彩照片的时间点；在BestMoment算法返回的BestShots时间点的数量小于上述数量阈值N的情况下，可以直接将BestMoment算法返回的BestShots时间点作为精彩照片的时间点。
示例性的，BestMoment算法也可以向相机解析服务返回0个BestShots时间点。也即BestMoment算法没有从视频中筛选出BestShots时间点，在这种情况下，虽然开启了“一录多得”功能，但视频不具有关联的精彩照片。
S506，为视频新增后缀Tag，为精彩照片新增关联字段。
为视频中新增后缀Tag，可以是以JOSN信息的方式将Tag插入到视频的尾部；为精彩 照片新增关联字段可以是将关联字段插入到精彩照片的Exif中。相机解析服务在抽取出精彩照片后，为视频新增后缀Tag，并为精彩图像新增关联字段。下面分别进行说明。
示例性的，以MPEG-4格式的视频为例，MPEG-4格式的视频文件具有文件头信息。MPEG-4格式的视频的文件头信息主要可以包括General、Video、和Audio三个部分。其中，General中可以包括视频的概括信息，例如：视频大小(File size)、视频时长(Duration)、总比特率(Overall bit rate)、编码日期(Encoded date)以及安卓系统版本(com.android.version)等；Video中可以包括视频文件中的视频信息，Audio中可以包括视频文件中的声音信息。在播放视频时，需要对该文件头信息进行解析得到对应的解码方式，从而使用对应的解码方式对视频文件进行解码。
Tag信息可以增加在文件头信息之后。例如：
Figure PCTCN2022140626-appb-000001
Figure PCTCN2022140626-appb-000002
上述Tag信息主要包括：视频时长、分组ID、是否开启背景音乐、镜头切换信息、精彩时刻以及视频类型等，下面分别进行说明。
"duration":"47122"用于描述视频时长；
"id":"71a301ab3fb54f2a9a4f54c74c646888"用于描述分组ID，一个一录多得视频和与其关联的精彩照片属于同一分组，因此具有相同的分组ID；
"isBgmOn":true用于描述开启背景音乐；
"lensInformations"用于描述镜头切换信息；
"magicMoment"用于描述视频中的精彩照片，在"magicMoment"中，"bestShots"即为BestMonment算法输出的bestShots时间点，"wonderPhotoCnt":3表示在该示例中选择了3张精彩照片；在该示例中，"bestShots"包括了20个时间戳，即BestMoment算法向相机解析服务返回了20个BestShots时间点；"wonderPhotoCnt":3，也即相机解析服务从中筛选出3个精彩照片；
"type":"MagicMomentMovie"用于描述该视频类型为一录多得视频。
精彩照片的关联字段可以增加在精彩照片的Exif信息中，例如：
[图像信息]
图像宽度＝4096
图像高度＝2304
图像标题＝magicmoment71a301ab3fb54f2a9a4f54c74c646888
厂商＝unknown
机型＝unknown
方向＝上/左
水平分辨率＝72
垂直分辨率＝72
分辨率单位＝英寸
修改时间＝2022-02-08 11:16:40
YCbCr定位＝居中
Exif IFD Pointer＝偏移:266
GPS Info IFD Pointer＝偏移:860
[相机拍摄记录]
曝光时间＝1/100"
光圈＝F1.8
曝光程序＝标准程序
ISO感光度＝115
Exif版本＝V2.2
拍摄时间＝2022-02-08 11:16:40
数字化时间＝2022-02-08 11:16:40
9010＝+08:00
9011＝+08:00
成分构成＝YCbcr
TV快门速度＝6.64TV
AV光圈值＝1.69AV
BV亮度值＝0.18BV
曝光补偿＝±0EV
最大光圈＝F1.8
测光模式＝未知
光源＝其他光源
闪光＝关闭(强制)
焦距＝5.53mm
厂商注释＝5Byte
次秒(修改时间)＝0.361025"
次秒(拍摄时间)＝0.361025"
次秒(数字化时间)＝0.361025"
Flashpix版本＝V1.0
色彩空间＝sRGB
Exif图像宽度＝4096
Exif图像高度＝2304
Interoperability IFD Pointer＝偏移:829
传感类型＝未定义
场景类型＝1
曝光模式＝自动
白平衡＝自动
等价35mm焦距＝23mm
场景拍摄类型＝标准
[GPS全球定位]
[可交换信息]
可交换标准＝ExifR98
可交换版本＝V1.0
[缩略图信息]
压缩模式＝JPEG压缩(缩略图)
方向＝上/左
水平分辨率＝72
垂直分辨率＝72
分辨率单位＝英寸
JPEG缩略图起始位置＝偏移:996
JPEG缩略图数据长度＝长度:10529
A002＝256
A003＝144
[缩略图]
缩略图像＝256x 144
其中，新增的关联字段为：
“图像标题＝magicmoment71a301ab3fb54f2a9a4f54c74c646888”。
“71a301ab3fb54f2a9a4f54c74c646888”即为该图像的分组ID。
S507，将视频和精彩的信息写入MP。
MP(MediaProvider)为电子设备的主数据库，Server在为视频增加后缀Tag，并在精彩照片的Exif中增加关联字段后，将视频和精彩照片的信息写入电子设备的MP。Server还将视频和精彩照片存储至电子设备的存储系统。
S508，通过广播触发Server获取视频和精彩照片的信息。
ML(MediaLibrary)为电子设备的图库数据库，在Server将视频和精彩照片的信息写入MP后，MP对写入新数据的事件进行广播，该广播触发Server获取视频和精彩照片的信息，Server获取的视频和精彩照片的信息包括视频和精彩照片的存储路径以及文件名。
S509，将视频和精彩照片的信息插入ML。
Server将从ML处获取的视频和精彩照片的信息插入ML。
S510，根据视频和精彩照片的信息读取视频和精彩照片。
图库解析服务根据视频和精彩照片的存储路径以及文件名，从电子设备的存储系统中读取视频和精彩照片。
S511，解析视频和精彩照片，得到视频和精彩照片的关联字段。
图库解析服务解析获得的视频和精彩照片，得到视频和精彩照片的关联字段。上述关联字段可以是写在视频文件头信息中的分组ID和写在精彩照片的Exif中的分组ID。
S512，将关联字段写入ML。
图库解析服务将关联字段写入ML，可以根据视频和精彩照片的分组ID，更新ML中的分组ID字段。
图6是根据本申请实施例的这一种在ML中关联存储一录多得视频和精彩照片的示意图。结合图6所示，_id字段用于存储图像文件(视频或图像)的主键；_data字段用于存储图像文件的存储路径；_size用于存储图像文件的大小，_dispaly_name字段用于存储图像文件的显示名称。还具有一字段ai_video_group_id，ai_video_group_id字段用于存储图像文件的分组ID；wonder_photo_count字段用于存储视频对应的精彩照片的数量。
在图6的示例中，第7行视频与第8行图像的ai_video_group_id字段相同，即第7行视频与第8行图像为同一组图像，第8行图像为第7行视频中的精彩照片；wonder_photo_count字段表示第7行的视频具有一个关联图像。相似的，第3行视频和第4行图像为同一组图像，也即第4行图像为第3行视频中的精彩照片，wonder_photo_count字段表示第3行的视频具有一个关联图像。第1、2、5、6行的wonder_photo_count字段为0，表示第1、2、5、6行的一录多得视频不具有关联图像。第9行的视频在ai_video_group_id字段为“(null)”，也即第9行的视频不为一录多得视频。
需要说明的是，ML中还包括更多在图6中没有示出的字段，且6中数据库的结构也仅用于示例，而并不限于此。
上述结合图5对电子设备100在开启“一录多得”功能的情况下录制视频的过程进行了描述，图7是根据本申请实施例的一种用户查看视频的交互图，下面对用户查看视频进行说明。
S701，用户查看视频。
用户可以在电子设备的图库中查看在开启“一录多得”功能下拍摄的视频。一录多得 视频可以和其他视频、图像共同显示在电子设备的图库显示界面中。
结合图3a所示，电子设备100检测到针对图库图标32的点击操作，进入电子设备100的图库。电子设备100显示如图4a所示的用户界面40a，用户界面40a即为电子设备100的图库显示界面。在电子设备100的图库显示界面中，显示视频和图像的缩略图，包括一录多得视频的缩略图，用户可以点击待查看的一录多得视频对应的缩略图以向图库发出查看请求，电子设备100在接收到用户查看视频的操作后，继续执行下述步骤。
S702，通知Server接收到视频查看请求。
在上述步骤中，Gallery通知Server接收到视频查看请求，以触发ML通过聚类查找与视频关联的图像。
S703，获取ML中的关联字段。
上述关联字段可以是如图6所示的ai_video_group_id字段，一录多得视频和关联的图像具有相同的ai_video_group_id字段。
S704，根据关联字段聚合图片视频。
Server根据用户所选的一录多得视频的ai_video_group_id字段查找具有相同ai_video_group_id的图像，并将用户所选的一录多得视频与查找到的图像作为一个分组进行聚类。
S705，推送到图库展示。
Server将用户所选的一录多得视频与查找到的图像推送至图库，在图库中进行显示。如图4b所示的用户界面40b可以作为一种示例。
上述在开启“一录多得”功能下录制的视频和关联图片也可以进行分享。结合图8所示，电子设备A和电子设备B具备解析视频中的Tag信息的能力，且具备解析关联图片Exif信息中的关联字段的能力，电子设备C不具备上述能力。
电子设备A向电子设备B发送上述视频B，图像B2、图像B3以及图像B4。电子设备B接收视频B、图像B2、图像B3以及图像B4之后，可以解析出视频B中的Tag信息，以及图像B2、图像B3、图像B4中的关联字段，并根据解析出的视频B中的Tag信息，以及图像B2、图像B3、图像B4中的关联字段，将视频B和图像B2、图像B3以及图像B4进行关联，从而可以以如图4b中所示的方式显示视频B。
电子设备A向电子设备C发送上述视频B，图像B2、图像B3以及图像B4，电子设备C接收视频B、图像B2、图像B3以及图像B4之后，无法解析出的视频B中的Tag信息，以及图像B2、图像B3、图像B4中的关联字段，但可以分别显示视频B、图像B2、图像B3以及图像B4，下面以图9a至图9c为例进行说明。
电子设备C将接收到的视频B、图像B2、图像B3以及图像B4存储至图库。进入电子设备C的图库，电子设备C显示如图9a所示的用户界面90a，用户界面90a即为电子设备C的图库界面。在用户界面90a中，图库控件92已被选中，用户界面90a中包括：视频B的缩略图911、图像B2的缩略图912、图像B3的缩略图913、图像B4的缩略图914。
用户在用户界面90a中选择视频B的缩略图911，电子设备C显示如图9b所示的用户界面90b。用户界面90b为视频B的播放界面，用户界面90b中包括：返回控件93、显示区域94、进度条951、暂停控件952、播放时间953、总时间954以及缩略图显示区域96。 电子设备C检测到针对返回控件93的点击操作，响应该操作，电子设备C返回用户界面90a；显示区域94用于播放视频B；进度条951用于显示视频B的播放进度；电子设备C检测到针对暂停控件952的操作，响应该操作，电子设备C停止播放视频B。缩略图显示区域96可以用于显示图库中其他视频的缩略图，也可以用于显示图库中其他图像和视频的缩略图。
在用户界面90a中，电子设备C检测到针对缩略图913的点击操作，电子设备C显示如图9c所示的用户界面90c。用户界面90c为图像B3的显示界面，用户界面90c中包括：返回控件93、显示区域94、分享控件971、收藏控件972、编辑控件973、删除控件974以及“更多”功能控件975。
图10是根据本申请实施例的一种抽象流程图示意图，结合图10所示，电子设备通过VideoBrowerView函数显示相机界面(CameraView)，用户在电子设备的相机界面进行视频录制。电子设备基于视频录制服务(CreateMultidiaServer)录制视频(CreateMultimedia)，并实时基于添加标签服务(AddTagServer)增加视频标签(InserVideoTag)和/或图像标签(InsertImageExif)；通过编码服务(EncodeServer)将视频和视频标签进行编码(EncodeVideoAndTag)。电子设备再调用数据接口(DataInterface)插入数据(InsertData)，将编码后的视频插入至主数据库(MediaProvider)的图像集(Album db)中，电子设备还将编码后的视频通过存储服务(StorageServer)存储至Read-OnlyMemory中。图库数据库(MediaLibrary)则可以从主数据库中获取精彩照片数据(MagicShot db)。
参见图11，为本申请实施例提供的一种视频的处理方法的流程图。该方法可应用于图1所示的电子设备，如图11所示，其主要包括以下步骤。
S1101，显示相机应用的第一界面，相机应用的第一界面包括：第一预览图像和第一控件。
上述相机应用的第一界面可以是电子设备在相机应用下的拍摄界面。结合图3b所示，上述相机应用的第一界面可以为用户界面30b，第一预览图像可以为用户界面30b中预览区域311内所显示的图像，第一控件可以为虚拟快门控件316。
S1102，响应作用于第一控件的第一操作，电子设备开始录制第一视频并显示相机应用的第二界面，相机应用的第二界面包括：第二预览图像和第二控件。
仍结合图3b所示，上述第一操作可以是对虚拟快门控件316的点击操作。上述相机应用的第二界面可以如图3d的用户界面30d所示，上述第二预览图像可以是显示在拍摄预览区域321中的图像，第二控件可以为拍照控件327。
S1103，响应在录制第一视频的过程中作用于第二控件的第二操作，电子设备得到第一图像。
仍结合图3d所示，作用于第二控件的第二操作可以是对拍照控件327的点击操作。在上述步骤中，在电子视频录制第一视频的过程中进行拍照，得到第一图像。
S1104，在第一视频录制完成后，显示图库应用的第一界面，图库应用的第一界面包括：第一视频对应的第一缩略图和第一图像对应的第二缩略图。
上述图库应用的第一界面可以是如图4a所示的用户界面40a。第一视频可以是上述实 施例中的视频B，第一视频对应的第一缩略图可以是视频B对应的缩略图42，第一图像可以为上述实施例中的图像B1，第一图像对应的第二缩略图可以为缩略图43。
S1105，响应作用于第一缩略图的第三操作，显示图库应用的第二界面，其中，图库应用的第二界面包括：所述第一缩略图和第二图像的第三缩略图，第二图像为从第一视频中自动获取的图像。
仍结合图4a所示，上述第三操作可以为点击缩略图42的操作。上述图库应用的第二界面可以为如图4b所示的用户界面40b，第二图像可以为上述实施例中的图像B3，第二图像还可以是将第一视频中的多帧视频进行融合得到的图像。第二图像的第三缩略图可以为缩略图4103。
上述图库应用的第二界面还可以与用户界面40b不同，例如，图库应用的第二界面中可以显示第一缩略图和第三缩略图，当电子设备检测到针对第一缩略图的操作时，响应于该操作，再显示用户界面40b。
在本申请的上述实施例中，在电子设备开启“一录多得”功能的情况下，电子设备自动生成与录像得到的视频相关联的图像，该图像可以作为视频的精彩照片。在相册应用的图库显示界面中，显示手动录制的视频和手动拍摄的图像的缩略图，在电子设备检测到对视频的操作后，再显示与视频关联的图像。通过这样的展示方式，避免了与视频关联的图像对图库显示界面的干扰，又可以展示出视频和与其关联的图像之间的关联关系，从而达到了便于用户查看的目标。
在一种可选的实现方式中，图库应用的第二界面还包括第一视频。
以图库应用的第二界面为用户界面40b为例，第一视频可以为显示在401中的视频。
在一种可选的实现方式中，响应作用于第一缩略图的第三操作，第一视频在图库应用的第二界面中静音播放，图库应用的第二界面还包括：进度条、第三控件和第四控件，方法还包括：响应作用于第三控件的第四操作，暂停播放第一视频；响应作用于第四控件的第五操作，播放第一视频的声音；和响应作用于进度条的第六操作，调整第一视频的播放进度。
仍以图库应用的第二界面为用户界面40b为例，第三控件可以为停止播放控件4021，第四控件可以为声音开关4022，进度条上可以具有进度控制控件4023，电子设备检测到对进度控制控件4023的拖动操作，响应于该操作，电子设备100跳转至进度控制控件4023所在的位置进行播放。
在一种可选的实现方式中，在响应作用于第一缩略图的第三操作，显示图库应用的第二界面之后，上述方法还包括：响应作用于第三缩略图的第七操作，显示图库应用的第三界面，图库应用的第三界面包括：第一缩略图、第二图像和第三缩略图。
上述第七操作可以为针对缩略图4613的点击操作。图库应用的第三界面可以为如图4c所示的用户界面40c，还可以是单独显示第二图像的用户界面。
在一种可选的实现方式中，在图库应用的第二界面中，第一缩略图大于第三缩略图；且在图库应用的第三界面中，第三缩略图大于第一缩略图。
在一种可选的实现方式中，上方法还包括：显示图库应用的第四界面，图库应用的第四界面包括第一文件夹；响应作用于第一文件夹的第八操作，显示图库应用的第五界面， 图库应用的第五界面包括第三缩略图；响应作用于第三缩略图的第九操作，显示图库应用的第六界面，在第一视频录制完成后，图库应用的第六界面自动包括第二图像。
上述图库应用的第四界面可以是如图4d所示的用户界面40d。上述第一文件夹可以为一录多得文件夹464。上述第八操作可以是针对一录多得文件夹464的点击操作。上述第九操作可以是针对第三缩略图的操作，响应于第九操作，图库应用的第六界面中显示第二图像。
在一种可选的实现方式中，图库应用的第六界面还包括：第一缩略图和第三缩略图。
图库应用的第六界面可以为如图4e所示的用户界面40e，第三缩略图可以为用户界面40e中的缩略图4613。
在一种可选的实现方式中，图库应用的第四界面还包括第二文件夹，上述方法还包括：响应作用于第二文件夹的第十操作，显示图库应用的第七界面，在第一视频录制完成后，第七界面自动包括第二缩略图。
上述第二文件夹可以为用户界面40d中的相机文件夹461，电子设备检测到针对相机文件夹461的操作，显示通过电子设备手动拍摄的图像的缩略图，例如第二缩略图。
在一种可选的实现方式中，相机应用的第二界面还包括第五控件，在响应作用于第一控件的第一操作，电子设备开始录制第一视频并显示相机应用的第二界面之后，上述方法还包括：响应作用于第五控件的第十一操作，电子设备结束录制第一视频并显示相机应用的第一界面，相机应用的第一界面还包括第六控件；响应作用于第六控件的第十二操作，显示图库应用的第二界面。
上述第五控件可以为用户界面30d中的停止录制控件326，响应于对停止录制控件326的点击操作，电子设备结束录制第一视频，并显示如图3b所示的用户界面30b，第六控件可以是用户界面30b中的图库控件315，响应于对图库控件315的点击操作，电子设备显示用户界面40b。
在一种可选的实现方式中，在响应作用于第一控件的第一操作，电子设备开始录制第一视频并显示相机应用的第二界面之前，上述方法还包括：响应于电子设备处于第一拍摄模式下拍摄第一视频，在录制第一视频的过程中，获取第二图像；响应于电子设备处于第二拍摄模式下拍摄第二视频，在录制第二视频的过程中，不自动从第二视频中获取图像。
上述第一拍摄模式可以为“一录多得”模式，开启“一录多得”模式的方式可以如图3c所示，此处不再赘述。
在一种可选的实现方式中，在响应作用于第一缩略图的第三操作，显示图库应用的第二界面之前，上述方法还包括：解析第一缩略图对应的第一视频，得到第一视频对应的分组标识；查找与第一视频具有相同分组标识的图像，并确定查找到的图像为第二图像。
用户查看视频的方式可以如图7所示，查找与第一视频具有相同分组标识的图像，并确定查找到的图像为第二图像可以如步骤704所示，此处不再赘述。
在一种可选的实现方式中，第一视频的文件头信息包括标签信息，标签信息包括第一视频的分组标识；以及第二图像的图像文件包括第二图像的分组标识，第二图像的分组标识与第一视频的分组标识相同。
可以在第一视频的文件头信息的尾部增加标签信息，标签信息包括第一视频的分组标 识；以及在第二图像的图像文件中增加第二图像的分组标识，第二图像的分组标识与第一视频的分组标识相同的步骤可以如图5中的S505至S512所示，此处不再赘述。
在一种可选的实现方式中，数据库中包括第一字段，第一字段包括第一视频的分组标识和第二图像的分组标识。
上述第一字段可以为如图6所示的ai_video_group_id，具体如何图6所示，此处不再赘述。
在一种可选的实现方式中，数据库中包括第二字段，第一视频对应的第二字段用于描述与第一视频具有相同分组标识的图像的数量。
上述第二字段可以为如图6所示的wonder_photo_count，具体如何图6所示，此处不再赘述。
在一种可选的实现方式中，第一视频的文件头信息中包括第一标识，第三图像的图像文件中包括第二标识，第一标识与第二标识相关联，图库应用的第二界面中还包括第三图像的第四缩略图。
上述第一视频的第一标识可以为第一视频的分组标识，第三图像的第二标识可以为第三图像的分组标识。如果在数据库中将第三图像的第二标识更改为与第一标识相关，则在显示图库应用的第二界面时，第三图像的第四缩略图将会显示在图库应用的第二界面中，类似的，第三图像的第四缩略图也会显示在图库应用的第一界面中。
在一种可选的实现方式中，第一标识与第二标识相同。
本申请实施例还提供了一种电子设备，包括上述处理器。本实施例提供的电子设备可以是图1所示的终端设备100，用于执行上述视频的处理方法。在采用集成的单元的情况下，电子设备可以包括处理模块、存储模块和存储模块。其中，处理模块可以用于对终端设备的动作进行控制管理，例如，可以用于支持终端设备执行显示单元、检测单元和处理单元执行的步骤。存储模块可以用于支持终端设备执行存储程序代码和数据等。存储模块，可以用于支持终端设备与其它设备的通信。
其中，处理模块可以是处理器或控制器。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框，模块和电路。处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，数字信号处理(digital signal processing，DSP)和微处理器的组合等等。存储模块可以是存储器。通信模块具体可以为射频电路、蓝牙芯片、Wi-Fi芯片等与其它终端设备交互的设备。
在一个实施例中，当处理模块为处理器，存储模块为存储器时，本实施例所涉及的终端设备可以为具有图1所示结构的设备。
本申请实施例还提供了一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当其在计算机或处理器上运行时，使得计算机或处理器执行上述任一个方法中的一个或多个步骤。
计算机可读存储介质可以是非临时性计算机可读存储介质，例如，非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本申请实施例还提供了一种本申请另一实施例还提供了一种包含指令的计算机程序产 品。当该计算机程序产品在计算机或处理器上运行时，使得计算机或处理器执行上述任一个方法中的一个或多个步骤。
其中，本实施例提供的电子设备、计算机可读存储介质、计算机程序产品均用于执行上文所提供的对应的方法，因此，其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果，此处不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个装置，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是一个物理单元或多个物理单元，即可以位于一个地方，或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该软件产品存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以权利要求的保护范围为准。

Claims (18)

  1. 一种视频的处理方法，其特征在于，包括：
    显示相机应用的第一界面，所述相机应用的第一界面包括：第一预览图像和第一控件；
    响应作用于所述第一控件的第一操作，所述电子设备开始录制第一视频并显示所述相机应用的第二界面，所述相机应用的第二界面包括：第二预览图像和第二控件；
    响应在录制所述第一视频的过程中作用于所述第二控件的第二操作，所述电子设备得到第一图像；
    在所述第一视频录制完成后，显示图库应用的第一界面，所述图库应用的第一界面包括：所述第一视频对应的第一缩略图和所述第一图像对应的第二缩略图；
    响应作用于所述第一缩略图的第三操作，显示图库应用的第二界面，其中，所述图库应用的第二界面包括：所述第一缩略图和第二图像的第三缩略图，所述第二图像为从所述第一视频中自动获取的图像。
  2. 根据权利要求1所述的处理方法，其特征在于，所述图库应用的第二界面还包括所述第一视频。
  3. 根据权利要求2所述的处理方法，其特征在于，响应作用于所述第一缩略图的第三操作，所述第一视频在所述图库应用的第二界面中静音播放，所述图库应用的第二界面还包括：进度条、第三控件和第四控件，所述方法还包括：
    响应作用于所述第三控件的第四操作，暂停播放所述第一视频；
    响应作用于所述第四控件的第五操作，播放所述第一视频的声音；和
    响应作用于所述进度条的第六操作，调整所述第一视频的播放进度。
  4. 根据权利要求2所述的处理方法，其特征在于，在响应作用于所述第一缩略图的第三操作，显示图库应用的第二界面之后，所述方法还包括：
    响应作用于所述第三缩略图的第七操作，显示图库应用的第三界面，所述图库应用的第三界面包括：所述第一缩略图、所述第二图像和所述第三缩略图。
  5. 根据权利要求1所述的处理方法，其特征在于，在所述图库应用的第二界面中，所述第一缩略图大于所述第三缩略图；且在所述图库应用的第三界面中，所述第三缩略图大于所述第一缩略图。
  6. 根据权利要求1所述的处理方法，其特征在于，所述方法还包括：
    显示图库应用的第四界面，所述图库应用的第四界面包括第一文件夹；
    响应作用于所述第一文件夹的第八操作，显示图库应用的第五界面，所述图库应用的第五界面包括所述第三缩略图；
    响应作用于所述第三缩略图的第九操作，显示图库应用的第六界面，在所述第一视频录制完成后，所述图库应用的第六界面自动包括所述第二图像。
  7. 根据权利要求6所述的处理方法，其特征在于，所述图库应用的第六界面还包括：所述第一缩略图和所述第三缩略图。
  8. 根据权利要求6所述的方法，其特征在于，所述图库应用的第四界面还包括第二文件夹，所述方法还包括：
    响应作用于所述第二文件夹的第十操作，显示图库应用的第七界面，在所述第一视频 录制完成后，所述第七界面自动包括所述第二缩略图。
  9. 根据权利要求1所述的处理方法，其特征在于，所述相机应用的第二界面还包括第五控件，在响应作用于所述第一控件的第一操作，所述电子设备开始录制第一视频并显示所述相机应用的第二界面之后，所述方法还包括：
    响应作用于所述第五控件的第十一操作，所述电子设备结束录制所述第一视频并显示所述相机应用的第一界面，所述相机应用的第一界面还包括第六控件；
    响应作用于所述第六控件的第十二操作，显示所述图库应用的第二界面。
  10. 根据权利要求1所述的处理方法，其特征在于，在响应作用于所述第一控件的第一操作，所述电子设备开始录制第一视频并显示所述相机应用的第二界面之前，所述方法还包括：
    响应于所述电子设备处于第一拍摄模式下拍摄所述第一视频，在录制所述第一视频的过程中，获取所述第二图像；
    响应于所述电子设备处于第二拍摄模式下拍摄所述第二视频，在录制所述第二视频的过程中，不自动从所述第二视频中获取图像。
  11. 根据权利要求1所述的处理方法，其特征在于，在响应作用于所述第一缩略图的第三操作，显示图库应用的第二界面之前，所述方法还包括：
    解析所述第一缩略图对应的所述第一视频，得到所述第一视频对应的分组标识；
    查找与所述第一视频具有相同分组标识的图像，并确定查找到的图像为所述第二图像。
  12. 根据权利要求1所述的处理方法，其特征在于，
    所述第一视频的文件头信息包括标签信息，所述标签信息包括所述第一视频的分组标识；以及
    所述第二图像的图像文件包括所述第二图像的分组标识，所述第二图像的分组标识与所述第一视频的分组标识相同。
  13. 根据权利要求12所述的处理方法，其特征在于，所述数据库中包括第一字段，所述第一字段包括所述第一视频的分组标识和所述第二图像的分组标识。
  14. 根据权利要求13所述的处理方法，其特征在于，所述数据库中包括第二字段，所述第一视频对应的第二字段用于描述与所述第一视频具有相同分组标识的图像的数量。
  15. 根据权利要求1所述的处理方法，其特征在于，所述第一视频的文件头信息中包括第一标识，所述第三图像的图像文件中包括第二标识，所述第一标识与所述第二标识相关联，所述图库应用的第二界面中还包括所述第三图像的第四缩略图。
  16. 根据权利要求15所述的处理方法，其特征在于，所述第一标识与所述第二标识相同。
  17. 一种电子设备，其特征在于，包括：
    一个或多个处理器、存储器，摄像头和显示屏；
    所述存储器、所述摄像头和所述显示屏与所述一个或多个所述处理器耦合，所述存储器用于存储计算机程序代码，所述计算机程序代码包括计算机指令，当所述一个或多个处理器执行所述计算机指令时，所述电子设备执行如权利要求1至16任意一项所述的视频的处理方法。
  18. 一种计算机可读存储介质，其特征在于，用于存储计算机程序，所述计算机程序被电子设备执行时，使得所述电子设备实现如权利要求1至16任意一项所述的视频的处理方法。
PCT/CN2022/140626 2022-02-28 2022-12-21 视频的处理方法、电子设备和可读存储介质 Ceased WO2023160186A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/546,711 US12541286B2 (en) 2022-02-28 2022-12-21 Video processing method, electronic device, and readable storage medium
EP22922535.4A EP4274242B1 (en) 2022-02-28 2022-12-21 Video processing method, and electronic device and readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210191809.1 2022-02-28
CN202210191809.1A CN116700577A (zh) 2022-02-28 2022-02-28 视频的处理方法、电子设备和可读存储介质

Publications (1)

Publication Number Publication Date
WO2023160186A1 true WO2023160186A1 (zh) 2023-08-31

Family

ID=87748275

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/140626 Ceased WO2023160186A1 (zh) 2022-02-28 2022-12-21 视频的处理方法、电子设备和可读存储介质

Country Status (4)

Country Link
US (1) US12541286B2 (zh)
EP (1) EP4274242B1 (zh)
CN (1) CN116700577A (zh)
WO (1) WO2023160186A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD1103188S1 (en) * 2023-07-21 2025-11-25 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
CN119653224A (zh) * 2023-09-18 2025-03-18 华为终端有限公司 视频处理方法、电子设备和计算机可读存储介质
CN120343178B (zh) * 2024-01-10 2026-03-31 荣耀终端股份有限公司 视频生成方法和电子设备
US20250273245A1 (en) * 2024-02-27 2025-08-28 Snap Inc. Post capture augmentation effects
CN120378673A (zh) * 2025-04-28 2025-07-25 北京字跳网络技术有限公司 用于内容处理的方法、装置、设备、介质及程序产品

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130104080A1 (en) * 2011-10-19 2013-04-25 Andrew Garrod Bosworth Automatic Photo Capture Based on Social Components and Identity Recognition
CN110401766A (zh) * 2019-05-22 2019-11-01 华为技术有限公司 一种拍摄方法及终端
CN111061912A (zh) * 2018-10-16 2020-04-24 华为技术有限公司 一种处理视频文件的方法及电子设备
CN113055585A (zh) * 2019-12-27 2021-06-29 青岛海信移动通信技术股份有限公司 拍摄界面的缩略图显示方法及移动终端
CN113810608A (zh) * 2021-09-14 2021-12-17 荣耀终端有限公司 一种拍摄方法、电子设备及存储介质

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5083090B2 (ja) 2007-09-18 2012-11-28 ソニー株式会社 表示制御装置、撮像装置、表示制御方法およびプログラム
US9204026B2 (en) * 2010-11-01 2015-12-01 Lg Electronics Inc. Mobile terminal and method of controlling an image photographing therein
JP6120051B2 (ja) * 2012-12-28 2017-04-26 ソニー株式会社 再生装置、再生方法、並びに記録媒体
KR102045957B1 (ko) * 2013-01-18 2019-11-18 삼성전자 주식회사 휴대단말의 촬영 방법 및 장치
KR102243653B1 (ko) * 2014-02-17 2021-04-23 엘지전자 주식회사 디스플레이 디바이스 및 그 제어 방법
KR20160024002A (ko) * 2014-08-21 2016-03-04 삼성전자주식회사 비쥬얼 사운드 이미지를 제공하는 방법 및 이를 구현하는 전자 장치
EP3007029B1 (en) * 2014-10-07 2017-12-27 LG Electronics Inc. Mobile terminal and wearable device
KR20170006559A (ko) * 2015-07-08 2017-01-18 엘지전자 주식회사 이동단말기 및 그 제어방법
KR101678861B1 (ko) * 2015-07-28 2016-11-23 엘지전자 주식회사 이동단말기 및 그 제어방법
KR20170091913A (ko) * 2016-02-02 2017-08-10 삼성전자주식회사 영상 서비스 제공 방법 및 장치
KR20170112492A (ko) * 2016-03-31 2017-10-12 엘지전자 주식회사 이동 단말기 및 그 제어방법
KR102649254B1 (ko) * 2016-08-03 2024-03-20 삼성전자주식회사 디스플레이 제어 방법, 저장 매체 및 전자 장치
KR20180041366A (ko) * 2016-10-14 2018-04-24 엘지전자 주식회사 이동단말기 및 그 제어방법
KR20180095331A (ko) * 2017-02-17 2018-08-27 엘지전자 주식회사 이동단말기 및 그 제어 방법
KR102477523B1 (ko) * 2017-12-22 2022-12-15 삼성전자주식회사 360 비디오에서 POI(Point of Interest) 정보를 제공하기 위한 장치 및 방법
CN112954219A (zh) * 2019-03-18 2021-06-11 荣耀终端有限公司 一种多路录像方法及设备
US10645294B1 (en) * 2019-05-06 2020-05-05 Apple Inc. User interfaces for capturing and managing visual media
US11770601B2 (en) * 2019-05-06 2023-09-26 Apple Inc. User interfaces for capturing and managing visual media
CN111010506A (zh) * 2019-11-15 2020-04-14 华为技术有限公司 一种拍摄方法及电子设备
CN113747047B (zh) * 2020-05-30 2023-10-13 华为技术有限公司 一种视频播放的方法及设备
US11054973B1 (en) * 2020-06-01 2021-07-06 Apple Inc. User interfaces for managing media

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130104080A1 (en) * 2011-10-19 2013-04-25 Andrew Garrod Bosworth Automatic Photo Capture Based on Social Components and Identity Recognition
CN111061912A (zh) * 2018-10-16 2020-04-24 华为技术有限公司 一种处理视频文件的方法及电子设备
CN110401766A (zh) * 2019-05-22 2019-11-01 华为技术有限公司 一种拍摄方法及终端
CN113055585A (zh) * 2019-12-27 2021-06-29 青岛海信移动通信技术股份有限公司 拍摄界面的缩略图显示方法及移动终端
CN113810608A (zh) * 2021-09-14 2021-12-17 荣耀终端有限公司 一种拍摄方法、电子设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4274242A4

Also Published As

Publication number Publication date
EP4274242A4 (en) 2024-08-14
CN116700577A (zh) 2023-09-05
US12541286B2 (en) 2026-02-03
EP4274242B1 (en) 2025-06-25
US20250004616A1 (en) 2025-01-02
EP4274242A1 (en) 2023-11-08

Similar Documents

Publication Publication Date Title
EP4274242B1 (en) Video processing method, and electronic device and readable storage medium
US20230056332A1 (en) Image Processing Method and Related Apparatus
CN112214636A (zh) 音频文件的推荐方法、装置、电子设备以及可读存储介质
KR102503329B1 (ko) 이미지 분류 방법 및 전자 디바이스
CN112529645B (zh) 一种图片的布局方法及电子设备
WO2021159746A1 (zh) 文件共享方法、系统及相关设备
CN109819306B (zh) 一种媒体文件裁剪的方法、电子设备和服务器
EP4660796A1 (en) Theme generation method and electronic device
WO2023035921A1 (zh) 一种录像中抓拍图像的方法及电子设备
WO2022228010A1 (zh) 一种生成封面的方法及电子设备
CN115145513A (zh) 一种投屏方法、系统及相关装置
CN115115679B (zh) 一种图像配准方法及相关设备
CN117499777B (zh) 一种图像显示方法和装置
CN114979459B (zh) 拍摄素材的管理方法、电子设备及系统
US20250181662A1 (en) Search method and electronic device
WO2022179271A1 (zh) 反馈搜索结果的方法、装置及存储介质
US20250007871A1 (en) Message processing method and related apparatus
CN113760191B (zh) 数据读取方法、装置、存储介质和程序产品
WO2022161058A1 (zh) 一种全景图像的拍摄方法及电子设备
CN116861019A (zh) 图片显示方法及电子设备
CN112783993A (zh) 基于数字地图的多个授权空间的内容同步方法
WO2024114785A1 (zh) 一种图像处理方法、电子设备及系统
WO2023061298A1 (zh) 一种图片备份系统、方法与设备
WO2023160455A1 (zh) 删除对象的方法及电子设备
WO2024188190A1 (zh) 一种卡片显示方法及电子设备

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 18546711

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2022922535

Country of ref document: EP

Effective date: 20230802

NENP Non-entry into the national phase

Ref country code: DE

WWG Wipo information: grant in national office

Ref document number: 2022922535

Country of ref document: EP

WWG Wipo information: grant in national office

Ref document number: 18546711

Country of ref document: US