WO2023160271A9 - 人机交互方法、装置和电子设备 - Google Patents
人机交互方法、装置和电子设备 Download PDFInfo
- Publication number
- WO2023160271A9 WO2023160271A9 PCT/CN2023/070780 CN2023070780W WO2023160271A9 WO 2023160271 A9 WO2023160271 A9 WO 2023160271A9 CN 2023070780 W CN2023070780 W CN 2023070780W WO 2023160271 A9 WO2023160271 A9 WO 2023160271A9
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- photo
- thumbnail
- shared
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
Definitions
- Embodiments of the present application relate to human-computer interaction technology, and in particular, to a human-computer interaction method, device and electronic equipment.
- Embodiments of the present application provide a human-computer interaction method, device, and electronic device, which can realize sharing of the original video in a scene where photos are extracted from the original video.
- embodiments of the present application provide a human-computer interaction method.
- the execution subject that executes the human-computer interaction method may be a terminal or a chip in the terminal.
- the following description takes the terminal as an example.
- the video in a scenario where associated photos have been generated based on the original video, the video can be shared.
- the first interface in response to the user's first operation on the thumbnail of the video displayed in the first album or photo tab, the first interface is displayed, and the display area of the first interface displays the picture of the video, so
- the first interface also includes: an association area and an operation area.
- the association area includes the identification of the video and the identification of at least one photo associated with the video.
- the at least one photo is generated based on the video.
- the operation area Includes sharing controls.
- the user when the user opens and displays a video in the first album or photo tab, the photo associated with the video and the sharing control can be displayed on the video display interface.
- the user can operate the sharing control to share the video, and accordingly, in response to the user operating the sharing control, the video is shared to the target terminal.
- the target terminal may be a preset terminal or a terminal selected by the user to share the video.
- the first album is an album containing videos.
- the first album is a camera album, or the first album can be any of the following: camera album, all photo albums, video albums, my collection, smart albums, map albums, search results, etc.
- the video is included in the photo tab.
- the thumbnail of the video displayed in the first album and the thumbnail of the video displayed in the photo tab include: an identification of the photo associated with the video; wherein, the The identifier of the video is the thumbnail of the first frame (picture) in the video, and the identifier of each photo associated with the video is the thumbnail of each photo.
- the terminal displays a first sharing interface in response to the user operating the sharing control.
- the first sharing interface includes: a first content browsing area to be shared and a sharing selection area.
- the sharing selection area includes the identification of the user to be shared.
- the video is shared to the target terminal, and the target terminal is the terminal corresponding to the target user.
- the content included in the first to-be-shared content browsing area is related to the first photo album and the photo tab to which the video belongs. That is to say, when the user performs the first operation on the thumbnail of the video displayed in the first album, the content included in the first to-be-shared content browsing area is associated with the first album (that is, whether the first album includes the video (at least one photo) related. When the user performs the first operation on the thumbnail of the video displayed in the photo tab, the content included in the first to-be-shared content browsing area is different from the photo tab (that is, whether the photo tab includes at least one photo associated with the video). ) related.
- the content included in the first to-be-shared content browsing area is related to the type of the first photo album.
- the type of the first photo album may include a physical photo album and a virtual photo album.
- the first to-be-shared content browsing area in the physical album includes a thumbnail of the video and a thumbnail of each photo associated with the video.
- the first content browsing area to be shared includes a thumbnail of the video.
- the first content browsing area to be shared includes a thumbnail of the video.
- photos associated with the video can be avoided from appearing repeatedly in the first content browsing area to be shared, thereby improving user experience.
- the display position of the thumbnail of the video in the first to-be-shared content browsing area also includes: a thumbnail of the content arranged before the video in the first photo album.
- the display position of the thumbnail of the at least one photo in the first to-be-shared content browsing area also includes: a thumbnail of the content arranged after the at least one photo in the first photo album, wherein the In the first album, the at least one photo is arranged after the video. This way, users can also choose other content to share.
- the The first content browsing area to be shared includes a thumbnail of the video and a thumbnail of each photo associated with the video.
- the photos associated with the video can be displayed in the first content browsing area to be shared, so that users can share the photos associated with the video at the same time when sharing the video, thereby improving sharing efficiency and thereby improving user experience.
- the display position of the thumbnail of the video in the first to-be-shared content browsing area also includes: a thumbnail of the content arranged before the video in the first photo album.
- the display position of the thumbnail of the video in the first to-be-shared content browsing area also includes: a thumbnail of the content arranged after the video in the first photo album. This way, users can also choose other content to share.
- a selection mark is displayed on the thumbnail of the video in the first to-be-shared content browsing area as described above to indicate that the user has selected the video to share.
- the first photo album when the first photo album includes the video and at least one photo associated with the video, the first photo album is an "all photos" photo album.
- the first content browsing area to be shared when the first photo album includes the video but does not include at least one photo associated with the video, the first content browsing area to be shared includes: an abbreviation of the video.
- a thumbnail image, and a thumbnail image of at least one photo associated with the video displayed based on the size of the first content browsing area to be shared. Due to the size of the first content browsing area to be shared, not all thumbnails can be displayed. Therefore, the user can slide left and right or up and down, or use other methods to browse the content in the first content browsing area to be shared, and the second content to be shared.
- the browsing area can refer to the first content browsing area to be shared.
- the first content browsing area to be shared includes: a thumbnail of the video, and a portion of the thumbnail of one of the at least one photo.
- the user can also select a photo to share. If in the first to-be-shared content browsing area, the user's operation of selecting the thumbnail of the target photo in the at least one photo is detected, then correspondingly, the terminal responds to the user's identification of the target user. The operation of sharing the video and the target photo to the target terminal.
- the user can also select the target photo to share on the first interface:
- the terminal displays the target photo in the display area in response to the user's operation on the identification of the target photo in the at least one photo on the first interface.
- the target photo is shared to the target terminal.
- the terminal may display a second sharing interface, where the second sharing interface includes: a second content browsing area to be shared and a sharing selection area.
- the sharing selection area can be the same as the sharing selection area in the first sharing interface, and you can refer to the above related descriptions.
- the second content browsing area to be shared includes: thumbnails of the target photo, thumbnails of the video, and thumbnails of other photos associated with the video, so A selection mark is displayed on the thumbnail of the target photo, and the sharing selection area includes the mark of the user to be shared.
- the terminal shares the target photo with the target terminal in response to the user's operation on the identification of the target user among the identifications of the users to be shared, and the target terminal is the terminal corresponding to the target user.
- the thumbnails of the video are arranged before the thumbnails of the target photo, and the thumbnails of other photos associated with the video are arranged. Posted after the thumbnail of the target photo.
- the display position of the thumbnail of the video in the second to-be-shared content browsing area also includes: a thumbnail of the content arranged before the video in the first photo album.
- the display position of the thumbnails of other photos associated with the video in the second to-be-shared content browsing area also includes: thumbnails of content arranged before the video in the first photo album.
- users can be provided to share other content (except videos and photos associated with videos) to improve user experience.
- users can also multiple-select to share videos and photos:
- a second interface is displayed, so The logo on the second interface indicating that the video is associated with the photo disappears, and a selected logo is displayed on the thumbnail of the video.
- sharing controls can also be displayed on the second interface for users to share videos and photos associated with the videos. You can refer to the sharing process in the above-mentioned first interface.
- inventions of the present application provide a human-computer interaction device.
- the human-computer interaction device may be the terminal in the first aspect or a chip in the terminal.
- the human-computer interaction device includes:
- the display module in response to the user's first operation on the thumbnail of the video displayed in the first album or photo tab, is configured to display a first interface, and the display area of the first interface displays the The picture of the video, the first interface also includes: an association area and an operation area, the association area includes the identification of the video and the identification of at least one photo associated with the video, the at least one photo is generated based on the video , the operation area includes sharing controls.
- a transceiver module configured to share the video to a target terminal in response to the user operating the sharing control.
- the display module is specifically configured to display a first sharing interface in response to the user operating the sharing control.
- the first sharing interface includes: a first content browsing area to be shared and a sharing area. Selection area, the content included in the first to-be-shared content browsing area is related to the first album or the photo tab to which the video belongs, and the sharing selection area includes the identification of the user to be shared.
- a transceiver module specifically configured to share the video to the target terminal in response to the user's operation on the identification of the target user among the identifications of the users to be shared, and the target terminal is the terminal corresponding to the target user.
- the first album when the user performs a first operation on a thumbnail of a video displayed in the first album, and the first album includes the video and at least one associated with the video
- the first content browsing area to be shared includes a thumbnail of the video.
- the first content browsing area to be shared includes a thumbnail of the video and a thumbnail of each photo associated with the video.
- a selection mark is displayed on the thumbnail of the video in the first content browsing area to be shared.
- the first photo album when the first photo album includes the video and at least one photo associated with the video, the first photo album is an "all photos" photo album.
- the first content browsing area to be shared includes: an abbreviation of the video. a thumbnail, and a portion of the thumbnail of one of the at least one photo.
- the first to-be-shared content browsing area includes a thumbnail of the video and a thumbnail of each photo associated with the video.
- a processing module configured to detect, in the first to-be-shared content browsing area, the user's operation of selecting a thumbnail of a target photo in the at least one photo.
- a transceiver module specifically configured to share the video and the target photo with the target terminal in response to the user's operation on the target user's identification.
- the thumbnail of the video is displayed in the first content browsing area to be shared. Before the position, it also includes: the thumbnail of the content arranged before the video in the first album, and after the display position of the thumbnail of the at least one photo in the first content browsing area to be shared, it also includes: Thumbnails of content arranged after the at least one photo in the first photo album, wherein the at least one photo is arranged after the video in the first photo album.
- the first photo album includes the video but does not include at least one photo associated with the video
- the following is also included:
- the thumbnails of the content arranged before the video in the first photo album, after the display position of the thumbnail of the video in the first content browsing area to be shared also include: the thumbnails arranged in the first photo album.
- the display module is further configured to display the target in the display area in response to the user's operation on the identification of the target photo in the at least one photo on the first interface. photo.
- the transceiver module is also configured to share the target photo to the target terminal in response to the user operating the sharing control.
- the display module is specifically configured to display a second sharing interface in response to the user operating the sharing control.
- the second sharing interface includes: a second content browsing area to be shared and a sharing area. Select an area.
- the second browsing area for content to be shared includes: thumbnails of the target photo, thumbnails of the video, and thumbnails of other photos associated with the video.
- the thumbnail of the target photo displays There is a selection mark, and the sharing selection area includes the mark of the user to be shared.
- a transceiver module specifically configured to share the target photo to the target terminal in response to the user's operation on the identification of the target user among the identifications of the users to be shared, and the target terminal is the target user corresponding to the target terminal. terminal.
- the thumbnails of the video are arranged before the thumbnails of the target photo, and the thumbnails of other photos associated with the video are arranged. Posted after the thumbnail of the target photo.
- the display position before the display position of the thumbnail of the video in the second to-be-shared content browsing area, the display position further includes: the thumbnail of the content arranged before the video in the first album.
- the thumbnails after the display position of the thumbnails of other photos associated with the video in the second to-be-shared content browsing area, also include: thumbnails of the content arranged before the video in the first album.
- the thumbnail of the video displayed in the first photo album or the photo tab includes: an identifier indicating that the video is associated with the photo; wherein, the identifier of the video is the thumbnail of the first frame (picture) in the video, and the identifier of each photo associated with the video is the thumbnail of each photo.
- the display module in response to the user's second operation on the thumbnail of the video displayed in the first photo album or the photo tab, the display module , and is also used to display a second interface, in which the logo indicating that the photo is associated with the video disappears, and a selected logo is displayed on the thumbnail of the video.
- embodiments of the present application provide an electronic device, which may include a processor and a memory.
- the memory is used to store computer-executable program code, and the program code includes instructions; when the processor executes the instructions, the instructions cause the electronic device to perform the method in the first aspect.
- embodiments of the present application provide a computer program product containing instructions that, when run on a computer, cause the computer to execute the method in the first aspect.
- embodiments of the present application provide a computer-readable storage medium that stores instructions that, when run on a computer, cause the computer to execute the method in the first aspect.
- Figure 1 is a schematic interface diagram of the one-record-and-many function provided by the embodiment of the present application.
- Figure 2 is a schematic diagram of an interface for shooting using the one-record-and-many function provided by the embodiment of the present application;
- Figure 3A is a schematic interface diagram of a terminal provided by an embodiment of the present application.
- Figure 3B is another schematic interface diagram of a terminal provided by an embodiment of the present application.
- Figure 4A is a schematic diagram of an interface for sharing gallery data provided by an embodiment of the present application.
- Figure 4B is a schematic diagram of another interface for sharing gallery data provided by an embodiment of the present application.
- Figure 4C is a schematic diagram of another interface for sharing gallery data provided by an embodiment of the present application.
- Figure 4D is a schematic diagram of another interface for sharing gallery data provided by an embodiment of the present application.
- Figure 4E is a schematic diagram of another interface for sharing gallery data provided by an embodiment of the present application.
- Figure 5 is a schematic diagram of another interface for sharing gallery data provided by an embodiment of the present application.
- Figure 6 is a schematic flow chart of a human-computer interaction method provided by an embodiment of the present application.
- Figure 7 is a schematic structural diagram of a human-computer interaction device provided by an embodiment of the present application.
- Figure 8 is a schematic structural diagram of a terminal provided by an embodiment of the present application.
- Terminals include but are not limited to mobile phones, tablet computers, desktops, laptops, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, etc.
- Computers netbooks, personal digital assistants (PDAs), wearable electronic devices, smart watches and other electronic devices with cameras.
- PDAs personal digital assistants
- the embodiments of this application do not limit the form of the terminal.
- Original video Video captured by the user through the terminal.
- Magic moments refer to some wonderful moments in the video recording (or shooting) process.
- MM can be the best sports moment, the best expression moment or the best check-in action. It can be understood that this application does not limit the term MM.
- MM can also be called a beautiful moment, a magical moment, a wonderful moment, a decisive moment, a wonderful key frame or a best shot (BS), etc.
- BS best shot
- wonderful moments can be different types of picture moments.
- the highlight moment can be the moment when the athlete's foot comes into contact with the football when shooting or passing the ball, or the moment when the football flies into the goal.
- the highlight moment can be the moment when the character is at the highest point in the air, or it can be the moment when the character is in the air with the most relaxed movements.
- MM tag is a time tag.
- the MM tag is used to indicate the location of the highlight moment in the recorded video.
- a video can correspond to one or more MM tags, and the MM tag can indicate that the corresponding image frame (or video frame) in the video at the 10th second, 1st minute and 20th second, etc. in the video is a highlight moment.
- AI photos video frames corresponding to the wonderful moments in the original video.
- AI photos may be called highlight photos.
- the AI photo can be: a video frame in the original video containing the user laughing, or a video frame containing the highest jump of the user, or a video frame containing the user looking back.
- AI photos can be obtained and saved.
- the AI configuration file is obtained based on the original video.
- the AI configuration file records information such as the scenes and highlight key frames of the video taken by the user.
- the AI configuration file can include: at least one scene in the original video.
- the logo, as well as the logo of the key frame (such as the logo of the AI photo).
- the original video includes scene 1 "aquarium” and scene 2 "playground”, as well as the identification 1 of the key frame in scene 1 "aquarium", and the identification of the key frame in scene 2 "aquarium” 2.
- the information recorded in the AI configuration file may specifically include MM tags, overall video scene tags, segmented scene tags, storyboard tags, and tags of good quality video frames, etc.
- a label may be understood as an identification.
- the overall video scene tag can also be called the overall video summary tag, which is mainly used to indicate the overall shooting scene of the video.
- This application does not limit the terminology of the overall video scene tag.
- the overall scene tag of the video can be a food tag, a night scene tag, etc.
- the implementation process of "one recording and multiple gains” can be: automatically identify the wonderful moments during the recording process and trigger the capture to obtain the MM's photos. After the recording is completed, when the user views the recorded video, the MM's photos and wonderful short videos of the wonderful moments can be recommended to the user. (Also called selected short videos, or wonderful videos, or selected videos, or AI videos). It is understandable that the duration of the wonderful short videos obtained through Yiluduode is shorter than the duration of the entire complete video. For example, if the entire recorded video is 1 minute, you can get 4 photos of wonderful moments and a short video of 15 seconds.
- One-touch recording can also have other names, such as one-click to get many, one-click to take multiple shots, one-click to produce movies, one-click blockbuster, AI one-click blockbuster, etc.
- AI video generated based on AI configuration file.
- the AI video may be: a 5-s video before and after the key frame identified as 1, and a 5-s video before and after the key frame identified as 2, that is, the AI video is a 10-s video.
- the AI video can be: a video containing 5s in Scene 1 "Aquarium", and a video containing 5s in Scene 2 "Amusement Park”.
- the AI video may not be generated but the AI video configuration file may be generated and saved. This can save storage space when the user does not browse the AI video.
- the user can trigger the terminal to generate an AI video on the playback interface of the original video. For example, if the user can operate the one-click blockbuster control 351 displayed at c in Figure 3B to trigger the terminal to generate an AI video, refer to the relevant description in Figure 3B.
- the embodiments of this application do not elaborate on the process of generating AI photos and AI configuration files from original videos, and generating AI videos from AI configuration files.
- GUI graphical user interface
- the user's operation methods of controls, icons and other objects in the graphical user interface include but are not limited to touching specific controls on the mobile phone screen, pressing specific physical keys or key combinations, and inputting Voice and air gestures.
- the user operates controls in the GUI as an example for description.
- the process of recording videos using the "one record, multiple gains" mode (or function) in the embodiment of the present application includes:
- the screen of the mobile phone displays a main interface, which displays application icons of multiple applications (applications, Apps).
- the user can click the "Camera" application icon 101 on the desktop of the mobile phone to trigger the mobile phone to open the camera application (hereinafter referred to as the camera), and the mobile phone displays a shooting interface as shown in b in Figure 1 .
- the camera's shooting interface generally includes multiple controls such as a viewfinder 102, a photo control, a video control, and a setting control 103 (such as portrait function controls, night scene function controls, or more other controls).
- the user can turn on the recording mode by clicking the video recording control, and the mobile phone can display the recording interface as shown in c in Figure 1.
- the user can enter the camera setting interface by clicking the "Settings" control 103, and the mobile phone displays an interface as shown in d in Figure 1.
- the interface shown as d in Figure 1 displays an option 104 for turning on the "one record, many gains" function, which is used to turn on the one record, many gains function. That is to say, when the user turns on Yiluduodao, the original video, AI photo and AI configuration file will be obtained when the mobile phone records a video. Of course, the user can also use option 104 to turn off the function of recording more than once.
- the setting interface shown in d in Figure 1 may also include a minimum time limit control.
- the minimum time setting control is used to limit the minimum recording duration that enables the one-record-and-get-together feature. If the recording duration of the video is less than the minimum recording duration, the video's one-to-one recording and multiple-to-get feature cannot be recalled.
- the minimum time limit can be set to 15s. When the user's shooting time is less than 15s, there will be no callback to capture more photos.
- the setting interface shown in d in Figure 1 can also include other controls related to recording settings, such as video resolution setting controls, video frame rate setting controls, etc.
- the control shown in d in Figure 1 is just Illustrative description.
- the user clicks the return control 105 shown as d in Figure 1, and the mobile phone can return to the interface shown as c in Figure 1, and then clicks the recording control 106 to record.
- the option of recording more than one record is enabled by default, and the user does not need to click the setting control 103 shown as c in Figure 1, but directly clicks the recording control 106 shown as c in Figure 1, You can record in one-record-many mode.
- FIG. 2 is a schematic interface diagram of using the one-record-many-get function according to an embodiment of the present application.
- a in Figure 2 shows a scene during the recording process of the terminal using the one-record-many function (for example, the scene at the 11th second).
- the interface shown in a in Figure 2 includes a recording stop control 107, a recording pause control 108, and a photo button 109.
- the user can click the photo button 109 to manually capture photos.
- the recording stop control 107 in a in Figure 2 the recording process ends.
- the mobile phone interface displays the interface shown in b in Figure 2.
- the interface shown in b in Figure 2 is the preview after the recording is completed.
- Interface, a bubble window 110 can pop up in the interface, and the content displayed in the window 110 is: "A photo of many wonderful moments has been generated" to prompt the user to view the AI photo.
- the preview image 111 in b in Figure 2 is a thumbnail of the recorded original video. If the user clicks on preview image 111, he or she can enter the gallery application (also known as gallery, gallery application) to view the recorded original video, as well as AI photos, etc.
- the playback and display of the original video and the display of AI photos can be as follows. Relevant descriptions in the examples.
- the original video shot by the terminal can be stored in the gallery application of the terminal, and the AI photos and AI videos can also be stored in the gallery application.
- the videos and photos stored in the gallery application may be referred to as gallery data.
- the gallery data may be displayed in the form of a photo album, in the form of a photo tab, etc.
- a in Figure 3A is an interface for displaying gallery data in the form of an album in the gallery application provided by the embodiment of the present application.
- the interface may include an album control 31, a photo control 32, and at least one album 33.
- the gallery application includes at least one photo album, such as a camera album, an all photo album, a video album, a screenshot album, a collection album, and other albums customized by the user.
- the photo albums in the gallery can be divided into physical photo albums and virtual photo albums.
- camera albums, screen capture and recording albums, and other albums for custom addition are physical albums
- all photo albums and video albums are virtual albums.
- the physical album can be understood as: a real path used to store the gallery data.
- a virtual photo album can be understood as an album that aggregates videos and photos based on their characteristics. For example, compared with photos, videos contain multiple video frames and have dynamic characteristics. Therefore, the videos captured by the terminal can be aggregated in a "video" album, which is a virtual album.
- the AI photos generated from the original video can be stored separately in a physical album, such as the "AI Photos" album, as shown in a in Figure 3A.
- a physical album such as the "AI Photos" album
- the interface for displaying gallery data in the form of photo tabs may include an album control 31 , a photo control 32 , and photos displayed in chronological order.
- the interface of the photo tab can display photos and videos in the camera album, as well as photos in the screenshot album.
- the cover of the original video in order to distinguish the original video for which AI photos have been generated from ordinary videos (for which no AI photos have been generated), when the cover of the original video is displayed in the camera album, video album, or other albums customized by the user, the cover of the original video can be displayed in the original video.
- a logo is added to the cover of the video, which indicates that the original video has generated an AI photo.
- a in Figure 3B is the same as a in Figure 3A.
- the terminal can display thumbnails of the photos included in the camera album, and the cover of the video, such as on the cover of Video 1
- the logo "AI" 34 may be displayed to indicate that video 1 is the original video of the generated AI photo, as shown in b in Figure 3B.
- the logo "AI" 34 may be displayed on the cover of video 1. It should be understood that the embodiments of this application involve the scenario where "AI photos have been generated from the original video”.
- the original video is associated with the AI photos generated from the original video. Therefore, in the embodiment of the present application, when the user views the original video, he or she can display the original video on the playback interface of the original video. View AI photos associated with the original video.
- AI photos can be displayed in association with the playback interface of the original video in the camera album, not in all virtual albums such as photos and videos, as well as in my collection, recycle bin, smart albums, map albums, search results, and hidden albums.
- AI photos are displayed in association with the playback interface of the original video in the shared album.
- AI photos can be displayed in association with the playback interface of the original video in the camera album, all photo albums, video albums, my collection, smart albums, map albums, and search results, and are not displayed in the recycle bin, hidden albums, or shared AI photos are displayed in association with the playback interface of the original video in the album.
- photo albums that are displayed in association and albums that are not displayed in association can be preset.
- the terminal when the user clicks on the cover of the original video, the terminal can play the original video.
- the terminal can play video 1 (or the terminal can display video 1 and a pause control, and the user operates The pause control can trigger the terminal to play the video 1).
- the interface for playing video 1 may include: a play area 35, an association area 36, and an operation area 37.
- the user clicking on the cover of Video 1 may be called the first operation.
- the interface shown in c in Figure 3B may be called the first interface. It should be understood that in the embodiment of the present application, in c in Figure 3, video 1 has been played for a period of time as an example.
- the playback area 35 can display the picture of video 1.
- the terminal in response to the user clicking on the cover of the original video, the terminal can directly display the image of Video 1 in the playback area 35 .
- the terminal in response to the user clicking on the cover of the original video, the terminal may display the first frame of video 1 and the pause control in the playback area 35 .
- the terminal in response to the user clicking the pause control, the terminal can start to display the video 1 in the playback area 35.
- This application does not limit the playback form of video 1.
- the playback area 35 may be called a display area.
- an icon 351 can be displayed on the playback area 35, such as the logo of "One-click Blockbuster".
- the terminal can be triggered to generate an AI video according to the AI configuration file.
- the playback area 35 can also display the playback time progress bar 352 of Video 1 so that the user can adjust the playback progress of Video 1. It should be understood that the following embodiments do not involve adjusting the playback progress of Video 1. Therefore, the playback time progress bar 352 of video 1 is not shown.
- the associated area 36 may include: a thumbnail of the cover of the original video (Video 1), and a thumbnail of the AI photo associated with the original video.
- video 1 and the AI photo associated with video 1 are represented by text.
- the AI photo associated with video 1 may include AI photo 1, AI photo 2 and AI photo 3.
- the thumbnail image can be understood as a reduced image of the original image.
- AI photo 3 is not fully displayed in c of Figure 3B.
- the thumbnail of the cover of video 1 displayed in the association area 36 can be called the identification of video 1
- the thumbnail of the AI photo associated with the original video can be called the identification of the photo.
- thumbnails are used to represent the logo of the video 1 and the logo of the photo.
- text or other forms may also be used to represent the logo of the video 1 and the logo of the photo. This embodiment of the present application does not limit this.
- video 1 is being played in playback area 35 in c in Figure 3B and the user clicks AI photo 1. Then the terminal can display AI photo 1 in playback area 35, as shown in d in Figure 3B.
- the terminal can continue to play Video 1 in the playback area 35, that is, it can continue to play Video 1 following the playback progress of Video 1 in c in Figure 3B.
- the first operation area 37 may include, but is not limited to: a share control 371 , a delete control 372 , and more controls 373 .
- This embodiment of the present application does not limit the controls included in the first operating area 37.
- Figure 3B shows the controls used in the embodiment of the present application, as well as other controls. You can refer to the accompanying drawings. The following embodiment introduces the process in which the user operates the sharing control 371 to trigger the terminal to perform corresponding operations.
- the photo tab when the photo tab includes video 1, the user can also play video 1 in the photo tab to display the same interface as c in Figure 3B, on which interface For the operations performed, refer to the relevant descriptions of the following embodiments.
- the following describes the process of terminal sharing gallery data from "large picture sharing” and "multi-select sharing”. It should be understood that the following embodiment uses a photo album as an example for explanation. Open it in the photo tab
- the process of sharing Video 1 can refer to the relevant description of the camera album in the following embodiment:
- Big picture sharing refers to the video 1 or the AI photo associated with video 1 being displayed on the terminal interface, and the photo sharing operation is performed on the interface.
- the terminal when sharing a large picture, when Video 1 or AI photo is displayed on the interface of the terminal, and when the terminal is sharing Video 1 or AI photo, the terminal may not display the associated content on the sharing interface. , share the content to be shared in the order in which it is arranged in the album.
- all photo albums include video 1 and the AI photos associated with video 1, and in all photo albums , the AI photos associated with video 1 are arranged behind video 1 in the order they appear in video 1.
- the sharing interface of video 1 also displays the AI photo associated with video 1
- the content behind video 1 in all photo albums will also be displayed after the AI photo associated with video 1, that is, the AI associated with video 1 photos, which causes duplicate AI photos to appear on the sharing interface, affecting user selection efficiency and poor user experience.
- the user opens video 1 in all photo albums.
- c in Figure 4A is the same as c in Figure 3B.
- the original video (video 1) is displayed on the interface of the terminal.
- the sharing interface may include: a content browsing area 41 and a sharing selection area 42.
- the sharing selection area 42, as well as the content, logos, etc. included in the sharing selection area 42 refer to the relevant description in FIG. 4B.
- the content browsing area 41 for content to be shared may include thumbnails of the content to be shared.
- the content to be shared includes: video 1, AI photo 1, AI photo 2, and AI photo 3 associated with video 1, as well as all videos in the photo album displayed before video 1
- the previous content of 1, and the next content of video 1 in all photo albums are displayed after video 1, such as AI photo 3, AI photo 2, and AI photo 1.
- d in FIG. 4A expands and displays the content included in the content browsing area 41 to be shared on the lower side of d in FIG. 4A .
- the accompanying drawing Characterize some of the photos in the content browsing area 41 to be shared in text form.
- the AI photos associated with video 1 are not displayed on the sharing interface.
- a-c in Figure 4B the user opens video 1 in all photo albums.
- a-c in Figure 4B is the same as a-c in Figure 4A.
- the interface shown in d in FIG. 4B may be called the first sharing interface, and the content browsing area 41 to be shared in d in FIG. 4B may be called the first content browsing area to be shared.
- the content browsing area 41 to be shared in Figure 4B includes: video 1, and the content arranged before and after video 1 in all photo albums.
- the content arranged before video 1 is photo 1
- the content arranged before video 1 is photo 1.
- Posted after video 1 are AI photo 3, AI photo 2, AI photo 1, and photo 2.
- the content browsing area 41 to be shared can display the thumbnail of photo 1, the thumbnail of video 1, the thumbnail of AI photo 3, the thumbnail of AI photo 2, the thumbnail of AI photo 1, and the thumbnail of photo 2.
- Sketch map the thumbnail of photo 1, the thumbnail of video 1, the thumbnail of AI photo 3, the thumbnail of AI photo 2, the thumbnail of AI photo 1, and the thumbnail of photo 2.
- thumbnail of video 1 may be the thumbnail of the first frame in video 1.
- the user clicks the sharing control 371 from the interface displaying Video 1 the user's intention is to share Video 1, so the thumbnail of Video 1 displayed in the content browsing area 41 to be shared is displayed as selected. Identifies that video 1 has been selected by the user to share.
- the check mark 411 in d in FIG. 4B indicates that video 1 is selected.
- the thumbnails other than the thumbnail of video 1 in the content browsing area 41 to be shared are in an unchecked state. The unchecked state is as shown on the photo 1 displayed in the content browsing area 41 to be shared. The check mark 412 is shown.
- the sharing selection area 42 includes: a user area to be shared 421 and a sharing mode area 422.
- the user to be shared area 421 includes the identity of at least one user to be shared, and user 1 in d in FIG. 4B represents the identity of the user to be shared.
- the sharing method area 422 includes at least one selectable sharing method, such as a Bluetooth sharing method, a text message sharing method, etc. This embodiment of the present application does not describe the sharing selection area 42 in detail.
- the AI configuration file of the original video does not support sharing.
- the AI video generated by the AI configuration file can support sharing.
- scenario 1 solution is also applicable to other photo albums that “store video 1 and AI photos associated with video 1.”
- Scenario 2 In one embodiment, when sharing a large picture, when Video 1 is displayed on the interface of the terminal, when sharing Video 1, the terminal can provide the user to share the AI photos associated with Video 1 at the same time.
- a camera album as an example, for example, video 1 is stored in the camera album, but the AI photo associated with video 1 is not stored.
- the AI photo associated with video 1 is stored in the AI photo album, then when the user When the camera album triggers the display of video 1 for sharing, the AI photos associated with the shared video 1 can be provided on the sharing interface. In this way, when users need to share video 1 and the AI photos associated with video 1, they do not need to go through the camera album and AI photo album in sequence. Sharing in the camera album, the embodiment of this application supports the completion of the sharing of "Video 1 and the AI photos associated with Video 1" in the camera album, which is highly efficient.
- a-c in Figure 4C are the same as a-c in Figure 3B. It should be understood that the photo 1 arranged before video 1 in the camera album is photo 2, and the photo 2 arranged after video 1 is.
- the sharing interface may include: a content browsing area 41 to be shared and a sharing selection area 42.
- the sharing selection area 42 may refer to the above related description.
- the interface shown in d in FIG. 4C may be called the first sharing interface
- the content browsing area 41 to be shared in d in FIG. 4C may be called the first content browsing area to be shared.
- the content browsing area 41 for content to be shared may include thumbnails of the content to be shared. Because video 1 is associated with the AI photo, in the embodiment of the present application, in order to facilitate sharing of video 1 and the AI photo associated with video 1, the thumbnail of video 1 and the AI photo 1 associated with video 1 can be displayed in the content browsing area 41 to be shared. Thumbnails, thumbnails of AI Photo 2, and thumbnails of AI Photo 3. It should be understood that in d in Figure 4C due to the size of the interface, the thumbnail of AI photo 2 and the thumbnail of AI photo 3 are not displayed in the content browsing area 41 to be shared, and half of the thumbnail is displayed in the content browsing area 41 to be shared. A thumbnail of AI photo 1. In order to easily characterize the difference between the content browsing area 41 to be shared in Figure 4C and Figure 4B, the content included in the content browsing area 41 to be shared is expanded and displayed on the left side of d in Figure 4C.
- the user clicks the sharing control 371 from the interface displaying Video 1 the user's intention is to share Video 1, so the thumbnail of Video 1 displayed in the content browsing area 41 to be shared is displayed as selected. Identifies that video 1 has been selected by the user to share. In one embodiment, the thumbnails in the to-be-shared content browsing area 41 except for the thumbnail of Video 1 are unchecked.
- the solution in Scenario 2 is also applicable to other albums and photo tabs that "have video 1 stored but do not display the AI photos associated with video 1".
- the terminal when sharing a large picture, similar to sharing of video 1, when the AI photo 1 associated with video 1 is displayed on the interface of the terminal, the terminal can provide the user with simultaneous sharing when sharing the AI photo 1 Video 1 associated with AI photo 1, and other AI photos associated with video 1, such as AI photo 2 and AI photo 3.
- Scenario 1 and Scenario 2 solutions are applicable to any photo album, photo tab, or other scenarios where AI photos are opened in the gallery application:
- Scenario 1 The sharing interface of AI photo 1 only displays AI photo 1, video 1 associated with AI photo 1, and other AI photos associated with video 1, such as AI photo 2 and AI photo 3.
- the sharing interface may include: a content browsing area 41 to be shared and a sharing selection area 42.
- the sharing selection area 42 may refer to the above related description.
- the interface shown in b in FIG. 4D may be called the first sharing interface
- the content browsing area 41 to be shared in b in FIG. 4D may be called the second content browsing area to be shared.
- the content browsing area 41 to be shared may include: a thumbnail of AI photo 1, a thumbnail of video 1, and a thumbnail of AI photo 2 associated with video 1, and Thumbnail of AI Photo 3. It should be understood that in b in Figure 4D due to the size of the interface, the thumbnail of AI photo 2 and the thumbnail of AI photo 3 are not displayed in the content browsing area 41 to be shared, and the thumbnail of AI photo 3 is displayed in the content browsing area 41 to be shared.
- the content included in the content browsing area 41 to be shared is expanded and displayed on the right side of b in 4D.
- the order of the thumbnails of AI photo 1 displayed in the content browsing area 41 to be shared, the thumbnails of AI photo 2 associated with video 1, and the thumbnails of AI photo 3 is not limited.
- the video and the AI photo can be displayed in the order in which they appear in the video, or the AI photo can be displayed first and then the video.
- a mark can be placed on the thumbnail of video 1, such as the duration of video 1, to indicate that the thumbnail corresponds to a video.
- the thumbnail of the AI photo 1 is displayed in the content browsing area 41 to be shared.
- a selected mark is displayed on the screen, indicating that AI photo 1 has been selected by the user to share.
- the thumbnail of video 1 displayed in the content browsing area 41 to be shared, as well as the thumbnails of AI photo 2 and AI photo 3 are all unchecked.
- Scenario 2 Sharing interface of AI photo 1: not only can display AI photo 1, video 1 associated with AI photo 1, and other AI photos associated with video 1 (such as AI photo 2, AI photo 3), the terminal can also obtain the arrangement The content before and after video 1 will be displayed on the sharing interface for users to choose to share.
- the sharing interface may include: a content browsing area 41 for content to be shared and a sharing selection area 42.
- the sharing selection area 42 may refer to the above related description.
- the interface shown in b in FIG. 4E may be called the first sharing interface, and the content browsing area 41 to be shared in b in FIG. 4E may be called the second content browsing area to be shared.
- the content browsing area 41 to be shared may include: thumbnails of AI photo 1, thumbnails of video 1, thumbnails of AI photo 2 associated with video 1, AI photos 3, and the content arranged before and after video 1 in the camera album.
- the content arranged before video 1 is photo 1
- the content arranged before video 2 is photo 2.
- the thumbnail of AI photo 2 and the thumbnail of AI photo 3 are not displayed in the content browsing area 41 to be shared, and the thumbnail of AI photo 3 is displayed in the content browsing area 41 to be shared.
- the content included in the content browsing area 41 to be shared is expanded and displayed on the right side of b in 4E.
- the order of the thumbnails of the AI photo 1 displayed in the content browsing area 41 to be shared, the thumbnails of the AI photo 2 associated with the video 1, and the thumbnails of the AI photo 3 is not limited. If possible, Display videos and AI photos in the order they appear in the video, or display them in other ways.
- the thumbnail of the AI photo 1 is displayed in the content browsing area 41 to be shared.
- a selected mark is displayed on the screen, indicating that AI photo 1 has been selected by the user to share.
- all thumbnails in the to-be-shared content browsing area 41 except the thumbnail of AI photo 1 are unchecked.
- Multi-select sharing refers to an interface where the terminal displays thumbnails of multiple gallery data, and user operations trigger the terminal to perform sharing of multiple gallery data.
- the video 1 or AI photo to be shared in this embodiment of the present application is not displayed in association.
- the AI photos associated with video 1 can be displayed.
- Shown as a in Figure 5 is a thumbnail of the gallery data contained in the camera album.
- the user long presses any gallery data to trigger the terminal to display the second operation area 38, as shown in b in Figure 5 .
- the AI logo may not be displayed on the thumbnail of video 1.
- the user's operation of long-pressing any gallery data (such as the thumbnail of Video 1) may be called a second operation, and the interface shown in b in Figure 5 may be called a second interface.
- the second operating area 38 may be the same as the first operating area 37 . In one embodiment, the second operation area 38 may be different from the first operation area 37.
- the second operation area 38 may include: a share control 371, a select all control 381, a delete control 372, and more controls. 373 etc.
- the terminal can display a sharing interface.
- the sharing interface may include a content browsing area 41 to be shared and a sharing selection area 42 .
- the content browsing area 41 to be shared may include a thumbnail of video 1 selected by the user, and a thumbnail of photo 1, and the thumbnail of video 1 displayed in the content browsing area 41 to be shared, and the photo A selected mark is displayed on the thumbnail of 1, indicating that video 1 and photo 1 have been selected by the user to share.
- the AI photos associated with Video 1 are not displayed in the shared content browsing area 41, otherwise there will be too much content, which will affect the user experience.
- the human-computer interaction method provided by the embodiment of the present application may include:
- the first interface in response to the user's first operation on the thumbnail of the video displayed in the first album or photo tab, the first interface is displayed, and the display area of the first interface displays the picture of the video.
- the first interface It also includes: an association area and an operation area, the association area includes an identification of the video and an identification of at least one photo associated with the video, at least one photo is generated based on the video, and the operation area includes a sharing control.
- the identifier of the video may be a thumbnail of any frame in the video (such as a thumbnail of the first frame of the video), and the identifier of each photo associated with the video may be the thumbnail of each photo.
- the identification of the video (or the photo associated with the video) may also be other information that can characterize the video (photo), such as text or number.
- the target terminal is a terminal corresponding to the target user.
- the target user is user 1 as shown in d in Figure 4B. After the user selects the identity of user 1, the terminal can send video 1 to user 1's terminal. .
- S601-S602 may refer to the relevant descriptions of FIGS. 4B-4C mentioned above.
- FIG. 7 is a schematic structural diagram of a human-computer interaction device provided by an embodiment of the present application.
- the human-computer interaction device may be the terminal in the above embodiment, or a chip in the terminal.
- the human-computer interaction device may include: a display module 701 , a transceiver module 702 , and a processing module 703 .
- the display module 701 in response to the user's first operation on the thumbnail of the video displayed in the first album or photo tab, is configured to display a first interface, the display area of the first interface displays the The picture of the video, the first interface also includes: an association area and an operation area, the association area includes the identification of the video and the identification of at least one photo associated with the video, the at least one photo is based on the video Generated, the operation area includes sharing controls.
- the transceiver module 702 is configured to share the video to the target terminal in response to the user operating the sharing control.
- the display module 701 is specifically configured to display a first sharing interface in response to the user operating the sharing control.
- the first sharing interface includes: a first content browsing area to be shared and a Sharing selection area, the content included in the first to-be-shared content browsing area is related to the first photo album or the photo tab to which the video belongs, and the sharing selection area includes the identification of the user to be shared.
- the transceiver module 702 is specifically configured to share the video to the target terminal in response to the user's operation on the identification of the target user among the identifications of the users to be shared, and the target terminal is the target user corresponding to the operation. terminal.
- the first album when the user performs a first operation on a thumbnail of a video displayed in the first album, and the first album includes the video and at least one associated with the video
- the first content browsing area to be shared includes a thumbnail of the video.
- the first content browsing area to be shared includes a thumbnail of the video and a thumbnail of each photo associated with the video.
- a selection mark is displayed on the thumbnail of the video in the first content browsing area to be shared.
- the first photo album when the first photo album includes the video and at least one photo associated with the video, the first photo album is an "all photos" photo album.
- the first content browsing area to be shared when the first photo album includes the video but does not include at least one photo associated with the video, the first content browsing area to be shared includes: an abbreviation of the video.
- the first content browsing area to be shared includes: a thumbnail of the video, and a portion of the thumbnail of one of the at least one photo.
- the processing module 703 is configured to In the first content browsing area to be shared, an operation of the user selecting a thumbnail of a target photo in the at least one photo is detected.
- the transceiving module 702 is specifically configured to share the video and the target photo to the target terminal in response to the user's operation on the target user's identification.
- the thumbnail of the video is displayed in the first content browsing area to be shared. Before the position, it also includes: the thumbnail of the content arranged before the video in the first album, and after the display position of the thumbnail of the at least one photo in the first content browsing area to be shared, it also includes: Thumbnails of content arranged after the at least one photo in the first photo album, wherein the at least one photo is arranged after the video in the first photo album.
- the first photo album includes the video but does not include at least one photo associated with the video
- the following is also included:
- the thumbnails of the content arranged before the video in the first photo album, after the display position of the thumbnail of the video in the first content browsing area to be shared also include: the thumbnails arranged in the first photo album.
- the display module 701 is further configured to display the identification of the target photo in the at least one photo in the display area in response to the user's operation on the first interface. Target photo.
- the transceiving module 702 is also configured to share the target photo to the target terminal in response to the user operating the sharing control.
- the display module 701 is specifically configured to display a second sharing interface in response to the user operating the sharing control.
- the second sharing interface includes: a second content browsing area to be shared and a second sharing interface. Sharing selection area, the second to-be-shared content browsing area includes: thumbnails of the target photo, thumbnails of the video, and thumbnails of other photos associated with the video. On the thumbnail of the target photo A selection mark is displayed, and the sharing selection area includes the mark of the user to be shared.
- the transceiver module 702 is specifically configured to share the target photo to the target terminal in response to the user's operation on the identification of the target user among the identifications of the users to be shared, and the target terminal corresponds to the target user. terminal.
- the thumbnails of the video are arranged before the thumbnails of the target photo, and the thumbnails of other photos associated with the video are arranged. Posted after the thumbnail of the target photo.
- the display position before the display position of the thumbnail of the video in the second to-be-shared content browsing area, the display position further includes: the thumbnail of the content arranged before the video in the first album.
- the thumbnails after the display position of the thumbnails of other photos associated with the video in the second to-be-shared content browsing area, also include: thumbnails of the content arranged before the video in the first photo album.
- the thumbnail of the video displayed in the first photo album or the photo tab includes: an identifier indicating that the video is associated with the photo; wherein, the identifier of the video is the thumbnail of the first frame of the video, and the identifier of each photo associated with the video is the thumbnail of each photo,
- the display module 701. in response to the user's second operation on the thumbnail of the video displayed in the first photo album or the photo tab, the display module 701. It is also used to display a second interface.
- the logo on the second interface indicating that the photo is associated with the video disappears, and a selection logo is displayed on the thumbnail of the video.
- the human-computer interaction device provided by the embodiment of the present application can be used to implement the interface display and internal processing flow in Figures 4B to 4E in the above embodiment, as well as in Figure 5, and has the same implementation principles and technical effects as the above embodiment. This will not be described in detail.
- an embodiment of the present application further provides an electronic device.
- the electronic device may be the terminal described in the above embodiment.
- the electronic device may include: a processor 801 (such as a CPU). , memory 802.
- the memory 802 may include high-speed random access memory (random-access memory, RAM), and may also include non-volatile memory (non-volatile memory, NVM), such as at least one disk memory.
- RAM random-access memory
- NVM non-volatile memory
- Various instructions may be stored in the memory 802 , to complete various processing functions and implement the method steps of the present application.
- the electronic device involved in this application may also include: a power supply 803, a communication bus 804, a communication port 805, and a display 806.
- the above-mentioned communication port 805 is used to realize connection and communication between the electronic device and other peripheral devices.
- the memory 802 is used to store computer executable program code, and the program code includes instructions; when the processor 801 executes the instructions, the instructions cause the processor 801 of the electronic device to perform the actions in the above method embodiment, which implements The principles and technical effects are similar and will not be repeated here.
- the display 806 may be a display screen of an electronic device, used to display an interface of the electronic device.
- modules or components described in the above embodiments may be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or , one or more microprocessors (digital signal processor, DSP), or one or more field programmable gate arrays (field programmable gate array, FPGA), etc.
- ASICs application specific integrated circuits
- DSP digital signal processor
- FPGA field programmable gate array
- the processing element can be a general processor, such as a central processing unit (CPU) or other processors that can call the program code such as a control device.
- these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).
- SOC system-on-a-chip
- a computer program product includes one or more computer instructions.
- Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g., computer instructions may be transmitted from a website, computer, server or data center via a wired link (e.g.
- Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless means to transmit to another website site, computer, server or data center.
- Computer-readable storage media can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or other integrated media that contains one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), etc.
- the term "plurality” as used herein means two or more.
- the term “and/or” in this article is just an association relationship that describes related objects, indicating that three relationships can exist. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations.
- the character "/" in this article generally indicates that the related objects before and after are an “or” relationship; in the formula, the character "/” indicates that the related objects before and after are a “division” relationship.
- words such as “first” and “second” are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating. Or suggestive order.
- the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
- the execution order of each process should be determined by its functions and internal logic, and should not be used in the implementation of the present application.
- the implementation of the examples does not constitute any limitations.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (16)
- 一种人机交互方法,其特征在于,包括:在图库应用程序中,响应于用户对第一相册或照片页签中显示的视频的缩略图的第一操作,显示第一界面,所述第一界面的显示区域显示所述视频的画面,所述第一界面还包括:关联区域和操作区域,所述关联区域包括所述视频的标识和所述视频关联的至少一个照片的标识,所述至少一个照片基于所述视频生成,所述操作区域中包括分享控件;响应于所述用户操作所述分享控件,向目标终端分享所述视频。
- 根据权利要求1所述的方法,其特征在于,所述响应于所述用户操作所述分享控件,向目标终端分享所述视频,包括:响应于所述用户操作所述分享控件,显示第一分享界面,所述第一分享界面上包括:第一待分享内容浏览区和分享选择区域,所述第一待分享内容浏览区中包括的内容与所述视频所属的所述第一相册或所述照片页签相关,所述分享选择区域包括待分享的用户的标识;响应于所述用户对所述待分享的用户的标识中目标用户的标识的操作,向所述目标终端分享所述视频,所述目标终端为所述目标用户对应的终端。
- 根据权利要求2所述的方法,其特征在于,当所述用户对所述第一相册中显示的视频的缩略图执行第一操作时,且所述第一相册中包括所述视频和所述视频关联的至少一个照片时,所述第一待分享内容浏览区中包括所述视频的缩略图;当所述用户对所述第一相册中显示的视频的缩略图执行第一操作时,且所述第一相册中包括所述视频,但未包括所述视频关联的至少一个照片时,所述第一待分享内容浏览区中包括所述视频的缩略图,以及所述视频关联的每个照片的缩略图;所述第一待分享内容浏览区中所述视频的缩略图上显示有选中标识。
- 根据权利要求3所述的方法,其特征在于,当所述第一相册中包括所述视频,但未包括所述视频关联的至少一个照片时,所述第一待分享内容浏览区包括:所述视频的缩略图,以及所述至少一个照片中一个照片的缩略图的部分。
- 根据权利要求3或4所述的方法,其特征在于,当所述第一相册中包括所述视频和所述视频关联的至少一个照片时,在所述第一待分享内容浏览区中所述视频的缩略图的显示位置之前还包括:所述第一相册中排布在所述视频之前的内容的缩略图,在所述第一待分享内容浏览区中所述至少一个照片的缩略图的显示位置之后还包括:所述第一相册中排布在所述至少一个照片之后的内容的缩略图,其中,所述第一相册中,所述至少一个照片排布在所述视频之后;当所述第一相册中包括所述视频,但未包括所述视频关联的至少一个照片时,在所述第一待分享内容浏览区中所述视频的缩略图的显示位置之前还包括:所述第一相册中排布在所述视频之前的内容的缩略图,在所述第一待分享内容浏览区中所述视频的缩略图的显示位置之后还包括:所述第一相册中排布在所述视频之后的内容的缩略图。
- 根据权利要求3-5中任一项所述的方法,其特征在于,当所述第一待分享内容浏览区中包括所述视频的缩略图,以及所述视频关联的每个照片的缩略图时,所述响应于所述用户对所述待分享的用户的标识中目标用户的标识的操作,向所述目标终端分享所述视频之前,还包括:在所述第一待分享内容浏览区中,检测到所述用户选择所述至少一个照片中目标照片的缩略图的操作;所述响应于所述用户对所述待分享的用户的标识中目标用户的标识的操作,向所述目标终端分享所述视频,包括:响应于所述用户对所述目标用户的标识的操作,向所述目标终端分享所述视频和所述目标照片。
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:响应于所述用户在所述第一界面上对所述至少一个照片中目标照片的标识的操作,在所述显示区域显示所述目标照片;响应于所述用户操作所述分享控件,向所述目标终端分享所述目标照片。
- 根据权利要求7所述的方法,其特征在于,所述响应于所述用户操作所述分享控件,向所述目标终端分享所述目标照片,包括:响应于所述用户操作所述分享控件,显示第二分享界面,所述第二分享界面上包括:第二待分享内容浏览区和分享选择区域,所述第二待分享内容浏览区包括:所述目标照片的缩略图、所述视频的缩略图,以及所述视频关联的其他照片的缩略图,所述目标照片的缩略图上显示有选中标识,所述分享选择区域包括待分享的用户的标识;响应于所述用户对所述待分享的用户的标识中目标用户的标识的操作,向所述目标终端分享所述目标照片,所述目标终端为所述目标用户对应的终端。
- 根据权利要求8所述的方法,其特征在于,在所述第二待分享内容浏览区中,所述视频的缩略图排布在所述目标照片的缩略图之前,所述视频关联的其他照片的缩略图排布在所述目标照片的缩略图之后。
- 根据权利要求9所述的方法,其特征在于,在所述第二待分享内容浏览区中所述视频的缩略图的显示位置之前还包括:所述第一相册中排布在所述视频之前的内容的缩略图,在所述第二待分享内容浏览区中所述视频关联的其他照片的缩略图的显示位置之后还包括:所述第一相册中排布在所述视频之前的内容的缩略图。
- 根据权利要求1-10中任一项所述的方法,其特征在于,所述第一相册或所述照片页签中显示的所述视频的缩略图上包括:表征所述视频存在关联的照片的标识;其中,所述视频的标识为所述视频的第一帧的缩略图,所述视频关联的每个照片的标识为每个照片的缩略图。
- 根据权利要求11所述的方法,其特征在于,所述方法还包括:在所述图库应用程序中,响应于所述用户对所述第一相册或所述照片页签中显示的所述视频的缩略图的第二操作,显示第二界面,所述第二界面上表征所述视频存在关联的照片的标识消失,且所述视频的缩略图上显示有选中标识。
- 一种人机交互装置,其特征在于,包括:在图库应用程序中,响应于用户对第一相册或照片页签中显示的视频的缩略图的第一操作,显示模块,用于显示第一界面,所述第一界面的显示区域显示所述视频的画面,所述第一界面还包括:关联区域和操作区域,所述关联区域包括所述视频的标识和所述视频关联的至少一个照片的标识,所述至少一个照片基于所述视频生成,所述操作区域中包括分享控件;收发模块,用于响应于所述用户操作所述分享控件,向目标终端分享所述视频。
- 一种电子设备,其特征在于,包括:处理器和存储器;所述存储器存储计算机执行指令;所述处理器执行所述存储器存储的计算机执行指令,使得所述处理器执行如权利要求1-12中任一项所述的方法。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机程 序或指令,当所述计算机程序或指令被运行时,实现如权利要求1-12中任一项所述的方法。
- 一种计算机程序产品,其特征在于,包括计算机程序或指令,所述计算机程序或指令被处理器执行时,实现权利要求1-12中任一项所述的方法。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23758896.7A EP4345650B1 (en) | 2022-02-28 | 2023-01-05 | Human-machine interaction method and apparatus, and electronic device |
| US18/577,103 US12638961B2 (en) | 2022-02-28 | 2023-01-05 | Human-machine interaction method and apparatus, and electronic device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210193754.8A CN116701686B (zh) | 2022-02-28 | 2022-02-28 | 人机交互方法、装置和电子设备 |
| CN202210193754.8 | 2022-02-28 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2023160271A1 WO2023160271A1 (zh) | 2023-08-31 |
| WO2023160271A9 true WO2023160271A9 (zh) | 2024-03-14 |
Family
ID=87764666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/070780 Ceased WO2023160271A1 (zh) | 2022-02-28 | 2023-01-05 | 人机交互方法、装置和电子设备 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US12638961B2 (zh) |
| EP (1) | EP4345650B1 (zh) |
| CN (2) | CN121901441A (zh) |
| WO (1) | WO2023160271A1 (zh) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| USD992593S1 (en) * | 2021-01-08 | 2023-07-18 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
| US12357914B2 (en) * | 2023-03-06 | 2025-07-15 | Sony Interactive Entertainment Inc. | Methods and systems for artificial intelligence (AI)-based storyboard generation |
| CN120343177B (zh) * | 2024-01-10 | 2026-06-09 | 荣耀终端股份有限公司 | 一种照片处理方法及电子设备 |
| CN119906719B (zh) * | 2024-09-23 | 2026-06-30 | 华为技术有限公司 | 一种图片分享方法及相关装置 |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104238893B (zh) | 2013-06-08 | 2018-08-03 | 腾讯科技(深圳)有限公司 | 一种对视频预览图片进行显示的方法和装置 |
| US10282056B2 (en) * | 2013-12-24 | 2019-05-07 | Dropbox, Inc. | Sharing content items from a collection |
| CN105100893A (zh) * | 2014-04-21 | 2015-11-25 | 联想(北京)有限公司 | 一种视频分享的方法和装置 |
| US10237621B2 (en) * | 2016-03-24 | 2019-03-19 | Dish Technologies Llc | Direct capture and sharing of screenshots from video programming |
| CN105898520A (zh) * | 2016-04-07 | 2016-08-24 | 合网络技术(北京)有限公司 | 视频帧截取方法和装置 |
| JP6899510B2 (ja) * | 2016-04-14 | 2021-07-07 | Line株式会社 | 表示制御方法、端末、及びプログラム |
| CN105872810B (zh) * | 2016-05-26 | 2019-05-03 | 网易传媒科技(北京)有限公司 | 一种媒体内容分享方法和装置 |
| DK179932B1 (en) * | 2017-05-16 | 2019-10-11 | Apple Inc. | DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR NAVIGATING, DISPLAYING, AND EDITING MEDIA ITEMS WITH MULTIPLE DISPLAY MODES |
| CN107704519B (zh) | 2017-09-01 | 2022-08-19 | 毛蔚青 | 基于云计算技术的用户端相册管理系统及其交互方法 |
| CN108536365B (zh) * | 2018-03-16 | 2020-07-28 | 维沃移动通信有限公司 | 一种图像分享方法及终端 |
| US10917372B2 (en) * | 2018-09-21 | 2021-02-09 | Blackberry Limited | Method and system for integration of shared photo albums with messaging applications |
| CN109542999A (zh) * | 2018-11-29 | 2019-03-29 | 湖南科技大学 | 一种记录轨迹和多媒体信息的系统及方法 |
| CN110072071B (zh) | 2019-05-31 | 2023-05-05 | 广东图盛超高清创新中心有限公司 | 一种视频录制交互控制方法、设备及计算机可读存储介质 |
| CN110460894A (zh) | 2019-06-25 | 2019-11-15 | 维沃移动通信有限公司 | 一种视频图像显示方法及终端设备 |
| CN110825289B (zh) * | 2019-10-31 | 2026-06-23 | 抖音视界有限公司 | 操作用户界面的方法、装置、电子设备及存储介质 |
| CN113297505A (zh) * | 2020-06-10 | 2021-08-24 | 阿里巴巴集团控股有限公司 | 信息分享方法及装置、信息展示方法及装置 |
| CN111857517B (zh) | 2020-07-28 | 2022-05-17 | 腾讯科技(深圳)有限公司 | 视频的信息处理方法、装置、电子设备及存储介质 |
| US12033669B2 (en) * | 2020-09-10 | 2024-07-09 | Adobe Inc. | Snap point video segmentation identifying selection snap points for a video |
-
2022
- 2022-02-28 CN CN202512060029.XA patent/CN121901441A/zh active Pending
- 2022-02-28 CN CN202210193754.8A patent/CN116701686B/zh active Active
-
2023
- 2023-01-05 US US18/577,103 patent/US12638961B2/en active Active
- 2023-01-05 WO PCT/CN2023/070780 patent/WO2023160271A1/zh not_active Ceased
- 2023-01-05 EP EP23758896.7A patent/EP4345650B1/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| US20240353979A1 (en) | 2024-10-24 |
| US12638961B2 (en) | 2026-05-26 |
| EP4345650A1 (en) | 2024-04-03 |
| WO2023160271A1 (zh) | 2023-08-31 |
| EP4345650B1 (en) | 2026-04-22 |
| CN116701686B (zh) | 2026-01-06 |
| CN121901441A (zh) | 2026-04-21 |
| CN116701686A (zh) | 2023-09-05 |
| EP4345650A4 (en) | 2024-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10963128B1 (en) | Systems and methods for capturing content | |
| CN106575361B (zh) | 提供视觉声像的方法和实现该方法的电子设备 | |
| WO2023160271A1 (zh) | 人机交互方法、装置和电子设备 | |
| CN114827342B (zh) | 视频处理方法、电子设备及可读介质 | |
| JP4988012B2 (ja) | 電子機器およびインデキシング制御方法 | |
| JP2019531561A (ja) | 画像処理方法および装置、電子デバイス、ならびにグラフィカルユーザインターフェース | |
| KR20170054868A (ko) | 콘텐트를 제공하는 방법 및 이를 지원하는 전자 장치 | |
| CN111371988A (zh) | 内容操作方法、装置、终端及存储介质 | |
| WO2019206243A1 (zh) | 一种素材展示方法、终端和计算机存储介质 | |
| WO2020073317A1 (zh) | 文件管理方法及电子设备 | |
| CN108228776B (zh) | 数据处理方法、装置、存储介质及电子设备 | |
| CN113487705A (zh) | 图像标注方法、终端及存储介质 | |
| CN106657767A (zh) | 一种拍摄的方法和移动终端 | |
| JP2012004747A (ja) | 電子機器および画像表示方法 | |
| CN115842953A (zh) | 拍摄方法及其装置 | |
| CN110019897A (zh) | 显示图片的方法及装置 | |
| CN113271378B (zh) | 图像处理方法、装置及电子设备 | |
| CN116701685A (zh) | 人机交互方法、装置和电子设备 | |
| WO2025036376A1 (zh) | 视频预览方法、视频预览装置和电子设备 | |
| CN117395462A (zh) | 媒体内容的生成方法、装置、电子设备和可读存储介质 | |
| WO2023160143A1 (zh) | 浏览多媒体内容的方法及装置 | |
| CN105430260B (zh) | 获取视频图像的方法及装置 | |
| WO2023160142A1 (zh) | 视频处理方法、电子设备及可读介质 | |
| CN116701684B (zh) | 人机交互方法、装置和电子设备 | |
| CN115904168A (zh) | 基于多设备的影像素材处理方法及相关装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23758896 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023758896 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18577103 Country of ref document: US |
|
| ENP | Entry into the national phase |
Ref document number: 2023758896 Country of ref document: EP Effective date: 20231229 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2023758896 Country of ref document: EP |
|
| WWG | Wipo information: grant in national office |
Ref document number: 18577103 Country of ref document: US |