WO2022073428A1 - 视频处理方法及装置 - Google Patents

视频处理方法及装置 Download PDF

Info

Publication number
WO2022073428A1
WO2022073428A1 PCT/CN2021/120454 CN2021120454W WO2022073428A1 WO 2022073428 A1 WO2022073428 A1 WO 2022073428A1 CN 2021120454 W CN2021120454 W CN 2021120454W WO 2022073428 A1 WO2022073428 A1 WO 2022073428A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
terminal
video
image
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/120454
Other languages
English (en)
French (fr)
Inventor
于宙
阚砚馨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to EP21876946.1A priority Critical patent/EP4171048B1/en
Priority to JP2023507881A priority patent/JP7534532B2/ja
Publication of WO2022073428A1 publication Critical patent/WO2022073428A1/zh
Priority to US18/148,384 priority patent/US12069111B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/04—Systems for the transmission of one television signal, i.e. both picture and sound, by a single carrier
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services

Definitions

  • Embodiments of the present disclosure relate to the technical field of computer and network communications, and in particular, to a video processing method, apparatus, electronic device, computer-readable storage medium, computer program product, and computer program.
  • a video method provided by a social application mainly includes: first, when the terminal of user A receives a video request initiated by user A in the social application, it forwards the video request to the terminal where user B is located; After receiving the confirmation answering instruction from user B, the terminal where it is located sends a confirmation answering message to the terminal used by user A; finally, the terminal used by user A sends the captured video to the terminal where user B is located, so that the Only the video is displayed on the terminal where user A is located, and the terminal used by user B sends the collected video to the terminal used by user A, so that only the video is displayed on the terminal where user A is located.
  • the existing video display mode is relatively simple, and will affect the display of other information such as chat content and notification information between users A and B.
  • Embodiments of the present disclosure provide a video processing method, apparatus, electronic device, computer-readable storage medium, computer program product, and computer program to overcome the problem of poor real-time performance of existing video methods.
  • an embodiment of the present disclosure provides a video processing method, applied to a first terminal, including:
  • the image captured by the camera of the first terminal is displayed in real time on the chat page of the first user and the second user, and the image is superimposed and displayed in a preset area on the image. and send the image captured by the camera of the first terminal as a video frame to the second terminal in real time, so that the second terminal can view the chat page between the second user and the first user in real time.
  • the image is displayed in real time in the image, and the remaining information other than the image is superimposed and displayed in a preset area on the image; wherein, the first terminal is the terminal corresponding to the first user, and the second terminal is the terminal corresponding to the first user.
  • the terminal is a terminal corresponding to the second user.
  • an operation instruction detection module for detecting an operation instruction of the first user
  • an operation instruction response module configured to, in response to the operation instruction, display the image captured by the camera of the first terminal in real time on the chat page of the first user and the second user, in a preset area on the image
  • the remaining information other than the image is displayed by superimposing the image, and the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame, so that the second terminal can communicate with the second user and the second terminal in real time.
  • the image is displayed in real time on the chat page of the first user, and the remaining information other than the image is superimposed and displayed in a preset area on the image; wherein the first terminal corresponds to the first user terminal, the second terminal is the terminal corresponding to the second user.
  • the memory stores computer-executable instructions
  • the at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the video processing method described in the first aspect above and various possible aspects of the first aspect.
  • embodiments of the present disclosure provide a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, the first aspect and the first Aspects may involve various described video processing methods.
  • embodiments of the present disclosure provide a computer program product, including computer-executable instructions, when a processor executes the computer-executable instructions, the video processing described in the first aspect and various possible designs of the first aspect is implemented. method.
  • embodiments of the present disclosure provide a computer program, when a processor executes the computer program, the video processing method described in the first aspect and various possible designs of the first aspect is implemented.
  • the video processing method and device provided in this embodiment are applied to a first terminal.
  • the method can display an image captured by a camera of the first terminal on a chat page, and superimpose and display other information such as chat content on the image.
  • the display of the remaining information of the first user and the second user is not affected.
  • FIG. 1 is a schematic flowchart of a video processing method provided by an embodiment of the present disclosure
  • FIG. 2 is an example diagram 1 of a chat page displayed on a first terminal according to an embodiment of the present disclosure
  • FIG. 3 is an example diagram 1 of a chat page displayed on a second terminal according to an embodiment of the present disclosure
  • FIG. 4 is an example FIG. 2 of displaying a chat page on a first terminal according to an embodiment of the present disclosure
  • Fig. 5 is an example diagram of a user list in the prior art
  • FIG. 6 is an example diagram of displaying a user list on the first terminal according to an embodiment of the present disclosure
  • FIG. 7 is an example diagram of displaying a video request on a second terminal according to an embodiment of the present disclosure.
  • FIG. 8 is another example diagram of displaying a video request on a second terminal according to an embodiment of the present disclosure.
  • FIG. 9 is an example FIG. 2 of displaying a chat page on a first terminal according to an embodiment of the present disclosure
  • FIG. 10 is an example FIG. 2 of displaying a chat page on a second terminal according to an embodiment of the present disclosure
  • FIG. 11 is a structural block diagram of a video processing apparatus provided by an embodiment of the present disclosure.
  • FIG. 12 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present disclosure.
  • FIG. 1 is a first schematic flowchart of a video processing method provided by an embodiment of the present disclosure.
  • the method of this embodiment can be applied to a first terminal, where the first terminal is a terminal device that sends a video, and the video processing method includes:
  • S101 Detect an operation instruction of a first user.
  • the operation instruction is an instruction for sending a video initiated by the first user on the first terminal, and may be specifically generated when the user operates a video control displayed on the first terminal.
  • S102 In response to the operation instruction, display the image captured by the camera of the first terminal in real time on the chat pages of the first user and the second user, and superimpose and display the image in a preset area on the image.
  • the remaining information other than the image, and the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame, so that the second terminal can be connected between the second user and the first user in real time.
  • the image is displayed in real time on the chat page, and other information other than the image is superimposed and displayed in a preset area on the image; wherein, the first terminal is a terminal corresponding to the first user, and the The second terminal is a terminal corresponding to the second user.
  • the first terminal turns on the camera to capture images, and every time a frame of image is captured, the frame of image is sent to the second terminal.
  • the first terminal sends continuous images to the second terminal, and these continuous images are displayed on the second terminal with A video is formed, and each frame of image in the video is called a video frame.
  • the chat page on the first terminal includes the remaining information between the first user and the second user, and the remaining information includes but is not limited to: dialogue information and notification information, and the dialogue information can be voice, text, pictures, video clips, etc. Format.
  • the first user sends a text message "I have dinner with our high school classmate Xiao Ming today" to the second user, and then the second user replies "no picture, no truth” to the first user, and finally the first user sends a message to the first user.
  • the second user operates the first video control after sending the message "show you".
  • the first camera is turned on and captures images, and the captured images are displayed on the chat page in real time, as shown in Figure 2
  • the images displayed in can be of Xiao Ming.
  • the first terminal also displays notification information on the chat page. As shown in FIG. 2 , after the first user operates the first video control, the first terminal displays notification information "You are sharing a real-time image"; the first terminal is turned on After the camera, the notification information "You have enabled real-time image sharing” is displayed; after the second user receives the real-time image sharing on the second terminal, the notification information "The other party has viewed the real-time image sharing" is displayed.
  • the chat page of the second terminal also displays corresponding dialogue information, notification information, and images.
  • the chat page displays the communication between the first user and the second user Dialogue information and images sent by the first terminal.
  • the second terminal also displays notification information on the chat page, and after the first user operates the first video control on the first terminal, the chat page on the second terminal displays notification information "the other party is sharing the real-time image"; After one terminal turns on the camera, a notification message "the other party has shared the real-time image" is displayed on the chat page of the second terminal.
  • the chat page of the second terminal starts to display the image sent by the first terminal in real time.
  • the dialogue information and notification information are superimposed on the image, that is, the image is used as the background of the chat page, and the dialogue information and notification information are used as the content of the chat page.
  • the dialogue information and notification information superimposed on the top need to have a certain degree of transparency, so that the first user can view the image superimposed on the bottom through the remaining information superimposed on the top.
  • the real-time display of the image is that each time the camera collects a frame of image, the image is displayed, so that multiple frames of images continuously collected form a video on the first terminal.
  • the first user can also send chat content, which will not affect the normal chat of the first user.
  • the first user may also send the chat content "see if it's him" on the chat page as shown in FIG. 2 or 3 .
  • the preset area may be the entire area of the chat page as shown in Figure 2 or 3, or may be a partial area of the chat page as shown in Figure 4, and the images in the partial area may be blocked by other information. The image outside some areas will not be occluded by the rest of the information, and the rest of the information at the latest time is displayed in some areas. As shown in Figure 4, part of the area is located in the lower left corner of the image, DL is the dialog information, and NT is the notification information.
  • the attribute information of the preset area may be adjusted: in response to the area adjustment instruction, the attribute information of the preset area is adjusted, wherein the attribute information of the preset area includes but is not limited to : Size, Transparency, Color, Position. Therefore, the first user can flexibly adjust the properties of the preset area, so as to avoid occlusion of the image as much as possible.
  • the chat page on the second terminal can also display images, dialogue information and notification information in this way, and the second user can also display the attribute information of the preset area. Adjustments are made, and details are not described herein again in this disclosure.
  • the embodiments of the present disclosure can superimpose and display the dialogue information in a preset area above the image, so as to avoid large-area occlusion of the image by the dialogue information, and help improve the display integrity of the image.
  • the S101 includes S1011:
  • S1011 Detect an operation instruction of a first user on a first video control, where the first video control is located in at least one of the following objects: the first user corresponds to the chat page of the second user and the second user in the user list in the information entry.
  • the first video control is a control for sending video frames in real time. After the first user operates the first video control, the first terminal turns on the camera to capture images.
  • the above-mentioned user list may include, but is not limited to: a user call list and an address book list, the second user in the user call list is a user recently contacted by the first user, and the second user in the address book list is a user recorded on the first terminal. .
  • the information item is used to display the information of the second user.
  • the information item includes but is not limited to: the name, image and other identification information of the second user.
  • the user can also click the information item to enter the details page.
  • the details page is a chat page, which may include but not limited to: voice, text, video and other conversation information and the corresponding conversation time;
  • the details page may include but not limited to: Contact information, user address, birthday, contact information and other details.
  • the embodiment of the present disclosure can display the first video control in the chat page, and also can display the first video control in the user list, providing a variety of display modes of the video control.
  • the present disclosure only requires the first user to The goal of displaying an image in the chat page can be achieved by operating the video control, and no operation by the second user is required, which reduces the operation complexity of the second user.
  • the S1011 before the S1011, it further includes S1012 to S1013:
  • the second user is a user using the second terminal, and the second terminal receives and displays the video sent by the first terminal for the second user to view.
  • User status includes but is not limited to: online status, offline status, busy status, and do not disturb status. It can be understood that when the user status is online, the second user can receive real-time video, text and other information sent by the first terminal through the second terminal; when the user status is offline or busy, the second user may The video, text and other information sent by the first terminal cannot be received in real time.
  • user behavior determines user state.
  • the login behavior of the second user may represent that the user status of the second user is online
  • the logout behavior of the second user may represent that the user status of the second user is offline
  • the chat behavior of the second user may represent the user status of the second user.
  • User status is online.
  • the first terminal may receive the user status of the second user sent by the second terminal.
  • the second terminal may send status notification information to the first terminal after the second user logs in, where the status notification information includes the user ID of the second user and the user status is online; the second terminal may also log in to the second user After switching the user status, send status notification information to the first terminal, where the status notification information includes the user ID of the second user and the user status after switching; the second terminal may also send status notification to the first terminal after the second user exits information, the status notification information includes the user ID of the second user and the user status is offline.
  • the first terminal may obtain the user status of the second user according to user behavior analysis of the second user. For example, if it is detected that the second user has chatting behavior in the current time or a preset time period before the current time, that is, the first terminal receives the chat information sent by the second terminal, it can be determined that the user status of the second user is online; If it is detected that the second user has not received the chat information sent by the second terminal within a preset time period before the current time, it may be determined that the user status of the second user is an offline state.
  • FIG. 5 is an example diagram of a user list in the prior art.
  • the first user needs to send a video
  • one of the second users can be selected from the user list shown in the attached drawing on the left side of FIG. 5 to enter the chat page with the second user, as shown on the right side of FIG.
  • a video control K is fixedly displayed, and the first user can operate K to initiate a video request to send a video to the second user in real time.
  • the first user operates the video control K he does not know whether the second user is online, so the initiated video may not be viewed in real time, resulting in poor real-time performance of the video.
  • the embodiment of the present disclosure may display the first video control in the information item when the second user is in an online state. It can be understood that, when the second user is in an online state, the second user can immediately view the video frame sent in real time, so this application scenario has high requirements on the real-time viewing of the video.
  • the method further includes S1014:
  • the second video control is a control for sending video clips. After the first user operates the second video control, the first terminal turns on the camera to capture images, but the difference is that after capturing a frame of image, it does not The image is sent to the second terminal immediately, but the image is temporarily stored, and all the collected images are spliced into video clips in chronological order after the image capture ends, and the video clips are sent to the second terminal.
  • the offline state includes, but is not limited to, an offline state, a busy state, and a do not disturb state.
  • the second user does not immediately view the sent video clip, but can view the video clip in idle time, so that the application scenario has lower requirements on the real-time viewing of the video clip.
  • the present disclosure can display the first video control or the second video control in the information item according to the user state. As shown in FIG. 6 , the first video control K1 and the second video control K2 are displayed in the information items, the user list is the user call list, and FIG.
  • the sixth includes 5 second users, the names are: name 1 to name 5, The second user name 1 corresponds to the information item L1, the second user name 2 corresponds to the information item L2, the second user name 3 corresponds to the information item L3, the second user name 4 corresponds to the information item L4, the second user name 5 corresponds to the information item L5,
  • the first video control or the second video control is displayed in the information item of each second user, the first video control K1 is displayed in the information items L1, L2 and L5, and the second video control K1 is displayed in the information items L3 and L4.
  • Video control K2 is displayed in the information item L1
  • the second user name 3 corresponds to the information item L3
  • the second user name 4 corresponds to the information item L4
  • the second user name 5 corresponds to the information item L5
  • the first video control or the second video control is displayed in the information item of each second user, the first video control K1 is displayed in the information items L1, L2 and L5, and the second video control K1 is displayed in the information items L
  • the first user can enter the chat page shown in FIG. 2 to display the collected images in real time on the chat page.
  • the first user can also prompt the first user to “turn on the camera”, and the first user can select “turn on immediately” to turn on the camera; if the camera is turned on subsequently, it will no longer be prompted.
  • the embodiments of the present disclosure can display video controls in the user list according to the user status.
  • the first user can directly perform video operations with the second user in the user list without entering the chat page with the second user.
  • the operation complexity of the first user is reduced, and the video efficiency is improved;
  • the first user can select a second user from a plurality of second users corresponding to the first video control to perform video, which improves the first user's understanding of the video. Flexibility of selection of the second user; finally, the user can also select the second user corresponding to the second video control to share video clips with lower real-time requirements according to actual needs.
  • a typical application scenario of the present disclosure is that the first terminal only sends a silent image to the second terminal, and does not send corresponding voice data to the second user at the same time, and the second terminal sends an in-site notification or an off-site notification to the second user.
  • the method prompts the second user, and does not notify the second user by means of ringtones, vibrations, etc.
  • the camera turned on by the first terminal is usually not a front-facing camera, but a camera that shoots in other directions, for example, a rear-facing camera. In this way, the first user can share the scene he sees with the second user in a silent manner. , enriching the social experience.
  • the video notification may prompt the second user with in-site information, or may prompt the second user with system information.
  • the first user of the social application initiates a video request to the second user
  • the first terminal generates a video notification according to the video request
  • the second terminal will display it in the form of in-site information
  • Video notifications for example, as shown in Figure 7, the in-site information "Xiao Wang is sharing real-time pictures with you" is displayed in the preset area of the social application;
  • the second terminal is in the locked screen state, the first user of the social application
  • the second user initiates a video request, the first terminal generates a video notification according to the video request, and the second terminal will display the video notification in the form of system information.
  • the preset area of the lock screen interface In the preset area of the lock screen interface.
  • the second user can click on the video notification.
  • the second terminal will enter the chat page and start to receive the video frames captured by the camera of the first terminal at the current time, so as to The video frame is displayed in real time on the chat page.
  • the second user when the user status of the second user is online, the second user can immediately receive video frames sent in real time, and at this time, the second user can receive a video request sent to the second terminal, thereby Combined with the operation of the second user, the real-time nature of viewing the video frame can be more accurately guaranteed.
  • the second terminal can automatically end the video notification without requiring the user to manually end the video notification.
  • the first user may also actively end the video notification on the first terminal.
  • the preset time can be set according to the actual application scenario, for example, can be set to 30 seconds.
  • S1024 Send a recorded video clip to the second terminal, where the video clip is generated from an image collected by a camera of the first terminal before the video request ends.
  • the first terminal can enter the chat page between the first user and the second user, and the chat page displays the first video in real time.
  • the images collected by the camera of the terminal after the video request ends, the images collected between the beginning and the end of the video request can be spliced into video segments in chronological order.
  • the first user may be allowed to set a threshold for the number of times the video clip is viewed on the first terminal, and count the number of times the video clip is viewed, and when the number of times is greater than or equal to the threshold, withdraw the Video clip; when the number of times is less than the threshold, the video clip will not be recalled.
  • the first user sets the number of times threshold.
  • the number of times threshold set by the first user is inaccurate in constraining the number of viewing times , so in order to avoid this situation, the present disclosure can allow the first user to set the number of times threshold within a preset time, and cannot be set after the preset time, for example, the first user can be allowed to send the video clip to the second terminal.
  • the number of times threshold is set within 2 minutes, and cannot be set after 2 minutes.
  • a typical number of thresholds may be 1, that is, the video clip is retracted after the video clip is viewed once.
  • the user can click the notification The information "allow to review once” only allows the video clip to be viewed only once, so that after setting, the thumbnail of the shared video clip can display the prompt message "the other party will withdraw after viewing it”.
  • the first user can be prompted through notification information on the chat page of the first terminal.
  • the notification information "The other party has viewed” is displayed first on the chat page, and then the notification information "The real-time screen has been withdrawn” is displayed.
  • the second user may also be prompted through a notification message “the real-time screen has been withdrawn” on the chat page of the second terminal.
  • the chat page of the second terminal also prompts the second user to view the shared video clip through the notification message "the other party has shared the real-time screen view", and the user can click "view” to play the video clip.
  • the present disclosure can withdraw the video clip after the second user views the video clip, prevent the video clip from being downloaded, forwarded, etc., and effectively protect the privacy of the video clip.
  • the method further includes S103 to S104:
  • S103 Receive an image collected by a camera of the second terminal.
  • the second user may also initiate a video on the second terminal to send the image captured by the camera of the second terminal to the first terminal.
  • the specific operation steps are the same as those of the first user in the first terminal.
  • the operation steps on the terminal are the same, and are not repeated here.
  • S104 Stop displaying the image captured by the camera of the first terminal in real time on the chat page of the first user and the second user, and display it in real time on the chat page of the first user and the second user The image collected by the camera of the second terminal.
  • the image captured by the camera of the first terminal that initiates the video can be shared to the second terminal by default, and displayed on the first terminal.
  • the second user after the second user also shares the video, it can be automatically switched to the second terminal.
  • Both the first terminal and the second terminal display the image captured by the camera of the second terminal, so when the second user wants to initiate a video to the first user, there is no need to exit the current video between the first user and the second user first, Restarting the video reduces the operation complexity of the second user.
  • the method further includes S105 to S106:
  • the switching instruction is an instruction on the first terminal for switching between the image captured by the camera of the first terminal and the image captured by the camera of the second terminal.
  • the first user can click the switching control on the first terminal.
  • S106 in response to the switching instruction, display the switched images in real time on the chat pages of the first user and the second user, where the switched images include the following item: a camera of the first terminal The collected image and the image collected by the camera of the second terminal.
  • the second terminal can also perform switching operations similar to S105 to S106, which are not limited in the present disclosure.
  • images can be switched and displayed according to the switching instruction of the first user, which helps to improve the flexibility of video display.
  • S107 Display different notification information marked differently on the chat pages of the first user and the second user, where the notification information is used to prompt the sending state of the video frame.
  • notification information can be distinguished in various ways, including but not limited to: icons, colors, sizes, and the like.
  • the icon for the notification information of starting to share the real-time screen is different from the icon for the notification information after sharing.
  • the icon of the notification information for starting to share the real-time screen can also be represented by the first color.
  • the icon of the notification information that has been shared is represented by a second color, where the first color may be green, and the second color may be gray.
  • the embodiment of the present disclosure distinguishes the marked notification information to distinguish different sending states, and distinguishing the marked notification information can facilitate the second user to obtain the sending state more quickly, and improve the efficiency of the second user obtaining the sending state.
  • the video processing method provided in this embodiment can display the image captured by the camera of the first terminal on the chat page, and superimpose and display other information such as the chat content on the image.
  • the image can also be sent to the second terminal. terminal, so that the second terminal can perform the same display, thus providing a new video display mode for the first user and the second user during the video process, which helps to enrich the diversification of video display.
  • FIG. 11 is a structural block diagram of a video processing apparatus provided by an embodiment of the present disclosure.
  • the apparatus includes: an operation instruction detection module 201 and an operation instruction response module 202 .
  • the operation instruction detection module 201 is used to detect the operation instruction of the first user.
  • the operation instruction response module 202 is configured to, in response to the operation instruction, display the image captured by the camera of the first terminal in real time on the chat page of the first user and the second user, and the preset image on the image is displayed in real time.
  • the remaining information other than the image is displayed superimposed in the area, and the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame, so that the second terminal can communicate with the second user and the second terminal in real time.
  • the image is displayed in real time on the chat page of the first user, and other information other than the image is superimposed and displayed in a preset area on the image; wherein the first terminal is owned by the first user.
  • a corresponding terminal, the second terminal is a terminal corresponding to the second user.
  • the operation instruction detection module 201 is further configured to:
  • the first video control is located in at least one of the following objects: the chat page of the first user and the second user, the information corresponding to the second user in the user list in the entry.
  • the apparatus further includes:
  • a user state detection module for detecting the user state of the second user
  • a first video control display module for displaying in the information item corresponding to the second user when the user state of the second user is online First video controls.
  • the apparatus further includes:
  • a second video control display module configured to display a second video control in the information item corresponding to the second user when the user status of the second user is offline, and in response to the second video control to send the video clip generated by the image captured by the camera to the second terminal.
  • the operation instruction response module 202 is further configured to:
  • the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame.
  • the operation instruction response module 202 is further configured to:
  • the video clip After the video clip has been viewed, the video clip is recalled.
  • the apparatus further includes:
  • an image receiving module configured to receive an image collected by a camera of the second terminal
  • a switching display module configured to stop displaying the image captured by the camera of the first terminal in real time in the chat page of the first user and the second user, and to stop displaying the image captured by the camera of the first terminal in real time in the chat page of the first user and the second user.
  • the image collected by the camera of the second terminal is displayed in real time on the page.
  • the apparatus further includes:
  • a switching instruction detection module configured to detect the switching instruction of the first user
  • a switching response module configured to display, in real time, a switched image in the chat page of the first user and the second user in response to the switching instruction, where the switched image includes the following item: the first user An image collected by a camera of one terminal, and an image collected by a camera of the second terminal.
  • the operation instruction response module 202 is further configured to:
  • Different notification information marked differently is displayed on the chat pages of the first user and the second user, and the notification information is used to prompt the sending status of the video frame.
  • the electronic device 900 may be a terminal device or a server.
  • the terminal equipment may include, but is not limited to, such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistant, referred to as PDA), tablet computers (Portable Android Device, referred to as PAD), portable multimedia players (Portable Media Player, PMP for short), mobile terminals such as in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, and the like.
  • PDA Personal Digital Assistant
  • PAD Portable Android Device
  • PMP Portable Multimedia Player
  • mobile terminals such as in-vehicle terminals (such as in-vehicle navigation terminals), etc.
  • fixed terminals such as digital TVs, desktop computers, and the like.
  • the electronic device shown in FIG. 12 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.
  • the electronic device 900 may include a processing device (such as a central processing unit, a graphics processor, etc.) 901, which may be stored in a read only memory (Read Only Memory, ROM for short) 902 according to a program or from a storage device 908 is a program loaded into a random access memory (Random Access Memory, RAM for short) 903 to execute various appropriate actions and processes.
  • a processing device such as a central processing unit, a graphics processor, etc.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • various programs and data necessary for the operation of the electronic device 900 are also stored.
  • the processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904.
  • An input/output (I/O) interface 905 is also connected to bus 904 .
  • an input device 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD for short) ), speaker, vibrator, etc. output device 907; storage device 908 including, eg, magnetic tape, hard disk, etc.; and communication device 909.
  • the communication means 909 may allow the electronic device 900 to communicate wirelessly or by wire with other devices to exchange data.
  • FIG. 12 shows electronic device 900 having various means, it should be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
  • embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
  • the computer program may be downloaded and installed from the network via the communication device 909, or from the storage device 908, or from the ROM 902.
  • the processing apparatus 901 When the computer program is executed by the processing apparatus 901, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.
  • Embodiments of the present disclosure also include a computer program that, when executed on an electronic device, performs the above-mentioned functions defined in the methods of the embodiments of the present disclosure.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • the computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .
  • Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or may exist alone without being assembled into the electronic device.
  • the aforementioned computer-readable medium carries one or more programs, and when the aforementioned one or more programs are executed by the electronic device, causes the electronic device to execute the methods shown in the foregoing embodiments.
  • Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as the "C" language or similar programming language.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or, can be connected to An external computer (eg using an Internet service provider to connect via the Internet).
  • LAN Local Area Network
  • WAN Wide Area Network
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner.
  • the name of the unit does not constitute a limitation of the unit itself under certain circumstances, for example, the first obtaining unit may also be described as "a unit that obtains at least two Internet Protocol addresses".
  • exemplary types of hardware logic components include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical Devices (CPLDs) and more.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs Systems on Chips
  • CPLDs Complex Programmable Logical Devices
  • machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM compact disk read only memory
  • magnetic storage or any suitable combination of the foregoing.
  • a video processing method is provided, applied to a first terminal, including:
  • the image captured by the camera of the first terminal is displayed in real time on the chat page of the first user and the second user, and the image is superimposed and displayed in a preset area on the image. and send the image captured by the camera of the first terminal as a video frame to the second terminal in real time, so that the second terminal can view the chat page between the second user and the first user in real time.
  • the image is displayed in real time in the image, and the remaining information other than the image is superimposed and displayed in a preset area on the image; wherein, the first terminal is the terminal corresponding to the first user, and the second terminal is the terminal corresponding to the first user.
  • the terminal is a terminal corresponding to the second user.
  • the detecting an operation instruction of the first user includes:
  • the first video control is located in at least one of the following objects: the chat page of the first user and the second user, the information corresponding to the second user in the user list in the entry.
  • the method before the detecting an operation instruction of the first user on the first video control, the method further includes:
  • Detecting the user state of the second user when the user state of the second user is an online state, displaying a first video control in an information item corresponding to the second user.
  • the method further includes:
  • the sending the image captured by the camera of the first terminal as a video frame to the second terminal in real time includes:
  • the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame.
  • the method further includes:
  • the video clip After the video clip has been viewed, the video clip is recalled.
  • the method further includes:
  • the method further includes:
  • a switched image is displayed in real time on the chat page of the first user and the second user, and the switched image includes the following item: the image captured by the camera of the first terminal The image, the image collected by the camera of the second terminal.
  • the method after sending the image captured by the camera of the first terminal to the second terminal in real time as a video frame, the method further includes:
  • Different notification information marked differently is displayed on the chat pages of the first user and the second user, and the notification information is used to prompt the sending status of the video frame.
  • a video processing apparatus applied to a first terminal, including:
  • an operation instruction detection module for detecting an operation instruction of the first user
  • an operation instruction response module configured to, in response to the operation instruction, display the image captured by the camera of the first terminal in real time on the chat page of the first user and the second user, in a preset area on the image
  • the remaining information other than the image is displayed by superimposing the image, and the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame, so that the second terminal can communicate with the second user and the second terminal in real time.
  • the image is displayed in real time on the chat page of the first user, and the remaining information other than the image is superimposed and displayed in a preset area on the image; wherein the first terminal corresponds to the first user terminal, the second terminal is the terminal corresponding to the second user.
  • the operation instruction detection module is further configured to:
  • the first video control is located in at least one of the following objects: the chat page of the first user and the second user, the information corresponding to the second user in the user list in the entry.
  • the apparatus further includes:
  • a user state detection module for detecting the user state of the second user
  • a first video control display module for displaying in the information item corresponding to the second user when the user state of the second user is online First video controls.
  • the apparatus further includes:
  • a second video control display module configured to display a second video control in the information item corresponding to the second user when the user status of the second user is offline, and in response to the second video control to send the video clip generated by the image captured by the camera to the second terminal.
  • the operation instruction response module is further configured to:
  • the image captured by the camera of the first terminal is sent to the second terminal in real time as a video frame.
  • the operation instruction response module is further configured to:
  • the video clip After the video clip has been viewed, the video clip is recalled.
  • the apparatus further includes:
  • an image receiving module configured to receive an image collected by a camera of the second terminal
  • a switching display module configured to stop displaying the image captured by the camera of the first terminal in real time in the chat page of the first user and the second user, and to stop displaying the image captured by the camera of the first terminal in real time in the chat page of the first user and the second user.
  • the image collected by the camera of the second terminal is displayed in real time on the page.
  • the apparatus further includes:
  • a switching instruction detection module configured to detect the switching instruction of the first user
  • the operation instruction response module is further configured to:
  • Different notification information marked differently is displayed on the chat pages of the first user and the second user, and the notification information is used to prompt the sending status of the video frame.
  • an electronic device comprising: at least one processor and a memory;
  • the memory stores computer-executable instructions
  • the at least one processor executes computer-implemented instructions stored in the memory, causing the at least one processor to perform the video processing method as described in the first aspect and various possible designs of the first aspect above.
  • a computer-readable storage medium where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, The video processing methods described above in the first aspect and various possible designs of the first aspect are implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开实施例提供一种视频处理方法及装置，该方法包括：检测第一用户的操作指令；响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。本公开实施例有助于丰富视频显示的多样化的同时，不影响第一用户和第二用户的其余信息的显示。

Description

视频处理方法及装置
本申请要求于2020年10月9日提交的申请号为202011074833.4、名称为“视频处理方法及装置”的中国专利申请的优先权，此申请的内容通过引用并入本文。
技术领域
本公开实施例涉及计算机与网络通信技术领域，尤其涉及一种视频处理方法、装置、电子设备、计算机可读存储介质、计算机程序产品及计算机程序。
背景技术
随着计算机与网络通信技术的迅速发展，出现了各式各样的社交应用，在这些社交应用中用户之间可以通过语音、视频、文字等方式进行交流。由于视频方式进行交流具有可视性，从而视频方式进行交流在社交应用中的使用逐渐增多。
现有技术中，社交应用提供的视频方法主要包括：首先，用户A的终端在接收到用户A在社交应用中发起的视频请求时，将视频请求转发给用户B所在的终端；然后，用户B所在的终端在接收到用户B的确认接听指令之后，向用户A所使用的终端发送确认接听消息；最后，用户A所使用的终端将采集的视频发送给用户B所在的终端，以在用户B所在的终端上仅显示该视频，以及用户B所使用的终端将采集的视频发送给用户A所使用的终端，以在用户A所在的终端上仅显示该视频。
申请人对现有技术进行研究之后发现，现有的视频显示方式较单一，并且会影响用户A和B之间的聊天内容、通知信息等其余信息的显示。
发明内容
本公开实施例提供一种视频处理方法、装置、电子设备、计算机可读存储介质、计算机程序产品及计算机程序，以克服现有视频方法的实时性较差的问题。
第一方面，本公开实施例提供一种视频处理方法，应用于第一终端，包括：
检测第一用户的操作指令；
响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
第二方面，本公开实施例提供一种视频处理装置，应用于第一终端，包括：
操作指令检测模块，用于检测第一用户的操作指令；
操作指令响应模块，用于响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图 像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
第三方面，本公开实施例提供一种电子设备，包括：至少一个处理器和存储器；
所述存储器存储计算机执行指令；
所述至少一个处理器执行所述存储器存储的计算机执行指令，使得所述至少一个处理器执行如上第一方面以及第一方面各种可能涉及的所述的视频处理方法。
第四方面，本公开实施例提供一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能涉及的所述的视频处理方法。
第五方面，本公开实施例提供一种计算机程序产品，包括计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能的设计所述的视频处理方法。
第六方面，本公开实施例提供一种计算机程序，当处理器执行所述计算机程序时，实现如上第一方面以及第一方面各种可能的设计所述的视频处理方法。
本实施例提供的视频处理方法及装置，应用于第一终端，该方法可以在聊天页面中显示第一终端的摄像头采集的图像，并在图像上叠加显示聊天内容等其余信息，同时，还可以将图像发送给第二终端，以使第二终端做同样的显示，如此在视频过程中为第一用户和第二用户提供了一种新的视频显示方式，有助于丰富视频显示的多样化的同时，不影响第一用户和第二用户的其余信息的显示。
附图说明
为了更清楚地说明本公开实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的视频处理方法流程示意图；
图2为本公开实施例提供的第一终端上显示聊天页面的示例图一；
图3为本公开实施例提供的第二终端上显示聊天页面的示例图一；
图4为本公开实施例提供的第一终端上显示聊天页面的示例图二；
图5为现有技术中一种用户列表的示例图；
图6为本公开实施例提供的第一终端上显示用户列表的一个示例图；
图7为本公开实施例提供的第二终端上显示视频请求的一个示例图；
图8为本公开实施例提供的第二终端上显示视频请求的另一个示例图；
图9为本公开实施例提供的第一终端上显示聊天页面的示例图二；
图10为本公开实施例提供的第二终端上显示聊天页面的示例图二；
图11为本公开实施例提供的视频处理装置的结构框图；
图12为本公开实施例提供的电子设备的硬件结构示意图。
具体实施方式
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本公开一部分实施例，而不是全部的实施例。基于本公开中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本公开保护的范围。
参考图1，图1为本公开实施例提供的视频处理方法流程示意图一。本实施例的方法可以应用在第一终端中，该第一终端是发送视频的终端设备，该视频处理方法包括：
S101：检测第一用户的操作指令。
其中，操作指令是第一用户在第一终端上发起的用于发送视频的指令，具体可以在用户操作第一终端上显示的视频控件时生成。
S102：响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
具体地，第一终端开启摄像头以采集图像，每采集一帧图像即将该帧图像发送给第二终端，如此，第一终端向第二终端发送连续图像，这些连续图像在第二终端上显示以形成视频，该视频中的每帧图像称为视频帧。
其中，第一终端上的聊天页面中包括第一用户和第二用户之间的其余信息，其余信息包括但不限于：对话信息和通知信息，对话信息可以是语音、文本、图片、视频片段等格式。如图2所示，第一用户向第二用户发送文本信息“我今天和咱们高中同学小明吃饭了”，然后第二用户向第一用户回复“无图无真相”，最后第一用户向第二用户发送信息“给你看看”之后操作第一视频控件，在开启第一终端的摄像头之后，第一摄像头开启并采集图像，采集的图像即开始实时的在该聊天页面中显示，图2中显示的图像可以是小明的图像。
此外，第一终端还在聊天页面中显示有通知信息，如图2所示，第一终端在第一用户操作第一视频控件之后，显示通知信息“你正在分享实时画面”；第一终端开启摄像头之后，显示通知信息“你开启了实时画面分享”；第二用户在第二终端上接收实时画面分享之后，显示通知信息“对方查看了实时画面分享”。
与图2所示的聊天页面对应，在第二终端的聊天页面中也对应显示对话信息、通知信息、图像，如图3所示，聊天页面中显示了第一用户和第二用户之间的对话信息和第一终端发送的图像。此外，第二终端还在聊天页面中显示有通知信息，第一用户在第一终端上操作第一视频控件之后，第二终端上的聊天页面中显示通知信息“对方正在分享实时画面”；第一终端开启摄像头之后，第二终端上的聊天页面中显示通知信息“对方分享了实时画面”，此时第二终端的聊天页面中开始实时显示第一终端发送的图像。
可以看出，在图2或图3所示的聊天页面中，对话信息、通知信息叠加在图像之上，即图像作为聊天页面的背景，对话信息、通知信息作为聊天页面的内容。为了避免对对话信息、通知信息对图像的遮挡，叠加在上方的对话信息、通知信息需要有一定的透明度，以使第一用户透过叠加在上方的其余信息查看被叠加在下方的图像。
可以理解的是，实时显示图像为摄像头每采集一帧图像即显示该图像，从而连续采集的多帧图像在第一终端上形成视频。此外，在第一终端显示的聊天页面中第一用户还可以发送聊天内容，不会影响第一用户的正常聊天。例如，第一用户还可以在如图2或3所示的聊天页面中发送聊天内容“看是不是他啊”。
需要说明的是，预设区域可以是如图2或3所示的聊天页面的整个区域，还可以是如图4所示的聊天页面的部分区域，部分区域内的图像可以被其余信息遮挡，部分区域外的图像不会被其余信息遮挡，部分区域内显示最近时间的其余信息。如图4所示，部分区域位于图像的左下角，DL为对话信息，NT为通知信息。
在本公开的另一种实施例中，上述预设区域的属性信息可以被调整：响应于区域调整指令，对预设区域的属性信息进行调整，其中，预设区域的属性信息包括但不限于：尺寸、透明度、颜色、位置。从而可以实现第一用户对预设区域的属性进行灵活调整，以尽可能地避免对图像的遮挡。
与图4所示的第一终端上的聊天页面对应，第二终端上的聊天页面中也可以以这种方式显示图像、对话信息和通知信息，第二用户也可以对预设区域的属性信息进行调整，本公开在此不再赘述。
本公开的实施例可以将对话信息叠加显示在图像之上的预设区域中，避免对话信息对图像的大面积遮挡，有助于提高图像的显示完整度。
可选地，根据本公开的一个或多个实施例，所述S101包括S1011：
S1011，检测第一用户对第一视频控件的操作指令，所述第一视频控件位于如下至少一项对象中：所述第一用户与第二用户的聊天页面、用户列表中的第二用户对应的信息条目中。
其中，第一视频控件是用于实时发送视频帧的控件，第一用户对该第一视频控件进行操作之后，第一终端开启摄像头以采集图像。
上述用户列表可以包括但不限于：用户通话列表、通信录列表，用户通话列表中的第二用户是第一用户最近联系的用户，通信录列表中的第二用户是第一终端上记录的用户。
在用户列表中，信息条目用于显示第二用户的信息，信息条目中包括但不限于：第二用户的名称、图像等标识信息，用户还可以点击信息条目以进入详情页面，当用户列表为用户通话列表时，详情页面为聊天页面，具体可以包括但不限于：语音、文字、视频等对话信息以及对应的对话时间；当用户列表为通信录列表时，详情页面中可以包括但不限于：联系方式、用户地址、生日、联系方式等详细信息。
本公开的实施例可以在聊天页面中显示第一视频控件，也可以在用户列表中显示第一视频控件，提供了多样化的视频控件显示方式，此外，本公开仅需要第一用户对第一视频控件进行操作即可实现在聊天页面中显示图像的目标，并不需要第二用户进行任何操作，降低了第二用户的操作复杂度。
可选地，根据本公开的一个或多个实施例，所述S1011之前，还包括S1012至S1013：
S1012，检测第二用户的用户状态。
其中，第二用户是使用第二终端的用户，第二终端接收第一终端发送的视频并显示，以供第二用户查看。
用户状态包括但不限于：在线状态、离线状态、忙碌状态、免打扰状态。可以理解的是，当用户状态为在线状态时，第二用户可以通过第二终端实时接收到第一终端发送的视频、文本等信息；当用户状态为离线状态、忙碌状态时，第二用户可能无法实时接收到第一终端发送的视频、文本等信息。
在实际应用中，用户行为决定用户状态。例如，第二用户的登录行为可以代表第二用户的用户状态为在线状态，第二用户的退出行为可以代表第二用户的用户状态为离线状态，第二用户的聊天行为可以代表第二用户的用户状态为在线状态。
基于上述用户行为，第一终端可以接收第二终端发送的第二用户的用户状态。具体地，第二终端可以在第二用户登录之后向第一终端发送状态通知信息，该状态通知信息中包括第二用户的用户标识、用户状态为在线状态；第二终端还可以在第二用户切换用户状态之后向第一终端发送状态通知信息，该状态通知信息中包括第二用户的用户标识、切换之后的用户状态；第二终端还可以在第二用户退出之后向第一终端发送状态通知信息，该状态通知信息中包括第二用户的用户标识、用户状态为离线状态。
在本公开的另一种示例中，第一终端可以根据第二用户的用户行为分析得到第二用户的用户状态。例如，若检测到第二用户在当前时间或当前时间之前预设时间段内存在聊天行为，即第一终端接收到第二终端发送的聊天信息，则可以确定第二用户的用户状态为在线；若检测到第二用户在当前时间之前预设时间段内未接收到第二终端发送的聊天信息，则可以确定第二用户的用户状态为离线状态。
S1013，在所述第二用户的用户状态为在线状态时，在所述第二用户对应的信息条目中显示第一视频控件。
图5为现有技术中一种用户列表的示例图。现有技术中，第一用户需要发送视频时，可以从图5左侧附图所示的用户列表中选取其中一个第二用户，以进入与该第二用户的聊天页面中，如图5右侧附图所示的聊天页面，其中固定显示有视频控件K，第一用户可以对K进行操作发起视频请求，以向第二用户实时发送视频。然而，在实际应用中，第一用户在操作视频控件K时，并不知道第二用户是否在线，从而发起的视频可能无法被实时的查看，从而导致视频的实时性较差。
而本公开的实施例可以在第二用户为在线状态时，在信息条目中显示第一视频控件。可以理解的是，在第二用户为在线状态时，第二用户可以立即查看实时发送的视频帧，从而该应用场景对视频被查看的实时性要求较高。
可选地，根据本公开的一个或多个实施例，基于S1012和S1013，所述方法还包括S1014：
S1014，在所述第二用户的用户状态为非在线状态时，在所述第二用户对应的信息条目中显示第二视频控件，响应于对所述第二视频控件的操作指令，将所述摄像头采集的图像生成的视频片段发送给所述第二终端。
其中，第二视频控件是用于发送视频片段的控件，第一用户对该第二视频控件进行操作之后，第一终端开启摄像头以采集图像，但不同的是，在采集一帧图像之后并不立即将该图像发送给第二终端，而是暂存该图像，并在采集图像结束之后将采集的所有图像按照时间顺序拼接为视频片段，并将该视频片段发送给第二终端。
可以理解的是，非在线状态包括但不限于：离线状态、忙碌状态、免打扰状态。在这种状态下，第二用户不立即查看发送的视频片段，可以在空闲时间再查看视频片段，从而该应用场景对视频片段被查看的实时性要求较低。
本公开可以根据用户状态在信息条目中显示第一视频控件或第二视频控件。如图6所示，第一视频控件K1和第二视频控件K2显示在信息条目中，用户列表是用户通话列表，图6中包括5个第二用户，名称分别为：名称1至名称5，第二用户名称1对应信息条目L1，第二用户名称2对应信息条目L2，第二用户名称3对应信息条目L3，第二用户名称4对应信息条目L4，第二用户名称5对应信息条目L5，每个第二用户的信息条目中均显示有第一视频控件或第二视频控件，信息条目L1、L2、L5中均显示有第一视频控件K1，信息条目L3和L4中均显示有第二视频控件K2、
需要说明的是，第一用户在图6中的用户列表中对第一视频控件进行操作之后可以进入如图2所示的聊天页面中，以在聊天页面中实时显示采集的图像。在第一次开启摄像头的情况下，第一用户在图6所示的用户列表中对K1或K2操作之后，还可以提示第一用户“将开启摄像头”，第一用户可以选取“立即开启”以开启摄像头；在后续开启摄像头的情况下，将不再提示。
本公开的实施例可以在用户列表中根据用户状态显示视频控件，一方面，第一用户可以直接在用户列表中实现与第二用户的视频操作，不需要进入与第二用户的聊天页面中，降低了第一用户的操作复杂度，提高了视频效率；另一方面，第一用户可以从第一视频控件对应的多个第二用户中选取一个第二用户进行视频，提高了第一用户对第二用户的选择灵活性；最后，用户还可以根据实际需求选取第二视频控件对应的第二用户分享实时性要求较低的视频片段。
本公开的一种典型应用场景是，第一终端仅向第二终端发送无声的图像，并不会同时向第二用户发送对应的语音数据，并且第二终端会以站内通知或站外通知的方式向提示第二用户，并不会以铃声、振动等方式通知第二用户。此外，第一终端开启的摄像头通常不是前置摄像头，而是拍摄其余方向的摄像头，例如，后置摄像头，如此，实现了第一用户以无声的方式向第二用户分享自己所看到的场景，丰富了社交体验。
可选地，根据本公开的一个或多个实施例，所述S102中：将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，包括S1021至S1022：
S1021，向所述第二终端发送视频通知。
其中，视频通知可以以站内信息提示第二用户，也可以以系统信息提示第二用户。具体地，当第二终端上正在全屏显示社交应用时，该社交应用的第一用户向第二用户发起视频请求，第一终端根据视频请求生成视频通知，第二终端将以站内信息的方式显示视频通知，例如，如图7所示的站内信息“小王正在向你分享实时画面”显示在社交应用的预设区域内；当第二终端处于锁屏状态时，社交应用的第一用户向第二用户发起视频请 求，第一终端根据视频请求生成视频通知，第二终端将以系统信息的方式显示视频通知，如图8所示的系统信息“小王正在向你分享实时画面”显示在锁屏界面的预设区域内。
S1022，在所述视频通知被查看的情况下，将所述第一终端的摄像头采集的图像作为视频帧实时发送给所述第二终端。
具体地，第二终端接收到视频通知之后，第二用户可以在点击视频通知，此时，第二终端将进入聊天页面中，并开始接收第一终端的摄像头当前时间拍摄的视频帧，以在该聊天页面中实时显示该视频帧。第二用户点击视频通知即为查看视频通知。
在本公开的实施例中，在第二用户的用户状态为在线状态时，第二用户可以立即接收实时发送的视频帧，此时，向第二终端发送视频请求第二用户可以接收到，从而结合了第二用户的操作更加准确的保证视频帧被查看的实时性。
可选地，根据本公开的一个或多个实施例，S1021之后，还包括S1023至S1025：
S1023，在所述视频通知未被查看的情况下，结束所述视频通知。
在实际应用中，在发送视频通知之后，若在预设时间内第二用户未接受该视频通知，则第二终端可以自动结束视频通知，不需要用户手动结束。当然，在该预设时间内，第一用户还可以在第一终端上主动结束该视频通知。
其中，该预设时间可以根据实际应用场景设定，例如，可以设定为30秒。
S1024，将录制的视频片段发送给所述第二终端，所述视频片段由所述视频请求结束之前所述第一终端的摄像头采集的图像生成。
在本公开中，当第一用户在第一终端上对第一视频控件进行操作之后，第一终端可以进入第一用户与第二用户的聊天页面中，在该聊天页面中实时显示该第一终端的摄像头采集的图像，在视频请求结束之后，可以将视频请求开始和结束之间采集的图像按照时间顺序拼接为视频片段。
S1025，在所述视频片段被查看之后，撤回所述视频片段。
在本公开的一种示例中，可以允许第一用户在第一终端上设置视频片段被查看的次数阈值，并统计视频片段被查看的次数，在该次数大于或等于该次数阈值时，撤回该视频片段；在该次数小于该次数阈值时，不撤回该视频片段。
然而，在设置次数阈值的过程中会出现如下异常：第二用户查看该视频片段之后第一用户设置次数阈值，在这种场景下，第一用户设置的次数阈值对查看的次数的约束不准确，从而为了避免该情况出现，本公开可以允许第一用户在预设时间内设置次数阈值，预设时间之后不可以设置，例如，可以允许第一用户在将视频片段发送给第二终端之后的2分钟内设置次数阈值，超过2分钟之后不可以设置。
基于上述撤回方法，一种典型的次数阈值可以为1，即，当视频片段被查看一次之后即撤回视频片段，例如，如图9所示，在第一终端的聊天页面中，用户可以点击通知信息“允许回看一次”实现仅允许视频片段仅被查看一次，从而在设置之后，分享的视频片段的缩略图上可以显示提示信息“对方查看之后将撤回”。
可以理解的是，在撤回视频片段之后，可以在第一终端的聊天页面中通过通知信息提示第一用户。例如，如图9所示，聊天页面中先显示通知信息“对方已查看”，然后显示通知信息“实时画面已撤回”。当然，如图10所示，还可以在第二终端的聊天页面中通过通知信息“实时画面已撤回”提示第二用户。如图10所示，第二终端的聊天页面中还通过 通知信息“对方分享了实时画面查看”来提示第二用户查看分享的视频片段，用户可以点击“查看”以播放视频片段。
本公开可以在第二用户查看视频片段之后撤回该视频片段，避免视频片段被下载、转发等，有效保护了该视频片段的隐私性。
可选地，根据本公开的一个或多个实施例，所述方法还包括S103至S104：
S103，接收所述第二终端的摄像头采集的图像。
在本公开的一种实施例中，第二用户还可以在第二终端上发起视频，以将第二终端的摄像头采集的图像发送给第一终端，具体操作步骤与的第一用户在第一终端上的操作步骤相同，在此不再赘述。
S104，停止在所述第一用户与所述第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述第一用户与所述第二用户的聊天页面中实时显示所述第二终端的摄像头采集的图像。
本公开的实施例可以默认将发起视频的第一终端的摄像头采集的图像分享给第二终端，并在第一终端上显示，此外，还可以在第二用户也分享视频之后，自动切换为在第一终端和第二终端上均显示第二终端的摄像头采集的图像，如此在第二用户要向第一用户发起视频时，不需要先退出第一用户和第二用户之间的当前视频，再发起视频，降低了第二用户的操作复杂度。
可选地，根据本公开的一个或多个实施例，所述方法还包括S105至S106：
S105，检测所述第一用户的切换指令。
其中，切换指令是第一终端上用于在第一终端的摄像头采集的图像和第二终端的摄像头采集的图像之间切换的指令，例如，第一用户可以在第一终端上点击切换控件。
S106，响应于所述切换指令，在所述第一用户与所述第二用户的聊天页面中实时显示切换后的图像，所述切换后的图像包括如下一项：所述第一终端的摄像头采集的图像、所述第二终端的摄像头采集的图像。
可以理解的是，第二终端也可以进行S105至S106类似的切换操作，本公开在此对其不加以限制。
本公开的实施例可以根据第一用户的切换指令对图像进行切换显示，有助于提高视频显示的灵活性。
可选地，根据本公开的一个或多个实施例，在S102中的将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端之后，还包括S107：
S107，在所述第一用户与所述第二用户的聊天页面中显示被区别标记的不同通知信息，所述通知信息用于提示所述视频帧的发送状态。
在本公开的实施例中，可以通过多种方式区分通知信息，包括但不限于：图标、颜色、尺寸等。例如，如图9或10所示，开始分享实时画面的通知信息用的图标和已经分享之后的通知信息的图标不同，当然，还可以将开始分享实时画面的通知信息的图标用第一颜色表示，将已经分享之后的通知信息的图标用第二颜色表示，其中第一颜色可以为绿色，第二颜色可以为灰色。
本公开的实施例区分标记通知信息以区分不同的发送状态，区分标记通知信息可以方便第二用户更快速的获取到发送状态，提高了第二用户获取发送状态的效率。
综上所述，本实施例提供的视频处理方法可以在聊天页面中显示第一终端的摄像头采集的图像，并在图像上叠加显示聊天内容等其余信息，同时，还可以将图像发送给第二终端，以使第二终端做同样的显示，如此在视频过程中为第一用户和第二用户提供了一种新的视频显示方式，有助于丰富视频显示的多样化。
对应于上文实施例的视频处理方法，图11为本公开实施例提供的视频处理装置的结构框图。为了便于说明，仅示出了与本公开实施例相关的部分。参照图11，所述装置包括：操作指令检测模块201、操作指令响应模块202。
其中，操作指令检测模块201，用于检测第一用户的操作指令。
操作指令响应模块202，用于响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
可选地，根据本公开的一个或多个实施例，所述操作指令检测模块201还用于：
检测第一用户对第一视频控件的操作指令，所述第一视频控件位于如下至少一项对象中：所述第一用户与第二用户的聊天页面、用户列表中的第二用户对应的信息条目中。
可选地，根据本公开的一个或多个实施例，所述装置还包括：
用户状态检测模块，用于检测第二用户的用户状态；第一视频控件显示模块，用于在所述第二用户的用户状态为在线状态时，在所述第二用户对应的信息条目中显示第一视频控件。
可选地，根据本公开的一个或多个实施例，基于用户状态检测模块和第一视频控件显示模块，所述装置还包括：
第二视频控件显示模块，用于在所述第二用户的用户状态为非在线状态时，在所述第二用户对应的信息条目中显示第二视频控件，响应于对所述第二视频控件的操作指令，将所述摄像头采集的图像生成的视频片段发送给所述第二终端。可选地，根据本公开的一个或多个实施例，所述操作指令响应模块202还用于：
向所述第二终端发送视频通知；
在所述视频通知被查看的情况下，将所述第一终端的摄像头采集的图像作为视频帧实时发送给所述第二终端。
可选地，根据本公开的一个或多个实施例，操作指令响应模块202还用于：
在所述视频通知未被查看的情况下，结束所述视频通知；
将录制的视频片段发送给所述第二终端，所述视频片段由所述视频请求结束之前所述第一终端的摄像头采集的图像生成；
在所述视频片段被查看之后，撤回所述视频片段。
可选地，根据本公开的一个或多个实施例，所述装置还包括：
图像接收模块，用于接收所述第二终端的摄像头采集的图像；
切换显示模块，用于停止在所述第一用户与所述第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述第一用户与所述第二用户的聊天页面中实时显示所述第二终端的摄像头采集的图像。
可选地，根据本公开的一个或多个实施例，所述装置还包括：
切换指令检测模块，用于检测所述第一用户的切换指令；
切换响应模块，用于响应于所述切换指令，在所述第一用户与所述第二用户的聊天页面中实时显示切换后的图像，所述切换后的图像包括如下一项：所述第一终端的摄像头采集的图像、所述第二终端的摄像头采集的图像。
可选地，根据本公开的一个或多个实施例，操作指令响应模块202还用于：
在所述第一用户与所述第二用户的聊天页面中显示被区别标记的不同通知信息，所述通知信息用于提示所述视频帧的发送状态。
本实施例提供的装置，可用于执行上述方法实施例的技术方案，其实现原理和技术效果类似，本实施例此处不再赘述。
参考图12，其示出了适于用来实现本公开实施例的电子设备900的结构示意图，该电子设备900可以为终端设备或服务器。其中，终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、个人数字助理(Personal Digital Assistant，简称PDA)、平板电脑(Portable Android Device，简称PAD)、便携式多媒体播放器(Portable Media Player，简称PMP)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图12示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图12所示，电子设备900可以包括处理装置(例如中央处理器、图形处理器等)901，其可以根据存储在只读存储器(Read Only Memory，简称ROM)902中的程序或者从存储装置908加载到随机访问存储器(Random Access Memory，简称RAM)903中的程序而执行各种适当的动作和处理。在RAM 903中，还存储有电子设备900操作所需的各种程序和数据。处理装置901、ROM 902以及RAM 903通过总线904彼此相连。输入/输出(I/O)接口905也连接至总线904。
通常，以下装置可以连接至I/O接口905：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置906；包括例如液晶显示器(Liquid Crystal Display，简称LCD)、扬声器、振动器等的输出装置907；包括例如磁带、硬盘等的存储装置908；以及通信装置909。通信装置909可以允许电子设备900与其他设备进行无线或有线通信以交换数据。虽然图12示出了具有各种装置的电子设备900，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置909从网络上被下载和安装，或者从存储装置908被安装，或者从ROM 902被安装。在该计算机程序被处理装置901执行时，执行本公开实施例的方法中限定的上述功能。本公开的实施例还包括一种计算机程序，当其在电子设备上运行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备执行上述实施例所示的方法。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(Local Area Network，简称LAN)或广域网(Wide Area Network，简称WAN)——连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定，例如，第一获取单元还可以被描述为“获取至少两个网际协议地址的单元”。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
第一方面，根据本公开的一个或多个实施例，提供了一种视频处理方法，应用于第一终端，包括：
检测第一用户的操作指令；
响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
根据本公开的一个或多个实施例，所述检测第一用户的操作指令，包括：
检测第一用户对第一视频控件的操作指令，所述第一视频控件位于如下至少一项对象中：所述第一用户与第二用户的聊天页面、用户列表中的第二用户对应的信息条目中。
根据本公开的一个或多个实施例，所述检测第一用户对第一视频控件的操作指令之前，还包括：
检测第二用户的用户状态；在所述第二用户的用户状态为在线状态时，在所述第二用户对应的信息条目中显示第一视频控件。
根据本公开的一个或多个实施例，所述方法还包括：
在所述第二用户的用户状态为非在线状态时，在所述第二用户对应的信息条目中显示第二视频控件，响应于对所述第二视频控件的操作指令，将所述摄像头采集的图像生成的视频片段发送给所述第二终端。根据本公开的一个或多个实施例，所述将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，包括：
向所述第二终端发送视频通知；
在所述视频通知被查看的情况下，将所述第一终端的摄像头采集的图像作为视频帧实时发送给所述第二终端。
根据本公开的一个或多个实施例，所述向所述第二终端发送视频通知之后，还包括：
在所述视频通知未被查看的情况下，结束所述视频通知；
将录制的视频片段发送给所述第二终端，所述视频片段由所述视频请求结束之前所述第一终端的摄像头采集的图像生成；
在所述视频片段被查看之后，撤回所述视频片段。
根据本公开的一个或多个实施例，所述方法还包括：
接收所述第二终端的摄像头采集的图像；
停止在所述第一用户与所述第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述第一用户与所述第二用户的聊天页面中实时显示所述第二终端的摄像头采集的图像。
根据本公开的一个或多个实施例，所述方法还包括：
检测所述第一用户的切换指令；
响应于所述切换指令，在所述第一用户与所述第二用户的聊天页面中实时显示切换后的图像，所述切换后的图像包括如下一项：所述第一终端的摄像头采集的图像、所述第二终端的摄像头采集的图像。
根据本公开的一个或多个实施例，在将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端之后，还包括：
在所述第一用户与所述第二用户的聊天页面中显示被区别标记的不同通知信息，所述通知信息用于提示所述视频帧的发送状态。
第二方面，根据本公开的一个或多个实施例，提供了一种视频处理装置，应用于第一终端，包括：
操作指令检测模块，用于检测第一用户的操作指令；
操作指令响应模块，用于响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
根据本公开的一个或多个实施例，所述操作指令检测模块还用于：
检测第一用户对第一视频控件的操作指令，所述第一视频控件位于如下至少一项对象中：所述第一用户与第二用户的聊天页面、用户列表中的第二用户对应的信息条目中。
根据本公开的一个或多个实施例，所述装置还包括：
用户状态检测模块，用于检测第二用户的用户状态；第一视频控件显示模块，用于在所述第二用户的用户状态为在线状态时，在所述第二用户对应的信息条目中显示第一视频控件。
根据本公开的一个或多个实施例，基于用户状态检测模块和第一视频控件显示模块，所述装置还包括：
第二视频控件显示模块，用于在所述第二用户的用户状态为非在线状态时，在所述第二用户对应的信息条目中显示第二视频控件，响应于对所述第二视频控件的操作指令，将所述摄像头采集的图像生成的视频片段发送给所述第二终端。根据本公开的一个或多个实施例，所述操作指令响应模块还用于：
向所述第二终端发送视频通知；
在所述视频通知被查看的情况下，将所述第一终端的摄像头采集的图像作为视频帧实时发送给所述第二终端。
根据本公开的一个或多个实施例，操作指令响应模块还用于：
在所述视频通知未被查看的情况下，结束所述视频通知；
将录制的视频片段发送给所述第二终端，所述视频片段由所述视频请求结束之前所述第一终端的摄像头采集的图像生成；
在所述视频片段被查看之后，撤回所述视频片段。
根据本公开的一个或多个实施例，所述装置还包括：
图像接收模块，用于接收所述第二终端的摄像头采集的图像；
切换显示模块，用于停止在所述第一用户与所述第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述第一用户与所述第二用户的聊天页面中实时显示所述第二终端的摄像头采集的图像。
根据本公开的一个或多个实施例，所述装置还包括：
切换指令检测模块，用于检测所述第一用户的切换指令；
切换响应模块，用于响应于所述切换指令，在所述第一用户与所述第二用户的聊天页面中实时显示切换后的图像，所述切换后的图像包括如下一项：所述第一终端的摄像头采集的图像、所述第二终端的摄像头采集的图像。
根据本公开的一个或多个实施例，操作指令响应模块还用于：
在所述第一用户与所述第二用户的聊天页面中显示被区别标记的不同通知信息，所述通知信息用于提示所述视频帧的发送状态。
第三方面，根据本公开的一个或多个实施例，提供了一种电子设备，包括：至少一个处理器和存储器；
所述存储器存储计算机执行指令；
所述至少一个处理器执行所述存储器存储的计算机执行指令，使得所述至少一个处理器执行如上第一方面以及第一方面各种可能的设计所述的视频处理方法。
第四方面，根据本公开的一个或多个实施例，提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能的设计所述的视频处理方法。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (14)

  1. 一种视频处理方法，其特征在于，应用于第一终端，包括：
    检测第一用户的操作指令；
    响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
  2. 根据权利要求1所述的方法，其特征在于，所述检测第一用户的操作指令，包括：
    检测第一用户对第一视频控件的操作指令，所述第一视频控件位于如下至少一项对象中：所述第一用户与第二用户的聊天页面、用户列表中的第二用户对应的信息条目中。
  3. 根据权利要求2所述的方法，其特征在于，所述检测第一用户对第一视频控件的操作指令之前，还包括：
    检测第二用户的用户状态；在所述第二用户的用户状态为在线状态时，在所述第二用户对应的信息条目中显示第一视频控件。
  4. 根据权利要求3所述的方法，其特征在于，所述方法还包括：
    在所述第二用户的用户状态为非在线状态时，在所述第二用户对应的信息条目中显示第二视频控件，响应于对所述第二视频控件的操作指令，将所述摄像头采集的图像生成的视频片段发送给所述第二终端。
  5. 根据权利要求1至4任一项所述的方法，其特征在于，所述将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，包括：
    向所述第二终端发送视频通知；
    在所述视频通知被查看的情况下，将所述第一终端的摄像头采集的图像作为视频帧实时发送给所述第二终端。
  6. 根据权利要求5所述的方法，其特征在于，所述向所述第二终端发送视频通知之后，还包括：
    在所述视频通知未被查看的情况下，结束所述视频通知；
    将录制的视频片段发送给所述第二终端，所述视频片段由所述视频请求结束之前所述第一终端的摄像头采集的图像生成；
    在所述视频片段被查看之后，撤回所述视频片段。
  7. 根据权利要求1至6任一项所述的方法，其特征在于，所述方法还包括：
    接收所述第二终端的摄像头采集的图像；
    停止在所述第一用户与所述第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述第一用户与所述第二用户的聊天页面中实时显示所述第二终端的摄像头采集的图像。
  8. 根据权利要求7所述的方法，其特征在于，所述方法还包括：
    检测所述第一用户的切换指令；
    响应于所述切换指令，在所述第一用户与所述第二用户的聊天页面中实时显示切换 后的图像，所述切换后的图像包括如下一项：所述第一终端的摄像头采集的图像、所述第二终端的摄像头采集的图像。
  9. 根据权利要求1至8任一项所述的方法，其特征在于，在将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端之后，还包括：
    在所述第一用户与所述第二用户的聊天页面中显示被区别标记的不同通知信息，所述通知信息用于提示所述视频帧的发送状态。
  10. 一种视频处理装置，其特征在于，应用于第一终端，包括：
    操作指令检测模块，用于检测第一用户的操作指令；
    操作指令响应模块，用于响应于所述操作指令，在所述第一用户与第二用户的聊天页面中实时显示所述第一终端的摄像头采集的图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息，以及，将所述第一终端的摄像头采集的图像作为视频帧实时发送给第二终端，以使所述第二终端在所述第二用户与所述第一用户的聊天页面中实时显示所述图像，在所述图像上的预设区域内叠加显示所述图像之外的其余信息；其中，所述第一终端为所述第一用户所对应的终端，所述第二终端为所述第二用户所对应的终端。
  11. 一种电子设备，其特征在于，包括：至少一个处理器和存储器；
    所述存储器存储计算机执行指令；
    所述至少一个处理器执行所述存储器存储的计算机执行指令，使得所述至少一个处理器执行如权利要求1至9任一项所述的视频处理方法。
  12. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有计算机执行指令，当处理器执行所述计算机执行指令时，实现如权利要求1至9任一项所述的视频处理方法。
  13. 一种计算机程序产品，包括计算机执行指令，当处理器执行所述计算机执行指令时，实现如权利要求1至9任一项所述的视频处理方法。
  14. 一种计算机程序，当处理器执行所述计算机程序时，实现如权利要求1至9任一项所述的视频处理方法。
PCT/CN2021/120454 2020-10-09 2021-09-24 视频处理方法及装置 Ceased WO2022073428A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21876946.1A EP4171048B1 (en) 2020-10-09 2021-09-24 Video processing method and apparatus
JP2023507881A JP7534532B2 (ja) 2020-10-09 2021-09-24 ビデオ処理方法及び装置
US18/148,384 US12069111B2 (en) 2020-10-09 2022-12-29 Video processing method and apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011074833.4A CN112203151B (zh) 2020-10-09 2020-10-09 视频处理方法、装置、电子设备及计算机可读存储介质
CN202011074833.4 2020-10-09

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/148,384 Continuation US12069111B2 (en) 2020-10-09 2022-12-29 Video processing method and apparatus

Publications (1)

Publication Number Publication Date
WO2022073428A1 true WO2022073428A1 (zh) 2022-04-14

Family

ID=74013193

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/120454 Ceased WO2022073428A1 (zh) 2020-10-09 2021-09-24 视频处理方法及装置

Country Status (5)

Country Link
US (1) US12069111B2 (zh)
EP (1) EP4171048B1 (zh)
JP (1) JP7534532B2 (zh)
CN (1) CN112203151B (zh)
WO (1) WO2022073428A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112203151B (zh) 2020-10-09 2022-05-17 北京字跳网络技术有限公司 视频处理方法、装置、电子设备及计算机可读存储介质
CN115225602B (zh) * 2022-06-29 2024-05-17 赤子城网络技术（北京）有限公司 一种社交应用处理方法和系统
CN115225603B (zh) * 2022-06-29 2024-05-28 赤子城网络技术（北京）有限公司 一种社交应用中的用户匹配方法和系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130227439A1 (en) * 2012-02-27 2013-08-29 Nhn Corporation Method and apparatus for providing chatting service
CN104539871A (zh) * 2014-12-22 2015-04-22 小米科技有限责任公司 多媒体通话方法及装置
CN104765522A (zh) * 2014-01-08 2015-07-08 腾讯科技（深圳）有限公司 聊天窗口的展示控制方法及系统
CN105610788A (zh) * 2015-12-17 2016-05-25 小米科技有限责任公司 建立通话的方法和装置
CN105871682A (zh) * 2015-12-15 2016-08-17 乐视致新电子科技（天津）有限公司 一种视频通话方法、装置及终端
CN108400925A (zh) * 2017-02-08 2018-08-14 阿里巴巴集团控股有限公司 即时通讯消息的提醒方法及即时通讯客户端
CN112203151A (zh) * 2020-10-09 2021-01-08 北京字跳网络技术有限公司 视频处理方法及装置

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102244695A (zh) 2010-05-12 2011-11-16 深圳富泰宏精密工业有限公司 联络人分组系统及方法
KR101988279B1 (ko) * 2013-01-07 2019-06-12 삼성전자 주식회사 얼굴 인식 기반 사용자 기능 운용 방법 및 이를 지원하는 단말기
WO2014123270A1 (ko) * 2013-02-08 2014-08-14 에스케이플래닛 주식회사 인스턴트 메시징 서비스 제공 방법, 이를 위한 프로그램을 기록한 기록 매체 및 단말
JP6097679B2 (ja) * 2013-02-28 2017-03-15 エルジー アプラス コーポレーション 端末間機能共有方法及びその端末
CN104469243A (zh) * 2013-09-13 2015-03-25 联想(北京)有限公司 通信方法和电子设备
US9876831B1 (en) * 2014-06-06 2018-01-23 Google Llc Facilitating communication between users
US20160373388A1 (en) * 2015-06-19 2016-12-22 Voxer Ip Llc Messaging application for recording and inserting a video message into a chat
CN105120074A (zh) * 2015-07-20 2015-12-02 陈包容 一种信息阅后即焚的方法及装置
WO2017087561A1 (en) * 2015-11-17 2017-05-26 Advisual, Inc. Methods and systems for dynamic chat background
KR20170097980A (ko) * 2016-02-19 2017-08-29 삼성전자주식회사 전자 장치의 컨텐트 그룹 공유 방법 및 그 전자 장치
CN107222772A (zh) * 2016-03-21 2017-09-29 中兴通讯股份有限公司 一种实现字幕处理的方法及装置
CN106341308A (zh) * 2016-08-31 2017-01-18 宇龙计算机通信科技(深圳)有限公司 分享和显示方法、分享和显示装置、终端和服务器
GB2557576A (en) * 2016-10-13 2018-06-27 Joivy Ltd Improvements relating to messaging applications
EP3324582A1 (en) * 2016-11-18 2018-05-23 LG Electronics Inc. Mobile terminal and method for controlling the same
CN107592492A (zh) * 2017-09-06 2018-01-16 维沃移动通信有限公司 一种视频流显示方法及移动终端
CN108415753A (zh) * 2018-03-12 2018-08-17 广东欧珀移动通信有限公司 用户界面显示方法、装置及终端
DK180130B1 (da) * 2018-05-07 2020-06-02 Apple Inc. Multi-participant live communication user interface
CN109120866B (zh) * 2018-09-27 2020-04-03 腾讯科技（深圳）有限公司 动态表情生成方法、装置、计算机可读存储介质和计算机设备
CN109889880B (zh) * 2019-04-11 2021-02-12 北京字节跳动网络技术有限公司 关注用户的信息展示方法、装置、设备及存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130227439A1 (en) * 2012-02-27 2013-08-29 Nhn Corporation Method and apparatus for providing chatting service
CN104765522A (zh) * 2014-01-08 2015-07-08 腾讯科技（深圳）有限公司 聊天窗口的展示控制方法及系统
CN104539871A (zh) * 2014-12-22 2015-04-22 小米科技有限责任公司 多媒体通话方法及装置
CN105871682A (zh) * 2015-12-15 2016-08-17 乐视致新电子科技（天津）有限公司 一种视频通话方法、装置及终端
CN105610788A (zh) * 2015-12-17 2016-05-25 小米科技有限责任公司 建立通话的方法和装置
CN108400925A (zh) * 2017-02-08 2018-08-14 阿里巴巴集团控股有限公司 即时通讯消息的提醒方法及即时通讯客户端
CN112203151A (zh) * 2020-10-09 2021-01-08 北京字跳网络技术有限公司 视频处理方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4171048A4

Also Published As

Publication number Publication date
US12069111B2 (en) 2024-08-20
US20230216899A1 (en) 2023-07-06
JP7534532B2 (ja) 2024-08-14
CN112203151B (zh) 2022-05-17
JP2023536365A (ja) 2023-08-24
EP4171048A4 (en) 2024-02-21
CN112203151A (zh) 2021-01-08
EP4171048C0 (en) 2025-09-17
EP4171048A1 (en) 2023-04-26
EP4171048B1 (en) 2025-09-17

Similar Documents

Publication Publication Date Title
CN113489937B (zh) 视频共享方法、装置、设备及介质
US12069111B2 (en) Video processing method and apparatus
US11956531B2 (en) Video sharing method and apparatus, electronic device, and storage medium
CN113076048B (zh) 视频的展示方法、装置、电子设备和存储介质
US12271415B2 (en) Method, apparatus, device, readable storage medium and product for media content processing
CN114371896B (zh) 一种基于文档共享的提示方法、装置、设备及介质
US20250358480A1 (en) Live-streaming reservation method and apparatus, and device, medium and product
CN114238673A (zh) 内容展示方法、装置、设备及存储介质
US20260081885A1 (en) Method, apparatus, device, readable storage medium, and product for displaying media content
CN114793285A (zh) 信息显示方法、装置、设备及介质
JP2025522580A (ja) セッションページの表示方法、装置、デバイス、読み取り可能な記憶媒体及び製品
CN115022696A (zh) 视频预览方法、装置、可读介质及电子设备
WO2023143299A1 (zh) 消息展示方法、装置、设备及存储介质
JP2023515105A (ja) マルチメディア会議データ処理方法、装置、及び電子機器
CN114501041B (zh) 特效显示方法、装置、设备及存储介质
CN115767002A (zh) 一种信息显示方法、装置、设备及介质
CN110069660A (zh) 用于显示消息的方法和装置
CN119781890A (zh) 互动信息的显示方法、装置、电子设备、存储介质和程序产品
WO2017107543A1 (zh) 信息输入方法及装置
WO2023124944A1 (zh) 视频通话方法、装置、电子设备和存储介质
US10015055B2 (en) Management system, communication terminal, communication system, method of management, and computer program product
EP3038320A1 (en) Management system, communication terminal, communication system, call control method, and computer program product
WO2025214469A1 (zh) 信息处理方法、装置及电子设备
CN120215764A (zh) 交互方法、装置、设备、存储介质及产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21876946

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021876946

Country of ref document: EP

Effective date: 20230123

ENP Entry into the national phase

Ref document number: 2023507881

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWG Wipo information: grant in national office

Ref document number: 2021876946

Country of ref document: EP