WO2021121237A1 - Procédé et dispositif électronique d'écrêtage de flux vidéo - Google Patents

Procédé et dispositif électronique d'écrêtage de flux vidéo Download PDF

Info

Publication number
WO2021121237A1
WO2021121237A1 PCT/CN2020/136656 CN2020136656W WO2021121237A1 WO 2021121237 A1 WO2021121237 A1 WO 2021121237A1 CN 2020136656 W CN2020136656 W CN 2020136656W WO 2021121237 A1 WO2021121237 A1 WO 2021121237A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
cropping
area
video stream
cropping area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/136656
Other languages
English (en)
Chinese (zh)
Inventor
胡吉祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Publication of WO2021121237A1 publication Critical patent/WO2021121237A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Definitions

  • the embodiments of the present invention relate to the field of communication technologies, and in particular, to a video stream cropping method and electronic equipment.
  • the video stream can be cropped by the electronic device to optimize the composition of the image in the video stream.
  • the video stream can be cropped by a cropping method with a fixed cropping area.
  • a cropping area can be set for a video stream first, and then the electronic device can crop each frame of the video stream, except for the cropping area.
  • the top area of each frame of the video stream can be set as a cropped area, and the electronic device can crop out other areas except the top area of each frame of the video stream.
  • Embodiments of the present invention provide a video stream cropping method and an electronic device, so as to solve the problem that the subject of one or some images in the cropped video stream is lost when the video stream is cropped.
  • an embodiment of the present invention provides a video stream cropping method, which can be applied to an electronic device.
  • the method may include: determining a first cropping area of a first image in a target video stream, and the first cropping area includes the first cropping area.
  • An object and according to the first cropping area and the first object, determine the second cropping area of the second image in the target video stream; and crop the image outside the first cropping area in the first image, and crop the second image
  • the cropped target video stream is obtained; wherein, the second cropping area includes the second object in the second image, and the matching degree between the second object and the first object is greater than or equal to the first preset Set the threshold.
  • an embodiment of the present invention provides an electronic device, which includes: a determining module and a cutting module.
  • the determining module is used to determine the first cropping area of the first image in the target video stream, the first cropping area includes the first object; and determining the second image in the target video stream according to the first cropping area and the first object
  • the second cropping area of the second cropping area includes the second object in the second image, and the matching degree between the second object and the first object is greater than or equal to the first preset threshold; the cropping module is used to crop the first image
  • the image outside the first cropping area determined by the determining module is cropped, and the image outside the second cropping area determined by the determining module in the second image is cropped to obtain the cropped target video stream.
  • an embodiment of the present invention provides an electronic device, including a processor, a memory, and a computer program stored on the memory and running on the processor.
  • the computer program can implement the above-mentioned first aspect when the computer program is executed by the processor.
  • the steps of the video stream cropping method can implement the above-mentioned first aspect when the computer program is executed by the processor.
  • an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored.
  • the steps of the video stream cropping method of the first aspect can be implemented. .
  • the electronic device can determine the first cropping area (including the first object) of the first image in the target video stream; and according to the first cropping area and the first object, determine the second cropping area in the target video stream.
  • the second cropping area of the image including the second object in the second image, the matching degree between the second object and the first object is greater than or equal to the first preset threshold; and cropping the first image outside the first cropping area And crop the image outside the second cropping area in the second image to obtain the cropped target video stream.
  • the electronic device determines the cropped area of an image, it can refer to the cropped area determined in another image and the objects in the cropped area, so the cropped area of the one image determined by the electronic device can include The object that matches the object (for example, the two objects are the same object), that is, the video stream cropping method provided by the embodiment of the present invention is adopted, and the cropped regions of each image are determined to include the main body of the image, so that the video is cropped according to these cropped regions After each frame of image in the stream, the main body of the image in the cropped video stream can be avoided from being lost.
  • FIG. 1 is a schematic structural diagram of a possible Android operating system provided by an embodiment of the present invention
  • Figure 2 is one of the schematic diagrams of a video stream cropping method provided by an embodiment of the present invention.
  • FIG. 3 is one of the schematic diagrams of the interface of the application of the video stream cropping method provided by the embodiment of the present invention.
  • FIG. 4 is the second schematic diagram of the interface of the application of the video stream cropping method provided by the embodiment of the present invention.
  • FIG 5 is the third schematic diagram of the interface of the application of the video stream cropping method provided by the embodiment of the present invention.
  • FIG. 6 is the fourth schematic diagram of the interface of the application of the video stream cropping method provided by the embodiment of the present invention.
  • FIG. 7 is the fifth schematic diagram of the interface of the application of the video stream cropping method provided by the embodiment of the present invention.
  • FIG. 8 is a second schematic diagram of a video stream cropping method provided by an embodiment of the present invention.
  • FIG. 9 is one of structural schematic diagrams of an electronic device provided by an embodiment of the present invention.
  • FIG. 10 is a second structural diagram of an electronic device provided by an embodiment of the present invention.
  • FIG. 11 is a third structural diagram of an electronic device provided by an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of hardware of an electronic device provided by an embodiment of the present invention.
  • first and second in this document are used to distinguish different objects, rather than to describe a specific order of objects.
  • first object and the second object are used to distinguish different objects, rather than to describe the specific order of the objects.
  • words such as “exemplary” or “for example” are used to represent examples, illustrations, or illustrations. Any embodiment or design solution described as “exemplary” or “for example” in the embodiments of the present invention should not be construed as being more preferable or advantageous than other embodiments or design solutions. To be precise, words such as “exemplary” or “for example” are used to present related concepts in a specific manner.
  • plural means two or more than two, for example, a plurality of elements means two or more elements, and so on.
  • Embodiments of the present invention provide a video stream cropping method and an electronic device.
  • the video stream cropping method can be applied to an electronic device, and the electronic device can determine a first cropping area (including a first object) of a first image in a target video stream. ); and according to the first cropping area and the first object, determine the second cropping area of the second image in the target video stream (including the second object in the second image, and the matching degree between the second object and the first object is greater than or Equal to the first preset threshold); and crop the image outside the first cropping area in the first image, and crop the image outside the second cropping area in the second image, to obtain the cropped target video stream.
  • the electronic device determines the cropped area of an image, it can refer to the cropped area determined in another image and the objects in the cropped area, so the cropped area of the one image determined by the electronic device can include The object that matches the object (for example, the two objects are the same object), that is, the video stream cropping method provided by the embodiment of the present invention is adopted, and the cropped regions of each image are determined to include the main body of the image, so that the video is cropped according to these cropped regions After each frame of image in the stream, the main body of the image in the cropped video stream can be avoided from being lost.
  • the electronic device in the embodiment of the present invention may be an electronic device with an operating system.
  • the operating system may be an Android operating system, an ios operating system, or other possible operating systems, which is not specifically limited in the embodiment of the present invention.
  • the following takes the Android operating system as an example to introduce the software environment to which the video stream cropping method provided by the embodiment of the present invention is applied.
  • FIG. 1 it is a schematic structural diagram of a possible Android operating system provided by an embodiment of the present invention.
  • the architecture of the Android operating system includes 4 layers, which are: application layer, application framework layer, system runtime library layer, and kernel layer (specifically, it may be the Linux kernel layer).
  • the application layer includes various applications (including system applications and third-party applications) in the Android operating system.
  • the application framework layer is the framework of the application. Developers can develop some applications based on the application framework layer while complying with the development principles of the application framework.
  • the system runtime layer includes a library (also called a system library) and an Android operating system runtime environment.
  • the library mainly provides various resources needed by the Android operating system.
  • the Android operating system operating environment is used to provide a software environment for the Android operating system.
  • the kernel layer is the operating system layer of the Android operating system and belongs to the lowest level of the Android operating system software level.
  • the kernel layer is based on the Linux kernel to provide core system services and hardware-related drivers for the Android operating system.
  • developers can develop a software program that implements the video stream cropping method provided by the embodiment of the present invention based on the system architecture of the Android operating system as shown in FIG.
  • the video stream cropping method can be run based on the Android operating system as shown in FIG. 1. That is, the processor or the electronic device can implement the video stream cropping method provided in the embodiment of the present invention by running the software program in the Android operating system.
  • the electronic device in the embodiment of the present invention may be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). Assistant, PDA), etc.
  • the non-mobile electronic device may be a personal computer (PC), television (television, TV), teller machine, or self-service machine, etc., which is not specifically limited in the embodiment of the present invention.
  • the execution subject of the video stream cropping method provided by the embodiments of the present invention may be the above-mentioned electronic device, or may be a functional module and/or functional entity in the electronic device that can implement the video stream cropping method, and may be specifically based on actual usage requirements. It is confirmed that the embodiment of the present invention is not limited.
  • the following takes an electronic device as an example to illustrate the video stream cropping method provided by the embodiment of the present invention.
  • cropping the video stream may include cropping the video stream in the temporal domain and cropping the video stream in the spatial domain.
  • cropping the video stream in the time domain can be cropping a video stream with a longer duration into a video stream with a shorter duration.
  • Cropping the video stream in the spatial domain can be to crop an image with a larger size in the video stream into an image with a smaller size.
  • the size in the embodiment of the present invention may be side length and/or area.
  • the size of the aforementioned image may be the side length of the image and/or the area of the image.
  • the video stream cropping method provided by the embodiment of the present invention can be applied to crop the video stream in the spatial domain through an electronic device to optimize the composition of the image in the video stream or to highlight the main body of the image in the video stream.
  • the subject in the embodiment of the present invention refers to a general meaning, and is not a specific thing.
  • the subject may be an image or a main part of an image in a video stream.
  • the electronic device may first determine the cropping area of an image (hereinafter referred to as image A1) in the video stream (for example, the first cropping area in the embodiment of the present invention, hereinafter referred to as cropping area 1); then, the electronic device
  • image A1 an image
  • image A2 the object in the cropped area 1 in the image A1
  • object B2 An object whose matching degree of the object B1 is greater than or equal to a preset threshold
  • object B2 and the object B1 can be the same subject in the video stream.
  • the object B2 and the object B1 can be the facial image of the same user; thus, when an image A2 includes the object B2, it means that the image A2 and The same subject is included in the image A1.
  • the electronic device may determine the area including the object B2 in the image A2 as the cropped area of the image A2 according to the cropped area 1 and the object B1 (for example, the second cropped area in the embodiment of the present invention, hereinafter referred to as cropped area 2) ).
  • the electronic device can determine the cropped areas of all images that include the same subject in the video stream.
  • the electronic device crops the images outside the cropped area in these images, for example, crops the image outside the cropped area 1 in the image A1, and crops the image outside the cropped area 2 in the image A2, the cropped video stream is obtained. All of these images include the same subject. Therefore, it is possible to avoid the loss of the main body of the image in the cropped video stream.
  • the electronic device can also crop the video stream in the time domain. For example, if the video stream includes 10 frames of images before cropping, and 2 frames of images do not include the subject, the electronic device can crop the video stream in the time domain.
  • the video stream is cropped in the domain, for example, the electronic device can discard these 2 frames of images.
  • the electronic device may also crop the frame of the image according to the cropped area of the previous frame of each of the two frames of images.
  • the details can be determined according to actual use requirements, and the embodiment of the present invention does not limit it.
  • the above-described cropping process is described by taking an object in the video stream as an example.
  • images including different objects can be cropped separately.
  • the electronic device can perform the video data provided by the embodiment of the present invention for each frame of image including subject 1 and each frame of image including subject 2.
  • the stream clipping method performs clipping. Specifically, it can be determined according to actual use requirements, and the embodiment of the present invention does not limit it.
  • an embodiment of the present invention provides a video stream cropping method, and the method may include the following S201 to S203.
  • the electronic device determines a first cropping area of a first image in a target video stream.
  • the above-mentioned first cropping area may include a first object.
  • the above-mentioned target video stream may be a video stream tailored according to user requirements.
  • the first object can be understood as the main body in the target video stream.
  • the subject may be an object that the user needs to keep in the target video stream after cropping.
  • the first object may be any object with a clear boundary in the first image.
  • the above-mentioned first object may include at least one of the following: a full-body image of a person, a face image of a person, an image of a house, an image of a tree, an image of an animal, etc., which can be specifically determined according to actual usage requirements. limited.
  • any object with a clear boundary in the first image can be determined according to at least one of color, pattern, and shape. For example, taking the determination of objects with clear boundaries in the first image based on color as an example, if the background color of the first image is white, then the objects in the first image are black, red and black, blue and black, and All green objects can be objects with clear boundaries in the first image.
  • the user before the electronic device determines the first object in the first image, the user can trigger the electronic device to select the target video stream and display the first image in the target video stream. It is understandable that this When, the target video stream can be in editable state.
  • the electronic device may first determine the first object in the first image, and then according to the area where the first object is located in the first image (for example, the following The first area), the first cropping area is determined.
  • the above S201 may be implemented by the following S201a and S201b.
  • the electronic device determines the first object in the first image.
  • the first object may be an object automatically recognized by the electronic device (implementation 1), or may be an object selected by the user (implementation 2), which can be specifically determined according to actual usage requirements, which is not limited in the embodiment of the present invention.
  • the first object is an object automatically recognized by the electronic device.
  • the electronic device may use image recognition technology to automatically recognize the object in the first image, and after recognizing the object in the first image, it will At least part of the object is determined to be the first object.
  • the electronic device can determine the 3 facial images as a whole and determine the first object; or , The electronic device may determine part of the facial images in the three facial images, for example, the facial image with the largest area, the smallest area, etc., as the first object. Specifically, it can be determined according to actual use requirements, and the embodiment of the present invention does not limit it.
  • the electronic device may display a prompt message to prompt the user that the subject is not recognized.
  • the prompt message may be "The subject is not recognized, please try another image.”
  • Implementation mode 2 The first object is the object selected by the user trigger.
  • the electronic device after the electronic device displays the first image, if the user inputs on the first image, the electronic device can obtain the input parameter input by the user, and determine the object corresponding to the input parameter in the first image For the first object.
  • the input parameter input by the user may be at least one of the following: input position, input area, input trajectory, and input duration, which may be specifically determined according to actual usage requirements, and the embodiment of the present invention does not limit it.
  • the electronic device displays a first image 40.
  • the first image 40 includes an image of a tree and an image of a house. If the user clicks on the image of the house, the electronic device can obtain the user The click position of the user (that is, the input position input by the user), and the image recognition technology is used to identify the image of the house at the click position, and the image of the house is determined as the first object.
  • the electronic device can display a prompt message to prompt the user that the subject currently selected cannot be recognized.
  • the prompt message can be "The subject currently selected cannot be recognized, please try selecting the subject again” .
  • the electronic device may display a first identification frame (for example, The identification box shown by 41 in (b) in Fig. 4).
  • the first identification frame may be used to indicate the first object determined by the electronic device.
  • the shape of the first area may be the same as the shape of the first identification frame; the size (for example, side length or area) of the first area may be the same as the size of the first identification frame, or The size of the first area may be smaller than the size of the aforementioned first identification frame.
  • the electronic device determines a first cropping area according to the first area where the first object is located in the first image.
  • the electronic device may determine an area including the first area in the first image as the first cropping area, so that the first cropping area includes the first object.
  • the area of the first cropping region may be larger than the area of the above-mentioned first identification frame.
  • the area of the first cropping region indicated by 42 is larger than the area of the first identification frame indicated by 41.
  • the aspect ratio of the first cropping area and the aspect ratio of the first image may be the same or different, and may be specifically determined according to actual usage requirements.
  • the electronic device may display the first cropping frame on the first cropping area (the cropping frame shown as 42 in (b) of FIG. 4) ) Is used to indicate the first cropping area, so that the user can confirm through the first cropping frame whether the first cropping area meets their actual usage requirements.
  • the shape of the first cropping frame is the same as the shape of the first cropping area
  • the size (side length or area) of the first cropping frame is the same as the size of the first cropping area.
  • the electronic device may use AI composition technology to determine the first cropping area. For example, the electronic device may determine one or more recommended cropping regions including the first object, and display multiple recommended cropping boxes for indicating the recommended cropping regions, and then the user can input one of the recommended cropping boxes to trigger the electronic device to select Compose the cropped area that meets its needs.
  • the electronic device can determine the first cropping area of the first image according to the area where the first object is located in the first image, it can be ensured that the first cropping area includes the user's requirements and remains in the cropped area.
  • the electronic device determines the second cropping area of the second image in the target video stream according to the first cropping area and the first object.
  • the second cropping area includes the second object in the second image, and the degree of matching between the second object and the first object is greater than or equal to a first preset threshold (specifically, it can be determined according to actual usage requirements.
  • a first preset threshold specifically, it can be determined according to actual usage requirements.
  • the implementation of the present invention The examples are not limited).
  • the degree of matching between the second object and the first object is greater than or equal to the first preset threshold, which can be understood as: the second object and the first object are the same subject in the target video stream, for example The second object and the first object are the same facial image (referring to facial images that include the same facial features) in the target video stream.
  • the number of second images in the target video stream may be one or multiple, and may be specifically determined according to actual use requirements, which is not limited in the embodiment of the present invention.
  • the number of second images in the target video stream is not limited.
  • the second image may be an image located after the first image in the target video stream; or it may be an image located before the first image in the target video stream, which can be specifically based on actual usage requirements. It is confirmed that the embodiment of the present invention is not limited.
  • the foregoing S202 may be specifically implemented by the following S202a and S202b.
  • the electronic device determines, according to the first object, that the target video stream includes a second image of the second object.
  • the above-mentioned second image may be an image in the at least one third image.
  • the electronic device can determine the degree of matching between each third image and the first object to determine whether each third image includes the second object; After the second object is included in a certain third image, the electronic device may determine the third image as the second image.
  • the electronic device may extract the first target characteristic information of the first object, and extract the second target characteristic information of each third image; then, the electronic device may sequentially compare each second target characteristic information with the first target characteristic information.
  • the feature information is compared to determine whether the degree of matching between each second target feature information and the first target feature information is greater than or equal to a preset threshold (for example, the aforementioned first preset threshold). If the degree of matching between a certain second target feature information and the first target feature information is greater than or equal to the first preset threshold, the electronic device may determine that the third image corresponding to the second target feature information includes the second object, and The object indicated by the second target feature information in the third image is the second object.
  • a preset threshold for example, the aforementioned first preset threshold
  • the electronic device may determine that the third image corresponding to the second target characteristic information does not include the second object. And so on, until the electronic device compares each second target characteristic information with the first target characteristic information. It can be understood that when the electronic device determines that a third image includes the second object, the electronic device can determine that the third image is the second image.
  • the electronic device can extract facial feature information in the first object (that is, the aforementioned first target feature information), and extract the third The feature information in the image (that is, the above-mentioned second target feature information), and the feature information is compared with the facial feature information. If the matching degree between the feature information and the facial feature information is greater than or equal to the preset matching degree threshold (that is, the aforementioned first preset threshold), the electronic device may determine that the third image includes the facial image of user A, and the electronic device The object corresponding to the second target feature information in the third image may be determined as the second object, and the electronic device may determine that the third image is the second image. If the degree of matching between the feature information and the facial feature information is less than the preset matching degree threshold, the electronic device may determine that the third image does not include the facial image of the user A, that is, the third image does not include the second object.
  • the preset matching degree threshold that is, the aforementioned first preset threshold
  • the electronic device may display the second recognition frame in the second area where the second object is located in the second image.
  • the second identification frame may be used to indicate the second object determined by the electronic device.
  • the description of the second area and the second identification frame reference may be made to the related description of the first area and the first identification frame in the foregoing embodiment. In order to avoid repetition, details are not repeated here.
  • the electronic device determines a second cropping area including the second object in the second image according to the first cropping area and the first object.
  • the electronic device may determine that the second image includes the second image through the following two possible implementation manners (ie, the first possible implementation manner and the second possible implementation manner described below) The second cropping area of the second object.
  • the electronic device may determine the second cropping area including the second object in the second image according to the size of the first cropping area and the relative position of the first object and the first cropping area.
  • the size (side length and/or area) of the second cropping area and the size of the first cropping area may be the same.
  • the electronic device may determine the relative position of the second object and the second cropping area (hereinafter referred to as the first relative position) according to the relative position of the first object and the first cropping area (hereinafter referred to as the first relative position). Is the second relative position). Wherein, the second relative position can be consistent with the first relative position.
  • the electronic device may determine the relative position between the center point of the first object and the center point of the first cropping area as the first relative position; or, the center of the first area may be determined as the first relative position.
  • the relative position between the point and the center point of the first cropping area is determined as the first relative position.
  • the first relative position is determined according to the center point of the first area and the center point of the first cropping area. Assuming that the center point of the first area is point A, and the center point of the first cropping area is point B, then, as shown in Figure 5, when point A is located to the left of point B, it means that the first relative position can be the first object It is located in the left area of the first cropping area, so that the electronic device can determine that the second relative position is that the second object is located in the left area of the second cropping area.
  • point A When point A is located to the right of point B, it means that the first relative position can be that the first object is located on the right side of the first cropping area, so the electronic device can determine that the second relative position is that the second object is located on the right of the second cropping area. Side area.
  • point A When point A is above point B, it means that the first relative position can be that the first object is located in the upper area of the first cropping area, so that the electronic device can determine that the second relative position is that the second object is located in the upper area of the second cropping area .
  • point A When point A is located below point B, it means that the first relative position may be that the first object is located at the lower side of the first cropping area, so the electronic device can determine that the second relative position is that the second object is located on the lower side of the second cropping area area.
  • point A and point B coincide or approximately coincide, it means that the first relative position is that the first object is located in the center area of the first cropping area, so the electronic device can determine that the second relative position is that the second object is located in the middle of the second cropping area. area.
  • it can be determined according to actual use requirements, and the embodiment of the present invention does not limit it.
  • the above-mentioned upper, lower, left, right, and middle are all based on that when the center point of the first cropping area is located at the origin of a coordinate system, the center point of the first area is relative to the origin. Take it as an example.
  • the above-mentioned relative position is determined by taking the relative positional relationship between the first object and the first cropping area as an example.
  • the relative position between the first object and the first cropping area can also be combined. The position relationship and distance are determined.
  • the size of the second cropping area is the same as the size of the first cropping area, it can be ensured that the size of each frame image in the target video stream after cropping can be kept consistent.
  • the relative position of the second object and the second cropping area is consistent with the relative position of the first object and the first cropping area, it can be ensured that the first object and the second object are in the target video stream after cropping.
  • the position in each frame of the image is basically fixed. In this way, not only can the composition effect of the image in the target video stream be optimized, but also it can be ensured that the target video stream after cropping has a better display effect.
  • the electronic device may determine that the second image includes the second crop of the second object according to the proportion of the area of the first object in the first cropping area and the relative position of the first object and the first cropping area. area.
  • the electronic device may determine the area ratio of the second object in the second cropping area according to the area ratio of the first object in the first cropping area; and may determine the area ratio of the second object in the second cropping area according to the The relative position of the first cropping area determines the relative position of the second object and the second cropping area.
  • the relative position of the object and the cropped area please refer to the related description of the first possible implementation manner. In order to avoid repetition, it will not be repeated here.
  • the area proportion of the first object in the first cropping region may be understood as the ratio of the area of the first object to the area of the first cropping region.
  • the electronic device may determine the area of the second object and the area of the second cropping area according to the ratio of the area of the first object to the area of the first cropping region (hereinafter referred to as the first ratio) Ratio (hereinafter referred to as the second ratio).
  • the second ratio can be the same as the first ratio.
  • the proportion of the second object in the second cropping area is the same as the proportion of the first object in the second cropping area, it can be ensured that the first object and the second object are cropped.
  • the proportion of each frame in the target video stream is the same.
  • the target video stream of the first object and the second object after cropping can be guaranteed.
  • the position in each frame of the image is basically fixed. In this way, not only the composition effect of each frame image in the target video stream can be optimized, but also the subject in the target video stream after cropping can be further highlighted, thereby improving the cropping effect.
  • the area of the first cropped area 61 of the first image 60 is 2 square centimeters, and the first cropped area 61 includes a facial image (Ie the first object), the facial image is located in the central area of the first cropping area, and the area of the facial image is 1 square centimeter; as shown in Figure 6 (b) or Figure 6 (c), and It is assumed that the second image 62 also includes a facial image, and the area of the facial image in the second image 62 is 0.5 square centimeters. Then, in the first possible implementation manner, as shown in (b) of FIG.
  • the area of the second cropping area 63 determined by the electronic device may be 2 square centimeters, and the center point of the second cropping area 63 and The center points of the facial images in the second image 62 coincide; that is, the electronic device determines the second cropping area according to the size of the first cropping area and the relative position of the first object and the first cropping area.
  • the electronic device determines the second cropping area according to the size of the first cropping area and the relative position of the first object and the first cropping area.
  • the area of the second cropping area 63 determined by the electronic device is 1 square centimeter, and the center point of the second cropping area 63 is the same as the second image
  • the center points of the facial images in 62 coincide; that is, the electronic device determines the second cropping area according to the area proportion of the first object in the first cropping area and the relative position of the first object and the first cropping area.
  • the electronic device may display the second cropping frame on the second cropping area, and the size of the second cropping frame Same size as the second crop area.
  • the electronic device may display the second cropping frame on the second cropping area, and the size of the second cropping frame Same size as the second crop area.
  • the electronic device may further divide the target video stream into at least A video segment, and mark each video segment. For example, you can set a flag mark in the first frame and the last frame of each video stream segment; or you can set the progress bar of the target video stream to correspond to each video segment The time periods are marked with different colors.
  • each frame of image of each video stream segment may include the first object or the second object, that is, it includes the main body in the target video stream.
  • the electronic device crops the image outside the first cropping area in the first image, and crops the image outside the second cropping area in the second image, to obtain a cropped target video stream.
  • the electronic device cropping the image outside the first cropping area in the first image can be understood as: the electronic device retains the image in the first image within the first cropping area, and discards the first image in the first image.
  • the electronic device cropping the image outside the second cropping area in the second image can be understood as: the electronic device retains the image within the second cropping area in the second image, and discards the image outside the second cropping area in the second image.
  • the target video stream cropped by the electronic device includes the image in the first cropping area and the image in the second cropping area.
  • the above-mentioned second image may be a multi-frame second image.
  • the cropped first image and the cropped multi-frame second image are then cropped.
  • the two images are combined into one video stream, and then the cropped target video stream can be obtained.
  • the electronic device when the electronic device determines the cropped area of an image, it can refer to the cropped area determined in another image and the objects in the cropped area, so that the electronic device can determine the cropped area.
  • the cropped area of an image may include objects that match the object (for example, two objects are the same object), that is, the video stream cropping method provided by the embodiment of the present invention is adopted, and the cropped areas of each image determined include the main body of the image. Therefore, after cropping each frame of the video stream according to these cropping regions, it is possible to avoid the loss of the main body of the image in the cropped video stream.
  • the electronic device may also use interpolation to perform pixel interpolation on each frame of the cropped target video stream to adjust the cropped target video stream.
  • the size of each frame of the target video stream For example, the size of each frame of image in the target video stream after cropping can be restored to the size before cropping.
  • the embodiment of the present invention when the position of the second object in the second image is close to the boundary of the second image, the boundary of the second cropping area determined by the electronic device may exceed the boundary of the second image, and so After the electronic device crops the image outside the second cropping area in the second image, the size of the obtained image may be smaller than the size of the second cropping area. Further, in order to ensure that the size of each frame image in the target video stream after cropping is consistent, the embodiment of the present invention may adjust the second cropping area when the boundary of the second cropping area exceeds the boundary of the second image, so that the adjusted The boundary of the second cropping area is located in the second image, that is, the boundary of the adjusted second cropping area does not exceed the boundary of the second image.
  • the method for the electronic device to determine whether the boundary of the second cropping area exceeds the boundary of the second image will be exemplarily described below.
  • the electronic device can obtain the coordinate range of the boundary of the second cropping area on the x-axis of the coordinate system (hereinafter referred to as the first coordinate range) and the boundary of the second cropping area at the coordinates
  • the coordinate range on the y-axis of the system (hereinafter referred to as the second coordinate range), and the coordinate range of the boundary of the second image on the x-axis of the coordinate system (hereinafter referred to as the third coordinate range) and the second image
  • the coordinate range of the boundary on the y-axis of the coordinate system hereinafter referred to as the fourth coordinate range).
  • the electronic device can compare the first coordinate range with the third coordinate range, and compare the second coordinate range with the fourth coordinate range. If all coordinates in the first coordinate range belong to the third coordinate range, and all coordinates in the second coordinate range belong to the fourth coordinate range, the electronic device may determine that the boundary of the second cropping area does not exceed the boundary of the second image . If at least one coordinate in the first coordinate range does not belong to the third coordinate range, or at least one coordinate in the second coordinate range does not belong to the fourth coordinate range, the electronic device may determine that the boundary of the second cropping area exceeds the boundary of the second image.
  • the electronic device can compare [X3, X4] with [X1, X2], and compare [Y3, Y4] with [Y1, Y2]. As shown in (a) in FIG.
  • the electronic device can determine that the boundary of the second cropping area 70 does not exceed the boundary of the second image 70 . As shown in (b) of FIG. 7, since Y4>Y2, the electronic device can determine that the boundary of the second cropping area 71 exceeds the boundary of the second image 70.
  • the method for adjusting the second cropping area of the electronic device will be described below as an example.
  • the video stream cropping method provided in the embodiment of the present invention may further include the following S204.
  • the boundary of the second crop area adjusted by the electronic device may be located in the second image; and the adjusted second crop area includes the second object.
  • the shape and size of the second cropping area may remain unchanged.
  • the electronic device may determine the offset direction of the boundary of the second cropping area relative to the center point of the second image, and determine that the boundary of the second cropping area is relative to the first offset direction in the offset direction.
  • the offset of the boundary of the second image so that the electronic device can adjust the second cropping area according to the offset direction and the offset.
  • the electronic device may keep the size of the second cropping area unchanged, and move the entire second cropping area in a direction opposite to the offset direction by the offset.
  • the electronic device when the boundary of the second cropping area exceeds the boundary of the second image, the electronic device can adjust the boundary of the second cropping area into the second image. Therefore, it can be ensured that the electronic device crops the second image. After the image outside the second cropping area, the size of the obtained image is equal to the size of the second cropping area, thereby ensuring that the cropped target video stream has a better display effect.
  • the electronic device may use a smoothing algorithm to adjust the second cropping area in the second image according to the position of the first cropping area in the first image.
  • a smoothing algorithm to adjust the position of the second cropping area in the second image to improve the smoothness between the frames of the cropped target video stream, so as to avoid the screen jitter of the cropped target video stream.
  • the electronic device may adjust the position of the second cropping area in the second image according to the position of the first cropping area in the first image after performing the above S204.
  • the above-mentioned smoothing algorithm may be a unary linear fitting algorithm, or may be a least squares method, or any other possible smoothing algorithm, which can be specifically determined according to actual usage requirements.
  • the embodiment of the present invention Not limited.
  • the electronic device may linearly fit the initial coordinates of the first cropping area with the initial coordinates of the second cropping area to update the initial cropping coordinates of the second cropping area, and use the updated initial cropping coordinates.
  • a second cropping area is re-determined.
  • the starting coordinate of a cropping area may be any coordinate on the boundary of the cropping area.
  • the starting cropping coordinates of the second cropping area can be any coordinates such as (X1, Y1), (X1, Y2), (X2, Y1) or (X2, Y2) .
  • the electronic device adopts a univariate linear fitting algorithm to adjust the position of the second cropping region in the second image.
  • the electronic device can linearly fit the coordinates of the starting clipping point of the first clipping region on the x-axis with the coordinates of the starting clipping point of the second clipping region on the x-axis to adjust the starting clipping of the second clipping region The coordinate of the point on the x-axis.
  • the electronic device can linearly fit the coordinates of the starting clipping point of the first clipping region on the y axis and the coordinates of the starting clipping point of the second clipping region on the y axis to adjust the size of the second clipping region.
  • the electronic device can adjust the starting cropping point of the second cropping area. Then, the electronic device can re-determine a second cropping area according to the original size of the second cropping area using the adjusted starting cropping point as the starting point. , The electronic device can adjust the position of the second cropping area in the second image.
  • the electronic device can adjust the smoothness of the cropped target video stream in advance by adjusting the position of the second cropped area in the second image, the smoothness of the cropped target video stream can be improved. , So as to ensure that the cropped target video stream has a better display effect.
  • the video stream cropping methods shown in the figures of the above methods are all exemplified in conjunction with a figure in the embodiment of the present invention.
  • the video stream cropping methods shown in the figures of the above methods can also be implemented in combination with any other figures that can be combined as illustrated in the above embodiments, and will not be repeated here.
  • an embodiment of the present invention provides an electronic device 900.
  • the electronic device 900 may include: a determining module 901 and a cutting module 902.
  • the determining module 901 may be used to determine the first cropping area of the first image in the target video stream, and the first cropping area may include the first object; and according to the first cropping area and the first object, determine the first cropping area in the target video stream.
  • the second cropping area of the second image may include: a determining module 901 and a cutting module 902.
  • the first cropping area may include the first object
  • the second cropping area may include the second object in the second image
  • the degree of matching between the second object and the first object may be greater than or equal to the first preset threshold
  • cropping The module 902 can be used to crop the image in the first image that is outside the first cropping area determined by the determining module 901, and crop the image in the second image that is outside the second cropping area determined by the determining module 901 to obtain the cropped target Video streaming.
  • the above-mentioned determining module 901 may be specifically configured to determine the second image including the second object in the target video stream according to the first object; and determine according to the first cropping area and the first object The second image includes the second cropped area of the second object.
  • the above-mentioned determining module 901 may be specifically configured to determine the second cropping area according to the size of the first cropping area and the relative position of the first object and the first cropping area.
  • the above-mentioned determining module 901 may be specifically configured to determine the second object according to the area ratio of the first object in the first cropping area and the relative position of the first object and the first cropping area. Cropping area.
  • the foregoing electronic device may further include an adjustment module 903.
  • the adjustment module 903 may be configured to, after the determining module 901 determines the second cropping area, and when the determining module 901 determines that the boundary of the second cropping area exceeds the boundary of the second image, the electronic device may, according to the boundary of the second image, The second cropping area is adjusted; wherein the boundary of the adjusted second cropping area is located in the second image.
  • the foregoing electronic device may further include an adjustment module 903.
  • the adjustment module 903 may be configured to, after the determining module 901 determines the second cropping area, use a smoothing algorithm to adjust the position of the second cropping area in the second image according to the position of the first cropping area in the first image.
  • the above-mentioned determining module 901 may be specifically used to determine the first object in the first image, and determine the first crop according to the first area where the first object is located in the first image. Area; the first object is an object automatically recognized by the electronic device or an object selected by the user.
  • the foregoing electronic device may further include a display module 904.
  • the display module 904 may be configured to display the first recognition frame in the first area after the determining module 901 determines the first object.
  • the first identification frame may be used to indicate the determined first object; the size (area and shape) of the first identification frame may be the same as the size of the first cropping area.
  • the electronic device 900 provided in the embodiment of the present invention can implement the various processes implemented by the electronic device shown in the foregoing method embodiments. In order to avoid repetition, details are not described herein again.
  • An embodiment of the present invention provides an electronic device that can determine a first cropped area (including a first object) of a first image in a target video stream; and determine the target video stream according to the first cropped area and the first object
  • the second cropping area of the second image in the second image including the second object in the second image, the matching degree between the second object and the first object is greater than or equal to the first preset threshold; and cropping the first image in the first image
  • the image outside the region is cropped, and the image outside the second cropping region in the second image is cropped to obtain the cropped target video stream.
  • the electronic device determines the cropped area of an image, it can refer to the cropped area determined in another image and the objects in the cropped area, so the cropped area of the one image determined by the electronic device can include The object that matches the object (for example, the two objects are the same object), that is, the video stream cropping method provided by the embodiment of the present invention is adopted, and the cropped regions of each image are determined to include the main body of the image, so that the video is cropped according to these cropped regions After each frame of image in the stream, the main body of the image in the cropped video stream can be avoided from being lost.
  • FIG. 12 is a schematic diagram of the hardware structure of an electronic device implementing various embodiments of the present invention.
  • the electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, and a memory 109 , Processor 110, and power supply 111 and other components.
  • Those skilled in the art can understand that the structure of the electronic device shown in FIG. 12 does not constitute a limitation on the electronic device.
  • the electronic device may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. Layout.
  • electronic devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, in-vehicle electronic devices, wearable devices, and pedometers.
  • the processor 110 is configured to determine a first cropping area of the first image in the target video stream, the first cropping area includes the first object; and according to the first cropping area and the first object, determine the first cropping area in the target video stream A second cropping area of the second image; and cropping an image outside the first cropping area in the first image, and cropping an image outside the second cropping area in the second image to obtain a cropped target video stream.
  • the second cropping area includes the second object in the second image, and the degree of matching between the second object and the first object is greater than or equal to the first preset threshold.
  • the determining module 901 and the cutting module 902 in the structural schematic diagrams of the foregoing electronic device may be implemented by the foregoing processor 110.
  • the adjustment module 903 in the above-mentioned structural schematic diagram of the electronic device may be implemented by the above-mentioned processor 110.
  • the display module 904 in the above-mentioned structural schematic diagram of the electronic device may be implemented by the above-mentioned display unit 106.
  • An embodiment of the present invention provides an electronic device.
  • the electronic device can determine a first cropping area (including a first object) of a first image in a target video stream; and according to the first cropping area and the first object, determine the target video stream
  • the second cropping area of the second image including the second object in the second image, the matching degree between the second object and the first object is greater than or equal to the first preset threshold; and cropping the first image in the first crop And crop the image outside the second cropping area in the second image to obtain the cropped target video stream.
  • the electronic device determines the cropped area of an image, it can refer to the cropped area determined in another image and the objects in the cropped area, so the cropped area of the one image determined by the electronic device can include The object that matches the object (for example, the two objects are the same object), that is, the video stream cropping method provided by the embodiment of the present invention is adopted, and the cropped regions of each image are determined to include the main body of the image, so that the video is cropped according to these cropped regions After each frame of image in the stream, the main body of the image in the cropped video stream can be avoided from being lost.
  • the radio frequency unit 101 can be used for receiving and sending signals in the process of sending and receiving information or talking. Specifically, the downlink data from the base station is received and processed by the processor 110; in addition, Uplink data is sent to the base station.
  • the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency unit 101 can also communicate with the network and other devices through a wireless communication system.
  • the electronic device provides users with wireless broadband Internet access through the network module 102, such as helping users to send and receive emails, browse web pages, and access streaming media.
  • the audio output unit 103 can convert the audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output it as sound. Moreover, the audio output unit 103 may also provide audio output related to a specific function performed by the electronic device 100 (for example, call signal reception sound, message reception sound, etc.).
  • the audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
  • the input unit 104 is used to receive audio or video signals.
  • the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042.
  • the graphics processor 1041 is configured to capture still pictures or video streams obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. Image data is processed.
  • the processed image frame can be displayed on the display unit 106.
  • the image frame processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the network module 102.
  • the microphone 1042 can receive sound, and can process such sound into audio data.
  • the processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 101 for output in the case of a telephone call mode.
  • the electronic device 100 further includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor.
  • the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light.
  • the proximity sensor can close the display panel 1061 and the display panel 1061 when the electronic device 100 is moved to the ear. / Or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, related games) , Magnetometer attitude calibration), vibration recognition related functions (such as pedometer, percussion), etc.; sensor 105 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
  • the display unit 106 is used to display information input by the user or information provided to the user.
  • the display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • the user input unit 107 may be used to receive inputted numeric or character information, and generate key signal input related to user settings and function control of the electronic device.
  • the user input unit 107 includes a touch panel 1071 and other input devices 1072.
  • the touch panel 1071 also called a touch screen, can collect the user's touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 1071 or near the touch panel 1071. operating).
  • the touch panel 1071 may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 110, the command sent by the processor 110 is received and executed.
  • the touch panel 1071 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the user input unit 107 may also include other input devices 1072.
  • other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick, which will not be repeated here.
  • the touch panel 1071 can be overlaid on the display panel 1061.
  • the touch panel 1071 detects a touch operation on or near it, it transmits it to the processor 110 to determine the type of the touch event, and then the processor 110 determines the type of the touch event according to the touch.
  • the type of event provides corresponding visual output on the display panel 1061.
  • the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated
  • the implementation of the input and output functions of the electronic device is not specifically limited here.
  • the interface unit 108 is an interface for connecting an external device with the electronic device 100.
  • the external device may include a wired or wireless headset port, an external power source (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) port, video I/O port, headphone port, etc.
  • the interface unit 108 can be used to receive input (for example, data information, power, etc.) from an external device and transmit the received input to one or more elements in the electronic device 100 or can be used to connect to the electronic device 100 and the external device. Transfer data between devices.
  • the memory 109 can be used to store software programs and various data.
  • the memory 109 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc.
  • the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the processor 110 is the control center of the electronic device, which uses various interfaces and lines to connect the various parts of the entire electronic device, runs or executes software programs and/or modules stored in the memory 109, and calls data stored in the memory 109 , Perform various functions of electronic equipment and process data, so as to monitor the electronic equipment as a whole.
  • the processor 110 may include one or more processing units; optionally, the processor 110 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, and application programs, etc.
  • the adjustment processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110.
  • the electronic device 100 may also include a power source 111 (such as a battery) for supplying power to various components.
  • a power source 111 such as a battery
  • the power source 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. Management and other functions.
  • the electronic device 100 includes some functional modules not shown, which will not be repeated here.
  • an embodiment of the present invention also provides an electronic device, including a processor 110 as shown in FIG. 12, a memory 109, a computer program stored in the memory 109 and running on the processor 110, the computer
  • the program is executed by the processor 110, each process of the foregoing method embodiment is realized, and the same technical effect can be achieved. In order to avoid repetition, details are not described herein again.
  • the embodiment of the present invention also provides a computer-readable storage medium, and a computer program is stored on the computer-readable storage medium.
  • a computer program is stored on the computer-readable storage medium.
  • the computer program is executed by a processor, each process of the foregoing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, I won’t repeat them here.
  • the computer-readable storage medium may include read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc.
  • the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. ⁇
  • the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The optical disc) includes several instructions to make an electronic device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

Un procédé d'écrêtage de flux vidéo et un dispositif électronique concernant le domaine technique des communications et visant à résoudre, lors de l'écrêtage d'un flux vidéo, le problème de perte d'un corps principal d'une certaine image ou de plusieurs images du flux vidéo écrêté. Le procédé consiste : à déterminer une première zone d'écrêtage d'une première image d'un flux vidéo cible, la première zone d'écrêtage comprenant un premier objet ; à déterminer une seconde zone d'écrêtage d'une seconde image du flux vidéo cible selon la première zone d'écrêtage et le premier objet, la seconde zone d'écrêtage comprenant un second objet de la seconde image et le degré de correspondance du second objet et du premier objet étant supérieur ou égal à un premier seuil prédéfini ; et à écrêter une image à l'extérieur de la première zone d'écrêtage de la première image et à écrêter une image à l'extérieur de la seconde zone d'écrêtage de la seconde image pour obtenir un flux vidéo cible écrêté.
PCT/CN2020/136656 2019-12-19 2020-12-16 Procédé et dispositif électronique d'écrêtage de flux vidéo Ceased WO2021121237A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911320804.9A CN111031178A (zh) 2019-12-19 2019-12-19 一种视频流裁剪方法及电子设备
CN201911320804.9 2019-12-19

Publications (1)

Publication Number Publication Date
WO2021121237A1 true WO2021121237A1 (fr) 2021-06-24

Family

ID=70212189

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/136656 Ceased WO2021121237A1 (fr) 2019-12-19 2020-12-16 Procédé et dispositif électronique d'écrêtage de flux vidéo

Country Status (2)

Country Link
CN (1) CN111031178A (fr)
WO (1) WO2021121237A1 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111031178A (zh) * 2019-12-19 2020-04-17 维沃移动通信有限公司 一种视频流裁剪方法及电子设备
CN112132836A (zh) * 2020-08-14 2020-12-25 咪咕文化科技有限公司 视频图像裁剪方法、装置、电子设备及存储介质
CN112561840B (zh) * 2020-12-02 2024-05-28 北京有竹居网络技术有限公司 视频裁剪方法、装置、存储介质及电子设备
CN116342639A (zh) * 2021-12-22 2023-06-27 华为技术有限公司 图像显示方法及其电子设备和介质
CN115018704B (zh) * 2022-05-27 2024-09-20 浙江大华技术股份有限公司 一种图像处理方法、装置、电子设备和存储介质
CN119068380A (zh) * 2023-06-01 2024-12-03 北京字跳网络技术有限公司 图像处理方法、装置、电子设备以及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017114211A1 (fr) * 2015-12-30 2017-07-06 株式会社日立制作所 Procédé et appareil permettant de détecter une commutation de scènes vidéo
CN107786812A (zh) * 2017-10-31 2018-03-09 维沃移动通信有限公司 一种拍摄方法、移动终端及计算机可读存储介质
CN108447021A (zh) * 2018-03-19 2018-08-24 河北工业大学 基于分块和逐帧优化的视频缩放方法
CN108776970A (zh) * 2018-06-12 2018-11-09 北京字节跳动网络技术有限公司 图像处理方法和装置
CN110223301A (zh) * 2019-03-01 2019-09-10 华为技术有限公司 一种图像裁剪方法和电子设备
CN110322472A (zh) * 2018-03-30 2019-10-11 华为技术有限公司 一种多目标跟踪方法以及终端设备
CN111031178A (zh) * 2019-12-19 2020-04-17 维沃移动通信有限公司 一种视频流裁剪方法及电子设备

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6627861B2 (ja) * 2015-03-26 2020-01-08 ソニー株式会社 画像処理システムおよび画像処理方法、並びにプログラム
CN105263049B (zh) * 2015-10-28 2019-10-29 努比亚技术有限公司 一种基于帧坐标的视频裁剪装置、方法及移动终端
CN107911748A (zh) * 2017-11-24 2018-04-13 南京融升教育科技有限公司 一种基于人脸识别的视频裁剪方法
CN109089157B (zh) * 2018-06-15 2021-12-07 广州华多网络科技有限公司 视频画面的裁剪方法、显示设备以及装置
CN109040780A (zh) * 2018-08-07 2018-12-18 北京优酷科技有限公司 一种视频处理方法及服务器

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017114211A1 (fr) * 2015-12-30 2017-07-06 株式会社日立制作所 Procédé et appareil permettant de détecter une commutation de scènes vidéo
CN107786812A (zh) * 2017-10-31 2018-03-09 维沃移动通信有限公司 一种拍摄方法、移动终端及计算机可读存储介质
CN108447021A (zh) * 2018-03-19 2018-08-24 河北工业大学 基于分块和逐帧优化的视频缩放方法
CN110322472A (zh) * 2018-03-30 2019-10-11 华为技术有限公司 一种多目标跟踪方法以及终端设备
CN108776970A (zh) * 2018-06-12 2018-11-09 北京字节跳动网络技术有限公司 图像处理方法和装置
CN110223301A (zh) * 2019-03-01 2019-09-10 华为技术有限公司 一种图像裁剪方法和电子设备
CN111031178A (zh) * 2019-12-19 2020-04-17 维沃移动通信有限公司 一种视频流裁剪方法及电子设备

Also Published As

Publication number Publication date
CN111031178A (zh) 2020-04-17

Similar Documents

Publication Publication Date Title
US20220276909A1 (en) Screen projection control method and electronic device
WO2021121237A1 (fr) Procédé et dispositif électronique d'écrêtage de flux vidéo
US11604567B2 (en) Information processing method and terminal
CN111562896B (zh) 投屏方法及电子设备
WO2021057267A1 (fr) Procédé de traitement d'image et dispositif terminal
CN110134356A (zh) 一种投屏方法及终端
CN109032486B (zh) 一种显示控制方法及终端设备
WO2020238497A1 (fr) Procédé de déplacement d'icône et dispositif terminal
CN111401463B (zh) 检测结果输出的方法、电子设备及介质
WO2020151525A1 (fr) Procédé d'envoi de message et dispositif terminal
WO2021082772A1 (fr) Procédé de capture d'écran et dispositif électronique
CN110445984A (zh) 一种拍摄提示方法及电子设备
WO2020192298A1 (fr) Procédé de traitement d'image et dispositif terminal
WO2021036623A1 (fr) Procédé d'affichage et dispositif électronique
CN111031253A (zh) 一种拍摄方法及电子设备
CN108037966A (zh) 一种界面显示方法、装置及移动终端
WO2021104266A1 (fr) Procédé d'affichage d'objets et dispositif électronique
WO2021017785A1 (fr) Procédé de transmission de données et dispositif terminal
WO2021017730A1 (fr) Procédé de capture d'écran et dispositif terminal
CN109343811B (zh) 一种显示调整方法及终端设备
WO2020211602A1 (fr) Procédé de commande d'application et dispositif terminal
WO2021185254A1 (fr) Procédé de partage de contenu et dispositif électronique
CN110851098B (zh) 一种视频窗口显示方法及电子设备
CN110602390B (zh) 一种图像处理方法及电子设备
CN109859718B (zh) 屏幕亮度调整方法及终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20903606

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20903606

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22.02.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20903606

Country of ref document: EP

Kind code of ref document: A1