CN118963902A

CN118963902A - Interaction method, device, electronic device and storage medium based on expression images

Info

Publication number: CN118963902A
Application number: CN202411167683.XA
Authority: CN
Inventors: 管久鸣
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2024-08-23
Filing date: 2024-08-23
Publication date: 2024-11-15

Abstract

The disclosure provides an interaction method and device based on expression images, electronic equipment and a storage medium, and belongs to the technical field of multimedia. The method comprises the following steps: displaying a conversation page of the first user account and the second user account, wherein the conversation page is any one of a private chat page, a group chat page and a barrage display page; in response to the first user account entering a conversation message, displaying a plurality of candidate emoticons in the conversation page, each candidate emoticon being made up of a plurality of parts; combining the parts in at least two candidate expression images under the condition that the at least two candidate expression images in the plurality of candidate expression images are selected, so as to obtain a first expression image; and sending the first expression image to the second user account as a session message. The method is not only beneficial to ensuring the accuracy of message transmission in the interaction process, but also can directly generate new expression images which accord with the intention of the user, and is beneficial to improving the interaction efficiency and frequency.

Description

Interaction method and device based on expression image, electronic equipment and storage medium

Technical Field

The disclosure relates to the technical field of multimedia, and in particular relates to an interaction method and device based on expression images, electronic equipment and a storage medium.

Background

With the development of multimedia technology, online interaction between people can be performed through a network. In the process of interaction, one party in the interaction can send an expression image to the other party so as to convey the mood of the user. However, the expression images sent in the interaction process are made into fixed expressions, the style is single, the interestingness is low, and the interaction requirement of the user is difficult to meet.

Disclosure of Invention

The interaction method, the device, the electronic equipment and the storage medium based on the expression images are beneficial to guaranteeing the accuracy of message transmission in the interaction process, and can directly generate new expression images meeting the intention of a user, thereby being beneficial to improving the interaction efficiency and frequency. The technical scheme of the present disclosure is as follows:

according to an aspect of the embodiments of the present disclosure, there is provided an interactive method based on an emoticon, the method including:

Displaying a conversation page of the first user account and the second user account, wherein the conversation page is any one of a private chat page, a group chat page and a barrage display page;

in response to the first user account entering a conversation message, displaying a plurality of candidate emoticons in the conversation page, each candidate emoticon being made up of a plurality of parts;

Combining the parts in at least two candidate expression images under the condition that the at least two candidate expression images in the plurality of candidate expression images are selected, so as to obtain a first expression image;

And sending the first expression image to the second user account as a session message.

According to another aspect of the embodiments of the present disclosure, there is provided an interactive apparatus based on an emoticon, the apparatus including:

The display unit is configured to execute a conversation page for displaying the first user account and the second user account, wherein the conversation page is any one of a private chat page, a group chat page and a barrage display page; in response to the first user account entering a conversation message, displaying a plurality of candidate emoticons in the conversation page, each candidate emoticon being made up of a plurality of parts;

a synthesizing unit configured to perform combining of parts in at least two candidate expression images in the plurality of candidate expression images to obtain a first expression image in a case where the at least two candidate expression images are selected;

and a transmitting unit configured to perform transmission of the first emoticon as a session message to the second user account.

In some embodiments, a message input box is displayed in the session page, the message input box being used for displaying a session message input by the first user account;

The synthesis unit includes:

a display subunit configured to perform a trigger operation in response to at least two candidate expression images among the plurality of candidate expression images, the at least two candidate expression images being displayed in the message input box;

and a synthesis subunit configured to perform combining of the parts in the at least two candidate expression images in the message input box to obtain the first expression image.

In some embodiments, the synthesizing subunit is configured to perform, when the at least two candidate images have been input in the message input box and no more expression image is input in the message input box within a preset period of time, respectively acquiring at least one part from the at least two input candidate images, where the parts provided in different candidate images are different; and combining the parts provided by the at least two candidate expression images to obtain the first expression image.

In some embodiments, a composition control is displayed in the conversation page, the composition control being used to compose together at least two emoticons entered by the user account;

The synthesis subunit is configured to perform a combination of the parts in the at least two candidate expression images in the message input box in response to a triggering operation on the synthesis control, so as to obtain the first expression image.

In some embodiments, the synthesizing subunit is configured to perform combining the parts in the at least two candidate images in the message input box to obtain a plurality of combined images, the parts in different combined images are not identical, and the plurality of combined images include the first image; and displaying the plurality of combined expression images.

In some embodiments, the synthesizing subunit is configured to perform, in synthesizing any one of the combined expression images, respectively acquiring each of the plurality of parts from the at least two candidate expression images in the message input box, where the parts provided in different candidate expression images are different; and combining the parts provided by the at least two candidate expression images to obtain the combined expression image.

In some embodiments, the synthesizing unit is configured to perform, when the number of candidate images in the message input box reaches a preset number, combining the parts in the preset number of candidate images in the message input box to obtain the first expression image, where the preset number of candidate images is a candidate image with a front input order or a candidate image with a rear input order.

In some embodiments, the display unit is further configured to perform displaying, in response to an image making operation, a composition panel in the conversation page, the composition panel being for composing together at least two emoticons selected by the user account, the composition panel having a plurality of image input boxes displayed therein, each for displaying one emoticon selected by the user account;

The synthesizing unit is further configured to perform a trigger operation for any one of the plurality of candidate expression images in response to any one of the plurality of candidate expression images in a case where the image input frame is selected, and display the candidate expression image in the image input frame; and combining the parts in the candidate expression images in the plurality of image input frames to obtain the first expression image.

In some embodiments, each image input box is used for extracting a part in the displayed candidate expression image, and the extracted parts of different image input boxes are different;

the display unit is configured to execute a trigger operation for any one of the plurality of image input frames, in response to the image input frame, in a case where the image input frame is used for extracting a target part in the displayed candidate expression images and the image input frame is selected, displaying the target part in the candidate expression images in the image input frame;

The display unit is configured to perform combination of the parts presented in the plurality of image input frames to obtain the first expression image.

In some embodiments, each image input box in the composite panel corresponds to an image selection control for randomly selecting one candidate emoticon from the plurality of candidate emoticons for the corresponding image input box;

the apparatus further comprises:

a selection unit configured to perform, for any one of the image input boxes in the composite panel, a random selection of one candidate expression image from the plurality of candidate expression images in response to a trigger operation of an image selection control corresponding to the image input box;

the display unit is further configured to perform display of the selected candidate expression image in the image input frame.

In some embodiments, a second emoticon sent by a second user account is displayed in the session page;

the display unit is further configured to perform a trigger operation for responding to the second expression image, and display an image making control in the conversation page, wherein the image making control is used for making an expression image with the same style as the second expression image; responding to the triggering operation of the image making control, and displaying a composite panel in the conversation page; displaying at least two candidate images used for synthesizing the second expression image in the synthesis panel;

The synthesizing unit is further configured to perform a new expression image based on at least two candidate images used for synthesizing the second expression image.

In some embodiments, the display unit is further configured to perform, after sending the first expression image, saving the first expression image in an expression panel of the conversation page, where the expression panel is used to store and display an expression image existing in the first user account, and the expression panel includes the plurality of candidate expression images.

According to another aspect of the embodiments of the present disclosure, there is provided an electronic device including:

One or more processors;

a memory for storing the processor-executable program code;

the processor is configured to execute the program code to implement the above-mentioned interactive method based on the expression image.

According to another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, which when executed by a processor of an electronic device, causes the electronic device to perform the above-described emoticon-based interaction method.

According to another aspect of the disclosed embodiments, a computer program product is provided, comprising a computer program/instruction which, when executed by a processor, implements the above-mentioned emoticon-based interaction method.

The embodiment of the disclosure provides an interaction method based on an expression image, wherein a conversation page of a first user account is displayed in the process of interaction between the first user account and any user account, a plurality of candidate expression images which can be sent in the process of user interaction are provided in the conversation page, the selected at least two candidate expression images can be synthesized into one expression image under the condition that the first user account selects the at least two candidate expression images, and the intention of the first user account can be accurately reflected by the at least two candidate expression images selected by the first user account, so that the synthesized image can also accurately reflect the intention of the first user account, and the synthesized expression images are used as conversation messages for interaction, thereby being beneficial to ensuring the accuracy of message transmission in the interaction process; moreover, the first user account can make new expression images through candidate expression images according to requirements to interact, so that the user account not only meets the intention of the user and meets the interaction requirements of the user, but also enriches interaction modes and interaction contents, and is beneficial to improving the interestingness of the interaction process, so that the interaction frequency among the users is improved; moreover, the first user account does not need to manually adjust the candidate expression images, so that the expression images meeting the user intention can be obtained, and the interaction efficiency can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and do not constitute an undue limitation on the disclosure.

Fig. 1 is a schematic view of an implementation environment of an interactive method based on an emoticon according to an exemplary embodiment.

Fig. 2 is a flowchart illustrating an interactive method based on an emoticon according to an exemplary embodiment.

Fig. 3 is a flowchart illustrating another emoticon-based interaction method, according to an exemplary embodiment.

FIG. 4 is a schematic diagram of a session page, shown according to an example embodiment.

Fig. 5 is a schematic diagram of a synthetic emoticon, according to an exemplary embodiment.

Fig. 6 is a schematic diagram of another synthetic expression image shown according to an example embodiment.

Fig. 7 is a schematic diagram of a composite panel, according to an example embodiment.

Fig. 8 is a schematic diagram of yet another synthetic expression image shown according to an exemplary embodiment.

FIG. 9 is a schematic diagram of another composite panel shown according to an exemplary embodiment.

FIG. 10 is a schematic diagram of an image selection control, according to an example embodiment.

FIG. 11 is a schematic diagram of an image production control, according to an example embodiment.

Fig. 12 is a schematic diagram of an expression panel shown according to an example embodiment.

Fig. 13 is a block diagram illustrating an interactive apparatus based on an emoticon according to an exemplary embodiment.

Fig. 14 is a block diagram illustrating a structure of a terminal according to an exemplary embodiment.

Detailed Description

In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

It should be noted that, the information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, presented data, etc.), and signals related to the present disclosure are all authorized by the user or are fully authorized by the parties, and the collection, use, and processing of relevant data is required to comply with relevant laws and regulations and standards of relevant countries and regions. For example, the images of expressions referred to in this disclosure are all acquired with sufficient authorization.

Fig. 1 is a schematic view of an implementation environment of an interactive method based on an emoticon according to an exemplary embodiment. Taking an example in which an electronic device is provided as a terminal, referring to fig. 1, the implementation environment specifically includes: a terminal 101 and a server 102.

The terminal 101 is at least one of a smart phone, a smart watch, a desktop computer, a laptop computer, an MP3 player, an MP4 player, and a laptop portable computer. The terminal 101 is installed and runs an application program supporting interaction, and a user can log in the application program through the terminal 101 to acquire services provided by the application program. The application may be a social class application, a multimedia class application, or a gaming class application, etc., to which embodiments of the present disclosure are not limited. The terminal 101 can be connected to the server 102 via a wireless network or a wired network, and further can transmit a session message (e.g., an emoticon) input by the user on the terminal 101 to the server 102, and the server 102 transmits the session message to terminals of other users designated by the terminal 101.

The terminal 101 refers broadly to one of a plurality of terminals, and this embodiment is illustrated with the terminal 101. Those skilled in the art will recognize that the number of terminals may be greater or lesser. For example, the number of the terminals may be several, or the number of the terminals may be tens or hundreds, or more, and the number and the device type of the terminals are not limited in the embodiments of the present disclosure.

Server 102 is at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. The server 102 can be connected to the terminal 101 and other terminals through a wireless network or a wired network, and the server 102 can receive the session message sent by the terminal 101 and send the received session message to the other terminals, so that the user can interact through the user of the other terminals. In some embodiments, the number of servers described above may be greater or lesser, and embodiments of the present disclosure are not limited in this regard. Of course, the server 102 also includes other functional servers to provide more comprehensive and diverse services.

Fig. 2 is a flowchart illustrating an interaction method based on an emoticon according to an exemplary embodiment, and referring to fig. 2, the interaction method based on an emoticon is applied to a terminal, and includes the following steps:

In step 201, the terminal displays a session page of the first user account and the second user account, where the session page is any one of a private chat page, a group chat page and a barrage display page.

In the embodiment of the disclosure, the terminal is a terminal controlled by the first user account. The first user account may interact with any other user account through the terminal. And in the interaction process of the first user account and the second user account, the terminal displays a conversation page of the first user account and the second user account. The first user account is able to send any session message to the second user account via the session page. The session message may be a text message or an emoticon, which is not limited by the embodiments of the present disclosure.

In the embodiment of the present disclosure, the second user account to be interacted with by the first user account may be a real person, or may be an artificial intelligent robot (such as a chat assistant), which is not limited in the embodiment of the present disclosure.

In step 202, in response to the first user account entering the conversation message, the terminal displays a plurality of candidate emoticons in a conversation page, each candidate emoticon being composed of a plurality of parts.

In an embodiment of the present disclosure, a plurality of candidate emoticons are included in a session page. The intent and mood of the user reflected by different candidate emoticons are different. The first user account can send the expression image to the second user account through the conversation page to interact.

The expression image sent by the first user account may be any one of a plurality of candidate expression images, or may be a new expression image synthesized based on any one of a plurality of candidate expression images, which is not limited in the embodiment of the present disclosure. The expression image may be an emoji expression package, or may be a gif expression package, which is not limited in the embodiment of the present disclosure.

Wherein, for any expression image, the part in the expression image can be eyes, mouth, facial outline (bottom outline) and carried decoration or action and the like in the face presented by the expression image; or the parts in the expression image can also be the background and the foreground in the expression image; or the parts in the emoticon may be various parts of the object presented in the emoticon (e.g., the doll's head and limbs, clothing, etc.), which are not limited by the embodiments of the disclosure.

In step 203, in the case that at least two candidate expression images of the plurality of candidate expression images are selected, the terminal combines the parts in the at least two candidate expression images to obtain a first expression image.

In the embodiment of the disclosure, in a case that at least two candidate expression images of the plurality of candidate expression images are selected by the first user account, the terminal synthesizes the selected at least two candidate expression images into the first expression image. The first expression image is a new expression image synthesized based on the candidate expression images. There are parts presented in the selected at least two candidate images in the first image. The style of the first emoticon includes the style of the selected at least two candidate emoticons. The embodiments of the present disclosure do not limit the number of candidate images participating in the synthesis of the first image.

In step 204, the terminal sends the first emoticon as a session message to the second user account.

In the embodiment of the disclosure, after synthesizing the first expression image, the terminal can display the first expression image in the conversation page to display the synthesized expression image to the first user account. The terminal may then send the first emoticon as a session message for the first user account to the user account with which the first user account is interacting. Then, after transmitting the first emoticon, the terminal displays the first emoticon in a session area in the session page. The embodiment of the present disclosure does not limit the display position of the first expression image. The session area in the session page is used for displaying session messages between user accounts.

In some embodiments, a message input box is displayed in the session page, the message input box being for displaying a session message entered by the first user account;

combining the parts in at least two candidate expression images under the condition that at least two candidate expression images in a plurality of candidate expression images are selected to obtain a first expression image, wherein the method comprises the following steps:

Displaying at least two candidate images in a message input box in response to a trigger operation on at least two candidate images in the plurality of candidate images;

and combining the parts in at least two candidate expression images in the message input box to obtain a first expression image.

According to the scheme provided by the embodiment of the disclosure, the conversation message in the message input box is the actively input message of the first user account, so that the intention of the first user account can be accurately reflected, and the intention of the first user account can be accurately reflected by synthesizing at least two candidate expression images in the message input box into the first expression image, so that the intention of the first user account can be accurately reflected by the synthesized first expression image, the accuracy of message transmission in the interaction process is guaranteed, the interaction mode and the interaction content are enriched, and the interestingness and the interaction frequency of the interaction process are improved.

In some embodiments, combining the parts in the at least two candidate images in the message input box to obtain a first image comprises:

under the condition that at least two candidate expression images are input in a message input box and any expression image is not input in the message input box within a preset time period, respectively acquiring at least one part from the at least two input candidate expression images, wherein the parts provided in different candidate expression images are different;

And combining the parts provided by the at least two candidate expression images to obtain a first expression image.

According to the scheme provided by the embodiment of the disclosure, under the condition that any expression image is not input in the message input box within the preset time period, the content to be input by the first user account is described to be completed, and under the condition, at least two candidate expression images input in the message input box are automatically synthesized into the first expression image, and the user operation is not needed, so that more interesting expression images can be obtained relatively quickly, and the interaction efficiency is improved.

Combining the parts in at least two candidate expression images in the message input box to obtain a first expression image, wherein the method comprises the following steps:

and responding to the triggering operation of the synthesis control, and combining the parts in at least two candidate expression images in the message input box to obtain a first expression image.

According to the scheme provided by the embodiment of the disclosure, through the synthesis control, the first user account can autonomously control whether at least two input candidate expression images are synthesized into the first expression image, so that the intention of the first user account is met, the operation is simple, the synthesis operation is not needed under the condition that the first user account does not want to be synthesized, and the running consumption can be reduced.

Combining parts in at least two candidate expression images in the message input frame to obtain a plurality of combined expression images, wherein the parts in different combined expression images are not completely identical, and the plurality of combined expression images comprise a first expression image;

and displaying a plurality of combined expression images.

According to the scheme provided by the embodiment of the disclosure, at least two candidate expression images are synthesized into a plurality of combined expression images, the positions presented in different combined expression images are not identical, and the synthesis condition of the expression images is displayed to the first user account by displaying the plurality of combined expression images, so that the first user account can select a proper combined expression image according to the self requirement, and the user intention is met.

In some embodiments, combining the parts in the at least two candidate images in the message input box to obtain a plurality of combined images comprises:

in the process of synthesizing any combined expression image, respectively acquiring each part in a plurality of parts from at least two candidate expression images in a message input box, wherein the parts provided in different candidate expression images are different;

and combining the parts provided by the at least two candidate expression images to obtain a combined expression image.

According to the scheme provided by the embodiment of the disclosure, in the process of synthesizing any combined expression image, each part is obtained from different candidate expression images in the message input frame so as to be fused into the combined expression image, the patterns of the expression images are enriched, the first user account can select a proper part from the candidate expression images according to requirements to manufacture a new expression image, the interest in the interaction process is improved, the interaction frequency between the user accounts is improved, the combined expression image can display the parts in the candidate expression images input by the first user account, the intention of the first user account is accurately reflected, and the accuracy of message transmission in the interaction process is ensured.

and under the condition that the number of candidate expression images in the message input frame reaches the preset number, combining the parts in the preset number of candidate expression images in the message input frame to obtain a first expression image, wherein the preset number of candidate expression images are candidate expression images with the front input sequence or candidate expression images with the rear input sequence.

According to the scheme provided by the embodiment of the disclosure, under the condition that the candidate expression images selected by the user are enough, the preset number of candidate expression images are selected to synthesize the first expression image, so that the first expression image synthesized is prevented from being disordered due to the fact that the number of candidate expression images participating in synthesis is large, and the excessive running consumption of the synthesis process can be avoided; and because the candidate expression images with the rear input sequence are the candidate expression images which are newly input by the first user account, the latest intention of the first user account can be reflected, and the candidate expression images with the rear input sequence are selected for synthesis, so that the first expression images can reflect the latest intention of the first user account, and the accuracy of message transmission in the interaction process can be guaranteed.

In some embodiments, the method further comprises:

responding to image making operation, displaying a synthesis panel in a conversation page, wherein the synthesis panel is used for synthesizing at least two expression images selected by a user account, a plurality of image input boxes are displayed in the synthesis panel, and each image input box is used for displaying one expression image selected by the user account;

combining the parts in the selected at least two candidate expression images to obtain a first expression image under the condition that the at least two candidate expression images in the plurality of candidate expression images are selected, wherein the method comprises the following steps:

for any one of the plurality of image input boxes, in response to a trigger operation for any one of the plurality of candidate expression images in a case where the image input box is selected, displaying the candidate expression image in the image input box;

and combining the parts in the candidate expression images in the image input frames to obtain a first expression image.

According to the scheme provided by the embodiment of the disclosure, a user can manufacture the expression images through the synthesis panel, the synthesis panel comprises a plurality of image input frames, each candidate expression image is selected by the user, the candidate expression images can be displayed in the image input frames, namely, each candidate expression image selected by the user can be respectively displayed in the plurality of image input frames, so that the plurality of candidate expression images to be synthesized can be intuitively displayed for the user, and as the expression images in the image input frames are messages actively input by the user, the intention of the user can be accurately reflected, and the candidate expression images in the plurality of image input frames are synthesized into the first expression image, so that the intention of the first user account can be accurately reflected by the synthesized first expression image, the accuracy of message transmission in the interaction process is guaranteed, the interaction mode and the interaction content are enriched, and the interest of the interaction process is promoted.

For any one of the plurality of image input boxes, in response to a trigger operation for any one of the plurality of candidate expression images in a case where the image input box is selected, displaying the candidate expression image in the image input box, comprising:

For any one of the plurality of image input frames, in a case where the image input frame is used to extract a target portion in the accommodated candidate expression images and the image input frame is selected, displaying the target portion in the candidate expression images in the image input frame in response to a trigger operation for any one of the plurality of candidate expression images;

combining parts in candidate expression images in a plurality of image input frames to obtain a first expression image, wherein the method comprises the following steps:

And combining the parts presented in the image input boxes to obtain a first expression image.

According to the scheme provided by the embodiment of the disclosure, the parts in the candidate expression images extracted by different image input frames are different, and a user can input the candidate expression images into the corresponding image input frames according to the functions of each image input frame so as to extract the required parts, so that the requirements of the user on the expression images can be met, and the operation is simple and convenient to control; and, by displaying the extracted corresponding parts in the image input box, a plurality of parts to be synthesized can be intuitively displayed to the user, so that the user can adjust the unsatisfactory parts.

In some embodiments, each image input box in the composite panel corresponds to an image selection control for randomly selecting one candidate emoticon from a plurality of candidate emoticons for the corresponding image input box;

The method further comprises the steps of:

For any image input box in the composite panel, responding to the triggering operation of an image selection control corresponding to the image input box, and randomly selecting one candidate expression image from a plurality of candidate expression images;

the selected candidate expression image is displayed in the image input box.

According to the scheme provided by the embodiment of the disclosure, for any image input frame, through the image selection control, one candidate expression image can be randomly selected for the image input frame, user selection is not needed, randomness of the synthesized expression image is increased, patterns and interaction modes of the expression image are enriched, the interaction interestingness and the expression synthesis efficiency are improved, and the interaction requirement of a user is met.

In some embodiments, a second expressive image sent by a second user account is displayed in the conversation page;

The method further comprises the steps of:

Responding to the triggering operation of the second expression image, displaying an image making control in the conversation page, wherein the image making control is used for making the expression image with the same style as the second expression image;

Responding to the triggering operation of the image making control, and displaying a composite panel in the conversation page;

Displaying at least two candidate images used for synthesizing the second expression image in the synthesis panel;

And based on at least two candidate images used for synthesizing the second expression image, a new expression image is produced.

According to the scheme provided by the embodiment of the disclosure, as the second expression image sent by the second user account is easier to attract the attention of the second user account, the synthesis panel can also display at least two candidate images used for synthesizing the second expression image like the first user account through the image preparation control, so that the first user account can know the source of the second expression image, and the expression image with the same style can be prepared according to the second expression image sent by the second user account, so that the interestingness of the interaction process can be improved, the prepared expression image is more in line with the interests of the other user, resonance is easier to be caused, and the interaction frequency among users is improved.

In some embodiments, the method further comprises:

After the first expression image is sent, the first expression image is stored in an expression panel of the conversation page, wherein the expression panel is used for storing and displaying the existing expression image of the first user account, and the expression panel comprises a plurality of candidate expression images.

According to the scheme provided by the embodiment of the disclosure, for the synthesized expression image (first expression image) used by the user in the interaction process, the synthesized expression image can be stored in the existing expression image, and the synthesized expression image is displayed in the expression panel, so that the user can conveniently and directly use the synthesized expression image without repeated synthesis, and the efficiency of multiplexing the expression image by the user can be improved.

The foregoing fig. 2 is merely a basic flow of the disclosure, and the scheme provided in the disclosure is further described below based on a specific implementation, and fig. 3 is a flowchart of another interaction method based on an emoticon according to an exemplary embodiment. Taking an example in which an electronic device is provided as a terminal, see fig. 3, the method comprises:

In step 301, the terminal displays a session page of the first user account and the second user account, where the session page is any one of a private chat page, a group chat page and a barrage display page.

In the embodiment of the present disclosure, the session page may be a private chat interface between the first user account and the second user account, a group chat interface between the first user account and other multiple user accounts (including the second user account), a comment area interface capable of interacting with other user accounts, or an interface capable of presenting a bullet screen, etc., which is not limited in the embodiment of the present disclosure. That is, the interaction method based on the expression image provided by the embodiment of the present disclosure may be applied to a private chat scene, a group chat scene, an interaction scene capable of sending comments or a barrage, and the like, which is not limited in the embodiment of the present disclosure.

In the interaction process of the first user account and the second user account, the terminal displays a session page between the first user account and the second user account, and sends a session message to the second user account through the session page.

In step 302, a plurality of candidate emoticons, each composed of a plurality of parts, are displayed in a conversation page in response to a first user account entering a conversation message.

In an embodiment of the disclosure, in response to the first user account entering a conversation message in a conversation page, the terminal displays an expression panel in the conversation page. The expression panel displays a plurality of candidate expression images. The first user account may send any candidate emoticons to the second user account for interaction.

For example, FIG. 4 is a schematic diagram of a session page shown in accordance with an exemplary embodiment. Referring to fig. 4, the session page shown in fig. 4 is a session page between a first user account and a second user account. The session page includes a session area 401 and an operation area 402. The session area 401 is used to present session messages between a first user account and a second user account. The conversation message may be an emoticon or a text message, which is not limited by the embodiments of the present disclosure. In the session area 401, a avatar 403 of the first user account and an avatar 404 of the second user account are displayed. The expression image near each head portrait is the conversation message sent by the corresponding user account. Also displayed in the session area 401 is a message input box 405. The message input box 405 is used to accommodate the session message entered by the first user account. The operation area 402 is a manipulation area when the first user account inputs a session message. The operating area 402 may have displayed therein a virtual keyboard for providing a means for entering text messages for the first user account; a plurality of candidate emoticons (emoticons) may also be displayed for providing a reference to the image message for the first user account. An expression control 406 and a send control 407 are displayed in the message input box 405. The emoticons 406 are used to switch the virtual keyboard in the operating area 402 to a plurality of candidate emoticons. The send control 407 is used to trigger the post-send of the session message in the message input box 405 to the interactive object (second user account). The candidate expression image may be, in addition to the emoji expression package shown in fig. 4, an expression package in gif format, which is not limited in the embodiment of the present disclosure.

In the case where the session message to be transmitted by the first user account is a candidate emoticon, the terminal may directly transmit the candidate emoticon selected (input) by the first user account to the second user account. Or the terminal may further synthesize a plurality of candidate expression images selected by the first user account together, and send the synthesized expression image to the second user account, which is not limited in the embodiment of the present disclosure. Wherein "plurality" refers to two and more.

In some embodiments, a message input box is displayed in the conversation page. The message input box is used for displaying the session message input by the first user account. The terminal can use the candidate expression images input in the message input box as the expression images selected by the first user account, so that the parts in the selected expression images are combined. Please refer to the content of step 303.

In other embodiments, the first user account may also be emoticons through a composite panel. In response to the image production operation, the terminal displays a composite panel in the session page. The composition panel is used for compositing at least two expression images selected by a user together. A plurality of image input boxes are displayed in the composite panel. Each image input box is used for displaying one expression image selected by a user. That is, the terminal may combine the candidate emoticons inputted in the plurality of image input boxes as the emoticons selected by the first user account, thereby combining the parts in the selected emoticons. Please refer to the content of step 304.

In step 303, in response to a trigger operation on at least two candidate images among the plurality of candidate images, the terminal displays the at least two candidate images in a message input box; and combining the parts in at least two candidate expression images in the message input box to obtain a first expression image.

In the embodiment of the present disclosure, for any one of a plurality of candidate images, in case the candidate image is triggered (e.g., clicked), the terminal displays the candidate image in a message input box. And under the condition that at least two candidate expression images appear in the message input box, the terminal combines the parts in the at least two candidate expression images in the message input box to obtain a first expression image. According to the scheme provided by the embodiment of the disclosure, the conversation message in the message input box is the actively input message of the first user account, so that the intention of the first user account can be accurately reflected, and the intention of the first user account can be accurately reflected by synthesizing at least two candidate expression images in the message input box into the first expression image, so that the intention of the first user account can be accurately reflected by the synthesized first expression image, the accuracy of message transmission in the interaction process is guaranteed, the interaction mode and the interaction content are enriched, and the interestingness and the interaction frequency of the interaction process are improved.

For example, fig. 5 is a schematic diagram of a synthetic expression image, according to an exemplary embodiment. Referring to fig. 5, a first user account inputs a candidate emoticon 502 and a candidate emoticon 503 in a message input box 501. The terminal synthesizes the candidate expression image 502 and the candidate expression image 503 to obtain a first expression image 504. The first emoticon 504 is located at an upper layer of the conversation area to present the composite effect to the first user account.

In the embodiment of the disclosure, the terminal can automatically synthesize at least two candidate expression images selected by the first user account; or the synthesis process of the candidate expression can also be controlled by a control, etc., which is not limited by the embodiment of the present disclosure.

In some embodiments, the terminal automatically synthesizes at least two candidate images of the expression selected by the first user account. Correspondingly, the process of combining the parts in at least two candidate expression images in the message input box by the terminal to obtain the first expression image comprises the following steps: under the condition that at least two candidate expression images are input in the message input box and any expression image is not input in the message input box within a preset time period, the terminal respectively acquires at least one part from the at least two input candidate expression images. The different candidate images provide different locations. And then, the terminal combines the parts provided by the at least two candidate expression images to obtain a first expression image. The preset period of time may be 1 second or 2 seconds, which is not limited in the embodiment of the present disclosure. According to the scheme provided by the embodiment of the disclosure, under the condition that any expression image is not input in the message input box within the preset time period, the content to be input by the first user account is described to be completed, and under the condition, at least two candidate expression images input in the message input box are automatically synthesized into the first expression image, and the user operation is not needed, so that more interesting expression images can be obtained relatively quickly, and the interaction efficiency is improved.

In some embodiments, the synthesis process of the candidate expression is manipulated by a control. And the session page is displayed with a composite control. The composition control is used for compositing at least two emoticons input by the user account together. Correspondingly, the process of combining the parts in at least two candidate expression images in the message input box by the terminal to obtain the first expression image comprises the following steps: and responding to the triggering operation of the synthesis control, and combining the parts in at least two candidate expression images in the message input box by the terminal to obtain a first expression image. The composition control may be displayed at any location in the conversation page, which is not limited by the disclosed embodiments. According to the scheme provided by the embodiment of the disclosure, through the synthesis control, the first user account can autonomously control whether at least two input candidate expression images are synthesized into the first expression image, so that the intention of the first user account is met, the operation is simple, the synthesis operation is not needed under the condition that the first user account does not want to be synthesized, and the running consumption can be reduced.

In the embodiment of the present disclosure, in the process of synthesizing at least two candidate expression images, the terminal may synthesize only the at least two candidate expression images into one expression image; or the terminal may further synthesize at least two candidate emoticons into a plurality of emoticons, which are not limited in the embodiments of the present disclosure. That is, in the process of synthesizing the emoticons, the terminal can synthesize a plurality of different emoticons for the first user account to select.

In some embodiments, the terminal synthesizes the at least two candidate emoticons into a plurality of emoticons for selection by the first user account. Correspondingly, the process of combining the parts in at least two candidate expression images in the message input box by the terminal to obtain the first expression image comprises the following steps: the terminal combines the parts in at least two candidate expression images in the message input frame to obtain a plurality of combined expression images. The parts in the different combined expression images are not identical. The plurality of combined emoticons includes a first emoticon. Then, the terminal displays a plurality of combined emoticons. According to the scheme provided by the embodiment of the disclosure, at least two candidate expression images are synthesized into a plurality of combined expression images, the positions presented in different combined expression images are not identical, and the synthesis condition of the expression images is displayed to the first user account by displaying the plurality of combined expression images, so that the first user account can select a proper combined expression image according to the self requirement, and the user intention is met.

In the process of synthesizing any combined expression image, the terminal can respectively acquire each of a plurality of parts from at least two candidate expression images in the message input box. The locations provided in the different candidate images are different. And the terminal combines the parts provided by the at least two candidate expression images to obtain a combined expression image. According to the scheme provided by the embodiment of the disclosure, in the process of synthesizing any combined expression image, each part is obtained from different candidate expression images in the message input frame so as to be fused into the combined expression image, the patterns of the expression images are enriched, the first user account can select a proper part from the candidate expression images according to requirements to manufacture a new expression image, the interest in the interaction process is improved, the interaction frequency between the user accounts is improved, the combined expression image can display the parts in the candidate expression images input by the first user account, the intention of the first user account is accurately reflected, and the accuracy of message transmission in the interaction process is ensured.

For example, fig. 6 is a schematic diagram of another synthetic expression image shown according to an exemplary embodiment. Referring to fig. 6, a first user account inputs a candidate emoticon 602 and a candidate emoticon 603 in a message input box 601. The terminal synthesizes the candidate expression image 602 and the candidate expression image 603 to obtain a combined expression image 604 and a combined expression image 605. As shown in fig. 6, the eye part in the combined expression image 604 is from the candidate expression image 603, and the mouth part in the combined expression image 604 is from the candidate expression image 602; the eye parts in the combined image 605 are from the candidate image of expression 602, and the mouth parts in the combined image 605 are from the candidate image of expression 603. The bottom outline in the combined expression image 604 and the combined expression image 605 is the bottom outline of any one of the candidate expression image 602 and the candidate expression image 603. That is, the terminal performs image synthesis according to the mouth portion of the candidate expression image 602, the eye portion of the candidate expression image 603, and the bottom contour of any one of the candidate expression images 602 and 603, to obtain the combined expression image 604. The terminal performs image synthesis according to the eye part of the candidate expression image 602, the mouth part of the candidate expression image 603, and the bottom contour of any one of the candidate expression image 602 and the candidate expression image 603, to obtain a combined expression image 605. If the candidate expression image includes an action (e.g., "kiss") or a decoration (e.g., "mask"), the synthesized combined image may also include the action or decoration in the candidate expression image, which is not limited by the embodiments of the disclosure. And under the condition that the first user account triggers any combined expression image, the terminal sends the combined expression image to the second user account. The terminal displays the combined expression image in the form of a conversation message in a conversation area of the conversation page.

In the case of synthesizing a plurality of combined emoticons, the terminal may only exemplarily show a part of the combined emoticons due to the size limitation of the screen of the terminal. In response to a sliding operation of the displayed combined expression image, the terminal displays more combined images.

The embodiment of the disclosure can limit the number of candidate expression images participating in synthesis. Correspondingly, the process of combining the parts in at least two candidate expression images in the message input box by the terminal to obtain the first expression image comprises the following steps: and under the condition that the number of the candidate expression images in the message input box reaches the preset number, combining the positions in the candidate expression images with the preset number in the message input box to obtain a first expression image. The preset number of candidate expression images are candidate expression images with the front input sequence or candidate expression images with the rear input sequence. The preset number is the maximum number of candidate expression images participating in the composition, and the embodiment of the present disclosure does not limit the preset number. According to the scheme provided by the embodiment of the disclosure, under the condition that the candidate expression images selected by the user are enough, the preset number of candidate expression images are selected to synthesize the first expression image, so that the first expression image synthesized is prevented from being disordered due to the fact that the number of candidate expression images participating in synthesis is large, and the excessive running consumption of the synthesis process can be avoided; and because the candidate expression images with the rear input sequence are the candidate expression images which are newly input by the first user account, the latest intention of the first user account can be reflected, and the candidate expression images with the rear input sequence are selected for synthesis, so that the first expression images can reflect the latest intention of the first user account, and the accuracy of message transmission in the interaction process can be guaranteed.

Wherein, the style (form) of the combined expression image is the same as that of the candidate expression image, and the combined expression image and the candidate expression image are provided with a preset number of parts. Alternatively, the preset number may be equal to the total number of parts in the candidate image. That is, the combined expression image has limited parts, and for each candidate expression image participating in synthesis, the terminal acquires at least one part from the candidate expression image; and, the terminal acquires different parts from different candidate expression images to form a combined expression image. The terminal acquires the preset number of parts at most, so that the terminal acquires the parts from the preset number of candidate expression images at most. That is, the number of candidate expression images participating in the synthesis is a preset number at maximum. When the number of candidate emoticons inputted by the first user account exceeds the preset number, the terminal may synthesize using the latest (last) inputted preset number of candidate emoticons.

In step 304, for any one of the plurality of image input frames, in response to a trigger operation for any one of the plurality of candidate expression images in the case where the image input frame is selected, the terminal displays the candidate expression image in the image input frame; and combining the parts in the candidate expression images in the image input frames to obtain a first expression image.

In the embodiment of the present disclosure, a plurality of image input boxes are displayed in a composition panel for composing an expression image. The plurality of image input boxes are used for respectively bearing candidate expression images participating in synthesis. The number of image input boxes may be equal to a preset number, avoiding the first user account from inputting redundant candidate emoticons. In a case where any one of the plurality of image input frames is selected, the terminal displays the selected candidate expression image in the image input frame in response to a selection operation of any one of the candidate expression images. The selection operation may be a click operation on the candidate expression image, or dragging the candidate expression image into a corresponding image input box, which is not limited in the embodiment of the present disclosure. Then, the terminal synthesizes the candidate expression images in the plurality of image input frames to obtain a first expression image. According to the scheme provided by the embodiment of the disclosure, a user can manufacture the expression images through the synthesis panel, the synthesis panel comprises a plurality of image input frames, each candidate expression image is selected by the user, the candidate expression images can be displayed in the image input frames, namely, each candidate expression image selected by the user can be respectively displayed in the plurality of image input frames, so that the plurality of candidate expression images to be synthesized can be intuitively displayed for the user, and as the expression images in the image input frames are messages actively input by the user, the intention of the user can be accurately reflected, and the candidate expression images in the plurality of image input frames are synthesized into the first expression image, so that the intention of the first user account can be accurately reflected by the synthesized first expression image, the accuracy of message transmission in the interaction process is guaranteed, the interaction mode and the interaction content are enriched, and the interest of the interaction process is promoted.

For example, fig. 7 is a schematic diagram of a composite panel shown according to an exemplary embodiment. Referring to (a) of fig. 7, the terminal displays an expression collection panel 701 in a conversation page. The expression collection panel 701 is used to store an expression image specified by the first user account. For example, gif1, gif2, and gif3 are gif expression packages for the first user account collection. The expression collection panel displays an expression collection control 702 and an expression synthesis control 703. The expression collection control 702 is used to store an emoticon designated by the first user account in the expression collection panel 701. The expression composition control 703 is used to compose an expression image already owned by the first user account to make a new expression image. In response to the triggering operation of the expression composition control 703, the terminal displays a composition panel in the session page, please refer to (b) in fig. 7. The composite panel includes a presentation area 704 and a composite area 705. The display area 704 is used to display a plurality of candidate emoticons for the first user account. The candidate expression image may be an emoji expression package or a gif expression package. An emoji expression control and a gif expression control are displayed in the display area 704. In case any of the expression controls is triggered, the terminal displays a candidate expression image (expression package) of a corresponding type in the presentation area 704. A plurality of image input boxes are displayed in the composition area 705, and the number of image input boxes is not limited by the embodiment of the present disclosure. In a case where any one of the image input boxes is selected, the terminal displays the selected candidate expression image in the image input box in response to a selection operation of any one of the candidate expression images. Then, the terminal synthesizes the candidate expression images in the plurality of image input frames to obtain a first expression image. The terminal may display the first emoticon in the composition area to display the composition effect to the first user account. A determination control 706 is displayed under the first emoticon. In response to a trigger operation to the determination control 706, the terminal determines the first emoticon as a session message for the first user account, and then sends the first emoticon to the second user account.

In the embodiment of the disclosure, in the composition panel, the terminal may automatically compose at least two candidate expression images selected by the first user account; or the synthesis process of the candidate expression can also be controlled by a control, etc., which is not limited by the embodiment of the present disclosure. Wherein the number of image input boxes is not less than the number of candidate expressions selected by the first user account. That is, the number of candidate expressions selected by the first user account may not necessarily occupy all of the image input boxes. Under the number of the image input boxes, the first user account can select a corresponding number of candidate expression images according to the self-demand. In other words, some image input boxes may be empty in the process of synthesizing the emoticons.

In some embodiments, in a case that candidate expression images exist in two image input frames among the plurality of image input frames, if any expression image is not input in the remaining image input frames within a preset period of time, the terminal synthesizes the input candidate expression images to obtain a first expression image. According to the method, at least two candidate expression images input in the image input frame are automatically synthesized into the first expression image, user operation is not needed, more interesting expression images can be obtained quickly, and therefore interaction efficiency is improved.

In other embodiments, a composition control is displayed in the composition panel. The composition control is used for compositing at least two emoticons input by the user account together. And responding to the triggering operation of the synthesis control, and synthesizing at least two candidate expression images in the plurality of image input frames by the terminal to obtain a first expression image. According to the method, whether the first user account synthesizes the input at least two candidate expression images into the first expression image or not can be automatically controlled through the synthesis control, the intention of the first user account is met, the operation is simple, the synthesis operation is not needed under the condition that the first user account does not want to be synthesized, and the running consumption can be reduced.

In the embodiment of the present disclosure, in the process of synthesizing at least two candidate expression images in the synthesis panel, the terminal may synthesize only the at least two candidate expression images into one expression image (see fig. 7); or the terminal may further synthesize at least two candidate emoticons into a plurality of emoticons, which are not limited in the embodiments of the present disclosure. That is, in the process of synthesizing the emoticons, the terminal can synthesize a plurality of different emoticons for the first user account to select. For example, fig. 8 is a schematic diagram showing still another synthetic expression image according to an exemplary embodiment. Referring to fig. 8, the terminal synthesizes at least two candidate expression images to obtain a combined expression image 1, a combined expression image 2, and a combined expression image 3. The combined expression images can be displayed in a sliding way. In response to a sliding operation of the combined emoticon, the terminal enlarges and displays the combined emoticon slid to the middle of the screen. And responding to the triggering operation of the determining control, enabling the terminal to take the combined expression image in the middle of the screen as a first expression image, and then sending the first expression image to a second user account.

In some embodiments, each image input box is used to extract a location in the displayed candidate emoticon. The extracted parts of different image input boxes are different. Accordingly, for any one of the plurality of image input frames, in a case where the image input frame is used to extract a target portion in the accommodated candidate expression image and the image input frame is selected, the terminal displays the target portion in the candidate expression image in the image input frame in response to a trigger operation for any one of the plurality of candidate expression images. Then, the terminal combines parts among the parts presented in the plurality of image input boxes to obtain a first expression image. According to the scheme provided by the embodiment of the disclosure, the parts in the candidate expression images extracted by different image input frames are different, and a user can input the candidate expression images into the corresponding image input frames according to the functions of each image input frame so as to extract the required parts, so that the requirements of the user on the expression images can be met, and the operation is simple and convenient to control; and, through displaying the extracted corresponding parts in the image input frame, a plurality of parts to be synthesized are intuitively displayed to the user, so that the user can adjust the unsatisfactory parts.

For example, fig. 9 is a schematic diagram of another composite panel shown according to an example embodiment. Referring to fig. 9, a plurality of image input boxes are used to extract the bottom outline (facial outline), eye part, mouth part, and motion or decoration, etc. of the expression image, respectively. And the terminal synthesizes the parts presented in the plurality of image input boxes to obtain a first expression image.

In some embodiments, each image input box in the composite panel corresponds to an image selection control. The image selection control is used for randomly selecting one candidate expression image from a plurality of candidate expression images for the corresponding image input frame. Correspondingly, for any image input box in the composite panel, responding to the triggering operation of the image selection control corresponding to the image input box, and randomly selecting one candidate expression image from a plurality of candidate expression images by the terminal. Then, the terminal displays the selected candidate expression image in the image input box. According to the scheme provided by the embodiment of the disclosure, for any image input frame, through the image selection control, one candidate expression image can be randomly selected for the image input frame, user selection is not needed, randomness of the synthesized expression image is increased, patterns and interaction modes of the expression image are enriched, the interaction interestingness and the expression synthesis efficiency are improved, and the interaction requirement of a user is met.

For example, FIG. 10 is a schematic diagram of an image selection control, shown in accordance with an exemplary embodiment. Referring to fig. 10, there is one image selection control for each image input box. In response to a trigger operation of the image selection control 1001, the terminal randomly selects one candidate expression image from among a plurality of candidate expression images, and displays the candidate expression image in the image input frame 1.

In step 305, the terminal sends the first emoticon as a session message to the second user account.

In the embodiment of the disclosure, after synthesizing the first expression image, the terminal can display the first expression image in the conversation page to display the synthesized expression image to the first user account. The terminal may then send the first emoticon as a session message for the first user account to a second user account with which the first user account is interacting. Then, after transmitting the first emoticon, the terminal displays the first emoticon in a session area in a session page in the form of a session message.

In some embodiments, the first user account may mimic the emoticon sent by the interactive object (e.g., the second user account) to produce the same type of emoticon. And displaying a second expression image sent by the second user account in the conversation page. The second user account is an object that interacts with the first user account. Correspondingly, responding to the triggering operation of the second expression image, and displaying an image making control in the conversation page by the terminal. The image making control is used for making the expression image with the same style as the second expression image. Then, in response to a triggering operation of the image production control, the terminal displays a composite panel in the conversation page. The terminal displays at least two candidate images used for synthesizing the second expression image in the synthesis panel. The terminal creates a new expression image based on at least two candidate images used to synthesize the second expression image. According to the scheme provided by the embodiment of the disclosure, as the second expression image sent by the second user account (the interaction object) is easier to attract the attention of the second user account, the synthesis panel can also display at least two candidate images used for synthesizing the second expression image like the first user account through the image making control, so that the first user account can know the source of the second expression image, and the expression image with the same style can be made according to the second expression image sent by the second user account, so that the interest of the interaction process can be improved, the made expression image is more in line with the interest of the interaction object, resonance of the interaction object is easier to be caused, and the interaction frequency among users is improved.

For example, FIG. 11 is a schematic diagram of an image production control, shown according to an exemplary embodiment. Referring to fig. 11, in the session page, a avatar 1101 of a first user account and a avatar 1102 of a second user account are displayed. The message near the head portrait of each user account is the session message (emoticon) sent by the user account. In the case of long pressing of the second expression image sent by the second user account, the terminal displays an operation panel 1103 of the second expression image in the conversation page. An image production control 1104 is displayed on the operation panel 1103. In the event that the image production control 1004 is triggered, the terminal displays a composite panel in the session page (see fig. 8 or 9). The terminal displays at least two candidate images used for synthesizing the second expression image in the synthesis panel. The terminal creates a new expression image based on at least two candidate images used to synthesize the second expression image. The operations panel 1103 may also display an add control 1105, a forward control 1106, a reply control 1107, a delete control 1108, and the like, which are not limited by the embodiments of the present disclosure. The add control 1105 is used to save the second emoji image. The forwarding control 1106 is used to forward the second emoji image to other user accounts than the second user account. The reply control 1107 is used to reply to the second emoticon of the second user account. The delete control 1108 is used to delete the second emoticon. After the second emoticon is deleted, it will not be displayed in the conversation page.

In some embodiments, after sending the first emoticon, the terminal saves the first emoticon in an emoticon panel of the conversation page. The expression panel is used for storing and displaying the existing expression images of the first user account. The expression panel comprises a plurality of candidate expression images. According to the scheme provided by the embodiment of the disclosure, for the synthesized expression image (first expression image) used by the user in the interaction process, the synthesized expression image can be stored in the existing expression image, and the synthesized expression image is displayed in the expression panel, so that the user can conveniently and directly use the synthesized expression image without repeated synthesis, and the efficiency of multiplexing the expression image by the user can be improved.

For example, fig. 12 is a schematic diagram of an expression panel shown according to an example embodiment. Referring to fig. 12, the terminal displays an expression panel 1201 in a conversation page. The expression panel 1201 displays therein all the expression images (including a plurality of candidate expression images) already possessed by the first user account. After transmitting the first emoticon 1202, the terminal displays the first emoticon 1202 in an emoticon 1201 of the conversation page.

Any combination of the above-mentioned optional solutions may be adopted to form an optional embodiment of the present disclosure, which is not described herein in detail.

Fig. 13 is a block diagram illustrating an interactive apparatus based on an emoticon according to an exemplary embodiment. Referring to fig. 13, the apparatus includes: a display unit 1301, a synthesizing unit 1302, and a transmitting unit 1303.

A display unit 1301 configured to perform displaying a session page of the first user account and the second user account, where the session page is any one of a private chat page, a group chat page, and a bullet screen display page; in response to the first user account entering a conversation message, displaying a plurality of candidate emoticons in a conversation page, each candidate emoticon being composed of a plurality of parts;

A synthesizing unit 1302 configured to perform, in a case where at least two candidate expression images of the plurality of candidate expression images are selected, combining the parts in the at least two candidate expression images to obtain a first expression image;

And a transmitting unit 1303 configured to perform transmitting the first expression image as a session message to the second user account.

The synthesizing unit 1302 includes:

A display subunit configured to perform a trigger operation in response to at least two candidate expression images among the plurality of candidate expression images, to display the at least two candidate expression images in the message input box;

and the synthesis subunit is configured to perform combination of the parts in the at least two candidate expression images in the message input box to obtain a first expression image.

In some embodiments, the synthesizing subunit is configured to perform, when at least two candidate images have been input in the message input box and no more expression image has been input in the message input box within a preset period of time, respectively acquiring at least one part from the at least two input candidate images, where the provided parts provided in different candidate images are different; and combining the parts provided by the at least two candidate expression images to obtain a first expression image.

And the synthesis subunit is configured to perform the combination of the parts in at least two candidate expression images in the message input box in response to the triggering operation of the synthesis control, so as to obtain a first expression image.

In some embodiments, the composition subunit is configured to perform combining the parts in the at least two candidate expression images in the message input box to obtain a plurality of combined expression images, the parts in different combined expression images are not identical, and the plurality of combined expression images comprise the first expression image; and displaying a plurality of combined expression images.

In some embodiments, each candidate expression image is composed of a plurality of parts;

A synthesizing subunit configured to perform, in synthesizing any one of the combined expression images, respectively acquiring, from at least two candidate expression images in the message input frame, each of a plurality of parts, the parts provided in the different candidate expression images being different; and combining the parts provided by the at least two candidate expression images to obtain a combined expression image.

In some embodiments, the synthesizing unit 1302 is configured to perform combining the parts in the preset number of candidate images in the message input box to obtain the first expression image when the number of candidate images in the message input box reaches the preset number, where the preset number of candidate images is the candidate image with the front input order or the candidate image with the rear input order.

In some embodiments, the display unit 1301 is further configured to perform displaying, in response to the image making operation, a composite panel in the conversation page, the composite panel being used for compositing together at least two expression images selected by the user account, the composite panel having a plurality of image input boxes displayed therein, each image input box being used for displaying one expression image selected by the user account;

A synthesizing unit 1302 further configured to perform, for any one of the plurality of image input frames, displaying the candidate expression image in the image input frame in response to a trigger operation for any one of the plurality of candidate expression images in a case where the image input frame is selected; and combining the parts in the candidate expression images in the image input frames to obtain a first expression image.

A display unit 1301 configured to perform, for any one of a plurality of image input frames, display a target part in a candidate expression image in the image input frame in response to a trigger operation for any one of the plurality of candidate expression images in a case where the image input frame is used to extract the target part in the displayed candidate expression image and the image input frame is selected;

A display unit 1301 configured to perform combining of the parts presented in the plurality of image input frames, resulting in a first expression image.

The apparatus further comprises:

A selection unit configured to perform a trigger operation of an image selection control corresponding to any one of the image input boxes in the composite panel, to randomly select one candidate expression image from among the plurality of candidate expression images;

the display unit 1301 is further configured to perform display of the selected candidate expression image in the image input frame.

the display unit 1301 is further configured to perform a trigger operation for responding to the second expression image, display an image making control in the conversation page, wherein the image making control is used for making an expression image with the same style as the second expression image; responding to the triggering operation of the image making control, and displaying a composite panel in the conversation page; displaying at least two candidate images used for synthesizing the second expression image in the synthesis panel;

The synthesizing unit 1302 is further configured to perform a new expression image production based on at least two candidate images used for synthesizing the second expression image.

In some embodiments, the display unit 1301 is further configured to perform, after sending the first expression image, saving the first expression image in an expression panel of the conversation page, where the expression panel is used to store and display an expression image existing in the first user account, and the expression panel includes a plurality of candidate expression images.

The embodiment of the disclosure provides an interaction device based on an expression image, wherein a conversation page of a first user account is displayed in the process of interaction between the first user account and any user account, a plurality of candidate expression images which can be sent in the process of user interaction are provided in the conversation page, the selected at least two candidate expression images can be synthesized into one expression image under the condition that the first user account selects the at least two candidate expression images, and the intention of the first user account can be accurately reflected by the at least two candidate expression images selected by the first user account, so that the synthesized image can also accurately reflect the intention of the first user account, and the synthesized expression images are used as conversation messages for interaction, thereby being beneficial to ensuring the accuracy of message transmission in the interaction process; moreover, the first user account can make new expression images through candidate expression images according to requirements to interact, so that the user account not only meets the intention of the user and meets the interaction requirements of the user, but also enriches interaction modes and interaction contents, and is beneficial to improving the interestingness of the interaction process, so that the interaction frequency among the users is improved; moreover, the first user account does not need to manually adjust the candidate expression images, so that the expression images meeting the user intention can be obtained, and the interaction efficiency can be improved.

It should be noted that, when the interactive device based on the expression image provided in the above embodiment synthesizes the expression image, only the division of the above functional units is used for illustration, in practical application, the above functional allocation may be completed by different functional units according to the need, that is, the internal structure of the electronic device is divided into different functional units, so as to complete all or part of the functions described above. In addition, the interaction device based on the expression image provided in the above embodiment and the interaction method embodiment based on the expression image belong to the same concept, and detailed implementation processes of the interaction device based on the expression image are detailed in the method embodiment, and are not repeated here.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

When the electronic device is provided as a terminal, fig. 14 is a block diagram illustrating a structure of a terminal 1400 according to an exemplary embodiment. The terminal 1400 may be a portable mobile terminal such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. Terminal 1400 may also be referred to as a user device, a portable terminal, a laptop terminal, a desktop terminal, and the like.

In general, terminal 1400 includes: a processor 1401 and a memory 1402.

Processor 1401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1401 may be implemented in at least one hardware form of DSP (DIGITAL SIGNAL Processing), FPGA (Field-Programmable gate array), PLA (Programmable Logic Array ). Processor 1401 may also include a main processor, which is a processor for processing data in an awake state, also referred to as a CPU (Central ProcessingUnit, central processor), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1401 may be integrated with a GPU (Graphics Processing Unit, image processor) for rendering and rendering of content that is required to be displayed by the display screen. In some embodiments, the processor 1401 may also include an AI (ARTIFICIAL INTELLIGENCE ) processor for processing computing operations related to machine learning.

Memory 1402 may include one or more computer-readable storage media, which may be non-transitory. Memory 1402 may also include high-speed random access memory as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1402 is used to store at least one computer program for execution by processor 1401 to implement the expressive image based interaction method provided by the method embodiments of the present application.

In some embodiments, terminal 1400 may optionally further include: a peripheral interface 1403 and at least one peripheral. The processor 1401, memory 1402, and peripheral interface 1403 may be connected by a bus or signal lines. The individual peripheral devices may be connected to the peripheral device interface 1403 via buses, signal lines or a circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1404, a display screen 1405, a camera assembly 1406, audio circuitry 1407, and a power source 1408.

Peripheral interface 1403 may be used to connect at least one Input/Output (I/O) related peripheral to processor 1401 and memory 1402. In some embodiments, processor 1401, memory 1402, and peripheral interface 1403 are integrated on the same chip or circuit board; in some other embodiments, either or both of processor 1401, memory 1402, and peripheral interface 1403 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.

The Radio Frequency circuit 1404 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1404 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 1404 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. In some embodiments, the radio frequency circuit 1404 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuit 1404 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the world wide web, metropolitan area networks, intranets, generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (WIRELESS FIDELITY ) networks. In some embodiments, the radio frequency circuit 1404 may also include NFC (Near FieldCommunication ) related circuits, which the present application is not limited to.

The display screen 1405 is used to display UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1405 is a touch display screen, the display screen 1405 also has the ability to collect touch signals at or above the surface of the display screen 1405. The touch signal may be input to the processor 1401 as a control signal for processing. At this time, the display 1405 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 1405 may be one, disposed on the front panel of the terminal 1400; in other embodiments, the display 1405 may be at least two, respectively disposed on different surfaces of the terminal 1400 or in a folded design; in other embodiments, the display 1405 may be a flexible display disposed on a curved surface or a folded surface of the terminal 1400. Even more, the display 1405 may be arranged in a non-rectangular irregular pattern, i.e. a shaped screen. The display 1405 may be made of LCD (Liquid CRYSTAL DISPLAY), OLED (organic light-Emitting Diode), or other materials.

The camera component 1406 is used to capture images or video. In some embodiments, camera assembly 1406 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal and the rear camera is disposed on the rear surface of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, camera assembly 1406 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.

The audio circuitry 1407 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1401 for processing, or inputting the electric signals to the radio frequency circuit 1404 for voice communication. For purposes of stereo acquisition or noise reduction, a plurality of microphones may be provided at different portions of the terminal 1400, respectively. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, audio circuitry 1407 may also include a headphone jack.

A power supply 1408 is used to provide power to various components in terminal 1400. The power supply 1408 may be alternating current, direct current, disposable battery, or rechargeable battery. When the power supply 1408 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, terminal 1400 also includes one or more sensors 1409. The one or more sensors 1409 include, but are not limited to: acceleration sensor 1410, gyroscope sensor 1411, pressure sensor 1412, optical sensor 1413, and proximity sensor 1414.

The acceleration sensor 1410 may detect the magnitudes of accelerations on three coordinate axes of the coordinate system established with the terminal 1400. For example, the acceleration sensor 1410 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 1401 may control the display screen 1405 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal acquired by the acceleration sensor 1410. Acceleration sensor 1410 may also be used for the acquisition of motion data of a game or user.

The gyro sensor 1411 may detect a body direction and a rotation angle of the terminal 1400, and the gyro sensor 1411 may collect a 3D motion of the user to the terminal 1400 in cooperation with the acceleration sensor 1410. The processor 1401 can realize the following functions according to the data collected by the gyro sensor 1411: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.

Pressure sensor 1412 may be disposed at a side frame of terminal 1400 and/or below display 1405. When the pressure sensor 1412 is provided at a side frame of the terminal 1400, a grip signal of the terminal 1400 by a user may be detected, and the processor 1401 performs a right-and-left hand recognition or a quick operation according to the grip signal collected by the pressure sensor 1412. When the pressure sensor 1412 is disposed at the lower layer of the display screen 1405, the processor 1401 realizes control of the operability control on the UI interface according to the pressure operation of the user on the display screen 1405. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

The optical sensor 1413 is used to collect the ambient light intensity. In one embodiment, processor 1401 may control the display brightness of display screen 1405 based on the intensity of ambient light collected by optical sensor 1413. Specifically, when the intensity of the ambient light is high, the display luminance of the display screen 1405 is turned high; when the ambient light intensity is low, the display luminance of the display screen 1405 is turned down. In another embodiment, the processor 1401 may also dynamically adjust the shooting parameters of the camera assembly 1406 based on the ambient light intensity collected by the optical sensor 1413.

A proximity sensor 1414, also referred to as a distance sensor, is typically provided on the front panel of terminal 1400. The proximity sensor 1414 is used to collect the distance between the user and the front of the terminal 1400. In one embodiment, when proximity sensor 1414 detects a gradual decrease in the distance between the user and the front of terminal 1400, processor 1401 controls display 1405 to switch from the on-screen state to the off-screen state; when the proximity sensor 1414 detects that the distance between the user and the front surface of the terminal 1400 gradually increases, the processor 1401 controls the display 1405 to switch from the off-screen state to the on-screen state.

Those skilled in the art will appreciate that the structure shown in fig. 14 is not limiting and that terminal 1400 may include more or less components than those illustrated, or may combine certain components, or employ a different arrangement of components.

In an exemplary embodiment, a computer readable storage medium is also provided, such as a memory 1402 including instructions executable by the processor 1401 of the terminal 1400 to perform the above-described emoticon-based interaction method. Alternatively, the computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

A computer program product comprising computer programs/instructions which when executed by a processor implement the above-described expressive image based interaction method.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interactive method based on expression images, which is characterized by comprising the following steps:

2. The emoticon-based interaction method of claim 1, wherein a message input box is displayed in the session page, the message input box being used for displaying a session message input by the first user account;

and combining the parts in the at least two candidate expression images under the condition that the at least two candidate expression images in the plurality of candidate expression images are selected to obtain a first expression image, wherein the method comprises the following steps:

displaying at least two candidate images of the plurality of candidate images in the message input box in response to a trigger operation for the at least two candidate images;

and combining the parts in the at least two candidate expression images in the message input box to obtain the first expression image.

3. The method of claim 2, wherein combining the locations in the at least two candidate images in the message input box to obtain the first image comprises:

Under the condition that the at least two candidate expression images are input in the message input box and any expression image is not input in the message input box within a preset time period, respectively acquiring at least one part from the at least two input candidate expression images, wherein the parts provided in different candidate expression images are different;

and combining the parts provided by the at least two candidate expression images to obtain the first expression image.

4. The interactive method based on the expression images according to claim 2, wherein a synthesis control is displayed in the conversation page, and the synthesis control is used for synthesizing at least two expression images input by a user account together;

The combining the parts in the at least two candidate expression images in the message input box to obtain the first expression image comprises the following steps:

And responding to the triggering operation of the synthesis control, and combining the parts in the at least two candidate expression images in the message input box to obtain the first expression image.

5. The method of claim 2, wherein combining the locations in the at least two candidate images in the message input box to obtain the first image comprises:

combining the parts in the at least two candidate expression images in the message input box to obtain a plurality of combined expression images, wherein the parts in different combined expression images are not identical, and the plurality of combined expression images comprise the first expression image;

And displaying the plurality of combined expression images.

6. The method of claim 5, wherein combining the locations in the at least two candidate images in the message input box to obtain a plurality of combined images comprises:

In the process of synthesizing any combined expression image, respectively acquiring each part in the plurality of parts from the at least two candidate expression images in the message input box, wherein the parts provided in different candidate expression images are different;

And combining the parts provided by the at least two candidate expression images to obtain the combined expression image.

7. The method of claim 2, wherein combining the locations in the at least two candidate images in the message input box to obtain the first image comprises:

And under the condition that the number of candidate expression images in the message input box reaches a preset number, combining the positions in the preset number of candidate expression images in the message input box to obtain the first expression image, wherein the preset number of candidate expression images are candidate expression images with the front input sequence or candidate expression images with the rear input sequence.

8. The emoticon-based interaction method of claim 1, further comprising:

Responding to image making operation, displaying a synthesis panel in the conversation page, wherein the synthesis panel is used for synthesizing at least two expression images selected by a user account, a plurality of image input boxes are displayed in the synthesis panel, and each image input box is used for displaying one expression image selected by the user account;

And combining the parts in the candidate expression images in the plurality of image input frames to obtain the first expression image.

9. The interactive method according to claim 8, wherein each image input frame is used for extracting a part in the displayed candidate expression images, and the extracted parts of different image input frames are different;

The displaying, for any one of the plurality of image input boxes, the candidate expression image in the image input box in response to a trigger operation for any one of the plurality of candidate expression images in a case where the image input box is selected, includes:

For any one of the plurality of image input boxes, in response to a trigger operation for any one of the plurality of candidate expression images, displaying a target portion in the candidate expression image in the image input box in a case where the image input box is used to extract the target portion in the displayed candidate expression image and the image input box is selected;

the combining the parts in the candidate expression images in the plurality of image input frames to obtain the first expression image comprises the following steps:

And combining the parts presented in the plurality of image input boxes to obtain the first expression image.

10. The method of claim 8, wherein each image input box in the composite panel corresponds to an image selection control, and the image selection control is used for randomly selecting one candidate expression image from the candidate expression images for the corresponding image input box;

The method further comprises the steps of:

For any image input box in the synthesized panel, responding to the triggering operation of an image selection control corresponding to the image input box, and randomly selecting one candidate expression image from the candidate expression images;

And displaying the selected candidate expression image in the image input box.

11. The interactive method according to claim 1, wherein a second expression image sent by a second user account is displayed in the conversation page;

The method further comprises the steps of:

responding to the triggering operation of the second expression image, and displaying an image making control in the conversation page, wherein the image making control is used for making the expression image with the same style as the second expression image;

12. The emoticon-based interaction method of claim 1, further comprising:

after the first expression image is sent, the first expression image is stored in an expression panel of the conversation page, wherein the expression panel is used for storing and displaying the expression image of the first user account, and the expression panel comprises the candidate expression images.

13. An interactive device based on an emoticon, the device comprising:

14. An electronic device, the electronic device comprising:

One or more processors;

A memory for storing the processor-executable program code;

Wherein the processor is configured to execute the program code to implement the emoticon-based interaction method of any of claims 1 to 12.

15. A computer readable storage medium, characterized in that instructions in the computer readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the emoticon-based interaction method according to any of claims 1 to 12.

16. A computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the emoticon-based interaction method of any of claims 1 to 12.