KR20200021402A - Electronic apparatus and controlling method thereof - Google Patents

Abstract

Disclosed is a control method of an electronic apparatus. The control method comprises the steps of: using an artificial intelligence model learned by an artificial intelligence algorithm to obtain a name indicating a user of another electronic apparatus in a conversation with a user of another electronic apparatus, while using the electronic apparatus to perform a conversation with the user of another electronic apparatus; and storing the obtained name in association with contact information of the user of another electronic apparatus. In particular, at least a part of the control method of the present disclosure may use an artificial intelligence model learned in accordance with at least one of machine learning, a neural network, or a deep learning algorithm.

Description

ELECTRONIC APPARATUS AND CONTROLLING METHOD THEREOF

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof, which can acquire meaningful information in a conversation with a counterpart and use it for various functions.

In addition, the present disclosure relates to an artificial intelligence (AI) system and its application for simulating functions such as recognition and judgment of the human brain using a machine learning algorithm.

In recent years, artificial intelligence systems that implement human-level intelligence have been used in various fields. Artificial intelligence systems, unlike conventional rule-based smart systems, are machines that learn and judge themselves and become smart. As the artificial intelligence system is used, the recognition rate is improved and the user's taste can be understood more accurately. The existing rule-based smart system is gradually replaced by the deep learning-based artificial intelligence system.

Artificial intelligence technology consists of elementary technologies that utilize machine learning (eg, deep learning) and machine learning.

Machine learning is an algorithm technology that classifies / learns characteristics of input data by itself, and element technology is a technology that simulates the functions of human brain cognition and judgment by using machine learning algorithms such as deep learning. It consists of technical fields such as understanding, reasoning / prediction, knowledge representation and motion control.

The various fields in which artificial intelligence technology is applied are as follows. Linguistic understanding is a technology for recognizing and applying / processing human language / characters and includes natural language processing, machine translation, dialogue system, question and answer, speech recognition / synthesis, and the like. Visual understanding is a technology of recognizing and processing objects as human vision, and includes object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, image enhancement, and the like. Inference prediction is a technique of judging information, logically inferring, and predicting information, and includes knowledge / probability based inference, optimization prediction, preference based planning, and recommendation. Knowledge expression is a technology that automatically processes human experience information into knowledge data, and includes knowledge construction (data generation / classification) and knowledge management (data utilization). Motion control is a technique for controlling autonomous driving of a vehicle and movement of a robot, and includes motion control (navigation, collision, driving), operation control (action control), and the like.

Recently, for the efficient management of information and various user experiences, a voice-based AI personal assistant platform has been provided on an electronic device. Electronic devices could support a natural, interactive interface to the user through a personal assistant platform.

For example, when a user requests to make a call while referring to a name of a specific counterpart, the AI personal assistant of the electronic device may find a phone number corresponding to the counterpart's name from previously stored contact information and connect with the counterpart. However, in order to use this function, the user must correctly remember the stored name of the other party. If the user attempts to contact with a name other than the stored counterpart name, the contact fails.

An object of the present disclosure is to provide an electronic device and a method of controlling the same, which can acquire meaningful information in a conversation with a counterpart and use it for various functions.

According to an embodiment of the present disclosure, a method of controlling an electronic device uses the artificial intelligence model learned by an artificial intelligence algorithm while talking with a user of another electronic device using the electronic device. Acquiring a name indicating a user of the other electronic device in a conversation with a user of and storing the obtained name in association with contact information of a user of the other electronic device.

In this case, the control method according to the present embodiment further includes the step of performing a telephone connection based on the contact information of the user of the other electronic device when a user voice for making a call including the obtained name is input. Can be.

On the other hand, in the acquiring step, when a first name indicating a user of the other electronic device is pre-registered in contact information of the user of the other electronic device, the user of the other electronic device using the artificial intelligence model. In a dialogue with the second name, a second name different from the first name may be obtained.

In this case, in the control method according to the present embodiment, when a user voice for making a call including the second name is input, a message UI (User interface) inquiring whether to make a telephone connection with the other party of the first name is input. It may further comprise providing a.

Meanwhile, the control method according to the present embodiment includes a phone number, the first name, and the second name of a user of the other electronic device when a user input for viewing contact information of the user of the other electronic device is received. The provided contact information UI.

The control method according to the present embodiment may further include providing a conversation UI for conducting a conversation with a user of the other electronic device, and the obtaining of the conversation UI may be performed by using the artificial intelligence model. In a conversation input through the mobile terminal, a name indicating a user of the other electronic device may be acquired.

The acquiring may include acquiring a name indicating a user of the other electronic device in the voice conversation using the artificial intelligence model while the voice conversation is performed with the user of the other electronic device.

On the other hand, in the storing step, if the name indicating the user of the other electronic device is acquired more than a predetermined number of times in a conversation with the user of the other electronic device, the name is associated with the contact information of the user of the other electronic device. Can be stored.

Meanwhile, the control method according to the embodiment of the present invention stores the frequency of using the name indicating the user of the other electronic device in a conversation with the user of the other electronic device and in addition to the contact information of the user of the other electronic device. When a user voice for making a call including the name is input when the same name as the name is stored in the contact information of another user, the call is connected based on the contact information of the user with a higher frequency of using the name. It may further comprise the step of performing.

Meanwhile, in the control method according to the present embodiment, when a user voice including the name for transmitting a message is input, the message including the name at the beginning is transmitted based on contact information of the user of the other electronic device. It may further comprise a step.

On the other hand, the control method according to the present embodiment, using the artificial intelligence model to obtain the schedule information associated with the user of the other electronic device in the conversation with the user of the other electronic device and the schedule information to the other electronic The method may further include storing the contact information of the user of the device.

In this case, the control method according to the present embodiment provides a response message UI including the name indicating the user of the other electronic device when a user voice requesting information on the conversation counterpart associated with the schedule information is input. It may further comprise a step.

On the other hand, the control method according to the present embodiment includes the step of adding the contact record with the user of the other electronic device in the recent contact record and the name in the contact record with the user of the other electronic device added to the recent contact record The method may further include tagging.

Meanwhile, the electronic device according to an embodiment of the present disclosure communicates with a user of another electronic device through the communication unit by executing a communication unit, a memory storing computer executable instructions, and the computer executable instructions. While performing the operation, a name indicating a user of the other electronic device is obtained in a conversation with a user of the other electronic device using an AI model learned by an artificial intelligence algorithm, and the obtained name is referred to as the other electronic. And store in the memory in association with contact information of a user of the device.

In this case, the electronic device according to the present embodiment further includes a microphone, and when the user voice for making a call including the obtained name is input through the microphone, the contact information of the user of the other electronic device is input. A telephone connection can be made based on the information.

Meanwhile, when a first name indicating a user of the other electronic device is pre-registered in the contact information of the user of the other electronic device, the processor uses the artificial intelligence model to communicate with the user of the other electronic device. In the dialogue, a second name different from the first name may be obtained.

In this case, the electronic device according to the present embodiment further includes a display, and when the user voice for making a call including the second name is input through the microphone, the electronic device calls the other party. A message UI (User interface) for inquiring whether to perform a connection may be provided through the display.

Meanwhile, when a user input for reading contact information of a user of the other electronic device is received, the processor includes a contact information UI including a phone number, the first name, and the second name of the user of the other electronic device. Can be provided through the display.

Meanwhile, the electronic device according to the present embodiment further includes a display, and the processor provides a conversation UI for conducting a conversation with a user of the other electronic device through the display and uses the artificial intelligence model to perform the conversation. In a conversation input through a conversation UI, a name indicating a user of the other electronic device may be obtained.

Meanwhile, the electronic device according to the present embodiment may further include a microphone, and the processor may be further configured to use the artificial intelligence model while the voice conversation is performed through the microphone with the user of the other electronic device. A name indicating a user of the electronic device may be obtained.

1 is a diagram illustrating an electronic device according to an embodiment of the present disclosure to obtain meaningful information in a conversation with a counterpart;
2 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure;
3 is a block diagram illustrating a configuration of an electronic device according to another embodiment of the present disclosure;
4 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;
5 to 6 are views for explaining various embodiments of the present disclosure that utilizes a name of a counterpart obtained in a conversation in a call function;
7 is a view for explaining an embodiment of the present disclosure with respect to a message sending function;
8 to 9 are views for explaining various embodiments of the present disclosure for performing a telephone connection when the same name is used to refer to several parties;
10 is a view for explaining an embodiment of the present disclosure for obtaining schedule information in a conversation;
11A is a view for explaining an embodiment of the present disclosure that utilizes a recent contact record;
11B is a view for explaining an embodiment of the present disclosure for adding information obtained in a conversation to a contact list;
12 to 14 are diagrams for describing various embodiments of the present disclosure that utilizes schedule information obtained in a conversation.
FIG. 15 is a diagram for explaining one embodiment of the present disclosure for registering a contact in association with a message application;
16 is a flowchart of a network system using an artificial intelligence model according to an embodiment of the present disclosure.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. However, this is not intended to limit the techniques described in this document to specific embodiments, but should be understood to cover various modifications, equivalents, and / or alternatives to the embodiments of this document. . In connection with the description of the drawings, similar reference numerals may be used for similar components.

In this document, expressions such as "have," "may have," "include," or "may include" include the presence of a corresponding feature (e.g., numerical, functional, operational, or component such as a component). Does not exclude the presence of additional features.

In this document, expressions such as "A or B," "at least one of A or / and B," or "one or more of A or / and B" may include all possible combinations of items listed together. . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) both of cases including at least one A and at least one B.

As used herein, the expressions "first," "second," "first," or "second," and the like may modify various components in any order and / or in importance. It is used to distinguish it from other components and does not limit the components. For example, the first user device and the second user device may indicate different user devices regardless of the order or importance. For example, without departing from the scope of rights described in this document, the first component may be referred to as a second component, and similarly, the second component may be renamed to the first component.

As used herein, the terms "module", "unit", "part", and the like are used to refer to a component that performs at least one function or operation, and the components are implemented in hardware or software. Or a combination of hardware and software. In addition, a plurality of "modules", "units", "parts", etc. are integrated into at least one module or chip, except that each needs to be implemented by a particular specific hardware, and is at least one processor. It can be implemented as.

One component (such as a first component) is "(functionally or communicatively) coupled with / to" to another component (such as a second component) or " When referred to as "connected to," it is to be understood that any component may be directly connected to the other component or may be connected through another component (e.g., a third component). On the other hand, when a component (e.g., a first component) is said to be "directly connected" or "directly connected" to another component (e.g., a second component), the component and the It may be understood that no other component (eg, a third component) exists between the other components.

The expression "configured to" used in this document is, for example, "having the capacity to," "suitable for," " , "" Designed to, "" adapted to, "" made to, "or" capable of. " The term "configured to" may not necessarily mean only "specifically designed to" in hardware. Instead, in some situations, the expression “device configured to” may mean that the device “can” along with other devices or components. For example, the phrase “processor configured (or configured to) perform A, B, and C” may be executed by executing a dedicated processor (eg, an embedded processor) to perform the operation, or one or more software programs stored in a memory device. It may mean a general-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art. Among the terms used in this document, terms defined in the general dictionary may be interpreted to have the same or similar meaning as the meaning in the context of the related art, and ideally or excessively formal meanings are not clearly defined in this document. Not interpreted as In some cases, even if terms are defined in the specification, they may not be interpreted to exclude embodiments of the present disclosure.

An electronic device (including a control device and a controlled device) according to various embodiments of the present disclosure may include, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, E-book reader, desktop personal computer, laptop personal computer, netbook computer, workstation, server, personal digital assistant, PMP ( It may include at least one of a portable multimedia player, an MP3 player, a mobile medical device, a camera, or a wearable device. According to various embodiments of the present disclosure, a wearable device may be an accessory type (eg, a watch, ring, bracelet, anklet, necklace, glasses, contact lens, or head-mounted-device (HMD)), a fabric, or an integrated clothing ( For example, it may include at least one of an electronic garment, a body attachment type (eg, a skin pad or a tattoo), or a living implantable type (eg, an implantable circuit).

In some embodiments, the electronic device may be a home appliance. Home appliances are, for example, televisions, digital video disk (DVD) players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air purifiers, set-top boxes, home automation controls Panel (home automation control panel), security control panel, TV box (e.g. Samsung HomeSync ™ Apple TV ™ or Google TV ™ game console (e.g. Xbox ™ PlayStation ™ electronic dictionary, electronic key, camcorder) ), Or at least one of the electronic picture frames.

In another embodiment, the electronic device may include various medical devices (eg, various portable medical measuring devices (such as blood glucose meters, heart rate monitors, blood pressure monitors, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Such as computed tomography (CT), imaging or ultrasound, etc. ) Devices, ship's electronic equipment (e.g. ship's navigation system, gyro compass, etc.), avionics, security devices, vehicle head units, industrial or home robots, automatic teller's machines (financial institutions) Point of sales (POS) in stores, or Internet of things (e.g. light bulbs, sensors, electricity or gas meters, sprinkler devices, fire alarms, thermostats, street lights, It may include at least one of (toaster), exercise equipment, hot water tank, heater, boiler.

According to some embodiments, an electronic device may be a furniture or part of a building / structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, Water, electricity, gas, or radio wave measuring instrument). In various embodiments of the present disclosure, the electronic device may be one or a combination of the above-mentioned devices. An electronic device according to an embodiment may be a flexible electronic device. In addition, the electronic device according to an embodiment of the present disclosure is not limited to the above-described devices, and may include a new electronic device according to technology development.

One object of the present disclosure is to provide an electronic device and a method of controlling the same, which can acquire meaningful information in a conversation with a counterpart and use it for various functions. Hereinafter, the present disclosure will be described in more detail with reference to the accompanying drawings.

1 is a diagram illustrating an electronic device according to an embodiment of the present disclosure to obtain meaningful information in a conversation with a counterpart.

Referring to FIG. 1, a user may perform a conversation with a user (the other party) of another electronic device using the electronic device 100. For example, a chat application can be used to conduct a conversation. The electronic device 100 may obtain a name indicating the other party in a conversation with the other party. In this case, a name indicating the counterpart in the conversation can be identified using the AI model learned by the AI algorithm.

Referring to FIG. 1, the electronic device 100 may obtain a name “bulldog” indicating a counterpart in a conversation with the counterpart.

When the name indicating the conversation counterpart is obtained, the electronic device 100 may store the acquired name in association with the contact information of the counterpart. For example, as illustrated in FIG. 1, a "bulldog" may be added to a nickname item of a contact information of a previously stored counterpart. That is, in addition to the name "Hong Gil-dong" previously registered in the contact information, another name that may refer to the other party is added to the contact information.

In addition to the name referring to the other party, keywords indicating the relationship with the other party in the conversation, the address of the other party, and the like may be obtained, which may be stored in the other party's contact information.

According to various embodiments of the present disclosure, meaningful information obtained in the dialogue as described above may be utilized. For example, the name “bulldog” obtained in the example described in FIG. 1 may be used to call Hong Gil-dong by voice. When the electronic device 100 receives a user voice "Call a bulldog", the electronic device 100 may perform a telephone connection based on the contact information of Hong Gil-dong. Therefore, even if the user does not remember that the other party's name is stored as "Hong Gil-dong" in the contact information, the user can make a phone call to "bulldog" which is often called.

2 is a block diagram illustrating a configuration of an electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 2, the electronic device 100 includes a communication unit 110, a memory 120, and a processor 130. Depending on the embodiment, some of the components may be omitted, and although not shown, suitable hardware / software configurations of a level apparent to those skilled in the art may be further included in the electronic device 100.

The communication unit 110 may be connected to a network through wireless or wired communication, for example, to communicate with an external device. Wireless communication is, for example, a cellular communication protocol, for example, long-term evolution (LTE), LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), and UMTS (universal). At least one of a mobile telecommunications system (WBro), a wireless broadband (WiBro), a global system for mobile communications (GSM), and the like may be used. In addition, wireless communication may include, for example, near field communication. The short range communication may include, for example, at least one of a WiFi fidelity direct, a Bluetooth, a near field communication, and a Zigbee. The wired communication may include, for example, at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a reduced standard232 (RS-232), a plain old telephone service (POTS), and the like. The network may include a telecommunications network, for example, at least one of a computer network (for example, a LAN or a WAN), the Internet, and a telephone network.

The communication unit 110 may include, for example, a cellular module, a WiFi module, a Bluetooth module, a GNSS module (eg, a GPS module, a Glonass module, a Beidou module, or a Galileo module), an NFC module, and a radio frequency (RF) module. .

The cellular module may provide, for example, a voice call, a video call, a text service, or an internet service through a communication network. According to an embodiment of the present disclosure, the cellular module may perform identification and authentication of an electronic device in a communication network using a subscriber identification module (eg, a SIM card). According to an embodiment of the present disclosure, the cellular module may perform at least some of the functions that the processor may provide. According to an embodiment, the cellular module may include a communication processor (CP).

Each of the WiFi module, the Bluetooth module, the GNSS module, or the NFC module may include, for example, a processor for processing data transmitted and received through the corresponding module. According to some embodiments, at least some (eg, two or more) of the cellular module, WiFi module, Bluetooth module, GNSS module, or NFC module may be included in one integrated chip (IC) or IC package.

The RF module may transmit / receive, for example, a communication signal (eg, an RF signal). The RF module may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna, or the like. According to another embodiment, at least one of the cellular module, the WiFi module, the Bluetooth module, the GNSS module, or the NFC module may transmit and receive an RF signal through a separate RF module.

The memory 120 may include, for example, an internal memory or an external memory. The built-in memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM, etc.), non-volatile memory (for example, OTPROM (one). time programmable ROM (PROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash), hard drive, Or it may include at least one of a solid state drive (SSD).

The external memory may be a flash drive such as compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (XD), It may include a multi-media card (MMC) or a memory stick.

The memory 120 is accessed by the processor 130 and read / write / modify / delete / update of data by the processor 130.

In the present disclosure, the term memory may include at least one of a memory provided separately from the processor 130, a ROM in the processor 130, and a RAM (not shown).

The processor 130 is a component for controlling the overall operation of the electronic device 100. For example, the processor 130 may drive an operating system and an application to control a plurality of hardware or software components connected to the processor 130, and may perform various data processing and operations. The processor 130 may be a central processing unit (CPU) or graphics-processing unit (GPU) or both. The processor 250 may be implemented with at least one general processor, a digital signal processor, an application specific integrated circuit (ASIC), a system on chip (SoC), a microcomputer (MICOM), or the like.

The processor 130 may perform various operations by using an AI model learned by an AI algorithm. For example, the processor 130 may obtain meaningful information in a conversation with a counterpart performed using the electronic device 100 using an artificial intelligence model learned by an artificial intelligence algorithm.

The artificial intelligence model is a decision model trained based on an artificial intelligence algorithm. For example, the artificial intelligence model may be a model based on a neural network. The learned AI model can be designed to simulate the human brain structure on a computer and can include a plurality of weighted network nodes that simulate the neurons of a human neural network. The plurality of network nodes may form a connection relationship so that neurons simulate the synaptic activity of neurons that send and receive signals through synapses. In addition, the learned AI model may include, for example, a neural network model or a deep learning model developed from the neural network model. In the deep learning model, a plurality of network nodes may be located at different depths (or layers), and may exchange data according to a convolutional connection relationship. Examples of the learned AI model may include, but are not limited to, a Deep Neural Network (DNN), a Recurrent Neural Network (RNN), and a Bidirectional Recurrent Deep Neural Network (BRDNN).

The electronic device 100 may use a personal assistant program (ex. Bixby ™), which is an artificial intelligence dedicated program (or artificial intelligence agent). Personal assistant program is dedicated program to provide AI (Artificial Intelligence) based service. Existing general purpose processors (eg, CPUs) may be used for artificial intelligence processing, or single purpose processors (eg, GPUs, FPGAs, ASICs, etc.) may be used. The electronic device 100 may include a plurality of processors. For example, the electronic device 100 may include a processor dedicated to artificial intelligence and a processor in charge of other processing.

According to an embodiment of the present disclosure, a preset user input (for example, an icon touch corresponding to a personal assistant chatbot, a user voice including a preset word, etc.) may be input or a button provided in the electronic device 100 may be provided. For example, when the button for executing the AI agent is pressed, the AI agent may operate (or execute). Alternatively, the artificial intelligence agent may be in a standby state before a preset user input is detected or a button provided in the electronic device 100 is selected. Here, the standby state is a state of detecting that a predefined user input (eg, when a user voice including a predetermined keyword (ex. Bixby) is received) is received to control the start of the operation of the AI agent. to be. When a preset user input is detected or a button provided in the electronic device 100 is selected while the artificial intelligence agent is in a standby state, the electronic device 100 may operate the artificial intelligence agent. When the user's voice is received, the AI agent may perform a function of the electronic device 100 based on the voice, and output an answer if the voice asks a voice.

An operation based on artificial intelligence may be performed in the electronic device 100 or may be performed through an external server. In the former case, for example, the electronic device 100 may obtain meaningful information in a conversation with the counterpart using an artificial intelligence model. In the latter case, for example, the electronic device 100 may transmit a conversation with the counterpart to an external server, and obtain meaningful information from the conversation using an artificial intelligence model at the external server, and provide the same to the electronic device 100. can do.

Functions related to artificial intelligence according to the present disclosure are operated through a processor and a memory.

The processor may consist of one or a plurality of processors. At this time, one or a plurality of processors are general purpose processors such as CPU, AP, GPU. It may be a graphics dedicated processor such as a VPU or the like, or an AI dedicated processor such as an NPU.

One or more processors control to process the input data according to a predefined operating rule or artificial intelligence model stored in the memory. The predefined action rule or artificial intelligence model is characterized by being made through learning.

In this case, to be made through learning means that a predetermined operating rule or artificial intelligence model of a desired characteristic is created by applying a learning algorithm to a plurality of learning data. Such learning may be made in the device itself in which the artificial intelligence according to the present disclosure is performed, or may be made through a separate server / system.

The artificial intelligence model may consist of a plurality of neural network layers. Each layer has a plurality of weight values, and the layer is calculated through the calculation result of the previous layer and the calculation of the plurality of weights. Examples of neural networks include Convolutional Neural Network (CNN), Deep Neural Network (DNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN) and deep There are Deep Q-Networks, and the neural network in the present disclosure is not limited to the above examples except where specified.

The learning algorithm is a method of training a predetermined target device (eg, a robot) using a plurality of learning data so that the predetermined target device can make a decision or make a prediction by itself. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, where the learning algorithm in the present disclosure is specified. It is not limited to the above-described example except for.

3 is a block diagram illustrating a configuration of an electronic device 100 according to another embodiment of the present disclosure. As shown in FIG. 3, the electronic device 100 includes a communication unit 110, a memory 120, a processor 130, a microphone 140, an input unit 150, an audio output unit 160, and a display 170. It may include. Depending on the embodiment, some of the components may be omitted, and although not shown, suitable hardware / software configurations of a level apparent to those skilled in the art may be further included in the electronic device 100. Meanwhile, since the communication unit 110, the memory 120, and the processor 130 have been described with reference to FIG. 2, redundant descriptions thereof will be omitted.

The microphone 140 is configured to receive a user voice or other sound and convert it into a digital signal. The processor 130 may acquire meaningful information in a voice conversation input through the microphone 140, for example, a name for the other party, a relationship with the other party, an address of the other party, and the like. The microphone 140 may be provided inside the electronic device 100, but this is only an example and may be provided outside the electronic device 100 to be electrically connected to the electronic device 100.

The input unit 150 may receive a user input and transmit it to the processor 130. The input unit 150 may include, for example, a touch sensor, a (digital) pen sensor, a pressure sensor, a key, or a microphone. For example, the touch sensor may use at least one of capacitive, resistive, infrared, or ultrasonic methods. The (digital) pen sensor may be, for example, part of a touch panel or may include a separate recognition sheet. The key may include, for example, a physical button, an optical key, or a keypad.

The sound output unit 160 may output an audio signal. For example, the audio output unit 160 may output the voice of the other party received through the communication unit 110. In addition, the sound output unit 160 may output audio data stored in the memory 120. For example, the sound output unit 160 may output various notification sounds and may output voices of an artificial intelligence assistant. The sound output unit 160 may include a receiver, a speaker, a buzzer, and the like.

The display 170 is a component for outputting an image. The display 170 is, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display (eg, AMOLED). (active-matrix organic light-emitting diodes), passive-matrix OLEDs (PMOLED), or microelectromechanical systems (MEMS) displays, or electronic paper displays. The touch sensor of the display 170 and the input unit 150 may have a mutual layer structure and be implemented as a touch screen.

The memory 120 stores computer executable instructions, and when it is executed by the processor 130, the method of controlling the electronic device 100 described in the present disclosure may be performed.

For example, the processor 130 executes computer executable instructions to communicate with the user of the other electronic device through the communication unit 110, and then uses the AI model learned by the artificial intelligence algorithm. In a conversation with a user, a name indicating a user of the other electronic device may be obtained, and the obtained name may be stored in the memory 120 in association with contact information of the user of the other electronic device.

In addition, the processor 130 may execute a computer executable command to obtain a name indicating a user of the other electronic device in the voice conversation using the artificial intelligence model while the voice conversation is performed through the microphone 140. .

In addition, when a user voice for making a call including the obtained name is input through the microphone 140, the processor 140 may perform a telephone connection based on contact information of the user of the other electronic device.

In addition, the processor 140 may provide various UIs through the display 170. For example, the display 170 may provide a UI for a conversation, a UI for inquiring whether to perform a telephone connection, a contact information UI, and the like.

4 is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 4, during a conversation with a user of another electronic device using the electronic device 100, the conversation with the user of the other electronic device is performed using an artificial intelligence model learned by an artificial intelligence algorithm. A name indicating a user of another electronic device is acquired (S410).

In addition to the name referring to the other party, various kinds of meaningful information such as a keyword representing the relationship with the other party in the conversation, the address of the other party, schedule information related to the other party, and the like may be obtained.

The electronic device 100 may support a text conversation function and a voice conversation function, and may acquire meaningful information using an artificial intelligence model in the text conversation and the voice conversation.

The electronic device 100 may acquire and understand meaningful information in text using an artificial intelligence model for natural language processing (NLP). When a voice is input, the electronic device 100 may use speech to text (STT) technology that first converts the voice into text. The artificial intelligence model for analyzing a conversation with the counterpart is provided in the electronic device 100 itself, or the artificial intelligence model is provided in the external server, so that the electronic device 100 transmits the conversation to the external server to It is also possible to be provided with an analysis of the dialogue. Alternatively, some processes of conversation analysis may be performed in the electronic device 100 and another process may be performed in an external server. For example, the electronic device 100 transmits a voice conversation to an external server, and the external server converts the voice into text to provide the electronic device 100, and the electronic device 100 performs natural language processing on the converted text. Can be.

The text conversation can be carried out via a message application, for example. The message application may include a message application (eg, KakaoTalk ™, Line ™, WhatsApp ™, etc.) that is basically installed in the electronic device 100 or downloaded from an application store such as Google Play ™ or Samsung Apps ™. . The text conversation may be in various forms such as SMS, MMS, and mail.

The electronic device 100 may provide a conversation UI for conducting a conversation with a user of another electronic device. The conversation UI may be provided by executing a message application, and may include an area in which a dialog text is input, a conversation input by oneself, and a conversation displayed by a counterpart. For example, the electronic device 100 may provide the conversation UI 10 as shown in FIG. 1.

The electronic device 100 may obtain meaningful information such as a name, a relationship, an address, etc., which refers to a user of another electronic device, in a conversation input through the conversation UI using the artificial intelligence model. For example, the electronic device 100 may obtain a name bulldog indicating the other party's Hong Gil Dong in the conversation input to the conversation UI 10 of FIG. 1.

Voice conversations can be carried out via landline or VoIP (Voice over Internet Protocol) based Internet telephony (ex. Skype ™, FaceTime ™, etc.).

The electronic device 100 may obtain meaningful information such as a name, a relationship, an address, etc., which refers to a user of the other electronic device in the voice conversation by using an artificial intelligence model while the voice conversation is performed with the user of the other electronic device. . For example, the electronic device 100 may obtain a name indicating a user of a conversation other electronic device by converting the voice conversation into text and inputting the converted text into the artificial intelligence model using the artificial intelligence model.

When the first name is pre-registered in the contact information of the user of the other electronic device, the electronic device 100 uses the artificial intelligence model to communicate with the user of the other electronic device in a second manner different from the first name. The name can be obtained. In other words, a name different from the name stored in advance is obtained. If no name is already registered, a new name can be obtained from the dialogue.

When the name is obtained, the electronic device 100 stores the obtained name in association with contact information of a user of another electronic device (420). For example, as described with reference to FIG. 1, a bulldog indicating Hong Gil Dong in a conversation with Hong Gil Dong may be stored in association with contact information of Hong Gil Dong. In addition to the name indicating the other party, when a variety of meaningful information such as a keyword representing the relationship with the other party in the conversation, the address of the other party, etc. are obtained, this may be stored in association with the contact information.

Meanwhile, when a name indicating a user of another electronic device is acquired more than a predetermined number of times in a conversation with a user of another electronic device, the electronic device 100 may store the name in association with contact information of the user of the other electronic device. . That is, it is determined that the name refers to the other party only when the name is used repeatedly for a predetermined number of times.

When a user input for viewing a contact of the counterpart is received, the electronic device 100 may provide a contact information UI including a phone number of the counterpart and names indicating the counterpart. For example, when a user input for viewing the contact information of the other party is received, the electronic device 100 may include the other party's name 'Hong Gil Dong', a phone number '010-0000-0000', and an alias 'Bulldog' as shown in FIG. 1. Contact information UI 20 may be provided.

Functions that could be performed using the name 'Hong Gil-dong', which was previously registered in the contact information, may be performed in the same manner using the bulldog, which is another name acquired through the dialogue. According to an embodiment, the name acquired in the conversation may be used for a dialing function.

FIG. 5 is a diagram for describing an exemplary embodiment of the present disclosure using a name of a counterpart obtained in a conversation in a dialing function.

Referring to FIG. 5, when a voice of “Call a bulldog” is input from a user, the electronic device 100 searches for a bulldog in all contact names and nickname items, and has a nickname as a bulldog. Telephone connection can be made based on Hong Gil-dong's contact information.

Since the artificial intelligence assistant performs the call connection function only based on the stored name, when the voice call " Call the Bulldog " is input, the call connection fails, but according to an embodiment of the present disclosure, the call connection can be successful. .

On the other hand, instead of making a phone call immediately, the user may be confirmed and a phone call may be performed. For example, when a user voice for making a call including a name acquired through a conversation is input, the electronic device 100 inquires whether to establish a telephone connection with a counterpart of another registered name. ) Can be provided. An embodiment related to this will be described with reference to FIG. 6.

6 is a view for explaining another embodiment of the present disclosure with respect to a dialing function.

Referring to FIG. 6, when a voice of “Call a Bulldog” is input from the user, the artificial intelligence assistant of the electronic device 100 may make a phone call to another name registered in the contact information associated with the Bulldog, that is, “Hong Gil Dong”. It may provide a message UI 610 to inquire whether or not. When a voice, for example, "yes", is input to the message UI 610, a telephone connection may be performed based on contact information of Hong Gil-dong corresponding to the bulldog. If a voice, for example, "no", to which the user does not agree is input to the message UI 610, the electronic device 100 may not perform a telephone connection.

The name indicating the other party obtained through the conversation may be used in the message sending function in addition to the dialing function. For example, when a voice is input from the user, “Please text a bulldog to meet at the park today,” the electronic device 100 may find a contact of Hong Gil-dong corresponding to the bulldog and transmit a message “Meet at the park today” to the contact. .

7 is a view for explaining another embodiment of the present disclosure with respect to a message sending function.

The electronic device 100 may transmit a message using a name acquired in a conversation with a user of another electronic device. Specifically, when a user voice including the obtained name for inputting a message is input, the name is input. The message included in the introduction may be transmitted based on contact information of a user of another electronic device.

For example, referring to FIG. 7, when a voice is input from the user, "Please send Hong Gil-dong to meet you at the park today," the user obtained the 'Bulldog' in the usual conversation with Hong Gil-dong and saved it in the contacts of Hong-gil-dong. The obtained nickname 'bulldog' may be included at the beginning of the message and transmitted. That is, as illustrated in FIG. 7, the message “Bulldog. Meet in the park today.” May be transmitted. According to the present embodiment, there is an advantage in that a message can be transmitted while calling a counterpart by a name commonly used in a conversation.

On the other hand, the same name can be used to refer to several people. For example, a name stored in association with contact information of a first user of another electronic device and a name stored in association with contact information of a second user of another electronic device may be the same.

8 is a view for explaining an embodiment of the present disclosure that performs a telephone connection when the same name is used to refer to multiple counterparts.

Referring to FIG. 8, when the name “honey” is stored in association with two pieces of contact information, when the voice of “call me honey” is received from the user, the electronic device 100 may have “honey”. The UI 810 indicating that there are a plurality of contacts may be provided. When the user utters a voice for selecting one of a plurality of contacts, for example, "call the acknowledgment", the electronic device 100 may perform a telephone connection based on the acknowledgment contact.

According to another embodiment of the present disclosure, when the same name is stored in the plurality of contact information, priority may be used based on the frequency of use of the name.

For example, the electronic device 100 may store a frequency of using a name indicating a user of another electronic device in a conversation. That is, the frequency used for the name referring to the first user and the frequency used for the name referring to the second user may be stored. When a user voice for making a call including the name is input, the electronic device 100 may perform a telephone connection based on contact information of a user whose frequency of use of the name is higher. This embodiment will be described with reference to FIG. 9.

Referring to FIG. 9, when a voice of “Call a Honey” is received from a user, the electronic device 100 searches for contact information of a person who has “honey”, and when there are a plurality of searched contact information, “Yello” The telephone connection may be made based on the contact information of the person with the highest frequency of which the name is used. In this case, a UI 910 may be provided for guiding that the telephone connection is performed with the contact information of the person with the highest frequency.

On the other hand, since a person may be called by various aliases, two or more aliases may be stored in the contact information.

Not only a name indicating the other party from the conversation, but also other meaningful information can be obtained. For example, information related to an appointment with a counterpart or a schedule may be obtained.

According to an embodiment of the present disclosure, the electronic device 100 obtains schedule information associated with a user of another electronic device in a conversation with a user of another electronic device by using an artificial intelligence model and uses the obtained schedule information in another electronic device. Can be stored in association with the user's contact information. This embodiment will be described with reference to FIG. 10.

10 is a diagram for describing an exemplary embodiment of obtaining the schedule information in a conversation.

Referring to FIG. 10, a user (user 1) of an electronic device 100 performs a voice conversation with a user (user 2) of another electronic device using the electronic device 100. The electronic device 100 may obtain a name for designating the user 2, ie, grill and chicken, in the conversation and obtain schedule information (time information) using the artificial intelligence model. The information thus obtained may be stored in association with the contact information of the user 2 and may be used later in various functions.

Meanwhile, according to an embodiment of the present disclosure, information obtained in a conversation may be stored in association with a time point at which the conversation occurs. For example, "When did you speak with Bulldog?", "Who was calling at 3 o'clock?" In the case where a voice such as a voice is input, information about the time at which the conversation takes place may be used when the AI assistant answers the question.

The message application or telephone application that provides the chat service also records time information about when the chat occurred, and thus can be used. For example, information about recent contact records provided by the phone application may be used.

According to an embodiment of the present disclosure, when a conversation (text conversation or voice conversation) is performed with a user of another electronic device using the electronic device 100, a contact record with a user of the other electronic device may be added to a recent contact record. have. In addition, the contact record added to the recent contact record may be tagged with information acquired from the conversation (name referring to the other party, schedule information, etc.). This embodiment will be described with reference to FIG. 11A.

11A is a diagram for explaining an embodiment of the present disclosure that utilizes a recent contact record. In connection with the conversation of FIG. 10, FIG. 11A will be described.

Referring to FIG. 11A, the electronic device 100 may add a contact of user 2 to a recent contact record during a conversation with user 2 described with reference to FIG. 10. If the contact of user 2 is not a registered contact, the contact record may be expressed by a phone number (02-1234-9876). In addition to the added contact record, information acquired in a conversation, that is, information about a name indicating a counterpart and schedule information may be added in a tag form. For example, as shown in FIG. 11A, tag information 1110 may be displayed near a contact record.

According to another embodiment, the information obtained in the conversation may be provided to a schedule management application (eg, a calendar application). For example, information such as' grill and chicken ', '19: 00', and 'reservation' may be included in the schedule of April 20, 2018 in the schedule management application.

According to an embodiment of the present disclosure, the electronic device 100 may distinguish whether a conversation counterpart is a specific person or a mutual name, and store information obtained in a conversation in contact information in the case of a specific person, and in the case of a mutual name. You can save a recent contact record in the form of a tag. For example, referring to FIG. 1, when the conversation partner is a person, information obtained in the conversation is stored in the contact information of the contact application. Referring to FIG. 11A, when the conversation partner is a specific store, the conversation is recorded in a recent contact record. The information obtained from can be saved in tag format.

The schedule information obtained in the conversation can be used in various situations. For example, when a user's voice requesting information on a conversation counterpart associated with schedule information obtained in a conversation is input, the electronic device 100 may provide an answer message UI including a name indicating a user of another electronic device. . This will be described with reference to FIGS. 12 to 14.

12 is a view for explaining an embodiment of the present disclosure that utilizes schedule information obtained in a conversation. 12 will be described in connection with the embodiment described with reference to FIG. 11A.

Referring to FIG. 12, when a voice is received from the user, "What is the name of the store reserved for April 20th at 19 o'clock?", The electronic device 100 triggers the keyword "bixby" to activate the artificial intelligence assistant. Can be obtained, and time information can be obtained from the voice, and the store name corresponding to the obtained time information can be retrieved from the information tagged in the contact record.

The electronic device 100 may search a recent contact record for a contact record having tagging information including the time information 'April 20, 19 o'clock' obtained from the user's voice. Referring to FIG. 11A, the electronic device 100 uses the name "grill and chicken" to designate a counterpart based on information tagged in a contact record, and the business name "Grill and Chicken" is reserved at 19 o'clock on April 20. The response message UI 1210 including "is" may be provided.

FIG. 13 is a diagram for describing another embodiment of the present disclosure using schedule information acquired in a conversation. 13 will be described with reference to the embodiment described with reference to FIG. 11A.

Referring to FIG. 13, when a voice is received from a user, “Bixby! Call me Grill and Chicken, which is reserved for next Friday,” the electronic device 100 recognizes a trigger keyword “Bixby” that activates an AI assistant. In addition, time information and a business name may be obtained and a corresponding telephone number may be retrieved from a recent contact record.

The electronic device 100 may search the recent contact record for a contact record having 'April 20, 2018' and 'Grill and Chicken' as tagging information corresponding to the time information 'Next Friday' acquired from the user's voice. have. Referring to FIG. 11A, the electronic device 100 may find a contact record “02-1234-9876” having “April 20, 2018” and “grill and chicken” as tagging information. In addition, the electronic device 100 may perform a telephone connection to the contact record "02-1234-9876".

14 is a view for explaining another embodiment of the present disclosure that utilizes schedule information obtained in a conversation. 14 will be described in connection with the embodiment described with reference to FIG. 11A.

Referring to FIG. 14, when a voice is received from the user, “Bixbee! Please text me a delay of 30 minutes of reservation time to Grill and Chicken,” which is reserved for next Friday, the electronic device 100 activates an AI assistant. Recognizing "Bixby", time information and business name can be obtained and the corresponding telephone number can be retrieved from the recent contact record.

The electronic device 100 may search the recent contact record for a contact record having 'April 20, 2018' and 'Grill and Chicken' as tagging information corresponding to the time information 'Next Friday' acquired from the user's voice. have. Referring to FIG. 11A, the electronic device 100 may find a contact record “02-1234-9876” having “April 20, 2018” and “grill and chicken” as tagging information. The electronic device 100 may confirm that the reservation time is 19:00 from the information tagged in the contact record, calculate a time that the user wants to change, and transmit a character requesting a reservation change to "02-1234-9876". have.

The information tagged in the recent contact record can be deleted together when the contact record is deleted by the user, and can also be automatically deleted together after the retention period of the contact record has passed.

In addition to tagging the information obtained in the conversation in the recent contact record, the electronic device 100 provides the information obtained in the conversation to the schedule management application, and the personal assistant uses the information in the schedule management application according to a user's request. You can reply to the user.

Meanwhile, according to another embodiment of the present disclosure, the electronic device 100 may add information obtained in a conversation to a contact list. This will be described with reference to FIG. 11B.

FIG. 11B is a diagram illustrating a contact list UI 1100 provided by the electronic device 100 according to an embodiment of the present disclosure.

The electronic device 100 may provide a contact list UI 1100 for contact information stored in the electronic device 100. The contact list UI 1100 may include UI items representing stored contacts. When the UI item is selected, the electronic device 100 may provide a UI including detailed information (phone number, email, etc.) of a contact corresponding to the selected UI item.

The electronic device 100 may obtain information (eg, a name for referring to a counterpart, a keyword representing a relationship with a counterpart, a counterpart of the counterpart, etc.) acquired from various conversation means (eg, a phone call, a text message, a message application, a chat application, an SNS application, etc.). Address, schedule information related to the other party, etc.) can be added to the contact list. For example, the electronic device 100 obtains 'honey', which is a name for acquaintance, in a conversation with Jane, and acquires 'Bulldog', which is a name for Hong Gil-dong, in a conversation with Hong Gil-dong, and stores the obtained information in the contact list. You can add In this case, as shown in FIG. 11B, the electronic device 100 includes a contact list including 'honey' 1110 in the UI item of 'recognition' and 'bulldog' 1120 in the UI item of 'Hong Gil-dong'. The UI 1100 may be provided.

Meanwhile, according to another exemplary embodiment of the present disclosure, when a contact is searched for in a contact list, the contact may be searched even if the search is performed by a name acquired through a conversation rather than an existing name. For example, referring to FIG. 11B, a contact may be searched by inputting a search term in the contact list UI 1100. In this case, if a contact is searched using 'bulldog' as a search term, a contact for Hong Gil-dong may be provided as a search result. .

FIG. 15 is a diagram for describing an embodiment of the present disclosure in which a contact is registered in association with an SNS application.

Referring to FIG. 15, the electronic device 100 searches for and registers a contact in an address book (or a friend list) of an SNS application (eg, KakaoTalk ™, Facebook ™, etc.) but not in the default contact application of the electronic device 100. can do. For example, as illustrated in FIG. 15, a contact for a self-bag, which is a person in the friend list of the SNS application but not in the basic contact application of the electronic device 100, may be newly registered in the basic contact application of the electronic device 100. In this case, items constituting the contact may be filled with information provided by the SNS application. For example, the phone number entry 1510, the email address entry 1520, the SNS ID entry 1530, and the like may be filled based on information provided by the SNS application.

Meanwhile, not only can a contact be newly registered based on the information provided from the SNS application, but it is also possible to fill in empty items among the items constituting an existing contact. For example, if the contact of the self-bag is already registered in the basic contact application of the electronic device 100, and the email address item of the items constituting the contact of the self-bag is empty, the user receives the email address of the self-bag from the SNS application. You can fill in the address fields.

 In addition, the electronic device 100 may acquire information related to the other party (a name referring to the other party, a relationship with the other party, a schedule with the other party, etc.) as described above in the conversation made through the SNS application, and the information may be obtained from the contact information. Can be included. For example, the electronic device 100 obtains the name 'Huskey', which refers to the self-back, in the conversation with the self-backed conversation made through the SNS application, and fills the obtained name in the alias item 1540 in the self-backed contact of the default contact application. You can ..

In this way, the information added to the contact information can be utilized for various functions such as a call function, a message transmission function, and an answer to a user voice inquiry as described above.

As described above, according to various embodiments of the present disclosure, contact information may be newly registered based on information obtained by various conversation means, or various conversation means (eg, a telephone, a text message, a message application, a chat application, etc. , SNS applications, etc.) can be stored in association with the existing contact information, and can be used for various functions.

16 is a flowchart of a network system using an artificial intelligence model, according to various embodiments of the present disclosure.

In FIG. 16, a network system using an artificial intelligence model may include a first component 2010 and a second component 2020.

Here, the first component 2010 may be the electronic device 100. The second component 2020 may be a server in which an artificial intelligence model is stored. Alternatively, the first component 2010 may be a general purpose processor, and the second component 2020 may be an artificial intelligence dedicated processor. Alternatively, the first component 2010 may be at least one application, and the second component 2020 may be an operating system (OS). That is, the second component 2020 is more integrated than the first component 2010, dedicated, delayed, has a high performance or has a lot of resources to generate the model as a component, Many operations required at the time of updating or applying may be a component capable of processing more quickly and effectively than the first component 2010.

An interface for transmitting / receiving data between the first component 2010 and the second component 2020 may be defined.

For example, an application program interface (API) having training data to be applied to a model as an argument value (or, a parameter value or a transfer value) may be defined. The API is a subroutine that can be called for any processing of one protocol (eg, a protocol defined in the electronic device 100) to another protocol (eg, a protocol defined in an external server of the electronic device 100) or Can be defined as a set of functions. That is, an API may provide an environment in which an operation of another protocol may be performed in one protocol.

Referring to FIG. 16, a user may communicate with a counterpart using the first component 2010 (S2001). For example, the first component 2010 may perform a conversation through a chat application or a telephone as described above.

The first component 2010 may transmit a conversation between the user and the counterpart to the second component 2020 (S2003). In the case of text-based conversations, the dialogue text may be transmitted to the second component 2020, and in the case of voice-based conversations, audio data including voice is transmitted to the second component 2020, or the first component. In operation 2010, the converted text may be transmitted to the second component 2020.

The second component 2020 may acquire information related to the counterpart in the conversation using the learned artificial intelligence model (S2005). The information related to the counterpart may include information such as a name indicating the counterpart, a relationship with the counterpart, an address of the counterpart, a schedule with the counterpart, and the like. In this case, the artificial intelligence model may be a model trained to determine information related to a counterpart in a conversation by using the conversation as input data.

The second component 2020 may transmit information related to the counterpart obtained in the conversation to the first component 2010 (S2007).

The first component 2010 may store information related to the counterpart obtained in the conversation in association with the contact information of the counterpart (S2009).

In addition, the first component 2010 may utilize information related to the counterpart stored in association with the contact information in various cases. For example, as in the above-described example, when a voice for requesting a call is input from the user, the first component 2010 searches for contact information corresponding to a name indicating a counterpart included in the voice, and corresponding contact information. A telephone connection can be made based on the information.

According to the embodiments described above, since meaningful information can be obtained from a private conversation of an individual and used for various functions, various user experiences can be made regardless of a predetermined name. The advantage is that you have more information to use.

The various embodiments described above may be implemented in software, hardware, or a combination thereof. According to a hardware implementation, embodiments described in the present disclosure may include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs). ), Processors, controllers, micro-controllers, microprocessors, and other electrical units for performing other functions. In particular, the various embodiments described above may be implemented by the processor 130 of the electronic device 100. According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

Various embodiments of the present disclosure may be implemented in software that includes instructions that may be stored in a machine-readable storage media. The machine is a device capable of calling a stored instruction from a storage medium and operating in accordance with the called instruction, and may include the control device 200 of the disclosed embodiments.

When such an instruction is executed by a processor, the processor may perform a function corresponding to the instruction by using other components directly or under the control of the processor. Instructions may include code generated or executed by a compiler or interpreter. For example, as the instructions stored in the storage medium are executed by the processor, the above-described control method of the electronic device 100 may be executed. For example, an instruction stored in a storage medium is executed by a processor of a device (or an electronic device), so that the artificial intelligence model learned by an artificial intelligence algorithm is used while talking to a user of another electronic device using the electronic device. Acquiring a name indicating a user of the other electronic device in a conversation with a user of the other electronic device by using the second electronic device; and storing the obtained name in association with contact information of the user of the other electronic device. The control method can be performed.

The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' means that the storage medium does not include a signal and is tangible, but does not distinguish that data is stored semi-permanently or temporarily on the storage medium.

According to an embodiment of the present disclosure, a method according to various embodiments of the present disclosure may be included in a computer program product. The computer program product may be traded between the seller and the buyer as a product. Computer program products may be distributed online in the form of device-readable storage media (eg compact disc read only memory (CD-ROM)) or through application stores (eg Play Store ™, App Store ™). have. In the case of an online distribution, at least a portion of the computer program product may be stored at least temporarily or temporarily created in a storage medium such as a server of a manufacturer, a server of an application store, or a relay server.

Each component (eg, a module or a program) according to various embodiments may be composed of a singular or plural number of objects, and some of the aforementioned subcomponents may be omitted, or various other subcomponents may be used. It may be further included in the embodiment. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity to perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or at least some operations may be executed in a different order, omitted, or another operation may be added. Can be.

While the above has been illustrated and described with respect to preferred embodiments of the present disclosure, the present disclosure is not limited to the above-described specific embodiments, and is normally carried out in the art without departing from the gist of the present disclosure as claimed in the claims. Various modifications may be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present disclosure.

100: electronic device

Claims (20)

In the control method of an electronic device,
While talking with a user of another electronic device using the electronic device, referring to a user of the other electronic device in a conversation with a user of the other electronic device using an AI model learned by an artificial intelligence algorithm. Obtaining a name; And
And storing the obtained name in association with contact information of a user of the other electronic device. The method of claim 1,
And when a user voice for making a call including the obtained name is input, performing a telephone connection based on contact information of the user of the other electronic device. The method of claim 1,
The obtaining step,
When a first name indicating a user of the other electronic device is previously registered in contact information of the user of the other electronic device, the first name in a conversation with the user of the other electronic device using the artificial intelligence model. A control method for acquiring a second name different from. The method of claim 3,
If a user voice for making a call including the second name is input, providing a message user interface (UI) for inquiring whether to make a telephone connection with the counterpart of the first name. . The method of claim 3,
If a user input for reading contact information of a user of the other electronic device is received, providing a contact information UI including a phone number, the first name, and the second name of the user of the other electronic device; The control method further comprising. The method of claim 1,
Providing a conversation UI for conducting a conversation with a user of the other electronic device;
The obtaining step,
And obtaining a name indicating a user of the other electronic device in a conversation input through the conversation UI using the artificial intelligence model. The method of claim 1,
The obtaining step,
And obtaining a name indicating a user of the other electronic device in the voice conversation using the artificial intelligence model while a voice conversation is performed with the user of the other electronic device. The method of claim 1,
The storing step,
And storing the name in association with contact information of the user of the other electronic device when the name indicating the user of the other electronic device is acquired more than a predetermined number in a conversation with the user of the other electronic device. The method of claim 1,
Storing the frequency with which the name referring to the user of the other electronic device is used in the conversation with the user of the other electronic device; And
When the same name as the name is associated with and stored in contact information of another user in addition to the contact information of the user of the other electronic device, if a user voice for making a call including the name is input, the frequency of using the name is further increased. And performing a telephone connection based on the contact information of the high user. The method of claim 1,
If a user voice including the name for transmitting a message is input, transmitting a message including the name at the beginning based on contact information of a user of the other electronic device. The method of claim 1,
Obtaining schedule information associated with a user of the other electronic device in a conversation with a user of the other electronic device using the artificial intelligence model; And
And storing the schedule information in association with contact information of a user of the other electronic device. The method of claim 11,
And when a user's voice requesting information on a conversation counterpart associated with the schedule information is input, providing an answer message UI including the name indicating a user of the other electronic device. The method of claim 1,
Adding a contact record with a user of the other electronic device to a recent contact record; And
Tagging the name in a contact record with a user of the other electronic device added to the recent contact record. In an electronic device,
Communication unit;
Memory for storing computer executable instructions; And
By executing the computer executable instructions,
During the conversation with the user of the other electronic device through the communication unit, a name indicating the user of the other electronic device in the conversation with the user of the other electronic device using the AI model learned by the AI algorithm. And a processor configured to obtain and store the acquired name in the memory in association with contact information of a user of the other electronic device. The method of claim 14,
It further comprises a microphone;
The processor,
And when a user voice for making a call including the obtained name is input through the microphone, making a telephone connection based on contact information of the user of the other electronic device. The method of claim 14,
The processor,
When a first name indicating a user of the other electronic device is pre-registered in the contact information of the user of the other electronic device, the first name in a conversation with the user of the other electronic device using the artificial intelligence model. An electronic device that obtains a second name that is different from. The method of claim 16,
It further includes a display;
The processor,
When a user voice for making a call including the second name is input through the microphone, a message UI (User interface) for inquiring whether to make a telephone connection with the other party of the first name is provided through the display. Electronic devices. The method of claim 16,
The processor,
When a user input for viewing contact information of a user of the other electronic device is received, a contact information UI including a phone number, the first name, and the second name of the user of the other electronic device is provided on the display. Electronic device. The method of claim 14,
It further includes a display;
The processor,
Provide a conversation UI for conducting a conversation with a user of the other electronic device through the display, and obtain a name indicating a user of the other electronic device in a conversation input through the conversation UI using the artificial intelligence model. Electronic device. The method of claim 14,
It further comprises a microphone;
The processor,
And obtaining a name indicating a user of the other electronic device in the voice conversation using the artificial intelligence model while the voice conversation is performed with the user of the other electronic device through the microphone.

Images