WO2017114048A1 - Terminal mobile et procédé pour identifier un contact - Google Patents

Terminal mobile et procédé pour identifier un contact Download PDF

Info

Publication number
WO2017114048A1
WO2017114048A1 PCT/CN2016/107329 CN2016107329W WO2017114048A1 WO 2017114048 A1 WO2017114048 A1 WO 2017114048A1 CN 2016107329 W CN2016107329 W CN 2016107329W WO 2017114048 A1 WO2017114048 A1 WO 2017114048A1
Authority
WO
WIPO (PCT)
Prior art keywords
contact
identified
data
information
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/107329
Other languages
English (en)
Chinese (zh)
Inventor
张圣杰
金蓉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Publication of WO2017114048A1 publication Critical patent/WO2017114048A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467—Methods of retrieving data
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/04—Details of speech synthesis systems, e.g. synthesiser structure or memory management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27453—Directories allowing storage of additional subscriber data, e.g. metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

  • This application relates to, but is not limited to, the field of communication technology.
  • the contact's photo and name are usually used to identify related contacts, thereby facilitating the user to query the contact information.
  • the identification of the contact is very simple and not vivid enough.
  • the user uses the contact to make a call or view the contact information, the user can only see the photo and name of the contact, and cannot see other information.
  • This paper proposes a mobile terminal and contact identification method to solve the technical problem that the identification method of contacts in the related art is very simple and not vivid.
  • a mobile terminal comprising:
  • Obtaining a module configured to: obtain a three-dimensional image and voiceprint feature information corresponding to the contact to be identified when receiving the contact identifier instruction;
  • the identifier module is configured to: identify, by using the three-dimensional image and voiceprint feature information acquired by the acquiring module, the contact to be identified;
  • the broadcast module is configured to: when viewing the contact information to be identified that is identified by the identifier module, perform a voice broadcast with the three-dimensional image and the voiceprint feature information of the contact to be identified.
  • the to-be-identified contact information includes: contact information to be identified in the contact application, or short message information sent by the contact to be identified in the short message application.
  • the broadcast module is configured to: view the identifier module
  • the voice broadcast of the three-dimensional image and the voiceprint feature information of the contact to be identified is performed, including:
  • the broadcasting module is configured to: view the identifier of the identifier module
  • the voice broadcast of the three-dimensional image and the voiceprint feature information of the contact to be identified is performed, including:
  • the broadcast module includes:
  • a synthesizing unit configured to: when viewing the contact information to be identified, determine a text to be broadcasted, and synthesize a standard pronunciation of the text to be broadcasted;
  • the modifying unit is configured to: modify the standard pronunciation synthesized by the synthesizing unit according to the voiceprint feature information of the to-be-identified contact, to obtain a sound waveform of the pronunciation feature of the contact to be identified;
  • an output unit configured to: output the sound waveform obtained by the modifying unit to perform voice broadcast, and display a three-dimensional image of the contact to be identified on a screen of the mobile terminal.
  • the acquiring module includes:
  • a shooting unit configured to: activate a panoramic shooting mode in a camera application of the mobile terminal to capture and store image data of the contact to be identified;
  • a first extracting unit configured to: extract, from the image data stored by the shooting unit, feature data for generating a three-dimensional image of the contact to be identified;
  • a generating unit configured to: according to the feature data extracted by the first extracting unit, activate a three-dimensional image engine to generate a three-dimensional image of the contact to be identified.
  • the photographing unit starts shooting of the mobile terminal
  • the panoramic shooting mode in the head application to capture and store the image data of the contact to be identified, including:
  • the first extracting unit includes:
  • the target stator unit is configured to: extract the portrait data in the image data stored by the photographing unit, and calibrate the portrait data of different orientations in the image data;
  • the method is configured to: acquire the feature data from the image data of the to-be-identified contact that is calibrated by the target stator unit in different orientations, where the feature data includes facial texture feature data and body proportion characteristics Data, hair styling data, wearing feature data, color characterization data.
  • the acquiring module further includes:
  • a copying unit configured to: when the call with the to-be-identified contact is detected, copy the received voice data of the to-be-identified contact, and use the copied voice data as the to-be-identified a sample of the voice of the contact;
  • the second extracting unit is configured to extract the voiceprint feature information from the sound samples obtained by the copying unit.
  • the copying unit is further configured to: when detecting that the recording function of the mobile terminal is enabled, copying the sound data of the to-be-identified contact transmitted by the microphone, and The copied sound data is used as a sound sample of the contact to be identified.
  • a contact identification method where the contact identification method includes:
  • the to-be-identified contact information includes: contact information to be identified in the contact application, or a short message sent by the contact to be identified in the short message application. information.
  • the viewing the to-be-identified contact identified by the identifier module is The information is broadcasted by the voice broadcast having the three-dimensional image and the voiceprint feature information of the contact to be identified, including:
  • the contact information to be identified When the contact information to be identified is viewed, the three-dimensional image of the contact to be identified is displayed on the screen of the mobile terminal, and the contact information to be identified is broadcasted by using the voiceprint feature information of the contact to be identified.
  • the viewing the identifier to be identified by the identifier module is When the contact information is obtained, a voice broadcast with the three-dimensional image and the voiceprint feature information of the contact to be identified is performed, including:
  • the voice broadcast having the three-dimensional image and the voiceprint feature information of the contact to be identified is performed, including:
  • the sound waveform is output for voice broadcast, and the three-dimensional image of the contact to be identified is displayed on the screen of the mobile terminal.
  • the obtaining a three-dimensional image corresponding to the contact to be identified includes:
  • a three-dimensional image engine is launched to generate a three-dimensional image of the contact to be identified.
  • the activating the panoramic shooting mode in the camera application of the mobile terminal to capture and store the image data of the to-be-identified contact includes:
  • the extracting the feature data for generating the three-dimensional image of the to-be-identified contact from the image data includes:
  • the feature data is acquired from the portrait data of the contact to be identified in different orientations, and the feature data includes face texture feature data, body scale feature data, hair style feature data, wearing feature data, and color feature data.
  • the acquiring the voiceprint feature corresponding to the to-be-identified contact includes:
  • Voiceprint feature information is extracted from the sound samples.
  • the obtaining the voiceprint feature corresponding to the contact to be identified further includes:
  • the sound data of the to-be-identified contact transmitted by the microphone is copied, and the copied sound data is used as the sound sample of the contact to be identified.
  • the mobile terminal and the contact identification method provided by the embodiment of the present invention when receiving a contact
  • the three-dimensional image and the voiceprint feature information of the contact to be identified are obtained, and the acquired three-dimensional image and the voiceprint feature information are used to identify the contact to be identified, thereby effectively solving the identification method of the contact in the related art. Very simple and not vivid enough.
  • the contact information of the to-be-identified contact information is broadcasted with the three-dimensional image of the contact to be identified and the contact voice feature information, thereby satisfying the increasing personality of the user. Demand, improve user experience and playability.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram showing the electrical structure of a camera in the mobile terminal shown in FIG. 1;
  • FIG. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure.
  • FIG. 4 is a schematic structural diagram of another mobile terminal according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic structural diagram of still another mobile terminal according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic structural diagram of a first extracting unit in a mobile terminal according to an embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of still another mobile terminal according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic diagram of a panoramic shooting process of a mobile terminal according to an embodiment of the present invention.
  • FIG. 9 is a schematic flowchart of a method for identifying a contact according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic flowchart diagram of another method for identifying a contact according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic flowchart diagram of still another method for identifying a contact according to an embodiment of the present disclosure.
  • FIG. 12 is a schematic flowchart of extracting feature data for generating a three-dimensional image of a contact to be identified in a method for identifying a contact according to an embodiment of the present disclosure
  • FIG. 13 is a schematic flowchart diagram of still another method for identifying a contact according to an embodiment of the present invention.
  • the mobile terminal can be implemented in various forms.
  • the terminal described in the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, etc.
  • Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal according to an embodiment of the present invention.
  • the mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and a controller 170.
  • Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.
  • the mobile communication module 111 transmits radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server.
  • a base station e.g., an access point, a Node B, etc.
  • Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.
  • the A/V input unit 120 is for receiving an audio or video signal.
  • the A/V input unit 120 may include a camera 121 and a microphone 122, the camera 121 being imaged in a video capture mode or an image capture mode
  • the image data of the still picture or video obtained by the capture device is processed.
  • the processed image frame can be displayed on the display module 151.
  • the image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal.
  • the microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data.
  • the processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode.
  • the microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.
  • the user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal.
  • the user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc.
  • a touch screen can be formed.
  • the sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal.
  • the sensing unit 140 can sense whether the slide type phone is turned on or off.
  • the sensing unit 140 includes an accelerometer 141 for detecting real-time acceleration of the mobile terminal 100 to derive a moving direction of the mobile terminal 100, and a gyroscope 142 for detecting the mobile terminal 100 with respect to a plane thereof slope.
  • Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner.
  • the output unit 150 may include a display module 151, an audio output module 152, an alarm module 153, and the like.
  • the display module 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display module 151 can display a user interface (UI) or graphical user interface (GUI) associated with a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capture mode, the display module 151 A captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like can be displayed.
  • UI user interface
  • GUI graphical user interface
  • the display module 151 can function as an input device and an output device.
  • the display module 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • OLED organic light emitting diode
  • a flexible display a three-dimensional (3D) display, and the like.
  • 3D three-dimensional
  • Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like.
  • TOLED Transparent Organic Light Emitting Diode
  • the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) .
  • the touch screen can be used to detect touch input pressure as well as touch input position and touch input area.
  • the audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like.
  • the audio signal is output as sound.
  • the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100.
  • the audio output module 152 can include a pickup, a buzzer, and the like.
  • the alert module 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert module 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm module 153 can provide an output in the form of vibrations that, when receiving a call, message, or some other incoming communication, can provide a haptic output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm module 153 can also provide an output of the notification event occurrence via the display module 151 or the audio output module 152.
  • a haptic output ie, vibration
  • the memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store information about when a touch is applied to the touch screen When outputting various ways of vibration and audio signal data.
  • the memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like.
  • the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
  • the controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like.
  • the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180.
  • the controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
  • the various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof.
  • the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle.
  • implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation.
  • the software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by
  • the mobile terminal has been described in terms of its function.
  • a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
  • FIG. 2 is a schematic diagram showing the electrical structure of a camera in the mobile terminal shown in FIG. 1.
  • the photographic lens 1211 may include a plurality of optical lenses forming an object image, and the optical lens may be Think of a single focus lens or zoom lens.
  • the photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance.
  • the lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.
  • An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211.
  • the imaging element 1212 is provided to image the subject image and acquire captured image data.
  • Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode.
  • the front surface of each pixel is provided with a Bayer array of red, green, blue (abbreviation: RGB) color filters.
  • the imaging element 1212 is connected to an imaging circuit 1213 that performs charge accumulation control and image signal readout control in the imaging element 1212, and reduces the reset noise after the read image signal (for example, an analog image signal).
  • the shaping is performed, and the gain is increased to obtain an appropriate signal level.
  • the imaging circuit 1213 is connected to an analog-to-digital conversion (A/D) converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal to the bus 1227 (hereinafter referred to as It is image data).
  • A/D analog-to-digital conversion
  • the bus 1227 is provided to transmit a transmission path of various data read or generated inside the camera.
  • the A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, and a Synchronous Dynamic Random Access Memory (SDRAM) 1218 are connected.
  • a memory interface hereinafter referred to as a memory I/F
  • a liquid crystal display (LCD) driver 1220 a memory interface
  • the image processor 1215 performs output buffering (Output Buffer, abbreviated as: OB) subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, and the image data based on the output of the imaging element 1212.
  • OB output buffering
  • the JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225.
  • the JPEG processor 1216 is for The line image reproduction display is performed to decompress the JPEG image data.
  • the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226.
  • the JPEG method is adopted as the image compression/decompression method.
  • the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.
  • the microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera.
  • the microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.
  • the operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button
  • the operation controls such as various input buttons and various input keys detect the operational state of these operation controls.
  • the detection result is output to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217.
  • the microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.
  • the flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217.
  • the microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.
  • the SDRAM 1218 is provided as an electrically rewritable volatile memory that temporarily stores image data or the like.
  • the SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.
  • the memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225.
  • the recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body.
  • the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.
  • the LCD driver 1210 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218.
  • the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. Yu In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data on the LCD 1226.
  • the LCD 1226 is configured to display an image on the back of the camera body.
  • the LCD 1226 may be an LCD, but is not limited thereto, and the LCD 1226 may be implemented by other display panels such as organic electroluminescence (EL), but is not limited thereto.
  • EL organic electroluminescence
  • the following embodiments of the mobile terminal provided by the embodiments of the present invention are based on the hardware structure of the mobile terminal and the electrical structure of the camera.
  • FIG. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • the mobile terminal provided by the embodiment of the present invention may include: an obtaining module 10, an identifying module 20, and a broadcast module 30.
  • the obtaining module 10 is configured to: when receiving the contact identifier instruction, obtain the three-dimensional image and the voiceprint feature information corresponding to the contact to be identified.
  • the shortcut icon for identifying the contact may be provided on the mobile terminal, and the user may trigger the contact identification instruction based on the shortcut icon; or may be provided by the mobile terminal for identifying the contact.
  • the physical button is used by the user to trigger the contact identification instruction based on the physical button; or the virtual button for identifying the contact may be provided on the mobile terminal, for the user to trigger the contact identification instruction based on the virtual button.
  • the voiceprint feature information in the embodiment of the present invention may be a voice spectrum parameter, a linear prediction parameter, a wavelet feature parameter, and the like of the voice signal.
  • the acquisition module 10 When the acquisition module 10 receives the user-triggered contact identification instruction, the acquisition module 10 acquires the three-dimensional image and voiceprint feature information corresponding to the to-be-identified contact stored in the storage unit of the mobile terminal. For example, if the user triggers an instruction to identify the information of the contact person and the three-dimensional image and voiceprint feature information of Xiao Wang, the obtaining module 10 acquires the three-dimensional image of Xiao Wang pre-stored in the mobile terminal and the voiceprint feature information of Xiao Wang.
  • the obtaining module 10 obtains the three-dimensional image of Xiao Li Wang pre-stored in the mobile terminal and the sound of Xiao Wang. Pattern feature information.
  • the identifier module 20 is configured to: identify the contact to be identified by using the three-dimensional image and the voiceprint feature information acquired by the acquiring module 10.
  • the identifier module 20 may identify the contact to be identified, that is, establish a three-dimensional image and voiceprint of the contact to be identified and the contact to be identified. The mapping relationship of feature information.
  • the broadcast module 30 is configured to: when viewing the contact information to be identified identified by the identification module 20, perform a voice broadcast with the three-dimensional image and the voiceprint feature information of the contact to be identified.
  • the to-be-identified contact information that is identified by the identifier module 20 may be the contact information to be identified in the contact application, or the short message information sent by the contact to be identified in the short message application.
  • the voice broadcast of the three-dimensional image and the contact voiceprint feature information of the contact to be identified may be: when the voice broadcast is performed, the three-dimensional image of the contact to be identified is displayed on the screen of the mobile terminal, and the contact to be identified is used at the same time.
  • the voiceprint feature information is voice broadcasted to the text information to be broadcast.
  • the broadcast module 30 displays the three-dimensional image of the contact on the screen of the mobile terminal, and broadcasts the contact information using the voiceprint feature information of the contact, the contact information includes a contact phone number, The contact address, the contact work unit, and the like; for example, if the contact information to be identified is the short message information sent by the contact to be identified in the short message application, when the short message information sent by the contact to be identified is viewed, the broadcast module 30 A three-dimensional image of the contact that sent the short message is displayed on the screen of the mobile terminal, and the short message content is broadcasted using the voiceprint feature information of the contact.
  • the idea of the embodiment of the present invention can also be applied to applications such as a voice assistant.
  • a voice assistant when a user opens a voice assistant, the user can select a contact that the user chats, and when the contact is selected, the screen of the mobile terminal The three-dimensional image associated with the contact is displayed, and during the chat, the character of the voice assistant uses the voiceprint feature information associated with the contact to broadcast the content of the chat, so that the user seems to be chatting with the real contact. To improve the user experience.
  • the mobile terminal provided by the embodiment of the present invention sets the acquisition module to: obtain the three-dimensional image and the voiceprint feature information of the contact to be identified when the contact identifier instruction is received, and the identifier module is set as:
  • the three-dimensional image and the voiceprint feature information are used to identify the contact to be identified, thereby effectively solving the problem that the identification method of the contact in the related art is very simple and not vivid.
  • the broadcast module to: When the contact information to be identified is identified, the voice information of the three-dimensional image and the voiceprint feature information of the contact to be identified is performed on the identified contact information, thereby satisfying the increasing personalized demand of the user and improving the user experience and Playful.
  • the embodiment of the present invention further provides a mobile terminal, as shown in FIG. 4, which is a schematic structural diagram of another mobile terminal according to an embodiment of the present invention.
  • the broadcast module 30 may include: a synthesizing unit 31, a modifying unit 32, and an output unit 33.
  • the synthesizing unit 31 is configured to: when viewing the contact information to be identified, determine the text to be broadcasted, and synthesize the standard pronunciation of the text to be broadcasted;
  • the modifying unit 32 is configured to: modify the standard pronunciation synthesized by the synthesizing unit 31 according to the voiceprint feature information of the contact to be identified, to obtain a sound waveform of the pronunciation feature of the contact to be identified;
  • the output unit 33 is configured to: output the sound waveform obtained by the modification unit 32 for voice broadcast, and display the three-dimensional image of the contact to be identified on the screen of the mobile terminal.
  • the synthesizing unit 31 when viewing the contact information to be identified, the synthesizing unit 31 first determines the text to be broadcasted, and synthesizes the standard pronunciation of the text to be broadcasted; and then, according to the modification unit 32, according to the voiceprint of the contact to be identified
  • the feature information is modified to the standard pronunciation synthesized by the synthesizing unit 31 to obtain a sound waveform of the pronunciation feature of the contact to be identified; finally, the sound waveform obtained by the output unit 33 is outputted by the output unit 33 for voice broadcast, and at the same time on the screen of the mobile terminal.
  • the three-dimensional image of the contact to be identified is displayed, and the voice broadcast of the three-dimensional image and the voiceprint feature information is realized.
  • the sound waveform obtained by the modifying unit 32 may be sent to the audio output interface for broadcast.
  • the audio output interface may include, for example, a microphone (Microphone, MIC for short), a headset, and a high High Definition Multimedia Interface (HDMI), built-in speakers, etc.
  • the voice broadcast of the voiceprint feature information of the contact to be identified when the voice broadcast of the voiceprint feature information of the contact to be identified is performed, the three-dimensional image of the contact to be identified is simultaneously displayed, so that the process of the voice broadcast is more vivid and the user experience is improved.
  • the embodiment of the present invention further provides a mobile terminal, as shown in FIG. 5, which is another mobile terminal structure provided by an embodiment of the present invention.
  • FIG. 5 is another mobile terminal structure provided by an embodiment of the present invention.
  • the present embodiment is illustrated by taking the structure of the mobile terminal shown in FIG. 3 as an example.
  • the obtaining module 10 in this embodiment may include: a photographing unit 11, a first extracting unit 12, and a generating unit 13.
  • the shooting unit 11 is configured to: activate a panoramic shooting mode in the camera application of the mobile terminal to capture and store image data of the contact to be identified.
  • the panoramic shooting mode in the camera application is activated by the shooting unit 11, and the photographing object (ie, the contact to be identified) is focused, and then the circular motion is started around the photographing object along the same distance, clockwise or counterclockwise.
  • the image data of the 360 degree orientation of the photographing object is obtained by the camera, as shown in FIG. 8 , which is a schematic diagram of a panoramic photographing process of the mobile terminal provided by the embodiment of the present invention.
  • gravity sensor, attitude sensor, gyroscope can be used during the shooting process.
  • the shooting module 30 can also save the captured panoramic photo (ie, image data) to the storage unit of the mobile terminal, so as to facilitate subsequent generation processing of the three-dimensional image.
  • the first extracting unit 12 is configured to extract feature data for generating a three-dimensional image of the contact to be identified from the image data stored by the photographing unit 11.
  • the feature data in the embodiment of the present invention may include: facial texture of the contact to be identified, 360 degree appearance features of the hairstyle, skin color, hair color, pupil color, height, wearing, limb ratio, and the like.
  • the generating unit 13 is configured to: according to the feature data extracted by the first extracting unit 12, activate a three-dimensional image engine to generate a three-dimensional image of the contact to be identified.
  • the generating unit 13 may start the three-dimensional image engine to generate the to-be-identified contact according to the feature data extracted by the first extracting unit 12.
  • the three-dimensional image of people In an actual application, the generating unit 13 may perform the ascending dimension calculation on the extracted feature data, calculate the length, width, height, and limb ratio data of the overall character in the three-dimensional space to generate a preliminary character model, and then use the image from the panorama.
  • the feature data extracted in the corresponding image data such as facial feature data, hair styling feature data, wearing feature data, color feature data, etc., are used to render the generated character models one by one.
  • the generating unit 13 may further perform splicing processing on the image information of different orientations by using a panoramic stitching fusion technology, thereby finally generating a three-dimensional character image corresponding to the photographed contact to be identified.
  • the three-dimensional image may also be saved in the storage unit, so as to contact the three-dimensional image with the to-be-identified identifier when receiving the contact identification instruction. People are connected.
  • the three-dimensional image engine is a three-dimensional graphics engine developed for facilitating generation of a three-dimensional image in the embodiment of the present invention.
  • a three-dimensional graphics application is generally written on a microcomputer using a large development tool such as an Open Graphics Library (OpenGL) or a multimedia programming interface (Direct eXtension, referred to as DirectX), but the three-dimensional graphics are involved.
  • OpenGL Open Graphics Library
  • DirectX multimedia programming interface
  • 3D graphics development environment that encapsulates hardware operations and graphics algorithms, as well as an easy-to-use and feature-rich environment.
  • This 3D graphics development environment can be called 3D graphics. engine.
  • the three-dimensional graphics engine includes, for example, an Object-Oriented Graphics Rendering Engine (OGRE) engine, an Open Scene Graph (OSG) engine, and the like.
  • OGI Object-Oriented Graphics Rendering Engine
  • OSG Open Scene Graph
  • the mobile terminal performs extraction of feature data required for generating a three-dimensional image based on the panoramic photo of the contact to be identified, and then starts the three-dimensional image engine to generate a corresponding three-dimensional image according to the extracted feature data.
  • the embodiment of the invention can conveniently and quickly generate a three-dimensional image of the captured object, and is used to identify the corresponding contact, thereby satisfying the personalized use requirement of the user and improving the user experience.
  • the embodiment of the present invention further provides a mobile terminal, as shown in FIG. 6, which is a first extracting unit of the mobile terminal provided by the embodiment of the present invention.
  • the first extraction unit 12 may include: a target stator unit 121 and an acquisition sub-unit 122.
  • the standard stator unit 121 is configured to: extract the portrait data in the image data stored by the photographing unit 11 and calibrate the portrait data of different orientations in the image data;
  • the target stator unit 121 may first extract the portrait data of the contact to be identified from the image data separately. deal with.
  • an image edge detection algorithm may be used to distinguish the person from the background environment, and then the corresponding determined pixel edge is closed.
  • the image data is extracted to obtain the portrait data of the contact to be identified.
  • the target stator unit 121 can also perform one-to-one calibration on the portrait data in the image data of different orientations for distinguishing.
  • the human body image data may be calibrated by using a human body orientation detection algorithm, such as calibrating a human body orientation every 45 degrees with respect to the front side of the human object, and the orientation of the human object for the 360 degree orientation may be calibrated to eight orientations.
  • the feature data in the corresponding person object image in different orientations is mostly different, so the character object feature data extraction in different orientation directions can be performed.
  • the obtaining sub-unit 122 is configured to: obtain feature data from the portrait data of the contact to be identified, which is calibrated by the standard stator unit 121, in different orientations, the feature data includes facial texture feature data, body scale feature data, and hairstyle feature data. , wearing feature data, color feature data.
  • the facial image data feature is a very important distinguishing feature. Therefore, in the embodiment of the present invention, the obtaining sub-unit 122 can perform face detection on all image data in different orientations, and determine image data of the presence of the face. The position of the face image is located, and then the position of the key point of the face is located on the basis of the image, for example, including the center of the eye, the corner of the mouth, the bridge of the nose, etc., due to the different shooting distances and angles selected during the shooting, the corresponding The head size and angle orientation of the characters in the image are also different. Therefore, the face can be obtained by scaling and/or rotating and/or stretching to obtain a preset standard size normal face avatar. The extraction of facial region feature data is performed.
  • the manner of extracting the feature data of the face region is not limited, for example, The local Binary Patterns (LBP) algorithm may be used, or the feature extraction may be performed by using a Histogram of Oriented Gradient (HOG) algorithm or a Gabor filter algorithm.
  • LBP Local Binary Patterns
  • HOG Histogram of Oriented Gradient
  • the obtaining sub-unit 122 may also determine the head, the upper body, the lower body and the limbs in the different orientation image data. a region for extracting feature data (ie, feature data of the body ratio) of the length ratio of the head, the upper body, the lower body, and the limbs of the contact to be identified.
  • feature data ie, feature data of the body ratio
  • the head, upper body, lower body and limbs of the person can be distinguished from the portrait data according to the relative positions of different parts of the human body and the correlation function, and then the head and upper body are extracted according to the proportion of the occupied pixels. Characteristic data of the length ratio of the lower body and the limbs.
  • the obtaining sub-unit 122 may also extract hairstyle feature data, wearing feature data, color feature data, and the like in the different orientation-down portrait data.
  • edge detection and feature extraction may be combined to obtain 360 degree appearance feature data of the contact hairstyle to be identified; according to the upper body and the lower body region, feature detection of the contact of the identified contact is performed, thereby extracting the clothing
  • the feature data and the feature data such as the main print; optionally, the acquisition sub-unit 122 may also extract the color feature data of the contact person's hair color, skin color, pupil color, and wearing color.
  • more feature data may be extracted from the overall image data of the contact to be identified, for example, including the most distinctive facial feature data and body limbs. Proportional data, hair styling data, wearing feature data, color characterization data, etc., to provide users with a more playable three-dimensional character image.
  • the embodiment of the present invention further provides a mobile terminal, as shown in FIG. 7 , which is a schematic structural diagram of another mobile terminal according to an embodiment of the present invention.
  • the embodiment is shown on the basis of the mobile terminal shown in FIG. 5, and the obtaining module 10 further includes: a copying unit 14 and a second extracting unit 15.
  • the copying unit 14 is configured to: when detecting a call with the to-be-identified contact, copy the received voice data of the to-be-identified contact, and use the copied voice data as the to-be-identified contact Sound sample.
  • the copying unit 14 copies the voice data transmitted by the opposite end through the audio input interface, and uses the copied voice data as the to-be-identified contact.
  • the sound sample of the person is copied; or the sound data transmitted by the microphone is copied through the audio input interface when the recording function is detected, and the copied sound data is used as the sound sample of the contact to be identified.
  • a sound sample can be collected by a copying method at a pulse code modulation (PCM) audio interface, and a sound data is copied as a sound sample of the contact to be identified. Extraction of voiceprint feature information.
  • PCM pulse code modulation
  • the second extracting unit 15 is configured to extract the voiceprint feature information from the sound samples obtained by the copying unit 14.
  • the second extracting unit 15 extracts the voiceprint feature information from the sound samples obtained by the copying unit 14.
  • the technique for extracting the voiceprint feature information may be: a base audio spectrum and its contour, the energy of the pitch frame, the appearance frequency of the pitch formant and its trajectory; linear prediction cepstrum, line spectrum pair, autocorrelation and log area ratio, Mel Frequency Cepstrum Coefficient (MFCC), perceptual linear prediction, wavelet transform technology, etc.
  • the information may also be saved to the storage unit of the mobile terminal, when the mobile terminal receives the contact identification instruction.
  • the voiceprint feature information is associated with the corresponding contact.
  • the voiceprint feature information of the contact to be identified is collected, thereby providing a basis for realizing voice broadcast according to the voiceprint feature information corresponding to the voice character.
  • FIG. 9 is a schematic flowchart of a method for identifying a contact provided by an embodiment of the present invention.
  • the method for identifying a contact may include the following steps, that is, S10 to S30:
  • the shortcut for identifying the contact may be provided on the mobile terminal.
  • the voiceprint feature information in the embodiment of the present invention may be a voice spectrum parameter, a linear prediction parameter, a wavelet feature parameter, and the like of the voice signal.
  • the mobile terminal When the mobile terminal receives the user-triggered contact identification instruction, the mobile terminal acquires the three-dimensional image and voiceprint feature information corresponding to the to-be-identified contact stored in the mobile terminal storage unit. For example, if the user triggers an instruction to identify the information of the contact Xiao Wang and the three-dimensional image and the voiceprint feature information of Xiao Wang, the three-dimensional image of Xiao Wang pre-stored in the mobile terminal and the voiceprint feature information of Xiao Wang are obtained; for example, The user triggers an instruction to identify the information of the contact Xiao Li and Xiao Li's three-dimensional image and voiceprint feature information, and obtains the three-dimensional image of Xiao Li Wang pre-stored in the mobile terminal and the voiceprint feature information of Xiao Wang.
  • the contact to be identified is identified, that is, the mapping relationship between the three-dimensional image and the voiceprint feature information of the contact to be identified is established.
  • the to-be-identified contact information may be the contact information to be identified in the contact application, or the short message information sent by the contact to be identified in the short message application.
  • the voice broadcast having the three-dimensional image and the voiceprint feature information of the contact to be identified may be: displaying the three-dimensional image of the contact to be identified on the screen of the mobile terminal during the voice broadcast, and using the voice of the contact to be identified
  • the pattern information is used for voice broadcast of the text information to be broadcast.
  • the contact information to be identified is the contact information to be identified in the contact application
  • when viewing the contact information of the three-dimensional image and the voiceprint feature information of the contact to be identified for example, when viewing the contact information to be identified in the contact application
  • the contact information is displayed, the three-dimensional image of the contact is displayed on the screen of the mobile terminal, and the contact information is broadcasted by using the voiceprint feature information of the contact, the contact information includes a contact phone number and a contact address.
  • the contact work unit, etc. for example, if the contact information to be identified is the short message information sent by the contact to be identified in the short message application, then the short message sent by the contact to be identified is viewed.
  • the three-dimensional image of the contact that sent the short message is displayed on the screen of the mobile terminal, and the short message content of the contact is used to broadcast the short message content.
  • the idea of the embodiment of the present invention can also be applied to applications such as a voice assistant.
  • a voice assistant when a user opens a voice assistant, the user can select a contact that the user chats, and when the contact is selected, the screen of the mobile terminal The three-dimensional image associated with the contact is displayed, and during the chat, the character of the voice assistant uses the voiceprint feature information associated with the contact to broadcast the content of the chat, so that the user seems to be chatting with the real contact. To improve the user experience.
  • An embodiment of the present invention provides a method for identifying a contact, by acquiring a three-dimensional image and voiceprint feature information of a contact to be identified when receiving a contact identification instruction, and using the acquired three-dimensional image and voiceprint feature information
  • the identification of the contact is performed to effectively solve the problem that the identification method of the contact in the related art is very simple and not vivid.
  • the contact information of the to-be-identified contact information is broadcasted with the three-dimensional image and the voiceprint feature information of the contact to be identified, thereby satisfying the increasing personalized demand of the user. Improve user experience and playability.
  • the embodiment of the present invention further provides a contact identification method, as shown in FIG. 10 , which is another contact identifier provided by the embodiment of the present invention.
  • FIG. 10 Schematic diagram of the process.
  • S30 may include the following steps, that is, S31 to S33:
  • S33 Output a sound waveform for voice broadcast, and display a three-dimensional image of the contact to be identified on a screen of the mobile terminal.
  • the text to be broadcast is first determined, and the standard pronunciation of the text to be broadcasted is synthesized; and then, according to the voiceprint characteristic letter of the contact to be identified
  • the standard pronunciation is modified to obtain the sound waveform of the pronunciation feature of the contact to be identified; finally, the sound waveform is output for voice broadcast, and the three-dimensional image of the contact to be identified is displayed on the screen of the mobile terminal to realize the three-dimensional image and Voice broadcast of voiceprint feature information.
  • the sound waveform may be sent to an audio output interface (such as a MIC, a headphone, an HDMI, a built-in speaker, etc.) for broadcast.
  • an audio output interface such as a MIC, a headphone, an HDMI, a built-in speaker, etc.
  • the voice broadcast of the voiceprint feature information of the contact to be identified when the voice broadcast of the voiceprint feature information of the contact to be identified is performed, the three-dimensional image of the contact to be identified is simultaneously displayed, so that the process of the voice broadcast is more vivid and the user experience is improved.
  • the embodiment of the present invention further provides a method for identifying a contact, as shown in FIG. A schematic diagram of the process of the contact identification method.
  • This embodiment is shown as an example on the basis of the embodiment shown in FIG. 9.
  • S10 in this embodiment may include the following steps, namely, S11 to S13:
  • the photographing object ie, the contact to be identified
  • the circular motion is started around the photographing object along the same distance, clockwise or counterclockwise, until
  • the camera acquires the image data of the 360-degree orientation of the photographed object, and also refers to the photographing process diagram shown in FIG.
  • gravity sensor, attitude sensor, gyroscope can be used during the shooting process.
  • the captured panoramic photo ie, image data
  • the captured panoramic photo can also be saved into the storage unit of the mobile terminal, so as to facilitate subsequent generation processing of the three-dimensional image.
  • the feature data required for the 3D image of the contact may include: facial texture of the contact to be identified, 360 degree appearance features of the hairstyle, skin color, hair color, pupil color, height, wearing, limb ratio, and the like.
  • the three-dimensional image engine is activated to generate a three-dimensional image of the contact to be identified.
  • the extracted feature data is subjected to the ascending dimension calculation, and the length, width, height and limb ratio data of the overall character in the three-dimensional space are calculated to generate a preliminary character model, and then the corresponding image from the panoramic image is used.
  • the feature data extracted in the data such as facial feature data, hair styling feature data, wearing feature data, color feature data, etc., are used to render the generated character models one by one.
  • the panoramic splicing fusion technology may also be used to splicing the image information of different orientations, thereby finally generating a three-dimensional character image corresponding to the captured contact to be identified.
  • the three-dimensional image may also be saved to the storage unit, so that when the mobile terminal receives the contact identification instruction, the three-dimensional image and the to-be-identified contact are Linked up.
  • the three-dimensional image engine is a three-dimensional graphics engine developed for facilitating generation of a three-dimensional image in the embodiment of the present invention.
  • a three-dimensional graphics application is generally written on a microcomputer using a large development tool such as OpenGL or DirectX.
  • OpenGL or DirectX a large development tool
  • the three-dimensional graphics involve many algorithms and professional knowledge, it is still difficult to rapidly develop a three-dimensional application. Therefore, the development of 3D applications requires a three-dimensional graphics development environment that encapsulates hardware operations and graphics algorithms, as well as an easy-to-use and feature-rich environment.
  • This three-dimensional graphics development environment can be called a three-dimensional graphics engine.
  • the three-dimensional graphics engine includes, for example, an OGRE engine, an OSG engine, and the like.
  • the mobile terminal performs extraction of feature data required for generating a three-dimensional image based on the panoramic photo of the contact to be identified, and then starts the three-dimensional image engine to generate a corresponding three-dimensional image according to the extracted feature data.
  • the embodiment of the invention can conveniently and quickly generate a three-dimensional image of the captured object, and is used to identify the corresponding contact, thereby satisfying the personalized use requirement of the user and improving the user experience.
  • the embodiment of the present invention further provides a method for identifying a contact, as shown in FIG. 12 , which is a method for identifying a contact provided by an embodiment of the present invention.
  • FIG. 12 A flow diagram for extracting feature data for generating a three-dimensional image of a contact to be identified.
  • the step S12 includes the following steps, that is, S121 to S122:
  • the portrait data of the contact to be identified may first be extracted from the image data and processed separately.
  • an image edge detection algorithm may be used to distinguish the person from the background environment, and then the corresponding determined pixel edge is closed.
  • the image data is extracted to obtain the portrait data of the contact to be identified.
  • the image data since the image data includes image data of different orientations, it is also possible to perform one-to-one calibration of the portrait data in the image data of different orientations for distinguishing.
  • the human body image data may be calibrated by using a human body orientation detection algorithm, such as calibrating a human body orientation every 45 degrees with respect to the front side of the human object, and the orientation of the human object for the 360 degree orientation may be calibrated to eight orientations.
  • the feature data in the corresponding person object image in different orientations is mostly different, so the character object feature data extraction in different orientation directions can be performed.
  • S122 Acquire feature data from the portrait data of the contact to be identified in different orientations, where the feature data includes face texture feature data, body scale feature data, hair style feature data, wearing feature data, and color feature data.
  • the facial image data feature is a very important distinguishing feature. Therefore, in the embodiment of the present invention, face detection can be performed on all image data in different orientations, and the face in the image data of the face is determined. The position of the image is located, and then the position of the key point of the face is located on the basis of the image, for example, including the center of the eye, the corner of the mouth, the bridge of the nose, etc., due to the different shooting distances and angles selected during the shooting, the corresponding characters in the image The head size and the angle orientation are also different. Therefore, the face can be obtained by scaling and/or rotating and/or stretching to obtain a normal standard face avatar of a preset standard size. Extraction of regional feature data.
  • the method for extracting the feature data of the face region is not limited, for example, the LBP calculation may be adopted.
  • the method, or the HOG algorithm, the Gabor filter algorithm, etc. performs feature extraction of the image.
  • the head, the upper body, the lower body and the limbs in the different orientation image data may be determined to extract Characteristic data of the length ratio of the head, upper body, lower body, and limbs of the contact to be identified (ie, feature data of the body ratio).
  • the head, upper body, lower body and limbs of the person can be distinguished from the portrait data according to the relative positions of different parts of the human body and the correlation function, and then the head and upper body are extracted according to the proportion of the occupied pixels. Characteristic data of the length ratio of the lower body and the limbs.
  • hair style feature data, wearing feature data, color feature data, and the like in different orientation-oriented portrait data may also be extracted.
  • edge detection and feature extraction may be combined to obtain 360 degree appearance feature data of the contact hairstyle to be identified; according to the upper body and the lower body region, feature detection of the contact of the identified contact is performed, thereby extracting the clothing Characteristic data such as shape and main printing; optionally, color feature data such as hair color, skin color, pupil color, and wearing color of the contact person can be extracted.
  • more feature data may be extracted from the overall image data of the contact to be identified, for example, including the most distinctive facial feature data and body limbs. Proportional data, hair styling data, wearing feature data, color characterization data, etc., to provide users with a more playable three-dimensional character image.
  • the embodiment of the present invention further provides a contact identification method, as shown in FIG. 13 , which is another contact identification method provided by an embodiment of the present invention.
  • FIG. 13 Schematic diagram of the process. This embodiment is shown as an example on the basis of the embodiment shown in FIG. 11.
  • S10 in this embodiment may further include the following steps, namely, S14 to S15:
  • the voice data transmitted by the opposite end is copied through the audio input interface, and the copied sound data is used as the voice data.
  • the sound sample can be collected by copying at the PCM audio interface, and a voice data is copied as the sound sample of the contact to be identified to extract the voiceprint feature information.
  • the voiceprint feature information is extracted from the sound sample.
  • the technique for extracting the voiceprint feature information may be: a base audio spectrum and its contour, the energy of the pitch frame, the appearance frequency of the pitch formant and its trajectory; linear prediction cepstrum, line spectrum pair, autocorrelation and log area ratio, MFCC , perceptual linear prediction; wavelet transform technology.
  • the information may be saved to the storage unit of the mobile terminal, where the mobile terminal obtains the voiceprint feature when receiving the contact identifier instruction.
  • the information is associated with the corresponding contact.
  • the voiceprint feature information of the contact to be identified is collected, thereby providing a basis for realizing voice broadcast according to the voiceprint feature information corresponding to the voice character.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better.
  • Implementation Based on such understanding, the technical solution in the embodiments of the present invention may be embodied in the form of a software product in essence or in a contribution to the related art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic
  • the disc, the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods provided by various embodiments and alternative embodiments of the present invention.
  • all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.
  • the devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.
  • the device/function module/functional unit in the above embodiment When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium.
  • the above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
  • the embodiment When receiving the contact identifier instruction, the embodiment obtains the three-dimensional image and the voiceprint feature information of the contact to be identified, and uses the acquired three-dimensional image and voiceprint feature information to identify the contact to be identified, thereby effectively
  • the problem that the identification of the contacts in the related art is very simple and not vivid enough is solved.
  • the contact information of the to-be-identified contact information is broadcasted with the three-dimensional image and the voiceprint feature information of the contact to be identified, thereby satisfying the increasing personalized demand of the user. Improve user experience and playability.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Library & Information Science (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un terminal mobile et un procédé pour identifier un contact. Le procédé pour identifier un contact consiste : à obtenir une image tridimensionnelle et des informations de caractéristique d'empreinte vocale qui correspondent à un contact à identifier lorsqu'une instruction d'identification de contact est reçue ; à identifier le contact à identifier par utilisation de l'image tridimensionnelle obtenue et des informations de caractéristique d'empreinte vocale ; et à réaliser une diffusion vocale comprenant l'image tridimensionnelle et des informations de caractéristique d'empreinte vocale du contact à identifier lorsque des informations du contact à identifier sont visualisées.
PCT/CN2016/107329 2015-12-28 2016-11-25 Terminal mobile et procédé pour identifier un contact Ceased WO2017114048A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201511004834.0 2015-12-28
CN201511004834.0A CN105635452B (zh) 2015-12-28 2015-12-28 移动终端及其联系人标识方法

Publications (1)

Publication Number Publication Date
WO2017114048A1 true WO2017114048A1 (fr) 2017-07-06

Family

ID=56049914

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/107329 Ceased WO2017114048A1 (fr) 2015-12-28 2016-11-25 Terminal mobile et procédé pour identifier un contact

Country Status (2)

Country Link
CN (1) CN105635452B (fr)
WO (1) WO2017114048A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112820270A (zh) * 2020-12-17 2021-05-18 北京捷通华声科技股份有限公司 语音播报方法、装置和智能设备
US11274102B2 (en) 2017-10-30 2022-03-15 Glaxosmithkline Intellectual Property Development Limited Compounds useful in HIV therapy

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105635452B (zh) * 2015-12-28 2019-05-10 努比亚技术有限公司 移动终端及其联系人标识方法
CN106686184A (zh) * 2017-01-13 2017-05-17 北京搜狗科技发展有限公司 一种添加联系人方法、电子设备及服务器
CN107680598B (zh) * 2017-09-04 2020-12-11 百度在线网络技术（北京）有限公司 基于好友声纹通讯录的信息交互方法、装置及其设备
CN111261139B (zh) * 2018-11-30 2023-12-26 上海擎感智能科技有限公司 文字拟人化播报方法及系统
CN110308792B (zh) * 2019-07-01 2023-12-12 北京百度网讯科技有限公司 虚拟角色的控制方法、装置、设备及可读存储介质
CN111798829A (zh) * 2020-06-30 2020-10-20 中国联合网络通信集团有限公司 语音朗读文字信息的方法、系统、计算机设备及存储介质
CN113012679A (zh) * 2021-02-20 2021-06-22 北京百度网讯科技有限公司 通过语音播报消息的方法、设备和介质
CN114549706A (zh) * 2022-02-21 2022-05-27 成都工业学院 一种动画生成方法及动画生成装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1379392A (zh) * 2001-04-11 2002-11-13 国际商业机器公司 具有情感的语音－语音翻译系统和方法
CN103067558A (zh) * 2013-01-17 2013-04-24 深圳市中兴移动通信有限公司 与通讯录中联系人的图片相关联的方法和装置
US20150046164A1 (en) * 2013-08-07 2015-02-12 Samsung Electronics Co., Ltd. Method, apparatus, and recording medium for text-to-speech conversion
CN104464716A (zh) * 2014-11-20 2015-03-25 北京云知声信息技术有限公司 一种语音播报系统和方法
CN105635452A (zh) * 2015-12-28 2016-06-01 努比亚技术有限公司 移动终端及其联系人标识方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101645954A (zh) * 2009-08-31 2010-02-10 深圳华为通信技术有限公司 终端通信录管理方法和终端设备
CN102170490B (zh) * 2011-03-18 2014-11-05 惠州Tcl移动通信有限公司 老人手机及其拨号方法
CN102915350A (zh) * 2012-09-29 2013-02-06 北京小米科技有限责任公司 一种查询联系人信息的方法、装置和设备
CN103035247B (zh) * 2012-12-05 2017-07-07 北京三星通信技术研究有限公司 基于声纹信息对音频/视频文件进行操作的方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1379392A (zh) * 2001-04-11 2002-11-13 国际商业机器公司 具有情感的语音－语音翻译系统和方法
CN103067558A (zh) * 2013-01-17 2013-04-24 深圳市中兴移动通信有限公司 与通讯录中联系人的图片相关联的方法和装置
US20150046164A1 (en) * 2013-08-07 2015-02-12 Samsung Electronics Co., Ltd. Method, apparatus, and recording medium for text-to-speech conversion
CN104464716A (zh) * 2014-11-20 2015-03-25 北京云知声信息技术有限公司 一种语音播报系统和方法
CN105635452A (zh) * 2015-12-28 2016-06-01 努比亚技术有限公司 移动终端及其联系人标识方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11274102B2 (en) 2017-10-30 2022-03-15 Glaxosmithkline Intellectual Property Development Limited Compounds useful in HIV therapy
CN112820270A (zh) * 2020-12-17 2021-05-18 北京捷通华声科技股份有限公司 语音播报方法、装置和智能设备

Also Published As

Publication number Publication date
CN105635452A (zh) 2016-06-01
CN105635452B (zh) 2019-05-10

Similar Documents

Publication Publication Date Title
CN108769562B (zh) 生成特效视频的方法和装置
WO2017114048A1 (fr) Terminal mobile et procédé pour identifier un contact
CN110502954B (zh) 视频分析的方法和装置
KR102018887B1 (ko) 신체 부위 검출을 이용한 이미지 프리뷰
WO2019109801A1 (fr) Procédé et dispositif de réglage de paramètre de photographie, support d'informations, et terminal mobile
CN108540724A (zh) 一种拍摄方法及移动终端
WO2017124899A1 (fr) Procédé, appareil et dispositif électronique de traitement d'informations
WO2017088714A1 (fr) Terminal mobile et procédé de génération d'image tridimensionnelle associé
CN112287852A (zh) 人脸图像的处理方法、显示方法、装置及设备
US8400532B2 (en) Digital image capturing device providing photographing composition and method thereof
CN113850709B (zh) 图像变换方法和装置
CN109360222B (zh) 图像分割方法、装置及存储介质
CN108848313A (zh) 一种多人拍照方法、终端和存储介质
CN110189348B (zh) 头像处理方法、装置、计算机设备及存储介质
CN108777766A (zh) 一种多人拍照方法、终端及存储介质
WO2021043121A1 (fr) Procédé, appareil, système et dispositif de changement de visage d'image et support de stockage
WO2022033272A1 (fr) Procédé de traitement d'images et dispositif électronique
JP2014146989A (ja) 撮像装置、撮像方法および撮像プログラム
CN115150542A (zh) 一种视频防抖方法及相关设备
CN117880634A (zh) 一种拍摄视频的方法及电子设备
JP2012257112A (ja) 撮像装置およびプログラム
CN115150543B (zh) 拍摄方法、装置、电子设备及可读存储介质
CN114429495A (zh) 一种三维场景的重建方法和电子设备
CN111898488B (zh) 视频图像的识别方法、装置、终端及存储介质
CN106878606A (zh) 一种基于电子设备的图像生成方法和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16880838

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16880838

Country of ref document: EP

Kind code of ref document: A1