WO2020211709A1 - 一种添加批注的方法及电子设备 - Google Patents

一种添加批注的方法及电子设备 Download PDF

Info

Publication number
WO2020211709A1
WO2020211709A1 PCT/CN2020/084348 CN2020084348W WO2020211709A1 WO 2020211709 A1 WO2020211709 A1 WO 2020211709A1 CN 2020084348 W CN2020084348 W CN 2020084348W WO 2020211709 A1 WO2020211709 A1 WO 2020211709A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
electronic device
user
annotation
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/084348
Other languages
English (en)
French (fr)
Inventor
蔡文迪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP20791516.6A priority Critical patent/EP3929716A4/en
Priority to JP2021561665A priority patent/JP7414842B2/ja
Publication of WO2020211709A1 publication Critical patent/WO2020211709A1/zh
Anticipated expiration legal-status Critical
Priority to US17/504,000 priority patent/US20220035995A1/en
Priority to JP2023222145A priority patent/JP2024041816A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/169—Annotation, e.g. comment data or footnotes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/532—Query formulation, e.g. graphical querying
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/171—Editing, e.g. inserting or deleting by use of digital ink

Definitions

  • This application relates to the field of terminal technology, and in particular, to a method and electronic equipment for adding comments.
  • stylus pens on electronic devices such as mobile phones and tablet computers.
  • the user can use the stylus to record text, patterns and other annotations on the electronic device.
  • the mobile phone when the user touches the touch panel of the mobile phone with a stylus, the mobile phone can detect changes in the electrical signal (such as a capacitance signal) of the contact point, thereby identifying the contact point of the stylus on the touch panel Position, and then record and recognize the annotation content entered by the stylus on the touch panel.
  • the electrical signal such as a capacitance signal
  • third-party applications installed on mobile phones need to set up additional interfaces to support users to enable handwritten annotation mode in third-party applications.
  • the running application does not support the handwriting annotation mode, the user cannot use the stylus pen to hand-write annotations in the current application interface, which greatly reduces the usage scenarios and scope of the stylus, and also makes the stylus use experience not tall.
  • the present application provides a method and electronic device for adding comments, which can enter the comment mode to add comments in any interface being displayed, thereby enriching the application scenarios of the stylus and improving the user experience of using the stylus.
  • this application provides a method for adding comments, including: the electronic device displays the first interface of the first application; if it is detected that the user performs a preset trigger operation, the electronic device can enter the comment mode in the first interface ; In the annotation mode, the electronic device can receive the first annotation added by the user on the first interface being displayed, and display the first annotation on the first interface; similarly, when the electronic device displays the second application (and the first One application is different) on the second interface (different from the first interface); if the user is detected to perform the above trigger operation, the electronic device can enter the annotation mode in the second interface; similarly, in the annotation mode, the electronic device can receive The second note added by the user on the second interface being displayed, and the second note is displayed on the second interface.
  • the method for adding annotations provided by this application can enter the annotation mode to receive user-added annotations when any interface is being displayed on the electronic device.
  • This method of adding annotations does not require any requirements for the display interface being displayed, nor does it require The application adds corresponding interfaces for adaptation, so the usage scenarios of the annotation mode can be enriched and the user experience can be improved.
  • the aforementioned first interface is an interface that can be dynamically updated in the first application, rather than an interface in a picture format.
  • the electronic device can also receive the first editing operation (such as playback operation, copy operation, sliding operation, click operation, etc.) performed by the user in the first interface, and the electronic device responds to the The first editing operation can correspondingly edit the content in the first interface, thereby updating the display content in the first interface.
  • the above second interface is also an interface that can be dynamically updated in the second application.
  • the electronic device After the electronic device enters the annotation mode in the second interface, it can also receive the second editing operation performed by the user in the second interface; similarly, respond to In the second editing operation, the electronic device can correspondingly edit the content in the second interface, thereby updating the display content in the second interface.
  • the electronic device enters the annotation mode on the first interface, which specifically refers to: the electronic device covers the annotation layer on the first interface, and the annotation layer includes the first interface corresponding to the first interface. Transparent area; at this time, the electronic device displays the first annotation added by the user on the first interface, specifically referring to: the electronic device displays the first annotation entered by the user on the first interface in the first transparent area.
  • the electronic device after entering the annotation mode, covers the annotation layer containing the transparent area on the first interface, so that the user can see the display content in the first interface through the transparent area. Furthermore, the user can add the first annotation in the transparent area corresponding to the first interface. In this way, the user adding comments in the transparent layer and the electronic device running the first application are relatively two independent processes, and the user adding comments will not affect the normal operation of the first application.
  • the method further includes: in response to a sliding operation of the user's finger, the electronic device may display the third interface of the first application.
  • the second transparent area of the annotation layer is covered on the third interface. That is, in the annotation mode, when the electronic device scrolls the screen to display the third interface subsequent to the first interface, the transparent area in the annotation layer can be scrolled synchronously so that the third interface covers the new second transparent area.
  • the electronic device displays the third interface of the first application, it further includes: the electronic device may receive a third remark input by the user on the third interface in the second transparent area, and display the third interface on the third interface. Three comments. In this way, in the annotation mode, the electronic device can add multiple annotations on different display interfaces in the application.
  • the method further includes: in response to the saving operation input by the user, the electronic device takes a screenshot of the first interface containing the first annotation Operate to obtain the first picture; the electronic device saves the first picture. That is, the electronic device can save the annotations added by the user in the way of screenshots.
  • the electronic device can also save the comments added by the user this time in other formats, and the embodiment of the present application does not impose any limitation on this.
  • the electronic device when the electronic device performs a screenshot operation on the first interface containing the first annotation, the electronic device may also display a first notification message, which is used to remind the user that the first annotation is being saved .
  • the method further includes: in response to the saving operation input by the user, the electronic device pair includes the first remark and Perform a screenshot operation on the first interface and the third interface of the third annotation to obtain the second picture; the electronic device saves the second picture. That is to say, when the user adds multiple annotations in different interfaces, the electronic device can save the multiple annotations added by the user through a long screenshot.
  • the electronic device when the electronic device performs a screenshot operation on the first interface and the third interface containing the first annotation and the third annotation, the electronic device may also display a second notification message, which is used for The user is prompted to save the first and second comments.
  • the electronic device may save the above-mentioned first picture in the memo application; similarly, the electronic device may also save the above-mentioned second picture in the memo application.
  • a folder for saving annotations can be preset in the memo application. Then, the storage location of the first picture and the second picture can be in the preset folder of the memo application, which is convenient for users to find .
  • a search bar may be set in the memo application, and the above method further includes: the electronic device receives a keyword input by the user in the search bar, and the keyword may be text in the first picture; in response to the user With the input search operation, the electronic device can display a memo list containing the keyword in the memo application, and the memo list containing the memo of the first picture. That is, the electronic device can retrieve the annotations related to the keyword according to the keyword input by the user, so that the user can quickly find the saved annotation content in the memo application.
  • the electronic device when the electronic device saves the first picture, it further includes: the electronic device saves the corresponding relationship between the first picture and the first interface; further, after the electronic device saves the first picture, it further includes : If it is detected that the user selects the first picture in the memo application, the electronic device can open the first application to display the first interface corresponding to the first picture; or if it is detected that the electronic device opens the first application to display the first interface, then The electronic device may display a third notification message, and the third notification message is used to prompt the user to find the annotations associated with the first interface, so that the user can view the annotations of related browsing content in time.
  • the above-mentioned trigger operation includes: a preset operation performed by the user on the stylus pen; wherein the first annotation and the second annotation are both annotations added by the user using the stylus pen.
  • the above annotation layer also includes a toolbar
  • the toolbar may include one or more of exit options, save options, eraser options, line thickness options, and line color options. The option is used to adjust the content of the annotation during the process of adding the annotation this time.
  • this application provides an electronic device including: a touch screen, one or more processors, a memory, and one or more computer programs; wherein the processor is coupled with the touch screen, the communication module and the memory, and one or more of the above A plurality of computer programs are stored in the memory, and when the electronic device is running, the processor executes one or more computer programs stored in the memory, so that the electronic device executes the method for adding annotations described in any one of the above.
  • the present application provides a computer storage medium including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to execute the method for adding comments as described in any one of the first aspect.
  • this application provides a computer program product, which when the computer program product runs on an electronic device, causes the electronic device to execute the method for adding comments as described in any one of the first aspect.
  • the electronic equipment described in the second aspect, the computer storage medium described in the third aspect, and the computer program product described in the fourth aspect provided above are all used to execute the corresponding methods provided above.
  • the beneficial effects that can be achieved please refer to the beneficial effects in the corresponding method provided above, which will not be repeated here.
  • FIG. 1 is a first structural diagram of an electronic device according to an embodiment of the application
  • FIG. 2 is a schematic diagram of an application scenario of an electronic device and a stylus provided by an embodiment of the application;
  • FIG. 3 is a schematic structural diagram of an operating system in an electronic device provided by an embodiment of the application.
  • FIG. 4 is a schematic diagram of a scenario for adding annotations according to an embodiment of the application.
  • FIG. 5 is an interactive schematic diagram of a method for adding annotations according to an embodiment of the application
  • FIG. 6 is a schematic diagram 1 of a scenario of a method for adding comments provided by an embodiment of the application.
  • FIG. 7 is a second schematic diagram of a scenario of a method for adding comments provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram 3 of a scenario of a method for adding comments provided by an embodiment of the application.
  • FIG. 9 is a fourth schematic diagram of a scenario of a method for adding comments provided by an embodiment of the application.
  • FIG. 10 is a schematic diagram 5 of a scenario of a method for adding comments provided by an embodiment of the application.
  • FIG. 11 is a sixth scenario diagram of a method for adding comments provided by an embodiment of this application.
  • FIG. 12 is a schematic diagram 7 of a method for adding annotations according to an embodiment of the application.
  • FIG. 13 is a schematic diagram eight of a scenario of a method for adding comments provided by an embodiment of the application.
  • FIG. 14 is a schematic diagram 9 of a scenario of a method for adding comments provided by an embodiment of the application.
  • 15 is a schematic diagram ten of a scene of a method for adding comments provided by an embodiment of the application.
  • 16 is a schematic diagram eleventh scene of a method for adding comments provided by an embodiment of this application.
  • FIG. 17 is a schematic diagram twelfth of a scenario of a method for adding comments provided by an embodiment of this application.
  • 18 is a schematic diagram thirteen of a method for adding comments provided by an embodiment of the application.
  • FIG. 19 is a second structural diagram of an electronic device according to an embodiment of the application.
  • FIG. 20 is a third structural diagram of an electronic device according to an embodiment of the application.
  • the method for adding annotations provided in the embodiments of this application can be applied to mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, netbooks, and personal digital assistants (Elect devices such as personal digital assistant (PDA), wearable electronic devices, virtual reality devices, etc., are not limited in the embodiment of the present application.
  • UMPC ultra-mobile personal computers
  • PDA personal digital assistant
  • wearable electronic devices virtual reality devices, etc.
  • FIG. 1 shows a schematic structural diagram of an electronic device 100.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone interface 170D, sensor module 180, camera 193, display screen 194 and so on.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous transmitter) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 can receive input from the battery 142 and/or the charging management module 140, and supply power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 may also be provided in the processor 110.
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100.
  • the mobile communication module 150 may include one or more filters, switches, power amplifiers, low noise amplifiers (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering and amplifying the received electromagnetic waves, and then transmitting them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating one or more communication processing modules.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic wave radiation via the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing, connected to the display 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, etc.
  • the display screen 194 includes a display panel.
  • the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one.
  • the electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the mobile phone 100 may include 1 or N cameras, and N is a positive integer greater than 1.
  • the camera 193 may be a front camera or a rear camera.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in a variety of encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 121 may be used to store one or more computer programs, and the one or more computer programs include instructions.
  • the processor 110 can execute the above-mentioned instructions stored in the internal memory 121 to enable the electronic device 100 to execute the method for intelligently recommending contacts provided in some embodiments of the present application, as well as various functional applications and data processing.
  • the internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store the operating system; the storage program area can also store one or more application programs (such as a gallery, contacts, etc.) and so on.
  • the data storage area can store data (such as photos, contacts, etc.) created during the use of the electronic device 101.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, universal flash storage (UFS), etc.
  • the processor 110 executes the instructions stored in the internal memory 121 and/or the instructions stored in the memory provided in the processor to cause the electronic device 100 to execute the smart device provided in the embodiments of the present application. Recommended number method, as well as various functional applications and data processing.
  • the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.
  • the speaker 170A also called a “speaker” is used to convert audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the electronic device 100 answers a call or voice message, it can receive the voice by bringing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can approach the microphone 170C through the mouth to make a sound, and input the sound signal to the microphone 170C.
  • the electronic device 100 may be provided with one or more microphones 170C.
  • the electronic device 100 may be provided with two microphones 170C, which can implement noise reduction functions in addition to collecting sound signals.
  • the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the earphone interface 170D is used to connect wired earphones.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association
  • the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., in the embodiments of the present application There are no restrictions on this.
  • the electronic device 100 provided in the embodiment of the present application may also include one or more devices such as a button, a motor, an indicator, and a SIM card interface, and the embodiment of the present application does not impose any limitation on this.
  • the electronic device 100 may also be equipped with a stylus 200.
  • the user can use the stylus pen 200 to write information such as text in a specific area displayed by the electronic device 100.
  • the electronic device 100 can display the movement track formed by the stylus pen 200 on the display screen.
  • the electronic device 100 can record the movement track formed by the stylus 200 on the display screen, and then recognize the corresponding text.
  • the stylus 200 and the electronic device 100 may communicate with each other through wireless communication methods such as Bluetooth and Wi-Fi.
  • wireless communication methods such as Bluetooth and Wi-Fi.
  • one or more buttons 201 may be provided on the stylus 200, and the buttons 201 may be physical buttons or virtual buttons. If it is detected that the user clicks on the button 201, the stylus 200 can send the key corresponding to the button 201 to the electronic device 100 via Bluetooth or the like. The electronic device 100 can perform corresponding operations by analyzing the key value sent by the stylus pen 200.
  • the stylus 200 can send the corresponding key value 001 to the electronic device 100.
  • the electronic device 100 can enter the comment mode in the interface being displayed.
  • the user can use the stylus pen 200 to handwrite the content of the comment on the display interface.
  • the electronic device 100 can recognize the annotation content handwritten by the user according to the movement track of the stylus 200 in the display interface, and save the annotation content in the display interface.
  • the above-mentioned stylus 200 may specifically be a resistive stylus, an electromagnetic stylus or a capacitive stylus, which is not limited in the embodiment of the present application.
  • the software system of the above electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of the present application takes a layered Android system as an example to illustrate the software structure of the electronic device 100.
  • FIG. 3 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
  • the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
  • the application layer can include a series of applications.
  • the application program may include APP (application) such as call, memo, browser, contact, camera, gallery, calendar, map, Bluetooth, music, video, short message, etc.
  • APP application
  • These applications may be pre-installed when the electronic device 100 is shipped from the factory, or downloaded and installed from the application market when the user uses the electronic device 100.
  • the embodiment of the present application does not impose any restriction on this.
  • the application framework layer provides application programming interfaces (application programming interface, API) and programming frameworks for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer can include a window manager, a content provider, a view system, a resource manager, and a notification manager.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • the content provider is used to store and retrieve data and make these data accessible to applications.
  • the data may include video, image, audio, phone calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls that display text and controls that display pictures.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can disappear automatically after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.
  • the system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the 2D graphics engine is a drawing engine for 2D drawing.
  • Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in a virtual machine.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, a sensor driver, etc., which are not limited in the embodiment of the present application.
  • the electronic device 100 can call the window manager to load a note for receiving annotations on the interface being displayed.
  • Layer can be called annotation layer. Since the annotation layer is on the top layer, the process of the user using the stylus pen 200 to input the content of the annotation on the display screen is actually the process of inputting the content of the annotation in the annotation layer by the stylus pen 200.
  • the window manager may send the motion track input by the stylus 200 received in the annotation layer to the processor for identification, thereby identifying the annotation content added by the user.
  • the display interface 401 of the browser APP can be displayed on the display screen.
  • the display interface 401 includes the user The content of the web page being viewed.
  • the window manager may load an annotation layer 402 on the display interface 401.
  • the annotation layer 402 may include a toolbar 403, and the toolbar 403 may include options such as eraser, line thickness, line color, and save or exit. These options are used to adjust the content of the annotation during the process of adding the annotation this time.
  • the window manager may set the area of the annotation layer 402 except for the toolbar 403 to be transparent. Then, after entering the annotation mode, the user can also see the display content in the display interface 401 (that is, the display content in the browser APP) through the annotation layer 402. In this way, the user can use the stylus pen 200 to annotate the display content in the display interface 401 in the transparent area of the annotation layer 402. Later, the window manager can call the screenshot application to take a screenshot and save the image formed after the annotation layer 402 is superimposed on the display interface 401. The image includes both the display content in the display interface 401 and the user using the stylus 200 to make comments. The annotation content added in the layer 402.
  • the electronic device 100 can load the annotation layer 402 on any display interface being displayed through the window manager. Since a transparent area is set in the annotation layer 402, the user can use the stylus 200 to annotate the display content in the original display interface in the transparent area of the annotation layer 402.
  • This method of adding annotations does not require any requirements on the display interface being displayed, and does not require the application installed in the application layer to add corresponding interfaces for adaptation.
  • the electronic device 100 can enter the handwriting annotation mode in any interface being displayed, which restores the user’s experience of adding annotations with paper and pen in real life, thereby enriching the application scenarios of the stylus and improving the user’s use of the stylus.
  • the handwriting annotation mode in any interface being displayed, which restores the user’s experience of adding annotations with paper and pen in real life, thereby enriching the application scenarios of the stylus and improving the user’s use of the stylus.
  • a mobile phone is used as an example of the electronic device 100.
  • FIG. 5 is a schematic flowchart of a method for adding comments provided by an embodiment of the application. As shown in Figure 5, the method for adding annotations may include:
  • the stylus pen In response to a preset operation performed by the user on the first button on the stylus pen, the stylus pen sends a first key value to the mobile phone, where the first key value is used to instruct the mobile phone to enter the annotation mode.
  • the stylus 200 can establish a Bluetooth connection with a mobile phone.
  • the button 201 on the stylus 200 may be the above-mentioned first button. If it is detected that the user has performed a preset operation on the button 201 (for example, a double-click operation, a single-click operation, or a long-press operation, etc.), it indicates that the user wants to enable the annotation mode of the mobile phone at this time, and use the stylus to add annotations on the display interface of the mobile phone.
  • a preset operation on the button 201 for example, a double-click operation, a single-click operation, or a long-press operation, etc.
  • the stylus 200 can send the corresponding key value 001 (ie, the first key value) to the mobile phone based on the established Bluetooth connection.
  • the first key value is used to instruct the mobile phone to enter the annotation mode of the stylus.
  • the mobile phone can continue to execute the following step S502 to enter the comment mode, which is convenient for the user to use the stylus to comment on the content in the display interface in the comment mode.
  • the mobile phone In response to the first key value sent by the stylus, the mobile phone loads an annotation layer on the first interface of the first application that is being displayed.
  • the annotation layer includes a first toolbar and a transparent area.
  • the mobile phone when the mobile phone receives the first key value sent by the stylus, it is displaying the first interface 601 of the browser APP, and the first interface 601 is the display screen at this time The top layer of the entire display screen in.
  • the first interface 601 can include a toolbar 602 of the browser APP, and one or more options such as sharing, commenting, and favorites can be set in the toolbar 602.
  • the mobile phone After receiving the above-mentioned first key value, the mobile phone can analyze the first key value so as to recognize that the user's operation intention at this time is to enable the annotation mode. In other words, by triggering the first button on the stylus, the mobile phone can quickly enter the comment mode for users to make comments.
  • the user can also trigger the mobile phone to enter the annotation mode in other ways. For example, if it is detected that the user has performed a preset operation in the first interface 601 being displayed, the mobile phone may enter the comment mode in response to the preset operation.
  • the preset operation may be a pressing operation, a tapping operation, a two-finger sliding operation, etc., which is not limited in the embodiment of the present application.
  • the mobile phone can load a new layer (namely the annotation layer 603) on the first interface 601, and the annotation layer 603 is the entire display on the display The top layer of the screen.
  • the annotation layer 603 may include a transparent area 604 and a first toolbar 605.
  • the first toolbar 605 is provided with functional options for adjusting the content of the annotation.
  • the first toolbar 605 can include one or more functions such as exiting the annotation mode, saving the annotation, adjusting the line thickness, adjusting the line color, and the eraser. Options.
  • the mobile phone may cover the first toolbar 605 in the annotation layer 603 on the toolbar 602 of the browser APP in the first interface 601.
  • the annotation layer 603 is at the topmost layer
  • the first interface 601 displayed by the browser APP before entering the annotation mode can be displayed through the transparent area 604 in the annotation layer 603.
  • the user can use the stylus to annotate the content in the first interface 601 in the annotation layer 603 at the top level, so that it will not affect the running browser APP, and it can also realize the real-time annotation of the current display interface.
  • the mobile phone may also display a prompt 606 to inform the user that the annotation mode is currently entered.
  • the mobile phone can also prompt the user to use a stylus pen to add a comment in the transparent area 604 of the comment layer 603 through text, voice or animation.
  • S503 The mobile phone receives the first comment input by the user on the first interface in the comment layer using the stylus pen.
  • the user can see the display content in the first interface 601 of the browser APP through the transparent area 604 of the annotation layer 603. Furthermore, the user can use the stylus pen to add comments on the corresponding display content, and the comments can include one or more content such as text, numbers, or patterns.
  • the user uses a stylus pen to circle the displayed content in the first interface 601 and mark it as "key".
  • the pattern formed by the user's circled content and the text "emphasis" are the first comment 701 added this time.
  • the mobile phone Since the layer that is actually at the top of the display screen is the annotation layer 603 at this time, the mobile phone actually receives and records the first annotation 701 entered by the user this time in the transparent area 604 of the annotation layer 603.
  • the display content in the first interface 601 in the browser APP is not modified. It should be noted that the user can add one or more annotations in the annotation layer 603 corresponding to the first interface 601, and the embodiment of the present application does not impose any limitation on this.
  • the mobile phone after the mobile phone receives an input event in the annotation mode, it can first determine whether the input event is an annotation event for the annotation layer 603. For example, if the input event is an input event formed by a stylus on the display screen, the mobile phone can determine that the input event is an annotation event for the annotation layer 603, and the mobile phone can display and record the user’s information on the annotation layer 603. The input content of the second time forms the first comment.
  • the input event is an input event formed by the user's finger on the display screen (for example, the user's finger sliding operation), it means that the user probably wants to operate the first interface 601 of the browser APP at this time, so the mobile phone can determine this time
  • the input event is not an annotation event for the annotation layer 603, and the mobile phone can continue to perform the following steps S506-S509 at this time.
  • the mobile phone can determine whether the input event is an input event formed by a stylus pen on the display screen or an input event formed by a user's finger on the display screen according to the size of the contact area in the aforementioned input event. Since the user’s finger has a large contact area with the display screen when sliding on the display screen, while the stylus has a small contact area with the display screen when sliding on the display screen, if the contact of the touch point in this input event is detected If the area is less than the preset value, the phone can determine that the input event is an input event formed by the stylus on the display; if it detects that the contact area of the contact in this input event is greater than the preset value, the phone can determine the input event It is the input event formed by the user's finger on the display screen.
  • the mobile phone can determine whether the input event is an input event formed by a stylus on the display screen or an input event formed by a user's finger on the display screen according to the magnitude of the electrical signal generated on the display screen by the aforementioned input event.
  • the browser APP can still dynamically update the content in the first interface 601.
  • the mobile phone can play the video or animation in the first interface 601 normally. That is to say, the process of the mobile phone receiving the user's annotation in the annotation layer 603 does not conflict with the process of playing the video or animation in the first interface 601 by the mobile phone.
  • the mobile phone can also receive the editing operation performed by the user on the first interface 601.
  • the editing operation may be a copy and paste operation.
  • the mobile phone can determine that the long press operation is for the first interface 601 of the browser APP, and the mobile phone can display an edit menu for copying text, etc.
  • the mobile phone can play the corresponding video or audio file in the first interface 601.
  • the browser APP in the mobile phone can normally edit or update the content in the first interface 601 in response to the touch event.
  • the mobile phone can display the movement track of the stylus pen in the annotation layer 603.
  • the mobile phone can also delete the first interface 601 while jumping to the new interface.
  • the overwritten annotation layer 603 exits the annotation mode.
  • the mobile phone can also continue to retain the annotation layer 603 while jumping to the new interface. Then, after the mobile phone jumps to the new interface, the annotation layer 603 is overlaid on the new interface after the mobile phone jumps, and the user can continue to add annotations on the new interface.
  • this input event acts on the first toolbar 605 of the annotation layer 603, no matter whether the input event is formed by the user using a stylus or the user using a finger, the mobile phone can determine that the input event is for the annotation The annotation event of layer 603.
  • the phone can delete the annotation layer 603 at the top level.
  • the annotation layer 603 is already The first note recorded is also deleted, and the first interface 601 of the browser APP is restored to the top layer.
  • the mobile phone can display a variety of optional line colors for the user to choose, and the color selected by the user will be used as the subsequent stylus when moving on the annotation layer 603 The color displayed.
  • the mobile phone can display a variety of optional thick and thin lines for the user to choose, and the thick and thin lines selected by the user will be used as a subsequent stylus to move on the annotation layer 603 The degree of thickness displayed at the time. If it is detected that the user selects the eraser option 705 in the first toolbar 605, the mobile phone can erase the line selected by the subsequent stylus on the annotation layer 603. If it is detected that the user selects the save option 706 in the first toolbar 605, the mobile phone can perform the following steps S504-S505 to save the annotations added this time.
  • the first toolbar 605 may also include options such as previous step, next step, and adding special effects, which are not limited in the embodiment of the present application.
  • the user can use a stylus to select a corresponding option in the first toolbar 605, or the user can also use a finger to select a corresponding option in the first toolbar 605, which is not limited in this embodiment of the application .
  • the mobile phone will take a screenshot of the first interface containing the first annotation to obtain the first picture.
  • the mobile phone can call the screenshot application to perform a screenshot operation on the interface being displayed on the display screen.
  • the first picture obtained by this screenshot operation includes both the first interface 601 of the browser APP and the user in the annotation layer 603. The first comment added to related content in the first interface 601.
  • the mobile phone may also automatically save the first interface 601 and the content in the first note after detecting that the user has added the first note in the first interface 601. For example, the mobile phone can automatically take a screenshot of the first interface 601 containing the first comment.
  • the mobile phone when the mobile phone takes a screenshot of the first interface 601 containing the first annotation, it may display a prompt 801 of the annotation being saved to prompt the user to save the annotation added this time.
  • the mobile phone can also delete the annotation layer 603 superimposed on the first interface 601 and exit the annotation mode.
  • the preview interface 902 of the first picture 901 may also be displayed.
  • the preview interface 902 may include a first picture 901 and a second toolbar 903.
  • One or more options such as sharing, starring, editing, and deleting are set in the second toolbar 903.
  • the user can perform operations such as picture sharing, picture deletion, or picture deletion on the first picture 901 through these options in the second toolbar 903.
  • the mobile phone can automatically hide the preview interface 902 and redisplay the first interface 601 of the browser APP to avoid previewing
  • the interface 902 disturbs the user's use of the browser APP.
  • the mobile phone adds the above first picture to the memo and saves it.
  • the first picture 901 can be automatically added as a memo to the memo APP.
  • the user can open the memo APP to find the memo 1001 containing the first picture 901. If it is detected that the user opens the memo 1001, as shown in (b) in FIG. 10, the mobile phone can display the first picture 901 containing the first comment in the memo APP.
  • the mobile phone when the mobile phone obtains the above-mentioned first picture 901 through a screenshot operation, it may also obtain the URL (uniform resource locator) address when the browser APP displays the first interface 601. Then, the mobile phone can save the URL address of the first interface 601 when saving the above-mentioned first picture 901 in the memo.
  • the mobile phone when the mobile phone displays the first picture 901 in the memo APP, if it detects that the user clicks on the first picture 901, as shown in Figure 11 (b), the mobile phone can The URL address of the interface 601 reopens the first interface 601 of the browser APP.
  • the mobile phone can establish an association between the saved annotation and the annotated page in the Memo APP, and the user can link to the page where the annotation was created for review when viewing the saved annotation.
  • the mobile phone when the mobile phone displays the preview interface 902 of the first picture 901, the user may be prompted to save the first picture 901 in the memo APP or the gallery APP. If the user chooses to save the comment added this time in the memo APP, as shown in (a) of FIG. 10, the mobile phone can add the first picture 901 as a memo to the memo APP. Correspondingly, if the user chooses to save the annotation added this time in the gallery APP, the mobile phone can save the first picture 901 in the gallery APP, and the user can find the image added this time annotation in the gallery APP.
  • the mobile phone can also save the first picture 901 in both the memo APP and the gallery APP at the same time, or the mobile phone can also save the first picture 901 in the mobile phone preset application (for example, the global collection APP).
  • the embodiments of the application do not impose any restriction on this.
  • the mobile phone when the mobile phone receives the first comment added by the user in the above comment layer 603, it can automatically recognize the specific text information in the first comment according to the movement track of the stylus. For example, the above first comment contains " The word "emphasis". Or, after the mobile phone obtains the above-mentioned first picture 901, the text information in the first picture 901 can be automatically extracted. For example, the mobile phone can extract the webpage content recorded in the first picture 901 through ORC (optical character recognition) technology. For another example, when it is detected that the user performs the operation of saving annotations, the mobile phone can obtain the URL address of the first interface 601 displayed by the current browser APP, and download the webpage content in the first interface 601 from the URL address. Then, the mobile phone can save the first picture 901 obtained by the screenshot and the text information in the first picture 901 in the memo 1001 together.
  • ORC optical character recognition
  • the mobile phone when the mobile phone creates the memo 1001, the relevant text information in the first picture 901 can be used as the title of the memo 1001.
  • the user when the user searches for the memo 1001 among multiple memos in the memo APP, the user can input related keywords in the first picture 901 in the search box 1002.
  • the mobile phone can retrieve the memo 1001 related to the keyword according to the keyword entered by the user.
  • the mobile phone can prompt the user with one or more memos containing the keyword as the search result, which is convenient for the user to quickly find the saved memo in the memo APP The content of comments.
  • the mobile phone in addition to saving the comments added by the user in the memo application in the form of screenshots, the mobile phone may also save the comments added by the user this time in other formats.
  • the mobile phone when the mobile phone detects that the user selects the save option 706 in the first toolbar 605, the mobile phone can obtain the URL of the first interface 601 of the browser APP that is currently displayed.
  • the specific display content in the first interface 601 can be obtained.
  • the mobile phone can also record the specific comment position of the first comment 701 in the first interface 601, the specific comment content in the first comment 701 and the time when the comment was added.
  • the mobile phone can generate a corresponding picture, text, PDF or Word format file, so as to save the first note 701 added this time in the file. Subsequently, the user can find the specific content annotated by the user in the first interface 601 in related applications.
  • the first interface 601 of the browser APP is still used as an example.
  • the user uses the stylus to input the first comment on the first interface 601, the user can also scroll the currently displayed first interface 601, and in the new display interface Continue to add other comments in.
  • the mobile phone executes the above step S503, if it receives the user's operation to scroll the screen, the mobile phone can continue to perform the following steps S506-S509 to add the second comment in the second interface.
  • the mobile phone In response to the user's input to scroll the screen, the mobile phone displays the second interface of the first application after scrolling the screen.
  • the annotation layer 603 is overlaid on the first interface 601 of the browser APP.
  • the user can annotate the content in the first interface 601 in the transparent area 604 of the annotation layer 603. If the user wants to continue to browse the subsequent content of the first interface 601 in the browser APP, the user can input a scrolling operation to the display screen.
  • the operation may be a sliding operation of the user's finger on the display screen.
  • the mobile phone After the mobile phone detects the user's finger sliding operation on the display, since the electrical signal generated by the finger on the display is different from the electrical signal generated by the stylus on the display, the mobile phone determines that the user's operation is the user's finger After the sliding operation, it can be determined that the sliding operation is for the browser APP, not for the annotation layer 603. Then, in response to the user's sliding operation, the display of the mobile phone can report this sliding event to the browser APP running in the application layer, as shown in Figure 13 (b), the browser APP can be in the display
  • the second interface 1301 is displayed by scrolling the screen.
  • the display content in the second interface 1301 may be partially the same as the display content in the first interface 601.
  • the mobile phone when the mobile phone scrolls the screen to display the second interface 1301, since the mobile phone has not exited the annotation mode, the mobile phone can simultaneously scroll the transparent area 604 in the annotation layer 603. Then, the first comment originally recorded in the transparent area 604 corresponding to the first interface 601 will also be hidden as the transparent area 604 scrolls.
  • the annotation layer 603 overlaid on the second interface 1301 of the browser APP does not include the above-mentioned first annotation.
  • S507 The mobile phone receives the second comment input by the user on the second interface in the comment layer using the stylus pen.
  • the user can see the display content in the second interface 1301 through the new transparent area 604 in the annotation layer 603. Furthermore, the user can use a stylus pen to add a second annotation 1401 on the corresponding display content.
  • the mobile phone since the layer that is actually on the top layer of the display screen is the annotation layer 603 at this time, the mobile phone actually receives and records the second input of the user in the transparent area 604 of the annotation layer 603. Remark 1401, the mobile phone has not modified the display content in the second interface 1301 in the browser APP at this time.
  • the user can continue to enter the scrolling screen operation, triggering the mobile phone to perform the above steps S506-S507 in a loop, so that the mobile phone can display different interfaces in the annotation mode Annotate the content separately.
  • the mobile phone can perform the following steps S508-S509 to save multiple annotations added by the user in different display interfaces this time.
  • the mobile phone will take a long screenshot of the interface containing the first comment and the second comment to obtain a second picture.
  • the mobile phone can automatically perform a long screenshot operation on the first interface 601 containing the first annotation and the second interface 1301 containing the second annotation (also called For screen recording operation).
  • the second picture obtained after the mobile phone takes a long screenshot contains not only the display content of the browser APP in the first interface 601 and the second interface 1301, but also the first comment added by the user on the first interface 601 and the user’s comment on the second interface.
  • a prompt 1501 may be displayed to prompt the user to save the annotation added this time.
  • the mobile phone can start scrolling display and save the article opened this time by the browser APP and the comments added by the user in different positions of the article. If the mobile phone detects that the user performs an operation to stop the screenshot (such as a tap operation) when the mobile phone scrolls to a certain position, the mobile phone can stop the screenshot, delete the annotation layer 603 superimposed on the interface of the browser APP, and exit the annotation mode. Then, the long screenshot saved by the mobile phone before the click operation is received is the second picture carrying this annotation.
  • the preview interface 1602 of the second picture 1601 can also be displayed. Similar to the preview interface 902 of the first picture 901 shown in FIG. 9, the preview interface 1602 of the second picture 1601 is provided with a third toolbar 1603. One or more options such as sharing, editing, and deleting are also set in the third toolbar 1603, which is not limited in the embodiment of the present application.
  • the mobile phone adds the above second picture to the memo and saves it.
  • the second picture 1601 can be added as a memo to the memo APP.
  • the mobile phone may set a folder 1701 for bookmarking annotations in the memo APP.
  • the mobile phone can display multiple memos in the memo APP, where each memo records the user's remarking process in the form of a picture.
  • the mobile phone may also set a secondary directory under the folder 1701 to save annotations of different categories.
  • the mobile phone can set a folder 1 corresponding to January, a folder 2 corresponding to February, etc. in the folder 1701 with a granularity of each month.
  • Folder 1 stores the notes saved by the mobile phone in January
  • folder 2 stores the notes saved by the mobile phone in February.
  • the mobile phone may use the application as the granularity, and set the folder A corresponding to the browser APP, the folder B corresponding to the e-book APP, etc. in the folder 1701.
  • Folder A stores various annotations saved by the user in the browser APP
  • folder B stores various annotations saved by the user in the e-book APP.
  • the mobile phone when the mobile phone adds the second picture 1601 to the memo APP, it can also record the URL address associated with the second picture 1601, that is, the URL address of the first interface (or second interface) displayed by the browser APP. .
  • the mobile phone when the user opens the browser APP again to browse the above-mentioned first interface (or second interface), the mobile phone can detect that the URL address currently opened by the browser APP is the same as the URL address already recorded by the mobile phone.
  • a notification message 1801 when the mobile phone displays the first interface (or the second interface) of the browser APP again, a notification message 1801 can be displayed. In the notification message 1801, the user is prompted to find the current display Annotations associated with the interface.
  • the mobile phone can automatically open the first picture 901 (or the second picture 1601) carrying the annotation content in the memo APP. In this way, when the user uses the browser APP, the mobile phone can automatically prompt the user of the annotations associated with the current browsing content, which is convenient for the user to check the previous annotations of the related browsing content in time.
  • the user can also manually trigger the mobile phone to find out whether the annotations associated with the current display interface are stored. For example, when the mobile phone displays the first interface (or second interface) of the browser APP again, if the user wants to find the annotation content associated with the current interface, the user can perform preset gestures (such as pressing operations, Knuckle tapping operation, etc.). Furthermore, in response to the gesture performed by the user in the current interface, the mobile phone can obtain the URL address of the current interface, and search the memo APP for whether there is a memo recorded with the URL address. If the URL address is found in the memo of the second picture 1601, it means that the user has added a comment on the same display interface, and the added comment is saved in the second picture 1601. Then, as shown in (a) of Figure 18, the mobile phone can display a notification message 1801 in the first interface of the browser APP, thereby prompting the user to find the annotation associated with the current display interface.
  • preset gestures such as pressing operations, Knuckle tapping operation, etc.
  • the mobile phone when the mobile phone displays the first interface (or the second interface) of the browser APP again, the mobile phone can determine the first interface opened by the user this time and the location of the first annotation according to the URL of each annotation saved in Table 1 above.
  • the first interface is the same.
  • the mobile phone can reproduce the first comment previously added by the user in the first interface displayed this time according to the specific comment location and comment content of the first comment recorded in Table 1.
  • the mobile phone can quickly reproduce the specific content of the previously added annotation in the current interface, and arouse the user's memory of the current interface and the corresponding annotation content. Improve user experience.
  • the user uses a stylus to add comments on the above first interface (or second interface) as an example. It is understandable that the user can also use a finger or other methods to add comments on the above first interface. Add one or more comments on one interface (or second interface).
  • the mobile phone can load the above-mentioned annotation layer on the first interface.
  • the mobile phone can set handwriting buttons and non-handwriting buttons in the toolbar of the annotation layer. If it is detected that the user selects the handwriting button, the mobile phone can display the touch track of the user's finger on the first interface in response to the touch event of the user's finger. At this time, the touch event is an annotation event for the annotation layer.
  • a touch event input by the user's finger when a touch event input by the user's finger is detected, it means that the touch event is a touch event for the first interface, and the mobile phone can update the content in the first interface in response to the touch event.
  • mobile phones can perform operations such as playing videos, copying text, or turning pages.
  • the mobile phone can also distinguish whether the user's finger touch operation is an annotation event for the annotation layer or a touch event for the first interface through a preset gesture. For example, after the mobile phone loads the above-mentioned annotation layer on the first interface, if a user input pressing operation (that is, a preset gesture) is detected, the mobile phone can determine the subsequently detected touch event as a touch event for the first interface. Before detecting the user's input and pressing operation, the mobile phone may determine the touch event of the user's finger as an annotation event in the annotation layer.
  • a user input pressing operation that is, a preset gesture
  • an embodiment of the present application discloses an electronic device, which can be used to implement the methods described in the above method embodiments.
  • the electronic device may specifically include: a receiving unit 1901, a display unit 1902, a screenshot unit 1903, and a saving unit 1904.
  • the receiving unit 1901 is used to support the electronic device to execute the procedures S501, S503, and S507 in FIG. 5;
  • the display unit 1902 is used to support the electronic device to perform the procedures S502 and S506 in FIG. 5;
  • the screenshot unit 1903 is used to support the electronic device to execute the diagram The processes S504 and S508 in 5;
  • the saving unit 1904 is used to support the electronic device to execute the processes S505 and S509 in FIG. 5.
  • all relevant content of the steps involved in the above method embodiments can be cited in the functional description of the corresponding functional module, which will not be repeated here.
  • an embodiment of the present application discloses an electronic device, including: a touch screen 2001, the touch screen 2001 includes a touch-sensitive surface 2006 and a display screen 2007; one or more processors 2002; a memory 2003; and one or Multiple computer programs 2004.
  • the aforementioned devices can be connected through one or more communication buses 2005.
  • the above-mentioned one or more computer programs 2004 are stored in the above-mentioned memory 2003 and configured to be executed by the one or more processors 2002, and the one or more computer programs 2004 include instructions, and the above-mentioned instructions can be used to execute the above-mentioned Each step in the embodiment should be implemented.
  • the above-mentioned electronic device may further include a communication module 2008.
  • the communication module 2008 can be used to interact with the stylus.
  • the above-mentioned processor 2002 may specifically be the processor 110 shown in FIG. 1
  • the above-mentioned memory 2003 may specifically be the internal memory 121 and/or the external memory 120 shown in FIG. 1
  • the above-mentioned display screen 2007 may specifically be FIG.
  • the communication module 2008 may be the mobile communication module 150 and/or the wireless communication module 160 shown in FIG. 1
  • the touch-sensitive surface 2006 may be the touch-sensitive surface in the sensor module 180 shown in FIG. Sensors, the embodiments of this application do not impose any restrictions on this.
  • the functional units in the various embodiments of the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • a computer readable storage medium includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Library & Information Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

一种添加批注的方法及电子设备，涉及终端技术领域，可在正在显示的任意界面中进入批注模式添加批注，从而丰富手写笔的应用场景，提高用户使用手写笔的使用体验。该方法包括：电子设备显示第一应用的第一界面；响应于预设的触发操作，电子设备在第一界面中进入批注模式；在批注模式下，电子设备在第一界面上显示用户添加的第一批注；电子设备显示第二应用的第二界面；响应于触发操作，电子设备在第二界面中进入批注模式；在批注模式下，电子设备在第二界面上显示用户添加的第二批注。

Description

一种添加批注的方法及电子设备
本申请要求在2019年4月17日提交中国国家知识产权局、申请号为201910310631.6、发明名称为“一种添加批注的方法及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域，尤其涉及一种添加批注的方法及电子设备。
背景技术
目前，一些生产厂商已经在手机、平板电脑等电子设备上搭载了手写笔。用户使用手写笔可在电子设备上记录文字、图案等批注内容。
以手机作为电子设备举例，用户使用手写笔与手机的触控面板接触时，手机可检测到接触点的电信号(例如电容信号)发生改变，从而识别出手写笔在触控面板上的接触点位置，进而记录并识别出手写笔在触控面板上输入的批注内容。
但是，安装在手机上的第三方应用需要设置额外的接口才能支持用户在第三方应用中开启手写批注模式。也就是说，如果正在运行的应用不支持使用手写批注模式，则用户无法使用手写笔在当前的应用界面中手写批注，这大大减少了手写笔的使用场景及范围，也使得手写笔的使用体验不高。
发明内容
本申请提供一种添加批注的方法及电子设备，可在正在显示的任意界面中进入批注模式添加批注，从而丰富手写笔的应用场景，提高用户使用手写笔的使用体验。
为达到上述目的，本申请采用如下技术方案：
第一方面，本申请提供一种添加批注的方法，包括：电子设备显示第一应用的第一界面；如果检测到用户执行预设的触发操作，则电子设备可在第一界面中进入批注模式；在批注模式下，电子设备可接收用户在正在显示的第一界面上添加的第一批注，并在第一界面上显示该第一批注；类似的，当电子设备显示第二应用(与第一应用不同)的第二界面(与第一界面不同)时；如果检测到用户执行上述触发操作，则电子设备可在第二界面中进入批注模式；同样，在批注模式下，电子设备可接收用户在正在显示的第二界面上添加的第二批注，并在第二界面上显示该第二批注。
也就是说，本申请提供的批注添加方法，可在正在电子设备显示任意界面时进入批注模式接收用户添加的批注，这种添加批注的方法对正在显示的显示界面不做任何要求，也不需要应用添加相应的接口进行适配，因此可丰富批注模式的使用场景提高用户的使用体验。
在一种可能的实现方式中，上述第一界面为第一应用中可以动态更新的界面，而不是图片格式的界面。例如，在电子设备在第一界面中进入批注模式之后，还可以接收用户在第一界面中执行的第一编辑操作(例如播放操作、复制操作、滑动操作、点击操作等)，电子设备响应该第一编辑操作可相应的编辑第一界面中的内容，从而更新第一界面中的显示内容。同样，上述第二界面也是第二应用中可以动态更新的界面，在电子设备在第二界面中进入批注模式之后，还可以接收用户在第二界面中执行的第二编辑操作；同样，响应于第二编辑操作，电子设备可相应的编辑第二界面中的内容，从而更新第二界面中的显示内容。
在一种可能的实现方式中，电子设备在第一界面中进入批注模式，具体是指：电子设备在第一界面上覆盖批注图层，该批注图层中包括与第一界面对应的第一透明区域；此时，电子设备在第一界面上显示用户添加的第一批注，具体是指：电子设备显示用户在第一透明区域中对第一界面输入的第一批注。
也就是说，进入批注模式后，电子设备通过在第一界面上覆盖包含透明区域的批注图层，使得用户透过该透明区域可以看到第一界面中的显示内容。进而，用户可在与第一界面对应的透明区域中添加第一批注。这样，用户在透明图层中添加批注与电子设备运行第一应用是相对两个独立的过程，用户在添加批注时不会影响第一应用的正常运行。
在一种可能的实现方式中，在电子设备在第一界面上显示用户添加的第一批注之后，还包括：响应于用户手指的滑动操作，电子设备可显示第一应用的第三界面，第三界面上覆盖有批注图层的第二透明区域。也就是说，在批注模式下，电子设备在滚动屏幕显示第一界面后续的第三界面时，可以同步滚动批注图层中的透明区域，使得第三界面上覆盖新的第二透明区域。
那么，在电子设备显示第一应用的第三界面之后，还包括：电子设备可在上述第二透明区域中接收用户对第三界面输入的第三批注，并显示在第三界面中显示该第三批注。这样，在批注模式下电子设备可以在应用内的不同显示界面中分别添加多个批注。
在一种可能的实现方式中，在电子设备显示用户在第一界面上添加的第一批注之后，还包括：响应于用户输入的保存操作，电子设备对包含第一批注的第一界面进行截屏操作，得到第一图片；电子设备保存第一图片。也即电子设备可通过截图的方式保存用户添加的批注。当然，电子设备也可以通过其他格式保存用户本次添加的批注，本申请实施例对此不做任何限制。
在一种可能的实现方式中，在电子设备对包含第一批注的第一界面进行截屏操作时，电子设备还可以显示第一通知消息，第一通知消息用于提示用户正在保存上述第一批注。
在一种可能的实现方式中，在电子设备显示用户在第二透明区域中对第三界面输入的第三批注之后，还包括：响应于用户输入的保存操作，电子设备对包含第一批注和第三批注的第一界面和第三界面进行截屏操作，得到第二图片；电子设备保存第二图片。也就是说，当用户在不同界面中添加了多个批注时，电子设备可通过长截图的方式保存用户添加的多个批注。
在一种可能的实现方式中，在电子设备对包含第一批注和第三批注的第一界面和第三界面进行截屏操作时，电子设备还可以显示第二通知消息，第二通知消息用于提示用户正在保存第一批注和第二批注。
在一种可能的实现方式中，电子设备可将上述第一图片保存在备忘录应用中；同样，电子设备将上述第二图片也保存在备忘录应用中。
在一种可能的实现方式中，备忘录应用内可预先设置用于保存批注的文件夹，那么，上述第一图片和第二图片的保存位置可位于备忘录应用的预设文件夹内，方便用户查找。
在一种可能的实现方式中，备忘录应用中可以设置搜索栏，上述方法还包括：电子设备接收用户在搜索栏中输入的关键词，该关键词可以为第一图片中的文字；响应于用户输入的搜索操作，电子设备可显示备忘录应用中包含该关键词的备忘录列表，该备忘录列表中包含第一图片的备忘录。也就是说，电子设备可根据用户输入的关键词检索到与该关键词相关的批注，方便用户在备忘录应用中快速查找到已保存的批注内容。
在一种可能的实现方式中，在电子设备保存第一图片时，还包括：电子设备保存第一图 片与第一界面之间的对应关系；进而，在电子设备保存第一图片之后，还包括：若检测到用户在备忘录应用中选中第一图片，则电子设备可打开第一应用显示与第一图片对应的第一界面；或者，若检测到电子设备打开第一应用显示第一界面，则电子设备可显示第三通知消息，第三通知消息用于提示用户查找到与第一界面关联的批注，方便用户及时查看曾经对相关浏览内容的批注。
在一种可能的实现方式中，上述触发操作包括：用户对手写笔执行的预设操作；其中，第一批注和第二批注均为用户使用手写笔添加的批注。
在一种可能的实现方式中，上述批注图层中还包括工具栏，该工具栏中可以包括退出选项、保存选项、橡皮擦选项、线条粗细选项以及线条颜色选项中的一个或多个，这些选项用于在本次添加批注的过程中对批注内容进行调整。
第二方面，本申请提供一种电子设备，包括：触摸屏、一个或多个处理器、存储器、以及一个或多个计算机程序；其中，处理器与触摸屏、通信模块和存储器均耦合，上述一个或多个计算机程序被存储在存储器中，当电子设备运行时，该处理器执行该存储器存储的一个或多个计算机程序，以使电子设备执行上述任一项所述的添加批注的方法。
第三方面，本申请提供一种计算机存储介质，包括计算机指令，当计算机指令在电子设备上运行时，使得电子设备执行如第一方面中任一项所述的添加批注的方法。
第四方面，本申请提供一种计算机程序产品，当计算机程序产品在电子设备上运行时，使得电子设备执行如第一方面中任一项所述的添加批注的方法。
可以理解地，上述提供的第二方面所述的电子设备、第三方面所述的计算机存储介质，以及第四方面所述的计算机程序产品均用于执行上文所提供的对应的方法，因此，其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果，此处不再赘述。
附图说明
图1为本申请实施例提供的一种电子设备的结构示意图一；
图2为本申请实施例提供的一种电子设备与手写笔的应用场景示意图；
图3为本申请实施例提供的一种电子设备内操作系统的架构示意图；
图4为本申请实施例提供的一种添加批注的场景示意图；
图5为本申请实施例提供的一种添加批注的方法的交互示意图；
图6为本申请实施例提供的一种添加批注的方法的场景示意图一；
图7为本申请实施例提供的一种添加批注的方法的场景示意图二；
图8为本申请实施例提供的一种添加批注的方法的场景示意图三；
图9为本申请实施例提供的一种添加批注的方法的场景示意图四；
图10为本申请实施例提供的一种添加批注的方法的场景示意图五；
图11为本申请实施例提供的一种添加批注的方法的场景示意图六；
图12为本申请实施例提供的一种添加批注的方法的场景示意图七；
图13为本申请实施例提供的一种添加批注的方法的场景示意图八；
图14为本申请实施例提供的一种添加批注的方法的场景示意图九；
图15为本申请实施例提供的一种添加批注的方法的场景示意图十；
图16为本申请实施例提供的一种添加批注的方法的场景示意图十一；
图17为本申请实施例提供的一种添加批注的方法的场景示意图十二；
图18为本申请实施例提供的一种添加批注的方法的场景示意图十三；
图19为本申请实施例提供的一种电子设备的结构示意图二；
图20为本申请实施例提供的一种电子设备的结构示意图三。
具体实施方式
下面将结合附图对本实施例的实施方式进行详细描述。
示例性的，本申请实施例提供的一种添加批注的方法可应用于手机、平板电脑、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、手持计算机、上网本、个人数字助理(personal digital assistant，PDA)、可穿戴电子设备、虚拟现实设备等电子设备，本申请实施例对此不做任何限制。
示例性的，图1示出了电子设备100的结构示意图。
电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，摄像头193以及显示屏194等。
可以理解的是，本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中，电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
充电管理模块140用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。在一些有线充电的实施例中，充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中，充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时，还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141可接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，显示屏194，摄像头193，和无线通信模块160等供电。在其他一些实施例中，电源管理模块141也可以设置于处理器110中。在另一些实施例中，电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括一个或多个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A，受话器170B等)输出声音信号，或通过显示屏194显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器110，与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(Bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块160可以是集成一个或多个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在一些实施例中，电子设备100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。在一些实施例中，手机100可以包括1个或N个摄像头，N为大于1的正整数。摄像头193可以是前置摄像头也可以是后置摄像头。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样，电子设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器121可以用于存储一个或多个计算机程序，该一个或多个计算机程序包括指令。处理器110可以通过运行存储在内部存储器121的上述指令，从而使得电子设备100执行本申请一些实施例中所提供的联系人智能推荐的方法，以及各种功能应用和数据处理等。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统；该存储程序区还可以存储一个或多个应用程序(比如图库、联系人等)等。存储数据区可存储电子设备101使用过程中所创建的数据(比如照片，联系人等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如一个或多个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。在另一些实施例中，处理器110通过运行存储在内部存储器121的指令，和/或存储在设置于处理器中的存储器的指令，来使得电子设备100执行本申请实施例中所提供的智能推荐号码的方法，以及各种功能应用和数据处理。
电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。电子设备100可以通 过扬声器170A收听音乐，或收听免提通话。
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风170C发声，将声音信号输入到麦克风170C。电子设备100可以设置一个或多个麦克风170C。在另一些实施例中，电子设备100可以设置两个麦克风170C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，电子设备100还可以设置三个，四个或更多麦克风170C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。
传感器模块180可以包括压力传感器，陀螺仪传感器，气压传感器，磁传感器，加速度传感器，距离传感器，接近光传感器，指纹传感器，温度传感器，触摸传感器，环境光传感器，骨传导传感器等，本申请实施例对此不做任何限制。
当然，本申请实施例提供的电子设备100还可以包括按键、马达、指示器以及SIM卡接口等一项或多项器件，本申请实施例对此不做任何限制。
在一些实施例中，如图2所示，电子设备100上还可以搭载手写笔200。用户可使用手写笔200在电子设备100显示的特定区域内书写文字等信息。电子设备100可将手写笔200在显示屏上形成的运动轨迹显示出来。并且，电子设备100可将手写笔200在显示屏上形成的运动轨迹记录下来，然后识别出对应的文字。
在本申请实施例中，手写笔200与电子设备100之间可通过蓝牙、Wi-Fi等无线通信方式进行通信。如图2所示，手写笔200上可设置一个或多个按键201，按键201可以为实体按键或虚拟按键。如果检测到用户点击按键201，则手写笔200可将与按键201对应的键值(key)通过蓝牙等方式发送给电子设备100。电子设备100通过解析手写笔200发来的键值可执行对应的操作。
例如，假设双击按键201这一操作对应的键值为001，键值001用于指示进入批注模式。那么，如果手写笔200检测到用户对按键201执行了双击操作，则手写笔200可将对应的键值001发送给电子设备100。电子设备100响应该键值001可在正在显示的界面中进入批注模式，在批注模式下用户可使用手写笔200在显示界面中手写批注内容。同时，电子设备100可根据手写笔200在显示界面中的运动轨迹识别用户手写的批注内容，并保存该显示界面中的批注内容。
其中，上述手写笔200具体可以为电阻式手写笔、电磁式手写笔或电容式手写笔，本申请实施例对此不做任何限制。
上述电子设备100的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的Android系统为例，示例性说明电子设备100的软件结构。
图3是本申请实施例的电子设备100的软件结构框图。
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层，安卓运行时(Android runtime)和系统库，以及内核层。
应用程序层可以包括一系列应用程序。
如图3所示，应用程序可以包括通话，备忘录，浏览器，联系人，相机，图库，日历，地图，蓝牙，音乐，视频，短信息等APP(应用，application)。这些应用可以是电子设备100出厂时预先安装的，也可以是用户使用电子设备100时从应用市场下载并安装的，本申请实施例对此不做任何限制。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图3所示，应用程序框架层可以包括窗口管理器，内容提供器，视图系统，资源管理器，通知管理器等。
其中，窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(Media Libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。2D图形引擎是2D绘图的绘图引擎。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动等，本申请实施例对此不做任何限制。
在本申请实施例中，如果电子设备100接收到手写笔200发来的键值用于指示开启批注模式，则电子设备100可调用窗口管理器在正在显示的界面上加载一个用于接收批注的图层(可称为批注图层)。由于批注图层位于顶层，因此，用户使用手写笔200在显示屏上输入批注内容的过程实际是手写笔200在批注图层中输入批注内容的过程。窗口管理器可将批注图层中接收到的手写笔200输入的运动轨迹发送给处理器进行识别，从而识别出用户添加的批注内容。
以电子设备100运行浏览器APP举例，如图4中的(a)所示，电子设备100在运行浏 览器APP时可在显示屏中显示浏览器APP的显示界面401，显示界面401中包括用户正在浏览的网页内容。当电子设备100通过蓝牙接收到手写笔200发来的键值(例如键值为001)后，说明用户触发了手写笔200上的按键201希望开启批注模式。进而，如图4中的(b)所示，窗口管理器可在显示界面401上加载一个批注图层402。批注图层402中可包括工具栏403，工具栏403中可包括橡皮擦、线条粗细、线条颜色、保存或退出等选项，这些选项用于在本次添加批注的过程中对批注内容进行调整。
示例性的，仍如图4中的(b)所示，窗口管理器可将批注图层402中除工具栏403之外的区域设置为透明的。那么，进入批注模式后，用户透过批注图层402还可以看到显示界面401中的显示内容(即浏览器APP中的显示内容)。这样，用户使用手写笔200可在批注图层402的透明区域对显示界面401中的显示内容进行批注。后续，窗口管理器可调用截图应用对批注图层402与显示界面401叠加后形成的图像进行截图并保存，该图像中既包括显示界面401中的显示内容，也包括用户使用手写笔200在批注图层402中添加的批注内容。
可以看出，在本申请实施例中，用户通过手写笔200触发电子设备100进入批注模式后，电子设备100通过窗口管理器可在正在显示的任意显示界面上加载批注图层402。由于批注图层402中设置有透明区域，因此，用户使用手写笔200可在批注图层402的透明区域对原本显示界面中的显示内容进行批注。这种添加批注的方法对正在显示的显示界面不做任何要求，也不需要应用程序层中安装的应用添加相应的接口进行适配。也就是说，电子设备100可在正在显示的任意界面中进入手写批注模式，还原了现实生活中用户使用纸笔添加批注的体验，从而丰富了手写笔的应用场景，提高用户使用手写笔的使用体验。
为了便于理解，以下结合附图对本申请实施例提供的一种添加批注的方法进行具体介绍。以下实施例中均以手机作为电子设备100举例说明。
图5为本申请实施例提供的一种添加批注的方法的流程示意图。如图5所示，该添加批注的方法可以包括：
S501、响应于用户对手写笔上第一按键执行的预设操作，手写笔向手机发送第一键值，第一键值用于指示手机进入批注模式。
仍以图2所示的手写笔200举例，手写笔200可与手机之间建立蓝牙连接。手写笔200上的按键201可以为上述第一按键。如果检测到用户对按键201执行了预设操作(例如双击操作、单击操作或长按操作等)，说明用户此时希望开启手机的批注模式，使用手写笔在手机的显示界面中添加批注。
手写笔200内预先设置有不同按键和不同操作对应的具体键值。例如，单击按键201对应的键值为010，双击按键201对应的键值为001。那么，检测到用户双击按键201后，手写笔200基于已建立的蓝牙连接可向手机发送对应的键值001(即第一键值)。该第一键值用于指示手机进入手写笔的批注模式。手机接收到第一键值后可继续执行下述步骤S502进入批注模式，方便用户在批注模式下使用手写笔对显示界面中的内容进行批注。
S502、响应于手写笔发送的第一键值，手机在正在显示的第一应用的第一界面上加载批注图层，批注图层包括第一工具栏和透明区域。
示例性的，如图6中的(a)所述，手机在接收到手写笔发来的第一键值时，正在显示浏览器APP的第一界面601，此时第一界面601为显示屏中整个显示画面的最顶层。第一界面601中可以包括浏览器APP的工具栏602，工具栏602中可以设置分享、评论、收藏等一项或多项选项。接收到上述第一键值后，手机可对该第一键值进行解析，从而识别出用户此时的操作意图为开启批注模式。也就是说，通过触发手写笔上的第一按键，手机可以快捷的进 入批注模式方便用户进行批注。
在另一些实施例中，用户也可以通过其他方式触发手机进入批注模式。例如，如果检测到用户在正在显示的第一界面601中执行了预设操作，则手机可响应该预设操作进入批注模式。例如，该预设操作可以是按压操作、敲击操作、双指滑动等操作，本申请实施例对此不做任何限制。
手机进入批注模式后，如图6中的(b)所示，手机可在第一界面601上加载新的图层(即批注图层603)，此时批注图层603为显示屏中整个显示画面的最顶层。批注图层603可包括透明区域604和第一工具栏605。第一工具栏605中设置有用于调整批注内容的功能选项，例如，第一工具栏605中可以包括退出批注模式、保存批注、调整线条粗细、调整线条颜色以及橡皮擦等一项或多项功能选项。
示例性的，手机可将批注图层603中的第一工具栏605覆盖在第一界面601中浏览器APP的工具栏602上。此时，虽然批注图层603位于最顶层，但透过批注图层603中的透明区域604可以显示出进入批注模式之前浏览器APP显示的第一界面601。后续，用户可使用手写笔在位于顶层的批注图层603中对第一界面601中的内容进行批注，这样既不会影响正在运行的浏览器APP，也可实现对当前显示界面实时添加批注的功能。
示例性的，仍如图6中的(b)所示，进入批注模式后，手机还可以显示提示606以告知用户当前已经入批注模式。又例如，手机还可以通过文字、语音或动画等方式提示用户使用手写笔在批注图层603的透明区域604中添加批注。
S503、手机接收用户使用手写笔在批注图层中对第一界面输入的第一批注。
仍以在上述第一界面601上覆盖批注图层603举例，进入批注模式后，用户透过批注图层603的透明区域604可以看到浏览器APP的第一界面601中的显示内容。进而，用户可使用手写笔在相应的显示内容上添加批注，批注中可以包括文字、数字或图案等一项或多项内容。
如图7所示，用户使用手写笔对第一界面601中的显示内容进行圈选，并标记为“重点”。此时，用户圈选内容形成的图案以及文字“重点”即为本次添加的第一批注701。由于此时显示屏中实际位于顶层的图层为批注图层603，因此，手机实际是在批注图层603的透明区域604中接收并记录用户本次输入的第一批注701，手机此时并未修改浏览器APP中第一界面601内的显示内容。需要说明的是，用户可以在与第一界面601对应的批注图层603中添加一个或多个批注，本申请实施例对此不做任何限制。
在一些实施例中，手机在批注模式下接收到输入事件后，可以先判断该输入事件是否为针对批注图层603的批注事件。例如，如果该输入事件为手写笔在显示屏上形成的输入事件，则手机可确定该输入事件为针对批注图层603的批注事件，那么，手机可在批注图层603上显示并记录用户本次的输入内容，形成第一批注。如果该输入事件为用户手指在显示屏上形成的输入事件(例如用户手指的滑动操作)，说明用户此时很可能是希望对浏览器APP的第一界面601进行操作，因此手机可确定本次输入事件不是针对批注图层603的批注事件，此时手机可继续执行下述步骤S506-S509。
示例性的，手机可根据上述输入事件中接触面积的大小，确定该输入事件是手写笔在显示屏上形成的输入事件还是用户手指在显示屏上形成的输入事件。由于用户手指在显示屏上滑动时与显示屏的接触面积较大，而手写笔在显示屏上滑动时与显示屏的接触面积较小，因此，如果检测到本次输入事件中触点的接触面积小于预设值，则手机可确定该输入事件是手写笔在显示屏上形成的输入事件；如果检测到本次输入事件中触点的接触面积大于预设值， 则手机可确定该输入事件是用户手指在显示屏上形成的输入事件。
又或者，由于手指在显示屏上生成的电信号与手写笔在显示屏上生成的电信号不相同，例如，手指接触显示屏后生成的电容信号强度在第一阈值范围内，而手写笔接触显示屏后生成的电容信号强度在第二阈值范围内。那么，手机可根据上述输入事件在显示屏上生成的电信号的大小，确定该输入事件是手写笔在显示屏上形成的输入事件还是用户手指在显示屏上形成的输入事件。
在本申请实施例中，手机在上述第一界面601上覆盖了批注图层603后，浏览器APP仍然可以动态更新第一界面601中的内容。例如，当第一界面601包括视频或动画时，手机可正常在第一界面601中播放该视频或动画。也就是说，手机在在批注图层603中接收用户添加批注的过程，与手机在第一界面601中播放视频或动画的过程不冲突。
又例如，手机在上述第一界面601上覆盖了批注图层603后，手机还可以接收用户对第一界面601执行的编辑操作。例如，该编辑操作可以是复制粘贴的操作。检测到用户手指长按显示屏后，手机可确定出该长按操作是针对浏览器APP的第一界面601的操作，则手机可显示用于复制文本的编辑菜单等。又例如，当第一界面601中设置有播放按钮时，如果检测到用户点击该播放按钮，则手机可在第一界面601中播放相应的视频或音频文件。
也就是说，用户使用手写笔在第一界面601上添加批注时不会影响浏览器APP正常运行上述第一界面601。当手机接收到用户手指的触摸事件后，手机中的浏览器APP可正常响应该触摸事件编辑或更新第一界面601中的内容。当手机接收到手写笔的触摸事件后，手机可在批注图层603中显示手写笔的运动轨迹。
当然，如果用户在第一界面601中执行了跳转界面的操作，例如用户点击返回按钮或用户点击网页链接的操作，则手机在跳转至新界面的同时，还可删除第一界面601上覆盖的批注图层603，退出批注模式。或者，手机也可以在跳转至新界面的同时继续保留该批注图层603。那么，手机跳转至新界面后，批注图层603覆盖在手机跳转后的新界面上，用户可在新界面上继续添加批注。
另外，如果本次输入事件作用于批注图层603的第一工具栏605，则无论该输入事件是用户使用手写笔形成的，还是用户使用手指形成的，手机均可确定该输入事件为针对批注图层603的批注事件。
仍如图7所示，手机进入批注模式后，如果检测到用户选中第一工具栏605中的退出选项702，则手机可删除位于顶层的批注图层603，此时，批注图层603中已经记录的第一批注也一并被删除，浏览器APP的第一界面601恢复为最顶层的图层。如果检测到用户选中第一工具栏605中调整线条颜色的选项703，则手机可显示多种可选的线条颜色供用户选择，用户选中的颜色将作为后续手写笔在批注图层603上运动时显示的颜色。如果检测到用户选中第一工具栏605中调整线条粗细的选项704，则手机可显示多种可选的粗细线条供用户选择，用户选中的粗细线条将作为后续手写笔在批注图层603上运动时显示的粗细程度。如果检测到用户选中第一工具栏605中的橡皮擦选项705，则手机可擦除后续手写笔在批注图层603上选中的线条。如果检测到用户选中第一工具栏605中的保存选项706，则手机可执行下述步骤S504-S505保存本次添加的批注。当然，第一工具栏605还可以包括上一步、下一步、添加特效等选项，本申请实施例对此不做任何限制。
示例性的，用户可使用手写笔在第一工具栏605中选择相应的选项，或者，用户也可以使用手指在第一工具栏605中选择相应的选项，本申请实施例对此不做任何限制。
S504、若检测到用户保存本次批注的操作，手机对包含第一批注的第一界面进行截图， 得到第一图片。
如果检测到用户选中上述第一工具栏605中的保存选项706，说明用户执行了保存本次批注的操作。此时，手机可调用截图应用对显示屏中正在显示的界面执行截图操作，本次截图操作得到的第一图片中既包括浏览器APP的第一界面601，同时还包括批注图层603中用户对第一界面601中相关内容添加的第一批注。
或者，手机也可以在检测到用户在第一界面601中添加第一批注后，自动保存第一界面601以及第一批注中的内容。例如，手机可自动对包含第一批注的第一界面601进行截图。
同时，如图8所示，手机对包含第一批注的第一界面601进行截图时，可显示正在保存批注的提示801，以提示用户正在保存本次添加的批注。另外，手机还可以删除在第一界面601上叠加的批注图层603，退出批注模式。
在一些实施例中，如图9所示，手机通过截图操作得到包含上述第一批注的第一图片901后，还可以显示第一图片901的预览界面902。预览界面902中可以包括第一图片901以及第二工具栏903。第二工具栏903中设置有分享、标星、编辑以及删除等一项或多项选项。用户通过第二工具栏903中的这些选项可对第一图片901执行图片分享、图片删除或图片删除等操作。示例性的，如果手机显示上述预览界面902后在预设时间内没有接收到用户的任何输入操作，则手机可自动隐藏该预览界面902，并重新显示浏览器APP的第一界面601，避免预览界面902对用户使用浏览器APP造成打扰。
S505、手机将上述第一图片添加至备忘录中保存。
手机通过截图操作得到包含上述第一批注的第一图片901后，可自动将该第一图片901作为一项备忘录添加至备忘录APP中。此时，如图10中的(a)所示，用户可打开备忘录APP查找到包含第一图片901的备忘录1001。如果检测到用户打开该备忘录1001，则如图10中的(b)所示，手机可在备忘录APP中显示包含第一批注的第一图片901。
在一些实施例中，手机通过截图操作获取上述第一图片901时，还可以获取浏览器APP显示第一界面601时的URL(uniform resource locator，统一资源定位符)地址。那么，手机在备忘录中保存上述第一图片901时可一同保存第一界面601的URL地址。如图11中的(a)所示，手机在备忘录APP中显示第一图片901时，如果检测到用户点击第一图片901，则如图11中的(b)所示，手机可根据第一界面601的URL地址重新打开浏览器APP的第一界面601。也就是说，手机可在备忘录APP中建立已保存的批注与被批注的页面之间的关联关系，用户可在查看已保存的批注时可链接至创建该批注的页面中进行回顾。
或者，如图12所示，手机在显示第一图片901的预览界面902时，可提示用户将第一图片901保存在备忘录APP或图库APP中。如果用户选择将本次添加的批注保存在备忘录APP中，则如图10中的(a)所示，手机可将该第一图片901作为一项备忘录添加至备忘录APP中。相应的，如果用户选择将本次添加的批注保存在图库APP中，则手机可将第一图片901保存在图库APP中，用户在图库APP中可以查找到本次添加批注的图片。当然，手机也可以将第一图片901既保存在备忘录APP中，同时也保存在图库APP中，或者，手机还可以将第一图片901保存至手机预设的应用(例如全局收藏APP)中，本申请实施例对此不做任何限制。
在一些实施例中，手机在上述批注图层603中接收用户添加的第一批注时，可根据手写笔的运动轨迹自动识别第一批注中的具体文字信息，例如，上述第一批注中包含“重点”二字。或者，手机得到上述第一图片901后，可以自动提取第一图片901中的文字信息。例如，手机可通过ORC(optical character recognition，光学字符识别)技术提取第一图片901中记 录的网页内容。又例如，检测到用户执行保存批注的操作时，手机可获取当前浏览器APP显示的第一界面601的URL地址，并从该URL地址中下载第一界面601内的网页内容。那么，手机可将截图得到的第一图片901以及第一图片901中的文字信息一并保存在备忘录1001中。
这样，手机在创建备忘录1001时，可将第一图片901中的相关文字信息作为备忘录1001的标题。另外，用户在备忘录APP的多条备忘录中查找备忘录1001时，可在搜索框1002中输入第一图片901内的相关关键词。手机可根据用户输入的关键词检索到与该关键词相关的备忘录1001，手机可将包含该关键词的一条或多条备忘录作为搜索结果提示给用户，方便用户在备忘录APP中快速查找到已保存的批注内容。
在另一些实施例中，除了以截图的形式将用户添加的批注保存在备忘录应用之外，手机还可以以其他格式保存本次用户添加的批注。
示例性的，如表1所示，当手机检测到用户选中上述第一工具栏605中的保存选项706后，手机可获取当前显示的浏览器APP的第一界面601的URL，根据该URL手机可以获取到第一界面601中的具体显示内容。并且，手机还可以记录第一批注701在第一界面601中的具体批注位置，以及第一批注701中的具体批注内容和本次批注的添加时间等信息。进而，根据表1中记录的第一批注701的相关信息，手机可生成对应的图片、文本、PDF或Word等格式的文件，从而将本次添加的第一批注701保存在该文件中。后续，用户可以在相关的应用中查找到用户在第一界面601中批注的具体内容。
表1
应用界面 批注位置 批注内容 添加时间 ……
第一界面601的URL 第二段第一行 “重点” 2019/3/8 ……
…… …… …… …… ……
在另一些实施例中，仍以浏览器APP的第一界面601举例，用户使用手写笔对第一界面601输入第一批注后，还可以滚动当前显示的第一界面601，在新的显示界面中继续添加其他批注。也就是说，手机在执行上述步骤S503后，如果接收到用户滚动屏幕的操作，则手机可继续执行下述步骤S506-S509在第二界面中添加第二批注。
S506、响应于用户输入的滚动屏幕的操作，手机滚动屏幕后显示第一应用的第二界面。
仍以第一应用为浏览器APP举例，如图13中的(a)所示，在批注模式下，浏览器APP的第一界面601上覆盖有批注图层603。用户可以在批注图层603的透明区域604中对第一界面601内的内容进行批注。如果用户希望继续浏览浏览器APP中第一界面601后续的内容，用户可向显示屏输入滚动屏幕的操作，例如，该操作可以为用户手指在显示屏上的滑动操作。
手机检测到用户手指在显示屏上的滑动操作后，由于手指在显示屏上生成的电信号与手写笔在显示屏上生成的电信号不相同，因此，手机判断出本次用户操作为用户手指的滑动操作后，可确定该滑动操作是针对浏览器APP的操作，而不是针对批注图层603的操作。那么，响应于用户的滑动操作，手机的显示屏可将本次滑动事件上报给应用程序层中运行的浏览器APP，如图13中的(b)所示，浏览器APP可在显示屏中滚动屏幕显示第二界面1301。第二界面1301中的显示内容可以与第一界面601中的显示内容有部分相同。
同时，手机在滚动屏幕显示第二界面1301时，由于手机还未退出批注模式，手机可以同步滚动批注图层603中的透明区域604。那么，原本记录在与第一界面601对应的透明区域604的第一批注也会随着透明区域604的滚动被隐藏。如图13中的(b)所示，浏览器APP的第二界面1301上覆盖的批注图层603中不包括上述第一批注。
S507、手机接收用户使用手写笔在批注图层中对第二界面输入的第二批注。
如图14所示，手机显示出浏览器APP的第二界面1301后，用户透过批注图层603中新的透明区域604可以看到第二界面1301中的显示内容。进而，用户可使用手写笔在相应的显示内容上添加第二批注1401。
与上述步骤S503类似的，由于此时显示屏中实际位于顶层的图层为批注图层603，因此，手机实际是在批注图层603的透明区域604中接收并记录用户本次输入的第二批注1401，手机此时并未修改浏览器APP中第二界面1301内的显示内容。
后续，如果用户希望继续浏览浏览器APP中第二界面1301前后的显示内容，用户可继续输入滚动屏幕的操作，触发手机循环执行上述步骤S506-S507，使得手机在批注模式下可以对不同显示界面中的内容分别添加批注。
相应的，用户对上述第一界面601输入第一批注并对第二界面1301输入第二批注后，如果用户希望退出批注模式并保存本次添加的两个批注，用户可点击批注图层603中第一工具栏605内的保存选项706，此时，手机可执行下述步骤S508-S509保存本次用户在不同显示界面中添加的多个批注。
S508、若检测到用户保存本次批注的操作，手机对包含上述第一批注和第二批注的界面进行长截图，得到第二图片。
如果检测到用户选中上述第一工具栏605中的保存选项706，手机可以自动对包含上述第一批注的第一界面601和包含上述第二批注的第二界面1301进行长截图操作(也可称为录屏操作)。这样，手机进行长截图后得到的第二图片中不仅包含第一界面601和第二界面1301中浏览器APP的显示内容，还包含用户对第一界面601添加的第一批注以及用户对第二界面1301添加的第二批注。
示例性的，检测到用户选中上述第一工具栏605中的保存选项后，如图15所示，手机在执行长截图操作时，可显示提示1501提示用户正在保存本次添加的批注。同时，手机可开始滚动显示并保存浏览器APP本次打开的文章以及用户在该文章不同位置添加的批注。如果手机滚动显示到某一位置时检测到用户执行停止截图的操作(例如点击操作)，则手机可停止截图，并删除在浏览器APP的界面上叠加的批注图层603，退出批注模式。那么，在接收到该点击操作之前手机保存的长截图即为携带本次批注的第二图片。
如图16所示，手机得到包含上述第一批注和第二批注的第二图片1601后，还可以显示第二图片1601的预览界面1602。与图9所示的第一图片901的预览界面902类似的，第二图片1601的预览界面1602中设置有第三工具栏1603。第三工具栏1603中也设置有分享、编辑以及删除等一项或多项选项，本申请实施例对此不做任何限制。
S509、手机将上述第二图片添加至备忘录中保存。
与上述步骤505类似的，手机通过截图操作得到包含上述第一批注和第二批注的第二图片1601后，可将第二图片1601作为一项备忘录添加至备忘录APP中。示例性的，如图17中的(a)所示，手机可在备忘录APP中设置一个用于收藏批注的文件夹1701。用户打开文件夹1701后，如图17中的(b)所示，手机可在备忘录APP中显示多个备忘录，其中，每个备忘录中均以图片的形式记录了用户的一次批注过程。
示例性的，手机还可以在文件夹1701下设置二级目录保存不同类别的批注。例如，手机可以以每个月为粒度，在文件夹1701内设置与1月对应的文件夹1，与2月对应的文件夹2等。文件夹1中存储有手机在1月份保存的各个批注，文件夹2中存储有手机在2月份保存的各个批注。又例如，手机可以以应用为粒度，在文件夹1701内设置与浏览器APP对应的 文件夹A，与电子书APP对应的文件夹B等。文件夹A中存储有用户在浏览器APP中保存的各个批注，文件夹B中存储有用户在电子书APP中保存的各个批注。
在一些实施例中，手机在将上述第二图片1601添加至备忘录APP时，还可以记录与第二图片1601关联的URL地址，即浏览器APP显示第一界面(或第二界面)的URL地址。这样，当用户再次打开浏览器APP浏览上述第一界面(或第二界面)时，手机可检到浏览器APP当前打开的URL地址与手机已记录的URL地址相同。此时，如图18中的(a)所示，手机再次显示浏览器APP的第一界面(或第二界面)时，可显示通知消息1801，在通知消息1801中提示用户查找到与当前显示界面关联的批注。如果检测到用户打开通知消息1801，则图18中的(b)所示，手机可自动打开备忘录APP中携带批注内容的第一图片901(或第二图片1601)。这样一来，用户在使用浏览器APP时手机可自动将与当前浏览内容相关联的批注提示给用户，方便用户及时查看曾经对相关浏览内容的批注。
又或者，用户也可以手动触发手机查找是否存储有与当前显示界面相关联的批注。例如，当手机再次显示浏览器APP的第一界面(或第二界面)时，如果用户希望查找与当前界面关联的批注内容，则用户可在当前界面中执行预设的手势(例如按压操作、指关节敲击操作等)。进而，响应于用户在当前界面中执行的手势，手机可获取当前界面的URL地址，并在备忘录APP中查找是否有某一备忘录中记录有该URL地址。如果在第二图片1601的备忘录中查询到该URL地址，说明用户曾经在同一显示界面中添加过批注，并将添加的批注保存在第二图片1601中。那么，如图18中的(a)所示，手机可在浏览器APP的第一界面中显示通知消息1801，从而提示用户查找到与当前显示界面关联的批注。
又或者，当手机再次显示浏览器APP的第一界面(或第二界面)时，手机根据上述表1保存的各个批注的URL，可以确定用户本次打开的第一界面与第一批注所在的第一界面相同。进而，手机可以根据表1中记录的第一批注的具体批注位置和批注内容，重新在本次显示的第一界面中复现用户之前添加的第一批注。这样，用户在使用各个应用时，当再次浏览到曾经添加过批注的界面时，手机可在当前界面中快速复现之前添加的批注的具体内容，唤起用户对当前界面和相应批注内容的记忆，提高用户的使用体验。
需要说明的是，上述实施例中是以用户使用手写笔在上述第一界面(或第二界面)上添加批注为例说明的，可以理解的是，用户也可以使用手指等其他方式在上述第一界面(或第二界面)上添加一个或多个批注。
例如，如果手机在显示第一界面时进入批注模式，手机可在第一界面上加载上述批注图层。并且，手机可在批注图层的工具栏中设置手写按钮和非手写按钮。如果检测到用户选中手写按钮，则手机可响应于用户手指的触摸事件显示用户手指在第一界面上的触摸轨迹，此时触摸事件为针对批注图层的批注事件。如果检测到用户选中非手写按钮，当检测到用户手指输入的触摸事件时，说明该触摸事件是针对第一界面的触摸事件，那么，手机可响应于该触摸事件更新第一界面中的内容，例如，手机可执行播放视频、复制文字或翻页等操作。
又或者，手机也可以通过预先设置的手势区分用户手指的触摸操作是针对批注图层的批注事件，还是针对第一界面的触摸事件。例如，手机在第一界面上加载上述批注图层后，如果检测到用户输入按压操作(即预设的手势)，则手机可将后续检测到的触摸事件确定为针对第一界面的触摸事件，在没有检测到用户输入按压操作前，手机可将用户手指的触摸事件确定为在批注图层中的批注事件。
如图19所示，本申请实施例公开了一种电子设备，该电子设备可用于实现以上各个方法实施例中记载的方法。示例性的，该电子设备具体可以包括：接收单元1901、显示单元1902、 截图单元1903以及保存单元1904。其中，接收单元1901用于支持电子设备执行图5中的过程S501、S503和S507；显示单元1902用于支持电子设备执行图5中的过程S502和S506；截图单元1903用于支持电子设备执行图5中的过程S504和S508；保存单元1904用于支持电子设备执行图5中的过程S505和S509。其中，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
如图20所示，本申请实施例公开了一种电子设备，包括：触摸屏2001，所述触摸屏2001包括触敏表面2006和显示屏2007；一个或多个处理器2002；存储器2003；以及一个或多个计算机程序2004。上述各器件可以通过一个或多个通信总线2005连接。其中，上述一个或多个计算机程序2004被存储在上述存储器2003中并被配置为被该一个或多个处理器2002执行，该一个或多个计算机程序2004包括指令，上述指令可以用于执行上述应实施例中的各个步骤。
可选的，仍如图20所示，上述电子设备还可以包括通信模块2008。通信模块2008可用于与手写笔之间进行交互。
示例性的，上述处理器2002具体可以为图1所示的处理器110，上述存储器2003具体可以为图1所示的内部存储器121和/或外部存储器120，上述显示屏2007具体可以为图1所示的显示屏194，上述通信模块2008具体可以为图1所示的移动通信模块150和/或无线通信模块160，上述触敏表面2006具体可以为图1所示的传感器模块180中的触摸传感器，本申请实施例对此不做任何限制。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请实施例的具体实施方式，但本申请实施例的保护范围并不局限于此，任何在本申请实施例揭露的技术范围内的变化或替换，都应涵盖在本申请实施例的保护范围之内。因此，本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (19)

  1. 一种添加批注的方法，其特征在于，包括：
    电子设备显示第一应用的第一界面；
    响应于预设的触发操作，所述电子设备在所述第一界面中进入批注模式；在所述批注模式下，所述电子设备在所述第一界面上显示用户添加的第一批注；
    所述电子设备显示第二应用的第二界面，所述第一应用与所述第二应用不同，所述第一界面与所述第二界面不同；
    响应于所述触发操作，所述电子设备在所述第二界面中进入批注模式；在所述批注模式下，所述电子设备在所述第二界面上显示用户添加的第二批注。
  2. 根据权利要求1所述的方法，其特征在于，
    在所述电子设备在所述第一界面中进入批注模式之后，还包括：
    响应于用户输入的第一编辑操作，所述电子设备编辑所述第一界面中的内容；
    在所述电子设备在所述第二界面中进入批注模式之后，还包括：
    响应于用户输入的第二编辑操作，所述电子设备编辑所述第二界面中的内容。
  3. 根据权利要求1或2所述的方法，其特征在于，所述电子设备在所述第一界面中进入批注模式，包括：
    所述电子设备在所述第一界面上覆盖批注图层，所述批注图层中包括与所述第一界面对应的第一透明区域；
    其中，所述电子设备在所述第一界面上显示用户添加的第一批注，包括：
    所述电子设备显示用户在所述第一透明区域中对所述第一界面输入的所述第一批注。
  4. 根据权利要求3所述的方法，其特征在于，在所述电子设备在所述第一界面上显示用户添加的第一批注之后，还包括：
    响应于用户手指的滑动操作，所述电子设备显示所述第一应用的第三界面，所述第三界面上覆盖有所述批注图层的第二透明区域。
  5. 根据权利要求4所述的方法，其特征在于，在所述电子设备显示所述第一应用的第三界面之后，还包括：
    所述电子设备显示用户在所述第二透明区域中对所述第三界面输入的第三批注。
  6. 根据权利要求1-5中任一项所述的方法，其特征在于，在所述电子设备显示用户在所述第一界面上添加的第一批注之后，还包括：
    响应于用户输入的保存操作，所述电子设备对包含所述第一批注的所述第一界面进行截屏操作，得到第一图片；
    所述电子设备保存所述第一图片。
  7. 根据权利要求6所述的方法，其特征在于，在所述电子设备对包含所述第一批注的所述第一界面进行截屏操作时，还包括：
    所述电子设备显示第一通知消息，所述第一通知消息用于提示用户正在保存所述第一批注。
  8. 根据权利要求5所述的方法，其特征在于，在所述电子设备显示用户在所述第二透明区域中对所述第三界面输入的第三批注之后，还包括：
    响应于用户输入的保存操作，所述电子设备对包含所述第一批注和所述第三批注的所述第一界面和所述第三界面进行截屏操作，得到第二图片；
    所述电子设备保存所述第二图片。
  9. 根据权利要求8所述的方法，其特征在于，在所述电子设备对包含所述第一批注和所述第三批注的所述第一界面和所述第三界面进行截屏操作时，还包括：
    所述电子设备显示第二通知消息，所述第二通知消息用于提示用户正在保存所述第一批注和所述第二批注。
  10. 根据权利要求6或8所述的方法，其特征在于，
    所述电子设备保存第一图片，包括：
    所述电子设备将所述第一图片保存在备忘录应用中；
    所述电子设备保存第二图片，包括：
    所述电子设备将所述第二图片保存在备忘录应用中。
  11. 根据权利要求10所述的方法，其特征在于，所述第一图片和所述第二图片位于所述备忘录应用中预设的文件夹内。
  12. 根据权利要求10所述的方法，其特征在于，所述备忘录应用中设置有搜索栏，所述方法还包括：
    所述电子设备接收用户在所述搜索栏中输入的关键词，所述关键词为所述第一图片中的文字；
    响应于用户输入的搜索操作，所述电子设备显示所述备忘录应用中包含所述关键词的备忘录列表，所述备忘录列表中包含所述第一图片的备忘录。
  13. 根据权利要求10所述的方法，其特征在于，在所述电子设备保存所述第一图片时，还包括：
    所述电子设备保存所述第一图片与所述第一界面之间的对应关系；
    其中，在所述电子设备保存所述第一图片之后，还包括：
    若检测到用户在所述备忘录应用中选中所述第一图片，则所述电子设备打开所述第一应用显示所述第一界面；或者，
    若检测到所述电子设备打开所述第一应用显示所述第一界面，则所述电子设备显示第三通知消息，所述第三通知消息用于提示用户查找到与所述第一界面关联的批注。
  14. 根据权利要求1-12中任一项所述的方法，其特征在于，所述触发操作包括：用户对手写笔执行的预设操作；
    其中，所述第一批注和所述第二批注均为用户使用所述手写笔添加的批注。
  15. 根据权利要求3或4所述的方法，其特征在于，所述批注图层中还包括工具栏，所述工具栏中包括退出选项、保存选项、橡皮擦选项、线条粗细选项以及线条颜色选项中的一个或多个。
  16. 一种电子设备，其特征在于，包括：
    触摸屏，所述触摸屏包括显示屏和触摸传感器；
    一个或多个处理器；
    存储器；
    以及一个或多个计算机程序，其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述电子设备执行时，使得所述电子设备执行如权利要求1-15中任一项所述的添加批注的方法。
  17. 根据权利要求16所述的电子设备，其特征在于，所述电子设备还包括：手写笔；所述手写笔用于向所述触摸屏中输入批注。
  18. 一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，其特征在于， 当所述指令在电子设备上运行时，使得所述电子设备执行如权利要求1-15中任一项所述的添加批注的方法。
  19. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在电子设备上运行时，使得所述电子设备执行如权利要求1-15中任一项所述的添加批注的方法。
PCT/CN2020/084348 2019-04-17 2020-04-11 一种添加批注的方法及电子设备 Ceased WO2020211709A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP20791516.6A EP3929716A4 (en) 2019-04-17 2020-04-11 METHOD AND ELECTRONIC APPARATUS FOR ADDING ANNOTATION
JP2021561665A JP7414842B2 (ja) 2019-04-17 2020-04-11 コメント追加方法及び電子デバイス
US17/504,000 US20220035995A1 (en) 2019-04-17 2021-10-18 Comment Addition Method and Electronic Device
JP2023222145A JP2024041816A (ja) 2019-04-17 2023-12-28 コメント追加方法及び電子デバイス

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910310631.6A CN110196675B (zh) 2019-04-17 2019-04-17 一种添加批注的方法及电子设备
CN201910310631.6 2019-04-17

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/504,000 Continuation US20220035995A1 (en) 2019-04-17 2021-10-18 Comment Addition Method and Electronic Device

Publications (1)

Publication Number Publication Date
WO2020211709A1 true WO2020211709A1 (zh) 2020-10-22

Family

ID=67752006

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/084348 Ceased WO2020211709A1 (zh) 2019-04-17 2020-04-11 一种添加批注的方法及电子设备

Country Status (5)

Country Link
US (1) US20220035995A1 (zh)
EP (1) EP3929716A4 (zh)
JP (2) JP7414842B2 (zh)
CN (3) CN115185445A (zh)
WO (1) WO2020211709A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240370156A1 (en) * 2021-09-06 2024-11-07 Huawei Technologies Co., Ltd. Annotation method and electronic device
US20250217012A1 (en) * 2023-12-29 2025-07-03 Cisco Technology, Inc. Logically grouping elements using tags for visualization in a virtual simulation

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115185445A (zh) * 2019-04-17 2022-10-14 华为技术有限公司 一种添加批注的方法及电子设备
CN110324496B (zh) * 2019-07-08 2021-02-26 珠海格力电器股份有限公司 在任意界面快捷标记的方法、存储介质以及终端设备
CN111428452B (zh) * 2019-11-27 2023-09-05 杭州海康威视数字技术股份有限公司 一种批注数据保存方法及装置
CN111459306B (zh) * 2020-03-12 2023-09-26 维沃移动通信有限公司 信息显示方法、信息发送方法、电子笔及电子设备
CN111476006B (zh) * 2020-04-13 2024-02-20 上海鸿翼软件技术股份有限公司 Pdf文件在线批注方法、装置、设备及可读存储介质
CN111881647B (zh) * 2020-06-09 2024-06-18 维沃移动通信有限公司 标识显示方法、装置及电子设备
CN111813473A (zh) * 2020-06-23 2020-10-23 维沃移动通信有限公司 截屏方法、装置及电子设备
CN111783387B (zh) * 2020-06-30 2024-11-19 掌阅科技股份有限公司 笔记处理方法、计算设备及存储介质
CN114089852B (zh) * 2020-07-15 2025-05-02 海信视像科技股份有限公司 一种显示设备、电子白板装置及白板擦除方法
CN114077825A (zh) * 2020-08-05 2022-02-22 华为技术有限公司 添加批注的方法、电子设备及相关装置
CN114385284A (zh) * 2020-10-22 2022-04-22 华为技术有限公司 批注的显示方法及电子设备
CN113765773B (zh) * 2020-11-09 2023-04-07 北京沃东天骏信息技术有限公司 一种沟通记录处理方法和装置
CN112486398B (zh) * 2020-12-18 2022-05-20 掌阅科技股份有限公司 手写笔迹翻页效果的实现方法、电子设备及存储介质
CN112966472A (zh) * 2021-03-05 2021-06-15 广州文石信息科技有限公司 一种电子书的全局批注方法和装置
CN113408438A (zh) * 2021-06-23 2021-09-17 北京字节跳动网络技术有限公司 电子设备的控制方法、装置、终端和存储介质
CN113672187A (zh) * 2021-08-23 2021-11-19 展讯半导体(南京)有限公司 一种数据双面显示方法、装置、电子设备及存储介质
CN113703631A (zh) * 2021-08-31 2021-11-26 维沃移动通信有限公司 书写控制方法、装置、电子设备及存储介质
CN115016722B (zh) * 2021-11-08 2023-04-07 荣耀终端有限公司 一种文本编辑方法及相关设备
CN116204254A (zh) * 2021-11-30 2023-06-02 华为技术有限公司 一种批注页面生成方法、电子设备及存储介质
CN114529634A (zh) * 2021-12-29 2022-05-24 华能国际电力股份有限公司大连电厂 电厂单元快速定位方法
CN116437138A (zh) * 2022-01-04 2023-07-14 海信视像科技股份有限公司 显示设备、视频录制及播放方法
CN115661301A (zh) * 2022-08-31 2023-01-31 华为技术有限公司 添加批注的方法、电子设备、存储介质及程序产品
CN115640792A (zh) * 2022-10-31 2023-01-24 维沃移动通信有限公司 信息处理方法及装置
CN115577078B (zh) * 2022-11-18 2023-06-02 江苏苏港智能装备产业创新中心有限公司 一种工程造价审计信息检索方法、系统、设备及存储介质
CN115826821A (zh) * 2022-11-29 2023-03-21 维沃移动通信有限公司 对象标注方法、装置、电子设备及存储介质
CN116402026B (zh) * 2023-04-13 2023-12-19 广州文石信息科技有限公司 应用内容批注方法、装置、设备以及存储介质
CN119316670A (zh) * 2023-07-12 2025-01-14 荣耀终端有限公司 视频的摘录方法和电子设备
CN119311183A (zh) * 2023-07-12 2025-01-14 荣耀终端有限公司 批注方法和电子设备
CN119854561A (zh) * 2023-10-17 2025-04-18 海信视像科技股份有限公司 批注数据的保存方法、电子设备和存储介质
CN121187468A (zh) * 2024-06-20 2025-12-23 华为技术有限公司 卡片添加方法及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060139372A1 (en) * 2004-12-28 2006-06-29 The Mathworks, Inc. Providing graphic generating capabilities for a model based development process
CN109523609A (zh) * 2018-10-16 2019-03-26 华为技术有限公司 一种内容编辑的方法及终端
CN110196675A (zh) * 2019-04-17 2019-09-03 华为技术有限公司 一种添加批注的方法及电子设备

Family Cites Families (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7103848B2 (en) * 2001-09-13 2006-09-05 International Business Machines Corporation Handheld electronic book reader with annotation and usage tracking capabilities
US7536713B1 (en) * 2002-12-11 2009-05-19 Alan Bartholomew Knowledge broadcasting and classification system
JP2006288962A (ja) 2005-04-14 2006-10-26 Aruze Corp 遊技機および遊技用プログラム
US8533199B2 (en) * 2005-12-14 2013-09-10 Unifi Scientific Advances, Inc Intelligent bookmarks and information management system based on the same
US20100278453A1 (en) * 2006-09-15 2010-11-04 King Martin T Capture and display of annotations in paper and electronic documents
US8881052B2 (en) * 2007-03-21 2014-11-04 Yahoo! Inc. Methods and systems for managing widgets through a widget dock user interface
US20100058181A1 (en) * 2008-08-26 2010-03-04 Oracle International Corporation Recording, playback, and distribution of dashboard interactions including annotations
US9292481B2 (en) * 2009-02-27 2016-03-22 Adobe Systems Incorporated Creating and modifying a snapshot of an electronic document with a user comment
US9086956B2 (en) * 2010-05-21 2015-07-21 Zetta Research and Development—RPO Series Methods for interacting with an on-screen document
JP5719153B2 (ja) 2010-11-22 2015-05-13 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 複数のオブジェクトを操作する方法、並びにそのコンピュータ及びコンピュータ・プログラム
US9645986B2 (en) * 2011-02-24 2017-05-09 Google Inc. Method, medium, and system for creating an electronic book with an umbrella policy
US10079039B2 (en) * 2011-09-26 2018-09-18 The University Of North Carolina At Charlotte Multi-modal collaborative web-based video annotation system
JP5887123B2 (ja) 2011-12-13 2016-03-16 株式会社ソニー・コンピュータエンタテインメント 情報処理システム、第１電子機器、第２電子機器、画像ファイル再生方法および提供方法
CN102609401A (zh) * 2011-12-26 2012-07-25 北京大学 一种网页批注方法
US9696898B2 (en) * 2012-11-14 2017-07-04 Facebook, Inc. Scrolling through a series of content items
WO2014106911A1 (ja) * 2013-01-04 2014-07-10 株式会社ユビキタスエンターテインメント 情報処理装置及び情報更新プログラム
WO2014147724A1 (ja) * 2013-03-18 2014-09-25 株式会社 東芝 電子機器および入力方法
US8635552B1 (en) * 2013-03-20 2014-01-21 Lg Electronics Inc. Display device capturing digital content and method of controlling therefor
KR102091235B1 (ko) * 2013-04-10 2020-03-18 삼성전자주식회사 휴대 단말기에서 메시지를 편집하는 장치 및 방법
KR102189787B1 (ko) 2013-11-13 2020-12-11 삼성전자 주식회사 터치스크린을 가지는 전자 장치 및 이의 입력 처리 방법
CN104731443B (zh) * 2013-12-23 2018-05-01 鸿合科技股份有限公司 一种批注实现方法及装置
US10002191B2 (en) 2013-12-31 2018-06-19 Google Llc Methods, systems, and media for generating search results based on contextual information
EP3736722B1 (en) * 2014-09-04 2025-05-21 Huawei Technologies Co., Ltd. Screen capturing method and apparatus
KR102407623B1 (ko) * 2014-09-29 2022-06-10 삼성전자주식회사 사용자 단말 장치 및 이의 제어 방법
HK1251670A1 (zh) * 2015-03-31 2019-02-01 Calgary Scientific Inc. 用於捕获分层屏幕内容的方法
KR20170016165A (ko) 2015-08-03 2017-02-13 엘지전자 주식회사 이동단말기 및 그 제어방법
KR102520398B1 (ko) 2016-05-18 2023-04-12 삼성전자주식회사 사용자 데이터를 저장하는 전자 장치 및 그 방법
US10379632B2 (en) 2016-06-12 2019-08-13 Apple Inc. Devices and methods for manipulating user interfaces with stylus and non-stylus contacts
US10852936B2 (en) 2016-09-23 2020-12-01 Apple Inc. Devices, methods, and graphical user interfaces for a unified annotation layer for annotating content displayed on a device
WO2018053620A1 (en) * 2016-09-23 2018-03-29 Hvr Technologies Inc. Digital communications platform for webpage overlay
JP6809137B2 (ja) 2016-10-31 2021-01-06 ブラザー工業株式会社 プログラム、情報処理装置、および情報処理装置の制御方法
CN106681624B (zh) * 2016-10-31 2019-12-03 广州视源电子科技股份有限公司 基于触摸显示屏的批注显示方法和装置
CN111008520B (zh) * 2016-12-15 2023-08-29 广州视源电子科技股份有限公司 一种批注方法、装置、终端设备及存储介质
CN107343104A (zh) 2017-07-19 2017-11-10 北京小米移动软件有限公司 处理收藏信息的方法、装置和终端设备
CN107797971A (zh) * 2017-10-11 2018-03-13 广州视源电子科技股份有限公司 文档批注方法、装置和电子设备
CN108038094A (zh) * 2017-10-17 2018-05-15 广州视源电子科技股份有限公司 一种文档批注方法、装置和电子设备
CN108874292B (zh) * 2018-07-16 2021-12-03 广州视源电子科技股份有限公司 批注显示方法、装置以及智能交互平板
CN109614178A (zh) * 2018-09-04 2019-04-12 广州视源电子科技股份有限公司 批注显示方法、装置、设备和存储介质
CN109358799B (zh) * 2018-09-11 2021-06-15 北京思骏教育科技有限公司 在手写设备上添加用户输入的手写批注信息的方法
CN109120880A (zh) * 2018-09-19 2019-01-01 电子科技大学 基于智能终端的实时会议批注方法及系统
CN109634501B (zh) * 2018-12-20 2020-01-21 掌阅科技股份有限公司 电子书批注添加方法、电子设备及计算机存储介质

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060139372A1 (en) * 2004-12-28 2006-06-29 The Mathworks, Inc. Providing graphic generating capabilities for a model based development process
CN109523609A (zh) * 2018-10-16 2019-03-26 华为技术有限公司 一种内容编辑的方法及终端
CN110196675A (zh) * 2019-04-17 2019-09-03 华为技术有限公司 一种添加批注的方法及电子设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3929716A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240370156A1 (en) * 2021-09-06 2024-11-07 Huawei Technologies Co., Ltd. Annotation method and electronic device
US20250217012A1 (en) * 2023-12-29 2025-07-03 Cisco Technology, Inc. Logically grouping elements using tags for visualization in a virtual simulation

Also Published As

Publication number Publication date
US20220035995A1 (en) 2022-02-03
JP7414842B2 (ja) 2024-01-16
CN110196675A (zh) 2019-09-03
EP3929716A4 (en) 2022-05-11
CN115185444A (zh) 2022-10-14
JP2024041816A (ja) 2024-03-27
CN110196675B (zh) 2022-07-15
CN115185445A (zh) 2022-10-14
EP3929716A1 (en) 2021-12-29
JP2022529159A (ja) 2022-06-17

Similar Documents

Publication Publication Date Title
WO2020211709A1 (zh) 一种添加批注的方法及电子设备
WO2020238774A1 (zh) 一种通知消息的预览方法及电子设备
CN114020197B (zh) 跨应用的消息的处理方法、电子设备及可读存储介质
US20220050975A1 (en) Content Translation Method and Terminal
WO2021110133A1 (zh) 一种控件的操作方法及电子设备
WO2021218365A1 (zh) 标注方法及电子设备
WO2021042881A1 (zh) 消息通知方法及电子设备
CN112202958B (zh) 截图方法、装置及电子设备
CN114816200A (zh) 一种显示方法及电子设备
CN114117269B (zh) 备忘信息收藏方法、装置、电子设备及存储介质
WO2023236794A1 (zh) 一种音轨标记方法及电子设备
JP7646997B2 (ja) 注釈方法及び電子デバイス
CN115661301A (zh) 添加批注的方法、电子设备、存储介质及程序产品
US20250181662A1 (en) Search method and electronic device
CN117631939A (zh) 一种触控输入的方法、系统、电子设备及存储介质
EP4722875A1 (en) Interaction method and electronic device
US9426277B2 (en) Method and apparatus for operating message function in connection with note function
CN117648040A (zh) 生成桌面文件夹的方法和电子设备
CN115700431A (zh) 一种桌面的显示方法及电子设备
CN114625303B (zh) 窗口显示方法、终端设备及计算机可读存储介质
WO2026045471A1 (zh) 一种显示方法、装置、电子设备及存储介质
CN121303069A (zh) 一种批注方法及电子设备
CN118075532A (zh) 一种视频的摘录方法、电子设备及存储介质
WO2025218509A1 (zh) 一种元服务分发的方法、系统以及电子设备
WO2024193413A1 (zh) 翻译方法、电子设备和计算机存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20791516

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020791516

Country of ref document: EP

Effective date: 20210924

ENP Entry into the national phase

Ref document number: 2021561665

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: 2020791516

Country of ref document: EP