WO2024067513A1 - 信息显示方法、装置、设备及存储介质 - Google Patents

信息显示方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2024067513A1
WO2024067513A1 PCT/CN2023/121198 CN2023121198W WO2024067513A1 WO 2024067513 A1 WO2024067513 A1 WO 2024067513A1 CN 2023121198 W CN2023121198 W CN 2023121198W WO 2024067513 A1 WO2024067513 A1 WO 2024067513A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
screen
information display
picture
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/121198
Other languages
English (en)
French (fr)
Inventor
张经睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to EP23870742.6A priority Critical patent/EP4597262A4/en
Publication of WO2024067513A1 publication Critical patent/WO2024067513A1/zh
Priority to US19/086,111 priority patent/US20250220102A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/724094—Interfacing with a device worn on the user's body to provide access to telephonic functionalities, e.g. accepting a call, reading or composing a message
    • H04M1/724097—Worn on the head
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/38—Displays

Definitions

  • the present application belongs to the field of computer technology, and specifically relates to an information display method, device, equipment and storage medium.
  • VR Virtual Reality
  • the purpose of the embodiments of the present application is to provide an information display method, apparatus, device and storage medium, which can solve the problem that users easily miss important information when using VR equipment, resulting in the inability to timely deliver information to users, and can deliver information to users in a timely manner to ensure user experience.
  • an embodiment of the present application provides an information display method, which is applied to an electronic device, and the method includes:
  • the terminal device obtains the notification message, issuing a location reminder based on the first location information of the terminal device, where the location reminder is used to indicate the relative position of the terminal device with respect to the electronic device;
  • the currently displayed first picture is switched to a second picture taken by the camera and including the terminal device.
  • an embodiment of the present application provides an information display device, which is applied to an electronic device, including a device connection module, a message response module and a screen switching module, wherein:
  • the device connection module is configured to establish a connection with a terminal device
  • the message response module is configured to issue a location reminder based on the first location information of the terminal device when the terminal device obtains the notification message, wherein the location reminder is used to indicate the relative location of the terminal device relative to the electronic device;
  • the picture switching module is configured to switch the currently displayed first picture to a second picture taken by a camera and including the terminal device when it is detected that the terminal device is within the viewing angle.
  • an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.
  • an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
  • an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
  • a location reminder is issued based on the first location information of the terminal device, and when it is detected that the terminal device is within the current viewing angle, the currently displayed first screen is switched to a second screen taken by the camera and containing the terminal device.
  • the user can get the terminal device and reply to the message based on the location reminder and the location of the terminal device displayed on the second screen, thereby delivering information to the user in a timely manner and ensuring user experience.
  • FIG1 is a flow chart of an information display method provided by an embodiment of the present application.
  • FIG2 is a schematic diagram of a process of issuing a location reminder provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a flow chart of displaying the position of a terminal device in a second screen provided by an embodiment of the present application;
  • FIG4 is a schematic diagram of the positional relationship between a first terminal device and a viewing angle range provided in an embodiment of the present application
  • FIG5 is a schematic diagram of a location reminder display provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of the positional relationship between a second terminal device and a viewing angle range provided in an embodiment of the present application
  • FIG7 is a schematic diagram showing a second screen according to an embodiment of the present application.
  • FIG8 is a schematic diagram of the positional relationship between a third terminal device and a viewing angle range provided in an embodiment of the present application.
  • FIG9 is a schematic diagram of a display of switching from a second screen to a first screen provided by an embodiment of the present application.
  • FIG10 is a schematic diagram of the structure of an information display device provided in an embodiment of the present application.
  • FIG11 is a schematic diagram of a framework structure of an electronic device provided in an embodiment of the present application.
  • FIG. 12 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
  • first, second, etc. in the specification and claims of this application are used to distinguish similar objects, rather than to describe a specific order or precedence. It should be understood that the terms used in this way can be interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first”, “second”, etc. are generally of the same type, and do not limit the number of objects.
  • the first object can be one
  • “and/or” in the specification and claims indicates at least one of the connected objects, and the character “/" generally indicates that the objects connected before and after are in an "or” relationship.
  • FIG1 is a flow chart of an information display method provided in an embodiment of the present application.
  • the information display method provided in an embodiment of the present application can be performed by an information display device, which can be implemented by hardware and/or software and integrated in the information display device.
  • the information display method can be applied to an electronic device, which can be a VR wearable device such as VR glasses.
  • the information display method includes:
  • S110 Establishing a connection with a terminal device.
  • the information display device and terminal device provided by this solution are pre-connected according to the set connection method and communicate with the terminal device.
  • the information display device and the terminal device can be connected through Bluetooth, WiFi hotspot, Internet and other connection methods.
  • the terminal device can be a mobile phone, tablet computer, etc.
  • the information display device is provided with a built-in or external display module, and the information display device displays the screen information (such as game screen, audio and video screen, instant chat communication screen, etc.) through the display module. After the user wears the information display device, he can observe the screen information displayed by the display module.
  • the information display device can also be provided with a built-in or external audio module. The information display device plays audio information through the audio module. After the user wears the information display device, he can hear the corresponding audio information through the audio module.
  • VR devices as information display devices as an example
  • the terminal device receives a message that needs to be reminded to the user
  • the VR device since the user is using the VR device at this time, it is easy for the user to fail to process the message in time.
  • the user is wearing the VR device for an immersive experience.
  • the VR device will block the user's perception of the outside world.
  • a helmet-type VR device will block the real picture and sound of the outside world, and the VR device will play the sound corresponding to the virtual picture while displaying the virtual picture.
  • the terminal device When the terminal device provided by this solution receives a notification message that needs to be reminded to the user, it can send a position reminder to the user who is using the information display device to indicate the relative position of the terminal device relative to the electronic device, reminding the user to process the message in time, and transmit information to the user in time, thereby improving the efficiency of information transmission and user experience.
  • the present solution provides a method of notifying an information display device that the terminal device has obtained a notification message when the terminal device has obtained a notification message.
  • the information display device receives a notification from the terminal device that a notification message has been obtained, it determines the first location information of the terminal device and issues a location reminder based on the first location information.
  • the location reminder is used to indicate the relative position of the terminal device relative to the electronic device, and the user can move or turn according to the location reminder to move the viewing angle of the information display device toward the first location where the terminal device is located.
  • the location reminder can be displayed in the form of voice or picture, for example, through information display
  • the display device plays a reminder audio corresponding to the position reminder, displays a reminder screen corresponding to the position reminder in the current screen (virtual screen or real screen) through the information display device, or displays the reminder screen in a pop-up window.
  • the prompt screen can be a guide to the first position of the terminal device.
  • the first position of the terminal device is prompted by an arrow icon.
  • a right arrow icon and a set text prompt are popped up in the screen currently displayed by the information display device, guiding the user to turn right to move the viewing angle of the information display device toward the first position where the terminal device is located.
  • the priorities of messages of different types or different contacts can be set in the terminal device, or a whitelist of messages of different types or different contacts can be set.
  • the terminal device receives a notification message, it determines whether it is a message that needs to be reminded to the user through the information display device according to the priority corresponding to the notification message or whether the notification message is in the whitelist. If the priority corresponding to the notification message is high priority, or the message type or contact corresponding to the notification message is in the whitelist, a message reminder is issued according to the set message reminder method, and a notification of obtaining the notification message is issued to the information display device.
  • a message reminder is directly issued according to the set message reminder method, and there is no need to issue a notification of obtaining the notification message to the information display device.
  • the terminal device receives a call reminder, a voice or video invitation, or a pinned message reminder, in addition to the message reminder according to the set reminder method, the terminal device also sends a notification of obtaining the notification message to the connected information display device.
  • a message reminder can be issued according to the set reminder method, and there is no need to remind the user who is using the information display device, so as to avoid too frequent location reminders for the user and affect the user experience.
  • the information display device provided in this embodiment is provided with a camera, and the camera is arranged forward, that is, the direction of the camera is consistent with or close to the direction of the user after the user wears the information display device.
  • the shooting range of the camera is the viewing angle range corresponding to the information display device.
  • the information display device can take pictures through a camera and display a second picture taken by the camera. At this time, what is displayed on the display module is the real picture taken by the camera, which is consistent or similar to the actual picture observed by the user when the user is not wearing the information display device.
  • the user can interact with the real environment according to the display picture displayed on the display module without taking off the information display device. The user does not need to take off or wear the information display device frequently, thereby improving the user's experience of the information display device.
  • the user may turn according to the first position of the terminal device indicated by the position reminder to move the viewing angle of the information display device to the direction corresponding to the first position of the terminal device.
  • the camera is called to shoot the second picture, and the second picture shot by the camera is displayed, so as to switch the first picture currently displayed by the information display device to the second picture shot by the camera containing the terminal device, for example, converting the virtual picture currently displayed by the VR wearable device into a real picture containing the terminal device.
  • the second picture displayed at this time contains the corresponding information of the terminal device. That is, the user can determine the first position of the terminal device through the image position of the terminal device displayed in the second screen, and can pick up the terminal device to reply to the message.
  • the second screen taken by the camera is continuously displayed.
  • the user can perform corresponding operations according to the interactive interface of the terminal device displayed in the second screen.
  • the user does not need to take off the information display device from receiving the location reminder to picking up the terminal device to reply to the message. While delivering information to the user in a timely manner, it improves the efficiency of the user's reply to the message and effectively improves the user experience.
  • a location reminder is issued based on the first location information of the terminal device, and when it is detected that the terminal device is within the current viewing angle, the currently displayed first screen is switched to a second screen taken by the camera containing the terminal device.
  • the user can get the terminal device and reply to the message based on the location reminder and the location of the terminal device displayed on the second screen, thereby delivering information to the user in a timely manner and ensuring user experience.
  • the information display method provided by the present solution further includes: when the wearable device is in a worn state and connected to a terminal device, obtaining first location information of the terminal device and/or terminal feature information of the terminal device.
  • the information display device is in a wearing state and has been connected to the terminal device. If so, the first location information of the terminal device and/or the terminal feature information of the terminal device are obtained.
  • the wearing state is used to indicate whether the information display device is worn.
  • a wearing detection module for detecting the wearing state of the information display device is set on the information display device.
  • the wearing detection module can be a biometric detection sensor, a distance sensor, etc. In addition, it can also be a picture taken by an external camera.
  • Whether the user is wearing the information display device is determined by user behavior analysis, thereby determining the wearing state of the information display device.
  • the information display device is in a non-worn state when idle. When it is detected that the user is wearing the information display device, the information display device changes from a non-worn state to a worn state.
  • the first location information can be determined by positioning the terminal device, for example, by Bluetooth positioning technology, WiFi positioning technology, graphic positioning technology (for example, locating the position of the terminal device in the picture captured by the external camera based on the terminal characteristic information of the terminal device).
  • the first location information of the terminal device and/or the terminal characteristic information of the terminal device can be obtained first, without waiting for the user to wear the information display device, thereby improving the efficiency of obtaining the first location information and the terminal characteristic information.
  • the first location information of the information display device can be continuously collected and updated.
  • This solution obtains the first location information of the terminal device when it is detected that it is in a worn state and has been connected to the terminal device.
  • the first location information of the terminal device can be quickly determined and a corresponding location reminder can be issued, thereby improving the efficiency of message reminders.
  • the terminal feature information of the terminal device may be an appearance image or image feature of the terminal device.
  • the terminal feature information of the terminal device may be pre-collected and provided by the terminal device, or may be obtained by collecting features of the terminal device through an information display device or other scanning device. Based on the terminal feature information of the terminal device, feature matching may be performed in the second screen and the position of the terminal device in the second screen may be determined, and the position of the terminal device in the second screen may be provided to the user, so that the user can locate the position of the terminal device more quickly, thereby improving the efficiency of message reminders and replies.
  • the present solution issues a location reminder based on the first location information of the terminal device.
  • S122 issuing a location reminder based on the current viewing angle range and the first location information.
  • the first location information of the terminal device and the current viewing angle range of the information display device are determined, the relative position of the terminal device relative to the electronic device is determined based on the first location information, and a location reminder is issued based on the relative position.
  • the viewing angle range of the information display device can be determined based on the real-time orientation of the camera and the shooting angle range.
  • the location reminder can be implemented in the form of a pop-up window reminder, which can provide content operation options and device direction guidance.
  • the content operation options are used to provide operation options for the currently displayed screen, such as pausing playback, minimizing the page, etc.
  • the currently displayed page can be switched to the homepage to jump to the second screen taken by the camera.
  • the content operation option can also be a quick reply to the notification message.
  • the quick reply to the notification message can notify the terminal device to quickly reply to the message and cancel the location reminder.
  • the device direction guidance is used to indicate the relative position of the terminal device with respect to the electronic device, which can be represented by arrows in different directions. For example, when the terminal device is on the right side of the current viewing angle, the device direction guidance is an arrow pointing to the right.
  • This solution sends a location reminder based on the positional relationship between the first location information of the terminal device and the current viewing range of the electronic device, accurately reminding the user of the location of the terminal device.
  • the user can locate the location of the terminal device more quickly, improving the efficiency of message reminders and replies.
  • this solution also includes:
  • S140 Determine a second position of the terminal device in the second picture.
  • a second position of the terminal device in the second picture is determined, and the position of the terminal device in the second picture is displayed in the second picture based on the second position.
  • the display method of the position of the terminal device in the second screen may be to add an indicator frame corresponding to the outline of the terminal device at the position corresponding to the second position in the second screen, or to highlight the terminal device at the position corresponding to the second position in the second screen, or to add a set indicator icon at the position corresponding to the second position in the second screen.
  • This solution prompts the position of the terminal device in the second screen based on the second position, guides the user to locate the position of the terminal device more quickly, and improves the efficiency of message reminders and replies.
  • the terminal feature information of the terminal device is an image feature of the terminal device (e.g., a feature descriptor). Based on this, when determining the second position of the terminal device in the second picture, the present solution specifically includes: based on the terminal feature information of the terminal device, obtaining a target object in the second picture that matches the terminal feature information, and determining the target position of the target object as the second position of the terminal device.
  • feature matching is performed in the second screen based on the terminal feature information of the terminal device, so as to obtain the target object that matches the terminal feature information in the second screen according to the feature matching result, determine the target position of the obtained target object, and determine the target position as the second position of the terminal device. It can be understood that when determining the second position of the terminal device in the second screen, it can be determined that the terminal device is within the viewing angle of the electronic device, and the screen currently displayed by the electronic device is the second screen including the terminal device.
  • This solution accurately determines the second position of the terminal device in the second screen by determining the target position of the target object in the second screen based on the terminal feature information of the terminal device, and determines the target position as the second position of the terminal device, thereby improving the accuracy of indicating the terminal device in the second screen.
  • the terminal characteristic information of the terminal device is an appearance image of the terminal device
  • image matching can be performed in the second screen based on the terminal characteristic information of the terminal device, and the second position of the terminal device can be determined based on the image matching result.
  • image matching is performed in the second screen based on the appearance image of the terminal device, and when the similarity between the recognition target indicated by the image matching result and the appearance image meets the set requirement, the second position of the terminal device is determined according to the position of the recognition target in the second screen.
  • This solution accurately determines the second position of the terminal device in the second screen by performing image matching in the second screen based on the terminal feature information of the terminal device, thereby improving the accuracy of indicating the terminal device in the second screen.
  • the information display method provided by this solution further includes: displaying a fourth screen of the terminal device in a set area of the second screen after switching the currently displayed first screen to a second screen captured by the camera and including the terminal device.
  • the fourth picture of the terminal device is simultaneously displayed in the set area of the second picture, and the user can observe the content displayed on the terminal device in real time through the fourth picture.
  • the fourth picture provided by this scheme can be obtained by recording the screen picture by the terminal device.
  • the information reminder device receives the data stream corresponding to the screen picture sent by the terminal device, it displays the screen picture as the fourth picture in the set area of the second picture.
  • the fourth picture can also be obtained by identifying the display area corresponding to the screen picture of the terminal device in the second picture, and enlarging the display area to obtain the fourth picture, and displaying it in the set area of the second picture.
  • the set area of the second picture can be an area set on one side of the second picture (for example, a rectangular area on the right side of the second picture).
  • this solution when the user completes processing the message received by the terminal device, the display screen of the information display device can be restored. Based on this, after switching the currently displayed first screen to the second screen captured by the camera and including the terminal device, this solution also includes: when it is determined that the processing of the notification message is completed, displaying the first screen or the pause screen corresponding to the first screen.
  • the second screen captured by the camera is kept displayed, and it is determined whether the processing of the notification message is completed.
  • the second screen currently displayed is switched to the first screen or the pause screen corresponding to the first screen.
  • the pause screen corresponding to the first screen allows the user to continue the operations on the terminal device before replying to the message, without the need for the user to manually switch the display screen, which facilitates user operation.
  • the type of the first screen is determined according to the type of screen displayed when the notification message is received.
  • the second screen currently displayed can be directly switched to the game screen when the notification message is processed.
  • the corresponding audio and video screen can be paused when the second screen captured by the camera is displayed, and when the notification message is processed, the second screen currently displayed is switched to the pause screen corresponding to the audio and video screen, and the user can choose whether to continue playing the audio and video screen.
  • whether the processing of the notification message is completed can be determined based on the user's operation on the terminal device. Based on this, when it is determined that the processing of the notification message is completed, before displaying the first screen or the pause screen corresponding to the first screen, this solution also includes: when a first operation on the terminal device is detected, determining that the processing of the notification message is completed, the first operation includes a placement operation, a closing operation and/or a reply operation to the notification message on the terminal device.
  • the first operation includes a placement operation, a closing operation and/or a reply operation to the notification message on the terminal device.
  • the user when it is detected that the user performs a placement operation on the terminal device (i.e., it is detected that the terminal device is separated from the user and is placed on other objects), it is detected that the user performs a closing operation on the terminal device (for example, it is detected that the user actively closes the terminal device, wherein closing the terminal device can be closing the screen of the terminal device, so that the screen of the terminal device enters a screen-off state) or when it is detected that the user completes the reply operation to the notification message, it can be considered that the user no longer needs to operate the terminal device, and the processing of the notification message has been completed at this time, wherein the user's reply operation to the notification message can be detected that the user sends a reply message to the notification message received by the terminal device, and closes the reply page of the message notification, for example, when the WeChat installed in the terminal device receives the notification message, the electronic device sends a location reminder, and when it is detected that the user replies to the notification message on the reply page of the notification message on
  • the terminal device determines whether it is held or placed by the user through the inertial motion sensor configured by itself, and notifies the information display device of the detection of the placement operation of the terminal device when it detects that the terminal device is placed, or determines whether the terminal device is held or placed by the user through the shooting picture of the external camera, and notifies the information display device of the detection of the placement operation of the terminal device when it detects that the terminal device is placed, and the information display device determines that the user has triggered the first operation on the terminal device.
  • the information display device determines that the user has triggered the first operation on the terminal device. This solution determines whether the processing of the notification message is completed by detecting the first operation performed by the user on the terminal device, so as to accurately determine the timing of switching to display the first screen or the pause screen corresponding to the first screen, without the user having to manually switch the display screen, which is convenient for user operation.
  • the information display method provided by the present solution further includes: in the first picture currently displayed
  • the message received by the terminal device is displayed on the screen.
  • the information received by the terminal device can also be displayed on the basis of the first screen, that is, when the terminal device receives new information, it sends a notification to the information display device that a notification message has been obtained.
  • the information display device receives the notification that a notification message has been obtained from the terminal device, the information received by the terminal device is obtained, and the information received by the terminal device is displayed on the basis of the currently displayed first screen in the form of a pop-up message.
  • the user can view or process the message received by the terminal device on the first screen, and can send a reply operation to the message to the terminal device to notify the terminal device to reply to the message based on the reply operation.
  • the message received by the terminal device is displayed on the virtual screen displayed by the VR wearable device.
  • the user can view and reply to the message on the virtual screen.
  • the reply operation to the message can be sent to the mobile phone, notifying the mobile phone to reply to the message based on the reply operation.
  • this solution receives a notification from the terminal device that a notification message has been obtained, the message received by the terminal device is displayed on the basis of the first screen.
  • the user can view the message in the first screen and can quickly process the notification message through the information display device. There is no need to move the terminal device's perspective to pick up the terminal device for message processing, which effectively improves the efficiency of information processing.
  • FIG 4 is a schematic diagram of the positional relationship between the first terminal device and the viewing angle range provided in an embodiment of the present application.
  • a camera is provided on the information display device A, and the shooting angle range of the camera is the viewing angle range S of the information display device A.
  • the area corresponding to the viewing angle range S of the information display device A in the figure is a fan-shaped area.
  • the terminal device B connected to the information display device A is outside the viewing angle range S at this time, and the first position of the terminal device B in the figure is located on the right side outside the viewing angle range S. If the terminal device B receives a message with a high priority and is in the whitelist at this time, it is necessary to promptly remind the user to process the notification message received by the terminal device, and then send a notification of obtaining the notification message to the information display device A.
  • FIG5 is a schematic diagram of a location reminder display provided by an embodiment of the present application.
  • the information display device A receives a notification of obtaining a notification message, it obtains the first location information of the terminal device B and the current viewing angle range S of the information display device A, and determines the relative position of the first location information of the terminal device B relative to the current viewing angle range S. If the first location information of the terminal device B is within the current viewing angle range S, the second picture taken by the camera containing the terminal device B can be directly displayed.
  • the information display device A needs to generate a location reminder based on the position of the first position indicated by the first location information of the terminal device B relative to the current viewing angle range S, and display the location reminder in the form of a message pop-up window C in the picture currently displayed by the information display device A.
  • the message pop-up window C includes a content operation option C1 and a device direction guide C2.
  • the content operation option C1 is used to provide operation options for the currently displayed picture, such as pausing playback, minimizing the page, etc.
  • the device direction indicator C2 is used to indicate the relative position of the terminal device B with respect to the electronic device (VR device) in the current viewing range S. It is represented by arrows in different directions. Since the terminal device B is on the right side of the current viewing range S in the figure, the device direction indicator C2 in the figure is an arrow pointing to the right.
  • FIG6 is a schematic diagram of the positional relationship between the second terminal device and the viewing angle range provided in an embodiment of the present application.
  • the user can turn right according to the instruction of the device direction indicator C2 so that the first position of the terminal device A enters the viewing angle range S.
  • the viewing angle range S also rotates clockwise (looking down) with the information display device A as the center, and as the viewing angle range S rotates, the terminal device B gradually enters the time range S.
  • FIG7 is a schematic diagram of a display of a second screen provided by an embodiment of the present application. Since the terminal device B enters the viewing angle range S at this time, the information display device A switches the currently displayed screen to the second screen captured by the camera. It can be seen that the image of the terminal device B is located in the second screen. At the same time, the information display device A performs feature matching in the second screen according to the terminal feature information of the terminal device B, and determines the second position of the terminal device B in the second screen according to the feature matching result, and indicates the second position in the second screen. The second position of the terminal device B in the second screen is indicated in the form of an indicator box D in the figure.
  • the user can accurately locate the actual position of the terminal device B in the real environment, and can pick up the terminal device B to reply to the message.
  • the user does not need to take off the information display device A to accurately locate and pick up the terminal device A, and reply to the message.
  • Fig. 8 is a schematic diagram of the position relationship between the third terminal device and the viewing angle range provided in an embodiment of the present application. Assume that after the user completes replying to the message, the terminal device B is placed on the desktop, and the first position of the terminal device B is still within the current viewing angle range S.
  • Figure 9 is a display diagram of switching from the second screen to the first screen provided in an embodiment of the present application.
  • the user's first operation on the terminal device B is detected (replying to the message and putting down the terminal device B, and the picture taken by the external camera arranged on site can be used to identify whether the user puts down the terminal device B), and the currently displayed second screen is switched to the first screen.
  • the user can continue to watch the picture before receiving the location reminder and continue the previous VR content experience. The user does not need to take off the VR headset to complete the picking up of the mobile phone and the reply to the message.
  • the information display method when receiving a notification issued by a terminal device that a notification message has been obtained, issues a location reminder based on the first location information of the terminal device, and when detecting that the terminal device is within the current viewing angle, switches the currently displayed first screen to the second screen captured by the camera and containing the terminal device, the user can get the terminal device and reply to the message based on the location reminder and the location of the terminal device displayed on the second screen, and deliver information to the user in a timely manner to ensure user experience.
  • the target position of the target object is determined in the second screen based on the terminal feature information of the terminal device, and the target position is determined as the second position of the terminal device, the second position of the terminal device in the second screen is accurately determined, and the accuracy of indicating the terminal device in the second screen is improved.
  • the second screen is switched to the first screen or the pause screen corresponding to the first screen, the user can continue to perform the operation before replying to the message on the terminal device, and the user does not need to manually switch the display screen, which is convenient for user operation.
  • the information display method provided in the embodiment of the present application can be executed by an information display device or a control module in the information display device for executing the message reminder method.
  • the information display device provided in the embodiment of the present application is described by taking the method for executing the message reminder by the information display device as an example.
  • FIG10 is a schematic diagram of the structure of an information display device provided in an embodiment of the present application.
  • the information display device can be applied to electronic devices.
  • the information display device includes a device connection module 1001 , a message response module 1002 and a screen switching module 1003 .
  • the device connection module 1001 is configured to establish a connection with the terminal device
  • the message response module 1002 is configured to issue a location reminder based on the first location information of the terminal device when the terminal device obtains a notification message, and the location reminder is used to indicate the relative position of the terminal device relative to the electronic device
  • the screen switching module 1003 is configured to switch the currently displayed first screen to the second screen captured by the camera and including the terminal device when it is detected that the terminal device is within the viewing angle.
  • the information display device further includes a second position determination module and a second position display module, wherein:
  • a second position determination module is configured to obtain a target object matching the terminal feature information in the second picture based on the terminal feature information of the terminal device, and determine a target position of the target object as a second position of the terminal device;
  • the second position display module is configured to display the position of the terminal device in the second picture based on the second position.
  • the information display device further includes a picture recovery module, wherein:
  • the screen recovery module is configured to display the first screen or a paused screen corresponding to the first screen when it is determined that the processing of the notification message is completed.
  • the information display device further includes a recovery detection module, wherein:
  • the recovery detection module is configured to determine that the processing of the notification message is completed when a first operation on the terminal device is detected.
  • the first operation includes a placement operation, a closing operation and/or a reply operation to the notification message on the terminal device.
  • the information display device when receiving a notification message sent by a terminal device, issues a location reminder according to the first location information of the terminal device, and when detecting that the terminal device is within the current viewing angle, switches the currently displayed first screen to the second screen taken by the camera containing the terminal device, and the user can get the terminal device and reply to the message based on the location reminder and the location of the terminal device displayed on the second screen, so as to deliver information to the user in a timely manner and ensure user experience.
  • the target position of the target object is determined in the second screen based on the terminal feature information of the terminal device, and the target position is determined as the second position of the terminal device, so as to accurately determine the second position of the terminal device in the second screen, and improve the accuracy of indicating the terminal device in the second screen.
  • the second screen is switched to the first screen or the pause screen corresponding to the first screen, and the user can continue to perform the operation before replying the message on the terminal device, and the user does not need to manually switch the display screen, which is convenient for user operation.
  • the information display device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal.
  • the device can be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc.
  • the non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
  • the information display device in the embodiment of the present application may be a device having an operating system.
  • the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
  • the information display device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 1 to 9, and will not be described again here to avoid repetition.
  • an embodiment of the present application also provides an electronic device 1100, including a processor 1101, a memory 1102, and a program or instruction stored in the memory 1102 and executable on the processor 1101.
  • a processor 1101 a memory 1102
  • the program or instruction is executed by the processor 1101
  • each process of the above-mentioned information display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
  • FIG. 12 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 1200 includes but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210 and other components.
  • the electronic device 1200 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1210 through a power management system, so that the power management system can manage charging, discharging, and power consumption management.
  • a power source such as a battery
  • the electronic device structure shown in FIG12 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.
  • Processor 1210 establishes a connection with a terminal device; when the terminal device obtains a notification message, a location reminder is issued based on the first location information of the terminal device, and the location reminder is used to indicate the relative position of the terminal device with respect to the electronic device; when it is detected that the terminal device is within the field of view, the currently displayed first screen is switched to a second screen captured by the camera and including the terminal device.
  • a location reminder is issued based on the first location information of the terminal device, and when it is detected that the terminal device is within the current viewing angle, the currently displayed first screen is switched to a second screen taken by the camera containing the terminal device.
  • the user can get the terminal device and reply to the message based on the location reminder and the location of the terminal device displayed on the second screen, thereby delivering information to the user in a timely manner and ensuring user experience.
  • Processor 1210 is also used to, after switching the currently displayed first screen to a second screen taken by the camera and including the terminal device: based on the terminal feature information of the terminal device, obtain a target object in the second screen that matches the terminal feature information, and determine the target position of the target object as the second position of the terminal device; and display the position of the terminal device in the second screen based on the second position.
  • the processor 1210 is further configured to switch the currently displayed first picture to a picture taken by the camera including the picture of the terminal device. After the second screen, when it is determined that the processing of the notification message is completed, the first screen or a pause screen corresponding to the first screen is displayed.
  • Processor 1210 is also used to, when determining that processing of the notification message is completed, before displaying the first screen or the pause screen corresponding to the first screen, and when detecting a first operation on the terminal device, determine that processing of the notification message is completed, the first operation includes a placement operation, a closing operation and/or a reply operation to the notification message on the terminal device.
  • a location reminder is issued according to the first location information of the terminal device, and when the terminal device is detected to be within the current viewing angle, the currently displayed first screen is switched to the second screen taken by the camera containing the terminal device.
  • the user can get the terminal device and reply to the message based on the location reminder and the location of the terminal device displayed on the second screen, so as to deliver information to the user in a timely manner and ensure user experience.
  • the target position of the target object is determined in the second screen based on the terminal feature information of the terminal device, and the target position is determined as the second position of the terminal device, so as to accurately determine the second position of the terminal device in the second screen, and improve the accuracy of indicating the terminal device in the second screen.
  • the second screen is switched to the first screen or the pause screen corresponding to the first screen, and the user can continue to perform the operation before replying to the message on the terminal device, without the need for the user to manually switch the display screen, so as to facilitate user operation.
  • the input unit 1204 may include a graphics processing unit (GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode.
  • the display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
  • the user input unit 1207 includes a touch panel 12071 and other input devices 12072.
  • the touch panel 12071 is also called a touch screen.
  • the touch panel 12071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 12072 may include but are not limited to a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
  • the memory 1209 can be used to store software programs and various data, including but not limited to application programs and operating systems.
  • the processor 1210 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1210.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the various processes of the above-mentioned information display method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the processor is a processor in the electronic device described in the above embodiment.
  • the readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • modules, units, and sub-units can be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present disclosure or a combination thereof.
  • ASIC application specific integrated circuits
  • DSP digital signal processors
  • DSPD digital signal processing devices
  • PLD programmable logic devices
  • FPGA field programmable gate arrays
  • controllers controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present disclosure or a combination thereof.
  • the technology described in the embodiments of the present disclosure can be implemented by a module (such as a process, function, etc.) that performs the functions described in the embodiments of the present disclosure.
  • the software code can be stored in a memory and executed by a processor.
  • the memory can be implemented in the processor or outside the processor.
  • the disclosed devices and methods can be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.
  • Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware. And whether these functions of the methods and units of each embodiment example are executed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure. In many cases, the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, which is a better implementation method.
  • the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, disk, CD), including a number of instructions to enable a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) to execute the methods described in each embodiment of the present application.
  • a storage medium such as ROM/RAM, disk, CD
  • a terminal which can be a mobile phone, computer, server, or network equipment, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种信息显示方法、装置、设备及存储介质，属于计算机技术领域。与终端设备建立连接；在终端设备获取到通知消息的情况下，基于终端设备的第一位置信息发出位置提醒，位置提醒用于指示终端设备相对于电子设备的相对位置；在检测到终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面。

Description

信息显示方法、装置、设备及存储介质
相关申请的交叉引用
本申请要求在2022年09月28日提交中国专利局、申请号为202211218484.8、名称为“一种信息显示方法、装置、设备及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请属于计算机技术领域，具体涉及一种信息显示方法、装置、设备及存储介质。
背景技术
随着计算机技术和画面处理技术的发展，VR(Virtual Reality，虚拟现实)设备为了满足用户体验内容时的沉浸感需求，会对外界真实环境的信息进行隔绝。
但是手机等终端设备作为重要的信息传递载体，电话、视频通话等重要的消息，需要以最高优先级传达给用户。此时用户若正在使用VR设备，容易导致用户遗漏重要信息，信息无法及时传递给用户。
发明内容
本申请实施例的目的是提供一种信息显示方法、装置、设备及存储介质，能够解决用户在使用VR设备过程中容易遗漏重要信息，导致信息无法及时传递给用户的问题，能够及时向用户传递信息，保证用户体验。
第一方面，本申请实施例提供了一种信息显示方法，应用于电子设备，该方法包括：
与终端设备建立连接；
在所述终端设备获取到通知消息的情况下，基于所述终端设备的第一位置信息发出位置提醒，所述位置提醒用于指示所述终端设备相对于所述电子设备的相对位置；
在检测到所述终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含所述终端设备的第二画面。
第二方面，本申请实施例提供了一种信息显示装置，应用于电子设备，包括设备连接模块、消息响应模块和画面切换模块，其中：
所述设备连接模块，配置为与终端设备建立连接；
所述消息响应模，配置为在所述终端设备获取到通知消息的情况下，基于所述终端设备的第一位置信息发出位置提醒，所述位置提醒用于指示所述终端设备相对于所述电子设备的相对位置；
所述画面切换模块，配置为在检测到所述终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含所述终端设备的第二画面。
第三方面，本申请实施例提供了一种电子设备，该电子设备包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如第一方面所述的方法的步骤。
第四方面，本申请实施例提供了一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如第一方面所述的方法的步骤。
第五方面，本申请实施例提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如第一方面所述的方法。
在本申请实施例中，在接收到终端设备发出的通知消息时，根据终端设备的第一位置信息发出位置提醒，并在检测到终端设备在当前的视角范围内时，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，用户可基于位置提醒和第二画面上显示的终端设备的位置拿到终端设备并回复消息，及时向用户传递信息，保证用户体验。
附图说明
图1是本申请实施例提供的一种信息显示方法的流程图；
图2是本申请实施例提供的一种发出位置提醒的流程示意图；
图3是本申请实施例提供的一种对终端设备在第二画面中的位置的显示流程示意图；
图4是本申请实施例提供的第一种终端设备与视角范围的位置关系示意图；
图5是本申请实施例提供的一种位置提醒显示示意图；
图6是本申请实施例提供的第二种终端设备与视角范围的位置关系示意图；
图7是本申请实施例提供的一种第二画面的显示示意图；
图8是本申请实施例提供的第三种终端设备与视角范围的位置关系示意图；
图9是本申请实施例提供的一种从第二画面切换到第一画面的显示示意图；
图10是本申请实施例提供的一种信息显示装置的结构示意图；
图11是本申请实施例提供的一种电子设备的框架结构示意图；
图12是本申请实施例提供的一种电子设备的硬件结构示意图。
具体实施例
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”等所区分的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个， 也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”，一般表示前后关联对象是一种“或”的关系。
下面结合附图，通过具体的实施例及其应用场景对本申请实施例提供的信息显示方法进行详细地说明。
图1给出了本申请实施例提供的一种信息显示方法的流程图，本申请实施例提供的信息显示方法可以由信息显示装置来执行，该信息显示装置可以通过硬件和/或软件的方式实现，并集成在信息显示设备中。该信息显示方法可应用电子设备，该电子设备可以是VR眼镜等VR穿戴设备。
下述以信息显示装置执行信息显示方法为例进行描述。参考图1，该信息显示方法包括：
S110：与终端设备建立连接。
本方案提供的信息显示装置和终端设备预先根据设定的连接方式进行连接并与终端设备进行通信。其中，信息显示装置与终端设备可通过蓝牙、wifi热点、互联网等连接方式进行连接。终端设备可以是手机、平板电脑等。信息显示设备设置有内置或外接的显示模组，信息显示装置通过显示模组显示画面信息(例如游戏画面、影音画面、即时聊天通信画面等)，用户在佩戴信息显示设备后，可观察显示模组显示的画面信息。另外，信息显示设备还可设置内置或外接的音频模组，信息显示装置通过音频模组播放音频信息，用户在佩戴信息显示设备后，可通过音频模组听到对应的音频信息。
以VR设备作为信息显示设备为例，在相关技术中，以用户在使用VR设备时终端设备接收到需要向用户进行提醒的消息时，由于此时用户正在使VR设备，容易出现用户无法及时处理消息的情况。此时用户正在佩戴VR设备进行沉浸式体验，一般情况下VR设备会隔断用户对外界的感知，例如头盔式的VR设备会隔断外界真实的画面和声音，并且VR设备在显示虚拟画面的同时，还会播放与虚拟画面对应的声音，用户难以察觉到终端设备接收到的消息，导致无法及时向用户传递信息，信息传递效率较低，影响了用户体验。本方案提供的终端设备在接收到需要向用户进行提醒的通知消息时，可向正在使用信息显示装置的用户发出用于指示终端设备相对于电子设备的相对位置的位置提醒，提醒用户及时处理消息，及时向用户传递信息，提高信息传递效率以及用户体验。
S120：在终端设备获取到通知消息的情况下，基于终端设备的第一位置信息发出位置提醒，位置提醒用于指示终端设备相对于电子设备的相对位置。
示例性地，本方案提供的在终端设备获取到通知消息时，通知信息显示装置终端设备获取到通知消息。信息显示装置在接收到终端设备发出的获取到通知消息的通知时，确定该终端设备的第一位置信息，并基于第一位置信息发出位置提醒。其中位置提醒用于指示终端设备相对于电子设备的相对位置，用户可根据位置提醒进行移动或转向，以使信息显示装置的视角范围朝终端设备所在的第一位置移动。
可选地，位置提醒的展示方式可以是通过语音或画面的方式进行，例如通过信息显 示装置播放位置提醒对应的提醒音频、通过信息显示装置在当前画面(虚拟画面或现实画面)中显示位置提醒对应的提醒画面或者是通过弹窗的方式显示提醒画面。对于通过画面的方式发出位置提醒，提示画面可以是对终端设备的第一位置的引导。例如通过箭头图标提示终端设备的第一位置，在终端设备的第一位置位于用户或信息显示装置的右侧时，在信息显示装置当前显示的画面中弹出向右的箭头图标以及设定的文字提示，引导用户向右转向以使信息显示装置的视角范围朝终端设备所在的第一位置移动。
在一个可能的实施例中，可在终端设备中设置不同类型或不同联系人的消息的优先级，或设置不同类型或不同联系人的消息的白名单，终端设备在接收到通知消息时，根据通知消息对应的优先级或者通知消息是否在白名单中确定是否为需要通过信息显示装置向用户发出提醒的消息。若通知消息对应的优先级为高优先级，或者通知消息对应的消息类型或联系人在白名单中，则按照设定的消息提醒方式发出消息提醒，并向信息显示装置发出获取到通知消息的通知，否则直接按照设定的消息提醒方式发出消息提醒，不需要向信息显示装置发出获取到通知消息的通知。例如终端设备在接收到来电提醒、语音视频邀请、置顶消息提醒时，终端设备除了按照设定的提醒方式进行消息提醒之外，还向所连接的信息显示装置发送获取到通知消息的通知，而在接收到短信提醒等不需要即时处理的消息时，可按照设定的提醒方式进行消息提醒，并不需要对正在使用信息显示装置的用户进行提醒，以免对用户的位置提醒过于频繁而影响用户体验。
S130：在检测到终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面。
本实施例提供的信息显示设备上设置有摄像头，并且摄像头朝前设置，即摄像头的朝向与用户在佩戴信息显示设备后用户的朝向一致或相近。其中，摄像头的拍摄范围即为信息显示装置对应的视角范围。
信息显示装置可通过摄像头进行拍摄，并显示摄像头拍摄得到的第二画面，此时在显示模组上显示的是摄像头拍摄得到的现实画面，其于用户在未佩戴信息显示设备时所观察到的实际画面一致或相近，用户可根据显示模组上显示的显示画面与现实环境进行互动，而不需要摘下信息显示设备，不需要用户频繁地摘下或佩戴信息显示设备，提高用户对信息显示设备的使用体验。
示例性地，在信息显示装置发出位置提醒后，用户可按照位置提醒所指示的终端设备的第一位置转向，以使信息显示装置的视角范围移动到终端设备的第一位置对应的方向。
进一步的，实时检测终端设备是否在视角范围内，若检测到终端设备位于视角范围内，则调用摄像头拍摄第二画面，并显示摄像头拍摄得到的第二画面，以将信息显示设备当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，例如将VR穿戴设备当前显示的虚拟画面转换为包含有终端设备的现实画面。可以理解的是，由于此时终端设备位于信息显示装置的视角范围内，此时显示的第二画面中包含有终端设备对应 的图像，即用户可通过第二画面中显示的终端设备的图像位置确定终端设备的第一位置，并可拿起终端设备进行消息回复。并且在进行消息回复时，持续显示摄像头拍摄的第二画面，此时用户可根据第二画面中显示的终端设备的交互界面进行相应的操作。在此期间，用户从接收到位置提醒到拿起终端设备进行消息回复，均不需要摘下信息显示设备，在及时向用户传递信息的同时，提高用户对消息的回复效率，有效提高用户体验。
上述，在接收到终端设备发出的获取到通知消息的通知时，根据终端设备的第一位置信息发出位置提醒，并在检测到终端设备在当前的视角范围内时，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，用户可基于位置提醒和第二画面上显示的终端设备的位置拿到终端设备并回复消息，及时向用户传递信息，保证用户体验。
在一个可能的实施例中，本方案提供的信息显示方法还包括：在处于佩戴状态并已接入终端设备的情况下，获取终端设备的第一位置信息和/或终端设备的终端特征信息。
示例性地，检测信息显示设备是否处于佩戴状态并且已接入终端设备，若是，则获取终端设备的第一位置信息和/或终端设备的终端特征信息。其中，佩戴状态用于指示用于是否佩戴信息显示设备，例如在信息显示设备上设置用于检测信息显示设备的佩戴状态的佩戴检测模组，佩戴检测模组可以是生物特征检测传感器、距离传感器等，另外还可以是通过外界的摄像头拍摄得到的画面，通过用户行为分析的方式判断用户是否佩戴信息显示设备，从而确定信息显示设备的佩戴状态。信息显示设备在闲置状态下处于未佩戴状态，在检测到用户佩戴信息显示设备时，信息显示设备从未佩戴状态转变为佩戴状态。
第一位置信息可通过对终端设备的定位进行确定，例如通过蓝牙定位技术、wifi定位技术、图形定位技术(例如根据终端设备的终端特性信息在外界的摄像头拍摄得到的画面中定位终端设备的位置)等确定终端设备的第一位置信息。可选地，在信息显示设备已接入终端设备时，可先获取终端设备的第一位置信息和/或终端设备的终端特征信息，不需要等待用户佩戴信息显示设备，提高第一位置信息和终端特征信息的获取效率。可选地，在信息显示设备处于佩戴状态并已接入终端设备的情况下，可持续采集并更新信息显示设备的第一位置信息。本方案通过在检测到处于佩戴状态并已接入终端设备时获取终端设备的第一位置信息，在后续接收到终端设备发出的获取到通知消息的通知时，可快速确定终端设备的第一位置信息并发出对应的位置提醒，提高消息提醒效率。
其中，终端设备的终端特征信息可以是终端设备的外观图像或图像特征。示例性地，终端设备的终端特征信息可由终端设备预先采集并提供，也可以是通过信息显示设备或其他扫描设备对终端设备进行特征采集得到。基于终端设备的终端特征信息，可在第二画面中进行特征匹配并确定终端设备在第二画面中的位置，向用户提供终端设备在第二画面中的位置，用户可更快速地定位终端设备的位置，提高消息提醒与回复效率。
在一个可能的实施例中，如图2提供的一种发出位置提醒的流程示意图所示，本方案在终端设备获取到通知消息的情况下，基于终端设备的第一位置信息发出位置提醒时， 包括：
S121：在终端设备获取到通知消息的情况下，获取终端设备的第一位置信息。
S122：基于当前的视角范围以及第一位置信息发出位置提醒。
示例性地，在接收到终端设备发出的获取到通知消息的通知时，确定终端设备的第一位置信息以及信息显示设备当前的视角范围，根据第一位置信息确定终端设备相对于电子设备的相对位置，并根据该相对位置发出位置提醒。可选地，信息显示设备的视角范围可根据摄像头的实时朝向以及拍摄角度范围进行确定。
可选地，位置提醒可以是通过弹窗提醒的方式进行，弹窗中可提供内容操作选项以及设备方向指引。其中内容操作选项用于提供对当前显示画面的操作选项，例如暂停播放、最小化页面等，在最小化页面时，可将当前显示页面切换为主页跳转到摄像头拍摄的第二画面。内容操作选项还可以是对通知消息的快捷回复，可通过对通知消息的快捷回复通知终端设备快捷回复消息，并取消位置提醒。设备方向指引用于指示终端设备相对于电子设备的相对位置，可通过不同方向的箭头进行表示，例如终端设备在当前的视角范围的右侧时，设备方向指引为指向右侧的箭头。
本方案通过根据终端设备的第一位置信息和电子设备当前的视角范围之间的的位置关系发出位置提醒，准确地向用户提醒终端设备的位置，用户可更快速地定位终端设备的位置，提高消息提醒与回复效率。
在一个可能的实施例中，在显示摄像头拍摄的第二画面之后，可在第二画面中提醒终端设备的位置，方便用户及时定位到终端设备的位置，提高对消息的回复效率。基于此，如图3提供的一种对终端设备在第二画面中的位置的显示流程示意图所示，本方案在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面之后，还包括：
S140：在第二画面中确定终端设备的第二位置。
S150：基于第二位置显示终端设备在第二画面中的位置。
示例性地，在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面时，确定终端设备在第二画面中的第二位置，并基于第二位置在第二画面中显示终端设备在第二画面中的位置。
其中，对终端设备在第二画面中的位置的显示方式可以是在第二画面中对应第二位置的位置添加与终端设备的轮廓对应的指示框，或者是在第二画面中对应第二位置的位置对终端设备进行高亮显示，还可以是在第二画面中对应第二位置的位置添加设定的指示图标。本方案基于第二位置对终端设备在第二画面中的位置进行提示，引导用户更快地定位到终端设备的位置，提高消息提醒与回复效率。
在一个可能的实施例中，终端设备的终端特征信息为终端设备的图像特征(例如特征描述子)。基于此，本方案在第二画面中确定终端设备的第二位置时，具体为：基于终端设备的终端特征信息，获取第二画面中与终端特征信息匹配的目标对象，将目标对象的目标位置确定为终端设备的第二位置。
示例性地，在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面时，基于终端设备的终端特征信息在第二画面中进行特征匹配，以根据特征匹配结果获取在第二画面中与终端特征信息匹配的目标对象，确定获取的目标对象的目标位置，并将该目标位置确定为终端设备的第二位置。可以理解的是，在第二画面中确定终端设备的第二位置时，可确定终端设备位于电子设备的视角范围内，电子设备当前显示的画面为包含终端设备的第二画面。本方案通过基于终端设备的终端特征信息在第二画面中确定目标对象的目标位置，并将目标位置确定为终端设备的第二位置，准确确定终端设备在第二画面中的第二位置，提高对第二画面中的终端设备进行指示的准确度。
在一个可能的实施例中，在终端设备的终端特征信息为终端设备的外观图像时，在第二画面中确定终端设备的第二位置时，可以是基于终端设备的终端特征信息在第二画面中进行图像匹配，并基于图像匹配结果确定终端设备的第二位置。
示例性地，根据终端设备的外观图像在第二画面中进行图像匹配，在图像匹配结果指示的识别目标与外观图像的相似度达到设定要求时，根据识别目标在第二画面中的位置确定终端设备的第二位置。本方案通过基于终端设备的终端特征信息在第二画面中进行图像匹配，准确确定终端设备在第二画面中的第二位置，提高对第二画面中的终端设备进行指示的准确度。
在一个可能的实施例中，本方案提供的信息显示方法在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面之后，还包括：在第二画面的设定区域中显示终端设备的第四画面。
示例性的，在显示摄像头拍摄的第二画面后，同时在第二画面的设定区域中显示终端设备的第四画面，用户可通过第四画面实时观察终端设备上显示的内容。本方案提供的第四画面可以是通过终端设备对屏幕画面进行录制得到，信息提醒装置在接收到终端设备发送的屏幕画面对应数据流时，在第二画面的设定区域中将屏幕画面作为第四画面进行显示，第四画面还可以是通过在第二画面中识别终端设备的屏幕画面对应的显示区域，并对该显示区域进行放大处理得到第四画面，并显示在第二画面的设定区域中。其中第二画面的设定区域可以是在第二画面的一侧设定的区域(例如第二画面右侧的矩形区域)，通过在第二画面的设定区域中同步显示终端设备的第四画面，用户可通过第四画面观察到更清晰的屏幕画面，对终端设备的操作更方便，可更高效地处理通知消息。
在一个可能的实施例中，在用户完成对终端设备接收到的消息的处理时，可恢复信息显示设备的显示画面。基于此，本方案在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面之后，还包括：在确定完成对通知消息的处理的情况下，显示所述第一画面或所述第一画面对应的暂停画面。
示例性地，保持显示摄像头拍摄的第二画面，并判断是否完成对通知消息的处理，并且在完成对通知消息的处理时，将当前显示的第二画面切换为第一画面或第一画面对应的暂停画面。本方案通过在完成对通知消息的处理时，将第二画面切换为第一画面或 第一画面对应的暂停画面，用户可继续对终端设备进行消息回复之前的操作，不需要用户再手动切换显示画面，方便用户操作。例如，根据在接收到通知消息时所显示的画面的类型确定第一画面的类型，例如在接收到通知消息时所显示的画面为游戏画面时，在完成对通知消息的处理时，可直接将当前显示的第二画面切换为游戏画面，而在接收到通知消息时所显示的画面为影音画面时，可在显示摄像头拍摄的第二画面时暂停对应的影音画面，并且在完成对通知消息的处理时，将当前显示的第二画面切换为影音画面对应的暂停画面，用户可选择是否继续播放影音画面。
在一个可能的实施例中，可根据用户对终端设备的操作确定是否完成对通知消息的处理，基于此，本方案在确定完成对通知消息的处理的情况下，显示第一画面或第一画面对应的暂停画面之前，还包括：在检测到对终端设备的第一操作的情况下，确定完成对通知消息的处理，第一操作包括对终端设备的放置操作、关闭操作和/或对通知消息的回复操作。
示例性地，在检测到用户对终端设备触发第一操作时，确定完成对通知消息的处理，并将当前显示画面从第二画面切换到第一画面或第一画面对应的暂停画面。可选地，第一操作包括对终端设备的放置操作、关闭操作和/或对通知消息的回复操作。例如，在检测到用户对终端设备执行放置操作(即检测到终端设备脱离用户，被放置在其他物体上)、检测到用户对终端设备执行关闭操作(例如检测到用户主动关闭终端设备，其中关闭终端设备可以是关闭终端设备的屏幕，以使终端设备的屏幕进入熄屏状态)或者是测到用户完成对通知消息的回复操作时，可认为用户已经不需要再对终端设备进行操作，此时已完成对通知消息的处理，其中检测到用户对通知消息的回复操作可以是检测到用户发送了对终端设备接收到的通知消息的回复消息，并且关闭了该消息通知的回复页面，例如终端设备中安装的微信接收到通知消息时，电子设备发出位置提醒，并在检测到用户在微信上该通知消息的回复页面上回复了该通知消息，并关闭了该回复页面时，确定用户已经完成对通知消息的回复操作。例如，终端设备通过自身配置的惯性运动传感器判断其被用户握持还是被放置，并在检测到终端设备被放置时通知信息显示设备检测到对终端设备的放置操作，或者是通过外部摄像头的拍摄画面判断终端设备被用户握持还是被放置，并在检测到终端设备被放置时通知信息显示设备检测到对终端设备的放置操作，信息显示设备确定检测到用户对终端设备触发第一操作。或者是在检测到用户对终端设备的放置操作时，继续检测终端设备是否被关闭(例如熄屏)，或者是终端设备是否已对接收到的消息进行回复，并且在检测到终端设备被关闭，或者是已经万和城对消息的回复时，信息显示设备确定检测到用户对终端设备触发第一操作。本方案通过检测用户对终端设备进行的第一操作判断是否完成对通知消息的处理，以准确判断切换显示第一画面或第一画面对应的暂停画面的时机，不需要用户再手动切换显示画面，方便用户操作。
在一个可能的实施例中，本方案提供的信息显示方法还包括：在当前显示的第一画 面上显示终端设备接收到的消息。示例性的，在接收到终端设备发出的获取到通知消息的通知时，除了在将第一画面切换为第二画面外，还可以是在第一画面的基础上显示终端设备接收到的信息，即终端设备在接收到新的信息时，向信息显示设备发出获取到通知消息的通知。信息显示设备在接收到终端设备发出的获取到通知消息的通知时，获取终端设备接收到的信息，并以弹窗消息的形式在当前显示的第一画面的基础上显示终端设备接收到的信息，用户可在第一画面上查看或处理终端设备接收到的消息，可将对消息的回复操作发送到终端设备上，以通知终端设备基于回复操作对消息进行回复。
例如手机在接收到新的消息时，在VR穿戴设备显示的虚拟画面上显示终端设备接收到的消息，用户可在虚拟画面上查看并回复消息，对消息的回复操作可发送到手机上，通知手机基于回复操作对消息进行回复。本方案在接收到终端设备发出的获取到通知消息的通知时，在第一画面的基础上显示终端设备接收到的消息，用户可在第一画面中查看消息，并可通过信息显示设备快速对通知消息进行处理，不需要移动终端设备的视角，拿起终端设备进行消息处理，有效提高对信息的处理效率。
以VR设备作为信息显示设备，并以手机作为终端设备为例进行示例性描述，信息显示设备在接入终端设备时，获取并记录终端设备的第一位置信息以及终端特征信息，并实时更新终端设备的第一位置信息以及信息显示设备当前的视角范围。图4是本申请实施例提供的第一种终端设备与视角范围的位置关系示意图，如图4所示，其中信息显示设备A上设置有摄像头，摄像头的拍摄角度范围即为信息显示设备A的视角范围S，图中信息显示设备A的视角范围S对应的区域为扇形区域。假设此时与信息显示设备A连接的终端设备B的第一位置位于视角范围S之外，图中终端设备B的第一位置位于视角范围S外的右侧。若此时终端设备B接收到高优先级并且在白名单内的消息，需要及时提醒用户对终端设备接收到的通知消息进行处理，则向信息显示设备A发送获取到通知消息的通知。
图5是本申请实施例提供的一种位置提醒显示示意图，如图5所示，信息显示设备A在接收到获取到通知消息的通知时，获取终端设备B的第一位置信息以及信息显示设备A当前的视角范围S，确定终端设备B的第一位置信息相对于当前的视角范围S的相对位置。若终端设备B的第一位置信息在当前的视角范围S内，则可直接显示摄像头拍摄的包含终端设备B的第二画面。由于此时终端设备B的第一位置位于当前的视角范围S之外，信息显示设备A需要根据终端设备B的第一位置信息所指示的第一位置相对于当前的视角范围S的位置生成位置提醒，并在信息显示设备A当前显示的画面中以消息弹窗C的方式显示位置提醒。其中消息弹窗C包括内容操作选项C1以及设备方向指引C2。其中内容操作选项C1用于提供对当前显示画面的操作选项，例如暂停播放、最小化页面等。设备方向指引C2用于指示终端设备B在当前的视角范围S相对于电子设备(VR设备)的相对位置，其通过不同方向的箭头进行表示，由于图中终端设备B在当前的视角范围S的右侧，图中设备方向指引C2为指向右侧的箭头。
图6是本申请实施例提供的第二种终端设备与视角范围的位置关系示意图。在显示位置提醒时，用户可根据设备方向指引C2的指示向右转动，以使终端设备A的第一位置进入视角范围S内。如图6所示，此时随着用户向右转向，视角范围S也以信息显示设备A为圆心顺时针(俯视角度)转动，并随着视角范围S的转动，终端设备B逐渐进入时间范围S。
图7是本申请实施例提供的一种第二画面的显示示意图，由于此时终端设备B进入视角范围S内，信息显示设备A将当前显示的画面切换为摄像头拍摄的第二画面，可见，终端设备B的图像位于第二画面内。同时，信息显示设备A根据终端设备B的终端特征信息在第二画面中进行特征匹配，并根据特征匹配结果确定终端设备B在第二画面中的第二位置，并在第二画面中对第二位置进行表示，图中以指示框D的形式指示终端设备B在第二画面中的第二位置。此时，用户可准确地定位终端设备B在现实环境中的实际位置，并可拿起终端设备B进行消息的回复，在此期间用户不需要摘下信息显示设备A即可准确定位并拿到终端设备A，并进行消息回复。
图8是本申请实施例提供的第三种终端设备与视角范围的位置关系示意图。假设用户在完成对消息的回复后，将终端设备B放置在桌面上，此时终端设备B的第一位置仍在当前的视角范围S内。
图9是本申请实施例提供的一种从第二画面切换到第一画面的显示示意图，此时检测到用户对终端设备B的第一操作(回复消息并放下终端设备B，可通过现场布置的外部摄像头拍摄的画面识别用户是否放下终端设备B)，则将当前显示的第二画面切换为第一画面，此时用户可继续观看接收到位置提醒前的画面，继续之前的VR内容体验，用户无需摘取VR头显设备，即可完成手机的拿取以及消息的回复。
本申请实施例提供的信息显示方法，在接收到终端设备发出的获取到通知消息的通知时，根据终端设备的第一位置信息发出位置提醒，并在检测到终端设备在当前的视角范围内时，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，用户可基于位置提醒和第二画面上显示的终端设备的位置拿到终端设备并回复消息，及时向用户传递信息，保证用户体验。同时，基于终端设备的终端特征信息在第二画面中确定目标对象的目标位置，并将目标位置确定为终端设备的第二位置，准确确定终端设备在第二画面中的第二位置，提高对第二画面中的终端设备进行指示的准确度。并且在完成对通知消息的处理时，将第二画面切换为第一画面或第一画面对应的暂停画面，用户可继续对终端设备进行消息回复之前的操作，不需要用户再手动切换显示画面，方便用户操作。
需要说明的是，本申请实施例提供的信息显示方法，执行主体可以为信息显示装置，或者该信息显示装置中的用于执行消息提醒的方法的控制模块。本申请实施例中以信息显示装置执行消息提醒的方法为例，说明本申请实施例提供的信息显示装置。
图10是本申请实施例提供的一种信息显示装置的结构示意图，该信息显示装置可应用于电子设备，如图10所示，该信息显示装置包括设备连接模块1001、消息响应模块1002和画面切换模块1003。
其中，设备连接模块1001，配置为与终端设备建立连接，消息响应模块1002，配置为在终端设备获取到通知消息的情况下，基于终端设备的第一位置信息发出位置提醒，位置提醒用于指示终端设备相对于电子设备的相对位置；画面切换模块1003，配置为在检测到终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面。
可选地，信息显示装置还包括第二位置确定模块和第二位置显示模块，其中：
第二位置确定模块，配置为基于终端设备的终端特征信息，获取第二画面中与终端特征信息匹配的目标对象，将目标对象的目标位置确定为终端设备的第二位置；
第二位置显示模块，配置为基于第二位置显示终端设备在第二画面中的位置。
可选地，信息显示装置还包括画面恢复模块，其中：
画面恢复模块，配置为在确定完成对通知消息的处理的情况下，显示所述第一画面或所述第一画面对应的暂停画面。
可选地，信息显示装置还包括恢复检测模块，其中：
恢复检测模块，配置为在检测到对终端设备的第一操作的情况下，确定完成对通知消息的处理，第一操作包括对终端设备的放置操作、关闭操作和/或对通知消息的回复操作。
本申请实施例提供的信息显示装置，在接收到终端设备发出的通知消息时，根据终端设备的第一位置信息发出位置提醒，并在检测到终端设备在当前的视角范围内时，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，用户可基于位置提醒和第二画面上显示的终端设备的位置拿到终端设备并回复消息，及时向用户传递信息，保证用户体验。同时，基于终端设备的终端特征信息在第二画面中确定目标对象的目标位置，并将目标位置确定为终端设备的第二位置，准确确定终端设备在第二画面中的第二位置，提高对第二画面中的终端设备进行指示的准确度。并且在完成对通知消息的处理时，将第二画面切换为第一画面或第一画面对应的暂停画面，用户可继续对终端设备进行消息回复之前的操作，不需要用户再手动切换显示画面，方便用户操作。
本申请实施例中的信息显示装置可以是装置，也可以是终端中的部件、集成电路、或芯片。该装置可以是移动电子设备，也可以为非移动电子设备。示例性地，移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本或者个人数字助理(personal digital assistant，PDA)等，非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage，NAS)、个人计算机(personal computer，PC)、电视机(television，TV)、柜员机或者自助机等，本申请实施例不作具体限定。
本申请实施例中的信息显示装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统，可以为ios操作系统，还可以为其他可能的操作系统，本申请实施例不作具体限定。
本申请实施例提供的信息显示装置能够实现图1至图9的方法实施例实现的各个过程，为避免重复，这里不再赘述。
可选地，如图11所示，本申请实施例还提供一种电子设备1100，包括处理器1101，存储器1102，存储在存储器1102上并可在所述处理器1101上运行的程序或指令，该程序或指令被处理器1101执行时实现上述信息显示方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，本申请实施例中的电子设备包括上述所述的移动电子设备和非移动电子设备。
图12为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备1200包括但不限于：射频单元1201、网络模块1202、音频输出单元1203、输入单元1204、传感器1205、显示单元1206、用户输入单元1207、接口单元1208、存储器1209、以及处理器1210等部件。
本领域技术人员可以理解，电子设备1200还可以包括给各个部件供电的电源(比如电池)，电源可以通过电源管理系统与处理器1210逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图12中示出的电子设备结构并不构成对电子设备的限定，电子设备可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置，在此不再赘述。
处理器1210，与终端设备建立连接；在终端设备获取到通知消息的情况下，基于终端设备的第一位置信息发出位置提醒，位置提醒用于指示终端设备相对于电子设备的相对位置；在检测到终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面。
上述，在接收到终端设备发出的通知消息时，根据终端设备的第一位置信息发出位置提醒，并在检测到终端设备在当前的视角范围内时，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，用户可基于位置提醒和第二画面上显示的终端设备的位置拿到终端设备并回复消息，及时向用户传递信息，保证用户体验。
处理器1210，还用于在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面之后：基于终端设备的终端特征信息，获取第二画面中与终端特征信息匹配的目标对象，将目标对象的目标位置确定为终端设备的第二位置；基于第二位置显示终端设备在第二画面中的位置。
处理器1210，还用于在将当前显示的第一画面切换为摄像头拍摄的包含终端设备的 第二画面之后，在确定完成对通知消息的处理的情况下，显示所述第一画面或所述第一画面对应的暂停画面。
处理器1210，还用于在确定完成对通知消息的处理的情况下，显示所述第一画面或所述第一画面对应的暂停画面之前，在检测到对终端设备的第一操作的情况下，确定完成对通知消息的处理，第一操作包括对终端设备的放置操作、关闭操作和/或对通知消息的回复操作。
上述，在接收到终端设备发出的通知消息时，根据终端设备的第一位置信息发出位置提醒，并在检测到终端设备在当前的视角范围内时，将当前显示的第一画面切换为摄像头拍摄的包含终端设备的第二画面，用户可基于位置提醒和第二画面上显示的终端设备的位置拿到终端设备并回复消息，及时向用户传递信息，保证用户体验。同时，基于终端设备的终端特征信息在第二画面中确定目标对象的目标位置，并将目标位置确定为终端设备的第二位置，准确确定终端设备在第二画面中的第二位置，提高对第二画面中的终端设备进行指示的准确度。并且在完成对通知消息的处理时，将第二画面切换为第一画面或第一画面对应的暂停画面，用户可继续对终端设备进行消息回复之前的操作，不需要用户再手动切换显示画面，方便用户操作。
应理解的是，本申请实施例中，输入单元1204可以包括图形处理器(Graphics Processing Unit，GPU)12041和麦克风12042，图形处理器12041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元1206可包括显示面板12061，可以采用液晶显示器、有机发光二极管等形式来配置显示面板12061。用户输入单元1207包括触控面板12071以及其他输入设备12072。触控面板12071，也称为触摸屏。触控面板12071可包括触摸检测装置和触摸控制器两个部分。其他输入设备12072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。存储器1209可用于存储软件程序以及各种数据，包括但不限于应用程序和操作系统。处理器1210可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器1210中。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述信息显示方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述信息显示方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
可以理解的是，本公开实施例描述的这些实施例可以用硬件、软件、固件、中间件、微码或其组合来实现。对于硬件实现，模块、单元、子单元可以实现在一个或多个专用集成电路(Application Specific Integrated Circuits,ASIC)、数字信号处理器(Digital Signal Processor,DSP)、数字信号处理设备(DSP Device,DSPD)、可编程逻辑设备(Programmable Logic Device,PLD)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、通用处理器、控制器、微控制器、微处理器、用于执行本公开所述功能的其它电子单元或其组合中。
对于软件实现，可通过执行本公开实施例所述功能的模块(例如过程、函数等)来实现本公开实施例所述的技术。软件代码可存储在存储器中并通过处理器执行。存储器可以在处理器中或在处理器外部实现。
在本申请所提供的实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽咯，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本公开各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。 另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件来实现。而各实施例示例的方法及单元的这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本公开的范围。很多情况下上述实施例方法可借助软件加必需的通用硬件平台的方式来实现是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。

Claims (13)

  1. 一种信息显示方法，应用于电子设备，包括：
    与终端设备建立连接；
    在所述终端设备获取到通知消息的情况下，基于所述终端设备的第一位置信息发出位置提醒，所述位置提醒用于指示所述终端设备相对于所述电子设备的相对位置；
    在检测到所述终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含所述终端设备的第二画面。
  2. 根据权利要求1所述的信息显示方法，其中，所述将当前显示的第一画面切换为摄像头拍摄的包含所述终端设备的第二画面之后，还包括：
    基于所述终端设备的终端特征信息，获取所述第二画面中与所述终端特征信息匹配的目标对象，将所述目标对象的目标位置确定为所述终端设备的第二位置；
    基于所述第二位置显示所述终端设备在所述第二画面中的位置。
  3. 根据权利要求1所述的信息显示方法，其中，所述将当前显示的第一画面切换为摄像头拍摄的包含所述终端设备的第二画面之后，还包括：
    在确定完成对所述通知消息的处理的情况下，显示所述第一画面或所述第一画面对应的暂停画面。
  4. 根据权利要求3所述的信息显示方法，其中，所述在确定完成对所述显示所述第一画面或所述第一画面对应的暂停画面之前，还包括：
    在检测到对所述终端设备的第一操作的情况下，确定完成对所述通知消息的处理，所述第一操作包括对所述终端设备的放置操作、关闭操作和/或对所述通知消息的回复操作。
  5. 一种信息显示装置，应用于电子设备，包括设备连接模块、消息响应模块和画面切换模块，其中：
    所述设备连接模块，配置为与终端设备建立连接；
    所述消息响应模，配置为在所述终端设备获取到通知消息的情况下，基于所述终端设备的第一位置信息发出位置提醒，所述位置提醒用于指示所述终端设备相对于所述电子设备的相对位置；
    所述画面切换模块，配置为在检测到所述终端设备位于视角范围内的情况下，将当前显示的第一画面切换为摄像头拍摄的包含所述终端设备的第二画面。
  6. 根据权利要求5所述的信息显示装置，其中，所述信息显示装置还包括第二位置确定模块和第二位置显示模块，其中：
    所述第二位置确定模块，配置为基于所述终端设备的终端特征信息，获取所述第二画面中与所述终端特征信息匹配的目标对象，将所述目标对象的目标位置确定为所述终端设备的第二位置；
    所述第二位置显示模块，配置为基于所述第二位置显示所述终端设备在所述第二画面中的位置。
  7. 根据权利要求5所述的信息显示装置，其中，所述信息显示装置还包括画面恢复模块，其中：
    所述画面恢复模块，配置为在确定完成对所述通知消息的处理的情况下，显示所述第一画面或所述第一画面对应的暂停画面。
  8. 根据权利要求7所述的信息显示装置，其中，所述信息显示装置还包括恢复检测模块，其中：
    所述恢复检测模块，配置为在检测到对所述终端设备的第一操作的情况下，确定完成对所述通知消息的处理，所述第一操作包括对所述终端设备的放置操作、关闭操作和/或对所述通知消息的回复操作。
  9. 一种电子设备，包括处理器，存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如权利要求1-4任一项所述的信息显示方法的步骤。
  10. 一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如权利要求1-4任一项所述的信息显示方法的步骤。
  11. 一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如权利要求1-4任一项所述的信息显示方法的步骤。
  12. 一种计算机程序产品，所述计算机程序产品被至少一个处理器执行以实现如权利要求1-4任一项所述的信息显示方法的步骤。
  13. 一种电子设备，用于执行如权利要求1-4任一项所述的信息显示方法的步骤。
PCT/CN2023/121198 2022-09-28 2023-09-25 信息显示方法、装置、设备及存储介质 Ceased WO2024067513A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP23870742.6A EP4597262A4 (en) 2022-09-28 2023-09-25 METHOD AND APPARATUS FOR DISPLAYING INFORMATION, AND DEVICE AND STORAGE MEDIA
US19/086,111 US20250220102A1 (en) 2022-09-28 2025-03-20 Information display method and apparatus, device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211218484.8A CN115407879A (zh) 2022-09-28 2022-09-28 一种信息显示方法、装置、设备及存储介质
CN202211218484.8 2022-09-28

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/086,111 Continuation US20250220102A1 (en) 2022-09-28 2025-03-20 Information display method and apparatus, device, and storage medium

Publications (1)

Publication Number Publication Date
WO2024067513A1 true WO2024067513A1 (zh) 2024-04-04

Family

ID=84166973

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/121198 Ceased WO2024067513A1 (zh) 2022-09-28 2023-09-25 信息显示方法、装置、设备及存储介质

Country Status (4)

Country Link
US (1) US20250220102A1 (zh)
EP (1) EP4597262A4 (zh)
CN (1) CN115407879A (zh)
WO (1) WO2024067513A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质
CN115794019A (zh) * 2022-12-09 2023-03-14 维沃移动通信有限公司 投影方法、装置、电子设备和可读存储介质
CN119211512B (zh) * 2024-11-22 2025-04-08 雷鸟创新技术(深圳)有限公司 扩展现实信息通知方法、装置、电子设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107533360A (zh) * 2015-12-07 2018-01-02 华为技术有限公司 一种显示、处理的方法及相关装置
CN112596609A (zh) * 2020-12-25 2021-04-02 维沃移动通信有限公司 显示处理方法、显示处理装置和可穿戴设备
CN113672324A (zh) * 2021-08-06 2021-11-19 维沃移动通信（杭州）有限公司 消息提醒装置方法、装置、电子设备及存储介质
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10055887B1 (en) * 2015-02-19 2018-08-21 Google Llc Virtual/augmented reality transition system and method
EP3236423A1 (en) * 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
US10152851B2 (en) * 2016-11-29 2018-12-11 Microsoft Technology Licensing, Llc Notification artifact display
CN106774855A (zh) * 2016-11-29 2017-05-31 北京小米移动软件有限公司 可移动控制器的定位方法及装置
US10558260B2 (en) * 2017-12-15 2020-02-11 Microsoft Technology Licensing, Llc Detecting the pose of an out-of-range controller
CN108646997A (zh) * 2018-05-14 2018-10-12 刘智勇 一种虚拟及增强现实设备与其他无线设备进行交互的方法
US20190385372A1 (en) * 2018-06-15 2019-12-19 Microsoft Technology Licensing, Llc Positioning a virtual reality passthrough region at a known distance
US11231827B2 (en) * 2019-08-03 2022-01-25 Qualcomm Incorporated Computing device and extended reality integration

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107533360A (zh) * 2015-12-07 2018-01-02 华为技术有限公司 一种显示、处理的方法及相关装置
CN112596609A (zh) * 2020-12-25 2021-04-02 维沃移动通信有限公司 显示处理方法、显示处理装置和可穿戴设备
CN113672324A (zh) * 2021-08-06 2021-11-19 维沃移动通信（杭州）有限公司 消息提醒装置方法、装置、电子设备及存储介质
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4597262A4 *

Also Published As

Publication number Publication date
CN115407879A (zh) 2022-11-29
EP4597262A1 (en) 2025-08-06
US20250220102A1 (en) 2025-07-03
EP4597262A4 (en) 2026-01-14

Similar Documents

Publication Publication Date Title
CN111447074B (zh) 群组会话中的提醒方法、装置、设备及介质
US10057627B2 (en) Method, apparatus and system for displaying bullet screen information
WO2024067513A1 (zh) 信息显示方法、装置、设备及存储介质
CN112041791B (zh) 一种显示输入法虚拟键盘的方法及终端
CN109905754B (zh) 虚拟礼物收取方法、装置及存储设备
CN110209952A (zh) 信息推荐方法、装置、设备及存储介质
CN111309431B (zh) 群组会话中的显示方法、装置、设备及介质
WO2019080929A1 (zh) 消息提示方法、移动终端
CN112764608B (zh) 消息处理方法、装置、设备及存储介质
WO2016184302A1 (zh) 消息转发方法及电子设备
CN109587322B (zh) 消息处理方法、消息查看方法和终端
US12028474B2 (en) User interfaces associated with remote input devices
CN115086737B (zh) 数据处理方法、装置、电子设备及存储介质
CN106375179B (zh) 一种显示即时通信消息的方法和装置
CN111414105A (zh) 信息提醒方法及电子设备
CN106303733B (zh) 播放直播特效信息的方法和装置
CN115051965B (zh) 一种控制视频播放的方法、装置、计算设备及存储介质
CN111949879A (zh) 推送消息的方法、装置、电子设备及可读存储介质
CN113141293A (zh) 消息显示方法、装置及电子设备
CN112764607A (zh) 定时消息处理方法、装置、终端及存储介质
CN112688859B (zh) 语音消息的发送方法、装置、电子设备及可读存储介质
CN109739408A (zh) 一种终端的操作控制方法及终端
CN113709306B (zh) 会话处理方法、装置及电子设备
CN114968021A (zh) 消息显示方法、装置、设备及介质
CN113225518B (zh) 会议录制文件的处理方法、装置、终端及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23870742

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023870742

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023870742

Country of ref document: EP

Effective date: 20250428

WWP Wipo information: published in national office

Ref document number: 2023870742

Country of ref document: EP