CN115840552B - Display method and device and first electronic equipment - Google Patents

Abstract

The application discloses a display method and device and first electronic equipment, and belongs to the field of image display. The method comprises the steps of obtaining a first image corresponding to a first view angle of a first camera, obtaining position information and modeling information of a target object, wherein the target object is blocked by the first object in the first view angle, the modeling information is used for building an object model of the target object, and generating and displaying a second image based on the position information and the modeling information of the target object and the first image, and the second image comprises the target object.

Description

Display method and device and first electronic equipment

Technical Field

The application belongs to the field of image display, and particularly relates to a display method and device and first electronic equipment.

Background

Extended Reality (XR) refers to a man-machine interactive environment generated by computer technology and electronic devices, in which a real physical world scene is combined with a virtual application scene, and when the electronic device is used, the electronic device may use the real physical world scene as a background and virtual application scene content as a foreground to be combined for presentation to a user.

However, taking an electronic device as an XR glasses, when a user uses the XR glasses, the XR glasses can only present objects in a real physical world scene acquired by a camera in real time to the user, so that some blocked objects cannot be presented to the user, and the user cannot know the position of the blocked objects in the current view angle range.

Disclosure of Invention

The embodiment of the application aims to provide a display method and device and first electronic equipment, which can solve the problem that the electronic equipment cannot help a user to locate a shielded object.

In a first aspect, an embodiment of the present application provides a display method, including acquiring a first image corresponding to a first view angle of a first camera, acquiring position information and modeling information of a target object, where the target object is blocked by a first object in the first view angle, and the modeling information is used to build an object model of the target object, and generating and displaying a second image based on the position information and the modeling information of the target object and the first image, where the second image includes the target object.

In a second aspect, an embodiment of the present application provides a display apparatus, including an acquisition module and a processing module. The system comprises an acquisition module, a modeling information acquisition module and a target object acquisition module, wherein the acquisition module is used for acquiring a first image corresponding to a first visual angle of a first camera, acquiring position information and modeling information of the target object, the target object is blocked by a first object in the first visual angle, and the modeling information is used for establishing an object model of the target object. And the processing module is used for generating and displaying a second image based on the position information and modeling information of the target object and the first image, wherein the second image comprises the target object.

In a third aspect, an embodiment of the present application provides a first electronic device comprising a processor and a memory storing a program or instructions executable on the processor, the program or instructions implementing the steps of the method according to the first aspect when executed by the processor.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor perform the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executable by at least one processor to implement the method according to the first aspect.

In the embodiment of the application, the first electronic equipment can acquire a first image corresponding to the first visual angle of the first camera, acquire the position information and the modeling information of the target object, and the target object is blocked by the first object in the first visual angle so as to generate and display a second image based on the position information and the modeling information of the target object and the first image, wherein the second image comprises the target object. In the scheme, the first electronic device can acquire the first image corresponding to the first visual angle of the first camera and the position information and modeling information of the target object blocked by the first object in the first visual angle, so that the first electronic device can generate and display the second image comprising the target object based on the acquired position information and modeling information of the target object and the first image, and the first electronic device can help a user to position the blocked target object in the first visual angle.

Drawings

FIG. 1 is a schematic diagram of a display method according to an embodiment of the present application;

FIG. 2 is one example schematic diagram of a display target object according to an embodiment of the present application;

FIG. 3 is a diagram showing a second example of a display target object according to the embodiment of the present application;

fig. 4 is a schematic structural diagram of a display device according to an embodiment of the present application;

fig. 5 is a schematic diagram of a hardware structure of a first electronic device according to an embodiment of the present application;

fig. 6 is a second schematic hardware structure of the first electronic device according to the embodiment of the present application.

Detailed Description

The technical solutions of the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which are obtained by a person skilled in the art based on the embodiments of the present application, fall within the scope of protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type, and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The display method provided by the embodiment of the application is described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.

The display method in the embodiment of the application can be applied to the scene of the shielded object displayed by the electronic equipment.

At present, when an electronic device (for example, XR glasses) displays an application scene, it is sometimes considered to mix the content of the application scene with a real physical world scene and then display the mixed content, which is often seen by a boundary system of a Virtual Reality (VR) device or an augmented reality (augmented reality, AR). Specifically, taking an electronic device as an example of XR glasses, when the XR glasses are used for mixing application scene content and real physical world scenes, the real physical world scenes are usually considered as the background, and the application scene content is considered as the foreground to be mixed, so that the experience effect of real human eye vision is achieved. However, in the above method, the XR glasses can only present the objects in the real physical world scene acquired by the camera in real time to the user, and some blocked objects cannot be presented to the user, so that the user cannot know the position of the blocked objects in the current view angle range.

In the embodiment of the application, when the target object (i.e. the blocked object) is out of the first view angle range of the first camera, the XR glasses can acquire the first image corresponding to the first view angle of the first camera, and the position information and the modeling information of the target object blocked by the first object in the first view angle, so that the second image comprising the target object is generated and displayed based on the acquired position information and the modeling information of the target object and the first image, and thus, the XR glasses can help a user to position the blocked target object in the first view angle.

The execution subject of the display method provided by the embodiment of the application is a display device. The display device may be a first electronic device, or may be a function control module in the first electronic device, which is not limited in this embodiment of the present application. The technical solution provided in the embodiment of the present application will be described below by taking a first electronic device as an example.

The embodiment of the application provides a display method, and fig. 1 shows a flow chart of the display method provided by the embodiment of the application. As shown in fig. 1, the display method provided in the embodiment of the present application may include the following steps 201 to 203.

Step 201, a first electronic device obtains a first image corresponding to a first view angle of a first camera.

Optionally, in an embodiment of the present application, the first camera is a camera of a first electronic device.

Optionally, in an embodiment of the present application, the first image may be an image, that is, a two-dimensional image, in a first view angle acquired by the first electronic device based on the first camera.

Optionally, in an embodiment of the present application, the first image may be a three-dimensional image constructed by the first electronic device based on a two-dimensional image in a first view angle acquired by the first camera.

The first electronic device may convert the two-dimensional image within the first view angle acquired by the first camera into a three-dimensional image by a structural reconstruction technique (Structure From Motion, SFM), for example.

Step 202, the first electronic device obtains location information and modeling information of the target object.

In the embodiment of the application, the target object is blocked by the first object in the first view angle, and the modeling information is used for establishing an object model of the target object.

Optionally, in the embodiment of the present application, the target object may include at least one of other users, plants, animals, buildings, electronic products, tables and chairs, etc.

Illustratively, the first object may include at least one of other users, plants, animals, buildings, electronics, tables, chairs, and the like.

It should be noted that, the target object is blocked by the first object in the first view angle, which can be understood that the target object is located outside the first view angle of the first camera, or the target object is not included in the display scene of the first electronic device, or the target object is not included in the image in the first view angle acquired by the first electronic device through the first camera, that is, the user cannot observe the target object through the display screen of the first electronic device.

Optionally, in the embodiment of the present application, the first electronic device may acquire an image acquired by the second camera, and then obtain the position information of the target object based on the image and the position information of the second camera.

The second camera may be any one of a camera of a target electronic device connected to the first electronic device, a network camera, a local camera, and the like.

The distance between the second camera and the first electronic device is smaller than or equal to a preset threshold value.

The target electronic device is exemplified by a mobile electronic device (e.g., a mobile phone, a tablet computer, a notebook computer, a palm computer, etc.), and may also be a non-mobile electronic device (e.g., a personal computer, a television, etc.).

For example, when the user uses the first electronic device, the first electronic device may be triggered to establish connection with the second camera or the target electronic device corresponding to the second camera, so as to acquire, in real time, a scene in the second view angle of the second camera, that is, acquire, in real time, an image acquired by the second camera based on the second view angle.

Illustratively, the target object is located in the second view angle of the second camera, and it is understood that the image acquired by the second camera includes the target object.

For example, after the first electronic device obtains the image including the target object acquired by the second camera, the image may be analyzed to obtain the position information of the target object relative to the second camera, and then the first electronic device may calculate, based on the position information of the second camera and the position information of the target object relative to the second camera, the position information of the target object relative to the first electronic device.

Optionally, in the embodiment of the present application, the first electronic device may obtain modeling information of the target object based on the image acquired by the second camera.

The modeling information of the target object includes data rendered by the target object, including color data, texture data, and the like.

For example, after the first electronic device obtains the image including the target object acquired by the second camera, the image may be processed by using a picture modeling technique to obtain modeling information of the target object.

For example, the first electronic device may directly acquire modeling information of the target object stored in advance.

Optionally, in the embodiment of the present application, the first electronic device may obtain at least one of location information of the target object and modeling information of the target object based on map data of the target map.

Illustratively, the target map includes a target object.

The map data of the target map may be a map prepared in advance for the local or network

Data.

For example, the first electronic device may acquire the name of the target object to perform a query in map data of the target map according to the name of the target object, thereby acquiring the location information of the target object.

For example, the first electronic device may query map data of the target map according to the name of the target object to obtain some picture information associated with the target object, and then the first electronic device may obtain modeling information of the target object according to the picture information by using a picture modeling technology.

For example, the first electronic device may directly obtain the modeling information of the target object from the map data of the target map according to the name of the target object, where the modeling information of the target object is stored in the map data in advance.

Step 203, the first electronic device is based on the location information and modeling information of the target object, and the first

And generating and displaying a second image.

In an embodiment of the present application, the second image includes a target object.

Optionally, in the embodiment of the present application, the first electronic device may process the first image based on the location information and the modeling information of the target object, so as to generate and display the second image.

The second image is understood, for example, as a perspective image of the target object, which is

Obtained by performing perspective projection on an object model of a target object on a first object.

Optionally, in the embodiment of the present application, after the first electronic device generates and displays the second image, some resources of the first electronic device, such as memory, occupation of a central processing unit (Central Processing Unit, CPU), etc., may be released.

Optionally, in the embodiment of the present application, after the first electronic device generates and displays the second image, if the window size for displaying the second image completely covers the foreground application of the first electronic device, the first electronic device may suspend running the foreground application.

Illustratively, the window size for displaying the second image may be displayed by default by the system, and the user may adjust the display size of the window.

Optionally, in an embodiment of the present application, the first electronic device generating and displaying the second image including the target object may be understood as entering a perspective mode to perspective display the occluded target object.

For example, the user may enter an input to the first electronic device to trigger the first electronic device to exit the perspective mode, i.e. cancel the display of the second image.

The input may be any one of voice input, key input, gesture input, etc., and may be specifically determined according to actual use requirements, which is not limited by the embodiment of the present invention.

For example, the user may trigger the first electronic device to exit the perspective mode by voice input such as "exit perspective mode", "cancel locating XX item", etc.

For example, the user may input physical keys of a common object such as a mobile phone, a headset, a watch, etc. associated with the first electronic device, or perform a specific gesture input to trigger the first electronic device to exit the perspective mode.

For example, the first electronic device may actively exit the perspective mode when the first electronic device detects that the target object has not been occluded by another object.

Illustratively, after the first electronic device exits perspective mode, the resource may be reloaded.

For example, after the first electronic device exits the perspective mode, if the foreground application is in a suspended running state, the first electronic device may re-run the foreground application.

The embodiment of the application provides a display method, wherein a first electronic device can acquire a first image corresponding to a first visual angle of a first camera, acquire position information and modeling information of a target object, and the target object is blocked by the first object in the first visual angle so as to generate and display a second image based on the position information and the modeling information of the target object and the first image, wherein the second image comprises the target object. In the scheme, the first electronic device can acquire the first image corresponding to the first visual angle of the first camera and the position information and modeling information of the target object blocked by the first object in the first visual angle, so that the first electronic device can generate and display the second image comprising the target object based on the acquired position information and modeling information of the target object and the first image, and the first electronic device can help a user to position the blocked target object in the first visual angle.

Optionally, in the embodiment of the present application, the first camera is a camera of the first electronic device, the target object is the second electronic device, and the above step 202 may be specifically implemented by the following step 202 a.

Step 202a, under the condition that the second electronic device receives the information, the first electronic device acquires the position information and modeling information of the second electronic device.

Optionally, in the embodiment of the present application, the second electronic device may be a mobile electronic device or a non-mobile electronic device.

Optionally, in the embodiment of the present application, when using the first electronic device, a user may trigger the first electronic device to establish a connection (e.g. a wired connection or a wireless connection) with the second electronic device, so as to determine that, when the second electronic device receives the information, thereby obtaining location information and modeling information of the second electronic device.

For example, in a case where the first electronic device establishes a connection with the second electronic device, the first electronic device may directly acquire the location information of the second electronic device (i.e., the target object).

Alternatively, in the embodiment of the present application, the information may be a voice call, a video call, a notification, or the like.

In the embodiment of the application, when the second electronic equipment receives the information, the first electronic equipment can acquire the position information and the modeling information of the second electronic equipment, so that the second image is generated and displayed based on the position information and the modeling information of the second electronic equipment and the first image, and thus, a user can be quickly helped to locate the second electronic equipment so as to view the received information.

Alternatively, in the embodiment of the present application, the above step 202 may be specifically implemented by the following step 202 b.

In step 202b, in the case that the acquired user voice information includes the target object, the first electronic device acquires the location information and the modeling information of the target object.

Optionally, in the embodiment of the present application, when a user needs to locate some blocked objects, that is, target objects, voice input may be performed on the first electronic device, so as to trigger the first electronic device to acquire position information and modeling information of the target objects, so that a second image including the target objects can be generated and displayed based on the acquired position information and modeling information of the target objects and the first image.

For example, when a user needs to locate a target object, for example, a XX object, the user can trigger the first electronic device to acquire the position information and modeling information of the target object through voice input such as 'help me find the XX object', 'locate the XX object', 'where the XX object is located', and the like.

In the embodiment of the application, when the user voice information identified by the first electronic equipment comprises the target object, the first electronic equipment can acquire the position information and the modeling information of the target object, so that the second image is generated and displayed based on the position information and the modeling information of the target object and the first image, and the user can be quickly helped to locate the target object.

Optionally, in the embodiment of the present application, when the user needs to locate the target object, key input or gesture input may be performed on the first electronic device, which may specifically be determined according to actual use requirements, and the embodiment of the present application is not limited.

For example, the user may input physical keys of a common object such as a mobile phone, an earphone, a watch, etc. associated with the first electronic device, or perform a specific gesture input, so as to trigger the first electronic device to acquire the location information and the modeling information of the target object.

Alternatively, in the embodiment of the present application, the above step 203 may be specifically implemented by the following step 203 a.

In step 203a, under the condition that the target object is identified to have potential safety hazard to the user, the first electronic device generates and displays a second image based on the position information and modeling information of the target object and the first image.

Optionally, in the embodiment of the present application, when it is determined that the target object is outside the first view angle of the first camera, that is, the target object is blocked, the first electronic device may determine that the target object has a potential safety hazard to the user.

For example, in a case where the image acquired in real time by the first electronic device does not include the target object and the target object is within the second angle of view of the second camera, the first electronic device may determine that the target object is occluded.

It can be understood that when the first electronic device detects, through the second camera, that the target object is within the second view angle of the second camera, but the image in the first view angle acquired through the first camera does not include the target object, the first electronic device may determine that the target object is outside the first view angle of the first camera, that is, the first electronic device is about to approach the target object, but the target object is blocked by other objects, so that the first electronic device may determine that the target object has a potential safety hazard to the user.

For example, as shown in fig. 2 (a), the current environment includes an object 11 and a tree 12, the first camera 13 may acquire an image 14 in a corresponding first view angle, and as shown in fig. 2 (B), the image 14 includes the object 11, where if the first electronic device detects, through the second camera, that the tree 12 is included in a second view angle corresponding to the second camera, the first electronic device may determine that the first electronic device is about to approach the tree 12, but the tree 12 is blocked by other objects, so that the first electronic device may determine that the target object has a safety hazard to the user.

In the embodiment of the application, when the target object is identified to have the potential safety hazard to the user, the first electronic equipment can generate and display the second image based on the acquired position information and modeling information of the target object and the first image, so that the user can be quickly helped to locate the target object, and the potential safety hazard is avoided.

Optionally, in the embodiment of the present application, when the target object is a second electronic device, and when the second electronic device establishes a connection with the first electronic device and receives information, the first electronic device may acquire location information of the second electronic device, so as to detect whether the second electronic device is located outside a first view angle of the first camera according to the location information of the second electronic device, and when it is determined that the second electronic device is located outside the first view angle of the first camera, generate and display a second image including the second electronic device based on the acquired location information and modeling information of the second electronic device and the first image.

For example, the first electronic device may detect, in combination with the position information of the second electronic device and the image within the first view angle acquired by the first camera, whether the second electronic device is outside the first view angle range of the first camera.

For example, if the first electronic device detects that the image in the first view angle acquired by the first camera does not include the second electronic device, and meanwhile, the first electronic device determines that the second electronic device is in a preset range of the first electronic device according to the position information of the second electronic device, the first electronic device can determine that the second electronic device is out of the first view angle of the first camera.

Alternatively, in the embodiment of the present application, the above step 203 may be specifically implemented by the following steps 203b and 203 c.

In step 203b, the first electronic device adds an image of the target object to the first image based on the location information and the modeling information of the target object, so as to generate a third image.

Optionally, in the embodiment of the present application, in the case that the first image is a three-dimensional image constructed by the first electronic device based on the two-dimensional image in the first view angle acquired by the first camera, the first electronic device may add the three-dimensional image of the target object to the first image based on the position information and the modeling information of the target object, so as to generate the third image.

It is understood that the third image includes a three-dimensional image of the target object, and the third image is a three-dimensional image.

The third image is a three-dimensional image corresponding to the first viewing angle.

The first electronic device may determine depth information of the target object in the first image according to the position information of the target object, then the first electronic device may obtain a three-dimensional image of the target object according to the modeling information of the target object and the depth information of the target object, and finally the first electronic device may obtain a placement direction of the target object in the real physical world scene according to the target object in the second view angle of the second camera, so that the first electronic device may correspondingly increase the three-dimensional image of the target object to the first image according to the direction of the target object in the real physical world scene to obtain a third image.

For example, assuming that the target object is a "car", the first electronic device may determine that the car is occluded by other objects in the first view angle when the car is not in the first view angle of the first camera and in the second view angle of the second camera, and may determine that the car is placed in the real physical world scene in a direction in which the right side of the car is placed towards the second camera when the right side of the car is displayed in the second view angle of the second camera, so that the first electronic device may add the three-dimensional image of the car to the first image in a direction in which the right side is directed towards the second camera, i.e., add the three-dimensional image of the car to the first image in accordance with the direction in which the car is placed in the real physical world scene, to generate the third image.

It is understood that after generating the third image, the first electronic device may derive a relative position of the target object in the scene within the first perspective based on the third image.

In step 203c, the first electronic device processes the third image based on the first viewing angle, and generates and displays a second image.

Optionally, in the embodiment of the present application, the first electronic device may collect an image in the first view angle through the first camera, and then process, based on the first view angle, the third image and the image in the first view angle collected by the first camera to generate and display a second image including the target object.

For example, the first electronic device may perspective-project the third image and the image within the first view angle acquired by the first camera based on the first view angle to generate and display a second image including the target object.

The second image may be understood as a perspective image of the target object, which is obtained by perspective projection of the object model of the target object on the first object.

Optionally, in an embodiment of the present application, the first electronic device may project the shape of the target object in the third image onto the first image based on the first viewing angle, so as to generate and display the second image including the target object.

For example, the first electronic device may perform an image rendering process on the third image and the first image based on the first perspective to generate and display a second image including the target object.

For example, the first electronic device may synthesize the third image and the first image through an Open Graphics Library (GL) based on the first perspective to generate and display a second image including the target object.

For example, in connection with fig. 2, the first electronic device may construct a first image corresponding to the first view angle based on the image 14, then the electronic device may add a three-dimensional image of the tree 12 to the first image based on the position information and the modeling information of the tree 12 to generate a third image, so that the first electronic device may obtain, according to the third image, a relative position of the tree 12 in a scene in the first view angle, and then the first electronic device may perform perspective projection on the third image and the first image based on the first view angle to obtain a perspective image 15, that is, a second image, of the tree 12 in the first view angle, where the tree 12 is displayed on the object 11 in a perspective manner, as shown in fig. 3, so as to facilitate a user to quickly locate the tree 12.

Fig. 4 shows a schematic diagram of one possible structure of a display device according to an embodiment of the present application. As shown in fig. 4, the display device 70 may include an acquisition module 71 and a processing module 72.

The acquiring module 71 is configured to acquire a first image corresponding to a first view angle of the first camera, and acquire position information and modeling information of a target object, where the target object is blocked by a first object in the first view angle, and the modeling information is used to build an object model of the target object. The processing module 72 is configured to generate and display a second image based on the location information and modeling information of the target object, and the first image, the second image including the target object.

The embodiment of the application provides a display device, which can acquire a first image corresponding to a first visual angle of a first camera and position information and modeling information of a target object blocked by a first object in the first visual angle, so that the display device can generate and display a second image comprising the target object based on the acquired position information and modeling information of the target object and the first image, and the display device can help a user to position the blocked target object in the first visual angle.

In one possible implementation manner, the first camera is a camera of the first electronic device, the target object is the second electronic device, and the obtaining module 71 is specifically configured to, when the second electronic device receives the information, obtain the location information and the modeling information of the second electronic device by using the first electronic device.

In a possible implementation manner, the obtaining module 71 is specifically configured to obtain, in a case where the obtained user voice information includes the target object, location information and modeling information of the target object.

In one possible implementation, the processing module 72 is specifically configured to generate and display the second image based on the location information and the modeling information of the target object and the first image when the target object is identified as having a safety hazard to the user.

In one possible implementation, the processing module 72 is specifically configured to add an image of the target object to the first image based on the location information and the modeling information of the target object to generate a third image, and process the third image based on the first perspective to generate and display a second image.

The display device in the embodiment of the application can be the first electronic device, and can also be a component in the first electronic device, such as an integrated circuit or a chip. The first electronic device may be a terminal, or may be other devices than a terminal. The first electronic device may be a Mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile internet appliance (Mobile INTERNET DEVICE, MID), an AR/VR device, a robot, a wearable device, an ultra-Mobile personal computer (UMPC), a netbook or a personal digital assistant (personal DIGITAL ASSISTANT, PDA), etc., and may also be a server, a network attached memory (Network Attached Storage, NAS), a personal computer (personal computer, PC), a Television (TV), a teller machine, a self-service machine, etc., which is not limited in the embodiments of the present application.

The display device in the embodiment of the application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.

The display device provided by the embodiment of the application can realize each process realized by the embodiment of the method, and in order to avoid repetition, the description is omitted here.

Optionally, as shown in fig. 5, the embodiment of the present application further provides an electronic device 900, which includes a processor 901 and a memory 902, where a program or an instruction capable of being executed on the processor 901 is stored in the memory 902, and the program or the instruction when executed by the processor 901 implements each step of the embodiment of the method, and the steps can achieve the same technical effect, so that repetition is avoided, and no further description is given here.

The first electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 6 is a schematic hardware structure of a first electronic device implementing an embodiment of the present application.

The first electronic device 100 includes, but is not limited to, a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

Those skilled in the art will appreciate that the first electronic device 100 may further include a power source (e.g., a battery) for powering the various components, and the power source may be logically connected to the processor 110 by a power management system, thereby implementing functions such as charge, discharge, and power consumption management by the power management system. The first electronic device structure shown in fig. 6 is not limited to the first electronic device, and the first electronic device may include more or less components than illustrated, or may be combined with some components, or may be arranged with different components, which are not described herein.

The processor 110 is configured to acquire a first image corresponding to a first view angle of the first camera, acquire position information and modeling information of a target object, where the target object is blocked by the first object in the first view angle, and generate and display a second image based on the position information and the modeling information of the target object, and the first image, where the second image includes the target object.

The embodiment of the application provides first electronic equipment, which can acquire a first image corresponding to a first visual angle of a first camera and position information and modeling information of a target object shielded by a first object in the first visual angle, so that the first electronic equipment can generate and display a second image comprising the target object based on the acquired position information and modeling information of the target object and the first image, and the first electronic equipment can help a user to position the shielded target object in the first visual angle.

Optionally, the first camera is a camera of the first electronic device, the target object is the second electronic device, and the processor 110 is specifically configured to, when the second electronic device receives the information, obtain the location information and the modeling information of the second electronic device by using the first electronic device.

Optionally, the processor 110 is specifically configured to acquire the location information and the modeling information of the target object in the case where the acquired user voice information includes the target object.

Optionally, the processor 110 is specifically configured to generate and display a second image based on the location information and the modeling information of the target object and the first image when it is recognized that the target object has a safety hazard to the user.

Optionally, the processor 110 is specifically configured to add the image of the target object to the first image based on the position information and the modeling information of the target object to generate a third image, and process the third image based on the first perspective to generate and display a second image.

The first electronic device provided by the embodiment of the present application can implement each process implemented by the above method embodiment, and can achieve the same technical effects, so that repetition is avoided, and no further description is provided herein.

The beneficial effects of the various implementation manners in this embodiment may be specifically referred to the beneficial effects of the corresponding implementation manners in the foregoing method embodiment, and in order to avoid repetition, the description is omitted here.

It should be appreciated that in embodiments of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g. a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 109 may include volatile memory or nonvolatile memory, or the memory 109 may include both volatile and nonvolatile memory. Wherein the nonvolatile memory

The Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM,

DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate Synchronous dynamic random access memory (Double DATA RATE SDRAM, DDRSDRAM), enhanced Synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCH LINK DRAM, SLDRAM), and Direct memory bus random access memory (DRRAM). Memory 109 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 110 may include one or more processing units, and optionally, processor 110 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, etc., and a modem processor that primarily processes wireless communication signals, such as a baseband processor.

It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The embodiment of the application also provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the above method embodiment, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted here.

Wherein the processor is a processor in the first electronic device described in the foregoing embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.

The embodiment of the application further provides a chip, which comprises a processor and a communication interface, wherein the communication interface is coupled with the processor, and the processor is used for running programs or instructions to realize the processes of the embodiment of the method, and can achieve the same technical effects, so that repetition is avoided, and the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

Embodiments of the present application provide a computer program product stored in a storage medium, where the program product is executed by at least one processor to implement the respective processes of the above method embodiments, and achieve the same technical effects, and for avoiding repetition, a detailed description is omitted herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

Claims (7)

1. A display method, the method comprising:

acquiring a first image corresponding to a first visual angle of a first camera;

acquiring position information and modeling information of a target object, wherein the target object is blocked by a first object in the first view angle, and the modeling information is used for establishing an object model of the target object;

generating and displaying a second image based on the position information and modeling information of the target object and the first image, wherein the second image comprises the target object, and the second image is a perspective image of the target object;

the obtaining the position information and the modeling information of the target object includes:

And under the condition that the acquired user voice information comprises the target object, acquiring the position information and modeling information of the target object.

2. The method of claim 1, wherein the generating and displaying a second image based on the location information and modeling information of the target object and the first image comprises:

and generating and displaying a second image based on the position information and modeling information of the target object and the first image under the condition that the target object is recognized to have potential safety hazards to a user.

3. The method according to claim 1 or 2, wherein the generating and displaying a second image based on the position information and modeling information of the target object and the first image comprises:

Adding an image of the target object in the first image based on the position information and modeling information of the target object to generate a third image;

and processing the third image based on the first view angle to generate and display a second image.

4. The display device is characterized by comprising an acquisition module and a processing module;

the system comprises an acquisition module, a modeling module, a target object acquisition module and a display module, wherein the acquisition module is used for acquiring a first image corresponding to a first visual angle of a first camera, acquiring position information and modeling information of the target object, the target object is blocked by a first object in the first visual angle, and the modeling information is used for establishing an object model of the target object;

the processing module is used for generating and displaying a second image based on the position information and modeling information of the target object and the first image, wherein the second image comprises the target object, and the second image is a perspective image of the target object;

The acquisition module is specifically configured to acquire location information and modeling information of the target object when the acquired user voice information includes the target object.

5. The apparatus according to claim 4, wherein the processing module is configured to generate and display a second image based on the location information and modeling information of the target object and the first image, in particular, in case that the target object is recognized to have a safety hazard to the user.

6. The apparatus according to claim 4 or 5, wherein the processing module is specifically configured to add an image of the target object to the first image based on the position information and the modeling information of the target object to generate a third image, and to process the third image based on the first perspective to generate and display a second image.

7. A first electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the display method of any one of claims 1-3.