CN106924970B - Virtual reality system, information display method and device based on virtual reality - Google Patents
Virtual reality system, information display method and device based on virtual reality Download PDFInfo
- Publication number
- CN106924970B CN106924970B CN201710135365.9A CN201710135365A CN106924970B CN 106924970 B CN106924970 B CN 106924970B CN 201710135365 A CN201710135365 A CN 201710135365A CN 106924970 B CN106924970 B CN 106924970B
- Authority
- CN
- China
- Prior art keywords
- virtual
- icon
- sight line
- virtual reality
- selected target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000012790 confirmation Methods 0.000 claims description 75
- 238000001514 detection method Methods 0.000 claims description 22
- 230000009471 action Effects 0.000 claims description 15
- 230000003993 interaction Effects 0.000 claims description 15
- 230000003044 adaptive effect Effects 0.000 claims description 7
- 230000014759 maintenance of location Effects 0.000 claims description 7
- 230000008685 targeting Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 4
- 230000002452 interceptive effect Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/822—Strategy games; Role-playing games
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
- A63F13/525—Changing parameters of virtual cameras
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present disclosure relates to the field of virtual reality technologies, and in particular, to a virtual reality-based information display method, a virtual reality-based information display apparatus, and a virtual reality system including the information display apparatus. The information reality method comprises the following steps: presenting a near plane, wherein the near plane is arranged in a preset range of a virtual camera for providing a virtual character view field in a virtual reality scene; detecting whether the virtual character sight line in the virtual reality scene falls on a virtual object; when the fact that the sight line of the virtual character falls on a virtual object is detected, the virtual object is taken as a selected target; and projecting the preset display information of the selected target onto the near plane. The method and the device can enable the user to look up the information of the virtual object in a short distance, and can greatly improve the user experience.
Description
Technical Field
The present disclosure relates to the field of virtual reality technologies, and in particular, to a virtual reality-based information display method, a virtual reality-based information display apparatus, and a virtual reality system including the information display apparatus.
Background
Vr (virtual reality), that is, virtual reality, specifically, a technology for providing an immersive sensation in an interactive three-dimensional environment generated on a computer by comprehensively using a computer graphics system and various interface devices such as reality and control. The current virtual reality technology is widely popularized and applied in games, and is related to game types such as shooting, puzzle solving, role playing and the like. In VR games, players generally search for scenes in a virtual reality environment through VR scenes (e.g., HTC Vive) and perform interactive operations. At this time, a very important UI design problem is encountered, namely how to provide the user with an introduction of certain items, such as using modes, effects and the like.
At present, most of virtual reality applications utilize a VR helmet as a display device, wherein a conventional prompt information reality method adopts a virtual camera lens alignment mode to click an article in a virtual reality scene, and then pops up a prompt box. Referring to fig. 1-3, the specific implementation may be: the virtual camera simulates a ray emitted from the center of the double lens every frame, and the ray can collide with an object provided with introduction information, namely a rigid body. As shown in fig. 2, when the virtual ray collides with the rigid body and the rigid body enters the selected state, a two-dimensional plane parallel to the lens is generated beside the object in the virtual reality scene, and then the introductory information of the object is displayed on the two-dimensional plane. As shown in fig. 3, the plane of introductory information is closed when the virtual camera lens is no longer aimed at the object. Such an introduction information presentation mode is relatively simple to operate, and substitution feeling in a virtual reality scene is relatively strong, but determination thereof is also relatively obvious, for example: when the selected rigid body is far away from the lens of the virtual camera, the corresponding two-dimensional plane for displaying the introduction information of the rigid body is also far away from the lens, so that a user cannot clearly and easily see the introduction information, and the user experience is reduced.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of the present disclosure is to provide a virtual reality-based information display method, a virtual reality-based information display apparatus, and a virtual reality system including the same, thereby overcoming, at least to some extent, one or more problems caused by the limitations and disadvantages of the related art.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to a first aspect of the present disclosure, there is provided a virtual reality-based information display method, including:
presenting a near plane, wherein the near plane is arranged in a preset range of a virtual camera for providing a virtual character view field in a virtual reality scene;
detecting whether the virtual character sight line in the virtual reality scene falls on a virtual object;
combining the action that the virtual character sight line falls on a virtual object after detecting that the virtual character sight line falls on the virtual object;
and projecting the preset display information of the selected target onto the near plane.
In an exemplary embodiment of the present disclosure, the taking a virtual object as a selected target in conjunction with the action of the virtual character's line of sight falling on the virtual object further includes:
after the fact that the sight line of the virtual role falls on a virtual object is detected, the virtual object is used as a target to be selected, and whether first confirmation information is received or not is judged;
and when the first confirmation information is judged to be received, taking the target to be selected as the selected target.
In an exemplary embodiment of the present disclosure, the determining whether the first acknowledgement information is received includes:
when the fact that the sight line of the virtual character falls on the target to be selected is detected, the stay time of the sight line of the virtual character on the target to be selected is judged; and when the retention time reaches a preset time, judging that the first confirmation information is received.
In an exemplary embodiment of the present disclosure, the information display method further includes:
after the target to be selected is taken as a selected target, generating an icon for the selected target, and projecting the icon onto the near plane;
detecting whether the virtual character sight line falls on the icon projection; detecting whether second confirmation information is received or not when the virtual character sight line is judged to fall on the icon projection;
and projecting the preset display information of the selected target onto the near plane when the second confirmation information is judged to be received.
In an exemplary embodiment of the disclosure, the determining whether a second acknowledgement is received includes:
when the virtual character sight line is judged to fall on the icon projection, the stay time of the virtual character sight line on the target to be selected is judged; and when the residence time reaches the preset time, judging that the second confirmation information is received.
In an exemplary embodiment of the present disclosure, the information display method further includes:
generating a minimum bounding box for bounding the icon projection and the selected target on the near plane, and detecting whether the sight line of the virtual character falls on the minimum bounding box;
and when the sight of the virtual character is judged to fall on the smallest enclosing frame, the selected target is kept in a selected state.
In an exemplary embodiment of the present disclosure, the information display method further includes:
performing an adaptive zoom operation on the icon before projecting the icon to the near plane;
wherein, the icon is a plane icon capable of setting transparency.
In an exemplary embodiment of the present disclosure, the information display method further includes:
after the preset display information of the selected target is projected onto the near plane, detecting whether the selected target is in an unselected state; and stopping projecting the preset display information of the selected target when the selected target is judged to be in the unselected state.
In an exemplary embodiment of the present disclosure, the detecting whether the virtual character's line of sight falls on a virtual object in the virtual reality scene includes:
detecting whether the virtual character sight line center is in an effective range of a virtual object;
and when detecting that the sight center point of the virtual character falls within the effective range of a virtual object, triggering the interaction between the virtual character and the virtual object.
According to a second aspect of the present disclosure, there is provided a virtual reality-based information display apparatus including:
the virtual reality system comprises a near plane setting module, a virtual reality scene display module and a virtual role display module, wherein the near plane setting module is used for presenting a near plane and setting the near plane in a preset range of a virtual camera used for providing a virtual role view field in the virtual reality scene;
the first sight line detection module is used for detecting whether the sight line of the virtual character in the virtual reality scene falls on a virtual object;
the target setting module is used for taking the virtual object as a selected target in combination with the action that the virtual character sight line falls on the virtual object after detecting that the virtual character sight line falls on the virtual object;
and the first projection control module is used for projecting the preset display information of the selected target onto the near plane.
In an exemplary embodiment of the present disclosure, the target setting module includes:
the first confirmation information judgment module is used for taking a virtual object as a target to be selected and judging whether first confirmation information is received or not after the fact that the sight line of the virtual character falls on the virtual object is detected;
and the selected target setting module is used for taking the target to be selected as the selected target when the first confirmation information is judged to be received.
In an exemplary embodiment of the present disclosure, the first confirmation information determination module includes:
the first time detection module is used for judging the stay time of the virtual character sight line on the target to be selected after the sight line of the virtual character is detected to fall on the target to be selected;
and the first confirmation information receiving module is used for judging that the first confirmation information is received when the retention time reaches the preset time.
In an exemplary embodiment of the present disclosure, the information display apparatus further includes:
the icon generating module is used for generating an icon for the selected target after the target to be selected is taken as the selected target, and projecting the icon and the selected target onto the near plane;
the second confirmation information judgment module is used for detecting whether the virtual character sight line falls on the icon projection; detecting whether second confirmation information is received or not when the virtual character sight line is judged to fall on the icon projection;
and the projection starting control module is used for projecting the preset display information of the selected target to the near plane when judging that the second confirmation information is received.
In an exemplary embodiment of the present disclosure, the second confirmation information determination module includes:
the second time detection module is used for judging the stay time of the virtual character sight line on the target to be selected when the virtual character sight line is judged to fall on the icon projection;
and the second confirmation information receiving module is used for judging that the second confirmation information is received when the retention time reaches the preset time.
In an exemplary embodiment of the present disclosure, the information display apparatus further includes:
the bounding box generating module is used for generating a minimum bounding box which is used for bounding the icon projection and the selected target on the near plane;
the second sight line detection module is used for detecting whether the sight line of the virtual role falls on the smallest enclosing frame or not;
and the first state judgment module is used for keeping the selected target in a selected state when judging that the sight of the virtual role falls on the smallest enclosing frame.
In an exemplary embodiment of the present disclosure, the information display apparatus further includes:
an icon scaling module for performing an adaptive scaling operation on the icon before projecting the icon to the near plane;
and the transparency setting module is used for setting the transparency of the icon.
In an exemplary embodiment of the present disclosure, the information display apparatus further includes:
the second state judgment module is used for projecting the preset display information of the selected target onto the near plane and then detecting whether the selected target is in an unselected state;
and the projection stopping control module is used for stopping projecting the preset display information of the selected target when the selected target is judged to be in the unselected state.
In an exemplary embodiment of the present disclosure, the first gaze detection module includes:
the sight center detection module is used for detecting whether the sight center of the virtual character falls within the effective range of a virtual object;
and the interaction triggering module is used for triggering the interaction between the virtual character and the virtual object when detecting that the sight line central point of the virtual character is within the effective range of the virtual object.
According to a third aspect of the present disclosure, there is provided a virtual reality system including the virtual reality-based information display apparatus.
In the information display method based on virtual reality provided by an embodiment of the present disclosure, a near plane is set within a preset range of a virtual camera, and when a user selects a virtual object in a virtual reality scene and uses the virtual object as a selected target, preset display information of the selected target can be projected on the near plane. The near plane is arranged in the preset range of the virtual camera, namely in the preset range in the visual field of the virtual character, so that a user can observe the preset display information projected by the selected target on the near plane in a close distance in the virtual reality scene, the user can conveniently look up the introduction information of the virtual object in the virtual reality scene, and the user experience can be greatly improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1-3 schematically illustrate a flow chart of displaying rigid body introduction information in a virtual reality scene in the prior art;
FIG. 4 is a schematic flow chart illustrating a virtual reality-based information display method according to an exemplary embodiment of the disclosure;
FIG. 5 schematically illustrates a near plane position and display scenario in an exemplary embodiment of the disclosure;
fig. 6 is a schematic diagram illustrating a display scene of preset presentation information of a virtual object in an exemplary embodiment of the present disclosure;
FIG. 7 is a block diagram schematically illustrating a virtual reality-based information display apparatus according to an exemplary embodiment of the present disclosure;
FIG. 8 is a block diagram schematically illustrating a target setting module in an exemplary embodiment of the present disclosure;
fig. 9 is a block diagram schematically illustrating a virtual reality-based information display apparatus according to an exemplary embodiment of the present disclosure;
fig. 10 is a block diagram schematically illustrating another virtual reality-based information display apparatus according to an exemplary embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
In this exemplary embodiment, a virtual reality-based information display method is first provided, which may be applied to a virtual reality system, where the virtual reality system may be composed of an optical structure and a display system, where the display system is connected to an external virtual reality engine to receive display content processed by the external virtual reality engine, and then presents a virtual reality scene to a user through the optical structure; or only comprises an optical structure, and the display system and the virtual reality engine are provided by external equipment such as a smart phone; that is, the virtual reality system to which the virtual reality interaction method is applied in the present exemplary embodiment is not particularly limited. For example, the information display method can be applied to shooting, puzzle solving, role playing or social contact game applications based on a virtual reality system. Referring to fig. 2, the information display method may include the steps of:
step S1, presenting a near plane, wherein the near plane is arranged in a preset range of a virtual camera for providing a virtual character view field in a virtual reality scene;
step S2, detecting whether the sight line of the virtual character in the virtual reality scene falls on a virtual object;
step S3, after detecting that the virtual character sight line falls on a virtual object, combining the action that the virtual character sight line falls on a virtual object to take the virtual object as a selected target;
and step S4, projecting the preset display information of the selected target onto the near plane.
In the information display device provided by the example embodiment, the near plane is set within a preset range of the virtual camera, that is, within a preset range within the visual field of the virtual character, so that a user can observe preset display information of a selected target projected on the near plane in a near distance in a virtual reality scene, the user can conveniently look up introduction information of a virtual object in the virtual reality scene, and user experience can be greatly improved.
Next, the respective steps of the information display method in the present exemplary embodiment will be described in more detail with reference to fig. 3 to 5.
In step S1, a near plane is presented, the near plane being disposed within a preset range of a virtual camera for providing a virtual character view in the virtual reality scene.
In the present exemplary embodiment, the view content of the virtual character in the virtual reality environment can be provided by a virtual camera, the virtual camera can be generally arranged at the shoulder of the virtual character or above the virtual character, so that the direction of the lens of the virtual camera is consistent with the sight direction of the virtual character, and the position of the virtual camera moves synchronously with the virtual character, so that the virtual character manipulated by the user can observe, move and interact with other characters in the virtual reality scene at the first person view angle; the user has higher immersion feeling, and an immersive experience is created for the user. Referring to the scenario shown in fig. 3, by setting the near plane 15 within a preset range of the virtual camera, the near plane 15 can be displayed within a certain distance from the visual field 14 of the virtual character 11 controlled by the user. And, the user can set the distance between the near plane 15 and the virtual camera, that is, adjust the distance between the near plane 15 and the virtual character 11 according to the requirement.
In step S2, detecting whether the virtual character line of sight falls on a virtual object in the virtual reality scene may specifically include the following steps:
step S21, detecting whether the virtual character sight line center is in the effective range of a virtual object;
and step S22, when the central point of the virtual character sight line is detected to be in the effective range of a virtual object, the interaction between the virtual character and the virtual object is triggered.
In this example embodiment, the user may be immersed in the virtual reality environment via an auxiliary device, such as a head mounted display or VR glasses. The user can change the visual angle and the scene in the visual field range by turning the head and the like in the virtual reality environment. Referring to the scenario shown in fig. 3, in the virtual reality environment, the virtual character 11 can use a cursor or a light beam set at the center of sight to perform target selection, and when the center of sight of the virtual character falls within the effective range of an interactive object, the interaction between the virtual character 11 and the virtual object 12 in the virtual reality environment is triggered. In addition, for the convenience of subsequent interaction, the sight line center of the virtual character and the virtual object both have collision volumes with preset sizes, and the sight line center of the virtual character falls within an effective range of an interactive object, namely the sight line center of the virtual character falls within the collision volume range of the interactive object. It should be noted that, when the interactive objects meet, if no collision volume is set for any of the interactive objects or only one of the interactive objects is set for the collision volume, the interactive objects can pass through each other when meeting, and interaction between the interactive objects is not triggered; if collision volumes are set for the interactive objects, the interactive objects cannot pass through each other when meeting, and the interaction between the interactive objects is triggered when collision occurs. In the present exemplary embodiment, in order to reduce the difficulty of visual sighting, the collision volume of the interactive object may be increased appropriately.
In step S3, after detecting that the virtual character line of sight falls on a virtual object, the virtual object is regarded as the selected target in conjunction with the action of the virtual character line of sight falling on a virtual object.
In this exemplary embodiment, after detecting that the line of sight of the virtual character 11 falls on a virtual object 12, and combining the action that the line of sight of the virtual character falls on the virtual object, the specific step of regarding the virtual object 12 as the selected target may further include:
step S31, after detecting that the line of sight of the virtual character 11 falls on a virtual object 12, taking the virtual object 11 as a candidate target, and determining whether a first confirmation message is received;
and step S32, when it is determined that the first confirmation information is received, taking the target to be selected as a selected target.
Referring to the scenario shown in fig. 3, it is first detected whether the line of sight of the virtual character 11 falls on a virtual object 12, and when it is detected that the line of sight of the virtual character 11 falls on a virtual object 12, the virtual object 12 is taken as a candidate target, and it is determined whether a first confirmation message is received. And when the first confirmation information is judged to be received, the target to be selected is taken as the selected target, and when the first confirmation information is judged not to be received, the identity identification of the target to be selected is unchanged. By adding the step of judgment and confirmation, the accuracy of the user in selecting the virtual object and serving as the selected target can be effectively ensured. Meanwhile, when the sight line of the virtual character 11 is detected to fall on a virtual object 12, the system can respond to the action of the virtual character 11 and directly take the virtual object 12 as the selected target, thereby simplifying the judgment process and improving the target confirmation speed.
For example, the first confirmation information may be a staying time of the virtual character 11 on the target to be selected, and the preset staying time may be 2 seconds, 3 seconds, or other time duration. When the system detects that the sight line of the virtual character 11 falls on a target to be selected, the stay time of the sight line of the virtual character on the target to be selected is judged; when the staying time does not reach the preset time length, namely the sight line of the virtual role leaves the current target to be selected, judging that the first confirmation information is not received; and when the residence time is judged to meet the preset time length, judging that the first confirmation information is received, and taking the target to be selected as the selected target. In other exemplary embodiments of the present disclosure, the first confirmation information may also be determined by detecting other actions of the user or the virtual character, for example: several blinking actions by the user, or gestural actions by the user controlling the virtual character to make in the virtual reality environment. When such an action is detected, it may be determined that the first acknowledgement information is received; at this time, the target to be selected can be used as the selected target. The present disclosure does not specifically limit the specific content of the first confirmation information.
In step S4, projecting the preset display information of the selected target onto the near plane.
After the virtual object 12 in the virtual reality scene in which the virtual character 11 is located is determined as the selected object, the preset presentation information 13 of the selected object may be projected on the near plane 15.
In other exemplary embodiments of the present disclosure, the step S4 may specifically include the following steps:
step S41, after the target to be selected is taken as the selected target, generating an icon for the selected target, and projecting the icon onto the near plane;
step S42, detecting whether the virtual character sight line falls on the icon projection; detecting whether second confirmation information is received or not when the virtual character sight line is judged to fall on the icon projection;
step S43, when it is determined that the second confirmation information is received, projecting the preset display information of the selected target onto the near plane.
Referring to the scene shown in fig. 4, when a virtual object 12 in the virtual reality scene is selected as a selected target, an icon 17 is generated near the selected target, and the display position of the icon 17 may be set at the upper left corner or the upper right corner of the selected target, or at another position convenient for the user to find and view the icon. The icon 11 is then projected onto the near plane 15, at which time it is detected whether the line of sight of the virtual character 11 falls on the icon projection 17. When the fact that the sight line of the virtual character 11 falls on the icon projection 17 is detected, whether second confirmation information is received or not is detected, and after the fact that the second confirmation information is received is judged, preset display information 13 of the selected target is projected onto the near plane 15; and if the second confirmation information is not received, displaying no information. The projection position of the preset display information on the near plane can be the left side, the right side or other positions on the near plane, and a user can set the projection position according to requirements.
Based on the above, in the present exemplary embodiment, the above-mentioned determining whether the second confirmation information is received may include the following steps:
when the sight of the virtual character 11 is judged to fall on the icon projection 16, judging the stay time of the sight of the virtual character 11 on the icon projection 16; and when the residence time reaches the preset time, judging that the second confirmation information is received.
For example, referring to the scene shown in fig. 4, in the virtual reality scene, when the virtual character 11 selects a virtual object 12 and takes the virtual object 12 as a selected target, an icon 17 is generated for the selected target, and the icon 17 is projected onto the near plane 15. At this point, the virtual character 11 may be moved from a selected object falling far away onto the icon projection 16 on the near plane. When the line of sight of the virtual character 11 falls on the projection 16 of the icon 17 on the near plane, the staying time of the line of sight of the virtual character 11 on the icon projection 16 may be detected, and when it is detected that the staying time reaches a preset time, for example, the preset time may be 2 seconds or 3 seconds, that is, it is determined that the second confirmation information is received, the preset showing information 13 of the selected target is displayed on the near plane. In other exemplary embodiments of the present disclosure, the second confirmation information may also be set as preset gesture information or a click operation of a user through an auxiliary input device, and this embodiment is not limited in particular herein.
Based on the above, in order to further optimize the operation of the projection selection step on the selected target, the information reality method may further include:
generating a minimum bounding box for bounding the icon projection and the selected target on the near plane 15, and detecting whether the sight line of the virtual character 11 falls on the minimum bounding box; and when the sight of the virtual role 11 is judged to fall on the smallest enclosing frame, the selected target is kept in a selected state.
By arranging the smallest surrounding frame on the near plane 15, the icon projection and the selected target can be visually surrounded in the smallest surrounding frame, and the effective selection area of the icon projection and the selected target projection can be effectively increased. When the sight of the virtual character 11 is detected to fall on the smallest enclosing frame, the selected target can be judged to be in the selected state, so that the user can easily keep the selected target in the selected state, and the user can conveniently perform subsequent operations after the icon is selected by projection.
In other exemplary embodiments of the present disclosure, the information display method described above may further include: performing an adaptive scaling operation on the icon 17 and projecting the adaptively scaled icon to the near plane 15; wherein, the icon 17 is a plane icon capable of setting transparency.
After the virtual character 11 selects a virtual object 12 in the virtual reality scene as a selected target, an icon 17 is generated for the selected target, the icon 17 can be adaptively zoomed, and then the adaptively zoomed icon is projected on the near plane 15. By carrying out adaptive zooming on the icon 17, the icon can be displayed on the near plane 15 in a proper size, and the projection of the icon is not easy to select because the size of the projection of the icon is too small; nor does it occupy too much space in the near plane 15, as the icon is projected too large, affecting the view of the virtual character 11. Meanwhile, the user can set the transparency of the icon 17 in advance according to the requirement, so that the icon 17 has a good display effect. The icon 17 is set to display the virtual character with a certain transparency, so that the icon 17 can not block other objects in the virtual reality scene, and the sight of the virtual character 11 in the virtual reality scene is not influenced.
In addition, in the present exemplary embodiment, the above-described information display method further includes the steps of:
step S5, projecting the preset display information of the selected target onto the near plane, and detecting whether the selected target is in an unselected state; and stopping projecting the preset display information of the selected target when the selected target is judged to be in the unselected state.
When a virtual character 11 selects a virtual object 12 in a virtual reality scene, after the virtual object 12 is taken as a selected target and preset display information 13 of the selected target is displayed, whether the selected target is still in a selected state is detected. When the selected target is detected to be still in the selected state, namely the sight line of the virtual character 11 still falls in the smallest enclosing frame, the preset display information of the selected target is still displayed; when the fact that the sight line of the virtual character 11 is not on the currently selected target is detected, that is, the sight line of the virtual character 11 leaves the smallest surrounding frame on the near plane 15 or falls on a virtual object or other objects in the virtual reality scene again, the preset display information 13 of the currently selected target is stopped being displayed.
According to the information display method, the near plane is arranged in the virtual camera lens within a certain range, so that the near plane can be displayed within a certain distance in the virtual role view field range in the virtual reality scene, and an article information display interface which is convenient to view and has a certain discrimination degree is provided. Moreover, the preset display information of the selected virtual object in the virtual reality scene is projected on the near plane, so that a user can check the preset display information of the selected virtual object in a short distance, the user can check all information of the virtual object conveniently, and the user can conveniently perform interactive operation between the virtual reality scene and all interactive objects. The information display method provided by the disclosure confirms the virtual object in the virtual reality scene as the selected target, and then displays the preset display information of the selected target, so that the step-by-step operation method is provided, the selected virtual object can be effectively determined, the preset display information of the selected virtual object can be accurately displayed, the operation accuracy is effectively guaranteed, and the use experience of a user is effectively improved.
It is to be noted that the above-mentioned figures are only schematic illustrations of the processes involved in the method according to an exemplary embodiment of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
Further, referring to fig. 5, the present exemplary embodiment also provides a virtual reality-based information display apparatus 5, including: a near plane setting module 51, a first gaze detection module 52, a target setting module 53, and a first projection control module 54. Wherein:
the near plane setting module 51 may be configured to present a near plane, which is set within a preset range of a virtual camera for providing a virtual character view in a virtual reality scene.
The first gaze detection module 52 may be configured to detect whether the virtual character's gaze falls on a virtual object in the virtual reality scene.
The target setting module 53 may be configured to, after detecting that the virtual character sight line falls on a virtual object, regard the virtual object as a selected target in combination with an action of the virtual character sight line falling on a virtual object.
The first projection control module 54 may be configured to project the preset presentation information of the selected target onto the near plane.
In the present exemplary embodiment, as shown with reference to fig. 6, the target setting module 53 described above may include: a first confirmation information judgment module 531 and a selected target setting module 532. Wherein:
the first confirmation information determining module 531 may be configured to, when it is detected that the line of sight of the virtual character falls on a virtual object, take the virtual object as a candidate target, and determine whether a first confirmation information is received.
The selected target setting module 532 may be configured to take the target to be selected as the selected target after determining that the first confirmation information is received.
In this exemplary embodiment, the first confirmation information determining module 531 may further include: the device comprises a first time detection module and a first confirmation information receiving module. Wherein:
the first time detection module may be configured to determine a stay time of the virtual character sight line on the target to be selected after detecting that the sight line of the virtual character falls on the target to be selected.
The first confirmation information receiving module may be configured to determine that the first confirmation information is received when the staying time reaches a preset time.
In the present exemplary embodiment, as shown with reference to fig. 7, the above-described information display device 5 further includes: an icon generation module 55, a second confirmation information judgment module 56, and a projection start control module 57. Wherein:
the icon generating module 55 may be configured to generate an icon for the selected target after the target to be selected is taken as the selected target, and project the icon and the selected target onto the near plane.
The second confirmation information determining module 56 may be configured to detect whether the virtual character line of sight falls on the icon projection; and detecting whether second confirmation information is received or not when the virtual character sight line is judged to fall on the icon projection.
The projection start control module 57 may be configured to project the preset display information of the selected target onto the near plane when it is determined that the second confirmation information is received.
In this exemplary embodiment, the second confirmation information determination module 36 may include: a second time detection module and a second confirmation information receiving module. Wherein:
the second time detection module may be configured to determine a dwell time of the virtual character sight line on the icon projection when determining that the virtual character sight line falls on the icon projection;
the second confirmation information receiving module may be configured to determine that the second confirmation information is received when the staying time reaches a preset time.
In the present exemplary embodiment, the information display device 5 described above may further include: the device comprises a bounding box generating module, a second sight line detecting module and a first state judging module. Wherein:
the bounding box generating module may be configured to generate a minimum bounding box on the near plane for bounding the icon projection and the selected target;
the second sight line detection module may be configured to detect whether a sight line of the virtual character falls on the smallest enclosure frame.
The first state judgment module may be configured to keep the selected target in a selected state when judging that the line of sight of the virtual character falls on the smallest enclosure frame.
In the present exemplary embodiment, the information display device 5 described above may further include: an icon scaling module and a transparency setting module. Wherein:
the icon scaling module may be configured to perform an adaptive scaling operation on the icon prior to projecting the icon onto the near plane.
The transparency setting module may be configured to set a transparency of the icon.
In order to further optimize the functions of the information display device, in the present exemplary embodiment, as shown in fig. 8, the information display device 5 may further include: a second state determination module 58 and a projection stop control module 59. Wherein:
the second state determining module 58 may be configured to detect whether the selected target is in an unselected state after projecting the preset display information of the selected target onto the near plane.
The projection stopping control module 59 may be configured to stop projecting the preset display information of the selected object when it is determined that the selected object is in the unselected state.
Based on the above, in the present exemplary embodiment, the first sight line detection module 52 described above may include: the system comprises a sight center detection module, an interaction triggering module and a collision volume setting module. Wherein:
the gaze center detection module may be configured to detect whether the virtual character gaze center falls within a valid range of a virtual object.
The interaction triggering module can be used for triggering the interaction between the virtual character and a virtual object when the fact that the sight line central point of the virtual character is within the effective range of the virtual object is detected.
The specific details of each unit in the virtual reality-based information display device are described in detail in the corresponding virtual reality-based information display method, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Further, the present exemplary embodiment also provides a virtual reality system, which at least includes the information display device based on the virtual reality system in the above exemplary embodiment. The information display device can provide a UI interface for displaying the article information for a certain distance in the virtual character view field in the virtual reality scene, so that the virtual character can conveniently view the preset display information of each virtual object in the virtual reality scene. And distributed operation can be realized through selection of the virtual objects and information display of each module, so that the accuracy of user operation is effectively guaranteed, the user can operate more simply in a virtual reality game, and the user experience is effectively improved.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (19)
1. A virtual reality-based information display method is characterized by comprising the following steps:
presenting a near plane, wherein the near plane is arranged in a preset range of a virtual camera for providing a virtual character view field in a virtual reality scene; the near plane is used for bearing projection and preset display information corresponding to a virtual object in the virtual reality scene;
detecting whether the sight line of the virtual character in the virtual reality scene falls on a virtual object or a projection of the virtual object corresponding to the near plane;
after detecting that the sight line of the virtual character falls on a virtual object or the projection of the virtual object corresponding to the near plane, taking the virtual object as a selected target by combining the action of the sight line of the virtual character falling on the virtual object;
and projecting the preset display information of the selected target onto the near plane.
2. The method of claim 1, wherein the act of targeting a virtual object in conjunction with the virtual character's line of sight to the virtual object further comprises:
after the fact that the sight line of the virtual role falls on a virtual object is detected, the virtual object is used as a target to be selected, and whether first confirmation information is received or not is judged;
and when the first confirmation information is judged to be received, taking the target to be selected as the selected target.
3. The virtual reality-based information display method according to claim 2, wherein the determining whether the first confirmation information is received includes:
when the fact that the sight line of the virtual character falls on the target to be selected is detected, the stay time of the sight line of the virtual character on the target to be selected is judged; and when the retention time reaches a preset time, judging that the first confirmation information is received.
4. The virtual reality-based information display method according to claim 2, further comprising:
after the target to be selected is taken as a selected target, generating an icon for the selected target, and projecting the icon onto the near plane;
detecting whether the virtual character sight line falls on the icon projection;
detecting whether second confirmation information is received or not when the virtual character sight line is judged to fall on the icon projection;
and projecting the preset display information of the selected target onto the near plane when the second confirmation information is judged to be received.
5. The method according to claim 4, wherein the determining whether a second confirmation message is received comprises:
when the virtual character sight line is judged to fall on the icon projection, judging the stay time of the virtual character sight line on the icon projection; and when the retention time reaches the preset time, judging that the second confirmation information is received.
6. The virtual reality-based information display method according to claim 4, further comprising:
generating a minimum bounding box for bounding the icon projection and the selected target on the near plane, and detecting whether the sight line of the virtual character falls on the minimum bounding box;
and when the sight of the virtual character is judged to fall on the smallest enclosing frame, the selected target is kept in a selected state.
7. The virtual reality-based information display method according to claim 4, further comprising:
performing an adaptive zoom operation on the icon before projecting the icon to the near plane;
wherein, the icon is a plane icon capable of setting transparency.
8. The virtual reality-based information display method according to claim 1, further comprising:
after the preset display information of the selected target is projected onto the near plane, detecting whether the selected target is in an unselected state; and stopping projecting the preset display information of the selected target when the selected target is judged to be in the unselected state.
9. The method of claim 1, wherein the detecting whether the virtual character's line of sight falls on a virtual object in the virtual reality scene comprises:
detecting whether the virtual character sight line center is in an effective range of a virtual object;
and when detecting that the sight center point of the virtual character falls within the effective range of a virtual object, triggering the interaction between the virtual character and the virtual object.
10. An information display device based on virtual reality, comprising:
the virtual reality system comprises a near plane setting module, a virtual reality scene display module and a virtual role display module, wherein the near plane setting module is used for presenting a near plane and setting the near plane in a preset range of a virtual camera used for providing a virtual role view field in the virtual reality scene; the near plane is used for bearing projection and preset display information corresponding to a virtual object in the virtual reality scene;
the first sight line detection module is used for detecting whether the sight line of the virtual character in the virtual reality scene falls on a virtual object or a projection of the virtual object corresponding to the near plane;
the target setting module is used for taking the virtual object as a selected target by combining the action that the virtual character sight line falls on the virtual object after detecting that the virtual character sight line falls on the virtual object or the virtual object is projected on the near plane correspondingly;
and the first projection control module is used for projecting the preset display information of the selected target onto the near plane.
11. The virtual reality-based information display apparatus of claim 10, wherein the goal setting module comprises:
the first confirmation information judgment module is used for taking a virtual object as a target to be selected and judging whether first confirmation information is received or not after the fact that the sight line of the virtual character falls on the virtual object is detected;
and the selected target setting module is used for taking the target to be selected as the selected target when the first confirmation information is judged to be received.
12. The virtual reality-based information display apparatus according to claim 11, wherein the first confirmation information determination module includes:
the first time detection module is used for judging the stay time of the virtual character sight line on the target to be selected after the sight line of the virtual character is detected to fall on the target to be selected;
and the first confirmation information receiving module is used for judging that the first confirmation information is received when the retention time reaches the preset time.
13. The virtual reality-based information display apparatus of claim 11, further comprising:
the icon generating module is used for generating an icon for the selected target after the target to be selected is taken as the selected target, and projecting the icon onto the near plane;
the second confirmation information judgment module is used for detecting whether the virtual character sight line falls on the icon projection; detecting whether second confirmation information is received or not when the virtual character sight line is judged to fall on the icon projection;
and the projection starting control module is used for projecting the preset display information of the selected target to the near plane when judging that the second confirmation information is received.
14. The virtual reality-based information display apparatus according to claim 13, wherein the second confirmation information determination module includes:
the second time detection module is used for judging the stay time of the virtual character sight line on the icon projection when the virtual character sight line is judged to fall on the icon projection;
and the second confirmation information receiving module is used for judging that the second confirmation information is received when the retention time reaches the preset time.
15. The virtual reality-based information display apparatus of claim 13, further comprising:
the bounding box generating module is used for generating a minimum bounding box which is used for bounding the icon projection and the selected target on the near plane;
the second sight line detection module is used for detecting whether the sight line of the virtual role falls on the smallest enclosing frame or not;
and the first state judgment module is used for keeping the selected target in a selected state when judging that the sight of the virtual role falls on the smallest enclosing frame.
16. The virtual reality-based information display apparatus of claim 13, further comprising:
an icon scaling module for performing an adaptive scaling operation on the icon before projecting the icon to the near plane;
and the transparency setting module is used for setting the transparency of the icon.
17. The virtual reality-based information display apparatus of claim 10, further comprising:
the second state judgment module is used for projecting the preset display information of the selected target onto the near plane and then detecting whether the selected target is in an unselected state;
and the projection stopping control module is used for stopping projecting the preset display information of the selected target when the selected target is judged to be in the unselected state.
18. The virtual reality-based information display apparatus of claim 10, wherein the first gaze detection module comprises:
the sight center detection module is used for detecting whether the sight center of the virtual character falls within the effective range of a virtual object;
and the interaction triggering module is used for triggering the interaction between the virtual character and the virtual object when detecting that the sight line central point of the virtual character is within the effective range of the virtual object.
19. A virtual reality system comprising the virtual reality-based information display apparatus of any one of claims 10 to 18.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710135365.9A CN106924970B (en) | 2017-03-08 | 2017-03-08 | Virtual reality system, information display method and device based on virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710135365.9A CN106924970B (en) | 2017-03-08 | 2017-03-08 | Virtual reality system, information display method and device based on virtual reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106924970A CN106924970A (en) | 2017-07-07 |
| CN106924970B true CN106924970B (en) | 2020-07-07 |
Family
ID=59431979
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710135365.9A Active CN106924970B (en) | 2017-03-08 | 2017-03-08 | Virtual reality system, information display method and device based on virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106924970B (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107450747B (en) * | 2017-07-25 | 2018-09-18 | 腾讯科技（深圳）有限公司 | The displacement control method and device of virtual role |
| US10445947B2 (en) * | 2017-08-01 | 2019-10-15 | Google Llc | Methods and apparatus for interacting with a distant object within a virtual reality environment |
| CN107506037B (en) * | 2017-08-23 | 2020-08-28 | 三星电子（中国）研发中心 | A method and device for controlling equipment based on augmented reality |
| US11351453B2 (en) * | 2017-09-12 | 2022-06-07 | Sony Interactive Entertainment LLC | Attention-based AI determination of player choices |
| CN107899241B (en) * | 2017-11-22 | 2020-05-22 | 网易（杭州）网络有限公司 | Information processing method and device, storage medium and electronic equipment |
| CN108107580A (en) * | 2017-12-20 | 2018-06-01 | 浙江煮艺文化科技有限公司 | Methods of exhibiting and system is presented in a kind of virtual reality scenario |
| CN108419090A (en) * | 2017-12-27 | 2018-08-17 | 广东鸿威国际会展集团有限公司 | Three-dimensional live TV stream display systems and method |
| CN108479069B (en) * | 2018-01-25 | 2020-12-01 | 网易（杭州）网络有限公司 | Control display control method and device and computer readable storage medium |
| CN108499102B (en) * | 2018-04-04 | 2021-04-23 | 网易（杭州）网络有限公司 | Information interface display method and device, storage medium and electronic equipment |
| CN109985385B (en) * | 2018-12-06 | 2022-08-05 | 派视觉虚拟现实（深圳）软件技术有限公司 | Game equipment and control method and device for game role of game equipment |
| CN110209276A (en) * | 2019-05-28 | 2019-09-06 | 网易（杭州）网络有限公司 | Object selection method and device, electronic equipment, storage medium in virtual reality |
| CN110898431B (en) * | 2019-12-03 | 2023-04-14 | 网易（杭州）网络有限公司 | Display control method and device of information in virtual reality game |
| CN111068309B (en) * | 2019-12-04 | 2023-09-15 | 网易（杭州）网络有限公司 | Display control method, device, equipment, system and medium for virtual reality game |
| CN111729296B (en) * | 2020-06-15 | 2024-02-09 | 网易（杭州）网络有限公司 | Game interface interaction method and device and electronic terminal |
| CN112152894B (en) * | 2020-08-31 | 2022-02-18 | 青岛海尔空调器有限总公司 | Household appliance control method based on virtual reality and virtual reality system |
| CN113791846A (en) * | 2020-11-13 | 2021-12-14 | 北京沃东天骏信息技术有限公司 | Information display method and device, electronic device, storage medium |
| US20220308659A1 (en) * | 2021-03-23 | 2022-09-29 | Htc Corporation | Method for interacting with virtual environment, electronic device, and computer readable storage medium |
| CN113209617A (en) * | 2021-06-10 | 2021-08-06 | 腾讯科技（深圳）有限公司 | Virtual object marking method and device |
| CN115993886A (en) * | 2021-10-20 | 2023-04-21 | 北京七鑫易维信息技术有限公司 | Control method, device, equipment and storage medium for virtual image |
| CN114461067B (en) * | 2021-12-29 | 2025-01-17 | 上海盛付通电子支付服务有限公司 | Method, device, medium and program product for remembering a deceased subject |
| CN118506224A (en) * | 2023-02-16 | 2024-08-16 | 北京字跳网络技术有限公司 | Action recognition method, device, equipment, medium and product |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7107549B2 (en) * | 2001-05-11 | 2006-09-12 | 3Dna Corp. | Method and system for creating and distributing collaborative multi-user three-dimensional websites for a computer system (3D Net Architecture) |
| US9588343B2 (en) * | 2014-01-25 | 2017-03-07 | Sony Interactive Entertainment America Llc | Menu navigation in a head-mounted display |
| CN105824409A (en) * | 2016-02-16 | 2016-08-03 | 乐视致新电子科技（天津）有限公司 | Interactive control method and device for virtual reality |
-
2017
- 2017-03-08 CN CN201710135365.9A patent/CN106924970B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106924970A (en) | 2017-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106924970B (en) | Virtual reality system, information display method and device based on virtual reality | |
| US20220382379A1 (en) | Touch Free User Interface | |
| US11099637B2 (en) | Dynamic adjustment of user interface | |
| CN110320997B (en) | Object-mapped multi-trace fixation for fixation of gaze attention targets | |
| CN109564472B (en) | Method, medium and system for selecting a method of interaction with a virtual object | |
| EP4718219A1 (en) | Artificial reality system having a sliding menu | |
| CN107810465B (en) | System and method for generating painted surfaces | |
| US20170195664A1 (en) | Three-dimensional viewing angle selecting method and apparatus | |
| US10191612B2 (en) | Three-dimensional virtualization | |
| CN111722716A (en) | Eye movement interaction method, head mounted device and computer readable medium | |
| JP2018526693A (en) | Hover behavior for gaze dialogue in virtual reality | |
| CN106951153B (en) | Display method and electronic equipment | |
| KR20180033138A (en) | Eye line detection method and apparatus | |
| KR20150116871A (en) | Human-body-gesture-based region and volume selection for hmd | |
| US20210042015A1 (en) | Method and system for dwell-less, hands-free interaction with a selectable object | |
| CN113559501B (en) | Virtual unit selection method and device in game, storage medium and electronic equipment | |
| CN110968187A (en) | Remote touch detection enabled by peripherals | |
| US11442268B2 (en) | Augmented reality gaming using virtual eyewear beams | |
| CN106683152B (en) | Three-dimensional visual effect simulation method and device | |
| WO2025223184A1 (en) | Human-computer interaction method and apparatus, device and medium | |
| WO2018000606A1 (en) | Virtual-reality interaction interface switching method and electronic device | |
| KR102523091B1 (en) | System and Method for Providing Location-based Content using Motion Base and Tracker in Immersive VR Experience Space | |
| WO2025255394A1 (en) | Methods of adjusting a simulated resolution of a virtual object in a three-dimensional environment | |
| CN117971040A (en) | Eye tracking methods, devices, equipment, media and procedures | |
| US10409464B2 (en) | Providing a context related view with a wearable apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |