CN112866672B - Augmented reality system and method for immersive cultural entertainment - Google Patents

Augmented reality system and method for immersive cultural entertainment Download PDF

Info

Publication number
CN112866672B
CN112866672B CN202011630329.8A CN202011630329A CN112866672B CN 112866672 B CN112866672 B CN 112866672B CN 202011630329 A CN202011630329 A CN 202011630329A CN 112866672 B CN112866672 B CN 112866672B
Authority
CN
China
Prior art keywords
infrared
head
augmented reality
mounted display
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN202011630329.8A
Other languages
Chinese (zh)
Other versions
CN112866672A (en
Inventor
李洋
任海军
李坚
文红光
戴奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Kale Star Digital Entertainment Co ltd
Original Assignee
Shenzhen Kale Star Digital Entertainment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Kale Star Digital Entertainment Co ltd filed Critical Shenzhen Kale Star Digital Entertainment Co ltd
Priority to CN202011630329.8A priority Critical patent/CN112866672B/en
Publication of CN112866672A publication Critical patent/CN112866672A/en
Application granted granted Critical
Publication of CN112866672B publication Critical patent/CN112866672B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明公开了一种用于沉浸式文化娱乐的增强现实系统及方法,所述增强现实系统包括:头戴式显示装置、虚拟屏幕、移动装置以及图像工作站,通过图像工作站通过移动装置根据预设运动参数向头戴式显示装置实时传输预先存储与预设运动参数对应的立体图像序列,同时,头戴式显示装置通过移动装置按照预设运动参数运动,并实时获取设置在虚拟银幕的边缘的红外发射装置的红外信号,从而实时显示头戴式显示装置在不同位置的与实景结合的影像,提高了影像的显示质量以及虚拟图像和实景的结合精度。

Figure 202011630329

The invention discloses an augmented reality system and method for immersive cultural entertainment. The augmented reality system includes: a head-mounted display device, a virtual screen, a mobile device and an image workstation. The motion parameters are transmitted to the head-mounted display device in real time, and the pre-stored stereoscopic image sequence corresponding to the preset motion parameters is pre-stored. The infrared signal of the infrared emitting device is used to display the images of the head-mounted display device combined with the real scene at different positions in real time, which improves the display quality of the image and the combination accuracy of the virtual image and the real scene.

Figure 202011630329

Description

Augmented reality system and method for immersive cultural entertainment
Technical Field
The invention relates to the field of augmented reality, in particular to an augmented reality system and method for immersive cultural entertainment.
Background
A large-scale high-tech immersive cultural entertainment system is a comprehensive cultural entertainment integrated system which provides three-dimensional, multi-dimensional and omnibearing physical and mental sensory experience for people by means of subsystems such as a stereo image system, a multi-channel sound system, a multi-degree-of-freedom mechanical motion and automatic control system, a software system, a scene setting system, a lighting system, a special effect system and the like and by combining rich cultural story content. The method is represented by dark rides, 4D cinemas, ball-screen flight cinemas, phantom theaters and the like in the industrial application field, and is widely applied to cultural and entertainment scenes such as theme parks, science and technology museums, exhibition museums and the like.
The high-tech immersive culture and entertainment system mainly adopts the characteristics of obvious culture attributes, strong immersion, complex system, high technological content and the like by means of special-shaped screens, stereoscopic vision, real scene atmosphere creation, seamless combination of virtual stereoscopic pictures and real scenes and high-reality motion simulation in cooperation with riding equipment to tell an interesting story and enable a user to experience a thrilling and stimulating playing process.
Taking the dark ride type as an example, spectators ride on a high-speed multi-axis dynamic trolley and walk in a series of scene-set theme scenes. A series of huge screens are arranged in the theme scene and used for playing story pictures with three-dimensional sense, scene details, three-dimensional depth, perspective relation and surrounding real scenes of the pictures are completely integrated, the motion of the dynamic trolley is completely matched with the motion of the virtual pictures, and audiences cannot distinguish the real scene from the virtual pictures.
However, to build such an immersive cultural entertainment system, a series of stereoscopic screens including special shapes are required to be built, and large hardware systems such as stereoscopic projection devices are required to be installed, so that the project cost is very high. If the augmented reality system and the large-scale high-tech immersive cultural entertainment system can be combined, and the augmented reality equipment replaces a large-scale screen and a stereoscopic projection system, the system cost can be greatly reduced, and the system scale and the system complexity can be reduced.
In recent years, small augmented reality systems widely popularized have the defects of low virtual image fidelity, obvious virtual-real combination trace, large time delay and small field of view, so that the user experience is poor, and the small augmented reality systems cannot be directly used in immersion type cultural entertainment systems.
Accordingly, the prior art is yet to be improved and developed.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention aims to provide an augmented reality system and method for immersive cultural entertainment, which aims to solve the problems of poor quality of virtual images and obvious false-true combination traces when the augmented reality system is used for immersive cultural entertainment.
The technical scheme of the invention is as follows:
an augmented reality system for immersive cultural entertainment, comprising:
the head-mounted display device is provided with an infrared camera device and is connected with the infrared camera device;
the virtual screen is connected with the real scene, and a plurality of infrared emission devices are arranged at the edge of the virtual screen;
the mobile device is used for enabling the head-mounted display device to move according to preset motion parameters;
the mobile device and the head-mounted display device are connected with the image workstation, and the image workstation stores a stereo image sequence corresponding to the preset motion parameters in advance.
The augmented reality system, wherein the head-mounted display device includes:
a helmet;
the processing unit is connected with the infrared camera device;
the perspective display screen is arranged on the helmet and is connected with the processing unit;
the image receiving unit is connected with the perspective display screen;
the processing unit establishes a display area on the perspective display screen according to the infrared signal, the image receiving unit receives a stereoscopic image sequence transmitted by the image workstation, and the display area is used for displaying the stereoscopic image sequence.
The augmented reality system, wherein, the perspective display screen is a perspective display screen with a curved surface of 160 degrees field of view.
The augmented reality system, wherein, infrared camera device includes two infrared cameras, two infrared cameras set up on the helmet to be located and unanimous with the visual direction of people's eye.
The augmented reality system, wherein, the virtual screen is the virtual screen of rectangle, a plurality of infrared emitter includes four infrared emitting diode, four infrared emitting diode are located respectively four apex angles of the virtual screen of rectangle.
The augmented reality system, wherein the preset motion parameters include a preset motion path, a motion speed and a motion acceleration.
The augmented reality system, wherein the stereoscopic image sequence is a continuous stereoscopic image sequence generated by rendering according to the preset motion parameters through a tracking camera in advance.
The augmented reality system, wherein, the travelling car device includes: the positioning and transmitting device is arranged on the moving trolley and connected with the image workstation; the movable trolley is used for carrying a user wearing the head-mounted display device and moving according to the preset motion parameters.
An augmented reality method for immersive cultural entertainment, wherein the augmented reality method is implemented using an augmented reality system for immersive cultural entertainment as described above, the augmented reality method comprising:
the mobile device enables the head-mounted display device to move according to the preset motion parameters;
the infrared camera device receives the infrared signal of the infrared transmitting device arranged at the edge of the virtual screen in real time;
the image workstation sends a stereoscopic image sequence to the head-mounted display device in real time according to the preset motion parameters, wherein the stereoscopic image sequence is stored in the image workstation in advance;
and the head-mounted display device displays images in real time according to the infrared signals and the stereoscopic image sequence.
The augmented reality method, wherein the preparation method of the stereoscopic image sequence comprises:
and the tracking camera moves according to the preset motion parameters, and acquires the three-dimensional image sequence according to the positions of the real scene and the virtual screen.
Has the beneficial effects that: the invention provides an augmented reality system and method for immersive cultural entertainment, wherein the augmented reality system transmits a three-dimensional image sequence which is prestored and corresponds to a preset motion parameter to a head-mounted display device in real time through an image workstation according to the preset motion parameter, and meanwhile, the head-mounted display device moves according to the preset motion parameter through the mobile device and acquires an infrared signal of an infrared emission device arranged at the edge of a virtual screen in real time, so that images of the head-mounted display device combined with a real scene at different positions are displayed in real time, and the display quality of the images and the combination precision of the virtual images and the real scene are improved.
Drawings
Fig. 1 is a first structural diagram of an augmented reality system for immersive cultural entertainment in accordance with the present invention.
Fig. 2 is a schematic diagram of a second structure of the augmented reality system for immersive cultural entertainment of the present invention.
Detailed Description
The invention provides an augmented reality system and method for immersive cultural entertainment, and the invention is further described in detail below in order to make the purpose, technical scheme and effect of the invention clearer and clearer. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The embodiment provides an augmented reality system for immersive cultural entertainment, please refer to fig. 1 and 2, including: the head-mounted display device 10 is provided with an infrared camera device 11, and the head-mounted display device 10 is connected with the infrared camera device 11; the virtual screen is connected with the real scene 21, and a plurality of infrared emission devices 22 are arranged at the edge of the virtual screen; a moving device 30 for moving the head-mounted display device 10 according to a preset motion parameter; the image workstation 40, the mobile device 30 and the head-mounted display device 10 are connected to the image workstation 40, and the image workstation 40 stores preset motion parameters of the mobile device 30 and a stereo image sequence corresponding to the preset motion parameters in advance.
Specifically, for a high-tech immersive cultural entertainment system, a real scene 21 and a large screen are usually established, and a virtual image is projected onto the large screen through a stereoscopic projection system to combine the real scene 21 and the virtual image. In this embodiment, the virtual screen refers to a virtual object established in the computing process of the augmented reality system, and only the spatial position is reserved in the real environment, and no entity screen is provided. The head-mounted display device 10 is adopted to replace a stereoscopic projection system, the head-mounted display device 10 is used for displaying virtual images in real time, a user wears the head-mounted display device 10 to move through the mobile device 30 according to preset motion parameters, while the mobile device 30 moves, an infrared camera on the head-mounted display device 10 receives infrared signals emitted by the infrared emission device 22 in real time, the head-mounted display device 10 can obtain the real-time spatial position of the infrared emission device 22 relative to the head-mounted display device 10 in real time according to the infrared signals, namely can obtain the real-time spatial position of a virtual screen relative to the head-mounted display device 10, meanwhile, the mobile device 30 sends the real-time position of the mobile device to the image workstation 40 in real time, so that the image workstation 40 can know the real-time position of the head-mounted display device 10, and forwards a stereoscopic image sequence which is stored in advance and corresponds to the preset motion parameters to the head-mounted display device 10 according to the real-time position of the head-mounted display device 10 In the head-mounted display device 10, a user can see a virtual image displayed on the head-mounted display device 10 through the head-mounted display device 10 during a movement of wearing the head-mounted display device 10, and when the virtual image is viewed through the head-mounted display device 10, the position of the virtual image is exactly at the position of a virtual screen, and the virtual screen is connected with the real scene 21, that is, a scene in which the virtual image and the real scene 21 are seamlessly combined can be seen through the head-mounted display device 10. Further, the image workstation 40 is connected to the head-mounted display device 10 through a high-speed wireless network, so that the stereoscopic image displayed by the head-mounted display device 10 can correctly correspond to the position of the stereoscopic image, and the accuracy of virtual-real combination is further improved.
The invention combines an augmented reality system and a large-scale high-tech immersive cultural entertainment system, and adopts the augmented reality system to replace a large-scale screen and a stereoscopic projection system, thereby greatly reducing the equipment cost, the system scale and the system complexity, and simultaneously improving the display quality of images and the combination precision of virtual images and real scenes 21.
In one implementation, the head mounted display device 10 includes: a helmet 12; a processing unit (not shown) connected to the infrared camera 11; the perspective display screen 13 is arranged on the helmet 12, and the perspective display screen 13 is connected with the processing unit; an image receiving unit (not shown) connected to the see-through display 13; the processing unit establishes a display area on the see-through display screen 13 according to the infrared signal, the image receiving unit receives a stereoscopic image sequence transmitted from the image workstation 40, and the display area is used for displaying the stereoscopic image sequence.
Specifically, the infrared emitting device 22 disposed on the edge of the virtual screen always emits infrared signals, the infrared camera 11 on the head-mounted display device 10 worn by the user receives the infrared signals in real time and transmits the infrared signals to the processing unit of the head-mounted display device 10, the processing unit obtains a first spatial position of the infrared emitting device 22 relative to the head-mounted display device 10 according to the real-time infrared signals, and establishes a display area on the see-through display screen 13 in real time, wherein the display area corresponds to an area of the virtual screen seen by the user through the see-through display screen 13. As the head-mounted display device 10 moves, the first spatial position changes accordingly, that is, the position of the head-mounted display device 10 at each time corresponds to the first spatial position at each time one by one, so that the stereoscopic image sequence transmitted by the image workstation 40 according to the preset motion parameters is received by the image receiving unit and corresponds to the real-time display area one by one, and the real-time display area of the see-through display 13 displays the corresponding stereoscopic image sequence, that is, displays the video, thereby combining the virtual video and the real scene 21 to make the user feel as if he is present.
In one implementation, the see-through display 13 is a see-through display having a curved surface with a 160 degree field of view.
Specifically, the viewing angles of the users are different, the display positions of the display areas on the see-through display screen 13 are different, and the transmission display screen is selected as the see-through display screen with the curved surface having the 160-degree visual field according to the maximum visual range of the human eyes, so that the display areas can be always located in the visual range of the human eyes in the whole movement process of the users.
In one implementation, the infrared camera 11 includes two infrared cameras, which are disposed on the helmet 12 and are aligned with the orientation of human eyes.
Specifically, two infrared cameras set up in the both sides of helmet 12, and are located the top of perspective display screen 13, and two infrared cameras are parallel to each other, and infrared camera's orientation is unanimous with the orientation of people's eye to interval between two infrared cameras is equivalent with the interval between two people's eyes, in order to simulate the position between two people's eyes.
Further, the infrared camera device 11 further includes a pupil detection device, the pupil detection device includes two sets of depth cameras and an image processor connected to the two sets of depth cameras, the two sets of depth cameras are respectively disposed on the helmet 12 and located above the front of the eyes and facing the pupils of the eyes obliquely downward, and the eyes are not obstructed from viewing the virtual image on the see-through display screen 13. Each group of depth cameras comprises a micro dot matrix projector and a micro infrared detection camera, the micro dot matrix projector is used for projecting first infrared light to human eyes, the micro infrared detection camera is used for receiving second infrared light reflected by the eyes, and the image processor reconstructs a 3D model of the eyes by detecting the deviation of the second infrared light relative to the first infrared light. Thereby determining a second spatial position of the two pupils relative to their corresponding depth camera. Meanwhile, the image processor is also connected with the processing unit, and the image processor is also used for transmitting the second spatial position to the processing unit, so that the processing unit can track the position of the pupil of the human eye, and a more accurate display area is established on the perspective display screen 13 according to the first spatial position and the second spatial position, thereby further improving the accuracy of virtual-real combination.
In one implementation, the virtual screen is a rectangular virtual screen, and the plurality of infrared emission devices 22 includes four infrared light emitting diodes, and the four infrared light emitting diodes are respectively located at four top corners of the rectangular virtual screen.
Specifically, the infrared emitting device 22 is disposed at the edge of the virtual screen, which reflects the position of the virtual screen in the real space, the virtual screen is tracked and positioned by the infrared signal of the infrared emitting device 22, a display area corresponding to the position of the virtual screen relative to the head-mounted display device 10 is established on the see-through display 13, four infrared emitting diodes can represent a rectangular area, which locates the length and width of the virtual screen, of course, the present embodiment is not limited to four infrared emitting diodes, and a plurality of infrared emitting diodes can be added to the virtual screen, so that the virtual screen is more accurately positioned, the virtual screen of the present embodiment is not limited to a rectangular screen, which can be a cylindrical screen, a spherical screen or a screen with other shapes, the specific shape can be determined according to the actual needs, and the positions of the infrared emitting diodes are set according to the shape of the virtual screen, it is only necessary that the arrangement of the infrared light emitting diodes can embody the shape of the virtual screen.
In one implementation, the preset motion parameters include a preset motion path 31, a motion speed and a motion acceleration.
Specifically, the preset motion parameters establish the connection between the image display of the head-mounted display device 10 and the transmission of the stereoscopic image sequence of the image workstation 40 in real time, and the preset motion parameters reflect the real-time position of the mobile device 30, and the real-time position of the mobile device 30 can be known through the set motion path 31, the set motion speed and the set motion acceleration, so that the real-time position of the head-mounted display device 10 can be known. Further, the stereoscopic image sequence is a continuous stereoscopic image sequence previously generated by rendering by the tracking camera 50 according to the preset motion parameters. The tracking camera 50 is driven according to the preset motion parameters, and the real-time position of the tracking camera 50 in the motion process is adopted to render or shoot the film and television level high-quality continuous stereoscopic image sequences according to a certain angle, and the stereoscopic image sequences are continuously displayed in the perspective display screen 13 of the head-mounted display device 10 according to the real-time position, so that the user can see images from the perspective display screen 13.
In one implementation, the mobile cart device includes: the system comprises a movable trolley and a positioning and transmitting device arranged on the movable trolley, wherein the positioning and transmitting device is connected with an image workstation 40; the moving trolley is used for carrying a user wearing the head-mounted display device 10 and moving according to the preset motion parameters.
Specifically, a positioning and transmitting device is disposed on the mobile cart, and transmits the position of the mobile cart to the image workstation 40 in real time, so that the image workstation 40 can know the real-time position of the head-mounted display device 10.
In one embodiment, the present invention further provides an augmented reality method for immersive cultural entertainment, which is implemented by the augmented reality system for immersive cultural entertainment as described above, with reference to fig. 1 and 2, and the augmented reality method includes:
s10, the mobile device 30 enables the head-mounted display device 10 to move according to the preset motion parameters;
s20, the infrared camera device 11 receives the infrared signal of the infrared emission device 22 arranged at the edge of the virtual screen in real time;
s30, the image workstation 40 sends a stereoscopic image sequence to the head-mounted display device 10 in real time according to the preset motion parameters, wherein the stereoscopic image sequence is stored in the image workstation 40 in advance;
and S40, displaying images in real time by the head-mounted display device 10 according to the infrared signals and the stereoscopic image sequence.
Particularly, the augmented reality system for immersive cultural entertainment is mainly applied to theme scenes with a series of situational settings, and the combination of virtual scenes and physical scenes is realized. Designing a situational subject scene, and determining the position of the real scene 21, the position of the virtual screen and the content of a virtual scene, wherein the content of the virtual scene is an image to be displayed by the head-mounted display device 10; meanwhile, the motion process of the head-mounted display device 10 is planned, and preset motion parameters are generated. Virtual scene content is pre-made, a tracking camera 50 is adopted to move according to preset motion parameters, a film and television high-quality continuous stereo image sequence is rendered or shot according to the positions of the real scene 21 and the virtual screen, and the shot continuous stereo image sequence is stored in the image workstation 40. A series of infrared emitting devices 22 are mounted at the edges of the virtual screen. The spectator wears the head-mounted display device 10 and moves in the theme scene on the moving trolley according to the preset motion parameters, the infrared light emitted by the infrared emission device 22 is detected by the infrared camera device 11 on the head-mounted display device 10 worn by the spectator, the head-mounted display device 10 tracks and calculates the relative positions of a series of infrared emission devices 22 and the head-mounted display device 10 in real time, and a display area is established on the perspective display screen of the head-mounted display device 10 in real time according to the relative positions. The mobile device 30 sends the real-time position of the mobile device to the image workstation 40 in real time, and the image workstation 40 transmits a three-dimensional image sequence corresponding to the real-time position to the head-mounted display device 10 in real time according to the real-time position of the mobile device 30; the head-mounted display device 10 displays the received stereoscopic image sequence in real time within the display area so that it can be displayed at the correct position on the see-through display screen 13 of the head-mounted display device 10.
In summary, the present invention provides an augmented reality system and method for immersive cultural entertainment, where the augmented reality system transmits a stereo image sequence pre-stored in a head-mounted display device in real time according to a preset motion parameter through an image workstation, and the head-mounted display device moves according to the preset motion parameter through a mobile device, and acquires an infrared signal of an infrared emitter disposed at an edge of a virtual screen in real time, so as to display images of the head-mounted display device at different positions in combination with a real scene in real time, thereby improving display quality of the images and combination accuracy of the virtual images and the real scene.
It is to be understood that the invention is not limited to the examples described above, but that modifications and variations may be effected thereto by those of ordinary skill in the art in light of the foregoing description, and that all such modifications and variations are intended to be within the scope of the invention as defined by the appended claims.

Claims (9)

1.一种用于沉浸式文化娱乐的增强现实系统,其特征在于,包括:1. an augmented reality system for immersive cultural entertainment, characterized in that, comprising: 头戴式显示装置,所述头戴式显示装置上设有红外摄像装置,所述头戴式显示装置与所述红外摄像装置连接,所述红外摄像装置包括瞳孔检测装置,所述瞳孔检测装置包括两组深度相机和以及与所述两组深度相机连接的图像处理器,两组深度相机分别设置于头戴式显示装置上,每组深度相机包括微型点阵投影机和微型红外检测相机,微型点阵投影机用于向人眼部投射第一红外光,微型红外检测相机用于接收眼部反射回的第二红外光,图像处理器通过检测第二红外光相对第一红外光的偏移以重建眼部的3D模型;A head-mounted display device, an infrared camera device is arranged on the head-mounted display device, the head-mounted display device is connected to the infrared camera device, the infrared camera device includes a pupil detection device, and the pupil detection device It includes two sets of depth cameras and an image processor connected to the two sets of depth cameras, the two sets of depth cameras are respectively arranged on the head-mounted display device, and each set of depth cameras includes a miniature dot matrix projector and a miniature infrared detection camera, The miniature dot matrix projector is used to project the first infrared light to the human eye, the miniature infrared detection camera is used to receive the second infrared light reflected back by the eye, and the image processor detects the polarization of the second infrared light relative to the first infrared light. move to reconstruct a 3D model of the eye; 虚拟屏幕,所述虚拟屏幕与实景连接,在所述虚拟屏幕的边缘设有若干个红外发射装置,所述红外发射装置用于发射红外信号;a virtual screen, the virtual screen is connected with the real scene, and a plurality of infrared emission devices are arranged on the edge of the virtual screen, and the infrared emission devices are used to emit infrared signals; 移动装置,用于使所述头戴式显示装置按照预设运动参数移动;a moving device, configured to move the head-mounted display device according to preset motion parameters; 图像工作站,所述移动装置和所述头戴式显示装置均与所述图像工作站连接,所述图像工作站预先存储有与所述预设运动参数对应的立体图像序列;an image workstation, both the mobile device and the head-mounted display device are connected to the image workstation, and the image workstation pre-stores a stereoscopic image sequence corresponding to the preset motion parameters; 所述头戴式显示装置包括:头盔;处理单元,所述处理单元与所述红外摄像装置连接,并接收所述红外摄像装置实时接收到的红外信号;透视显示屏,所述透视显示屏设置于所述头盔上,并与所述处理单元连接;图像接收单元,所述图像接收单元与所述透视显示屏连接;The head-mounted display device includes: a helmet; a processing unit, the processing unit is connected with the infrared camera device, and receives the infrared signal received by the infrared camera device in real time; a see-through display screen, the see-through display screen is set on the helmet and connected with the processing unit; an image receiving unit, the image receiving unit is connected with the see-through display screen; 其中,所述处理单元根据所述红外信号在所述透视显示屏上建立显示区域,所述图像接收单元接收所述图像工作站传来的立体图像序列,所述显示区域用于显示所述立体图像序列。Wherein, the processing unit establishes a display area on the see-through display screen according to the infrared signal, the image receiving unit receives the stereoscopic image sequence transmitted from the image workstation, and the display area is used for displaying the stereoscopic image sequence. 2.根据权利要求1所述的增强现实系统,其特征在于,所述透视显示屏为具有160度视野的弯曲面的透视式显示屏。2 . The augmented reality system according to claim 1 , wherein the see-through display screen is a see-through display screen with a curved surface having a field of view of 160 degrees. 3 . 3.根据权利要求2所述的增强现实系统,其特征在于,所述红外摄像装置包括两个红外摄像头,所述两个红外摄像头设置在所述头盔上,且所述两个红外摄像头的视觉方向与人眼的视觉方向一致。3. The augmented reality system according to claim 2, wherein the infrared camera device comprises two infrared cameras, the two infrared cameras are arranged on the helmet, and the vision of the two infrared cameras is The direction is consistent with the visual direction of the human eye. 4.根据权利要求3所述的增强现实系统,其特征在于,所述虚拟屏幕为矩形虚拟屏幕,所述若干个红外发射装置包括四个红外发光二极管,所述四个红外发光二极管分别位于所述矩形虚拟屏幕的四个顶角。4 . The augmented reality system according to claim 3 , wherein the virtual screen is a rectangular virtual screen, and the plurality of infrared emitting devices comprises four infrared light-emitting diodes, and the four infrared light-emitting diodes are respectively located in the The four top corners of the rectangular virtual screen. 5.根据权利要求1所述的增强现实系统,其特征在于,所述预设运动参数包括预先设定的运动路径、运动速度和运动加速度。5 . The augmented reality system according to claim 1 , wherein the preset motion parameters include preset motion paths, motion speeds and motion accelerations. 6 . 6.根据权利要求1所述的增强现实系统,其特征在于,所述立体图像序列为预先通过跟踪摄影机根据所述预设运动参数渲染生成的连续的立体图像序列。6 . The augmented reality system according to claim 1 , wherein the stereoscopic image sequence is a continuous stereoscopic image sequence that is pre-rendered and generated by a tracking camera according to the preset motion parameters. 7 . 7.根据权利要求1所述的增强现实系统,其特征在于,所述移动装置包括:移动小车以及设置在所述移动小车上的定位发射装置,所述定位发射装置与所述图像工作站连接。7 . The augmented reality system according to claim 1 , wherein the mobile device comprises: a mobile cart and a positioning and transmitting device arranged on the moving cart, and the positioning and transmitting device is connected to the image workstation. 8 . 8.一种用于沉浸式文化娱乐的增强现实方法,其特征在于,采用如权利要求1-7任一所述的用于沉浸式文化娱乐的增强现实系统实现,所述增强现实方法包括:8. An augmented reality method for immersive cultural entertainment, characterized in that it is implemented by using the augmented reality system for immersive cultural entertainment according to any one of claims 1-7, the augmented reality method comprising: 移动装置使头戴式显示装置以预设运动参数进行移动;The moving device makes the head-mounted display device move with preset motion parameters; 红外摄像装置实时接收设置于虚拟屏幕的边缘的所述红外发射装置的红外信号;The infrared camera device receives in real time the infrared signal of the infrared emission device arranged on the edge of the virtual screen; 图像工作站根据所述预设运动参数实时给所述头戴式显示装置发送立体图像序列,其中,所述图像工作站预先存储有所述立体图像序列;The image workstation sends a stereoscopic image sequence to the head-mounted display device in real time according to the preset motion parameter, wherein the image workstation pre-stores the stereoscopic image sequence; 所述头戴式显示装置根据所述红外信号和所述立体图像序列实时显示影像。The head-mounted display device displays images in real time according to the infrared signal and the stereoscopic image sequence. 9.根据权利要求8所述的增强现实方法,其特征在于,所述立体图像序列的制备方法包括:9. The augmented reality method according to claim 8, wherein the preparation method of the stereoscopic image sequence comprises: 跟踪摄影机按照所述预设运动参数移动,并根据实景与虚拟屏幕的位置获取所述立体图像序列。The tracking camera moves according to the preset motion parameters, and acquires the stereoscopic image sequence according to the positions of the real scene and the virtual screen.
CN202011630329.8A 2020-12-30 2020-12-30 Augmented reality system and method for immersive cultural entertainment Expired - Fee Related CN112866672B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011630329.8A CN112866672B (en) 2020-12-30 2020-12-30 Augmented reality system and method for immersive cultural entertainment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011630329.8A CN112866672B (en) 2020-12-30 2020-12-30 Augmented reality system and method for immersive cultural entertainment

Publications (2)

Publication Number Publication Date
CN112866672A CN112866672A (en) 2021-05-28
CN112866672B true CN112866672B (en) 2022-08-26

Family

ID=75999817

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011630329.8A Expired - Fee Related CN112866672B (en) 2020-12-30 2020-12-30 Augmented reality system and method for immersive cultural entertainment

Country Status (1)

Country Link
CN (1) CN112866672B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118247963A (en) * 2024-04-03 2024-06-25 中国建筑第二工程局有限公司 Vehicle overload monitoring system and method

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101673161B (en) * 2009-10-15 2011-12-07 复旦大学 Visual, operable and non-solid touch screen system
WO2016012044A1 (en) * 2014-07-24 2016-01-28 Deutsche Telekom Ag Method and system for augmenting television watching experience
EP3485465A1 (en) * 2016-09-23 2019-05-22 Apple Inc. Augmented reality display
WO2018113759A1 (en) * 2016-12-22 2018-06-28 大辅科技(北京)有限公司 Detection system and detection method based on positioning system and ar/mr
US11249714B2 (en) * 2017-09-13 2022-02-15 Magical Technologies, Llc Systems and methods of shareable virtual objects and virtual objects as message objects to facilitate communications sessions in an augmented reality environment
CN109613706B (en) * 2019-01-28 2021-05-07 京东方科技集团股份有限公司 Adjusting method and device for intelligent head-mounted device and storage medium
CN111580273B (en) * 2019-02-18 2022-02-01 宏碁股份有限公司 Video transmission type head-mounted display and control method thereof
CN110727111A (en) * 2019-10-23 2020-01-24 深圳惠牛科技有限公司 Head-mounted display optical system and head-mounted display equipment
CN210609485U (en) * 2019-11-29 2020-05-22 镇江慧影科技发展有限公司 Real-time interactive virtual reality view sharing system

Also Published As

Publication number Publication date
CN112866672A (en) 2021-05-28

Similar Documents

Publication Publication Date Title
US11758346B2 (en) Sound localization for user in motion
US11310618B2 (en) Virtual reality, augmented reality, and mixed reality systems with spatialized audio
CN103149689B (en) The reality virtual monitor expanded
US10114455B2 (en) Eye tracking enabling 3D viewing
CN107533230A (en) Head Mounted Display Tracking System
CN107247511A (en) A kind of across object exchange method and device based on the dynamic seizure of eye in virtual reality
US11507201B2 (en) Virtual reality
WO2013112635A1 (en) Virtual environment generating system
US20110141246A1 (en) System and Method for Producing Stereoscopic Images
CN110458953B (en) Three-dimensional image reconstruction system and method
CN108108027A (en) Virtual reality method and system based on roller-coaster
CN112866672B (en) Augmented reality system and method for immersive cultural entertainment
CN110882536A (en) Chess and play game system based on AR equipment
Yoshida fVisiOn: glasses-free tabletop 3D display to provide virtual 3D media naturally alongside real media
JP6820299B2 (en) Programs, information processing equipment, and methods
Li et al. Real-time immersive table tennis game for two players with motion tracking
Li Development of immersive and interactive virtual reality environment for two-player table tennis
TWM555001U (en) System, wearable device and flying device for providing semi-holographic images
JP2021507365A (en) Data processing
PATTI Reducing motion sickness on mobile phone based VR applications using 6DoF tracking
KR20260005899A (en) Augmented reality display with adjustable parallax
WO2024226309A1 (en) Augmented reality display with adjustable parallax
HK40005416A (en) Geometry matching in virtual reality and augmented reality
NZ792211A (en) Virtual reality, augmented reality, and mixed reality systems with spatialized audio

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20220826