WO2024155308A1 - Plateforme d'inspection de sécurité à réalité augmentée - Google Patents

Plateforme d'inspection de sécurité à réalité augmentée Download PDF

Info

Publication number
WO2024155308A1
WO2024155308A1 PCT/US2023/036577 US2023036577W WO2024155308A1 WO 2024155308 A1 WO2024155308 A1 WO 2024155308A1 US 2023036577 W US2023036577 W US 2023036577W WO 2024155308 A1 WO2024155308 A1 WO 2024155308A1
Authority
WO
WIPO (PCT)
Prior art keywords
site
augmented reality
real
time
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2023/036577
Other languages
English (en)
Inventor
Harold HUMPHREY
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2024155308A1 publication Critical patent/WO2024155308A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects

Definitions

  • the present invention relates generally to the field of safety inspections systems, and more particularly, to a system and method that facilitates using virtual reality environments with respect to performing safety inspections of a particular site.
  • Tunnels remain in service for extended periods of time, sometime beyond then- intended service life. Tunnels that are not adequately maintained usually need more costly and extorsive repairs. Structural, civil, and functional systems deteriorate at accelerated levels because of the harsh tunnel environment. Many tunnels have complicated functional systems such as lighting, ventilation, drainage, fire detection and alarms, fire suppression, co unication and traffic control and these systems must be kept in good working order to minimize death and injury during an emergency such as a vehicle collision, derailment, fire, flood, earthquake, or criminal act. [0003] For example, efficient emergency response is key to preventing major losses in tunnel fires. Conformance to prescriptive regulations dominates existing practice in the area of emergency preparedness.
  • a successful emergency response to tunnel fires and otherinfrastructure emergencies is dependent on many parties collaborating under serious time constraints and harsh and unsafe conditions.
  • Safety becomes a matter of controlling critical processes necessary to keep the system in a safe state and prevent the loss of life. Efficient decision-making in situations of major uncertainty is vital, to achieve safety goals.
  • efficient emergency preparedness for any type of infrastructure is a matter that needs attention in the early design phases and continuous improvements during the operational phase. Enhancing the ability to perform safety inspections and emergency responses for different physical sites is an area for further deployment of various technologies and associated devices.
  • the present invention is directed to providing a system and method that facilitates using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site or other infrastructure.
  • an augmented reality safety inspection platform that facilitates using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site or other infrastructure.
  • the system comprising: a plurality of proximity data loaders, each proximity data loader of the plurality of proximity data loaders installed at and associated with a particular section within a site and storing a three-dimensional (3D) point cloud data set specific to the particular section associated therewith; a plurality of 3D image capture devices, each 3D image capture device installed at a different location within the site for capturing real-time 3D images of the site; an augmented reality (AR) device configured for receiving the 3D point cloud data set specific to the particular section from the proximity data loader associated therewith as a user traverses the site while wearing the augmented reality device and displaying a real-time AR view of the site; and wherein the real-time AR view comprises a combination of at least one 3D image generated using the 3D point cloud data set received and at least one
  • a method that facilitates using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site or other infrastructure.
  • the method comprising: (i) collecting a plurality of point cloud data sets specific to a site, each point cloud data set associated with a particular section of the facility or site; (ii) storing each point cloud data set collected in a proximity data loader located proximate to the particular section of the facility or site associated therewith; (in) receiving the point cloud data set stored from the proxi ty dataloader located proximate to the particular section of the facility or site; (iv) geneating at least one 3D image using the point cloud data set received; and (v) rendering areal-time view on an AR device of the facility or site comprising a combination of at least the real-time image with the at least one 3D image generated associated with the particular section of the facility or site.
  • a user device configured for using augmented reality environments for paforming safety inspections of and/or emergency response activities within a particular site or other infrastructure.
  • the user device comprising at least a processor, a display and a memory storing instructions that when executed cause the processor to perform operations compri g (i) collecting a plurality of point cloud data sets specific to a site, each point cloud data set associated with a particular section of the facility or site; (ii) storing each point cloud data set collected in a proximity data loader located proximate to the particular section ofthe facility or site associated therewith; (iii) receiving at least one real-time video image associated with at least a particular section of the facility or site; (iv) receiving the point cloud data set stored from the proximity data loader located proximate to the particular section of the facility or site; (v) generating at least one 3D image using the point cloud data set received; and (vi) rendering a real- time view on an AR device of the facility or site comprising
  • an augmented reality safety inspection application (alternatively referred to herein as an “app”) may be executed on the augmented reality safety inspection platform and/or the user device for executing operations that provide for using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site or other infrastructure.
  • the operations comprising (i) collecting a plurality of point cloud data sets specific to a site, each point cloud data set associated with a particular section of the facility or site; (ii) storing each point cloud data set collected in a proximity data loader located proximate to the particular section of the facility or site associated therewith; (iii) receiving at least one real-time video image associated with at least a particular section of the facility or site; (iv) receiving the point cloud data set stored from the proximity data loader located proximate to the particular section of the facility or site; (v) generating at least one 3D image using the point cloud data set received; and (vi) rendering a real-time view on an AR device of the facility or site comprising a combination of at least the real-time image with the at least one 3D image generated associated with the particular section of the facility or site.
  • At least one of the 3D image capture devices is a 3D holographic projection camera.
  • At least one of the 3D image capture devices is configured with a 3D motion detector and video recorder.
  • the augmented reality safety inspection platform further co rises at least one terrestrial scanner configured to scan the site for creating the three-dimensional (3D) point cloud data set specific to the particular section associated therewith.
  • the site is a tunnel.
  • the site is a building.
  • the user is a first responder responding to a real-time emergency at a site.
  • a first responder responding to the real-time emergency at a site remains external to the site while wearing the AR device.
  • the real-time AR view displays a plurality of levels of a site.
  • the user may sippress one or more levels of the plurality of levels from being displayed.
  • the user may make one or more features shown in the real-time AR view transparent.
  • the augmented reality safety inspection platform further comprises a mobile command center communicatively coupled with the user through the AR device worn thereby.
  • the mobile command center collects georeferenced data for identifying and locating any threat within a site.
  • the user remotely activates one or more safety systems within a site using the real-time time AR view of the site displayed as the user traverses the site.
  • the methods and systems described herein can be implemented by data processing systems, such as one or more smartphones, tablet computers, desktop computers, laptop computers, smart watches, wearable, audio accessories, on-board computer, and other data processing systems and other consumer electronic devices.
  • the methods and systems described herein can also be implemented by one or more data processing systems which execute executable computer program instructions, stared in one or more non-transitory machine-readable media that cause the one or more data processing systems to perform the one or more methods described herein when, the program instructions are executed.
  • the embodiments described herein can include methods, data processing systems, and non-transitory machine-readable media.
  • FIG. 1 presents an exemplary site configured with an augmented reality safety inspection system in accordance with an embodiment
  • FIG. 2 an illustrative AR device configured in accordance with an embodiment
  • FIG. 3 presents an illustrative user AR device view created in accordance with an embodiment
  • FIG.4 presents a high-level block diagram of a cloud network services architecture for providing augmented reality safety inspections in accordance with an embodiment
  • FIG. 5 presents an illustrative block diagram for conducting augmented reality safety inspections and how the user’s AR device engages and views the user augmented reality views created in accordance with an embodiment
  • FIG. 6 presents illustrative an augmented reality safety inspection platform in accordance with an embodiment
  • FIG. 7 presents an illustrative user device configured in accordance with an embodiment
  • FIG. 8 a flowchart of illustrative operations for using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site or other infrastructure in accordance with an embodiment
  • FIG. 9 presents an illustrative architecture for an augmented reality safety inspection app in accordance with an embodiment.
  • the present invention is directed toward a system and method that facilitates using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site or other infrastructure. More particularly, the system co rises a plurality of proximity data loaders and each proximity data loader of the plurality of proximity data loaders installed at and associated with a particular section within a site and stores a 3D point cloud data set specific to the particular section associated therewith. Further, a plurality of 3D image capture devices is employed with each 3D image capture device installed at a different location within the site for capturing real-time 3D images of the site.
  • An AR device worn by a user is configured for receiving the 3D point cloud data set specific to the particular section from the proximity data loader associated therewith as a user traverses the site (or is proximate thereto) while wearing the augmented reality device and displaying a real-time time AR view of the site.
  • the real-time AR view comprises a combination of at least one 3D image generated using the 3D point cloud data set received and at least one real-time 3D image of the site captured by at least one of the 3D image capture devices.
  • the augmented reality safety inspection system and method of the disclosed embodiments provides an advantageous improvement of practical applications such as safety inspection systems, emergency first responder systems, location-based systems and platforms, extended reality platforms, extended reality devices, and extending reality applications.
  • VR virtual reality
  • AR augmented reality
  • VR or AR may refer to simulated environments featuring conputer graphics that a user can interact with in a way that is more immersive than merely watching a television or conputer screen.
  • Past VR environments have included large pod-like or cockpit-like stations, where a user would sit down inside the station and be able to interact with a panoramic graphical interface that represented some 3-dimensional world. The user would typically utilize some external set of controllers, such as a joystick or interactive glove, in order to move around in the VR environment.
  • VR goggles are head-mounted devices that a user only needs to wear over their eyes. The user can then see the equivalent of a panoramic view that they could have seen in the immersive, pod -like stations, but the goggles enable the user to be more mobile and does not require such a large hardware implementation.
  • the user may manipulate the environment seen through the goggles by using some external device, like a joystick or some other controller.
  • AR implementations attempt to blend computer graphics and other images with a user's actual surroundings, such that the user may perceive that their surroundings have been augmented. To achieve this, AR smart eyeglasses that the user may wear typically provide transparent or substantially transparent lenses, so that theuser can still see their actual surroundings while viewing other objects at the same time.
  • Augmented reality technology involves modifying a view of a real-world environment (also referred to as a "scene") to enhance the viewer's perception. This can be done, for example, by presenting various AR elements to a user such that the AR elements are incorporated into the user's experience of a scene. By incorporating these AR elements, the user's experience of the scene may thereby become enhanced. Examples of these AR elements include computer-generated data, text, images, sounds, haptics, or the like.
  • AR technology may take the form of electronic devices, including wearable devices (e.g., smart eyeglasses), mobile devices (e.g., smartphones), tablets, or laptop computers. These AR devices may perform a variety of AR functions.
  • a pair of smart eyeglasses may include a transparent display capable of presenting various visual AR elements.
  • the display When a user wears the smart eyeglasses, the display may be positioned in between the user's eyes and the scene that the user is viewing. In this way, the AR elements presented on the display of the smart eyeglasses may be overlaid on top of and/or incorporated into the user’s view of the scene.
  • AR can use “markers" or data-based triggers, for instance geolocation, to know where to include AR elements in the user's display.
  • AR devices may facilitate social interactions. For example, an AR device may display biographical information about various people that a user might encounter. An AR device may use markers/geolocation or scan a person's face, determine identification information related to the person, and thereafter display some data about that person, such as his name, profession, age, interests, and/or contact information.
  • MR mixed reality
  • digital and real-world objects are co-existing and may interact with each other in real-time.
  • This immersive technology (sometimes also referrred to as hybrid reality) requires an MR headset and typically more processing power than VR or AR applications.
  • Mixed reality does not exclusively take place in either the physical world or virtual world but is a hybrid of AR and VR.
  • AR takes place in the physical world, with information or objects added virtually like an overlay and VR immerses the user in a fully virtual world without the intervention of the physical world.
  • Mixed reality is a blend of physical and digital worlds, unlocking natural and intuitive three-dimensional (3D) human, computer, and environmental interactions. This new reality is based on advancements in computer vision, graphical processing, display technologies, input systems, and cloud computing.
  • AR and VR capabilities are blended, bringing together the physical and digital world to produce an environment where physical and digital objects co-exist and interact in real-time.
  • mixed reality including design, entertainment, military training, and remote working.
  • display technologies used to facilitate the interaction between users and mixed reality applications.
  • Extended reality is a term referring to all real-and-virtual combined environments and human-machine interactions generated by computer technology and wearables and includes representative forms such as AR, VR, and MR, and the areas interpolated among them.
  • the levels of virtuality range from partially sensory inputs to immersive virtuality such that XR is a superset which includes the entire spectrum from the "complete real" to the "complete virtual” in conceptual terms.
  • its connotation lies in the extension of human experiences, especially relating to the senses of existence (represented by VR) and the acquisition of cognition (represented by AR).
  • extended reality is an umbrella term for all immersive technologies including, but not limited to, augmented reality (AR), virtual reality (VR), and mixed reality (MR).
  • XR refers to all real-and-virtual combined environments and human-machine interactions generated by computer technology and wearables and includes representative forms such as AR, VR, and MR, and the areas interpolated among them.
  • the levels of virtuality range from partially sensory inputs to immersive virtuality such that XR is a superset which includes the entire spectrum from "the complete real” to "the complete virtual” in conceptual terms.
  • XR’s connotation lies in the extension of human experiences especially relating to the senses of existence (represented by VR) and the acquisition of cognition (represented by AR).
  • AR augmented reality
  • VR virtual reality
  • An individual uses a VR headset or head-mounted display to engage with a 360- degree view of an artificial world that manipulates their brain into believing they are performing or engaging in a particular activity (e.g., walking on the moon, stepping into a castle or whatever environment is created by the VR developers); and (hi) mixed reality (MR): in mixed reality, digital and real world objects co-exist and may interact with one another in real-time.
  • MR mixed reality
  • a user employs a MR headset to engage the MR environment that, for example, may place digital objects in a room where the user is standing and give that user the ability to control (e.g., spin) the objects and/or interact with the digital objects in almost any way possible. While the disclosed embodiments herein focus on an AR environment and application it will be understood that the principles described herein are equally applicable to XR, VR, and MR, and the areas interpolated among them.
  • FIG. 1 presents an exemplary site 100 configured with an augmented reality safety inspection system in accordance with an embodiment
  • FIG.2 shows an illustrative AR device 200 configured in accordance with an embodiment
  • FIG.3 presents an illustrative user AR device view 300 created in accordance with an embodiment
  • the site 100 comprises a railroad tunnel 106 through which railcar 102 traverses over tracks 104.
  • the site 100 may be any type of infrastructure including, but not limited to, buildings, homes and malls, to name just a few.
  • the augmented reality safety inspection system comprises a plurality of proximity data loaders 108 and each proximity data loader 108 of the plurality of proximity data loaders is installed at and associated with a particular section within the site 100 (e.g., section A 116, section B 118, section C 120, section D 122, section E 124, and section F 126) and stores a 3D point cloud dataset specific to the particular section associated therewith.
  • each proximity data loader 108 comprises at least one proximity data loader for storing the 3D point cloud data.
  • a point cloud is a 3D visualization made up of thousands or even millions of georeferenced points. Point clouds provide high-resolution data without the distortion sometimes present in 3D mesh models. Point clouds are datasets that represent objects or space.
  • Point clouds are a means of collating a large number of single spatial measur ts into a dataset that can then represent a whole.
  • Point clouds are most commonly generated using 3D laser scanners and LiDAR (light detection and ranging) technology and techniques.
  • each point represents a single laser scan measurement.
  • These scans are then stitched together, creating a complete capture of a scene, using a process called “registration”.
  • the augmented reality safety inspection system herein further co rises at least one tarestrial scanner (not shown) configured to scan the site for creating the 3D point cloud data set specific to the particular section associated therewith.
  • Such tarestrial scanners are c - rcially available from companies such as Trimble, Riegl, and Topcon.
  • a plurality of 3D image capture devices 110 is employed with each 3D image capture device 110 installed at a different location within the site for capturing real-time 3D images of the site.
  • the 3D image capture devices 110 are placed to ensure that all or substantially all of the site 100 may be visually covered for observation.
  • at least one of the 3D image apture devices is a 3D holographic projection camera.
  • at least one of the 3D image apture devices is configured with a 3D motion detector and video recorder.
  • Such 3D holographic projection cameras and 3D motion detectors and video recorders are commercially available from companies such as Basler, Vzense, and Nerian Vision Technologies.
  • an AR device is worn by a user which is configured for receiving the 3D point cloud data set specific to the particular section from the proximity data loader associated therewith as a user traverses the site (or is proximate thereto) while wearing the augmented reality device and displaying a real-time time AR view of the site.
  • the real-time AR view comprises a combination of at least one 3D image generated using the 3D point cloud data set received and at least one real-time 3D image of the site captured by at least one of the 3D image capture devices.
  • FIG.2 an illustrative ARdevice 200 is shown configured in accordance with an embodiment.
  • the illustrative AR device 200 shown having an eyeglass configuration comprising control unit 202 that may be located anywhere in or on the physical frame of the AR device 200.
  • control unit 202 provides functionality including, but not limited, interfacing with the augmented reality safety inspection platform 600 (see, FIGs. 4, 5, and 6), the augmented reality safety inspection app 900 (see, FIG.9), the user device(s) 700 (see, FIGs. 4, 5, and 7), and the plurality of proximity data loaders 108.
  • the control unit 202 further comprises processor 206, image generation and control unit 204, Global Positioning System (GPS) module 208, left display 210, right display 212, and power source 214 (e.g., a battery).
  • the processor 206 may be a microcontroller and include both general and special purpose microprocessors and may be the sole processor or one of multiple processors of the device. Further, the processor 206 may comprise one or more central processing units (CPUs) and may include, be supplemented by, or incorporated in, one or more application-specific integrated circuits (ASICs) and/or one or more field programmable gate arrays (FPGAs).
  • CPUs central processing units
  • ASICs application-specific integrated circuits
  • FPGAs field programmable gate arrays
  • the left display 210 and the right display 212 may be configured using a transparent liquid crystal display (LCD), a heads-up display (HUD) or other suitable display.
  • LCD liquid crystal display
  • HUD heads-up display
  • a user wearing the AR device 200 is traversing the site 100 (traversing includes both being inside the site or external to the site at any particular time) and is proximate to one of the proxi ty data loaders 108, the 3D point cloud data set stored therein is received the AR device 200 and a real-time time AR view of the site 100 is displayed.
  • the real-time AR view comprises a combination of at least one 3D image generated using the 3D point cloud data set received and at least one real-time 3D image of the site captured by at least one of the 3D image capture devices.
  • FIG. 3 presents one such illustrative user AR device view 300 created in accordance with an embodiment for display on the AR device 200.
  • the rendered user AR device view 300 will show the site’s (e.g., the site 100) internal features and may include multple levels.
  • the user may sippress one or more levels of the plurality oflevels from being displayed in the user AR device view 300 and/or make one or more of the features shown in the user AR device view 300 transparent in nature.
  • the generated user AR device view 300 may comprise transparent features (e.g., a transparent wall) to allow users (e.g., a first responder) to obtain a visual of any threats within the site 100, for example. These transparent features will also allow for the user to view multiple and different angles/perspectives of the site.
  • the user may remotely activate one or more safety systems within the site as a function of the real-time time user AR device view 300 displayed as the user traverses the site. For exarrple, the user may activate water supply line 116 electrical line 112 and/or control box 114 (each as shown in FIG. 1) depending upon their real-time interaction with user AR device view 300 and current observed conditions at the site 100.
  • FIG.4 a high-level block diagram of a cloud network savices architecture 400 is shown for use with an augmented reality safety inspection platform 600 in accordance with an embodiment.
  • the cloud 402 facilitates the delivery of augmented reality safety inspection savices to a plurality of users (e.g., co rised by user 410-1, 410-2, 410-3 through 410-N) that are offered by and through the augmented reality safety inspection platform 600 using an augmented reality safety inspection app 900, as will be detailed herein below, on user device 700.
  • the user device 700 provides various users (e.g., user 410-1 through user 410-N) with real-time access to augmented reality safety inspection services in accordance with the disclosed embodiments herein.
  • the users may be an emergency first responder that is responding to a real-time emergency at a site.
  • the augmented reality safety inspection processing, offered by and through the cloud network services architecture 400 and the augmented reality safety inspection platform 600 will be facilitated by the augmented reality safety inspection app 900 (see, FIG. 9), as will be detailed herein below, executing on the user device 700 (see, FIG. 7).
  • the user device 700 provides the various users (e.g., user 410-1 through user 410-N) with real-time access to augmented reality safety inspection services in accordance with the disclosed embodiments herein.
  • the cloud 402 comprises at least server(s) 404, the access point(s) 406 and the database(s) 408.
  • mobile command centa network 412 is hosted and provided by and through cloud 402 at the direction of a mobile command center that may be situated at the site 100 in support of the safety inspection activities including, but not limited to, technical operations.
  • the mobile command centa network 412 (as deployed by the mobile command centa, for example) is communicatively coupled with at least the proximity data loaders 108, the plurality of 3D image capture devices 110 and each AR device 200 as worn by each user.
  • the mobile command centa network 412 may be any secure network type and may include mobile networks configured within, on or proximate to the site 100.
  • the on-site mobile command centa is able to collect georeferenced data for identifying and locating any threat within the site that may be conveyed to the user through their respective AR device 200. Furtha, one or mare users may deploy their respective AR device 200 while within the mobile command centa.
  • Cloud, cloud service, cloud serva and cloud database are broad terms and are to be given their ordinary and customary meaning to one of ordinary skill in the art and includes, without limitation, any database, data repository or storage media which store content typically associated with and managed by users, emergency service platforms (e.g., emergency service platforms 418) and third-party content providers (e.g., third-party content providers 416) in the context of augmented reality safety inflection services, to name just a few.
  • one emergency service platform 418 may be an emergency 911 system.
  • a cloud service may include one or more cloud servers and cloud databases that provides for the remote storage of content as hosted by a third-party service provider or operator.
  • a cloud server may include an HTTP/HTTPS servo sending and receiving messages in order to provide web-browsing interfaces to client web browsers as well as web services to sold data to integrate with other interfaces (e.g., as executed on the user device 700).
  • the cloud server may be implemented in one or more servers and may said and receive content in a various forms and formats, user supplied and/or created information/content and profile/configuration data that may be transferred from or stored in a cloud database (e.g., the databases 408).
  • a cloud database may include one or more physical servers, databases or storage devices as dictated by the cloud service’s storage requirements.
  • the cloud database may further include one or more well-known databases (e.g., an SQL database) or a fixed content storage system to store content, user profile information, configuration information, ad istration information and any other information necessary to execute the cloud service.
  • one or more networks providing computing infrastructure on behalf of one or more users may be refared to as a cloud, and resources may include, without limitation, data center resources, applications (e.g., software-as-a-service or platform-as-a-service) and management tools.
  • FIG. 5 an illustrative block diagram 500 for conducting augmented reality safety inspections and how the user’s AR device engages and views the user augmented reality views created in accordance with an embodiment.
  • each of users 410-1, 410-2, 410-3, and 410-N is wearing a respective AR device 200 which communicates, for exanple, with the augmented reality safety inspection platform 600, a respective user device 700 associated with each user, and the mobile command center network 412 over the communications links 436.
  • each USCT is executing the augmented reality safety inspection app 900 on their respective user device 700, as detailed herein.
  • Each of these users is experiencing an AR environment and a user AR view (i.e., user AR view 502 (illustratively compri g the user AR device view 300 as detailed above), user AR view 504, USCT AR view 506, and user AR view 508) in accordance with the principles of the disclosed embodiments, which is generated as a function of the augmented reality safety inspection system configured within the site 100, as detailed previously.
  • the real-time AR views i.e., user AR view 502, user AR view 504, user AR view 506, and user AR view 508 comprise a combination of at least one 3D image generated using the 3D point cloud data set received and at least one real-time 3D image of the site captured by at least one of the 3D image capture devices.
  • the user may either be within the site 100 or external to the site 100 when receiving the user AR view on their respective AR device 200.
  • the augmented reality safety inspection platform 600 c rises processor 602 for executing program code (e.g., augmented reality safety inspection app 900) and communications interface 614 for managing communications to and from the augmented reality safety inspection platform 600, memory 606, data storage 610, and/or read- only memory (ROM) 608 for storing program code and data, and power source 618 for powering the augmented reality safety inspection platform 600.
  • the memory 606 is coupled to the bus 604 for storing computer-readable instructions to be executed by the processor 602 (e.g., execution of the augmented reality safety inspection app 900).
  • Database manager 612 is used to manage the delivery and storage of content, data, and other information in the augmented reality safety inspection platform database(s) 420, database(s) 408 and across third-party content providers, for example.
  • the augmented reality safety inspection platform database(s) 420 may store and provide information including, but not limited, to user IDs 422, user profiles 424, AR device information 426, 3D point cloud dataand information 428, site-specific information 430, and hardware tracking and inventory information 432.
  • the operations performed by for the augmented reality safety inspection platform 600 in combination with the augmented reality safety inspection app 900 provide for using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site, facility or other infrastructure in accordance with the disclosed embodiments.
  • Website manager 620 is used to deliver and manage contort, data, and other information across one or more websites that may be utilized to access and use the augmented reality safety inspection platform 600, for example. Further, the operations provided by and through the augmented reality safety inspection app 900 may be offered through a web-based application.
  • the augmented reality safety inspection app 900 when executed by the processor 602 will arable access by a plurality of users (e.g., user 410-1, 410-2, 410-3 through 410-N) to the augmented reality safety inspection platform 600 for the processing of, for example, the user IDs 422, user profiles 424, AR device information 426, 3D point cloud data and information 428, site-specific information 430, and hardware tracking and inventory information 432.
  • Location-based services manager 622 facilitates the delivery of location-based services (e.g., GPS tracking) either independently or on user device 700.
  • AR device manager 630 and on-site hardware and device manager 626 facilitates the management of such AR devices 200 and/or user devices 700, and the management of the devices comprised by the augmented reality safety inspection system (e.g., plurality of proximity data loaders 108 and the plurality of 3D image capture devices 110).
  • the augmented reality safety inspection processing provided through the execution of the augmented reality safety inspection app 900 may also include a web-based delivery platform and/or accessing and interfacing any number of websites using website manager 620 for procuring information and data that can be used in the augmented reality safety inspection platform 600.
  • the term “website” in the context herein is used in a conventional and broadest sense and is located on at least one server containing web pages stored thereon and is operational in a 24-hour/7-day typical fashion.
  • the plurality of users may alternatively utilize well- known Internet 434 for access to augmented reality safety inspection platform 600 by and through a web browser on the user device 700, for exarrple.
  • the augmented reality safety inspection platform 600 may also include one or more input/output devices 616 that enable user interaction with the user device 700 (e.g., camera, display, keyboard, mouse, speakers, microphone, buttons,, etc.).
  • the input/output devices may include peripherals, such as an NFC device (e.g., NFC tag reader), camera, printer, scanner (e.g., a QR-code scanner), touchscreen display, etc.
  • the input/output devices 616 may include a display device such as a cathode ray tube (CRT), plasma monitor, liquid crystal display (LCD) monitor or organic light-emitting diode (OLED) monitor for displaying information to the user, a keyboard, and a pointing device such as a mouse or a trackball by which the user can provide input to the user device 700 or an associated display device 624, for example, that may also be managed by graphical user interface generator 628.
  • a display device such as a cathode ray tube (CRT), plasma monitor, liquid crystal display (LCD) monitor or organic light-emitting diode (OLED) monitor for displaying information to the user
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • the c unications interface 614 is used to facilitate communications across the communications links 436 (see, FIG.4) within the cloud network services architecture 400. This may take the form, for example, of a wide area network connection that communicatively couples the augmented reality safety inspection platform 600 with the access points 406 (see, FIG.4) which may be a cellular communications service. Similarly, communications managed by the c unications interface 614 may take the form, for example, of a local Wi-Fi network interface or Ethernet interface the communicatively couples the augmented reality safety inspection platform 600 with the Internet 434, local area network (LAN) 414, and ultimately the user device 700.
  • LAN local area network
  • the augmented reality safety inspection app 900 and/or the communications interface 614 may include a communications stack for facilitating communications over the respective communications link 436.
  • Electronic c ommunications by and through augmented reality safety inspection platform 600 between the various systems, networks, devices, users, entities, and/or individuals are facilitated by the communications links 436 in accordance with any number of well-known c unications protocols and methods (e.g., wireless communications).
  • FIG. 7 an illustrative user device 700 is shown for use with, illustratively, the augmented reality safety inspection platform 600 and the AR device 200 in accordance with an embodiment.
  • the user device 700 typically includes bus 702 and processor 704 coupled to the bus 702 for executing operations and processing information.
  • a “user device” in the context herein may comprise a wide variety of devices such as any type of hardware device, XR device, mobile devices, smartphones, laptop computers, desktop computers, tablets, kiosks, and wearable devices, to name just a few, that execute applications (e.g., a mobile application) in accordance with the principles of the disclosed embodiments herein.
  • the processor 704 may include both general and special purpose microprocessors, and may be the sole processor or one of multiple processors of the device. This is equally applicable to the processor 602 ofFIG.6. Further, the processor 704 (or the processor 602) may comprise one or more central processing units (CPU s) and may include, be supplemented by, or incorporated in, one or more application-specific integrated circuits (ASICs) and/or one or more field programmable gate arrays (FPGAs).
  • CPU s central processing units
  • ASICs application-specific integrated circuits
  • FPGAs field programmable gate arrays
  • the user device 700 may also include memory 706 coupled to the bus 702 for storing computer-readable instructions to be executed by the processor 704.
  • the memory 706 may also be utilized for storing temporary variables or other intermediate information during the execution of the instructions by the processor 704.
  • the user device 700 may also include ROM 708 or other static storage device coupled to the bus 702.
  • datastorage device 710 such as a magnetic, optical, or solid-state device may be coupled to the bus 702 for storing information and instructions for the processor 704 including, but not limited to, the augmented reality safety inspection app 900.
  • Data storage device 710 (or the data storage device 610) and the memory 706 (and the memory 606) may each comprise a non-transitory computer readable storage medium and may each include high-speed random access memory, such as dynamic random access memory (DRAM), static random access memory (SRAM), double data rate synchronous dynamic random access memory (DDR RAM), or other random access solid state memory devices, and may include non-volatile memory, such as one or more magnetic disk storage devices such as internal hard disks and removable disks, magneto-optical disk storage devices, optical disk storage devices, flash memory devices, semiconductor memory devices, such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), compact disc read- only memory (CD-ROM), digital versatile disc read-only memory (DVD-ROM) disks, or other non-volatile solid state storage devices.
  • DRAM dynamic random access memory
  • SRAM static random access memory
  • DDR RAM double data rate synchronous dynamic random access memory
  • non-volatile memory
  • the user device 700 may also include one or more communications interface 716 for communicating with other devices via a network (e.g., a wireless c unications network) or communications protocol (e.g., Bluetooth®).
  • a network e.g., a wireless c unications network
  • communications protocol e.g., Bluetooth®
  • such communication interfaces may be a receiver, transceiver, or modem for exchanging wired or wireless communications in any number of well-known fashions.
  • the communications interface 716 (or the communications interface 614) may be an integrated services digital network (ISDN) card or modem/router used to facilitate data communications of various well-known types and formats.
  • ISDN integrated services digital network
  • the communications interface 716 (or the com unications interface 614) may be a LAN card used to provide data communication connectivity to a comparable LAN.
  • Wireless communication links may also be implemented.
  • the GPS transceiver 718 and antenna 720 facilitate delivery of location-based services in order to register the exact location of the user device 700, for example, as the user roams from one location to another location.
  • the application herein will be able to track individual users and their location (and proximities to other locations) upon the launching of the application thereby enabling the well understood GPS location features of the user device 700 (e.g., a smartphone).
  • the functionality of the communications interface 716 is to send and receive a variety of signals (e.g., electrical, optical, or other signals) that transmit data streams representing various data types.
  • the user device 700 may also include one or more input/output devices 714 that enable user interaction with the user device 700 such as a camera, display, keyboard, mouse, speakers, microphone, buttons, etc.
  • the input/output devices 714 may include peripherals, such as an NFC device (e.g., NFC reader), camera, printer, scanner (e.g., QR-code scanner), touchscreen display, etc.
  • the input/output devices 714 may include a display device such as a cathoderay tube (CRT), plasma monitor, liquid crystal display (LCD)monitor or organic light- emitting diode (OLED) monitor for displaying information to the user, a keyboard, and a pointing device such as a mouse or a trackball by which the user can provide input to the user device 700 or an associated display device, for example.
  • a display device such as a cathoderay tube (CRT), plasma monitor, liquid crystal display (LCD)monitor or organic light- emitting diode (OLED) monitor for displaying information to the user
  • LCD liquid crystal display
  • OLED organic light- emitting diode
  • FIG. 8 a flowchart of illustrative operations 800 for using augmented reality environments for performing safety inspections of and/or emergency response activities within a particular site, facility or other infrastructure in accordance with an embodiment. More particularly, at step 802, collecting a plurality of point cloud data sets specific to a site, each point cloud data set associated with a particular section of the facility or site. At step 804, storing each point cloud data set collected in a proximity data loader located proximate to the particular section of the facility or site associated therewith.
  • receiving the point cloud data set stored from the proximity data loader located proximate to the particular section of the facility or site At step 810, generating at least one 3D image using the point cloud data set received and at step 812, rendering a real-time view on an AR device of the facility or site comprising a combination of at least the real-time image with the at least one 3D image generated associated with the particular section of the facility or site.
  • FIG. 9 an illustrative architecture for the operation of the augmented reality safety inspection app 900 is presented in accordance with an embodiment.
  • the architecture may be used, illustratively, in conjunction with the cloud network services architecture 400, the augmented reality safety inspection platform 600, the mobile command center network 412, the AR device(s) 200 and/or the user device(s) 700 for launching and executing the augmented reality safety inspection app 900 and its associated operations.
  • the architecture for the operations of the augmented reality safety inspection app 900 provides several interfaces and engines used to perform a variety of functions such as the collection, aggregation, manipulation, processing, analyzing, verification, authentication, and display of applicable real-time information and data that are useful to realize the delivery of the augmented reality safety inspection operations of the disclosed embodiments. More particularly, data display interface module 918 and communications module 912 are used to facilitate the input/output aid display of electronic data and other information to, illustratively, the users (e.g., user 410-1 through user 410-N) employing the user device 700 (e.g., a touch screen of the user device 700) and executing the augmented reality safety inspection app 900.
  • the users e.g., user 410-1 through user 410-N
  • the user device 700 e.g., a touch screen of the user device 700
  • the data collection module 906 facilitates data gathering from the plurality of users and other third parties.
  • the location-based services module 920 provides for the delivery of location-based services in order for the geographic locations of the users to be identified and displayed (e.g., GPS locations) including with the site boundary areas, as detailed previously.
  • the communications module 912 will also facilitate communications by and through the augmented reality safety inspection platform 600, forexanple.
  • Execution engine 902 may be employed to deliver the augmented reality safety inspection services herein through the execution of the augmented reality safety inspection app 900.
  • the execution engine 902 will operate and execute, as further detailed herein below, with at least the following program modules: graphical user interface module 904, data collection module 906, on-site hardware and device module 908, user profile module 910, communications module 912, augmented reality safety inspection system operations module 914, 3D point cloud data administration and management module 916, data display intaface module 918, location-based services module 920, AR device module 922, user AR view administration and management module 924, user device module 926, mobile co nd center network module 928, and real-time images administration and management module 930.
  • program modules graphical user interface module 904, data collection module 906, on-site hardware and device module 908, user profile module 910, communications module 912, augmented reality safety inspection system operations module 914, 3D point cloud data administration and management module 916, data display intaface module 918, location-based services module 920
  • the graphical user interface module 904, data display interface module 918, and the communications module 912 are used to facilitate the input/output and display of electronic data and other information (e.g., a graphical user intaface) to, illustratively, the users (e.g., user 410-1 through user 410-N) employing their respective AR device 200 and/or user device 700 (e.g., a touch screen) and executing the augmented reality safety inspection app 900.
  • the data collection module 906 facilitates augmented reality safety inspection services information collection from the plurality of users (e.g., user 410-1 through user 410-N).
  • the data collection module 906 may also be used to collect a variety of augmented reality safety inspection services information from other virtual and/or electronic sources accessible via the Internet 434 and individual third party websites hosted thereon.
  • the operations executed by each and every of the foregoing modules are, for example, as discussed throughout this disclosure.
  • a “program,” “computer program,” “application,” or “software application” may include a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a servlet, a source code, an object code, a shared library/dynamic load library, and/or other sequence of instructions designed for execution on a computer system. Accordingly, the applications and programs, for example, may be written using any number of program I l lmi ing languages and/or executed on compatible platforms including, but not limited to, JavaScript, PHP (PHP: Hypertext Preprocessor), WordPress, Joomla, Laravel, React.js, Angular.js, and Vue.js.
  • Conputer readable program instructions for carrying out operations of the disclosed embodiments may be assembler instructions, instruction-set- architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
  • ISA instruction-set- architecture
  • machine instructions machine dependent instructions
  • microcode firmware instructions
  • state-setting data or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
  • the conputer readable program instructions may execute entirely on one or more standalone computers, partly on one or more standalone computers, as a stand-alone software package, partly on one or more standalone computers and partly on one or more remote computers, partly on one or more standalone computers and partly on one or more distributed computing environments (such as a cloud environment), partly on one or more remote computers and partly on one or more distributed conputing environments, entirely on one or more remote conputers or servers, or entirely on one or more distributed conputing environments.
  • Standalone computers, remote conputers, and distributed conputing environments may be connected to each other through any type of network or combination of networks, including LANs, wide area networks (WANs), through the Intenet (e.g., using an Internet Service Provider), or the connection may be made to external conputers.
  • LANs local area networks
  • WANs wide area networks
  • Intenet e.g., using an Internet Service Provider
  • Devices or system modules that are in at least general communication with each other need not be in continuous communication with each other, unless expressly specified otherwise.
  • devices or system modules that are in at least general communication with each other may com-municate directly or indirectly through one or more intermediaries.
  • any system components described or named in any embodiment or claimed herein may be grouped or sub-grouped (and accordingly implicitly renamed) in any combination or sub- combination as those skilled in the art can imagine as suitable for the particular application, and still be within the scope and spirit of the claimed embodimoits of the present invention.
  • a c ercial implemoitation in accordance with the spirit and teachings of the present invention may be configured according to the needs of the particular application, whereby any aspect(s), feature(s), ftmction(s), result(s), components), approach(es), or step(s) of the teachings related to any described embodiment of the present invention may be suitably omitted, included, adapted, mixed and matched, or improved and/or optimized by those skilled in the art, using their avoage skills and known techniques, to achieve the desired implemoitation that addresses the needs of the particular application.
  • embodiments of the disclosure may be practiced in network computing environments with many types of computer system configurations, including personal computers, handheld devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, icomputers, mainframe computers, and the like. Where appropriate, embodiments may also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (either by hardwired links, wireless links, or by a combination thereof) through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices. "Software” may refer to prescribed rules to operate a computer.
  • Examples of software may include code segments in one or more computer-readable languages; graphical and or/textual instructions; applets; pre-compiled code; interpreted code; compiled code; and computer programs.
  • a network is a collection of links and nodes (e.g., multiple computers and/or other devices connected together) arranged so that information may be passed firom one part ofthe network to another over muttiple links and through various nodes. Examples of networks include the Internet, the public switched telephone network, wireless co ' unications networks, computer networks (e.g., an intranet, an extranet, a local area network, or a wide area network), wired networks, and wireless networks.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical functions).
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration can be implemented by special purpose hardware- based systems that perform the specified functions or acts, or combinations of special purpose hardware and conputer instructions.
  • These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium pro-duce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • process steps, method steps, algorithms or the like may be described in a sequential order, such processes, methods and algorithms may be configured to work in alternate orders. In other words, any sequence or order of steps that may be described does not necessarily indicate a requirement that the steps be performed in that order. The steps of processes described herein may be performed in any order practical Further, some steps may be performed simultaneously.
  • social media as referred to herein inplies interactive computer-mediated technologies that facilitate the creation and sharing of information, ideas, career interests and other forms of expression via virtual co ities and networks.
  • the variety of stand-alone and built-in social media services currently available introduces challenges of definition; however, there are some common features such as social media are typically interactive Internet-based applications.
  • User-generated contort such as text posts or comments, digital photos or videos, and data generated through all online interactions, is the lifeblood of social media. Users create service- specific profiles for the website or app that are designed and maintained by the social media organization.
  • Social media facilitate the development of online social networks by connecting a user's profile with those of other individuals or groups.
  • Non-volatile media include, for example, optical or magnetic disks and other persistent memory.
  • Volatile media include dynamic random-access memory (DRAM), which typically constitutes the main memory.
  • Transmission media include coaxial cables, copper wire and fiber optics, including the wires that comprise a system bus coupled to the processor.
  • Transmission media may include or convey acoustic waves, light waves and electromagnetic emissions, such as those generated during radio frequency (RF) and infrared (IR) data communications.
  • RF radio frequency
  • IR infrared
  • Common forms of computer readable media and non-transitory media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, a RAM, a PROM, an EPROM, a FLASH-EEPROM, removable media, flash memory, a "memory stick", any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
  • Various forms of corrputer readable media may be involved in carrying sequences of instructions to a processor. For example, sequences of instruction may be delivered from RAM to a processor, may be carried over a wireless transmission medium, and/or may be formatted according to numerous formats, standards or protocols, such as Bluetooth, 4G, 5G
  • the method(s) described above may be executed or carried out by a conputing system including a non-transitory computer-readable storage medium, also described herein as a storage machine, that holds machine-readable instructions executable by a logic machine (Le., a processor or progra ble control device) to provide, implement, perform, and/or enact the above-described methods, processes and/or tasks.
  • a logic machine Le., a processor or progra ble control device
  • the state of the storage machine may be changed to hold different data.
  • the storage machine may include memory devices such as various hard disk drives, CD, or DVD devices.
  • the logic machine may execute machine-readable instructions via one or more physical information and/or logic processing devices.
  • the logic machine may be configured to execute instructions to perform tasks for a computer program.
  • the logic machine may include one or more processors to execute the machine-readable instructions.
  • the conputing system may include a display subsystem to display a graphical user interface (GUI), or any visual element of the methods or processes described above.
  • GUI graphical user interface
  • the display subsystem, storage machine, and logic machine may be integrated such that the above method may be executed while visual elements of the disclosed system and/or method are displayed on a display screen for user consumption.
  • the computing system may include an input subsystem that receives user input.
  • the input subsystem may be configured to connect to and receive input from devices such as a mouse, keyboard, or gaming controller.
  • a user input may indicate a request that certain task is to be executed by the computing system, such as requesting the computing system to display any of the above-described information or requesting that the user input updates or modifies existing stored information forprocessing.
  • a communication subsystem may allow the methods described above to be executed or provided over a computer network.
  • the communication subsystem may be configured to enable the computing system to communicate with a plurality of personal computing devices.
  • the communication subsystem may include wired and/or wireless communication devices to facilitate networked communication.
  • the described methods or processes may be executed, provided, or inplemented for a user or one or more computing devices via a computer program product such as via an application progra ming interface (API).
  • API application progra ming interface
  • the steps of the disclosed method(s) and the associated discussion herein above can be defined by the computer program instructions stored in a memory and/or data storage device and controlled by a processor executing the conputer program instructions. Accordingly, by executing the conputer program instructions, the processor executes an algorithm defined by the disclosed method.
  • the conputer program instructions can be inplemented as conputer executable code progr d by one skilled in the art to perform the illustrative operations defined by the disclosed methods.
  • any flowcharts, flow diagrams, state transition diagrams, pseudo code, program code and the like represent various processes which may be substantially represented in computer readable medium and so executed by a conputer, machine, or processor, whether or not such conputer, machine or processor is explicitly shown.
  • a conputer machine, or processor
  • One skilled in the art will recognize that an implementation of an actual conputer or computer system may have other structures and may contain other components as well, and that a high-level representation of some of the components of such a conputer is for illustrative purposes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un système et un procédé pour effectuer des inspections de sécurité et/ou des activités de réponse d'urgence dans un site particulier. Des chargeurs de données de proximité sont installés au niveau d'une section particulière à l'intérieur d'un site et associés à celle-ci et stockent un nuage de points tridimensionnel (3D), un ensemble de données spécifique à la section particulière associée. Des dispositifs de capture d'image 3D sont installés à un emplacement différent à l'intérieur du site pour capturer des images 3D en temps réel. Un dispositif de réalité augmentée (AR) porté par un utilisateur est configuré pour recevoir l'ensemble de données de nuage de points 3D à partir du chargeur de données de proximité lorsqu'un utilisateur traverse le site et une vue AR temporelle en temps réel du site est affichée. La vue AR en temps réel est une combinaison d'au moins une image 3D générée à l'aide de l'ensemble de données de nuage de points 3D et d'au moins une image 3D en temps réel du site à partir d'au moins l'un des dispositifs de capture d'image 3D.
PCT/US2023/036577 2023-01-20 2023-11-01 Plateforme d'inspection de sécurité à réalité augmentée Ceased WO2024155308A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202363440127P 2023-01-20 2023-01-20
US63/440,127 2023-01-20

Publications (1)

Publication Number Publication Date
WO2024155308A1 true WO2024155308A1 (fr) 2024-07-25

Family

ID=91956324

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/036577 Ceased WO2024155308A1 (fr) 2023-01-20 2023-11-01 Plateforme d'inspection de sécurité à réalité augmentée

Country Status (1)

Country Link
WO (1) WO2024155308A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190147655A1 (en) * 2017-11-13 2019-05-16 Rockwell Automation Technologies, Inc. Augmented reality safety automation zone system and method
US20220163959A1 (en) * 2016-05-09 2022-05-26 Strong Force Iot Portfolio 2016, Llc Intelligent vibration digital twin systems and methods for industrial environments

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220163959A1 (en) * 2016-05-09 2022-05-26 Strong Force Iot Portfolio 2016, Llc Intelligent vibration digital twin systems and methods for industrial environments
US20190147655A1 (en) * 2017-11-13 2019-05-16 Rockwell Automation Technologies, Inc. Augmented reality safety automation zone system and method

Similar Documents

Publication Publication Date Title
US12175614B2 (en) Recording the complete physical and extended reality environments of a user
US11877203B2 (en) Controlled exposure to location-based virtual content
US11948263B1 (en) Recording the complete physical and extended reality environments of a user
CN110954083B (zh) 移动设备的定位
Whitlock et al. Designing for mobile and immersive visual analytics in the field
US12020667B2 (en) Systems, methods, and media for displaying interactive augmented reality presentations
US20190019011A1 (en) Systems and methods for identifying real objects in an area of interest for use in identifying virtual content a user is authorized to view using an augmented reality device
CN113168231A (zh) 用于跟踪真实世界对象的移动以改进虚拟对象定位的增强技术
US20080301570A1 (en) Spaciotemporal graphical user interface for collaborative and secure information sharing
CN114236837A (zh) 用于显示交互式增强现实展示的系统、方法和介质
US20230353616A1 (en) Communication Sessions Between Devices Using Customizable Interaction Environments And Physical Location Determination
CN113196239A (zh) 对与在通信会话内所显示的对象相关的内容的智能管理
US11361664B2 (en) Integration of unmanned aerial system data with structured and unstructured information for decision support
US11699269B2 (en) User interface with augmented work environments
CN114270409A (zh) 在计算机生成现实记录中提供限制
US20230177776A1 (en) Systems and methods for enhanced augmented reality emulation for user interaction
US10466474B2 (en) Facilitation of communication using shared visual cue
Wani et al. Augmented reality for fire and emergency services
US12614348B2 (en) Incremental scanning for custom landmarkers
WO2024155308A1 (fr) Plateforme d'inspection de sécurité à réalité augmentée
US9632673B1 (en) Cyber domain visualization systems and methods
US20230072623A1 (en) Artificial Reality Device Capture Control and Sharing
US12524939B1 (en) System and method of registering wireless tracking devices into a private network visual augmented reality view
Xie Sensing, Safeguarding, and Synergizing with AI for the Blind Community
Du Fusing multimedia data into dynamic virtual environments

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23917975

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23917975

Country of ref document: EP

Kind code of ref document: A1