WO2020043942A1 - Génération automatique d'une traversée en réalité virtuelle - Google Patents

Génération automatique d'une traversée en réalité virtuelle Download PDF

Info

Publication number
WO2020043942A1
WO2020043942A1 PCT/FI2019/050604 FI2019050604W WO2020043942A1 WO 2020043942 A1 WO2020043942 A1 WO 2020043942A1 FI 2019050604 W FI2019050604 W FI 2019050604W WO 2020043942 A1 WO2020043942 A1 WO 2020043942A1
Authority
WO
WIPO (PCT)
Prior art keywords
bim
interest
point
points
space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/FI2019/050604
Other languages
English (en)
Inventor
Juhani KORPINEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tridify Oy
Original Assignee
Tridify Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tridify Oy filed Critical Tridify Oy
Priority to EP19766058.2A priority Critical patent/EP3844724A1/fr
Publication of WO2020043942A1 publication Critical patent/WO2020043942A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20—Instruments for performing navigational calculations
    • G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design

Definitions

  • the present invention relates to a method, a system and a computer program product related to virtual reality. More particularly, the present invention relates to automated generation of a virtual reality walkthrough based on building information model data.
  • Building Information Modeling also referred to as Building Information Model, is a digital representation of physical and functional characteristics of a facility.
  • a BIM is a shared knowledge resource for information about a facility forming a reliable basis for decisions during its life -cycle.
  • a BIM involves representing a design as combinations of objects that carry their geometry, relations and attributes. However, BIM goes beyond planning and design, extending throughout the building life cycle.
  • IFC Industry Foundation Classes
  • IfcProduct is an IFC base class that represents occurrences in space, such as physical building elements and spatial locations.
  • IFC relationships (IfcRelationship) capture relationships among objects. IFC relationships may indicate a whole-part relationship having exclusive containment, such as subdividing a building into floors and rooms.
  • IFC product is a base class for any physical objects, and may be subdivided into spatial elements, physical elements, structural analysis items and other concepts. Products may have associated materials, shape representations, and placement in space. Spatial elements comprise for example sites (IfcSite), buildings (IfcBuilding), building storeys (IfcBuildingStorey) and spaces (IfcSpace) such as apartments or rooms. Physical building elements comprise for example walls (IfcWall), beams (IfcBeam), doors (IfcBeam), windows (IcfWindow), stairs (IfcStair) and so on. Various connectivity relationships may be used for IFC products, such as walls having openings filled by doors or windows.
  • IFC products may also have placement, which can be defined locally (IfcLocalPlacement) in relation to an enclosing element, or in a grid (IfcGridPlacement) relative to a grid with user-defined axes.
  • Physical elements may have defined materials, with optional properties such as mechanical, thermal properties and styles, such as colors and textures.
  • BIM standards are for example various national standards such as CIS/2 standard by American Institute of Steel Construction, BuildingSmart Flong Kong, Virtual Design and Construction (VDC) in India, and a variety of national BIM implementations such as ONORM A6241 in Austria and building transition digital plan (PTNB) in France, to name a few.
  • CIS/2 standard by American Institute of Steel Construction, BuildingSmart Flong Kong, Virtual Design and Construction (VDC) in India
  • VDC Virtual Design and Construction
  • PTNB building transition digital plan
  • a virtual walkthrough also referred to as a virtual tour, is a simulation of a location or facility, usually composed of a sequence of videos or still images.
  • a virtual walkthrough enables for example a buyer of a house or a flat to virtually experience the property even if it only exists on a drawing table or is still in early phase of construction.
  • a modern version of a virtual walkthrough comprises 360° images, which enable the viewer to explore the facility without being at the location, for example online.
  • Patent application US 20160300392 A1 discloses systems, media, and methods for providing virtual reality tours.
  • a user selects one or more vantage points on a 2D floorplan, and the system generates a virtual reality tour based on the 2D floorplan, vantage point coordinates and associated virtual reality content.
  • An object is to provide a method and apparatus so as to solve the problem of automating creation of virtual walkthroughs.
  • the objects of the present invention are achieved with a method according to the characterizing portion of claim 1.
  • the objects of the present invention are further achieved with a computer program product according to the characterizing portion of claim 10, a computer readable medium according to the characterizing portion of claim 11 and a virtual reality walkthrough generation system according to the characterizing portion of claim 12.
  • the preferred embodiments of the invention are disclosed in the dependent claims.
  • the present invention is based on the idea of automating calculation of navigation points needed for the virtual walkthrough and 360° images needed for generation of the virtual walkthrough.
  • the present invention has the advantage that the automatic virtual walkthrough generation is fully automated, which allows providing the entire generation of a virtual walkthrough for example as a web service.
  • the customer simply uploads relevant BIM data for the service, and in response receives an automatically generated full virtual walkthrough.
  • a computer-implemented method for automatically generating a virtual reality walkthrough based on Building Information Model (BIM) data comprises obtaining serialized BIM data, finding a plurality of BIM space elements among the serialized BIM data and automatically selecting a plurality of points of interest, wherein each point of interest represents a location in one of the plurality of BIM space elements.
  • the method also comprises calculating a viewpoint for each point of interest, rendering a 360° image from each of the viewpoints and associating the rendered 360° image with the respective one of the plurality of points of interest.
  • the method also comprises locating one or more openings associated to each of the plurality of BIM space elements, identifying adjacent BIM space elements that are connected to the respective BIM space element through via the openings and placing a navigation point at each opening connecting adjacent BIM space elements.
  • a navigation mesh is calculated, the navigation mesh comprising the plurality of points of interest and the plurality of navigation points placed at the locations of the openings connecting BIM space elements.
  • a virtual reality walkthrough data object is combined for the plurality of BIM space elements, the virtual reality walkthrough data object comprising the navigation mesh and any one of the 360 images and links to the 360 images. The virtual reality walkthrough data object is stored.
  • the selecting of the points of interest for a BIM space element comprises, if a size measure of the BIM space element is above a first threshold value but below a second threshold value, calculating a geometrical center of a floor of a plurality of the BIM space elements, and placing the respective point of interest at the calculated geometrical center of the respective BIM space element; if the size measure of the BIM space element is above a second threshold value, defining a grid with a predefined cell size, calculating a geometrical center for a plurality of cells of the grid overlapping the BIM space element, and placing a plurality of points of interest at the calculated geometrical centers of the overlapping cells, and if the size measure of the BIM space element is below the first threshold value, not placing any point of interest.
  • a point of interest is placed at a cell if size measure of an overlapping section of the BIM space element and the respective cell of the grid exceeds a third threshold value.
  • the third threshold value is equal to the first threshold value.
  • the size measure is any one of volume, area, diameter and length of at least one side of an area.
  • the rendering the 360° image comprises placing a 360° image probe at a predetermined height above the point of interest, and calculating at least one of a 2D 360° image and a 3D 360° image on basis of BIM data of physical building elements connected to the BIM space element associated with the point of interest.
  • the locating one or more openings comprises identifying an BIM product associated with the respective BIM space element that has an opening associated with it and obtaining coordinates of the opening connecting BIM space elements from BIM data.
  • the method further comprises identifying a plurality of information points based on selected BIM elements comprised the serialized BIM data, associating each information point with a location in the space, including the information points in the navigation mesh, and storing the plurality of information points in the virtual reality walkthrough data object.
  • a computer program product for automatically generating a virtual reality walkthrough from Building Information Model (BIM) data is provided, wherein the computer program product is configured to perform the computer-implemented method steps according to any one of the first to eighth aspect.
  • BIM Building Information Model
  • a computer readable medium having stored thereon a computer program product according to the above aspect.
  • a virtual reality walkthrough generation system that generates a virtual reality automatically based on Building Information Model (BIM) data by carrying out the computer- implemented method according to any one of the first to eighth aspect.
  • BIM Building Information Model
  • a computer program product having instructions which, when executed by a computing device or system cause the computing device or system to perform a method according to any one of the first to eighth aspect.
  • Figure 1 shows an exemplary BIM space element diagram of an apartment as a 2D floor plan.
  • Figure 2 illustrates a high-level flow chart of an automatic virtual reality (VR) walkthrough generation service.
  • VR virtual reality
  • Figure 3 illustrates first phases of the method of automatic generation of a virtual walkthrough.
  • Figure 4 illustrates an example of a BIM space element for which a plurality of points of interest are to be defined.
  • Figure 5 is a flow chart illustrating phases of a method related to handling relationships of the BIM space elements via openings.
  • Figure 6 illustrates phases of the method of automatic generation of a virtual walkthrough.
  • Figure 7 illustrates features of a navigation mesh on top of a perspective view of a flat.
  • Figure 8 illustrates a system, in particular a computer system. Detailed description
  • Navigation point is a point or node by pointing which a user can navigate to a node of a navigation mesh.
  • a navigation point also refers to coordinates of a navigation button to a neighboring point of interest that is connected via the navigation mesh. Coordinates of the navigation points may be automatically calculated from IFC data.
  • a navigation mesh is a network that declares all possible navigation routes.
  • a navigation mesh may comprise navigation points, points of interest and information points.
  • a navigation route refers to a virtual walk through path from node to node.
  • An information point refers an IFC element about which information is to be shown and also the coordinates for the information button.
  • space element and BIM space element refer to a space element defined in any type of BIM data.
  • a space element or a BIM space element may be an IFC Space Element (IfcSpace).
  • a BIM space element may refer for example to an apartment or a room.
  • the terms space element and BIM space element may be used alternatively.
  • the figure 1 shows an exemplary, simplified space element diagram of an apartment shown as a 2D floor plan.
  • the exemplary space comprises an apartment space element (100) that comprises three room space elements (101).
  • the space elements (100, 101) may be associated with walls that have openings (103).
  • the space elements (100, 101) are spatial elements, and they are associated with physical elements such as walls, beams, doors, windows, stairs and so on.
  • the openings define connectivity relationships between space elements (100, 101), and represent for example doorways, doors and/or windows. Some of the openings are associated with two adjacent room space elements, thus connecting the rooms, while others may connect a room towards outside.
  • At least one point of interest (104) may be defined for at least some of the space elements (100, 101).
  • the point of interest (104) represents coordinates of a navigation point in the space element.
  • the point of interest is disposed on the floor of the respective space element. If the point of interest is on the floor, above the point of interest (104) a view point is defined, at which a 360° image of the respective space is to be rendered.
  • the rendered 360° image is, as the name defines, a 360-degree rendered image from the view point associated with the respective point of interest, which is wrapped around a sphere to enable the viewer to virtually look at any direction around him/her from the point of view.
  • the location of a point of interest may be expressed in cartesian (XYZ) coordinates.
  • the x- and y-coordinates of the point of interest are preferably defined so that the point of interest (104) resides within the space element (101).
  • the z-coordinate, in other words the vertical height, of the point of interest may be defined so that it resides at the floor level of the space element.
  • the associated view point is preferably placed on a predefined height above the point of interest.
  • the point of interest (104) may be defined to be disposed at a predefined height, in other words at a vertical distance above the floor level of the space element (101). In the latter case, the point of interest (104) and the respective associated view point may be collocated.
  • FIG. 2 illustrates a high-level flow chart of a service that is enabled by the disclosed method of automatic generation of a virtual reality (VR) walkthrough.
  • the service may be entirely web based, in which a user uploads BIM data to the service and, in return, receives an automatically generated VR walkthrough, which may be provided as a single data object.
  • the VR walkthrough may also comprise a plurality of data objects, that also comprise 360° images and for example audiovisual elements. Such additional elements may be originally linked to BIM data, and these may also become linked or included in the VR walkthrough.
  • the service may begin with receiving BIM data from the user in the phase 201.
  • the BIM data may be provided in various forms. If the BIM data received from the user is not in serial form, it may be first serialized in the phase 202. If the BIM data is received in serial form, there is no need for serializing, and phase 202 may be omitted.
  • the VR walkthrough is automatically generated in the method described in short as phase 203, which method will be described in more detail in relation to following figures 3, 5 and 6.
  • the automatically generated VR walkthrough is stored in the phase 204 to a web server, at which the VR walkthrough is available for the user and may be used for example by a user application running either on the web server or at a user device.
  • Figure 3 illustrates first phases of the method of automatic generation of a virtual walkthrough.
  • the automated method utilizes serialized BIM data.
  • Serialized BIM data (300) is then received as input to the method.
  • Serializing BIM data refers to a process of translating data structures or object state into a format comprising a series of bytes that can be stored or transmitted and reconstructed later.
  • a repeating process is then performed to identify a plurality of space elements in the serialized BIM data. Each round of the process starts with finding a space element in the serialized BIM data in the phase 301. If the serialized BIM data comprises IFC data, the found space element may be an IfcSpace element.
  • the process ends in step 307. This may occur when all space elements in the data have been handled in the process, or if no space element is found in the BIM data.
  • the found space element is tested against at least one pre-defined selection rule in the phase 303.
  • a selection rule may define that the plurality of space elements simply comprises all space elements comprised in the serialized BIM data, or the selection rule or a combination of selection rules may cause only part of all space elements to be selected. If the currently identified space element does not fulfill the selection rule(s), the process returns to step 301, and next space element is looked for in the serialized BIM data.
  • Testing the space element against selection rules in the phase 303 and selection of space elements in the phase 304 can be fully automatic, while predefined rules for the selection of space elements may be defined to control the automated process of selecting the space elements. For example, only space elements of a certain type or types of space, such as room space elements, may be selected. Size of the space may be used as a selection rule. For example, space element having a size measure below a first threshold value may be excluded from selection. The size measure and the first threshold value may be defined by area, in particular the floor area, of the space element, so that the first threshold defines a minimum area of a space element to be selected to be subject to next steps of the method.
  • the size measure may comprise volume of the space element, diameter of the space element (100, 101) via a computed middle point of the space or between two opposite corners of the floor of the space element, or the size measure may be defined as a length of at least one side of the floor of the space element (100, 101).
  • more complex selection criteria may be defined as any combination of the above-mentioned size measures and the respective first threshold values.
  • At least one point of interest (104) is calculated automatically for the space element in the phase 305.
  • a geometrical center of the floor of the space element is calculated, and the point of interest (104) is placed at the calculated geometrical center.
  • the point of interest, above which an 360° image probe is to be disposed is located on the floor of the space element, and a view point is defined at a predefined height above the floor level of the space element so that the 360° image view corresponds to that of an average person if he would actually stand on the floor of the respective space.
  • each point of interest is defined at the respective view point.
  • the point of interest is disposed above the floor level of the space element at a predefined height.
  • the point of interest and the respective view point are located in the same location in the cartesian XYZ-coordinates.
  • the space element information may comprise information on the area of a room represented by the space element. If the size of the space element exceeds a predefined first threshold value, at least one point of interest is calculated for a space element.
  • a plurality of points of interest may be calculated for a single space element. This will be described later in connection with figure 5.
  • Each automatically calculated point of interest (104) has a defined location in the space defined by the space elements that may be defined with three-dimensional coordinates, for example cartesian coordinates. All calculated points of interest and their coordinates are stored, so that they can be later used for example in generation of a navigation mesh.
  • the points of interest are stored in a database.
  • a 360° image is rendered for it in the phase 306.
  • Rendering a 360° image is, as such, known technology.
  • 360° image associated to a point of interest may be rendered from a view point vertically above the respective point of interest. If the point of interest is readily defined at a convenient view height, the 360° image may be rendered at the point of interest.
  • the height of the view point and/or the height of the point of interest above the floor plane of the space element may be adjusted via setting a parameter value for the automatic calculation algorithm.
  • any IFC data related to physical objects associated with the space element may be utilized for rendering the 360° image.
  • the physical elements, their placement, shape and materials may be utilized for 360° image rendering.
  • the rendered 360° image is stored.
  • the rendered 360° image is stored in a database.
  • the database may be a dedicated image database, or the same database may be used that is used for storing all data related to the virtual reality walktrough, including but not limited to the points of interest.
  • the location of the rendered 360° image in the database is also stored to enable establishment of a link between the 360° image and the respective point of interest.
  • Some identified space elements may be left without any points of interest if they do not fulfill selection criteria in the phase 303. Further, some space elements that initially fulfill the selection criteria in the phase 303 may fail in calculation of point of interest for various reasons. In such cases, no point of interest is calculated for the space element, and no 360° image is rendered.
  • the process of finding space components in the serialized BIM data is repeated until no more new space elements are found in the serialized BIM data. This is illustrated with the decision box phase 302 in which it is checked whether there are more space elements in the serialized BIM data to be processed. If, based on the checking in the phase 302, there are more space elements found, the process will continue with performing the phase 303. If there are no more space elements in the serialized BIM data, the process stops in the phase 307.
  • a plurality of points of interest (104) may be calculated, each representing a location in one of the plurality of space elements comprised in the serialized BIM data, and a respective 360° image has been rendered and stored for each of the plurality of points of interest.
  • All points of interest (104) may be calculated automatically on basis of the spaces defined by the BIM data, and a 360° image is automatically rendered for all of them also using the BIM data. All this can be done on basis of the serialized IBM data without requiring any manual steps in the process.
  • Various parameters of the BIM data may be utilized in the rendering process. If BIM data comprises IFC data, a non-limiting list of IFC parameters that may be used in the rendering comprises IfcMaterial Properties, IfcLightFixtureType, IfcSite and/or IfcGeometricRepresentationContext. Any method for 360° image rendering known in the art may be utilized.
  • Figure 4 illustrates an example of a space element for which a plurality of points of interest are to be defined.
  • a space element may be elected for defining a plurality of points of interest if it fulfills a size-based selection criterion.
  • size-based selection criterion may comprise a size measure of the space element.
  • a space element is elected for placement of multiple points of interest if the relevant size measure of the space element exceeds a second threshold value.
  • the size measure may comprise any one of volume of the space element, the area (floor area), diameter and length of at least one side of the floor of the space element.
  • a grid (120), illustrated with a dash dot lines, may be used for defining the locations of the plurality of points of interest.
  • Side length of the cells (121) and thus area of a cell of the grid (120) may be freely selected.
  • the side length of the cells (121) is defined by a parameter.
  • size of each cell (121) of the grid (120) equals to the minimum size of a space element that may be selected in the phases 303 and 304 to be included in the process steps for defining a point of interest.
  • the selected space element (101) that fulfills the size-based selection criteria for multiple points of interest is placed in the grid (120).
  • At least one criterion is defined for selecting which cells (121) of the grid are used for defining points of interest.
  • the criterion may comprise a selected size measure of the overlapping section of a cell (121) of the grid and the space element (101). Similar to selection rules defined for selecting space elements, the size measure may comprise for example area, diameter or length of at least one side, and the size measure may be correspondingly compared to a third threshold value.
  • the third threshold value may thus comprise a minimum area, minimum diameter or minimum length of at least one side of the overlapping section of a cell (121) of the grid and the space element (101).
  • the third threshold value is equal to the first threshold value so that a minimum section of a space element defined by the grid for which a point of interest to be generated has the same minimum size limit as a space element that is selected for receiving a single point of interest.
  • Further criteria may be defined for example on basis of walls within the section. For example, if the geometrical center of the cell (121) of the grid (120) falls outside the space element (101), the section may be omitted as point of interest. In the exemplary case of figure 4, six cells (121) of the grid with overlapping sections with the space element (101) have been selected on basis of the selection criteria, and thus six points of interest are defined in the geometrical center of the cells (121) for this particular space element (101).
  • the process also continues to another sub-process as illustrated with the connector "A" (400) in the figure 3.
  • the second sub-process is disclosed in more detail in connection with figure 5.
  • a second part of the method may also be started that defines relationships between found space elements. Phases of the method related to handling relationships of the space elements by openings are illustrated in the figure 5.
  • Each space element may have one or more openings (103) associated with it.
  • one or more openings associated with the space element are automatically found.
  • the opening(s) may be found in the BIM data.
  • an IFC space element may have an IfcOpeningElement defined for it.
  • the algorithm checks whether the opening represents a type of opening that is to be used. Typically, for virtual reality walkthrough purposes, openings that represents doors are selected for further processing, while other types of openings, such as windows or technical inlets intended for example for plumbing, air conditioning or like are omitted from further processing. Coordinates of the found opening are obtained in the phase 402. Coordinates may be obtained from BIM data either directly or by calculating a coordinate for the opening. For example, calculation of the coordinates of the opening may receive as input data known as Box Geometry of an IFC object, which represents dimension of the smallest box bounding the object. The obtained coordinates are preferably stored so that they may later be used.
  • any space elements connected to the opening are automatically found.
  • the opening connects two adjacent space elements.
  • the opening connects two space elements and the opening, more particularly the coordinates of the opening obtained in the phase 402, may thus be used as a navigation point between the two space elements. Openings which do not provide any connection between space elements may be omitted from further processing.
  • Handling of the openings acting as connections between space elements may be facilitated by naming the openings so that the particular opening has a name that indicates the names of the space element and the neighboring space element connected via the opening.
  • data on the openings including their names and coordinates may be stored in a database.
  • a name of the opening may be defined on basis of information found in the respective IfcSpaceElement.
  • the name of the opening may comprise the name of the space element into which the opening leads or names of the adjacent space elements that are connected by the opening.
  • the name of the opening is stored together with its coordinates. Similar to the coordinates of the points of interest, coordinates of the openings may be defined with three- dimensional coordinates, for example cartesian coordinates.
  • the method of finding openings is repeated as long as new openings are found that relate to the space element that is currently been handled. This is illustrated with the decision phase 405, in which it is checked whether there are more openings associated to the current space element. If there are more openings to be found, the process is repeated from the phase 401.
  • Figure 6 illustrates final phases of the method of automatic generation of a virtual walkthrough.
  • the final stages of the automated VR walkthrough generation process receive as input all the points of interest representing the plurality of space elements, coordinates of the points of interest and the respective rendered 360° images, the found openings, coordinates of the openings and information on which space elements are connected via the openings as illustrated by the connector "B" (500).
  • information points may be defined on basis of the BIM data and stored in the phase 501, which information points are to be shown in the appropriate VR view at a place that corresponds to coordinates of an IFC element.
  • Location of an information point may be defined based on location of the respective IFC element.
  • a rule or a ruleset may be defined for selecting which IFC elements are selected for generation of information points.
  • the rule or ruleset may comprise for example type of IFC element.
  • Data related to information points that will be shown to the user is stored in the database together with the coordinates of the information point, preferably cartesian coordinates, and all stored information points are included in the navigation mesh.
  • Information points may for example provide additional information on particular features of an IFC element.
  • an information point may give more technical or commercial details of a particular appliance, more detailed material information, information on possibility to make individual choices relating to this particular IFC element and so on.
  • the additional information comprised in the information point may be directly and automatically derived from the respective BIM data.
  • the user may receive the information available at the information point. Examples of the information provided by an information point are for example various details of household appliances or surface materials and/or colors of any item.
  • the phase of the method at which information points are defined may vary.
  • an information point may be defined and stored whenever an IFC element fulfilling a selection criterion for defining an information point is detected in the serialized BIM data. Only critical rule for defining information point is that as they should be defined and stored, thus available by calculating a navigation mesh.
  • the navigation mesh is calculated.
  • the navigation mesh is a mesh network that connects all points of interest, the openings connecting the respective space elements and the information points into a navigation network that enables navigating within the spaces defined by the space elements by moving between points of interest within the spaces.
  • a user of the VR walkthrough may point at any neighboring node of the navigation mesh to move between spaces in the VR walkthrough. For example, by pointing at a via node (a navigation point) residing at an opening in the 360° image of a space, the user may move into a point of interest in an adjacent space connected to the current space via the via node representing the opening.
  • a starting point is defined for the navigation mesh at the phase 503.
  • the starting point refers to a preselected node of the navigation mesh at which the user virtually resides when the VR walkthrough is initiated.
  • the starting point may be, for example, a space representing an entry hall of the apartment.
  • a virtual reality walkthrough data object is generated that comprises all VR walkthrough data found and calculated during the above method phases.
  • the virtual reality walkthrough data object thus combines all data created during the process into a VR walkthrough.
  • the virtual reality walkthrough data object comprises information on the navigation mesh, including points of interest and navigation points, as well as on information points, if such were defined, and links to the rendered 360° images associated with the respective points of interest.
  • the virtual reality walkthrough data object may further have a connection to the BIM data or to an external database, from which information may be obtained on basis of identifiers, such as a globally unique identifier (GUID).
  • GUID globally unique identifier
  • the virtual reality walkthrough data object which comprises data needed for running the VR walkthrough, is preferably stored in JavaScript Object Notation (JSON) format.
  • JSON is a lightweight data-interchange format that uses human-readable text to transmit data objects consisting of attribute-value pairs and array data types or any other serializable values, that is broadly utilized in web services.
  • Figure 7 illustrates features of a navigation mesh on top of a perspective view of an apartment.
  • the navigation mesh preferably comprises a plurality of points of interest (104) and a plurality of navigation points (605) that represent openings connecting spaces.
  • Two of the space elements (101-A, 101-B), representing two rooms of the apartment are marked in the figure.
  • Black two-ended arrows (608) between the points of interest (104) and navigation points (605) illustrate navigation mesh connections between the points of interest and navigation points over which the user of the VR walkthrough may virtually move around in and between the spaces.
  • the figure shows two information points (606).
  • Location of an information point (606) is defined by coordinates, such as cartesian coordinates, so that they may be placed in the navigation mesh and shown in the 360° image, so that any defined information points may be pointed and/or clicked at any 360° image view in which they are visible. Pointing and/or clicking an information point in the 360° image does not cause movement along the navigation mesh but provides additional information. For example, selecting an information point (606) may open a window in the virtual reality view that presents further information to the user.
  • a view point (610) illustrates a location from which a 360° image has been rendered for the associated point of interest (104).
  • a double-ended arrow (611) illustrates height of the view point above the floor level.
  • Similar view points are defined for all points of interest in the navigation mesh as disclosed above. Navigation between points of interest is possible either via navigation points or directly between points of interest. Especially, if a space includes multiple points of interest, it is possible to move between the points of interest directly for example by selecting, for example by pointing and/or clicking, another point of interest visualized in the current 360° image.
  • a BIM server (701) may store BIM data (700).
  • BIM data (700) may be stored in any applicable form.
  • the BIM data (700) may comprise serialized BIM data. If the BIM data is not serialized, the BIM server may be configured to serialize BIM data, or the BIM data may be serialized by the VR walkthrough generation apparatus (702).
  • the BIM server is communicatively connected to an VR walkthrough generation apparatus (702), which is configured to perform the steps of the method of automatically creating a VR walkthrough from the serialized BIM data as disclosed above.
  • the VR walkthrough generation apparatus (702) may be implemented in a physical or virtual server or a network of physical or virtual servers running computer software that performs the method steps.
  • the VR walkthrough generation apparatus (702) has a defined application programming interface (API) towards a web server (703).
  • API application programming interface
  • the virtual reality walkthrough data object may be provided to the web server over the API.
  • the virtual reality walkthrough data object is a JSON data object and it comprises the navigation mesh and all the 360° images of the VR walkthrough, or links to the 360° images.
  • a client application (704) residing at a client computer capable of reading JSON data objects and representing 360° images in one way or another may then contact the web server (703) for running the VR walkthrough.
  • the client application may be a browser application that shows a 2D view of the 360° image at its display.
  • the client application may be a virtual reality application that is capable of showing 360° images as 3D images for example via a 3D display.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention concerne un procédé, un système et un produit-programme d'ordinateur permettant de générer automatiquement une traversée en réalité virtuelle sur la base de données d'un modèle d'informations de bâtiment (BIM). Une pluralité d'élément d'espace sont trouvés parmi des données sérialisées du BIM. Une pluralité de points d'intérêt sont automatiquement sélectionnés, chaque point d'intérêt représentant un emplacement dans un élément d'espace de la pluralité des éléments d'espace. Un point de vue est calculé pour chaque point d'intérêt et une image à 360 degrés est rendue à partir du point de vue qui est associé à un point d'intérêt respectif de la pluralité des points d'intérêt. Une ou plusieurs ouvertures associées à chaque élément d'espace de la pluralité des éléments d'espace sont localisées, et des éléments d'espace adjacents qui sont connectés à l'élément d'espace respectif via les ouvertures sont identifiés. Un point de navigation est placé à chaque ouverture connectant des éléments d'espace adjacents. Une grille de navigation comprenant la pluralité des points d'intérêt et la pluralité des points de navigation est calculée. Un objet de données de traversée en réalité virtuelle est combiné, l'objet de données comprenant la grille de navigation et des liens vers les images à 360 degrés, et l'objet de données est stocké pour une utilisation future.
PCT/FI2019/050604 2018-08-30 2019-08-27 Génération automatique d'une traversée en réalité virtuelle Ceased WO2020043942A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP19766058.2A EP3844724A1 (fr) 2018-08-30 2019-08-27 Génération automatique d'une traversée en réalité virtuelle

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FI20185717A FI20185717A1 (en) 2018-08-30 2018-08-30 Automatic generation of virtual reality review
FI20185717 2018-08-30

Publications (1)

Publication Number Publication Date
WO2020043942A1 true WO2020043942A1 (fr) 2020-03-05

Family

ID=67909414

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/FI2019/050604 Ceased WO2020043942A1 (fr) 2018-08-30 2019-08-27 Génération automatique d'une traversée en réalité virtuelle

Country Status (3)

Country Link
EP (1) EP3844724A1 (fr)
FI (1) FI20185717A1 (fr)
WO (1) WO2020043942A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025065343A1 (fr) * 2023-09-27 2025-04-03 中交第四航务工程勘察设计院有限公司 Procédé et système de simulation de processus de construction d'ingénierie hydraulique

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111460542B (zh) * 2020-04-03 2023-08-01 湖南翰坤实业有限公司 一种基于bim和vr的建筑设计图纸处理方法和系统
CN112507427B (zh) * 2020-11-30 2022-12-06 同济大学建筑设计研究院(集团)有限公司 Eicad与ifc的路线数据自动转换方法、介质及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020113805A1 (en) * 2001-01-02 2002-08-22 Jiang Li Image-based walkthrough system and process employing spatial video streaming
JP2006048278A (ja) * 2004-08-03 2006-02-16 Fukui Computer Kk 移動経路設定装置、移動経路設定プログラム
WO2010052548A2 (fr) * 2008-11-05 2010-05-14 Easywalk Capital S.A. Système et procédé de création d'applications interactives de visite virtuelle panoramique
US20160300392A1 (en) 2015-04-10 2016-10-13 VR Global, Inc. Systems, media, and methods for providing improved virtual reality tours and associated analytics

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020113805A1 (en) * 2001-01-02 2002-08-22 Jiang Li Image-based walkthrough system and process employing spatial video streaming
JP2006048278A (ja) * 2004-08-03 2006-02-16 Fukui Computer Kk 移動経路設定装置、移動経路設定プログラム
WO2010052548A2 (fr) * 2008-11-05 2010-05-14 Easywalk Capital S.A. Système et procédé de création d'applications interactives de visite virtuelle panoramique
US20160300392A1 (en) 2015-04-10 2016-10-13 VR Global, Inc. Systems, media, and methods for providing improved virtual reality tours and associated analytics

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CHEN S E ED - O'CONNELL K: "QUICKTIME(R) VR - AN IMAGE-BASED APPROACH TO VIRTUAL ENVIRONMENT NAVIGATION", COMPUTER GRAPHICS PROCEEDINGS. VISUAL PROCEEDINGS: ART AND INTERDISCIPLINARY PROGRAMS OF SIGGRAPH '95 LOS ANGELES, AUG. 6 - 11, 1995; [COMPUTER GRAPHICS PROCEEDINGS (SIGGRAPH)], NEW YORK, ACM, US, 1 January 1995 (1995-01-01), pages 1 - 10, XP002913617, ISBN: 978-0-89791-702-5 *
ROBERT GRAF ET AL: "Automatic Walkthrough Utilizing Building Information Modeling to Facilitate Architectural Visualization", 31 December 2008 (2008-12-31), pages 555 - 560, XP055638873, Retrieved from the Internet <URL:https://cumincad.architexturez.net/system/files/pdf/ecaade2008_077.content.pdf> [retrieved on 20191105] *
WEI YAN ET AL: "Integrating BIM and gaming for real-time interactive architectural visualization", AUTOMATION IN CONSTRUCTION, ELSEVIER, AMSTERDAM, NL, vol. 20, no. 4, 4 November 2010 (2010-11-04), pages 446 - 458, XP028194610, ISSN: 0926-5805, [retrieved on 20101113], DOI: 10.1016/J.AUTCON.2010.11.013 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025065343A1 (fr) * 2023-09-27 2025-04-03 中交第四航务工程勘察设计院有限公司 Procédé et système de simulation de processus de construction d'ingénierie hydraulique

Also Published As

Publication number Publication date
FI20185717A1 (en) 2020-03-01
EP3844724A1 (fr) 2021-07-07

Similar Documents

Publication Publication Date Title
Hong et al. Semi-automated approach to indoor mapping for 3D as-built building information modeling
CN109408044B (zh) 一种基于glTF的BIM数据与GIS数据的整合方法
CN118278094B (zh) 基于数据库的建筑三维模型计算方法及系统
Fisher-Gewirtzman et al. Voxel based volumetric visibility analysis of urban environments
CN110069840B (zh) 室内三维语义模型的构建方法及装置
WO2020043942A1 (fr) Génération automatique d&#39;une traversée en réalité virtuelle
CN111047392B (zh) 一种构建数字化店铺的系统、方法及存储介质
CN114417458B (zh) 一种基于cim技术的建设项目在线多维报建协同系统
CN114095716A (zh) 基于bim技术与gis技术的监控摄像机三维仿真方法及系统
CN110647610B (zh) 一种电力系统可视化平台的构建方法和装置
CN107665500A (zh) 使用实时渲染技术的内部设计系统
Ng et al. Syntable: A synthetic data generation pipeline for unseen object amodal instance segmentation of cluttered tabletop scenes
CN107704483A (zh) 一种三维模型的加载方法
Ding et al. Irregularity inspection using neural radiance field
CN107481306B (zh) 一种三维交互的方法
CN118235165A (zh) 用于从点云创建用于数字孪生的3d模型的方法和系统
Hernández et al. An IFC-based interoperable framework for building linked-data.
US12346636B2 (en) Computer aided modeling and interactions with different models
CN116977787A (zh) 训练场景生成方法、装置、电子设备和可读存储介质
De Amicis et al. Geo-visual analytics for urban design in the context of future internet
Cheng Algorithm of CAD surface generation for complex pipe model in Industry 4.0 background
Tutzauer et al. A study of the human comprehension of building categories based on different 3D building representations
Liu et al. Semi-automated processing and routing within indoor structures for emergency response applications
CN107688599B (zh) 一种快速检索三维模型的方法
Elsafty Advancing residential building assessment: an integrated approach using laser scanning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19766058

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019766058

Country of ref document: EP

Effective date: 20210330