WO2023242147A1 - Schweissschulungsanordnung zur durchführung eines virtuellen handschweissvorganges - Google Patents
Schweissschulungsanordnung zur durchführung eines virtuellen handschweissvorganges Download PDFInfo
- Publication number
- WO2023242147A1 WO2023242147A1 PCT/EP2023/065706 EP2023065706W WO2023242147A1 WO 2023242147 A1 WO2023242147 A1 WO 2023242147A1 EP 2023065706 W EP2023065706 W EP 2023065706W WO 2023242147 A1 WO2023242147 A1 WO 2023242147A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- training
- welding
- virtual
- mixed reality
- workpiece
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/24—Use of tools
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Definitions
- the present invention relates to a welding training arrangement and a method for carrying out a virtual manual welding process.
- Welding is the most important joining process in modern production technology and plays an essential role in a variety of modern production and manufacturing processes.
- An example is the production of modern means of transport, such as motor vehicles, railways or aircraft, which is unthinkable without modern and high-precision welding technology.
- robot welding at least partially automated welding processes (“robot welding”) are increasingly being used in welding technology, which can save time and resources in many cases.
- manual welding a hand welder carries out the required welding work by manually moving a hand welding torch.
- manual welding is divided into different manual welding processes depending on the type of materials used, such as E-manual welding (electrode welding), TIG welding (tungsten inert gas welding), MIG welding (metal inert gas welding) or MAG -Welding (metal active gas welding).
- Welding training arrangements and the so-called “virtual welding” that can be carried out with them make it possible to realistically simulate complex welding tasks and difficult situations safely and cost-effectively and to practice them again and again.
- a welding training arrangement for virtual welding trainee manual welders can learn and train basic welding skills/hand skills on common training workpieces.
- virtual welding can save expensive consumables such as training components made of different metals/steels/alloys (and their sometimes complex preparation), wire and/or shielding gas and energy.
- the basic components of a welding training arrangement are a training handheld welding torch, a training workpiece, a welding simulator and an electronic display (electronic screen).
- the training hand welding torch is moved along the training workpiece.
- the welding simulator determines a so-called virtual weld seam, which is shown on the display.
- the specific design in particular regarding the recording of the movement data of the training hand welding torch or the representation of the virtual weld seam on the display, can be done in different ways. The state of the art offers a variety of approaches to this.
- US 2020/0265750 A1 describes a welding training system in which markers are attached to the training workpiece and the training hand welding torch.
- markers are recorded using RGB cameras, i.e. optical cameras.
- EP 2863376 A1 describes approaches to simulating different welding processes (MIG, MAG), with the results of these simulations being shown on the display of video glasses as part of an augmented reality (“AR”) approach. This will be the case The outside world is captured by one or more cameras and a so-called mixed reality (real and virtual images are superimposed on each other) is displayed to the hand welder.
- MIG welding processes
- AR augmented reality
- WO 2020/167812 A1 describes a welding helmet that can be used in virtual manual welding processes.
- the welding helmet includes an electronic screen, i.e. an electronic display, and several cameras (RGB (optical), thermal image, infrared).
- RGB optical
- WO 2020/167812 A1 also teaches markings that are attached to the training workpiece and the training hand welding torch. The markings are captured by an optical camera for object recognition and object tracking.
- the US 2021/0158724 A1 describes camera sensors, each with several adjustable lenses, filters and other optical components for carrying out a welding training simulation.
- An analysis of the sensor data recorded with the camera sensors which can describe, among other things, markers for identifying objects, is disclosed in order to determine the position, orientation and movement of the training workpieces and the training hand welding torches from these sensor data.
- Welding training arrangements known from the prior art preferably use RGB cameras (optical cameras) for object recognition and object tracking, and usually the same RGB camera that is also used to record the field of view (partly also referred to as the field of view) of the manual welder.
- RGB cameras optical cameras
- RGB camera optical cameras
- This circumstance results in several disadvantages.
- only components that are in the field of view of the manual welder i.e. in the field of view of the RGB camera
- the tracking area is therefore limited by the gaze of the manual welder. This can cause problems if the manual welder wants to view a training workpiece from different angles.
- a manual welder In state-of-the-art welding training arrangements, a manual welder must also maintain a minimum distance from the given training workpieces during virtual welding. In the case of tracking carried out with RGB cameras, maintaining a minimum distance is necessary in order to always be able to capture a sufficiently large area of the objects to be tracked. This requirement can sometimes significantly limit the applicability of a welding training arrangement.
- RGB camera which simultaneously tracks objects and captures the field of view of a manual welder, cannot be expanded arbitrarily. Attempts to this end, for example using wide-angle lenses such as Fisheye lenses have shown that the use of such lenses can cause dizziness and discomfort in manual welders. Tracking based on RGB cameras is also often dependent on the given lighting conditions, which can sometimes result in significant malfunctions when lighting conditions change.
- the independent claims describe a welding training arrangement and a method for carrying out a virtual welding process on the welding training arrangement according to the invention.
- the welding training arrangement has a training workpiece and a movable training hand welding torch.
- a first plurality of IR-reflecting reference markers are provided on the training workpiece, which are arranged on the training workpiece in a first reference pattern that individualizes the training workpiece.
- a second plurality of IR-reflecting reference markers are provided, which are arranged in a second reference pattern on the training hand welding torch that individualizes the training hand welding torch.
- the welding training arrangement according to the invention has a mixed reality headset on which a mixed reality display, an RGB camera and an IR camera are provided.
- the IR camera has a spatial IR field of view for capturing IR images of IR-reflecting reference markers located in the IR field of view, which is larger than the RGB field of view of the RGB camera.
- object recognition and object tracking can be improved compared to welding training arrangements known from the prior art.
- a hand welder can move much closer to a training workpiece, can perform significantly faster movements with the training hand welding torch, and precise and accurate object detection and object tracking, especially of the training hand welding torch, can still be guaranteed even in such scenarios.
- the welding training arrangement according to the invention makes it possible to track, i.e. object recognition and object tracking, in particular of training workpieces and training hand-held welding torches, even in dynamic phases in which, for example Training hand welding torch is moved quickly, ensuring precision and reliability.
- the welding training arrangement has a simulation unit which is designed to produce a geometry and/or a shape and/or a type of the training manual welding torch from the IR images of the first and second reference patterns captured by the IR camera, such as MIG hand welding torches or MAG hand welding torches or TIG hand welding torches or E hand welding torches, as well as the training workpiece and a time course of the spatial positions of the training hand welding torch and the training workpiece relative to the headset reference point.
- a simulation unit which is designed to produce a geometry and/or a shape and/or a type of the training manual welding torch from the IR images of the first and second reference patterns captured by the IR camera, such as MIG hand welding torches or MAG hand welding torches or TIG hand welding torches or E hand welding torches, as well as the training workpiece and a time course of the spatial positions of the training hand welding torch and the training workpiece relative to the headset reference point.
- the simulation unit allows a time course of the position of a virtual welding electrode to be determined and, from this, a virtual weld seam on the training workpiece, with which mixed reality images of the virtual manual welding process are generated, which are ultimately also arranged on a mixed reality headset Mixed reality display.
- welding electrodes are used, the type and design of which are known to depend on the type of welding process.
- a welding electrode for which wire or strip electrodes that melt under protective gas or melting rod electrodes or non-melting welding electrodes (e.g. tungsten-based welding electrodes) can be provided.
- the welding electrode required for a simulated welding process for example a wire or strip electrode that melts under protective gas or a melting rod electrode or a non-melting welding electrode, is taken into account in the simulation in the form of a virtual welding electrode.
- the type of virtual welding electrode can be identified with the type of training manual welding torch, with the temporal position progression and also the spatial position of the virtual welding electrode advantageously being able to be determined from the determined time course of the spatial position of the training hand welding torch.
- the RGB camera is used as a so-called “live view” of the environment; tracking is implemented via the IR camera. What is crucial here is that the IR camera can be equipped with a larger field of view, which has the advantage of a much larger trackable area, but avoids the disadvantages mentioned for a manual welder.
- An important advantage of the welding training arrangement according to the invention is that, due to the use of the IR camera for tracking, moving components in particular can be equipped with smaller, passive and therefore more cost-effective markers compared to the prior art and can still be identified reliably and precisely.
- the movable components to be tracked also sometimes require significantly less hardware compared to components known from the prior art, especially since the markers are passive and therefore do not require a power supply.
- FIGS. 1 to 12 show advantageous embodiments of the invention by way of example, schematically and non-restrictively. This shows
- FIG. 2 is a schematic block diagram of a simulation model in a simulation unit according to the invention
- FIG. 5 shows a mixed reality headset in front view and an adapter for fixing an IR camera at a specified spatial distance from an RGB camera on the mixed reality headset
- FIG. 6 shows the fields of view of an RGB camera and an IR camera arranged according to the invention on a mixed reality headset; 7 training hand welding torches designed according to the invention with IR-reflecting reference markers,
- Fig. 8 design options for a first reference pattern for individualizing a training workpiece
- FIG. 9 shows an embodiment of a first reference pattern for individualizing a training workpiece with a trough for arranging an IR-reflecting reference marker in a side view
- 11a, 11b, 11c show the activation of a menu or interaction menu on the mixed reality display of a mixed reality headset according to the invention when a mixed reality target object is detected
- Fig.12a, Fig.12b a weld seam and a weld root.
- Fig. 1 shows a possible embodiment of a welding training arrangement 1 according to the invention for carrying out a virtual manual welding process.
- the basic components of the welding training arrangement 1 are a training workpiece 4, a manually movable training hand welding torch 6, a mixed reality headset 800 and a simulation unit 9 with a schematically shown torch holder 17.
- mixed reality or “mixed reality” is understood to mean the mixing of the natural perception of a manual welder 2 with an artificially generated (“computer-generated”) perception.
- the natural perception of a hand welder 2 is recorded within the scope of the present invention using an RGB camera 803 and represented by RGB images generated by the RGB camera 803.
- the simulation unit 9 functions as a CPU or computing unit of the welding training arrangement 1 shown. How a CPU and thus a simulation unit 9 of a welding training arrangement 1 can be constructed can be found in several prior art documents. Specifically, for example, EP 2 863 376 A1, US 202/0265750 A1 or WO 2020/167812 A1 provide relevant explanations.
- a simulation unit 9 can also be integrated into a real welding machine (also referred to in specialist circles as a “welding power source” or “power source”), to which a training manual welding torch 6 can be connected like a conventional, real welding torch.
- a real welding machine also referred to in specialist circles as a “welding power source” or “power source”
- a training manual welding torch 6 can be connected like a conventional, real welding torch.
- those provided on a real welding machine or on its housing can be used Interfaces, e.g. connections for connecting a real hand welding torch, can also be used unchanged when carrying out a virtual welding process. If a virtual welding process is carried out using a simulation unit 9 integrated in a real welding machine, the power supply from the real welding machine, for example to the training manual welding torch 6, is deactivated.
- a training hand welding torch 6 can in particular be a real hand welding torch, which can be adapted to carry out virtual hand welding processes, but can still also be suitable for carrying out real welding processes, such as carrying out a real TIG welding process .
- a workpiece holder 5 is provided in the embodiment shown in FIG. 1, on which the training workpiece 4 can be mounted.
- a workpiece holder 5 With the help of a workpiece holder 5, a wide variety of so-called welding positions can be simulated. As is known, welding positions describe the position and/or orientation and/or arrangement of the workpieces, the torch and the welding electrode and thus the position and/or orientation and/or arrangement of a weld seam in the course of a welding process.
- the standard DIN EN ISO 6947 or the ASME code Section IX defines a number of possible welding positions, such as PA (horizontal welding of butt and fillet welds), PB (horizontal welding of fillet welds, horizontal-vertical position) or PC (Transverse position or transverse seam, horizontal welding on a vertical wall).
- PA horizontal welding of butt and fillet welds
- PB horizontal welding of fillet welds, horizontal-vertical position
- PC Transverse position or transverse seam, horizontal welding on a vertical wall
- the training workpiece 4 can be magnetically mounted on the workpiece holder 5, or screwed or clamped or glued or cast or wedged on the workpiece holder 5 or simply placed on it. Furthermore, assembly of the workpiece 4 can generally take place in a form-fitting, non-positive and/or material-locking manner.
- the training workpiece 4 can be equipped with at least one metallic component and the workpiece holder 5 can be equipped with at least one magnet in order to provide a magnetic holding force. Realizations with magnets in the training workpiece 4 and/or metallic components in the workpiece holder 5 are also conceivable.
- the room in which, in a welding training arrangement 1, the training workpiece 4, and if necessary the workpiece holder 5, and if necessary the Training manual welding torch 6 and the torch holder 17 are arranged, is often referred to as 3D welding environment 3.
- a workpiece holder 5 does not represent a mandatory part of a welding training arrangement 1 according to the invention.
- a training workpiece 4 can also be placed freely and loosely. The functionality of the welding training arrangement 1 according to the invention is not influenced by the type of arrangement of the training workpiece 4.
- the use of only a single training workpiece 4 is purely an example. Likewise, a further, second training workpiece 4 or a plurality of further training workpieces 4 can be provided.
- the training workpieces 4 can have the same shape or different shapes.
- the use of several training workpieces 4 can be provided in cases in which welding processes are recreated on the welding training arrangement 1 that aim to connect several workpieces. The basic functionality of the welding training arrangement 1 remains unchanged, which is why only one training workpiece 4 is assumed for the description of the invention without restricting the generality.
- the principle for training hand welders 2, implemented using the basic components training workpiece 4, training hand welding torch 6, mixed reality headset 800 and simulation unit 9, provides for a virtual weld seam 13 on the training workpiece 4 by manually moving the training hand welding torch 6 to generate and display the virtual weld seam 13 together with the training workpiece 4 to the manual welder 2.
- the virtual weld seam 13 does not actually exist, but is determined by simulating a real welding process by specifying movement data from the hand welding torch 6 and the training workpiece 4.
- the virtual weld seam 13 is displayed as part of a sequence of mixed reality images 12 of the virtual manual welding process on a mixed reality display 801, which is arranged on the mixed reality headset 800.
- Possible embodiment variants of a mixed reality display 801 are well known from the prior art; liquid crystal displays or liquid crystal screens can preferably be used for this.
- welding training arrangement 1 By using a welding training arrangement 1 as shown in FIG. 1, various welding processes, such as MIG, MAG, TIG, plasma or electric manual welding processes, can be learned without any safety risk.
- welding gloves and/or protective equipment can also be worn by the hand welder 2 during the virtual welding, which also ensures a high degree of correspondence between real ones with regard to the clothing to be worn by the hand welder 2 and virtual welding is achieved.
- an RGB camera 803 is provided in the welding training arrangement 1 (FIG. 4), which optically records the components used in virtual manual welding, in particular the training manual welding torch 6 and the training workpiece 4 , provided they are in the field of view of the RGB camera 803.
- the RGB camera 803 can be designed as a conventional digital camera, i.e. as an optical instrument or photographic apparatus for recording moving images.
- the RGB camera 803 can be equipped with suitable or required lenses, apertures, optical filters, etc. for this purpose.
- RGB camera 803 used in the context of the present invention that it is able to detect “visible light”, that is, light from the visible part of the electromagnetic spectrum.
- visible light includes electromagnetic waves with wavelengths ranging from 400 nm to 780 nm.
- the RGB camera 803 is arranged on the mixed reality headset 800 and allows RGB images of objects located in the field of view of the RGB camera 803, hereinafter referred to as “RGB field of view” 809, to be captured.
- the term “field of view” is understood to mean that area in the image angle of an optical device within which objects or events or changes can be perceived by the optical device and thus recorded by the RGB camera 803.
- the terms “field of view” and “angle of view” are well known to those skilled in the field of camera technology.
- At least part of the training workpiece 4 and at least part of the training hand welding torch 6 are in the RGB field of view 809 of the RGB camera at least at one point in time during the manual welding process 803 are located.
- at least three, preferably at least four or particularly preferably at least five IR reference markers 71, 73 are located in the RGB field of view 809 of the RGB camera 803.
- this condition does not rule out that the Manual welder 2 briefly turns away from the training workpiece 4 while carrying out the virtual manual welding process and, for example, temporarily turns his gaze to the floor.
- the manual welder 2 works facing the training workpiece 4, which is why the above requirement is consistently met in the usual cases.
- the simulation unit 9 of the welding training arrangement 1 shown in FIG. 1 is designed to determine a geometry and/or a shape and/or a type of the training hand-held welding torch 6 and the training workpiece 4 and in particular a time course of the spatial positions of the training hand-held welding torch 6 and the training workpiece 4 to be determined while carrying out the virtual welding.
- a first plurality of infrared-reflecting reference markers 71 hereinafter “IR- “reflective” reference markers 71, as well as a second plurality of IR-reflecting reference markers 73 are provided.
- the IR-reflecting reference markers 71, 73 according to the invention can sometimes be made significantly smaller compared to approaches known from the prior art, with preferred diameters or largest dimensions or largest distances between two points on the edge of a reference marker 71, 73 in the range of just a few millimeters.
- infrared is understood to mean infrared radiation, also known as IR radiation, which is known to correspond to electromagnetic radiation in the spectral range between visible light and longer-wave terahertz radiation. Specifically, this refers to light with a wavelength between 780 nm and 1 mm, which corresponds to a frequency range of 300 GHz to 400 THz or a wave number range of 10 cm -1 to 12,800 cm -1 .
- the IR-reflecting reference markers in question are characterized in that they reflect preferably more than 70% or very preferably more than 80% or particularly preferably more than 90% or most preferably more than 99% of IR radiation striking them.
- the first plurality of IR-reflecting reference markers 71 are arranged in a first reference pattern 72 on the training workpiece 4 that individualizes the training workpiece 4.
- the second plurality of IR-reflecting reference markers 73 are arranged in a second reference pattern 74 on the training hand-held welding torch 6 that individualizes the training hand-held welding torch 6.
- a “reference pattern” is a specific, geometric arrangement of a plurality of IR-reflecting reference markers. “Individualizing” means that a Reference pattern is unique and therefore one reference pattern can be distinguished from another reference pattern. The reference pattern is preferably individualizing from different viewing directions, with only a part of the reference pattern being visible from different viewing directions.
- the present invention provides an IR camera 804 specifically intended for this purpose.
- An IR camera 804 is understood to mean an optical device similar to a conventional camera, which is capable of receiving and processing infrared radiation and further reproducing the IR radiation as an image. Light in a spectral range other than the IR range is not recorded by the IR camera 804.
- the IR camera 804 can also be equipped with appropriate optical filters.
- the IR camera 804 is arranged on the mixed reality headset 800 at a fixed spatial distance from the RGB camera 803 (FIG. 4). Like the RGB camera 803, the IR camera 804 has its own field of view, which is referred to below as the “IR field of view” 810.
- the IR camera 804 allows IR images of IR-reflecting reference markers 71, 73 located in the IR field of view 810 to be captured.
- the detection of the IR-reflecting reference markers 71, 73 is accompanied by the detection of at least parts of the reference patterns 72, 74 that individualize the training workpiece 4 and the training hand welding torch 6.
- An essential property of the IR camera 804 used according to the invention is that its IR field of view 810 is larger than the RGB field of view 809 of the RGB camera 803, preferably larger in at least one solid angle. According to the invention, the IR field of view 810 and the RGB field of view 809 overlap.
- a database or a database entry or a list can be stored in the simulation unit 9, which contains different reference patterns 72, 74 with descriptions of training workpieces 4 or training Hand welding torches 6 linked. If a reference pattern 72, 74 or a part of the reference pattern 72, 74, which allows a conclusion to be drawn about the entire reference pattern 72, 74, is now captured by the IR camera 804, the underlying training workpiece 4 can be identified by comparing it with the intended database entries and its properties are identified.
- the database entries can contain a description of the geometry, dimensions, material, etc. of the training workpiece 4. The same applies to training hand welding torches 6, whose identification can also be done by comparing recorded reference patterns 74 with corresponding database entries.
- the acquisition of IR images and RGB images takes place continuously at discrete times k. “Continuous” is to be understood here as a repeated recording of IR images and RGB images at the discrete times mentioned. It should be noted that the RGB camera 803 and the IR camera 804 can also be clocked differently within the scope of the invention and can therefore have different sampling times.
- continuously captured IR images lead to continuously captured parts of the first and second reference patterns 72, 74, from which a continuous description of the spatial positions of the training workpiece 4 and the training hand welding torch 6 can be derived in the simulation unit 9.
- the captured RGB images and the captured IR images are fed to the simulation unit 9.
- the RGB camera 803 and the IR camera 804 can be connected to the simulation unit 9, for example by cabling, in order to transmit the recorded image data.
- a wireless connection of the RGB camera 803 and the IR camera 804 with the simulation unit 9 is also conceivable.
- Known concepts such as Bluetooth, WLAN or ZigBee can be used to wirelessly connect the RGB camera 803 and the IR camera 804 to the simulation unit 9.
- the relative movement between the training hand welding torch 6 and the training workpiece 4 required for the implementation of the virtual welding process can ultimately be determined in a known manner.
- their acceleration and speed can also be determined from the position profiles of the training workpiece 4 and training hand welding torch 6, which can also be taken into account in the determination of the virtual weld seam 13.
- the determination of the spatial positions and the resulting position progressions of the training hand welding torch 6 and the training workpiece 4 are carried out relative to a headset reference point 802, which is set as a fixed point on the mixed reality headset 800.
- the headset reference point 802 moves with the mixed reality headset 800, which allows great flexibility in the position description. The specific design of this position description based on the headset reference point 802 will be discussed in detail later.
- spatial positions and the resulting position progressions of the training hand welding torch 6 or the training workpiece 4 can not only be determined, but also evaluated.
- instructions can be issued on the mixed reality display 801 or information can be issued on the mixed reality display 801, for example that the manual welder 2 has positioned the training workpiece 4 incorrectly, which can then be followed by instructions or instructions for correcting the Positioning can be given.
- geometric reference points on the training workpiece 4 and on the training hand-held welding torch 6 can first be determined.
- the geometric reference points on the training workpiece 4 and on the training hand-held welding torch 6 can be determined, for example, from the reference patterns 72, 74 attached to the training workpiece 4 and on the training hand-held welding torch 6.
- three-dimensional position vectors can be determined which describe the relative positions of the geometric reference points on the training workpiece 4 and on the training hand welding torch 6 in relation to the predetermined geometric headset reference point 802. These position vectors can be determined from the image data captured by the IR camera 804.
- a time course of image data from the IR camera 804 can determine a time course of these position vectors, from which the position courses of the training workpiece 4 and the training hand welding torch 6 can be derived as a direct consequence.
- Position progressions can therefore be understood as a temporal sequence of position vectors which describe the relative positions of the training workpiece 4 and the training hand welding torch 6 in relation to the headset reference point 802.
- the orientations of the training workpiece 4 and the training hand welding torch 6 relative to the headset reference point 802 can preferably also be determined from the reference patterns 72, 74.
- further sensors can also be provided which provide further sensor data that can be used for this purpose . These sensors, with the help of which, for example, the welding positions mentioned at the beginning (PA, PB, ...) can be determined, will be discussed separately later.
- the temporal progressions of the corresponding spatial positions are determined.
- the virtual weld seam 13 is preferably determined by simulating a real hand welding process, under the boundary condition that a real hand welding torch, which is preferably equipped with a corresponding welding electrode, corresponds to the determined time course of the position of the training hand welding torch 6 relative to the training workpiece 4 is moved, with a corresponding welding electrode being represented in the simulation by a virtual welding electrode.
- a variable length of the virtual welding electrode can also be taken into account.
- a suitable welding simulation model 91 can be implemented on the simulation unit 9, which creates a virtual one from the position profiles of the training manual welding torch 6 and the training workpiece 4 and, associated with this, from the temporal position profile of a virtual welding electrode, taking into account at least one predetermined training welding parameter ps Weld seam 13 determined.
- the state of the art offers a number of approaches, for example in RU 2694147 C1, WO 2020/056388 A1 or US 2015/0352794 A1.
- the simulation unit 9 is designed as a computer or computer-based hardware.
- a simulation model 91 can be implemented as software that runs on the simulation unit 9. How a simulation model 91 can be constructed is shown schematically in FIG. 2 using a block diagram.
- the simulation model 91 is arranged in the simulation unit 9 and receives image data BRGB from the RGB camera 803, image data BIR from the IR camera 804 and training welding parameters ps as input signals. From this, the simulation model 91 determines the virtual weld seam 13. According to the invention, the virtual weld seam 13 is subsequently displayed on the mixed reality display 801 of the mixed reality headset 800.
- the simulation model 91 can advantageously be designed to also take into account the introduction of additional materials that is common in welding technology.
- additional sub-simulation models can be used, which model the introduction of additional materials.
- the at least one predetermined training welding parameter ps can correspond to a welding current strength or a welding voltage or a welding speed or a workpiece geometry or a waiting time or a preheating temperature or a wire feed speed or an arc length or a type of welding or a protective gas setting, in particular a flow rate of a protective gas.
- another choice for the training welding parameter ps is also conceivable within the scope of the present invention.
- not just a single training welding parameter ps is specified, but a large number of training welding parameters ps, since welding is a complex physical process in which a large number of variables usually have to be specified.
- the training welding parameters ps mentioned can also be changed in an advantageous manner during a virtual manual welding process, for which purpose a suitable, preferably haptic, control element can be provided on the simulation unit 9, for example a rotary potentiometer.
- a simulated protective gas can be controlled as a training welding parameter ps using a haptic control element, preferably exclusively, and other training welding parameters ps can be set elsewhere, for example on a tablet as a portable display element 14, which will be discussed separately later is received.
- the determined virtual weld seam 13 and the associated welding progress must be graphically prepared and displayed in a final step.
- a mixed reality display 801 is provided on the mixed reality headset 800.
- the graphic display pay attention to the current time cycle during the virtual manual welding process.
- at least that part of the virtual weld seam 13 determined up to a current time cycle of the virtual manual welding process, which lies within the RGB field of view 809 present at the current time cycle, is superimposed on the RGB image present at the current time cycle in order to achieve a Mixed reality image 12 of the virtual manual welding process at the current time to generate a cycle.
- the virtual weld seam 13 is of course superimposed in the correct spatial orientation and position relative to the training workpiece 4 in order to correctly display the virtual weld seam 13 on the training workpiece 4.
- a mixed reality image 12 determined in accordance with the above statements is subsequently transmitted to the mixed reality display 801 provided on the mixed reality headset 800 in order to form it as part of the sequence of mixed reality images 12 of the virtual hand welding process on the mixed reality display 801.
- the mixed reality image 12 can also be displayed on an additional display element 14. This enables a trainer, for example, to observe virtual welding.
- the display element 14 can show the trainer a mixed reality image 12 of the virtual welding process, also from the trainer's perspective.
- the trainer it is also possible for the trainer to give the manual welder 2 visual information or tips, which can be transferred from the display element 14 to the mixed reality display 801 in real time.
- the described steps of determining the position profiles of the training hand welding torch 6 and the training workpiece 4, determining the virtual weld seam 13 and creating the mixed reality image 12 preferably take place in the simulation unit 9, i.e. the CPU or computing unit of the one under consideration Welding training arrangement 1.
- Possible implementations of a simulation unit 9 include microprocessor-based hardware, for example microcontrollers and integrated circuits (ASIC, FPGA). However, other approaches to designing the simulation unit 9 are also conceivable.
- Several simulation units 9 can also be provided, or the simulation unit 9 can be connected to a large number of other simulation units 9 via a computing cloud.
- the simulation unit 9 can be designed to carry out further complex calculations in addition to the calculation of the virtual weld seam 13. For example, in the simulation unit 9, starting from the determined virtual weld seam 13, in subsequent mechanical simulations a virtual metallurgical structure and/or a virtual stress-induced distortion and/or a virtual grain structure of the metallurgical structure, which arises as a result of the virtual weld seam 13 in the training workpiece 4 can be set, determined and, if necessary, displayed.
- the simulation unit 9 can also be designed to determine so-called welding quality parameters based on subsequent mechanical simulations, which describe a quality and/or a quality of the virtual weld seam 13.
- Welding quality parameters can describe a seam thickness, a vibration resistance, a weld seam transition or an edge offset, which is described, for example, in the DIN EN ISO 581 standard.
- it can be provided to display determined welding quality parameters on the mixed reality display 801 alongside the virtual manual welding process.
- the simulation unit 9 can also be designed to superimpose a predetermined virtual ideal weld seam 131 (shown in dashed lines in Fig. 1 and Fig. 11a-c) on the existing RGB images, which is to be generated by the virtual manual welding process.
- the mixed reality display 801 can of course be designed to accommodate the Virtual ideal weld seam 131 superimposed RGB images to display.
- the simulation unit 9 can also be designed to determine one or more seam quality parameters, which can, for example, describe a deviation between the determined virtual weld seam 13 and the predetermined ideal weld seam 131. In this way, an objective and comprehensible assessment of the virtual weld seam 13 created by a manual welder is made possible.
- a deviation threshold can be specified in an advantageous manner. If there is a deviation between the determined virtual weld seam 13 and the predetermined ideal weld seam 131, which exceeds a predetermined deviation threshold, the simulation unit 9 or another element of the welding training arrangement 1 can be designed to detect the manual welder 2 using acoustic and/or optical signals to draw attention to this deviation and thus to the associated welding errors. These acoustic and/or optical signals are preferably output via the mixed reality headset 800, for which purpose the mixed reality headset 800 can be equipped with suitable speakers.
- the simulation unit 9 can be designed to enable data backup and/or recording of welds, which makes it possible for a learning manual welder 2 to view a virtual manual welding process again, analyze errors and document learning progress.
- the simulation unit 9 can also be arranged on the mixed reality headset 800.
- the simulation unit 9 can therefore be part of the mixed reality headset 800 or be an integral, i.e. inextricably connected, part of the mixed reality headset 800.
- a free-standing simulation unit 9 can be dispensed with.
- a virtual manual welding process usually does not require any preparation or follow-up of the training workpiece.
- the welding result often depends to a significant extent on the seam preparation.
- One of the most important requirements for good welds is the cleanliness of the weld seam edges. These must not only be bright metal, ie free of oxides and/or scale, but must also not contain any contamination from fats, oils or other organic substances that can lead to carburization and inclusions in the weld seams. Preparation and follow-up work are not required for training workpieces 4.
- the present invention allows inadequate preparation of a manual welding process in one according to the invention
- Simulation unit 9 must be consciously specified and taken into account in a simulation for calculating the virtual weld seam 13, in particular in order to show a trainee manual welder 2 the effects associated with inadequate preparation of a manual welding process.
- the embodiment of the welding training arrangement 1 shown in FIG. 1 also has an optional, further display element 14.
- the further display element 14 is not a mandatory part of the welding training arrangement 1 according to the invention, but rather serves only to display the virtual manual welding process for other people in addition to the manual welder 2, such as a trainer or other training personnel.
- the further display element 14 can preferably be designed to be detachable from the simulation unit 9, for example in the form of a tablet, which can be removed from the simulation unit 9 and reattached to it, for example by means of a plug connection.
- a further display element 14 is of course not a necessary prerequisite for the welding training arrangement 1 according to the invention.
- a front end of the display element 14 can be adapted to a real welding machine modeled in the simulation or to corresponding operating units of a real welding machine modeled in the simulation, so that the operating units of various real welding machines can be simulated realistically.
- the possibility of changing the front end in a 3D view can also be provided for the mixed reality display 801 of the mixed reality headset 800, among other things in order to adapt it to a real welding machine modeled in the simulation.
- a front end can preferably be synchronized and coordinated with training welding parameters ps, which are taken into account in a virtual manual welding process, since not every front end necessarily has the same training welding parameters ps.
- a virtual manual welding process via a display element 14, preferably via a portable tablet.
- provision can also be made to control a virtual manual welding process exclusively via a portable tablet.
- a removable display element 14 is provided, there are preferably no further display elements on the remaining part of the simulation unit 9, apart from a few status LEDs for signaling and/or displaying a state of the simulation unit 9.
- 3 shows a welding training arrangement according to the prior art in comparison to the previously discussed welding training arrangement 1 according to the invention. It is obvious that to identify the welding torch 21 and the workpiece 22, large-area markers (e.g. so-called “image markers”, such as the Arllco markers, which are well known in the field of image processing and whose diameter is typically larger than 1 cm) are used. which are captured with an RGB camera 23.
- Fig. 3 has the obvious disadvantage that only components that are in the RGB field of view of the RGB camera 23 can be tracked, i.e. identified and followed.
- the so-called tracking area, indicated in Fig. 3 by the circle 24, is therefore limited by the visual guidance of the hand welder 2 and the field of view of the RGB camera.
- RGB camera which simultaneously tracks objects and captures the field of view of a hand welder 2
- RGB camera which simultaneously tracks objects and captures the field of view of a hand welder 2
- wide-angle lenses such as fisheye lenses
- Tracking based on RGB cameras is also often dependent on the given lighting conditions, which can sometimes result in significant malfunctions when lighting conditions change.
- the problems mentioned in the prior art are solved using the welding training arrangement 1 according to the invention, with the mixed reality headset 800 in particular being decisive for solving these problems.
- a possible embodiment of a mixed reality headset 800 according to the invention is shown in Fig.4.
- the mixed reality headset 800 shown has a mixed reality display 801 for displaying the sequence of mixed reality images 12 of the virtual hand welding process.
- the mixed reality display 801 on the mixed reality headset 800 is of course arranged so that a person wearing the mixed reality headset 800 can see the mixed reality display 801 in the has field of vision.
- a predetermined geometric headset reference point 802 is assigned to the mixed reality headset 800 shown. This does not result in a static coordinate system that cannot be changed during the virtual manual welding process, which is used to describe the spatial positions of the training workpiece 4 and the training manual welding torch 6. Rather, the aforementioned headset reference point 802 can be used as the origin of a movable coordinate system, which corresponds to the movement of the hand welder 2 and thus to the movement of the mixed reality headset 800 moved along. In approaches known from the prior art, in which, for example, RGB cameras are arranged stationary on tripods in the space of the welding training arrangement, only the use of static coordinate systems is possible. Through the reference point 802 on the mixed reality headset 800, tracking, as the identification and tracking of objects such as the training hand-held welding torch, can sometimes be made significantly more dynamic and better adapted to a specific welding situation in a specific individual case.
- a mixed reality headset 800 can also have a weight compensation element 807, as described with reference to the embodiment of FIG. 4.
- the weight compensation element 807 acts with a torque TK that is formed and normal due to the weight or the weight distribution of the RGB camera 803 and/or the weight of the IR camera 804 and/or the weight of the mixed reality display 801 Line of sight 10 of the mixed reality headset 800 counteracts the torque T g .
- a mixed reality headset 800 especially when it is connected to the simulation unit 9 using cables, as shown in FIG. 4, can assume a sometimes considerable total weight of the mixed reality headset 800.
- a high weight distributed asymmetrically over the head of a manual welder 2 can lead to strain on the back and neck of the manual welder 2.
- the weight compensation element 807 does not reduce the overall weight of the mixed reality headset 800, its distribution over the head of a manual welder 2 is made more symmetrical. In this way, the duration of training units can be extended considerably, which means that the intensity of welding training can be increased and better training effects and progress can be achieved.
- Line of sight 10 is to be understood as a line along which the hand welder 2 would look at the training workpiece 4 if the hand welder 2 were not wearing the mixed reality headset 800.
- the line of sight 10 can correspond to an optical axis of the RGB camera 803.
- the RGB camera 803 has at least one RGB lens 831, the optical axis 806 of which intersects the display surface 805 facing the hand welder 2 at a display cutting angle y in a display intersection 808.
- An optical axis 806 and the line of sight 10 can coincide, particularly in cases where the display intersection angle y is 90 degrees.
- the mixed reality headset 800 is preferably designed such that the line of sight 10 and the optical axis 806 have a common intersection and at an angle of less than 10 degrees, or at one Angle less than 5 degrees, or spread apart at an angle less than 1 degree.
- the weight compensation element 807 can additionally ensure a predetermined cable routing for the cables used to connect the simulation unit 9 and the mixed reality headset 800. In particular, it can be ensured in this way that the cables do not touch the manual welder 2 and therefore do not interfere with virtual manual welding.
- the weight compensation element 807 can be changed in shape and/or its position on the mixed reality headset 800 can be adjusted.
- the weight compensation element 807 can be designed to be foldable and/or removable.
- loudspeakers can also be arranged in the mixed reality headset 800, which simulate the sound noise to be expected in a real hand welding process.
- acoustics are an essential element in welding.
- sound noises can be related to the properties of the arc, such as the power transported by the arc or the so-called angle of attack of the welding torch, which can determine the angle between the arc and the workpiece.
- an acoustic model can be provided in the simulation unit 9 in addition to the simulation model 91 for simulating the welding process.
- the loudspeakers can be arranged in such a way that they are able to deliver a spatial stereo sound, which can often offer the hand welder 2 a particularly realistic representation (“immersion”) of the virtual hand welding process.
- Fig.5 shows a mixed reality headset 800 in front view and an adapter 30 for fixing an IR camera 804 in a predetermined relative position to an RGB camera 803.
- RGB camera 803 and the IR camera 804 on the mixed - Reality Headset 800 found that these should preferably be attached in the most rigid arrangement possible to each other.
- the RGB camera 803 and the IR camera 804 are vertically offset from one another.
- This vertical offset must be taken into account when superimposing the virtual weld seam, which is determined from IR images, on the RGB images obtained with the RGB camera. It has been shown here that Although temporal changes in this vertical offset can be taken into account, this requires the determination of the vertical offset and the use of significantly higher computing capacities.
- both the RGB camera 803 and the IR camera 804 each include two optical lenses.
- the use of two optical lenses in the RGB camera 803 makes it possible to capture so-called stereoscopic images or images of the RGB field of view 809.
- Stereoscopic images are known to mean the reproduction of images with an impression of spatial depth.
- Stereoscopic images can be used to provide the manual welder 2 with a stereoscopic representation of the virtual manual welding process.
- two stereoscopically offset mixed reality images 12 can always be displayed simultaneously in real time on the mixed reality display 801 of the mixed reality headset 800.
- sensors can be provided on the RGB camera 803 and/or on the mixed reality headset 800 in order to ensure the previously mentioned orientation of the training workpiece 4, the training hand-held welding torch 6, and the mixed reality target object T in the 3D welding environment 3 or generally in three-dimensional space.
- These sensors can be, for example, gyroscopes, acceleration sensors and/or proximity sensors.
- the sensor data recorded by such sensors can be forwarded in an advantageous manner to the simulation unit 9, in which the orientation mentioned in three-dimensional space can be determined from the transmitted sensor data.
- the adapter 30 thus serves to advantageously ensure a vertical offset between the RGB camera 803 and the IR camera 804 that is always (as possible) constant.
- the embodiment of the adapter 30 shown in FIG. 5 has a rigid mounting frame 33 on which two mounting elements 31, 32 are arranged in a defined spatial position.
- the RGB camera 803 is fixed using the first mounting element 31 and the IR camera 804 is fixed using the second mounting element 32.
- the IR field of view 810 is designed to be significantly larger than the RGB field of view 809.
- the invention is based on IR images captured using the IR camera 804
- the fields of view 809, 810 of the Karners i.e. the RGB field of view 809 and the IR field of view 810, overlap at least to some extent. “Overlap” is to be understood here as one at least partially mutually covering the RGB field of view and the IR field of view.
- the IR field of view 810 completely encloses the RGB field of view 809, so that the RGB field of view 809 is completely contained in the IR field of view 810.
- this does not represent a mandatory requirement within the scope of the invention.
- the reference pattern 72 intended for individualizing the training workpiece 4 is located outside the RGB field of view 809 of the RGB camera 803. In this case, there would be no identification and tracking, i.e. no tracking of the training workpiece, based solely on RGB images. Workpiece 4 possible. Thanks to the larger IR field of view, the reference pattern 72 can still be captured and a virtual manual welding process can also be carried out in this case without any problems.
- IR-reflecting reference markers that are essential for the present invention are discussed in more detail with reference to FIG. 7. 7 show various versions of a training hand welding torch 6 but also of training additional materials 7, as they can be used to simulate electrode hand welding processes and TIG welding processes. The following statements are also valid for reference samples 72 for training workpieces 4.
- the individualizing reference patterns 72, 74 are designed according to the invention in such a way that the detection of only a part of the respective reference pattern 72, 74 is sufficient to identify the object to which a corresponding reference pattern 72, 74 is attached.
- the type of virtual welding electrode can preferably be identified with the type of training hand welding torch 6.
- various checks can also be provided, which are preferably carried out in the Simulation unit 9 can be made.
- a check of connections of a training hand welding torch 6, such as a ground connection and/or a torch connection can be provided, or a check as to whether the correct training hand welding torch 6 is being used, which is particularly relevant in the context of MIG/MAG welding.
- it can be checked whether a training hand welding torch 6 is connected to the correct electrical polarity, or whether a ground connection is correctly connected to a training workpiece 4, or whether a ground connection is generally connected correctly and/or whether a welding circuit is closed.
- the mentioned checks or the results of these checks can be displayed graphically on the mixed reality display 801, whereby in particular faulty or missing connections can be pointed out, and in the event of a faulty or missing connection, information can also be provided for a suitable correction can.
- a first distance between the IR-reflecting reference markers 71 can be provided in the first reference pattern 72 for individualizing the training workpiece 4, by which the IR-reflecting reference markers 71 are spaced from the respective neighboring IR-reflecting reference markers 71, and in the second reference pattern 72 for individualizing the training workpiece 4 a second distance, which is different from the first distance.
- the IR-reflecting reference markers 71, 73 can also form fractals that are different from one another. Fractals that differ from one another can be created, for example, based on different Mandelbrot sets. However, reference patterns can also be generated using random generators or determined empirically as part of the design of the welding training arrangement 1.
- IR-reflecting reference markers An important advantage of the use of IR-reflecting reference markers according to the invention is that significantly smaller reference markers can be used compared to the prior art.
- the diameters of the IR-reflecting reference markers 71, 73 can be selected in a range between 0.1 mm and 5 mm or in a range between 0.1 mm and 3 mm or in a range between 0.1 mm and 1 mm.
- the diameters of the IR-reflecting reference markers 71, 73 can also be used to distinguish between different reference patterns 72, 74.
- IR-reflecting reference markers 71 with a first diameter can be used, for example of 0.5 mm or 1.5 mm or 2.5 mm or 3.5 mm
- IR-reflecting reference markers 74 with a second diameter are used, for example of 0.1 mm or 1.1 mm or 2.1 mm or 3.1 mm.
- the reflection properties of the reference markers and the surfaces of the training workpiece 4 and the training hand welding torch 6 can also be designed inversely to the previously described embodiments. Accordingly, the surfaces of the training workpiece 4 and the training hand welding torch 6 can be designed to be more reflective than the reference markers. In this way, too, reference patterns detectable by the IR camera can be created on the training workpiece 4 and the training hand welding torch 6.
- the training hand welding torch 6 can be designed as a real hand welding torch, for example as a real MIG hand welding torch or as a real MAG hand welding torch or real TIG hand welding torch or real E hand welding torch.
- a real hand welding torch from a real welding arrangement for real welding, to equip it with an IR-reflecting reference marker 73 with a reference pattern 74 that individualizes the hand welding torch, and thus to use the real hand welding torch when carrying out the virtual hand welding process to be used as a training hand welding torch 6.
- operating elements S1, S2 such as switches, buttons, slide controls, etc.
- control elements S1, S2 are used to control a welding process, for example to start it, for example to ignite an arc, or to vary a welding current intensity, or to change a wire feed speed.
- a training Hand welding torch 6 have the same controls S1, S2 and, for example, pass on control signals generated by these controls S1, S2 to the simulation unit 9 using a cable connection.
- the effect of these control signals can subsequently be taken into account in the simulation of the manual welding process, i.e. the simulated welding can be started or interrupted, a simulated wire feed can be accelerated or braked, or a simulated welding current can be increased or reduced.
- FIG. 8 shows several possible design options for a first reference pattern 72 for individualizing different training workpieces 4. It can be seen that the IR reference markers 71 can also be attached to the end faces and side surfaces of the training workpieces 4 due to their small size. The statements made in FIG. 7 regarding the design of the IR-reflecting reference markers 71 also apply without restriction to the IR-reflecting reference markers 71 on training workpieces 4 as in FIG. 8.
- the IR-reflecting reference markers 71, 73 can, for example, be applied in the form of an adhesive film to the surface of the training workpiece 4 or can also be painted, printed, embossed onto the surface of the training workpiece 4 or can also be applied by a coating process. Furthermore, it would also be possible to provide such IR-reflecting reference markers 71, 73 on a surface of a training workpiece 4 by applying energy to the surface, for example in the form of an engraving laser.
- FIG. 9 shows a further possible embodiment of a first reference pattern 72 for individualizing a training workpiece 4.
- the troughs 16 represent depressions, i.e. depressions the surface of the training workpiece 4.
- IR-reflecting reference markers 71 are arranged in these recesses, but due to the recess they can only be detected by the IR camera 804 from certain viewing angles.
- Fig. 10 shows a trough 16 for arranging an IR-reflecting reference marker 71 in a detailed view. Due to the fact that IR-reflecting reference markers 71 arranged in a trough 16 can only be detected by the IR camera 804 from certain viewing angles, the spatial orientation of the training workpiece 4 can be inferred from their detection, for example. 9, both IR-reflecting reference markers 71 arranged in the troughs 16 can be seen, which suggests an orientation of the training workpiece 4 in which one long side of the training workpiece 4 faces the IR camera 804 is. However, if only one IR-reflecting reference marker 71 arranged in a trough 16 can be seen, it can be assumed that the training workpiece 4 is oriented in such a way that a transverse side faces the IR camera 804.
- 11a to 11c further show the activation of a menu M on the mixed reality display of the mixed reality headset 800 when a mixed reality target object T is detected by the IR camera 804.
- a third plurality of IR-reflecting reference markers 75 are arranged on the mixed reality target object T in a third reference pattern 76 that individualizes the mixed reality target object T. If at least part of the third reference pattern 76 is captured by the IR camera 804, the display of the menu M on the mixed reality display 801 is triggered.
- the mixed reality target object T can be arranged in the desired position in the 3D welding environment 3.
- the orientation of the menu M can be dependent on the spatial orientation of the mixed reality target object T, so that the spatial orientation of the menu M changes when the spatial orientation of the mixed reality target object T changes.
- a further reference pattern 77 can also be arranged on a training workpiece 4, which can also display a menu M.
- the orientation of the displayed menu M in this case can be made dependent on the spatial orientation of the training workpiece 4.
- the menu M can thus be designed to modify the at least one training welding parameter ps, whereby the entire virtual manual welding process can ultimately be modified and changed.
- the display of a menu M described above can also take place on a further display element 14, which is detachably connected to the simulation unit 9, for example in the form of a tablet.
- the simulation unit 9 for example in the form of a tablet.
- other people can also follow the menu and, if necessary, operate it.
- it can be provided to synchronize a smartphone with the welding training arrangement 1 and to use the display of the smartphone to display the menu.
- the training hand welding torch 6 can be equipped with a further control element which allows the displayed menu M to be operated.
- the orientation of the training hand welding torch 6 can first be determined in the manner already described. Based on this, a menu element in menu M identified by the orientation of the training hand welding torch 6 can be determined, for example by determining a menu element which is intersected by a straight line emanating from the training hand welding torch 6, determined in the course of the identification. If a menu element is identified, it can be activated and/or deactivated by activating the additional control element.
- the actuation/confirmation of menu elements of the menu M can be done on the one hand by aiming at a virtual straight line of the menu starting from a menu element, whereby the virtual straight line can also be displayed, and by subsequently pressing a key on a control element S1, S2, as shown in Figures 11a and 11b.
- the method of “dwell-based pointing” (“aiming and loading”) which is established in the field of human-computer interaction, can also be used to select a menu element, and a menu element can also be selected by virtually touching it the training hand welding torch 6.
- Fig. 12a and Fig. 12b show a so-called welding root 15 as the subject of a further advantageous embodiment of the invention.
- Fig. 12a the underside I of a training workpiece 4 is shown
- Fig. 12b the opposite top side II.
- a virtual weld seam 13 can be seen, which forms a so-called weld root on the underside I 15 leads.
- the simulation unit 9 can be designed in an advantageous manner to first determine a virtual weld root 15 generated by the virtual manual welding process on the training workpiece 4 or a virtual penetration weld or a virtual longitudinal crack or a virtual transverse crack through the weld seam 13. Based on such a determination, the simulation unit 9 can advantageously be designed to superimpose the determined virtual weld root 15 or the determined virtual penetration weld or the determined virtual longitudinal crack or the determined virtual transverse crack on the RGB image present at the current time.
- the representation of a weld root 15 or a transverse crack or a longitudinal crack is of particular interest in cases in which the training workpiece 4 is analyzed during the virtual manual welding process, for example by interrupting the welding and viewing the training workpiece 4 from all sides, for example from the bottom, or by rotating the training workpiece 4.
- the possibility of viewing a weld root 15 in such cases or examining whether the workpiece has been welded through sometimes makes the virtual welding process significantly more realistic.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
- Arc Welding In General (AREA)
- Resistance Welding (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
Description
Claims
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202380046907.9A CN119365912A (zh) | 2022-06-14 | 2023-06-13 | 用于执行虚拟手工焊接过程的焊接培训系统 |
| DE112023001944.4T DE112023001944A5 (de) | 2022-06-14 | 2023-06-13 | Schweißschulungsanordnung zur Durchführung eines virtuellen Handschweißvorganges |
| ATA9142/2023A AT527978B1 (de) | 2022-06-14 | 2023-06-13 | Schweißschulungsanordnung zur Durchführung eines virtuellen Handschweißvorganges |
| US18/874,770 US20250371993A1 (en) | 2022-06-14 | 2023-06-13 | Welding training assembly for performing a virtual manual welding process |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102022206024.5A DE102022206024A1 (de) | 2022-06-14 | 2022-06-14 | Schweißschulungsanordnung zur Durchführung eines virtuellen Handschweißvorganges |
| DE102022206024.5 | 2022-06-14 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023242147A1 true WO2023242147A1 (de) | 2023-12-21 |
Family
ID=86899106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2023/065706 Ceased WO2023242147A1 (de) | 2022-06-14 | 2023-06-13 | Schweissschulungsanordnung zur durchführung eines virtuellen handschweissvorganges |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20250371993A1 (de) |
| CN (1) | CN119365912A (de) |
| AT (1) | AT527978B1 (de) |
| DE (2) | DE102022206024A1 (de) |
| WO (1) | WO2023242147A1 (de) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119141048A (zh) * | 2024-08-29 | 2024-12-17 | 中国水利水电第四工程局有限公司 | 一种蜗壳座环组焊浇筑质量控制方法 |
| EP4604101A1 (de) | 2024-02-15 | 2025-08-20 | FRONIUS INTERNATIONAL GmbH | Schulungs-e-handschweissbrenner, schulungs-stabelektrode und schweissschulungsanordnung zur durchführung eines virtuellen e-handschweissvorganges |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20250353097A1 (en) * | 2024-05-20 | 2025-11-20 | Illinois Tool Works Inc. | Tig torch tracking attachments for welding technique monitoring systems |
| US20260127978A1 (en) * | 2024-11-05 | 2026-05-07 | Illinois Tool Works Inc. | Weld training simulation systems with electromagnetic haptic feedback |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102005053276A1 (de) | 2004-11-08 | 2006-05-11 | Pentax Corp. | Digitalkamera |
| EP2863376A1 (de) | 2012-06-13 | 2015-04-22 | Seabery Soluciones S.L. | Erweiterte, aus der ferne aktualisierbare vorrichtung zum schweisstraining auf basis von simulationen mit erweiterter realität |
| US20150352794A1 (en) | 2014-06-05 | 2015-12-10 | Commonwealth Scientific And Industrial Research Organisation | Distortion prediction and minimisation in additive manufacturing |
| WO2016144744A1 (en) * | 2015-03-09 | 2016-09-15 | Illinois Tool Works Inc. | Methods and apparatus to provide visual information associated with welding operations |
| US20180130377A1 (en) * | 2016-11-07 | 2018-05-10 | Lincoln Global, Inc. | Communication between a welding machine and a live welding training device |
| US20180130226A1 (en) * | 2016-11-07 | 2018-05-10 | Lincoln Global, Inc. | System and method for calibrating a welding trainer |
| CN207937787U (zh) * | 2017-10-31 | 2018-10-02 | 塔普翊海(上海)智能科技有限公司 | 扩增实境仿真系统 |
| RU2694147C1 (ru) | 2016-04-06 | 2019-07-09 | Сименс Акциенгезелльшафт | Способ, считываемый компьютером носитель данных, компьютерная программа и симулятор для определения напряжений и отклонений форм в аддитивно изготавливаемой конструктивной структуре |
| WO2020056388A1 (en) | 2018-09-13 | 2020-03-19 | Board Of Regents Of The University Of Nebraska | Simulating heat flux in additive manufacturing |
| US20200254572A1 (en) * | 2019-02-12 | 2020-08-13 | Illinois Tool Works Inc. | Virtual markings in welding systems |
| US20200265750A1 (en) | 2019-02-19 | 2020-08-20 | Pedro Marquinez | Systems for simulating joining operations using mobile devices |
| US10877266B2 (en) | 2006-07-11 | 2020-12-29 | Optimum Imaging Technologies Llc | Digital camera with wireless image transfer |
| CN112454363A (zh) * | 2020-11-25 | 2021-03-09 | 马鞍山学院 | 一种用于焊接操作的ar辅助机器人的控制方法 |
| US20210158724A1 (en) | 2019-11-25 | 2021-05-27 | William Joshua Becker | Weld training simulations using mobile devices, modular workpieces, and simulated welding equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9368045B2 (en) | 2012-11-09 | 2016-06-14 | Illinois Tool Works Inc. | System and device for welding training |
-
2022
- 2022-06-14 DE DE102022206024.5A patent/DE102022206024A1/de not_active Withdrawn
-
2023
- 2023-06-13 US US18/874,770 patent/US20250371993A1/en active Pending
- 2023-06-13 AT ATA9142/2023A patent/AT527978B1/de active
- 2023-06-13 DE DE112023001944.4T patent/DE112023001944A5/de active Pending
- 2023-06-13 WO PCT/EP2023/065706 patent/WO2023242147A1/de not_active Ceased
- 2023-06-13 CN CN202380046907.9A patent/CN119365912A/zh active Pending
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102005053276A1 (de) | 2004-11-08 | 2006-05-11 | Pentax Corp. | Digitalkamera |
| US10877266B2 (en) | 2006-07-11 | 2020-12-29 | Optimum Imaging Technologies Llc | Digital camera with wireless image transfer |
| EP2863376A1 (de) | 2012-06-13 | 2015-04-22 | Seabery Soluciones S.L. | Erweiterte, aus der ferne aktualisierbare vorrichtung zum schweisstraining auf basis von simulationen mit erweiterter realität |
| US20150352794A1 (en) | 2014-06-05 | 2015-12-10 | Commonwealth Scientific And Industrial Research Organisation | Distortion prediction and minimisation in additive manufacturing |
| WO2016144744A1 (en) * | 2015-03-09 | 2016-09-15 | Illinois Tool Works Inc. | Methods and apparatus to provide visual information associated with welding operations |
| RU2694147C1 (ru) | 2016-04-06 | 2019-07-09 | Сименс Акциенгезелльшафт | Способ, считываемый компьютером носитель данных, компьютерная программа и симулятор для определения напряжений и отклонений форм в аддитивно изготавливаемой конструктивной структуре |
| US20180130377A1 (en) * | 2016-11-07 | 2018-05-10 | Lincoln Global, Inc. | Communication between a welding machine and a live welding training device |
| US20180130226A1 (en) * | 2016-11-07 | 2018-05-10 | Lincoln Global, Inc. | System and method for calibrating a welding trainer |
| CN207937787U (zh) * | 2017-10-31 | 2018-10-02 | 塔普翊海(上海)智能科技有限公司 | 扩增实境仿真系统 |
| WO2020056388A1 (en) | 2018-09-13 | 2020-03-19 | Board Of Regents Of The University Of Nebraska | Simulating heat flux in additive manufacturing |
| WO2020167812A1 (en) | 2019-02-12 | 2020-08-20 | Illinois Tool Works Inc. | Virtual markings in welding systems |
| US20200254572A1 (en) * | 2019-02-12 | 2020-08-13 | Illinois Tool Works Inc. | Virtual markings in welding systems |
| US20200265750A1 (en) | 2019-02-19 | 2020-08-20 | Pedro Marquinez | Systems for simulating joining operations using mobile devices |
| WO2020172309A1 (en) * | 2019-02-19 | 2020-08-27 | Seabery Soluciones, S.L. | Systems for simulating joining operations using mobile devices |
| US20210158724A1 (en) | 2019-11-25 | 2021-05-27 | William Joshua Becker | Weld training simulations using mobile devices, modular workpieces, and simulated welding equipment |
| CN112454363A (zh) * | 2020-11-25 | 2021-03-09 | 马鞍山学院 | 一种用于焊接操作的ar辅助机器人的控制方法 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4604101A1 (de) | 2024-02-15 | 2025-08-20 | FRONIUS INTERNATIONAL GmbH | Schulungs-e-handschweissbrenner, schulungs-stabelektrode und schweissschulungsanordnung zur durchführung eines virtuellen e-handschweissvorganges |
| CN119141048A (zh) * | 2024-08-29 | 2024-12-17 | 中国水利水电第四工程局有限公司 | 一种蜗壳座环组焊浇筑质量控制方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN119365912A (zh) | 2025-01-24 |
| DE102022206024A1 (de) | 2023-12-14 |
| AT527978B1 (de) | 2026-02-15 |
| DE112023001944A5 (de) | 2025-03-06 |
| AT527978A5 (de) | 2025-07-15 |
| US20250371993A1 (en) | 2025-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AT527978B1 (de) | Schweißschulungsanordnung zur Durchführung eines virtuellen Handschweißvorganges | |
| EP2326452B1 (de) | Verfahren zur erzeugung eines zweidimensionalen bildes an einer ausgabevorrichtung über eine visualisierungsvorrichtung | |
| DE102007033486B4 (de) | Verfahren und System zur Vermischung eines virtuellen Datenmodells mit einem von einer Kamera oder einer Darstellungsvorrichtung generierten Abbild | |
| DE102019009313B4 (de) | Robotersteuerung, Verfahren und Computerprogramm unter Verwendung von erweiterter Realität und gemischter Realität | |
| DE102018109463B3 (de) | Verfahren zur Benutzung einer mehrgliedrigen aktuierten Kinematik, vorzugsweise eines Roboters, besonders vorzugsweise eines Knickarmroboters, durch einen Benutzer mittels einer mobilen Anzeigevorrichtung | |
| DE102010038902B4 (de) | Verfahren und Einrichtung zur Unterstützung der Ausbildung eines Handschweißers | |
| WO2006092251A1 (de) | Verfahren und vorrichtung zur bestimmung von optischen überdeckungen mit ar-objekten | |
| US9773429B2 (en) | System and method for manual welder training | |
| EP2973513B1 (de) | Import und analyse externer daten unter verwendung eines virtual-reality-schweisssystems | |
| WO2015185972A1 (en) | System and method for manual welder training | |
| EP2801966A1 (de) | Verfahren zur Simulation eines Schweissprozesses | |
| DE202012013151U1 (de) | System zur Charakterisierung manueller Schweissvorgänge | |
| DE10335501A1 (de) | Verfahren und Vorrichtung zum Schweißen oder Schneiden mit Laserstrahl | |
| EP2989872B1 (de) | Platziervorrichtung und platzierverfahren | |
| DE212014000077U1 (de) | Systeme zum Exportieren oder Verwenden von Schweisssequenzerdaten für externe Systeme | |
| DE102004016331A1 (de) | Vorrichtung und Verfahren zur gleichzeitigen Darstellung virtueller und realer Umgebungsinformationen | |
| DE102013221850A1 (de) | Verfahren und Vorrichtung zur Laserbeschriftung eines Bauteils | |
| EP4293436A1 (de) | Anordnung umfassend ein cnc-bearbeitungssystem und eine augmented-reality anzeigevorrichtung | |
| EP4604101A1 (de) | Schulungs-e-handschweissbrenner, schulungs-stabelektrode und schweissschulungsanordnung zur durchführung eines virtuellen e-handschweissvorganges | |
| DE102024124614A1 (de) | System und Verfahren zum präzisen Auftragschweißen | |
| DE102013207323B4 (de) | Kamerasystem für ein Fahrzeug und Fahrzeug | |
| EP4728330A1 (de) | Farbliche kennzeichnung relevanter bereiche in einer erweiterten oder virtuellen realität |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23732889 Country of ref document: EP Kind code of ref document: A1 |
|
| DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
| WWE | Wipo information: entry into national phase |
Ref document number: A 9142/2023 Country of ref document: AT |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 112023001944 Country of ref document: DE Ref document number: 18874770 Country of ref document: US Ref document number: 202380046907.9 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202517000546 Country of ref document: IN |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380046907.9 Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 202517000546 Country of ref document: IN |
|
| REG | Reference to national code |
Ref country code: DE Ref legal event code: R225 Ref document number: 112023001944 Country of ref document: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 112023001944 Country of ref document: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 23732889 Country of ref document: EP Kind code of ref document: A1 |
|
| WWP | Wipo information: published in national office |
Ref document number: 18874770 Country of ref document: US |