CN116830589A

CN116830589A - Welding image processing method and device

Info

Publication number: CN116830589A
Application number: CN202180091857.7A
Authority: CN
Inventors: 许盛元
Original assignee: Otos Wing Co Ltd
Current assignee: Otos Wing Co Ltd
Priority date: 2021-02-03
Filing date: 2021-05-20
Publication date: 2023-09-29
Also published as: KR20220133043A; KR102814326B1

Abstract

Welding image processing devices and methods are provided. A welding image processing device according to an embodiment of the present invention includes: a camera head, which photographs the welding part; goggles, which are arranged adjacent to the camera module; and a processor. The processor controls the transmittance of the goggles based on sensor values received from the sensor, and acquires welding images through the camera head based on light passing through the goggles whose transmittance is controlled.

Description

Welding image processing method and device thereof

Technical field

The invention relates to a welding image processing method and a device thereof.

Background

The protective tool is worn to protect an operator from light, high heat, and the like generated in a welding process such as arc welding. Since the operator can confirm progress of welding by the protective tool only in a state where the protective tool is worn, it is inconvenient to detach the protective tool and confirm with naked eyes in order to confirm various information of welding, such as conditions set in the welding apparatus.

If the operator's proficiency is not high, especially when wearing automatic welding masks and manual welding masks, the operator can only see the adjacent portion to the welding light, and it is difficult to recognize specific welding conditions such as the welding surroundings. Therefore, it is necessary to provide the operator with a high-quality image that enables the operator to visually confirm the welding environment, and to provide the operator with specific information about the welding site.

In particular, when a welding process that generates smoke is performed, there is a problem in that it is difficult to identify a welding site even with welding light or illumination of a welding device.

The problems described above may cause the same problems to medical staff in skin surgery and/or diagnosis using high-brightness/high-illuminance light such as laser light, in addition to welding work, and also in other operations using high-brightness/high-illuminance light.

Disclosure of Invention

Technical problem to be solved by the invention

The present invention has been made in view of the above-described needs, and an object thereof is to provide a welding image processing apparatus capable of displaying a welding point and a welding surrounding environment to an operator in a welding environment where smoke is generated, thereby improving welding accuracy of the operator.

The embodiment of the invention discloses a method for acquiring a clear welding image of a welding part by using a camera.

The invention can provide correct information for users in the work of processing high-brightness/high-illumination light.

However, these problems are exemplary, and the scope of the present invention is not limited thereto.

Technical proposal

A welding image processing apparatus according to an aspect of the present invention includes: a camera head for shooting a welding part; goggles arranged adjacent to the camera module; and a processor. The processor is configured to control the transmissivity of the goggles based on sensor values received from sensors and to acquire a welding image based on light passing through the goggles whose transmissivity is controlled and using the camera head.

The welding image processing method according to another aspect of the present invention includes: a step of receiving a sensor value from a sensor; a step of controlling transmittance of goggles based on the received sensor values; and a step of acquiring a welding image based on the light passing through the goggles whose transmittance is controlled.

Other aspects, features and advantages than those described above will become apparent from the following drawings, claims and detailed description of the invention.

Effects of the invention

According to the welding image processing device, the camera does not need to be realized as a high-configuration camera, so that the manufacturing cost of the welding image processing device can be reduced, and meanwhile, high-quality welding images can be obtained.

In addition, the welding image processing device may control the light shielding degree or transmittance of goggles (cartridge) based on the image sensor value of the welding image. Therefore, even in the case where the actual welding light exceeds the range of brightness or illuminance that can be photographed by the camera head, the camera head can generate a high-quality welding image using the light filtered through the goggles.

Drawings

Fig. 1 is a diagram for explaining the structure of a welding system for performing a welding image processing method according to an embodiment of the present invention.

Fig. 2 is a block diagram illustrating structural elements of a welding system according to an embodiment of the present invention.

Fig. 3 shows an internal configuration of a processor of an embodiment of the present invention.

Fig. 4 is a flowchart of a welding image processing method according to an embodiment of the invention.

Fig. 5 is a diagram for explaining an image frame acquired according to a photographing mode according to an embodiment of the present invention.

Fig. 6 is a diagram for explaining an example of a welding processing apparatus according to an embodiment of the present invention.

Fig. 7 is a flowchart for explaining a method of processing a welding image without a photosensor according to an embodiment of the present invention.

Fig. 8 is a flow chart illustrating a method of controlling goggles based on photosensor values in accordance with an embodiment of the invention.

Fig. 9 is a flowchart for explaining a method of controlling a filter position of a welding processing apparatus according to an embodiment of the present invention.

Fig. 10 is a diagram for explaining an example of a mechanical filter control method according to an embodiment of the present invention.

Fig. 11 is a diagram for explaining another example of the mechanical filter control method according to the embodiment of the present invention.

Fig. 12 is a diagram for explaining an example of the movement position of the selected filter according to an embodiment of the present invention.

Fig. 13 is a view for explaining another example of the moving position of the selected filter according to an embodiment of the present invention. DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION

Detailed Description

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. Various modifications may be made to the various embodiments of the invention, and the invention is capable of embodiments, specific embodiments being shown in the drawings and described in detail herein. These are not intended, however, to limit the various embodiments of the invention to the particular implementations, but rather should be understood to include all modifications and/or equivalents or alternatives falling within the spirit and technical scope of the various embodiments of the invention. Like reference numerals are used for like structural elements in connection with the description of the figures.

The expressions "include" or "can include" and the like, which can be used in the various embodiments of the present invention, indicate the presence of corresponding functions, acts, structural elements, or the like, disclosed, and are not limited to more than one function, act, structural element, or the like. Furthermore, in various embodiments of the invention, the terms "comprises" or "comprising," and the like, are used to specify the presence of stated features, integers, steps, acts, structural elements, components, or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, acts, structural elements, components, or groups thereof.

The expressions "first", "second", "first", or "second", etc., used in the various embodiments of the present disclosure may modify various structural elements of the various embodiments, but are not limited to the corresponding structural elements. For example, the description does not limit the order and/or importance of the structural elements, etc. The expression is used only to distinguish one structural element from another. For example, the first user equipment and the second user equipment are both user equipment and represent user equipment that are different from each other. For example, a first component could be termed a second component, and, similarly, a second component could be termed a first component, without departing from the scope of the various embodiments of the present invention.

When it is referred to that a certain component is "connected" or "mounted" to another structural element, it should be understood that the one structural element may be directly connected or connected to the other structural element, but other new structural elements may also exist between the one structural element and the other structural element. Conversely, when reference is made to a certain structural element being "directly connected" or "directly mounted" to another structural element, it is to be understood that no other structural element is present between the certain structural element and the other structural element.

In an embodiment of the present invention, terms such as "unit", "part" and the like are terms referring to structural elements that perform at least one function or operation, and these structural elements may be implemented in hardware or software, or may be implemented in a combination of hardware and software. Furthermore, the terms "unit," "part," and the like may be integrated into at least one module or chip and implemented by at least one processor, unless each "unit," "part," and the like requires separate specific hardware to be implemented.

Terms such as defined in commonly used dictionaries should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in the context of the various embodiments of the invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is a diagram for explaining the structure of a welding system that performs a welding image processing method according to an embodiment of the present invention.

Referring to fig. 1, the welding system of the present invention may include a welding image processing device 100 and a welding torch 200. The welding image processing device 100 and the welding torch 200 may be connected to each other through a communication network to transmit and receive data. The welding image processing apparatus 100 and the welding torch 200 may be operated in a one-to-one matching relationship, but the present invention is not limited thereto, and may be operated in a one-to-n relationship. That is, n welding torches 200 may be connected to one welding image processing apparatus 100, or one welding torch 200 may be connected to n welding image processing apparatuses 100. In addition, the welding image processing device 100 and the welding torch 200 may exchange data by communicating with other servers (not shown).

The welding image processing device 100 may provide information about the welding situation to the operator. Specifically, the welding image processing apparatus 100 may acquire a welding image using at least one camera module included in a camera of the welding image processing apparatus 100, and generate a composite image based thereon and display the image to an operator. At this time, the welding image processing apparatus 100 may generate a composite image using a high dynamic range (HDR, high Dynamic Range) technique, and may display and provide the composite image and/or the composite image with high image quality to an operator. In this case, the operator can visually confirm information about the shape of the weld bead and the surrounding environment except for the portion adjacent to the welding light by using the welding image of high image quality.

In order to synthesize and provide high-quality welding images, the welding image processing apparatus 100 according to an embodiment of the present invention may acquire images through a camera head and display each image through at least one display section. At this time, the welding image processing apparatus 100 may synthesize an image by differently setting each shutter speed of the camera, international organization for standardization (ISO, international Organization for Standardization) sensitivity and Gain (Gain) value, and repeating photographing. The welding image processing apparatus 100 according to an embodiment of the present invention can improve image quality by performing contrast processing on the acquired composite image.

The welding image processing apparatus 100 according to the present invention can provide a function of displaying welding information by using RGB and favorite colors (for example, green and blue). In addition, the welding image processing apparatus 100 of the present invention can provide a magnifying glass diopter correction function (for example, screen enlargement and reduction). In addition, the welding image processing apparatus 100 of the present invention may provide a temperature synthesized image using a separate thermal imaging camera. At this time, the welding image processing apparatus 100 may display the welding temperature in color. The welding image processing apparatus 100 of the present invention can support functions provided in a voice (e.g., guidance alert) or guidance voice manner for all of the above functions.

The welding torch 200 according to an embodiment of the present invention may detect welding conditions including a welding temperature, a welding direction, a welding slope, a welding speed, and a distance between the base metal and the welding torch, etc., associated with a real-time welding operation through at least one sensor. The welding torch 200 may monitor the state of the welding torch and change the set point for the operation of the welding torch based on the welding conditions.

The welding image processing apparatus 100 of the present invention may receive information on operation settings and operation states from the welding torch 200 through a communication network connected to the welding torch 200, and provide operation information to an operator through visual feedback based on the received welding information.

For example, when the welding image processing apparatus 100 receives detection information on the welding temperature value, a prompt corresponding to the temperature value may be output in various manners such as a lamp light, vibration, and message. At this time, the notification may be visual feedback provided on a display or a display of the welding image processing apparatus 100, and may be audible feedback by sound (for example, a guidance alarm) or guidance voice.

On the other hand, the detection information on the temperature value may include information on whether a preset temperature range or the like is exceeded. In addition, the detection information on the temperature value may include a numerical value, a grade, a level, and the like corresponding to the temperature value of the welding surface.

The welding image processing apparatus 100 according to an embodiment of the present invention may guide an operator to stop an operation if it is determined that the temperature values of the welding torch and the welding surface are out of the preset temperature range. When welding is performed beyond a preset temperature range, there is a risk of degradation, so guidance may be provided for the operator to adjust the temperature value of the welding torch.

When an abnormality in the current or voltage state of the welding torch 200 is detected, the welding image processing apparatus 100 according to an embodiment of the present invention may provide visual feedback to warn.

At this time, the visual feedback may be to provide an icon for indicating a hazard to a partial area of the display section of the welding image processing device 100 that is displaying the work site. As another example, the welding image processing apparatus 100 may provide guidance of stopping operation by visual feedback by repeatedly increasing and decreasing the saturation of a specific color (e.g., red) over the entire display section screen.

According to an embodiment of the present invention, the welding image processing device 100 may detect welding information through a sensor (e.g., a first sensor) included in the welding image processing device 100 in addition to at least one sensor (e.g., a second sensor) included in the welding torch 200. At this time, the welding information may detect welding conditions including a light level, a welding temperature, a welding direction, a welding slope, a welding speed, a distance between the base material and the welding torch, etc. related to the real-time welding operation by at least one sensor.

Similarly, the welding image processing apparatus 100 may provide guidance corresponding to welding information based on welding information detected by a sensor (e.g., a first sensor) included in the welding image processing apparatus 100.

According to an embodiment of the present invention, after the guidance on stopping operation is provided, the welding image processing apparatus 100 may change the operation of the welding torch by detecting a preset user operation or a preset user sound, etc.

In still another embodiment, the welding image processing apparatus 100 may acquire temperature values of the welding torch and the welding surface by using an image sensor provided in itself in a state where communication with the welding torch 200 is not clear. As an example, the welding image processing apparatus 100 may acquire temperature values of the welding torch and the welding surface based on image data acquired by a thermal imaging camera.

The above examples only describe the case where the information received from the welding torch 200 is welding temperature information, and the welding image processing apparatus 100 may provide various guidance for various welding information.

Fig. 2 is a schematic block diagram illustrating structural elements of a welding system according to an embodiment of the present invention.

Referring to fig. 2, the welding system 10 may include a welding image processing device 100 and a welding torch 200. The welding image processing apparatus 100 may include a camera 110, an illumination portion 112, a communication portion 120, a display portion 130, a first processor 150, and a sensor portion 140, and the welding torch 200 may include a communication portion 210, a sensor portion 220, and a second processor 230.

The camera head 110 may include at least one camera module, for example, the camera module may include a camera for capturing images of a welding operation site. The camera 110 according to an embodiment of the present invention may be a camera disposed adjacent to the display 130 of the welding image processing apparatus 100. As an example, the first camera and the second camera of the camera head 110 may be symmetrically mounted on one region of the front surface portion of the welding image processing apparatus 100.

The camera head 110 may receive a control instruction from the first processor 150 and change settings such as shutter speed, ISO sensitivity, GAIN, etc. to capture a welding operation scene in response to the control instruction. The camera head 110 may include a first camera and a second camera, and may photograph a welding operation site through different photographing settings, respectively.

The camera head 110 according to an embodiment of the present invention may include a region at a front surface of the display part 130, and may be a structure in which light blocking goggles are located in front of a lens that receives light from a photographing object.

The automatic light blocking goggles can block welding light generated by an operator during welding. That is, the automatic light blocking goggles (not shown) may be blackened by welding light information detected by the sensor section 140 (e.g., an image sensor or a photosensor), so that the shade of the goggles may be increased. At this time, for example, the automatic light blocking goggles may include a liquid crystal panel (LCD panel) that may adjust the blackening degree according to the alignment direction of the liquid crystal. However, it is not limited thereto, and may be implemented by various panels such as a Vertically Aligned (VA) mode Liquid Crystal Display (LCD), a Twisted Nematic (TN) mode LCD, and an in-plane switching (IPS, in Plane Switching) mode LCD.

The blackening degree of the automatic light blocking goggles can be automatically adjusted according to the brightness of welding light. As described above, the sensor section 140 may be utilized when automatically adjusting according to the brightness of the welding light. When the sensor section 140 acquires welding light information by detecting the brightness of the welding light and transmits information of the brightness of the welding light included in the welding light information as a predetermined electric signal to the first processor 150 described later, the first processor 150 can control the blackening degree based on the brightness of the welding light.

That is, an automatic light blocking visor (not shown) may change the shade of the panel in real time so that the camera head 110 may capture a welding image having a certain amount of welding light blocked by the automatic light blocking visor provided at the front surface portion corresponding to the brightness of light generated from the welding mask at the welding operation site.

According to another embodiment of the present invention, the welding image processing device 100 may not include automatic light blocking goggles. In this case, the user can perform the welding operation only through the welding image acquired by the camera head 110.

The camera head 110 according to an embodiment of the present invention may include a thermal imaging camera. The welding image processing apparatus 100 may synthesize a thermal imaging image obtained by a thermal imaging camera with an image of a welding site to obtain a temperature image.

According to an embodiment of the present invention, the illumination portion 112 may be further included to be electrically connected with the first processor 150. The illumination section 112 is located outside the welding image processing apparatus 100, and is configured to irradiate light at least toward a welding operation region. The illumination section 112 may include a plurality of LED modules, and the output of the light irradiated through the illumination section 112 may be adjusted by the control of the first processor 150. According to an embodiment, the illumination portion 112 may operate in conjunction with the camera head 110 according to the control of the first processor 150. Later, more detailed embodiments will be described.

The communication section 120 is configured to receive welding information from the welding torch 200 and transmit instructions for controlling the welding torch 200. According to an embodiment of the present invention, the communication section 120 may transmit the composite image to an external device other than the welding torch 200. At this time, the external device may include a smart phone of an operator/a third party, a computer, etc. including various devices of the communication module.

The communication section 120 may be configured to perform communication with various types of external devices according to various types of communication methods. The communication part 120 may include at least one of a wifi chip, a bluetooth chip, a wireless communication chip, and an NFC chip. In particular, in the case of using a wifi chip or a bluetooth chip, various connection information such as a service set identifier (SSID, service Set Identifier) and a session key can be transmitted and received first, and various information can be transmitted and received after a communication connection is established using the same. The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, zigbee, third generation mobile communication technology (3G,3rd Generation), third generation partnership project (3GPP,3rd Generation Partnership Project), long term evolution (LTE, long Term Evolution), and the like. The NFC chip is a chip that operates in a near field communication (NFC, near Field Communication) mode using the 13.56MHz band among various RF-ID bands such as 135kHz, 13.56MHz, 433MHz, 860 to 960MHz, and 2.45 GHz.

The display unit 130 is configured to provide a high-quality composite image to an operator. Specifically, the display section 130 may be implemented in the form of goggles, which include a display for displaying a synthesized image, which synthesizes images acquired through the camera head 110, to an operator.

According to an embodiment of the present invention, the rear surface portion of the display portion 130, i.e., the portion facing the operator, may include a display for displaying high-quality images to the operator, and an eyepiece lens and an eyepiece portion for viewing the display.

The display included in the display unit 130 may display a high-quality composite image so that the operator can visually confirm the surrounding environment (for example, the shape of the processed bead) except for the portion adjacent to the welding light. In addition, the display unit 130 may guide the operator by visual feedback of the welding progress state (for example, the welding progress direction).

The display included in the display part 130 may be implemented using various display technologies such as a liquid crystal display (LCD, liquid Crystal Display), an organic electro-laser display (OLED, organic Light Emitting Diodes), a Light-Emitting Diode (LED), a liquid crystal on silicon (LcoS, liquid Crystal on Silicon), or a digital Light processing (DLP, digital Light Processing). At this time, the display according to an embodiment of the present invention is implemented as a panel made of an opaque material, and an operator may not be directly exposed to harmful light. However, the present invention is not necessarily limited thereto, and the display may be provided as a transparent display.

The sensor section 140 may include a plurality of sensor modules configured to detect various information about a welding site and acquire welding information. In this case, the welding information may include a welding temperature, a welding direction, a welding slope, a welding speed, an interval between the base material and the welding torch, and the like, which are related to the real-time welding operation. Further, the sensor portion 140 may include a photosensor module configured to detect at least a light level within the welding operation region.

According to an embodiment of the present invention, the sensor part 140 may include an illuminance sensor (illuminance sensor), at which time the sensor part 140 may acquire information related to the welding light brightness of the welding site. The Sensor part 140 may include various types of sensors, such as a proximity Sensor (proximity Sensor), a Noise Sensor (Noise Sensor), a Video Sensor (Video Sensor), an ultrasonic Sensor, a Radio Frequency (RF) Sensor, an optical Sensor, and may detect various changes related to the welding operation environment, in addition to the illuminance Sensor (illuminance Sensor).

The first processor 150 may synthesize the welding image frames received from the camera head 110 to generate a high-quality synthetic image. The first processor 150 may set different photographing conditions for each frame of the camera section 110 and obtain a composite image by synthesizing the time-sequentially acquired frames in parallel. Specifically, the first processor 150 may control the camera 110 to capture by changing the shutter speed, ISO sensitivity, gain, and the like of the camera 110.

At this time, the first processor 150 may set different photographing conditions according to conditions of the detected welding light of the welding site, the ambient light, the degree of movement of the welding torch 200, and the like. Specifically, the first processor 150 may set the photographing conditions such that ISO sensitivity and gain decrease with an increase in welding light and/or ambient light of the welding site. In addition, if the movement and/or the operation speed of the welding torch 200 is detected to be fast, photographing conditions may be set to increase the door speed.

The first processor 150 may synthesize images of a predetermined number of frames in parallel. According to an embodiment of the present invention, each image in the preset frame may be photographed under different photographing conditions.

According to an embodiment of the present invention, when there are more than two camera heads 110, the first processor 150 may control photographing by setting different photographing setting conditions for each camera head. In this case, the first processor 150 may also synthesize images of a predetermined number of frames in parallel.

In addition, the first processor 150 according to some embodiments of the present invention receives a sensor value from the welding device, sets a photographing mode of the camera module to a first mode or a second mode based on the sensor value, and acquires an image frame about a welding site from the camera module, and may acquire an infrared image frame about the welding site when the photographing mode of the camera module is set to the first mode.

The first processor 150 may control the overall operation of the welding image processing apparatus 100 using various programs stored in a memory (not shown). For example, the first processor 150 may include a CPU, a Random Access Memory (RAM), a Read Only Memory (ROM), a system bus. Wherein the ROM is configured to store an instruction set for starting up the system, the CPU copies an operating system stored in a memory of the welding image processing apparatus 100 into the RAM according to the instruction stored in the ROM, and runs the O/S to start up the system. After the startup is completed, the CPU copies various application programs stored in the memory to the random access memory and runs to perform various operations. Although it has been described above that the first processor 150 includes only one CPU, it may be implemented with a plurality of CPUs (or DSPs, socs, etc.).

According to an embodiment of the present invention, the first processor 150 may be implemented as a digital signal processor (digital signal processor, DSP), a microprocessor (micro processor) and/or a Time Controller (TCON) for processing digital signals. But are not limited thereto, may include one or more of a central processing unit (central processing unit, CPU), a microcontroller (Micro Controller Unit, MCU), a micro processing unit (MPU, micro processing unit), a controller, an application processor (application processor, AP) or a communication processor (communication processor, CP), an advanced reduced instruction set machine (Advanced RISC Machine, ARM) processor, or may be defined by corresponding terms. In addition, the first processor 150 may be implemented as a System on Chip (SoC) and a large scale integrated circuit (large scale integration, LSI) with built-in processing algorithms, or may be implemented as a field programmable gate array (Field Programmable gate array, FPGA).

The welding torch 200 may include a communication portion 210, a sensor portion 220, and a second processor 230.

The communication unit 210 transmits data to the welding image processing apparatus 100 and receives data from the welding image processing apparatus 100. The communication part 210 may include a module capable of short-range wireless communication (e.g., bluetooth, wifi-Direct (Wifi Direct)) or long-range wireless communication (3G, high-speed downlink packet access (HSDPA, high-Speed Downlink Packet Access), or long term evolution (LTE, long Term Evolution)).

The sensor unit 220 or the second sensor is included in the welding torch, and is configured to detect welding conditions such as a welding temperature, a welding speed, a welding slope, a welding direction, and an interval between the base material and the welding torch.

The sensor part 220 may detect at least one of various changes such as a change in posture of a user holding the welding torch 200, a change in illuminance of a welding surface, a change in acceleration of the welding torch 200, and the like, and transmit an electrical signal corresponding thereto to the second processor. That is, the sensor unit 220 may detect a state change based on the welding torch 200, generate a detection signal based on the state change, and transmit the detection signal to the second processor 230.

In the present invention, the sensor part 220 may include various sensors, and may supply power to at least one sensor preset according to control (or based on user settings) to detect a state change of the welding torch 200 when the welding torch 200 is driven.

In this case, the sensor unit 220 may include at least one of all types of detection devices (sensing devices) capable of detecting a state change of the welding torch 200. For example, the Sensor unit 220 may include at least one Sensor among various sensing devices such as an acceleration Sensor (Acceleration Sensor), a Gyro Sensor (Gyro Sensor), an illuminance Sensor (illuminance Sensor), a proximity Sensor (proximity Sensor), a pressure Sensor (pressure Sensor), a Noise Sensor (Noise Sensor), a Video Sensor (Video Sensor), and a weight Sensor. The light level within the welding operation area detected by the illuminance sensor of the welding torch 200 may be transmitted to the first processor 150 through the communication part 210, and the first processor 150 may control the illumination part 112 and/or the camera part 110 based on the illuminance sensor of the welding torch 200 instead of the light level transmitted through the sensor part 140 of the welding image processing apparatus 100.

On the other hand, the acceleration sensor is a component for detecting movement of the welding torch 200. Specifically, the acceleration sensor may measure dynamic forces such as acceleration, vibration, shock, etc. of the welding torch 200, and thus, may measure movement of the welding torch 200.

The gravity sensor is a structural element for detecting the direction of gravity. That is, the detection result of the gravity sensor may be used together with the acceleration sensor to determine the movement of the welding torch 200. In addition, the direction in which the welding torch 200 is held may be determined by a gravity sensor.

In addition to the types of sensors described above, the welding torch 200 may also include various types of sensors, such as a gyroscopic sensor, a geomagnetic sensor, an ultrasonic sensor, and an RF sensor, and may detect various changes related to the welding operation environment.

Fig. 3 shows an internal configuration of the first processor 150 of the welding image processing apparatus 100 according to an embodiment of the present invention.

Hereinafter, referring to fig. 3, a detailed review of the structure of the first processor 150 according to an embodiment of the present invention will be made. For ease of understanding, it is assumed that the processor described below is the first processor 150 of the welding image processing apparatus 100 shown in fig. 2, but it should be noted that in another embodiment, when the welding image processing method is performed on the welding torch 200, the welding image processing method described below may be performed by the second processor 230, and in yet another embodiment, when the welding image processing method is performed on an external server, the processor described below may be a processor of the external server.

The first processor 150 of the welding image processing apparatus 100 according to an embodiment of the present invention includes a sensor value receiving section 151, a photographing mode setting section 152, and an image frame acquiring section 153. According to some embodiments, structural elements of the first processor 150 described above are optionally included in or excluded from the processor. Additionally, according to some embodiments, structural elements of the processor may be separated or combined to express the functionality of the processor.

Such a processor 150 and structural elements of the processor 150 may control the welding image processing apparatus to perform steps (S110 to S150) included in the welding image processing method of fig. 4. For example, the processor 150 and structural elements of the processor 150 may be implemented as operating system code included in a memory (not shown) and commands (instructions) executed according to at least one program code. Here, the constituent elements of the processor 150 may be representations of different functions (different functions) of the processor 150 that are executed by the processor 150 in accordance with commands provided by program codes stored in the welding image processing apparatus 100. The internal structure and specific operation of the processor 150 will be described with reference to the welding image processing method of fig. 4 and the embodiments of fig. 5 to 10.

In step S110, the welding image processing device may receive a sensor value from the welding device. More specifically, the welding image processing device may receive a sensor value from the smoke detection sensor that is related to the degree of smoke generation at the welding site.

In step S120, the welding image processing apparatus may set the photographing mode of the camera module to the first mode or the second mode based on the sensor value. In an embodiment, the first mode may be an infrared shooting mode, and the second mode may be a visible light shooting mode. In this embodiment, the welding image processing device may send a setting signal of the first mode or the second mode to the camera.

In step S130, the welding image processing device may confirm whether the photographing mode of the camera module is set to the first mode. When the sensor value is above the critical value, the welding image processing device may set the shooting mode of the camera module to the first mode, and when the sensor value is less than the critical value, the shooting mode of the camera module may be set to the second mode. In an embodiment, the welding image processing apparatus may perform step S140 when the sensor value is above the threshold value, and in an alternative embodiment, the welding image processing apparatus may perform step S150 when the sensor value is below the threshold value.

In step S140, the welding image processing device may acquire an infrared image frame of the welding portion. In an embodiment, when the photographing mode is set to the first mode, the welding image processing apparatus may acquire the infrared image frame from the camera module including the infrared transmission filter.

That is, the method of acquiring the infrared image frame is not limited. For example, the infrared image frame may be acquired by disposing an infrared transmission filter in front of a camera included in the welding image processing apparatus, or may be acquired by an electronically set infrared shooting mode.

In step S150, the welding image processing apparatus may acquire an image frame of the welding portion. That is, in the present embodiment, the welding image processing apparatus can acquire a visible light image frame of the welding portion.

In one embodiment, the welding image processing device 100 receives a sensor value related to the smoke generation degree of the welding site, and may acquire the visible light image frame 301 or the infrared image frame 302 according to the sensor value.

More specifically, the welding image processing apparatus 100 may set the photographing mode of the camera to the first mode or the second mode based on the above-described sensor values. In one embodiment, the photographing mode of the camera may be set in response to a user input of an operator performing the welding process, but according to another embodiment, the photographing mode of the camera may be set based on whether the above-described sensor value exceeds a standard value.

According to some embodiments of the present invention, a photographing mode of a camera is automatically set based on a sensor value, so that a welding image most suitable for a surrounding environment can be acquired without additional operation of a user.

Hereinafter, a method of acquiring an infrared image frame using an infrared transmission filter will be described in detail.

The welding image processing device may receive a sensor value from the smoke detection sensor that is related to a smoke generation level of the welding site.

When the sensor value is above the critical value, the welding image processing device sets the photographing mode of the camera module to the first mode, and in an embodiment, when the photographing mode is set to the first mode, the welding image processing device may acquire the infrared image frame from the camera module including the infrared transmission filter.

The welding image processing device according to an embodiment can acquire infrared image frames by configuring an infrared transmission filter in front of a camera.

That is, the welding image processing apparatus superimposes a plurality of filters on the front of the camera, thereby transmitting only light in a predetermined wavelength band. For example, the camera filter may be designed such that light passes through the filter only in the infrared band.

For example, the infrared transmission filter may include a long-pass filter and a band-pass filter, but is not limited thereto.

The welding image processing apparatus 100 may generate a light transmission of only a wavelength of a predetermined frequency band using the welding filter. Accordingly, the welding image processing apparatus 100 acquires various optimized image frames using various filters satisfying various standards.

In one embodiment, the welding image processing apparatus 100 may further include a filter that meets a specific security standard. In one embodiment, the welding image processing device may be provided with a filter conforming to international uv security standards. The welding image processing apparatus according to the present embodiment can ensure the safety of an operator by satisfying the ultraviolet safety standard (CE, ANSI).

On the other hand, the camera of the welding image processing apparatus 100 may include an image sensor. Alternatively, goggles of the welding image processing apparatus 100 may include a photosensor. Alternatively, the welding image processing device 100 may include both an image sensor and a photosensor. Hereinafter, as sensors included in the welding image processing apparatus 100, an image sensor and a photoelectric sensor are described as examples, but the present invention is not limited thereto. In other words, the welding image processing apparatus 100 may include various types of optical sensors, and any type of sensor may be used as long as it is a sensor that performs detection for controlling the transmittance of goggles.

The welding image processing device 100 may control the transmittance of the goggles based on the sensor values of the image sensor and/or the sensor values of the photo sensor. Here, the action of controlling the transmittance of the goggles means an action of increasing or decreasing the shade by adjusting the blackening degree of the goggles.

Typically, the brightness of the welding light generated during the welding operation is higher than the brightness of light in the normal environment (e.g., sunlight). Therefore, in order to capture a welding image, a camera having a higher specification than a normal camera is required. On the other hand, as the specifications of cameras are increased, the price of cameras is increased, and thus the manufacturing cost of a welding image processing apparatus including high-specification cameras is also necessarily high.

According to the welding image processing apparatus 100 of an embodiment of the present invention, goggles are disposed on the front surface of the camera, and the transmittance of the goggles is controlled according to the sensor values of the image sensor and/or the photoelectric sensor. Therefore, the camera of the welding image processing apparatus 100 can capture a high-quality welding image with only a normal camera.

Therefore, according to an embodiment of the present invention, the camera head of the welding image processing apparatus 100 does not need to be implemented as a high-specification camera, so that the manufacturing cost of the welding image processing apparatus 100 can be reduced, and a high-quality welding image can be obtained.

An example of an image sensor and a photoelectric sensor included in the welding image processing apparatus 100 is described below with reference to fig. 6.

Fig. 6 is a diagram for explaining an example of a welding processing apparatus according to an embodiment of the present invention. Referring to fig. 6, the welding image processing apparatus 100 includes: a main body 160; a display unit 130 provided on the front surface of the main body 160; the camera head 110 is mounted on the outside of the main body. In addition, although not shown in fig. 6, as described with reference to fig. 2, the welding image processing device 100 may further include an illumination section 112, a communication section 120, a sensor section 140, and a processor 150.

Camera head 110 may be implemented as more than one camera head. As an example, when the camera 110 is implemented as a single camera, the single camera may be disposed at one region of the main body 160. As another example, when the camera head 110 is implemented as a plurality of cameras, the camera head 110 may be symmetrically disposed at one region of the body 160. However, the position where the camera head 110 is disposed in the welding image processing apparatus 100 is not limited to a specific position. In addition, the camera head 110 may be detachably implemented by changing the position as needed.

The front surface of the display portion 130 may be an outer area (an area shown in fig. 1) corresponding to the welding operation proceeding direction. In contrast, the back surface of the display portion 130 may be an inner area corresponding to the face direction of the operator.

As described with reference to fig. 5, the welding image processing apparatus 100 includes goggles in which transmittance can be controlled. For example, goggles may be arranged on the front surface of the camera head 110. Thus, light filtered through goggles (including welding light) is received by camera head 110, and camera head 110 may generate a welding image from the filtered light.

In addition, as described with reference to fig. 5, the sensor section 140 includes an image sensor and/or a photosensor. For example, the image sensor may be included in the camera head 110, or may be disposed adjacent to the camera head 110. In addition, the photosensor may be included in the goggles, or may be disposed adjacent to the goggles. Accordingly, the image sensor and/or the photosensor can accurately detect the brightness of light at the point at which the camera head 100 is looking.

Hereinafter, an example of controlling transmittance of goggles based on a sensor value of an image sensor or a sensor value of a photoelectric sensor will be described with reference to fig. 7 and 8.

In step S111, the welding image processing apparatus 100 may acquire a welding image. Thereafter, in step S112, the welding image processing device 100 may acquire a sensor value related to the welding image acquired from the image sensor. In addition, in step S113, the welding image processing device may control the transmittance of the goggles based on the image sensor value.

According to the present embodiment, the welding image processing apparatus 100 can control the shade or transmittance of the goggles based on the image sensor values of the welding images described above. For example, the image sensor of the welding image processing apparatus 100 may measure the brightness of the welding light based on the welding image. When the measured brightness of the welding light is above the critical value, the welding image processing apparatus 100 may increase the shading degree of the goggles by adjusting the blackening degree of the goggles. Therefore, even in the case where the actual welding light exceeds the range of brightness or illuminance that can be photographed by the camera head 110, the camera head 110 can generate a high-quality welding image using the light filtered through the goggles.

When the exposure amount of the welding camera is adjusted by using the neutral density filter (Neutral Density Filter), there is an inconvenience of using filters of different densities according to circumstances, and there is a limit in that the exposure amount cannot be finely adjusted. The welding image processing apparatus 100 according to an embodiment of the present invention controls the transmittance of goggles based on the photosensor values, so that an optimal welding image of a welding portion can be obtained by adjusting the exposure in real time.

For example, in step S210, the welding image processing device 100 may acquire a photosensor value of a welding image in photographing. In step S220, the welding image processing apparatus 100 may determine whether the photosensor value exceeds a specified critical section.

If the photosensor value exceeds the specified critical interval, the welding image processing apparatus 100 may control the transmittance of the goggles based on the photosensor value in step S230. Alternatively, when the photosensor value is included in the specified critical section, the welding image processing apparatus 100 may not additionally perform a process of controlling the transmittance of the goggles. In step S240, the welding image processing apparatus 100 may acquire a welding image of the welding portion using the light filtered through the goggles.

As described with reference to fig. 7 and 8, the welding image processing apparatus 100 can acquire an optimal welding image of a welding environment even if a low-cost camera module having a wide brightness range is used.

On the other hand, as described with reference to fig. 2, the welding image processing apparatus 100 may include an automatic light blocking goggle, but is not limited thereto. In other words, the welding image processing apparatus 100 includes a plurality of filters having a predetermined shade, and the plurality of filters may be changed in position according to mechanical control.

For example, the welding image processing apparatus 100 determines a welding environment, and may select any one of a plurality of filters according to the welding environment. In addition, the welding image processing apparatus 100 may drive a motor for changing the position of the filter so that the selected filter is moved to a prescribed position.

Hereinafter, an example in which any one of a plurality of filters is selected and the selected filter position is controlled by the welding image processing apparatus 100 will be described with reference to fig. 9 to 13.

In step S310, the welding image processing apparatus 100 determines a welding environment.

The processor 150 may determine the welding environment through the sensor portion 140. For example, an optical sensor (e.g., an image sensor, a photoelectric sensor, etc.) included in the sensor section 140 detects welding light generated when welding is performed, and the processor 150 may determine a welding environment based on the detected welding light.

Here, determining the welding environment includes determining that welding is started or determining that the brightness of the welding light has changed.

When a welding arc is generated with the start of welding, the sensor part 140 may detect welding light according to the welding arc. The welding arc emits very bright light compared to light in a normal environment. Therefore, when the sensor section 140 detects light brighter than normal light, the processor 150 can determine that welding has started. For example, when the brightness of the light detected by the sensor section 140 exceeds a prescribed value, the processor 150 may determine that welding has started. However, the method of the processor 150 determining the time of the start of welding is not limited to the above-described example.

Even during the welding, the brightness of the welding light may vary depending on various conditions such as the welding temperature, the welding speed, the welding inclination, the welding direction, and the interval between the base material and the welding torch. Accordingly, the processor 150 can determine a change in brightness of the welding light from the light detected by the sensor section 140.

An example of the processor 150 determining the welding environment by the sensor portion 140 is described with reference to fig. 7 and 8.

In step S320, the welding image processing apparatus 100 selects any one of the plurality of filters based on the welding environment.

Here, the plurality of filters may represent each preset shade. In other words, each filter may have a predetermined degree of light transmission (i.e., transmittance of light). For example, the optical filter may be implemented by bonding an optical filter to a neutral density filter (Neutral Density Filter), but is not limited thereto.

As another example, the filter may previously determine a frequency band in which light is filtered. For example, the filter may be implemented by coating a prescribed material on a filter of a glass material, but is not limited thereto. The frequency band of light passing through the filter may be determined or varied according to the coating described above.

The processor 150 selects a filter capable of filtering welding light corresponding to a current welding environment from among a plurality of filters. As described in step S310, the brightness of the welding light may vary with the start of welding or with the change in welding environment. Therefore, only when an appropriate filter is selected corresponding to the brightness of the welding light, the camera head 110 can generate a high-quality welding image using the welding light filtered through the filter. Here, the welding light filtering by the filter means to filter the transmittance and/or the transmission band of the welding light so as to include the brightness or illuminance that can be photographed at the camera head 110.

In step S330, the welding image processing apparatus 100 drives the motor to move the selected filter to a predetermined position.

As an example, the processor 150 may move the selected filter to a predetermined position by driving the motor to linearly move the plurality of filters. As another example, the processor 150 may move the selected filter to a predetermined position by rotationally moving the plurality of filters by driving the motor. Referring to fig. 10 and 11, an example in which the processor 150 moves the position of the filter by driving the motor will be described.

As described with reference to step S320, the plurality of filters respectively represent a preset shade, and an appropriate filter is selected from the plurality of filters based on the welding environment. In other words, the filter for filtering the welding light is selected so that a high-quality welding image can be generated by the camera head 100. Therefore, the selected filter should be positioned to filter the welding light before the welding image is generated.

The processor 150 confirms where the selected filter is currently located. In addition, the processor 150 drives the motor so that the selected filter is moved to a prescribed position.

As an example, the predetermined position may be between the lens of the camera head 110 and the image sensor. As another example, the predetermined position may be on the front surface of the lens of the camera head 110. With reference to fig. 12 and 13, an example of the prescribed position will be described.

Fig. 10 shows a part of the structure of the welding image processing apparatus 100. For example, the welding image processing apparatus 100 includes a PCB1010, a motor 1020, a filter moving part 1030, filters 1041, 1042, 1043, and an image sensor 1050.

Referring to fig. 10, filters 1041, 1042, 1043 are arranged in series on the filter moving section 1030. Accordingly, the processor 150 drives the motor 1020 to move the filter moving part 1030 linearly (e.g., left and right or up and down), thereby changing the positions of the filters 1041, 1042, 1043.

For example, when the processor 150 selects the filter 1043 from the filters 1041, 1042, 1043, the processor 150 may confirm the current position of the filter 1043 and drive the motor 1020 such that the filter 1043 is located on the image sensor 1050.

On the other hand, although the filter 1043 is shown on the image sensor 1050 in fig. 10, it is not limited thereto. An example of the position where the filter 1043 moves will be described with reference to fig. 12 and 13.

Fig. 11 shows a part of the structure of the welding image processing apparatus 100. For example, the welding image processing apparatus 100 includes a PCB1110, a motor 1120, a filter moving portion 1130, filters 1141, 1142, 1143, 1144, and an image sensor 1150.

Referring to fig. 11, filters 1141, 1142, 1143, 1144 are arranged in a circular shape on the filter moving portion 1130. Accordingly, the processor 150 drives the motor 1120 to rotate the filter moving part 1130, thereby changing the positions of the filters 1141, 1142, 1143, 1144.

For example, when the processor 150 selects the filter 1143 from the filters 1141, 1142, 1143, 1144, the processor 150 may confirm the current position of the filter 1143 and drive the motor 1120 such that the filter 1143 is located on the image sensor 1150.

On the other hand, although the filter 1143 is shown on the image sensor 1150 in fig. 11, it is not limited thereto. An example of the position where the filter 1143 moves will be described with reference to fig. 12 and 13.

Fig. 12 shows a part of the structure of the welding image processing apparatus 100. For example, the welding image processing apparatus 100 includes a PCB1210, a motor 1220, a filter 1230, a lens 1240, and an image sensor 1150. The PCB1210, the motor 1220, the filter 1230, and the image sensor 1250 shown in fig. 12 are shown in fig. 10 and 11.

Lens 1240 refers to a lens included in camera head 110. The filter 1230 is a filter selected by the processor 150 from a plurality of filters.

As described with reference to fig. 9 to 11, the filter 1230 has a shade degree of appropriately filtering the welding light so that the camera head 110 can generate a high-quality welding image. Accordingly, the filter 1230 should be moved to a position where the camera head 110 can generate a welding image from the filtered welding light.

The processor 150 moves the filter 1230 to a prescribed position by driving the motor 1220. For example, processor 150 may drive motor 1220 to position filter 1230 on the front surface of lens 1240. Accordingly, the image sensor 1250 may detect the light filtered through the filter 1230.

Fig. 13 is a view for explaining another example of the moving position of the selected filter according to an embodiment of the present invention.

Fig. 13 shows a part of the structure of the welding image processing apparatus 100. For example, the solder image processing apparatus 100 includes a PCB1310, a motor 1320, a filter 1330, a lens 1340, and an image sensor 1350. The PCB1310, motor 1320, optical filter 1330, lens 1340 and image sensor 1350 shown in fig. 13 are as shown in fig. 12.

The processor 150 moves the filter 1330 to a prescribed position by driving the motor 1320. For example, the processor 150 may position the optical filter 1330 between the lens 1340 and the image sensor 1350 by driving the motor 1320. Accordingly, the image sensor 1350 may detect the light filtered through the filter 1330.

All embodiments described in the present specification can be applied to other embodiments in combination with each other.

On the other hand, the welding image processing apparatus 100 of the above-described embodiment exemplifies a case for a welding operation, but the present invention is not necessarily limited thereto. That is, the welding image processing device 100 of the above-described embodiment may be implemented as an information providing device that can be used in accordance with the above-described configuration for, for example, a fire-fighting, medical, and/or skin treatment information providing device. That is, when performing a light irradiation operation of high brightness/high illuminance such as laser light, a user provides an environment capable of obtaining an optimal image with reduced unnecessary power waste by adjusting the output of the illumination section according to circumstances using the information providing apparatus for fire control, medical treatment, and/or skin treatment according to the above. In addition, the present invention can be used as an information providing apparatus in various operations for performing an operation of irradiating light of high brightness/high illuminance.

As described above, although the present invention has been described with reference to the embodiments shown in the drawings, it is to be understood that this is by way of example only and that various modifications and equivalent other embodiments may be made by one of ordinary skill in the art. Therefore, the true technical protection scope of the present invention should be subject to the technical spirit of the appended claims.

Claims

1. A welding image processing device, which includes:

The camera head captures the welding parts;

Goggles, configured adjacent to the camera module; and

processor,

The processor configuration is:

The transmittance of the goggles is controlled based on a sensor value received from a sensor, and a welding image is acquired using the camera head based on light passing through the goggles whose transmittance is controlled.

2. The welding image processing device according to claim 1, wherein,

The sensor includes an image sensor,

the image sensor generates sensor values related to images captured by the camera head,

The processor uses the sensor value to control the transmittance of the goggles.

3. The welding image processing device according to claim 1, wherein,

The sensor includes a photoelectric sensor,

the photoelectric sensor generates a sensor value associated with an image captured by the camera head,

4. The welding image processing device according to claim 1, wherein,

The processor configuration is:

setting the shooting mode of the camera head to a first mode or a second mode among a plurality of shooting modes based on the sensor value,

The first mode includes a mode that uses infrared light to generate the welding image,

The second mode includes a mode using visible light to generate the welding image.

5. The welding image processing device according to claim 4, wherein,

The sensors include smoke detection sensors,

The processor sets a shooting mode of the camera head based on sensor values received from the smoke detection sensor.

6. A welding image processing method, which is executed by a computing device, including:

The step of receiving sensor values from the sensor;

the step of controlling the transmittance of the goggles based on the received sensor values; and

The step of acquiring a welding image based on the light passing through the goggles whose transmittance is controlled.

7. The welding image processing method according to claim 6, wherein,

The sensor includes an image sensor,

The receiving steps include:

The step of receiving sensor values associated with images captured by the camera head.

8. The welding image processing method according to claim 6, wherein,

The sensor includes a photoelectric sensor,

The receiving steps include:

9. The welding image processing method according to claim 6, further comprising:

the step of setting the shooting mode of the camera head to a first mode or a second mode among a plurality of shooting modes based on the sensor value,

10. The welding image processing method according to claim 9, wherein,

The sensors include smoke detection sensors,

The setting steps include:

The step of setting a shooting mode of the camera head based on a sensor value received from the smoke detection sensor.