WO2025091409A1 - 视觉检测系统及方法 - Google Patents
视觉检测系统及方法 Download PDFInfo
- Publication number
- WO2025091409A1 WO2025091409A1 PCT/CN2023/129428 CN2023129428W WO2025091409A1 WO 2025091409 A1 WO2025091409 A1 WO 2025091409A1 CN 2023129428 W CN2023129428 W CN 2023129428W WO 2025091409 A1 WO2025091409 A1 WO 2025091409A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- verification
- visual
- image
- visual inspection
- host computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/93—Detection standards; Calibrating baseline adjustment, drift correction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/27—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using photo-electric detection ; circuits for computing concentration
- G01N21/274—Calibration, base line adjustment, drift correction
- G01N21/276—Calibration, base line adjustment, drift correction with alternation of sample and standard in optical path
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8887—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/93—Detection standards; Calibrating baseline adjustment, drift correction
- G01N2021/936—Adjusting threshold, e.g. by way of moving average
Definitions
- the present application relates to the technical field of visual inspection.
- the existing production line inspection method solves the problem that the inspection time is too long.
- the present application provides a visual inspection system, wherein the visual inspection system comprises:
- a visual inspection device comprising a verification piece and a verification piece moving device, wherein the verification piece moving device comprises a movably mounted mounting plate, wherein the mounting plate can be located at a verification position during the movable travel of the mounting plate, wherein the verification position is within the detection range of the visual inspection device, and wherein the verification piece is arranged on the mounting plate;
- a visual inspection device used to obtain an image of the verification piece and send the image of the verification piece to a host computer
- the host computer is used to determine the systematic verification result of the visual inspection device according to the image of the verification part.
- the calibration parts when performing system calibration, are concentrated on the mounting plate, and the mounting plate is driven to move the calibration parts, thereby adopting an automatic method to achieve fully automatic calibration, thereby solving the problem of long calibration time and large production capacity loss caused by the operator's proficiency.
- the verification member includes a plurality of size verification parts with gradient-changing sizes and a color card verification part with gradient-changing grayscale values;
- the visual inspection device is further used to obtain a first image of the size verification unit and a second image of the color card verification unit, and send the first image and the second image to a host computer;
- the host computer is further used to determine a systematic verification result of the visual inspection device according to the first image and/or the second image.
- a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
- the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
- the accuracy error caused by the distortion of the 2D camera lens can be verified, and on the basis of realizing the accuracy verification, the algorithm verification is further performed, thereby realizing the systematic verification of the visual inspection device.
- the verification piece can be detachably mounted on the mounting plate.
- a quick-release locking method of the calibration component is realized by a detachable component on the calibration component mounting plate, which is convenient for true value measurement of a two-dimensional or higher-precision measurement system.
- the visual verification device further comprises:
- the driving device comprises a fixed part and a movable part which can move linearly relative to each other, the fixed part is arranged on the supporting base, and the movable part is connected to the mounting plate.
- the movement of the verification piece is achieved by driving, thereby realizing full-automatic verification of the visual inspection device.
- the visual verification device also includes a sliding guide structure, which includes a slide rail and a slider that slide with each other, and the slide guide structure includes a slide rail and a slider that slide with each other, and the slide rail and the slider are arranged between the support base and the mounting plate.
- the movement trajectory of the verification piece mounting plate is determined by the sliding device, thereby improving the accuracy of the movement of the verification piece.
- the visual inspection device further includes an adapter, two of the sliders are provided, and two corresponding sliders are provided;
- One group of the slide rails and the sliding blocks that cooperate with each other is arranged between the support base and the adapter seat, and the other group of the slide rails and the sliding blocks is arranged between the mounting plate and the adapter seat.
- the movement of the mounting plate is achieved through multiple sets of sliding devices, thereby achieving precise control of the movement of the mounting plate.
- the verification element includes:
- a plurality of dimension verification parts are arranged on the verification surface at intervals along a straight line direction, and the plurality of dimension verification parts have a length dimension in a first direction and a width dimension in a second direction, and the length dimensions of the plurality of dimension verification parts vary in a gradient, and/or the width dimensions of the plurality of dimension verification parts vary in a gradient, wherein the first direction and the second direction are directions perpendicular to each other in a horizontal plane.
- a plurality of dimension verification parts with gradient changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
- the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints passing through the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
- the accuracy error caused by the distortion of the 2D camera lens can be verified, thereby improving the accuracy of visual inspection.
- the size verification portion includes a protrusion or a groove formed on the plate body.
- the size information of the grooves, protrusions, etc. on the verification piece is obtained to determine whether it is within a reasonable error range with the predetermined size information, so as to achieve camera accuracy verification.
- the sizes of the plurality of size verification parts along the third direction vary in a gradient manner.
- a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools and ensures that the linear offset of the measuring tool is verified.
- it also includes a color card calibration part with a gradient grayscale value disposed on the calibration surface of the board body.
- the calibration of the imaging effect is achieved by providing a colorimetric card on the calibration piece.
- the color card of the calibration piece requires that the black and white camera be equipped with three gradient standard color cards of light gray, gray and dark gray, so as to achieve the calibration of the imaging effect of the black and white camera.
- the color card verification unit includes a three-primary color card.
- the color camera is equipped with an RGB three-primary color card to verify the imaging effect of the color camera.
- the material of the plate body includes aluminum alloy; and/or,
- the material plate of the plate body includes aluminum alloy, and the roughness of the verification surface of the plate body is adjusted to improve the imaging effect of the size verification part with multiple gradient changes in size and the color card verification part with gradient changes in grayscale values.
- the present application further provides a visual inspection method, wherein the visual inspection system includes a visual inspection device, a visual verification device, and a host computer, the visual verification device includes a verification piece and a verification piece moving device, the verification piece moving device includes a movably mounted mounting plate, the mounting plate can be in a verification position in the movable stroke of the mounting plate, the verification position is within the detection range of the visual inspection device, and the verification piece is arranged on the mounting plate;
- the visual inspection device obtains the image of the verification piece and sends the image of the verification piece to the host computer;
- the host computer determines the systematic verification result of the visual inspection device according to the image of the verification part.
- the calibration parts when performing system calibration, are concentrated on the mounting plate, and the mounting plate is driven to move the calibration parts, thereby adopting an automatic method to achieve fully automatic calibration, thereby solving the problem of long calibration time and large production capacity loss caused by the operator's proficiency.
- the verification piece includes a plurality of size verification parts with gradient-changing sizes and a color card verification part with gradient-changing grayscale values
- the visual inspection method further includes:
- the visual inspection device obtains a first image of the size verification unit and a second image of the color card verification unit, and sends the first image and the second image to a host computer;
- the host computer determines a systematic verification result of the visual inspection device according to the first image and/or the second image.
- a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
- the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
- the accuracy error caused by the distortion of the 2D camera lens can be verified, and on the basis of realizing the accuracy verification, the algorithm verification is further performed, thereby realizing the systematic verification of the visual inspection device.
- the systematic verification result includes a visual accuracy verification result, an imaging effect detection result, and a visual algorithm verification result
- the visual detection method further includes:
- the device to be detected is notified to stop working.
- the visual detection method further comprises:
- the visual detection method further comprises:
- the host computer When receiving the verification instruction, the host computer sends the verification instruction to the visual inspection device;
- the visual inspection device When receiving the verification instruction, the visual inspection device notifies the station controller to stop conveying the material to the visual inspection device.
- the material delivery to the production line is suspended, thereby improving the accuracy of the verification.
- the visual detection method further comprises:
- the driving device in the visual inspection device is notified to move the check piece to the check position, and the check position is within the detection range of the visual inspection device;
- the calibration piece is moved to the position to be measured by a driving device without manual operation of the calibration piece, thereby achieving fully automatic calibration and solving the problem of long calibration time and large production capacity loss due to the influence of the operator's proficiency.
- the visual detection method further comprises:
- the visual inspection device detects that there is material on the check position inspected by the visual inspection device, the visual inspection device is notified to continue inspecting the current material on the check position. Until the target material leaves the check position, the driving device in the visual inspection device is notified to move the check piece to the check position so that the light source in the visual inspection device illuminates the check piece.
- the visual inspection device uses a sensor to determine whether there is material at the position to be tested. If there is material, the last product inspection is performed, thereby realizing fully automatic verification and improving the efficiency of verification.
- the visual detection method further comprises:
- the visual inspection device When the visual inspection device detects the first image and/or the second image, the visual inspection device notifies the driving device in the visual verification device to move the verification piece back to its original position.
- the verification piece after obtaining the verification image, the verification piece is automatically moved back to its original position through the driving device without the need for manual operation of the verification piece, thereby achieving fully automatic verification and solving the problem of long verification time and large production capacity loss due to the influence of the operator's proficiency.
- the visual detection method further comprises:
- the host computer When the system verification result is normal, the host computer notifies the station controller to start conveying materials;
- the host computer When the result of the systematic check is abnormal, the host computer notifies each detection device to perform a shutdown test and issues an alarm.
- the host computer controls the production line according to the systematic verification result.
- the workstation controller is notified to start conveying materials, thereby improving the processing efficiency of the production line.
- each detection equipment is notified to perform shutdown detection and issue an alarm, thereby improving effective monitoring of the production line.
- the visual detection method further comprises:
- the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result
- the host computer performs imaging effect verification according to the second image to obtain an imaging effect verification result
- the host computer performs visual algorithm verification according to the target image to obtain a visual algorithm verification result
- the host computer determines the systematic verification result of the visual inspection device according to the visual accuracy verification result, the imaging effect verification result and the visual algorithm verification result.
- the accuracy verification within the measuring range of the 2D camera and 3D camera measuring tools is effectively achieved, and on the basis of achieving the accuracy verification, the algorithm verification is further performed, thereby realizing the systematic verification of the visual inspection device.
- the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result, including:
- the visual accuracy verification result of the visual inspection device is determined according to the measurement values corresponding to the structural parameters of the size verification part in the first image.
- the visual accuracy verification result is obtained by comparing the measurement values corresponding to the structural parameters, thereby realizing the visual accuracy verification through quantified data and improving the accuracy of visual detection.
- the host computer determines the visual accuracy verification result of the visual inspection device according to the measurement value corresponding to the structural parameter, including:
- a visual accuracy verification result of the visual inspection device is determined according to the first difference.
- the visual accuracy verification result is obtained by the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object, so as to effectively obtain the error between the result of image analysis and the actual result, and more accurately obtain the accuracy of visual detection.
- the host computer determines the visual accuracy verification result of the visual inspection device according to the first difference, including:
- a visual accuracy verification result of the visual inspection device is determined according to the first difference and a first parameter threshold range.
- the visual accuracy verification result is obtained by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with the comparison only by the difference, a certain threshold range is given, and the detection result is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual accuracy detection.
- the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result, including:
- the host computer determines a first difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a preset standard value
- the host computer When the first difference is greater than or equal to the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is abnormal; when the first difference is less than the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is normal.
- the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object is compared with the parameter threshold range.
- the detection result is considered normal only if it does not exceed the range, thereby improving the accuracy of visual precision detection.
- it also includes:
- the host computer determines a first parameter threshold range according to a tolerance corresponding to the structural parameter.
- the parameter threshold range is determined by the corresponding structural parameters. Since the standards corresponding to different structural parameters are also different, the parameter threshold range is determined by the tolerance corresponding to the parameters, so that the parameter threshold range is adapted to the structural parameters, thereby improving the rationality of visual accuracy detection.
- the visual detection method further comprises:
- the host computer determines a second difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a target standard value
- the measurement values corresponding to the structural parameters are compared with the measurement values of the structural parameters analyzed by the normal visual detection algorithm to obtain the difference between the analysis results of the current visual algorithm and the analysis results detected by the normal visual detection algorithm. Therefore, the difference between the current visual algorithm and the normal visual detection algorithm is obtained, thereby realizing the verification of the visual algorithm.
- the method before determining the second difference between the measured value corresponding to the structural parameter and the standard value corresponding to the target structural parameter, the method further includes:
- the first image is detected by a target vision algorithm to obtain target standard values corresponding to the structural parameters.
- the dimension verification part is analyzed by the target visual algorithm to obtain the target standard value corresponding to the structural parameter, which can be compared with the measurement value corresponding to the structural parameter, thereby achieving the standard unification of the comparison between the current visual algorithm and the normal visual detection algorithm, and improving the accuracy of the visual algorithm verification.
- determining the first visual algorithm verification result of the visual detection device according to the second difference includes:
- a first visual algorithm verification result of the visual detection device is determined according to the second difference and a second parameter threshold range.
- the visual algorithm verification result is obtained by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
- the visual detection method further comprises:
- the host computer detects the first image through a target vision algorithm to obtain a target standard value corresponding to the structural parameter;
- the host computer determines a second difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a target standard value
- the host computer When the second difference is greater than or equal to the second parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual detection device is abnormal; when the second difference is less than the second parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual detection device is normal.
- the visual algorithm verification result is obtained by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range, thereby improving the accuracy of the visual algorithm verification.
- performing imaging effect verification according to the second image to obtain an imaging effect verification result includes:
- An imaging effect verification result is obtained according to the grayscale value of the color card verification part in the second image.
- the calibration of the imaging effect is further achieved on the basis of achieving visual accuracy.
- obtaining an imaging effect verification result according to the grayscale value of the color card verification portion in the second image includes:
- a detection result of the imaging effect of the visual detection device is determined.
- the imaging effect verification result is obtained by the difference between the grayscale value and the grayscale value corresponding to the actual detection object, so as to effectively obtain the error between the result of image analysis and the actual result, and more accurately realize the detection of imaging effect.
- determining the detection result of the imaging effect of the visual detection device according to the third difference includes:
- the detection result of the imaging effect of the visual detection device is determined according to the third difference and the third parameter threshold range.
- the imaging effect verification result is obtained by comparing the difference between the current grayscale value and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the detection result is considered abnormal only when it exceeds this range, thereby improving the accuracy of imaging effect detection.
- the host computer performs imaging effect verification according to the second image to obtain an imaging effect verification result, including:
- the host computer determines a third difference between the grayscale value of the color card verification part in the second image and a preset grayscale value
- the host computer determines that the detection result of the imaging effect of the visual detection device is abnormal; when the third difference is less than the third parameter threshold range, the host computer determines that the detection result of the imaging effect of the visual detection device is normal.
- the imaging effect verification result is obtained by comparing the difference between the current grayscale value and the standard value corresponding to the actual detection object with the parameter threshold range.
- the visual detection method further comprises:
- a second visual algorithm verification result of the visual inspection device is obtained according to the grayscale value of the color card verification part in the second image.
- the visual algorithm in addition to detecting the imaging effect through grayscale values, the visual algorithm can also be verified, thereby realizing systematic visual verification and improving the comprehensiveness and effectiveness of production line monitoring.
- obtaining the second visual algorithm verification result of the visual inspection device according to the grayscale value of the color card verification part in the second image includes:
- a second visual algorithm verification result of the visual inspection device is obtained according to a fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value.
- the grayscale value is compared with the grayscale value analyzed by the normal visual detection algorithm to obtain the difference between the analysis result of the current visual algorithm and the analysis result detected by the normal visual detection algorithm. Therefore, the difference between the current visual algorithm and the normal visual detection algorithm is obtained, thereby realizing the verification of the visual algorithm.
- the method before obtaining the second visual algorithm verification result of the visual inspection device according to the fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value, the method further includes:
- the second image is detected by a target vision algorithm to obtain a target grayscale value.
- the colorimetric card is analyzed by the target visual algorithm to obtain the target standard value corresponding to the colorimetric card, which can be compared with the grayscale value obtained by the current visual algorithm analysis, thereby achieving the standard unification for comparing the current visual algorithm with the normal visual detection algorithm, and improving the accuracy of visual algorithm verification.
- obtaining the second visual algorithm verification result of the visual inspection device according to the fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value includes:
- a second visual algorithm verification result of the visual inspection device is determined according to the fourth difference and the fourth parameter threshold range.
- the visual algorithm verification result is obtained by comparing the difference between the grayscale value corresponding to the current visual algorithm and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
- the visual detection method further comprises:
- the host computer detects the second image by using a target vision algorithm to obtain a target grayscale value
- the host computer determines a fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value
- the host computer obtains a verification result of an abnormality in the visual algorithm of the visual detection device when the fourth difference is greater than or equal to a fourth parameter threshold range;
- the host computer obtains a verification result that the visual algorithm of the visual detection device is normal.
- the visual algorithm verification result is obtained by comparing the difference between the grayscale value corresponding to the current visual algorithm and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
- the visual detection method further comprises:
- a systematic verification result of the visual inspection device is determined according to the detection value and the standard value corresponding to the first image.
- the systematic verification result of the visual inspection device is obtained by comparing the detection value with the standard value, thereby realizing the systematic verification result of the visual inspection device through quantified data, thereby improving the accuracy of the systematic verification of the visual inspection device.
- the visual detection method further comprises:
- a systematic verification result of the visual inspection device is determined based on the detection value and the standard value corresponding to the second image.
- the visual accuracy verification result is obtained by comparing the measured value corresponding to the structural parameter with the standard value
- the imaging effect verification result is obtained by comparing the grayscale value of the colorimetric card with the standard value, thereby realizing the systematic verification of the visual inspection device through quantified data and improving the accuracy of the systematic verification.
- the visual detection method further comprises:
- a systematic verification result of the visual inspection device is determined based on the detection value and the standard value corresponding to the first image and the detection value and the standard value corresponding to the second image.
- visual accuracy verification and imaging effect verification are achieved through the images of multiple size verification parts with gradient changes in size and color card verification parts with gradient changes in grayscale values. Then, the visual algorithm is verified on the basis of the visual accuracy verification and imaging effect verification, thereby realizing systematic verification of the visual inspection device.
- the host computer performs visual algorithm verification according to the target image, and before obtaining the visual algorithm verification result, it also includes:
- the host computer obtains a first picture, a second picture, a third picture, and a fourth picture with calibrated parameter values, wherein the parameter value of the first picture is within a first range, the parameter value of the second picture is within a second range, the parameter value of the third picture is within a third range, and the parameter value of the third picture is within a fourth range, the first range is different from the second range, and the third range is different from the fourth range;
- a picture verification library is established according to the first picture, the second picture, the third picture and the fourth picture.
- the visual algorithm is detected by using a pre-established image verification library, which has a higher verification efficiency than directly comparing the verification results.
- the host computer establishes a picture verification library according to the first picture, the second picture, the third picture and the fourth picture, including:
- the host computer numbers the first picture, the second picture, the third picture and the fourth picture;
- a picture verification library is established according to the numbered first picture, second picture, third picture and fourth picture.
- the image samples are managed by numbering, thereby achieving effective management of the image verification library, which is not convenient for subsequent adjustment and update of the image verification library.
- FIG5 is a schematic diagram of a first flow chart of a visual inspection method proposed in some embodiments of the present application.
- FIG6 is a schematic diagram of a second process of the visual inspection method proposed in some embodiments of the present application.
- FIG7 is a schematic diagram of a third flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG8 is a schematic diagram of a first overall process of visual inspection proposed in some embodiments of the present application.
- FIG9 is a schematic diagram of a fourth process flow of a visual inspection method proposed in some embodiments of the present application.
- FIG10 is a fifth flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG11 is a sixth flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG12 is a seventh flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG13 is a schematic diagram of an eighth flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG14 is a ninth flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG16 is a schematic diagram of a visual algorithm detection process of a visual detection method proposed in some embodiments of the present application.
- FIG17 is a schematic diagram of a tenth flow chart of a visual inspection method proposed in some embodiments of the present application.
- FIG18 is a schematic diagram of an eleventh flow chart of a visual inspection method proposed in some embodiments of the present application.
- FIG19 is a twelfth flow chart of the visual inspection method proposed in some embodiments of the present application.
- FIG20 is a schematic diagram of a thirteenth flow chart of a visual inspection method proposed in some embodiments of the present application.
- FIG. 21 is a third overall flow chart of the visual inspection method proposed in some embodiments of the present application.
- the reference numerals in the specific implementation manner are as follows: Visual inspection device 100, visual inspection device 200, host computer 300, inspection piece 10, inspection piece moving device 20, size inspection unit 201, color card inspection unit 202, The plate body 30 , the calibration surface 40 , the mounting plate 50 , the support base 60 , the drive devices 70 , 701 , 702 , the slide rail 80 , the adapter 90 , the height limit block 901 , the first slide limit block 902 and the second slide limit block 903 .
- the movement of the mounting plate 50 is achieved through multiple sets of sliding devices, thereby achieving precise control of the movement of the mounting plate 50 .
- the visual inspection verification piece 10 includes:
- the plate body 30 has a calibration surface 40
- Multiple size verification parts 201 are arranged on the verification surface 40 at intervals along a straight line direction.
- the multiple size verification parts have a length dimension in a first direction and a width dimension in a second direction.
- the length dimensions of the multiple size verification parts change in a gradient, and/or the width dimensions of the multiple size verification parts change in a gradient, wherein the first direction and the second direction are directions perpendicular to each other in a horizontal plane.
- the verification piece 10 includes a verification block, and may also be a verification piece 10 in other forms, which is not limited in the present embodiment.
- the first direction may be the horizontal direction along the plate body 30, that is, the x-axis direction
- the second direction may be the vertical direction along the plate body 30, that is, the y-axis direction. It may also be that the first direction is the vertical direction along the plate body 30, and the second direction is the horizontal direction along the plate body 30, which is not limited in the present embodiment.
- the length dimension of the dimension verification part on the front side of any two adjacent dimension verification parts is greater than or smaller than the length dimension of the dimension verification part on the rear side
- the width dimension of the dimension verification part on the front side of any two adjacent dimension verification parts is greater than or smaller than the width dimension of the dimension verification part on the rear side
- the first direction and the second direction are directions perpendicular to each other in a horizontal plane, so that the length or width dimension changes linearly, thereby realizing the verification of linear offset.
- the length dimension change amount of the two adjacent dimension verification parts at the front side is the same as the length dimension change amount of the two adjacent dimension verification parts at the rear side; and/or the width dimension change amount of the two adjacent dimension verification parts at the front side is the same as the width dimension change amount of the two adjacent dimension verification parts at the rear side.
- the length or width dimension changes in a gradient, improving the accuracy of linear offset.
- the size checking part and the plate body 30 may be integrally formed or separately provided, and this embodiment does not impose any limitation on this.
- a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece 10, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tools is verified.
- the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints passing through the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
- the accuracy error caused by the distortion of the 2D camera lens can be verified, thereby improving the accuracy of visual inspection.
- the size verification portion includes a protrusion or a groove formed on the plate body.
- the dimension verification part in the present embodiment is provided with a protrusion or a groove, thereby increasing the visual accuracy verification on the basis of two-dimensional and three-dimensional, and its dimension changes in a gradient, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, ensures that the linear offset of the measuring tool is verified, and can also verify the accuracy error caused by distortion of the 2D camera lens.
- This embodiment obtains whether the size information of the grooves, protrusions, etc. on the verification piece 10 is within a reasonable error range with the predetermined size information, so as to achieve camera accuracy verification.
- the sizes of the multiple size verification parts along a third direction vary in a gradient manner, and the third direction is perpendicular to the first direction and the second direction.
- the third direction is the z-axis direction along the plate body 30 , that is, the z-axis direction of the dimension verification portion changes in a gradient.
- a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece 10, which effectively realizes the accuracy verification within the measuring range of the 2D camera and 3D camera measuring tools and ensures that the linear offset of the measuring tools is verified.
- a color card calibration part 202 with a gradient grayscale value provided on the calibration surface 40 of the board body 30 is further included.
- the color card verification unit 202 can be a colorimetric card or other forms of color cards, and this embodiment does not limit this.
- the colorimetric card includes standard color cards with multiple gradients.
- the colorimetric card can be a light gray, gray, and dark gray three-gradient standard color card, and can also be an RGB three-primary color card.
- the black and white camera is equipped with a light gray, gray, and dark gray three-gradient standard color card, and the color camera is equipped with an RGB three-primary color card for verifying the imaging effect.
- the calibration of the imaging effect is achieved by providing a colorimetric card on the calibration piece 10.
- the color card of the calibration piece 10 requires that the black-and-white camera be equipped with three gradient standard color cards of light gray, gray, and dark gray, thereby achieving the calibration of the imaging effect of the black-and-white camera.
- the color card verification unit 202 includes a three-primary color card.
- the color camera of this embodiment is equipped with an RGB three-primary color card, so as to realize the calibration of the imaging effect of the color camera.
- the material of the plate body 30 includes aluminum alloy; and/or the roughness of the calibration surface 40 of the plate body 30 is less than a preset roughness threshold.
- the calibration block in the visual inspection system includes an aluminum white substrate, such as an aluminum alloy material, a gradient calibration groove or protrusion, a gradient standard color card, a cylinder required for the movement of the calibration block, a slide rail 80, and a slider.
- the preset roughness threshold can be Ra3.2, or other thresholds. This embodiment does not impose any restrictions on this.
- the calibration block requires that the size of the groove or protrusion presents a periodic pattern and covers the measuring range of the measuring tool as much as possible.
- the calibration block requires that the groove or protrusion is non-mirror, the surface is frosted, and the roughness is ⁇ Ra3.2, so as to obtain a better imaging effect.
- the material of the plate body 30 includes aluminum alloy, and the roughness of the verification surface 40 of the plate body 30 is adjusted, so as to improve the imaging effect of the size verification parts with multiple gradient sizes and the color card verification part 202 with gradient grayscale values.
- the present application also proposes a visual inspection method, wherein the visual inspection system includes a visual inspection device, a visual verification device, and a host computer, as shown in FIG1 , wherein the visual verification device includes a verification piece and a verification piece moving device, wherein the verification piece moving device includes a movably mounted mounting plate, wherein the mounting plate can be in a verification position in the movable travel of the mounting plate, wherein the verification position is within the detection range of the visual inspection device, and the verification piece is arranged on the mounting plate;
- the flow chart of the first embodiment of the visual inspection method includes:
- Step S10 the visual inspection device obtains an image of the verification piece and sends the image of the verification piece to the host computer;
- Step S20 the host computer determines the systematic verification result of the visual inspection device according to the image of the verification object.
- the visual verification device can be located on one side of the verification position.
- the manufacturing execution system creates a verification task to trigger the visual system to enter the automatic verification mode or the detection equipment sets the automatic verification time to enter the verification mode
- the host computer notifies the visual verification device to enter the verification mode.
- the visual verification device moves the verification piece to the verification position for visual inspection through the verification piece moving device. Since the visual inspection device is used to collect the image of the inspection object located at the verification position, the visual inspection device can collect the image of the verification piece and send the collected verification piece to the host computer for image analysis.
- the visual inspection system of this embodiment is adaptable to different application scenarios of visual inspection equipment.
- the device itself can have an automatic calibration function according to the characteristics of the measured object, and can automatically realize online calibration of the visual system light source, camera accuracy, and algorithm stability accuracy.
- the calibration parts are concentrated on the mounting plate, and the movement of the calibration parts is achieved by driving the mounting plate, so that full-automatic calibration is achieved in an automatic manner, thereby solving the problem of long calibration time and large production capacity loss caused by the operator's proficiency.
- the verification piece moving device is used to drive the verification block to move to the verification position so that the light source of the visual inspection device illuminates the verification piece.
- the verification piece moving device is used to move the verification piece under the light source for visual inspection when verification is required, so as to avoid affecting the normal operation of the production line.
- the verification piece is automatically retracted.
- the verification piece on the verification piece moving device is moved under the light source for visual inspection, thereby realizing automated visual inspection.
- the check position is the position of visual inspection.
- the visual inspection device includes a light source, a visual inspection component, a processing device and a control device.
- the visual inspection component faces the check position and is used to collect the image of the product on the check position.
- the light source provides light for the check position
- the processing device is used to obtain the visual image
- the control device is used to realize the workflow control of the visual inspection device on the production line.
- the calibration piece when a system calibration is required through a calibration piece, the calibration piece is automatically moved to the calibration position, thereby achieving a fully automatic calibration of the visual inspection device.
- This embodiment concentrates the verification parts on the mounting plate, and realizes the movement of the verification parts by driving the mounting plate, thereby realizing fully automatic verification in an automatic manner, thereby solving the problem that the verification time is long and the production capacity loss is large due to the influence of the operator's proficiency.
- the verification piece includes a plurality of size verification parts with gradient-changing sizes and a color card verification part with gradient-changing grayscale values;
- Step S10' the visual inspection device is used to obtain a first image of the size verification part and a second image of the color card verification part, and send the first image and the second image to the host computer;
- Step S20' the host computer is used to determine the systematic verification result of the visual inspection device according to the first image and/or the second image.
- a product-prototype calibration piece is designed and manually placed on the inspection position of the piece to be tested to match the actual production process detection posture. Then, a camera is used to obtain the dimensional information of the grooves, protrusions, etc. on the calibration piece to see if it is within a reasonable error range with the predetermined dimensional information, thereby achieving camera accuracy calibration.
- This calibration method is only for camera accuracy calibration, which limits the calibration method.
- the embodiment of the present application is provided with multiple dimension calibration parts with gradient size changes on the calibration piece, which effectively realizes the accuracy calibration within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is calibrated.
- the linear offset is the linear error or the endpoint linearity. It is the maximum deviation of the straight line composed of the endpoints of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
- it can calibrate the accuracy error caused by the distortion of the 2D camera lens, and on the basis of realizing the accuracy calibration, further perform the algorithm calibration, so as to realize the systematic calibration of the visual inspection device.
- the product can be a battery cell or a battery pack, etc., or other types of products, which are not limited in this embodiment.
- a battery cell is used as an example for explanation.
- the visual inspection device can be a 2D camera, a 3D camera, a structural camera, a surface scanning camera or a line scanning camera and a light source, etc.
- the visual inspection device faces the verification piece for image acquisition, and a light source is also provided to provide light to illuminate the verification piece, so that the visual inspection device can collect the image of the verification piece.
- the verification piece can be placed on the transportation production line. When the visual inspection device detects the verification piece, the image of the verification piece is collected. It can also be set on the side of the transportation line. When verification is required, the verification piece is automatically placed on the conveyor line. It can also be moved to the detection position by a driving device. This embodiment does not limit this.
- the visual inspection device includes a verification piece, which is used as a sample.
- the visual inspection device can be systematically inspected by collecting images of the verification piece.
- the verification piece and the schematic diagram of the verification part in the verification piece include a plurality of size verification parts with gradient changes in size and a color card verification part with gradient changes in grayscale values.
- the size verification part can be a gradient verification groove or protrusion, or other forms of size verification parts.
- the verification piece requires that the size of the groove or protrusion presents a periodic pattern and covers the measuring range of the measuring tool as much as possible.
- the verification piece requires that the groove or protrusion is not a mirror surface, and the surface is frosted with a roughness of ⁇ Ra3.2.
- this embodiment adds gradient changes in two-dimensional and three-dimensional dimensions, effectively realizes the accuracy calibration within the measuring range of 2D cameras and 3D cameras, ensures that the linear offset of the measuring tool is calibrated, and at the same time, it can calibrate the accuracy error caused by the distortion of the 2D camera lens.
- the calibration piece requires no less than 5 grooves or protrusions with gradient changes, and at the same time satisfies 2D and 3D size gradient changes. It is suitable for accuracy calibration of the measuring range of 2D cameras and 3D camera measuring tools, and is suitable for linear offset analysis and calibration of 2D cameras and 3D camera measuring tools.
- the first image is an image of a size verification part with multiple sizes changing in a gradient.
- the verification piece can also be set on the product to obtain an image of the product, and the visual algorithm is verified based on the image of the product.
- a visual inspection device is provided opposite the verification piece. When the verification piece is supplemented with light by a light source, the visual inspection device obtains an image of the size verification part on the verification piece. A systematic analysis is performed through the image of the size verification part to realize the detection of the visual inspection device.
- the second image is an image of a color card verification part with a gradient grayscale value.
- the first image and the second image can be one image or multiple separate images.
- the first image and the second image of the corresponding area are collected by arranging visual inspection devices in different areas.
- the image can be divided into regions to obtain the first image and the second image corresponding to the size verification parts with multiple sizes changing in a gradient and the color card verification part with a gradient grayscale value, thereby realizing visual inspection.
- the verification piece can also be placed on the product to obtain an image of the product, and the visual algorithm can be verified based on the image of the product.
- a visual inspection device is placed directly opposite the verification piece. When the verification piece is supplemented with light by a light source, the visual inspection device obtains an image of the size verification part on the verification piece, and a systematic analysis is performed through the image of the size verification part to realize the inspection of the visual inspection device.
- the systematic verification results include visual accuracy verification results, imaging effect verification results and visual algorithm verification results, thereby achieving systematic verification of the visual inspection device.
- multiple dimension verification parts with gradient size changes are provided on the verification part, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
- the linear offset is the linear error or the end point linearity. It is the maximum deviation of the straight line composed of the end points of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
- the accuracy error caused by the distortion of the 2D camera lens can be verified, and on the basis of achieving the accuracy verification, the algorithm verification is further performed, so as to realize the systematic verification of the visual inspection device.
- the various parameters and comparison results obtained are uploaded to the manufacturing execution system, and the manufacturing execution system compares the structural parameters again. If any result is NG, the manufacturing execution system locks the machine and prevents the detection system from producing. At the same time, the equipment alarms, and the staff needs to conduct system troubleshooting and adjustments based on the NG items to correct the visual detection errors in a timely manner. Ensure that the visual inspection system still has good accuracy after a long time or adjustment. For example, when an abnormality in visual accuracy is detected, the manufacturing execution system locks the machine, or when an abnormality occurs in the imaging effect or the visual algorithm, the machine is shut down for rectification, thereby improving the effective monitoring of production.
- this embodiment promptly stops production for inspection when problems with visual accuracy, visual imaging, and visual algorithms on the production line are detected, thereby achieving effective management and control of production line monitoring.
- the verification mode is determined to be ended, and the relevant production equipment is notified to enter the production mode.
- the visual inspection device interacts with the upstream workstation to inform the upstream workstation to start unloading and enter the production mode, thereby realizing automated management of production.
- execute S302 move the verification block to the verification position, take a picture with the camera, and perform picture analysis; S303: after completing the picture acquisition, the cylinder controls the verification block to return to its original position; S304: camera accuracy judgment:
- Step S501 when the visual inspection device detects that there is no material on the verification position, it notifies the visual inspection device to move the verification piece to the verification position, and the verification position is within the detection range of the visual inspection device, so that the light source in the visual inspection device illuminates the verification piece.
- the driving device may be a cylinder or other devices that can realize the driving function. This embodiment does not limit this. Taking the cylinder as an example, the visual inspection device confirms that there is no product at the check position through the perception of the sensor, controls the cylinder to extend, and moves the check piece to the waiting position.
- This embodiment moves the verification piece to the verification position through a driving device without manual operation of the verification piece, thereby achieving fully automatic verification and solving the problem of long verification time and large production capacity loss due to the influence of operator proficiency.
- Step S502 when the visual inspection device detects that there is material on the check position, it continues to inspect the current material on the check position until the target material leaves the check position, and then notifies the driving device in the visual inspection device to move the check piece to the check position so that the light source in the visual inspection device illuminates the check piece.
- the target material is the last material in the current transportation process. Since it is detected that there is still material on the check position during the automatic check mode, the verification starts when the last product is detected.
- the visual inspection device uses a sensor to determine whether there is material at the verification position. If there is material, the last product is inspected. If there is no material, the verification starts.
- the visual inspection device of this embodiment uses a sensor to determine whether there is material at the check position. If there is material, the last product inspection is performed, thereby realizing fully automatic inspection and improving the efficiency of inspection.
- the visual detection method further includes:
- Step S601 When the visual inspection device detects the first image and/or the second image, the visual inspection device notifies the driving device in the visual verification device to move the verification piece back to its original position.
- control cylinder is triggered to retract to the original position, and the verification piece is moved to the original position.
- this embodiment automatically moves the verification piece back to its original position through a driving device without manual operation of the verification piece, thereby achieving fully automatic verification and solving the problem of long verification time and large production capacity loss that is easily affected by the proficiency of the operator.
- the visual detection method further includes:
- Step S701 when the system check result is normal, the host computer notifies the station controller to start conveying materials;
- Step S702 When the system check result is abnormal, the host computer notifies each detection device to perform shutdown detection and issues an alarm.
- the host computer controls the production line according to the systematic verification result.
- the workstation controller is notified to start conveying materials, thereby improving the processing efficiency of the production line.
- each detection equipment is notified to perform shutdown detection and an alarm is issued, thereby improving the effective monitoring of the production line.
- the visual detection method further includes:
- Step S801 the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result
- Step S802 the host computer performs imaging effect verification according to the second image to obtain an imaging effect verification result
- Step S803 When the visual accuracy verification result and the imaging effect verification result are both normal verification results, the host computer performs visual algorithm verification according to the target image to obtain a visual algorithm verification result;
- Step S804 the host computer determines the systematic verification result of the visual inspection device according to the visual accuracy verification result, the imaging effect verification result and the visual algorithm verification result.
- the visual accuracy verification can be used to verify the shooting accuracy of the visual detection device.
- the size of the verification piece collected by the visual detection device can be compared with the size of the actual verification piece to obtain the visual accuracy verification result. For example, after analyzing the first image, the size of the size verification part on the verification piece is 10mm, but the size of the actual size verification part is 9mm. Therefore, the visual accuracy verification is achieved through the size verification part in the first image, and the accuracy verification within the measuring range of 2D cameras and 3D cameras is effectively achieved. Ensure that the linear offset of the measuring tool is verified, and at the same time, the accuracy error caused by the distortion of the 2D camera lens can be verified to achieve accuracy verification.
- the color card verification part can be a colorimetric card
- the colorimetric card can be a light gray, gray, and dark gray three-gradient standard color card, and can also be an RGB three-primary color card. It is required that the black and white camera is equipped with light gray, gray, and dark gray three-gradient standard color cards, and the color camera is equipped with an RGB three-primary color card for the verification of the imaging effect. For example, after analyzing the colorimetric card of the first image, the grayscale value of the colorimetric card on the verification piece is 50, but the grayscale value of the actual colorimetric card is 60, so that the imaging effect verification is achieved through the colorimetric card in the first image.
- the visual algorithm verification is performed to achieve a systematic verification result of the visual inspection device.
- This embodiment obtains the systematic verification result of the visual inspection device by comparing the detection value with the standard value, thereby realizing the systematic verification result of the visual inspection device through quantified data and improving the accuracy of the systematic verification of the visual inspection device.
- the systematic verification result of the visual inspection device can also be determined based on the second image.
- a colorimetric card is also provided on the verification piece. Since the size verification part can verify the visual accuracy and the colorimetric card can verify the imaging effect, the visual accuracy, imaging effect and visual algorithm can be verified at the same time, thereby realizing a systematic verification of the visual inspection device.
- This embodiment acquires images through the size verification part on the verification piece to obtain visual accuracy verification results, detects the imaging effect through the colorimetric card on the verification piece, and simultaneously detects the visual algorithm, thereby achieving systematic verification of the visual inspection device.
- the detected value when performing visual accuracy inspection, can be the measured value of the structural parameter, and the standard value can be the parameter value of the actual inspection object, so as to make a comparison and verify the visual accuracy.
- the detected value when performing imaging effect inspection, can be the grayscale value of the colorimetric card, and the standard value can be the grayscale value of the actual inspection object, so as to make a comparison and verify the imaging effect.
- the detected value when performing a visual algorithm, the detected value can be the measured value obtained by analyzing the structural parameters through the current visual algorithm, and the standard value can be the parameter value obtained by analyzing a good visual algorithm, so as to make a comparison and verify the visual algorithm.
- This embodiment obtains the visual accuracy verification result by comparing the measured value corresponding to the structural parameter with the standard value, and obtains the imaging effect verification result by comparing the gray value of the colorimetric card with the standard value, thereby realizing the systematic verification of the visual inspection device through quantified data and improving the accuracy of the systematic verification.
- the systemicity of the visual inspection device is determined based on the detection value and the standard value corresponding to the first image and the detection value and the standard value corresponding to the second image. Verify the results.
- This embodiment compares the structural parameter detection values of the size verification part image with multiple sizes showing gradient changes in the first image with standard values to realize visual accuracy verification and visual algorithm verification at the same time, and compares the detection values of the color card verification part with grayscale values showing gradient changes in the second image with standard values to realize effectiveness verification and visual algorithm verification at the same time, thereby achieving a systematic verification result of the visual inspection device.
- the visual accuracy verification result of the visual inspection device can be determined according to the measurement values corresponding to the structural parameters.
- the structural parameters may be the size, depth, and thickness of the size verification part, and may also include other parameters, which are not limited in this embodiment.
- the comparison is performed based on the structural parameters of the verification piece. Since the structural parameter value may be a specific numerical value, the difference between the measured value and the actual value can be obtained more accurately.
- the size of the size verification part is taken as an example. In order to achieve visual accuracy detection, the image of the two-dimensional size verification part on the verification piece is analyzed to obtain the size of the size verification part with a length of 2 mm and a width of 1 mm, so that the visual accuracy is directly verified based on the measurement value analyzed in the image.
- This embodiment obtains the visual accuracy verification result by comparing the measurement values corresponding to the structural parameters, thereby realizing the visual accuracy verification through quantified data and improving the accuracy of visual detection.
- the first difference between the measured value corresponding to the structural parameter and the preset standard value can also be determined; based on the first difference, the visual accuracy verification result of the visual inspection device is determined.
- the measured value of the structural parameter obtained by image analysis is consistent with the parameter value of the actual inspection object. It can be seen that the image collected by the current visual inspection device is the same as the parameter value of the actual inspection object. Therefore, the visual accuracy of the visual inspection device is normal.
- This embodiment obtains the visual accuracy verification result by the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object, thereby effectively obtaining the error between the result of image analysis and the actual result, and more accurately obtaining the accuracy of visual detection.
- the visual accuracy verification result of the visual inspection device is determined according to the first difference and the first parameter threshold range.
- the first parameter threshold range is defined to determine whether the difference is within the allowable range. If the difference is within the first parameter threshold range, it is determined to be within the allowable range. If the difference is outside the first parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of allowable error to avoid misjudgment. For example, taking the parameter threshold range of less than 0.1mm as an example, through analysis of the image of the two-dimensional size verification part on the verification piece, it is obtained that the length of the size verification part is 2mm, and the length of the actual detection object is 2.5mm. The measured value of the structural parameter obtained by the image analysis differs from the parameter value of the actual detection object by 0.5mm, which exceeds the parameter threshold range. It can be seen that the visual accuracy of the visual inspection device is abnormal.
- the parameter threshold range of less than 0.1mm is 2mm, and the length of the actual detection object is 2.03mm.
- the measured value of the structural parameter obtained by the image analysis differs from the parameter value of the actual detection object by 0.03mm, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the visual accuracy of the visual inspection device.
- step S801 includes:
- Step S805 the host computer determines a first difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a preset standard value.
- Step S806 When the first difference is greater than or equal to the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is abnormal.
- Step S807 When the first difference is less than the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is normal.
- the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
- This embodiment obtains the visual accuracy verification result by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with the comparison only by the difference, a certain threshold range is given, and the detection result is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual accuracy detection.
- the method further includes:
- Step S808 The host computer determines a first parameter threshold range according to a tolerance corresponding to the structural parameter.
- the tolerance is the variation corresponding to each structural parameter, which is equal to the absolute value of the algebraic difference between the maximum limit and the minimum limit.
- 1mm is the tolerance corresponding to the size parameter
- 1mm2 is the tolerance corresponding to the size parameter.
- T represents the tolerance corresponding to the structural parameter, i.e., camera accuracy verification:
- the parameter threshold range corresponding to the size parameter is less than 0.1mm for comparison, so as to avoid the parameter threshold range corresponding to the area parameter being less than 1mm2 for comparison, thereby causing misjudgment.
- this embodiment determines the parameter threshold range by corresponding structural parameters. Since different structural parameters correspond to different standards, the parameter threshold range is determined by the tolerance corresponding to the parameters, so that the parameter threshold range is compatible with the structural parameters, thereby improving the rationality of visual accuracy detection.
- the visual detection method further includes:
- Step S809 the host computer detects the first image through a target vision algorithm to obtain target standard values corresponding to the structural parameters.
- Step S810 The host computer determines a second difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a target standard value.
- Step S811 When the second difference is greater than or equal to the second parameter threshold range, the host computer obtains a verification result of an abnormality in the visual algorithm of the visual detection device.
- Step S812 When the second difference is less than the second parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual inspection device is normal.
- the host computer can determine the first visual algorithm verification result of the visual inspection device according to the measurement value corresponding to the structural parameter.
- the measured value corresponding to the structural parameter is compared with the measured value obtained by the good visual analysis algorithm, so as to realize the verification of the visual algorithm.
- the good visual analysis algorithm is used to calibrate the size verification part on the verification piece.
- the measurement value obtained by analyzing the image of the two-dimensional size verification part is 1.8mm, thereby realizing the verification of the visual algorithm.
- the measurement value of the size verification part obtained by analyzing the image of the two-dimensional size verification part on the verification piece is consistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece through a good visual analysis algorithm, it is determined that the current visual algorithm is normal; when the measurement value of the size verification part is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece through a good visual analysis algorithm, it is determined that the current visual algorithm is abnormal, thereby realizing the detection of the visual algorithm.
- this embodiment can also verify the visual algorithm through the measurement values corresponding to the structural parameters, thereby achieving systematic visual verification and improving the comprehensiveness and effectiveness of production line monitoring.
- the host computer can also determine a second difference between the measured value corresponding to the structural parameter and the target standard value; and determine the first visual algorithm verification result of the visual detection device based on the second difference.
- the target standard value may be a measurement value obtained by detecting a good visual algorithm.
- the difference between the measurement value corresponding to the structural parameter and the target standard value the difference between the measurement value of the structural parameter obtained by image analysis and the measurement value obtained by detecting the good visual algorithm is obtained.
- the length of the dimension verification part is 2 mm.
- the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm is 2.5 mm.
- the measurement value of the structural parameter obtained by the image analysis differs from the parameter value of the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm by 0.5 mm.
- the measurement value of the structural parameter obtained by the image analysis is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm. It can be seen that there is a difference in the detection results between the current visual algorithm and the good visual algorithm. Therefore, the current visual algorithm is abnormal.
- the measurement value of the structural parameter obtained by image analysis is consistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece through a good visual analysis algorithm. It can be seen that the detection results of the current visual algorithm are the same as those of the good visual algorithm. Therefore, the current visual algorithm is normal.
- This embodiment compares the measured values corresponding to the structural parameters with the measured values of the structural parameters analyzed by the normal visual detection algorithm, thereby obtaining the difference between the analysis results of the current visual algorithm and the analysis results detected by the normal visual detection algorithm, and thus obtaining the difference between the current visual algorithm and the normal visual detection algorithm, thereby realizing the verification of the visual algorithm.
- the target visual algorithm is a good visual algorithm that has been verified.
- the target visual algorithm is used to analyze the dimension verification part at the same time to obtain the target standard value corresponding to the structural parameter, so as to achieve comparison with the current measurement value.
- the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm is 2mm.
- the measurement value of 2mm is used as the target standard value, so that different visual algorithms are used for analysis based on the same analysis object, avoiding the use of different analysis objects for comparison, which affects the accuracy of the comparison result.
- this embodiment analyzes the dimension verification part through the target visual algorithm to obtain the target standard value corresponding to the structural parameter, so that it can be compared with the measurement value corresponding to the structural parameter, so as to achieve the standard unification of the comparison between the current visual algorithm and the normal visual detection algorithm, and improve the accuracy of the visual algorithm verification.
- the second parameter threshold range is defined to determine whether the difference is within the allowable range. If the difference is within the second parameter threshold range, it is determined to be within the allowable range. If the difference is outside the second parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of a certain allowable error to avoid misjudgment.
- the second parameter threshold range can be T/10, where T represents the tolerance corresponding to the detection object, that is, the visual algorithm verification:
- the image of the two-dimensional size verification part on the verification piece is analyzed to obtain a length of 2mm for the size verification part, and a length of 2.5mm is obtained through good visual algorithm detection.
- the measured value of the structural parameter obtained by image analysis differs from the parameter value obtained by good visual algorithm detection by 0.5mm, which exceeds the parameter threshold range. It can be seen that the visual algorithm of the visual detection device is abnormal.
- the length of the size verification part is 2mm, and the length obtained by detecting with a good visual algorithm is 2.03mm.
- the measured value of the structural parameter obtained by image analysis differs from the parameter value obtained by detecting with a good visual algorithm by 0.03mm, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the visual algorithm of the visual inspection device.
- the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
- S801' move the product to the verification position and trigger the camera to collect product pictures
- S802' pass the collected pictures to the image processing and analysis module, i.e., the visual inspection algorithm
- S803' according to the output of the visual inspection algorithm results, the equipment compares with the set rules to determine whether the product is defective
- S804' the results are uploaded to the Manufacturing Execution System (MES), and the Manufacturing Execution System automatically records the product status information based on the results, and the equipment performs preset actions based on the results.
- MES Manufacturing Execution System
- Manufacturing Execution System is an industrial production management system used to optimize and monitor the entire manufacturing process from raw materials to final products.
- Manufacturing Execution System coordinates planning, execution, control and monitoring of various aspects of production activities by interacting with various equipment, systems and personnel. It is usually integrated with other information systems of the enterprise, such as Enterprise Resource Planning (ERP), Product Lifecycle Management (PLM), Supply Chain Management (SCM), etc., to achieve more efficient, flexible and visual production management.
- ERP Enterprise Resource Planning
- PLM Product Lifecycle Management
- SCM Supply Chain Management
- the first step of collecting pictures is normal, that is, the hardware such as the camera and light source work normally, the pictures obtained are stable. This part is designed with camera accuracy verification and imaging verification.
- the normality of the visual algorithm affects the judgment of whether the product is defective.
- the algorithm can be designed to determine whether the specifications need to be verified if they have changed.
- the flow chart of visual algorithm verification is as follows: algorithm verification: S801": the picture in the algorithm verification library replaces the product picture currently captured by the camera; S802": the captured picture is passed into the image processing and analysis module, i.e., the visual inspection algorithm; S803": based on the output of the visual inspection algorithm result, the equipment is compared with the set specifications to determine whether the product is defective; S804": the inspection result is compared with the standard result to verify whether the algorithm and specification are normal based on whether they are within the standard range; S805": the verification result is uploaded to the manufacturing execution system, and the equipment executes the preset action based on the verification result; S806”: based on the number of pictures in the gallery N, the loop is traversed and executed N times.
- the verification process is: according to the test results,
- the original specifications were 10-11, and the current specifications are 10.5-11.
- the original rules were determined when the standards were established, and the current rules are rules for reading the current device settings. The two are inconsistent, indicating that the device specifications have been maliciously modified and there are problems with the measurement system, thereby achieving verification of the visual algorithm.
- This embodiment obtains the visual algorithm verification result by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range, and further realizes the systematic verification of the visual detection device by comparison through specifications. Compared with comparison only through difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
- step S802 includes:
- Step S813 the host computer determines a third difference between the grayscale value of the color card verification part in the second image and the preset grayscale value.
- Step S814 When the third difference is greater than or equal to the third parameter threshold range, the host computer determines a detection result that the imaging effect of the visual detection device is abnormal.
- Step S815 When the third difference is less than the third parameter threshold range, the host computer determines a detection result that the imaging effect of the visual detection device is normal.
- the gray value is an image representation concept of digital image processing technology.
- the gray value refers to the brightness value of the pixel of the grayscale digital image, indicating the depth level of the color of the digital image.
- the grayscale level is divided into 0 to 255, where white is 255 and black is 0.
- the grayscale image can show different shades of any color, and even different colors at different brightness.
- the comparison is based on the grayscale value of the colorimetric card. Since the grayscale value of the colorimetric card can be a specific value, the difference between the measured value and the actual value can be obtained more accurately.
- the grayscale value of the colorimetric card on the verification piece is obtained to be 50, so that the imaging effect verification is directly performed according to the grayscale value analyzed in the image.
- the imaging effect verification result is obtained by comparing the gray value of the color card, so that the imaging effect verification is realized through quantitative data, thereby improving the accuracy of imaging effect detection.
- the preset grayscale value may be the grayscale value of the actual detection object, and image analysis is performed on the colorimetric card to obtain the difference between the corresponding measurement value and the preset standard value, thereby obtaining the measurement value of the colorimetric card obtained by image analysis and the grayscale value of the actual detection object.
- the grayscale value of the colorimetric card on the calibration piece is 50
- the grayscale value of the same position of the actual colorimetric card is 60.
- the measurement value obtained by the image analysis differs from the parameter value of the actual detection object by 10, thereby obtaining that the current measurement value obtained by the image analysis is inconsistent with the parameter value of the actual detection object. It can be seen that the image captured by the current visual detection device is different from the actual detection object. Therefore, the imaging effect of the visual detection device is abnormal.
- the grayscale value of the colorimetric card on the calibration piece is 50
- the grayscale value of the same position on the actual colorimetric card is 50.
- the measurement value obtained by image analysis is consistent with the parameter value of the actual detection object. It can be seen that the image captured by the current visual detection device is the same as the parameter value of the actual detection object. Therefore, the imaging effect of the visual detection device is normal.
- This embodiment obtains the imaging effect verification result by the difference between the grayscale value and the grayscale value corresponding to the actual detection object, thereby effectively obtaining the error between the image analysis result and the actual result, and more accurately realizing the detection of the imaging effect.
- the third parameter threshold range is defined to determine whether the grayscale value difference is within the allowable range. If the difference is within the third parameter threshold range, it is determined to be within the allowable range. If the difference is outside the third parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of a certain allowable error to avoid misjudgment.
- the third parameter threshold range can be 10, that is, imaging effect verification:
- the grayscale value of the colorimetric card on the calibration piece is 50, and the grayscale value of the same position on the actual colorimetric card is 55.
- the measurement value obtained by the image analysis differs from the parameter value of the actual detection object by 5, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the imaging effect of the visual detection device.
- the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
- This embodiment obtains the imaging effect verification result by comparing the difference between the current grayscale value and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with comparison only by difference, a certain threshold range is given and the detection result is considered abnormal only when it exceeds the range, thereby improving the accuracy of imaging effect detection.
- the visual detection method further includes:
- Step S816 The host computer detects the second image through a target vision algorithm to obtain a target grayscale value.
- Step S817 the host computer determines a fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value.
- Step S818 When the fourth difference is greater than or equal to the fourth parameter threshold range, the host computer obtains a verification result of an abnormality in the visual algorithm of the visual detection device.
- Step S819 When the fourth difference is less than the fourth parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual inspection device is normal.
- the grayscale value obtained by the current visual algorithm analysis is compared with the grayscale value obtained by the good visual analysis algorithm, so as to realize the verification of the visual algorithm.
- the grayscale value of the colorimetric card on the verification piece is 50, and the grayscale value of the same position of the colorimetric card on the verification piece is calibrated as 60 by the good visual analysis algorithm, so as to realize the verification of the visual algorithm.
- the measurement value of the size verification part obtained by analyzing the image of the two-dimensional size verification part on the verification part is consistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification part through a good visual analysis algorithm, it is determined that the current visual algorithm is normal; when the measurement value of the size verification part is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification part through a good visual analysis algorithm, it is determined that the current visual algorithm is abnormal, thereby realizing the detection of the visual algorithm.
- this embodiment can also verify the visual algorithm, thereby achieving systematic visual verification and improving the comprehensiveness and effectiveness of production line monitoring.
- the target grayscale value may be a measurement value obtained by detecting a good vision algorithm.
- the difference between the grayscale value of the colorimetric card and the target standard value the difference between the measurement value obtained by image analysis and the measurement value obtained by detecting the good vision algorithm is obtained.
- the grayscale value of the colorimetric card on the verification piece is 50
- the grayscale value of the same position of the colorimetric card on the verification piece is 60 after calibration by the good vision analysis algorithm.
- the measurement value obtained by image analysis and the measurement value obtained by analyzing the image of the colorimetric card on the verification piece by the good vision analysis algorithm differ by 10 in parameter value.
- the measurement value obtained by image analysis is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece by the good vision analysis algorithm. It can be seen that there is a difference in the detection results between the current vision algorithm and the good vision algorithm. Therefore, the current vision algorithm is abnormal.
- the grayscale value of the colorimetric card on the calibration piece is 50.
- the grayscale value of the same position of the colorimetric card on the calibration piece is calibrated to 50 by a good visual analysis algorithm.
- the measurement value obtained by image analysis is consistent with the measurement value obtained by analyzing the colorimetric card on the calibration piece by a good visual analysis algorithm. It can be seen that the current visual algorithm has the same detection results as the good visual algorithm. Therefore, the current visual algorithm is normal.
- This embodiment compares the grayscale value with the grayscale value analyzed by the normal visual detection algorithm to obtain the difference between the analysis result of the current visual algorithm and the analysis result detected by the normal visual detection algorithm, thereby obtaining the difference between the current visual algorithm and the normal visual detection algorithm, thereby realizing the verification of the visual algorithm.
- the target vision algorithm is a good vision algorithm that has been calibrated.
- the colorimetric card is analyzed by the target vision algorithm to obtain the target standard value corresponding to the colorimetric card, thereby realizing comparison with the current measurement value.
- the grayscale value of the same position of the colorimetric card on the calibration piece is calibrated to 50 by a good vision analysis algorithm, and the grayscale value of 50 is used as the target standard value, so that different vision algorithms are used for analysis based on the same analysis object, avoiding the use of different analysis objects for comparison, which affects the accuracy of the comparison results.
- this embodiment uses the target visual algorithm to analyze the color comparison card to obtain the target standard value corresponding to the color comparison card, which can be compared with the grayscale value obtained by the current visual algorithm analysis, thereby achieving the standard unification of the comparison between the current visual algorithm and the normal visual detection algorithm, and improving the accuracy of the visual algorithm verification.
- the fourth parameter threshold range is defined to determine whether the grayscale value difference is within the allowable range. If the difference is within the fourth parameter threshold range, it is determined to be within the allowable range. If the difference is outside the fourth parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of a certain allowable error to avoid misjudgment.
- the fourth parameter threshold range can be 10, that is, the visual algorithm verification:
- the grayscale value of the colorimetric card on the calibration piece is 50
- the grayscale value of the same position of the colorimetric card on the calibration piece calibrated by a good visual analysis algorithm is 55.
- the measurement value obtained by image analysis differs from the parameter value obtained by detection through a good visual algorithm by 5, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the visual algorithm of the visual inspection device.
- the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
- This embodiment obtains the visual algorithm verification result by comparing the difference between the grayscale value corresponding to the current visual algorithm and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, a certain threshold range is given, and the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
- the method further includes:
- Step S820 the host computer obtains the first picture, the second picture, the third picture and the fourth picture with calibrated parameter values, wherein the parameter value of the first picture is in the first range, the parameter value of the second picture is in the second range, the parameter value of the third picture is in the third range, the parameter value of the third picture is in the fourth range, the first range is different from the second range, and the third range is different from the fourth range; an image verification library is established according to the first picture, the second picture, the third picture and the fourth picture.
- the first picture can be a normal picture
- the second picture can be a normal limit picture
- the third picture can be an abnormal picture
- the fourth picture can be an abnormal limit picture.
- the product picture verification library needs to have NG products, NG limit samples, OK products, and OK limit samples.
- Each defect of NG products and NG limit samples is not less than 3EA, and OK products and OK limit samples are not less than 3EA.
- the pictures of typical defective products produced by production are collected, or typical defects are artificially created, and then the pictures are taken and stored by a camera, so as to realize the establishment of the verification library.
- This embodiment uses a pre-established image verification library to detect the visual algorithm, which has a higher verification efficiency than directly comparing the verification results.
- the host computer numbers the first picture, the second picture, the third picture, and the fourth picture; and establishes a picture verification library according to the numbered first picture, the second picture, the third picture, and the fourth picture.
- the pictures are numbered and analyzed using a complete algorithm to obtain results that are set as standard values.
- the numbering method can be through coding identification or other methods. This embodiment does not impose any restrictions on this.
- the numbering method can be used to locate and track pictures, which facilitates gallery management.
- the picture samples are managed by numbering, thereby achieving effective management of the picture verification library, but it is not convenient for subsequent adjustment and update of the picture verification library.
- the method further includes:
- Step S821 The host computer uses a target visual detection algorithm to evaluate the sample image to obtain a first image, a second image, a third image, and a fourth image with calibrated parameter values.
- a perfect algorithm is used to analyze the images in the verification library to obtain the results, which are set as standard values.
- the length of the structural parameters of image A obtained through a good visual algorithm analysis is 5 mm, which facilitates the verification of the visual algorithm.
- This embodiment pre-evaluates the sampled images through a perfect visual detection algorithm, and uses the evaluated parameter values as standard values for subsequent comparisons to achieve verification of the visual algorithm.
- step S803 includes:
- Step S818' selecting a target image from the image verification library.
- Step S819' perform image recognition on the target image through a visual detection device to obtain parameter values of the target image.
- Step S820' comparing the parameter value with the calibration parameter value corresponding to the target image.
- Step S821' when the difference between the parameter value and the calibration parameter value corresponding to the target image exceeds the fifth parameter threshold range, it is determined that the visual algorithm is abnormal.
- the visual system performs algorithm verification.
- the visual algorithm traverses the algorithm verification library and performs algorithm analysis. Then obtain the result parameters of the verification image. If the obtained result parameters are the same as the predetermined standard parameters or are within the reasonable error range of the predetermined standard parameters, it means that the algorithm has good accuracy.
- Algorithm verification
- Step S900 the manufacturing execution system creates a verification task, or the equipment sets an automatic verification time, triggering the visual inspection device to enter an automatic verification mode.
- Step S901 the visual inspection device interacts with the upstream workstation to inform the upstream workstation to stop unloading and enter the verification mode.
- Step S902 the visual inspection device determines whether there is material at the check position through a sensor
- Step S903 If there is material, the last product test is performed. If there is no material, the verification is started.
- Step S904 The visual inspection device confirms through the perception of the sensor that there is no product at the verification position, controls the cylinder to extend, and moves the verification piece to the waiting position.
- Step S905 the camera performs imaging analysis on the size verification part on the verification piece to obtain the parameters of the size verification part, the camera performs precision verification to obtain the size parameters of the groove or protrusion, and the imaging effect verification obtains the grayscale value of the color card.
- Step S906 after completing the acquisition of the verification piece image, trigger the control cylinder to retract to the original position and move the verification piece to the original position.
- Step S907 compare the obtained structural parameters with the predetermined structural parameters. If the obtained structural parameters are the same as the predetermined structural parameters or are within the reasonable error range of the predetermined structural parameters, it means that the obtained groove or protrusion structural parameters are not distorted, the lens is not loose or out of focus, the structural parameters of the color card are not varied, the light source brightness, camera aperture, camera exposure, gain, etc.
- the visual inspection device After the visual inspection device completes the accuracy and imaging verification results, the visual inspection device performs algorithm verification.
- Step S908 the visual algorithm traverses the algorithm verification library, and obtains the result parameters of the verification image after algorithm analysis. If the obtained result parameters are the same as the predetermined standard parameters or are within the reasonable error range of the predetermined standard parameters, it means that the algorithm accuracy is good, and the algorithm verification is:
- Step S909 upload the obtained parameters and comparison results to the manufacturing execution system, and the manufacturing execution system will compare the structural parameters again. If any result is NG, the manufacturing execution system will lock the machine and prevent the detection system from producing. At the same time, the equipment will alarm.
- step S910 the staff needs to conduct system inspection and adjustment based on the NG items to correct the visual inspection errors in time, so as to ensure that the visual inspection system still has good accuracy after a long time or adjustment.
- step S911 the visual inspection device interacts with the upstream workstation to inform the upstream workstation to start unloading and enter the production mode.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Pathology (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Mathematical Physics (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
视觉校验装置100,视觉检测装置200,上位机300,校验件10,校验件移动装置20,尺寸校验部201,色卡校验部202,
板主体30,校验面40,安装板50,支撑底座60,驱动装置70、701、702、滑轨80、转接座90、高度限位块901、第一滑动限位块902以及第二滑动限位块903。
Claims (26)
- 一种视觉检测系统,其中,所述视觉检测系统包括:视觉校验装置,包括校验件以及校验件移动装置,所述校验件移动装置包括活动安装的安装板,在所述安装板的活动行程上,所述安装板能够处在校验位,所述校验位在视觉检测装置的检测范围内,所述校验件设于所述安装板;视觉检测装置,用于获得所述校验件的图像,并将所述校验件的图像发送至上位机;上位机,用于根据所述校验件的图像确定所述视觉检测装置的系统性校验结果。
- 如权利要求1所述的视觉检测系统,其中,所述校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部;所述视觉检测装置,还用于获得所述尺寸校验部的第一图像以及所述色卡校验部的第二图像,并将所述第一图像以及所述第二图像发送至上位机;所述上位机,还用于根据所述第一图像和/或所述第二图像确定所述视觉检测装置的系统性校验结果。
- 如权利要求2所述的视觉检测系统,其中,所述视觉校验装置还包括:支撑底座;以及,驱动装置,包括相对直线活动的固定部和活动部,所述固定部设于所述支撑底座,所述活动部与所述安装板连接。
- 如权利要求3所述的视觉检测系统,其中,所述视觉校验装置还包括滑动导向结构,所述滑动导向结构包括相互滑动配合的滑轨和滑块,所述滑轨和所述滑块设于所述支撑底座与所述安装板之间。
- 如权利要求4所述的视觉检测系统,其中,所述视觉校验装置还包括转接座,所述滑轨设置两个,对应所述滑块设置两个;其中相互配合的一组所述滑轨和滑块分设于所述支撑底座和所述转接座之间,另一组所述滑轨和滑块分设于所述安装板和所述转接座之间。
- 如权利要求1所述的视觉检测系统,其中,所述校验件包括:板主体,具有校验面;多个尺寸校验部,沿直线方向间隔设于所述校验面上,多个所述尺寸校验部具有处在第一方向上的长度尺寸和处在第二方向上的宽度尺寸,多个所述尺寸校验部的长度尺寸呈梯度变化,和/或,多个所述尺寸校验部的宽度尺寸呈梯度变化,其中,所述第一方向与所述第二方向为水平面内相互垂直的方向。
- 如权利要求6所述的视觉检测系统,其中,所述尺寸校验部包括形成在所述板本体上的凸起或者凹槽。
- 如权利要求6所述的视觉检测系统,其中,多个所述尺寸校验部沿第三方向上的尺寸呈梯度变化,所述第三方向与所述第一方向和所述第二方向均垂直设置。
- 如权利要求6所述的视觉检测系统,其中,还包括设于所述板主体的校验面上的灰度值呈梯度变化的色卡校验部。
- 如权利要求6所述的视觉检测系统,其中,所述板主体的材质包括铝合金;和/或,所述板主体的校验面的粗糙度小于预设粗糙度阈值。
- 一种视觉检测方法,其中,视觉检测系统包括视觉检测装置、视觉校验装置以及上位机,所述视觉校验装置,包括校验件以及校验件移动装置,所述校验件移动装置包括活动安装的安装板,在所述安装板的活动行程上,所述安装板能够处在校验位,所述校验位在视觉检测装置的检测范围内,所述校验件设于所述安装板;所述视觉检测方法包括:所述视觉检测装置获得所述校验件的图像,并将所述校验件的图像发送至所述上位机;所述上位机根据所述校验件的图像确定所述视觉检测装置的系统性校验结果。
- 如权利要求11所述的视觉检测方法,其中,所述校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部,所述视觉检测方法还包括:所述视觉检测装置获得所述尺寸校验部的第一图像以及所述色卡校验部的第二图像,并将所述第一图像以及所述第二图像发送至上位机;所述上位机根据所述第一图像和/或所述第二图像确定所述视觉检测装置的系统性校验结果。
- 如权利要求11所述的视觉检测方法,其中,所述视觉检测方法还包括:所述上位机在接收到校验指令的情况下,发送校验指令至所述视觉检测装置;所述视觉检测装置在接收到校验指令的情况下,通知工位控制器停止输送物料。
- 如权利要求13所述的视觉检测方法,其中,所述视觉检测方法还包括:所述视觉检测装置在检测到校验位上未存有物料的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移动至所述校验位,所述校验位在所述视觉检测装置的检测范围内;所述视觉检测装置检测到校验位上存有物料的情况下,继续对所述校验位上的当前物料进行检测,直至目标物料离开所述校验位的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移动至所述校验位。
- 如权利要求12所述的视觉检测方法,其中,所述视觉检测方法还包括:所述视觉检测装置在检测到第一图像和/或第二图像的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移出所述校验位。
- 如权利要求11至15任一项所述的视觉检测方法,其中,所述视觉检测方法还包括:所述上位机在所述系统性校验结果为正常的情况下,通知工位控制器开始输送物料;所述上位机在所述系统性校验结果为异常的情况下,通知各检测设备进行停机检测,并进行报警。
- 如权利要求12所述的视觉检测方法,其中,所述视觉检测方法还包括:所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果;所述上位机根据所述第二图像进行成像效果校验,得到成像效果校验结果;所述上位机在所述视觉精度校验结果以及成像效果校验结果均为正常校验结果的情况下,根据目标图像进行视觉算法校验,得到视觉算法校验结果;所述上位机根据所述视觉精度校验结果、成像效果校验结果以及视觉算法校验结果确定所述视觉检测装置的系统性校验结果。
- 如权利要求17所述的视觉检测方法,其中,所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果,包括:所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与预设标准值的第一差值;所述上位机在所述第一差值大于等于第一参数阈值范围的情况下,得到所述视觉检测装置的视觉精度异常的校验结果;所述上位机在所述第一差值小于第一参数阈值范围的情况下,得到所述视觉检测装置的视觉精度正常的校验结果。
- 如权利要求18所述的视觉检测方法,其中,还包括:所述上位机根据所述结构参数对应的公差确定第一参数阈值范围。
- 如权利要求18所述的视觉检测方法,其中,所述视觉检测方法还包括:所述上位机通过目标视觉算法对所述第一图像进行检测,得到结构参数对应的目标标准值;所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与目标标准值的第二差值;所述上位机在所述第二差值大于等于第二参数阈值范围的情况下,得到所述视觉检测装置的视觉算法异常的校验结果;所述上位机在所述第二差值小于第二参数阈值范围的情况下,得到所述视觉检测装置的视觉算法正常的校验结果。
- 如权利要求17所述的视觉检测方法,其中,所述上位机根据所述第二图像进行成像效果校验,得到成像效果校验结果,包括:所述上位机确定所述第二图像中所述色卡校验部的灰度值与预设灰度值的第三差值;所述上位机在所述第三差值大于等于第三参数阈值范围的情况下,确定所述视觉检测装置的成像效果异常的检测结果;所述上位机在所述第三差值小于第三参数阈值范围的情况下,确定所述视觉检测装置的成像效果正常的检测结果。
- 如权利要求11至21任一项所述的视觉检测方法,其中,所述视觉检测方法还包括:所述上位机通过目标视觉算法对所述第二图像进行检测,得到目标灰度值;所述上位机确定所述第二图像中所述色卡校验部的灰度值与目标灰度值的第四差值;所述上位机在所述第四差值大于等于第四参数阈值范围的情况下,得到所述视觉检测装置的视觉算法异常的校验结果;所述上位机在所述第四差值小于第四参数阈值范围的情况下,得到所述视觉检测装置的视觉算法正常的校验结果。
- 如权利要求17所述的视觉检测方法,其中,所述上位机根据目标图像进行视觉算法校验,得到视觉算法校验结果之前,还包括:所述上位机获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片,其中,所述第一图片的参数值处于第一范围,第二图片的参数值处于第二范围,第三图片的参数值处于第三范围,第三图片的参数值处于第四范围,所述第一范围和第二范围不同,所述第三范围和第四范围不同;所述上位机根据所述第一图片、第二图片、第三图片以及第四图片建立图片校验库。
- 如权利要求23所述的视觉检测方法,其中,所述上位机根据所述第一图片、第二图片、第三图片以及第四图片建立图片校验库,包括:所述上位机对所述第一图片、第二图片、第三图片以及第四图片进行编号;所述上位机根据编号后的第一图片、第二图片、第三图片以及第四图片建立图片校验库。
- 如权利要求23所述的视觉检测方法,其中,所述上位机获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片之前,还包括:所述上位机采用目标视觉检测算法对样本图像进行评估,得到经过标定参数值的第一图片、第二图片、第三图片以及第四图片。
- 如权利要求23所述的视觉检测方法,其中,所述上位机根据目标图像进行视觉算法校验,得到视觉算法校验结果,包括:所述上位机从所述图片校验库中选择目标图像;所述上位机通过所述视觉检测装置对所述目标图像进行图像识别,得到所述目标图像的参数值;所述上位机将所述参数值与所述目标图像对应的标定参数值进行比较;所述上位机将所述参数值与所述目标图像对应的标定参数值的差值超过第五参数阈值范围的情况下,确定视觉算法异常。
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2023/129428 WO2025091409A1 (zh) | 2023-11-02 | 2023-11-02 | 视觉检测系统及方法 |
| EP23889858.9A EP4579173A4 (en) | 2023-11-02 | 2023-11-02 | Visual inspection system and method |
| CN202380060046.XA CN120265943A (zh) | 2023-11-02 | 2023-11-02 | 视觉检测系统及方法 |
| US18/433,462 US20250146951A1 (en) | 2023-11-02 | 2024-02-06 | Visual inspection system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2023/129428 WO2025091409A1 (zh) | 2023-11-02 | 2023-11-02 | 视觉检测系统及方法 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/433,462 Continuation US20250146951A1 (en) | 2023-11-02 | 2024-02-06 | Visual inspection system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025091409A1 true WO2025091409A1 (zh) | 2025-05-08 |
Family
ID=95562167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/129428 Pending WO2025091409A1 (zh) | 2023-11-02 | 2023-11-02 | 视觉检测系统及方法 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20250146951A1 (zh) |
| EP (1) | EP4579173A4 (zh) |
| CN (1) | CN120265943A (zh) |
| WO (1) | WO2025091409A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN121568543A (zh) * | 2026-01-21 | 2026-02-24 | 浙江轩田智能科技有限公司 | 一种kgd分选机高温转塔至常温转塔转运机构及转运方法 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07208924A (ja) * | 1994-01-11 | 1995-08-11 | Toshiba Corp | 視覚認識装置の認識用光学系のキャリブレーション方法 |
| CN115930784A (zh) * | 2023-01-09 | 2023-04-07 | 广州市易鸿智能装备有限公司 | 一种视觉检测系统的点检方法 |
| CN115984177A (zh) * | 2022-12-01 | 2023-04-18 | 五邑大学 | 机器视觉检测装置及其控制方法、控制装置及存储介质 |
| CN116124006A (zh) * | 2023-04-19 | 2023-05-16 | 征图新视(江苏)科技股份有限公司 | 一种电池极片视觉检测系统的自动点检方法 |
| CN116342599A (zh) * | 2023-05-29 | 2023-06-27 | 宁德时代新能源科技股份有限公司 | 缺陷检测设备的点检方法、装置、设备和存储介质 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2595927B2 (ja) * | 1992-07-07 | 1997-04-02 | 東洋紡績株式会社 | シート状物色差検査装置 |
| US9305366B2 (en) * | 2012-08-08 | 2016-04-05 | Jeffrey Stark | Portable electronic apparatus, software and method for imaging and interpreting pressure and temperature indicating |
| JP6353766B2 (ja) * | 2014-10-23 | 2018-07-04 | 株式会社プレックス | 外観検査装置 |
| US10399227B1 (en) * | 2019-03-29 | 2019-09-03 | Mujin, Inc. | Method and control system for verifying and updating camera calibration for robot control |
-
2023
- 2023-11-02 CN CN202380060046.XA patent/CN120265943A/zh active Pending
- 2023-11-02 WO PCT/CN2023/129428 patent/WO2025091409A1/zh active Pending
- 2023-11-02 EP EP23889858.9A patent/EP4579173A4/en active Pending
-
2024
- 2024-02-06 US US18/433,462 patent/US20250146951A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07208924A (ja) * | 1994-01-11 | 1995-08-11 | Toshiba Corp | 視覚認識装置の認識用光学系のキャリブレーション方法 |
| CN115984177A (zh) * | 2022-12-01 | 2023-04-18 | 五邑大学 | 机器视觉检测装置及其控制方法、控制装置及存储介质 |
| CN115930784A (zh) * | 2023-01-09 | 2023-04-07 | 广州市易鸿智能装备有限公司 | 一种视觉检测系统的点检方法 |
| CN116124006A (zh) * | 2023-04-19 | 2023-05-16 | 征图新视(江苏)科技股份有限公司 | 一种电池极片视觉检测系统的自动点检方法 |
| CN116342599A (zh) * | 2023-05-29 | 2023-06-27 | 宁德时代新能源科技股份有限公司 | 缺陷检测设备的点检方法、装置、设备和存储介质 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4579173A4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4579173A1 (en) | 2025-07-02 |
| CN120265943A (zh) | 2025-07-04 |
| EP4579173A4 (en) | 2025-08-20 |
| US20250146951A1 (en) | 2025-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12001191B2 (en) | Automated 360-degree dense point object inspection | |
| US12254617B2 (en) | Automated in-line object inspection | |
| Cemenska et al. | Automated in-process inspection system for AFP machines | |
| EP3963414A2 (en) | Automated 360-degree dense point object inspection | |
| EP3102018B1 (en) | Quality management device and method for controlling quality management device | |
| US9743527B2 (en) | Stencil programming and inspection using solder paste inspection system | |
| EP3568665A1 (en) | Surface height measurement system | |
| CN116428984B (zh) | 一种五金模具冲压加工智能检测系统 | |
| CN105574845A (zh) | 一种多相机阵列烟标叠层数量测量方法及装置 | |
| CN118329777A (zh) | 裸晶圆表面缺陷的检测方法、装置、终端设备及存储介质 | |
| JP2007096153A (ja) | はんだペースト印刷システム | |
| CN107110642A (zh) | 用于在线视觉检查的参考系统 | |
| WO2025091409A1 (zh) | 视觉检测系统及方法 | |
| Cemenska et al. | AFP automated inspection system performance and expectations | |
| CN120777999B (zh) | 自动化调试标定系统和方法 | |
| KR20220044741A (ko) | 웨이퍼 외관 검사 장치 및 방법 | |
| CN119438085A (zh) | 电池检测系统及电池检测系统的点检方法 | |
| KR101991277B1 (ko) | 마커를 이용한 자동차 부품 품질 보증 방법 및 장치 | |
| JP2012202957A (ja) | 欠陥位置情報生成装置、欠陥確認システム及び欠陥位置情報生成方法 | |
| TW201522949A (zh) | 影像資訊檢測方法 | |
| KR20130068737A (ko) | 공구 매거진의 공구 상태 확인 장치 및 방법 | |
| KR102909092B1 (ko) | 설비 진단을 위한 스테이지 마크를 이용한 설비 진단 시스템 및 이를 이용한 설비 진단 방법 | |
| KR20160067303A (ko) | 실러 도포 품질 검사 장치 및 이를 이용한 실러 도포 품질 검사 방법 | |
| Cemenska et al. | Automated in-process inspection system for AFP machines | |
| TW202133114A (zh) | 尺寸量測裝置及尺寸量測方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| ENP | Entry into the national phase |
Ref document number: 2023889858 Country of ref document: EP Effective date: 20240531 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202380060046.X Country of ref document: CN |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23889858 Country of ref document: EP Kind code of ref document: A1 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023889858 Country of ref document: EP |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380060046.X Country of ref document: CN |