WO2025091409A1 - 视觉检测系统及方法 - Google Patents

视觉检测系统及方法 Download PDF

Info

Publication number
WO2025091409A1
WO2025091409A1 PCT/CN2023/129428 CN2023129428W WO2025091409A1 WO 2025091409 A1 WO2025091409 A1 WO 2025091409A1 CN 2023129428 W CN2023129428 W CN 2023129428W WO 2025091409 A1 WO2025091409 A1 WO 2025091409A1
Authority
WO
WIPO (PCT)
Prior art keywords
verification
visual
image
visual inspection
host computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2023/129428
Other languages
English (en)
French (fr)
Inventor
李武书
邱桂加
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Contemporary Amperex Technology Co Ltd
Contemporary Amperex Runzhi Software Technology Ltd
Original Assignee
Contemporary Amperex Technology Co Ltd
Contemporary Amperex Runzhi Software Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Contemporary Amperex Technology Co Ltd, Contemporary Amperex Runzhi Software Technology Ltd filed Critical Contemporary Amperex Technology Co Ltd
Priority to PCT/CN2023/129428 priority Critical patent/WO2025091409A1/zh
Priority to EP23889858.9A priority patent/EP4579173A4/en
Priority to CN202380060046.XA priority patent/CN120265943A/zh
Priority to US18/433,462 priority patent/US20250146951A1/en
Publication of WO2025091409A1 publication Critical patent/WO2025091409A1/zh
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/93Detection standards; Calibrating baseline adjustment, drift correction
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/27Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using photo-electric detection ; circuits for computing concentration
    • G01N21/274Calibration, base line adjustment, drift correction
    • G01N21/276Calibration, base line adjustment, drift correction with alternation of sample and standard in optical path
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/93Detection standards; Calibrating baseline adjustment, drift correction
    • G01N2021/936Adjusting threshold, e.g. by way of moving average

Definitions

  • the present application relates to the technical field of visual inspection.
  • the existing production line inspection method solves the problem that the inspection time is too long.
  • the present application provides a visual inspection system, wherein the visual inspection system comprises:
  • a visual inspection device comprising a verification piece and a verification piece moving device, wherein the verification piece moving device comprises a movably mounted mounting plate, wherein the mounting plate can be located at a verification position during the movable travel of the mounting plate, wherein the verification position is within the detection range of the visual inspection device, and wherein the verification piece is arranged on the mounting plate;
  • a visual inspection device used to obtain an image of the verification piece and send the image of the verification piece to a host computer
  • the host computer is used to determine the systematic verification result of the visual inspection device according to the image of the verification part.
  • the calibration parts when performing system calibration, are concentrated on the mounting plate, and the mounting plate is driven to move the calibration parts, thereby adopting an automatic method to achieve fully automatic calibration, thereby solving the problem of long calibration time and large production capacity loss caused by the operator's proficiency.
  • the verification member includes a plurality of size verification parts with gradient-changing sizes and a color card verification part with gradient-changing grayscale values;
  • the visual inspection device is further used to obtain a first image of the size verification unit and a second image of the color card verification unit, and send the first image and the second image to a host computer;
  • the host computer is further used to determine a systematic verification result of the visual inspection device according to the first image and/or the second image.
  • a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
  • the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
  • the accuracy error caused by the distortion of the 2D camera lens can be verified, and on the basis of realizing the accuracy verification, the algorithm verification is further performed, thereby realizing the systematic verification of the visual inspection device.
  • the verification piece can be detachably mounted on the mounting plate.
  • a quick-release locking method of the calibration component is realized by a detachable component on the calibration component mounting plate, which is convenient for true value measurement of a two-dimensional or higher-precision measurement system.
  • the visual verification device further comprises:
  • the driving device comprises a fixed part and a movable part which can move linearly relative to each other, the fixed part is arranged on the supporting base, and the movable part is connected to the mounting plate.
  • the movement of the verification piece is achieved by driving, thereby realizing full-automatic verification of the visual inspection device.
  • the visual verification device also includes a sliding guide structure, which includes a slide rail and a slider that slide with each other, and the slide guide structure includes a slide rail and a slider that slide with each other, and the slide rail and the slider are arranged between the support base and the mounting plate.
  • the movement trajectory of the verification piece mounting plate is determined by the sliding device, thereby improving the accuracy of the movement of the verification piece.
  • the visual inspection device further includes an adapter, two of the sliders are provided, and two corresponding sliders are provided;
  • One group of the slide rails and the sliding blocks that cooperate with each other is arranged between the support base and the adapter seat, and the other group of the slide rails and the sliding blocks is arranged between the mounting plate and the adapter seat.
  • the movement of the mounting plate is achieved through multiple sets of sliding devices, thereby achieving precise control of the movement of the mounting plate.
  • the verification element includes:
  • a plurality of dimension verification parts are arranged on the verification surface at intervals along a straight line direction, and the plurality of dimension verification parts have a length dimension in a first direction and a width dimension in a second direction, and the length dimensions of the plurality of dimension verification parts vary in a gradient, and/or the width dimensions of the plurality of dimension verification parts vary in a gradient, wherein the first direction and the second direction are directions perpendicular to each other in a horizontal plane.
  • a plurality of dimension verification parts with gradient changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
  • the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints passing through the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
  • the accuracy error caused by the distortion of the 2D camera lens can be verified, thereby improving the accuracy of visual inspection.
  • the size verification portion includes a protrusion or a groove formed on the plate body.
  • the size information of the grooves, protrusions, etc. on the verification piece is obtained to determine whether it is within a reasonable error range with the predetermined size information, so as to achieve camera accuracy verification.
  • the sizes of the plurality of size verification parts along the third direction vary in a gradient manner.
  • a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools and ensures that the linear offset of the measuring tool is verified.
  • it also includes a color card calibration part with a gradient grayscale value disposed on the calibration surface of the board body.
  • the calibration of the imaging effect is achieved by providing a colorimetric card on the calibration piece.
  • the color card of the calibration piece requires that the black and white camera be equipped with three gradient standard color cards of light gray, gray and dark gray, so as to achieve the calibration of the imaging effect of the black and white camera.
  • the color card verification unit includes a three-primary color card.
  • the color camera is equipped with an RGB three-primary color card to verify the imaging effect of the color camera.
  • the material of the plate body includes aluminum alloy; and/or,
  • the material plate of the plate body includes aluminum alloy, and the roughness of the verification surface of the plate body is adjusted to improve the imaging effect of the size verification part with multiple gradient changes in size and the color card verification part with gradient changes in grayscale values.
  • the present application further provides a visual inspection method, wherein the visual inspection system includes a visual inspection device, a visual verification device, and a host computer, the visual verification device includes a verification piece and a verification piece moving device, the verification piece moving device includes a movably mounted mounting plate, the mounting plate can be in a verification position in the movable stroke of the mounting plate, the verification position is within the detection range of the visual inspection device, and the verification piece is arranged on the mounting plate;
  • the visual inspection device obtains the image of the verification piece and sends the image of the verification piece to the host computer;
  • the host computer determines the systematic verification result of the visual inspection device according to the image of the verification part.
  • the calibration parts when performing system calibration, are concentrated on the mounting plate, and the mounting plate is driven to move the calibration parts, thereby adopting an automatic method to achieve fully automatic calibration, thereby solving the problem of long calibration time and large production capacity loss caused by the operator's proficiency.
  • the verification piece includes a plurality of size verification parts with gradient-changing sizes and a color card verification part with gradient-changing grayscale values
  • the visual inspection method further includes:
  • the visual inspection device obtains a first image of the size verification unit and a second image of the color card verification unit, and sends the first image and the second image to a host computer;
  • the host computer determines a systematic verification result of the visual inspection device according to the first image and/or the second image.
  • a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
  • the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
  • the accuracy error caused by the distortion of the 2D camera lens can be verified, and on the basis of realizing the accuracy verification, the algorithm verification is further performed, thereby realizing the systematic verification of the visual inspection device.
  • the systematic verification result includes a visual accuracy verification result, an imaging effect detection result, and a visual algorithm verification result
  • the visual detection method further includes:
  • the device to be detected is notified to stop working.
  • the visual detection method further comprises:
  • the visual detection method further comprises:
  • the host computer When receiving the verification instruction, the host computer sends the verification instruction to the visual inspection device;
  • the visual inspection device When receiving the verification instruction, the visual inspection device notifies the station controller to stop conveying the material to the visual inspection device.
  • the material delivery to the production line is suspended, thereby improving the accuracy of the verification.
  • the visual detection method further comprises:
  • the driving device in the visual inspection device is notified to move the check piece to the check position, and the check position is within the detection range of the visual inspection device;
  • the calibration piece is moved to the position to be measured by a driving device without manual operation of the calibration piece, thereby achieving fully automatic calibration and solving the problem of long calibration time and large production capacity loss due to the influence of the operator's proficiency.
  • the visual detection method further comprises:
  • the visual inspection device detects that there is material on the check position inspected by the visual inspection device, the visual inspection device is notified to continue inspecting the current material on the check position. Until the target material leaves the check position, the driving device in the visual inspection device is notified to move the check piece to the check position so that the light source in the visual inspection device illuminates the check piece.
  • the visual inspection device uses a sensor to determine whether there is material at the position to be tested. If there is material, the last product inspection is performed, thereby realizing fully automatic verification and improving the efficiency of verification.
  • the visual detection method further comprises:
  • the visual inspection device When the visual inspection device detects the first image and/or the second image, the visual inspection device notifies the driving device in the visual verification device to move the verification piece back to its original position.
  • the verification piece after obtaining the verification image, the verification piece is automatically moved back to its original position through the driving device without the need for manual operation of the verification piece, thereby achieving fully automatic verification and solving the problem of long verification time and large production capacity loss due to the influence of the operator's proficiency.
  • the visual detection method further comprises:
  • the host computer When the system verification result is normal, the host computer notifies the station controller to start conveying materials;
  • the host computer When the result of the systematic check is abnormal, the host computer notifies each detection device to perform a shutdown test and issues an alarm.
  • the host computer controls the production line according to the systematic verification result.
  • the workstation controller is notified to start conveying materials, thereby improving the processing efficiency of the production line.
  • each detection equipment is notified to perform shutdown detection and issue an alarm, thereby improving effective monitoring of the production line.
  • the visual detection method further comprises:
  • the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result
  • the host computer performs imaging effect verification according to the second image to obtain an imaging effect verification result
  • the host computer performs visual algorithm verification according to the target image to obtain a visual algorithm verification result
  • the host computer determines the systematic verification result of the visual inspection device according to the visual accuracy verification result, the imaging effect verification result and the visual algorithm verification result.
  • the accuracy verification within the measuring range of the 2D camera and 3D camera measuring tools is effectively achieved, and on the basis of achieving the accuracy verification, the algorithm verification is further performed, thereby realizing the systematic verification of the visual inspection device.
  • the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result, including:
  • the visual accuracy verification result of the visual inspection device is determined according to the measurement values corresponding to the structural parameters of the size verification part in the first image.
  • the visual accuracy verification result is obtained by comparing the measurement values corresponding to the structural parameters, thereby realizing the visual accuracy verification through quantified data and improving the accuracy of visual detection.
  • the host computer determines the visual accuracy verification result of the visual inspection device according to the measurement value corresponding to the structural parameter, including:
  • a visual accuracy verification result of the visual inspection device is determined according to the first difference.
  • the visual accuracy verification result is obtained by the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object, so as to effectively obtain the error between the result of image analysis and the actual result, and more accurately obtain the accuracy of visual detection.
  • the host computer determines the visual accuracy verification result of the visual inspection device according to the first difference, including:
  • a visual accuracy verification result of the visual inspection device is determined according to the first difference and a first parameter threshold range.
  • the visual accuracy verification result is obtained by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with the comparison only by the difference, a certain threshold range is given, and the detection result is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual accuracy detection.
  • the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result, including:
  • the host computer determines a first difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a preset standard value
  • the host computer When the first difference is greater than or equal to the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is abnormal; when the first difference is less than the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is normal.
  • the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object is compared with the parameter threshold range.
  • the detection result is considered normal only if it does not exceed the range, thereby improving the accuracy of visual precision detection.
  • it also includes:
  • the host computer determines a first parameter threshold range according to a tolerance corresponding to the structural parameter.
  • the parameter threshold range is determined by the corresponding structural parameters. Since the standards corresponding to different structural parameters are also different, the parameter threshold range is determined by the tolerance corresponding to the parameters, so that the parameter threshold range is adapted to the structural parameters, thereby improving the rationality of visual accuracy detection.
  • the visual detection method further comprises:
  • the host computer determines a second difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a target standard value
  • the measurement values corresponding to the structural parameters are compared with the measurement values of the structural parameters analyzed by the normal visual detection algorithm to obtain the difference between the analysis results of the current visual algorithm and the analysis results detected by the normal visual detection algorithm. Therefore, the difference between the current visual algorithm and the normal visual detection algorithm is obtained, thereby realizing the verification of the visual algorithm.
  • the method before determining the second difference between the measured value corresponding to the structural parameter and the standard value corresponding to the target structural parameter, the method further includes:
  • the first image is detected by a target vision algorithm to obtain target standard values corresponding to the structural parameters.
  • the dimension verification part is analyzed by the target visual algorithm to obtain the target standard value corresponding to the structural parameter, which can be compared with the measurement value corresponding to the structural parameter, thereby achieving the standard unification of the comparison between the current visual algorithm and the normal visual detection algorithm, and improving the accuracy of the visual algorithm verification.
  • determining the first visual algorithm verification result of the visual detection device according to the second difference includes:
  • a first visual algorithm verification result of the visual detection device is determined according to the second difference and a second parameter threshold range.
  • the visual algorithm verification result is obtained by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
  • the visual detection method further comprises:
  • the host computer detects the first image through a target vision algorithm to obtain a target standard value corresponding to the structural parameter;
  • the host computer determines a second difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a target standard value
  • the host computer When the second difference is greater than or equal to the second parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual detection device is abnormal; when the second difference is less than the second parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual detection device is normal.
  • the visual algorithm verification result is obtained by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range, thereby improving the accuracy of the visual algorithm verification.
  • performing imaging effect verification according to the second image to obtain an imaging effect verification result includes:
  • An imaging effect verification result is obtained according to the grayscale value of the color card verification part in the second image.
  • the calibration of the imaging effect is further achieved on the basis of achieving visual accuracy.
  • obtaining an imaging effect verification result according to the grayscale value of the color card verification portion in the second image includes:
  • a detection result of the imaging effect of the visual detection device is determined.
  • the imaging effect verification result is obtained by the difference between the grayscale value and the grayscale value corresponding to the actual detection object, so as to effectively obtain the error between the result of image analysis and the actual result, and more accurately realize the detection of imaging effect.
  • determining the detection result of the imaging effect of the visual detection device according to the third difference includes:
  • the detection result of the imaging effect of the visual detection device is determined according to the third difference and the third parameter threshold range.
  • the imaging effect verification result is obtained by comparing the difference between the current grayscale value and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the detection result is considered abnormal only when it exceeds this range, thereby improving the accuracy of imaging effect detection.
  • the host computer performs imaging effect verification according to the second image to obtain an imaging effect verification result, including:
  • the host computer determines a third difference between the grayscale value of the color card verification part in the second image and a preset grayscale value
  • the host computer determines that the detection result of the imaging effect of the visual detection device is abnormal; when the third difference is less than the third parameter threshold range, the host computer determines that the detection result of the imaging effect of the visual detection device is normal.
  • the imaging effect verification result is obtained by comparing the difference between the current grayscale value and the standard value corresponding to the actual detection object with the parameter threshold range.
  • the visual detection method further comprises:
  • a second visual algorithm verification result of the visual inspection device is obtained according to the grayscale value of the color card verification part in the second image.
  • the visual algorithm in addition to detecting the imaging effect through grayscale values, the visual algorithm can also be verified, thereby realizing systematic visual verification and improving the comprehensiveness and effectiveness of production line monitoring.
  • obtaining the second visual algorithm verification result of the visual inspection device according to the grayscale value of the color card verification part in the second image includes:
  • a second visual algorithm verification result of the visual inspection device is obtained according to a fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value.
  • the grayscale value is compared with the grayscale value analyzed by the normal visual detection algorithm to obtain the difference between the analysis result of the current visual algorithm and the analysis result detected by the normal visual detection algorithm. Therefore, the difference between the current visual algorithm and the normal visual detection algorithm is obtained, thereby realizing the verification of the visual algorithm.
  • the method before obtaining the second visual algorithm verification result of the visual inspection device according to the fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value, the method further includes:
  • the second image is detected by a target vision algorithm to obtain a target grayscale value.
  • the colorimetric card is analyzed by the target visual algorithm to obtain the target standard value corresponding to the colorimetric card, which can be compared with the grayscale value obtained by the current visual algorithm analysis, thereby achieving the standard unification for comparing the current visual algorithm with the normal visual detection algorithm, and improving the accuracy of visual algorithm verification.
  • obtaining the second visual algorithm verification result of the visual inspection device according to the fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value includes:
  • a second visual algorithm verification result of the visual inspection device is determined according to the fourth difference and the fourth parameter threshold range.
  • the visual algorithm verification result is obtained by comparing the difference between the grayscale value corresponding to the current visual algorithm and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
  • the visual detection method further comprises:
  • the host computer detects the second image by using a target vision algorithm to obtain a target grayscale value
  • the host computer determines a fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value
  • the host computer obtains a verification result of an abnormality in the visual algorithm of the visual detection device when the fourth difference is greater than or equal to a fourth parameter threshold range;
  • the host computer obtains a verification result that the visual algorithm of the visual detection device is normal.
  • the visual algorithm verification result is obtained by comparing the difference between the grayscale value corresponding to the current visual algorithm and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
  • the visual detection method further comprises:
  • a systematic verification result of the visual inspection device is determined according to the detection value and the standard value corresponding to the first image.
  • the systematic verification result of the visual inspection device is obtained by comparing the detection value with the standard value, thereby realizing the systematic verification result of the visual inspection device through quantified data, thereby improving the accuracy of the systematic verification of the visual inspection device.
  • the visual detection method further comprises:
  • a systematic verification result of the visual inspection device is determined based on the detection value and the standard value corresponding to the second image.
  • the visual accuracy verification result is obtained by comparing the measured value corresponding to the structural parameter with the standard value
  • the imaging effect verification result is obtained by comparing the grayscale value of the colorimetric card with the standard value, thereby realizing the systematic verification of the visual inspection device through quantified data and improving the accuracy of the systematic verification.
  • the visual detection method further comprises:
  • a systematic verification result of the visual inspection device is determined based on the detection value and the standard value corresponding to the first image and the detection value and the standard value corresponding to the second image.
  • visual accuracy verification and imaging effect verification are achieved through the images of multiple size verification parts with gradient changes in size and color card verification parts with gradient changes in grayscale values. Then, the visual algorithm is verified on the basis of the visual accuracy verification and imaging effect verification, thereby realizing systematic verification of the visual inspection device.
  • the host computer performs visual algorithm verification according to the target image, and before obtaining the visual algorithm verification result, it also includes:
  • the host computer obtains a first picture, a second picture, a third picture, and a fourth picture with calibrated parameter values, wherein the parameter value of the first picture is within a first range, the parameter value of the second picture is within a second range, the parameter value of the third picture is within a third range, and the parameter value of the third picture is within a fourth range, the first range is different from the second range, and the third range is different from the fourth range;
  • a picture verification library is established according to the first picture, the second picture, the third picture and the fourth picture.
  • the visual algorithm is detected by using a pre-established image verification library, which has a higher verification efficiency than directly comparing the verification results.
  • the host computer establishes a picture verification library according to the first picture, the second picture, the third picture and the fourth picture, including:
  • the host computer numbers the first picture, the second picture, the third picture and the fourth picture;
  • a picture verification library is established according to the numbered first picture, second picture, third picture and fourth picture.
  • the image samples are managed by numbering, thereby achieving effective management of the image verification library, which is not convenient for subsequent adjustment and update of the image verification library.
  • FIG5 is a schematic diagram of a first flow chart of a visual inspection method proposed in some embodiments of the present application.
  • FIG6 is a schematic diagram of a second process of the visual inspection method proposed in some embodiments of the present application.
  • FIG7 is a schematic diagram of a third flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG8 is a schematic diagram of a first overall process of visual inspection proposed in some embodiments of the present application.
  • FIG9 is a schematic diagram of a fourth process flow of a visual inspection method proposed in some embodiments of the present application.
  • FIG10 is a fifth flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG11 is a sixth flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG12 is a seventh flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG13 is a schematic diagram of an eighth flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG14 is a ninth flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG16 is a schematic diagram of a visual algorithm detection process of a visual detection method proposed in some embodiments of the present application.
  • FIG17 is a schematic diagram of a tenth flow chart of a visual inspection method proposed in some embodiments of the present application.
  • FIG18 is a schematic diagram of an eleventh flow chart of a visual inspection method proposed in some embodiments of the present application.
  • FIG19 is a twelfth flow chart of the visual inspection method proposed in some embodiments of the present application.
  • FIG20 is a schematic diagram of a thirteenth flow chart of a visual inspection method proposed in some embodiments of the present application.
  • FIG. 21 is a third overall flow chart of the visual inspection method proposed in some embodiments of the present application.
  • the reference numerals in the specific implementation manner are as follows: Visual inspection device 100, visual inspection device 200, host computer 300, inspection piece 10, inspection piece moving device 20, size inspection unit 201, color card inspection unit 202, The plate body 30 , the calibration surface 40 , the mounting plate 50 , the support base 60 , the drive devices 70 , 701 , 702 , the slide rail 80 , the adapter 90 , the height limit block 901 , the first slide limit block 902 and the second slide limit block 903 .
  • the movement of the mounting plate 50 is achieved through multiple sets of sliding devices, thereby achieving precise control of the movement of the mounting plate 50 .
  • the visual inspection verification piece 10 includes:
  • the plate body 30 has a calibration surface 40
  • Multiple size verification parts 201 are arranged on the verification surface 40 at intervals along a straight line direction.
  • the multiple size verification parts have a length dimension in a first direction and a width dimension in a second direction.
  • the length dimensions of the multiple size verification parts change in a gradient, and/or the width dimensions of the multiple size verification parts change in a gradient, wherein the first direction and the second direction are directions perpendicular to each other in a horizontal plane.
  • the verification piece 10 includes a verification block, and may also be a verification piece 10 in other forms, which is not limited in the present embodiment.
  • the first direction may be the horizontal direction along the plate body 30, that is, the x-axis direction
  • the second direction may be the vertical direction along the plate body 30, that is, the y-axis direction. It may also be that the first direction is the vertical direction along the plate body 30, and the second direction is the horizontal direction along the plate body 30, which is not limited in the present embodiment.
  • the length dimension of the dimension verification part on the front side of any two adjacent dimension verification parts is greater than or smaller than the length dimension of the dimension verification part on the rear side
  • the width dimension of the dimension verification part on the front side of any two adjacent dimension verification parts is greater than or smaller than the width dimension of the dimension verification part on the rear side
  • the first direction and the second direction are directions perpendicular to each other in a horizontal plane, so that the length or width dimension changes linearly, thereby realizing the verification of linear offset.
  • the length dimension change amount of the two adjacent dimension verification parts at the front side is the same as the length dimension change amount of the two adjacent dimension verification parts at the rear side; and/or the width dimension change amount of the two adjacent dimension verification parts at the front side is the same as the width dimension change amount of the two adjacent dimension verification parts at the rear side.
  • the length or width dimension changes in a gradient, improving the accuracy of linear offset.
  • the size checking part and the plate body 30 may be integrally formed or separately provided, and this embodiment does not impose any limitation on this.
  • a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece 10, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tools is verified.
  • the linear offset is the linear error or endpoint linearity, which is the maximum deviation of the straight line composed of the endpoints passing through the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
  • the accuracy error caused by the distortion of the 2D camera lens can be verified, thereby improving the accuracy of visual inspection.
  • the size verification portion includes a protrusion or a groove formed on the plate body.
  • the dimension verification part in the present embodiment is provided with a protrusion or a groove, thereby increasing the visual accuracy verification on the basis of two-dimensional and three-dimensional, and its dimension changes in a gradient, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, ensures that the linear offset of the measuring tool is verified, and can also verify the accuracy error caused by distortion of the 2D camera lens.
  • This embodiment obtains whether the size information of the grooves, protrusions, etc. on the verification piece 10 is within a reasonable error range with the predetermined size information, so as to achieve camera accuracy verification.
  • the sizes of the multiple size verification parts along a third direction vary in a gradient manner, and the third direction is perpendicular to the first direction and the second direction.
  • the third direction is the z-axis direction along the plate body 30 , that is, the z-axis direction of the dimension verification portion changes in a gradient.
  • a plurality of dimension verification parts with gradient-changing dimensions are provided on the verification piece 10, which effectively realizes the accuracy verification within the measuring range of the 2D camera and 3D camera measuring tools and ensures that the linear offset of the measuring tools is verified.
  • a color card calibration part 202 with a gradient grayscale value provided on the calibration surface 40 of the board body 30 is further included.
  • the color card verification unit 202 can be a colorimetric card or other forms of color cards, and this embodiment does not limit this.
  • the colorimetric card includes standard color cards with multiple gradients.
  • the colorimetric card can be a light gray, gray, and dark gray three-gradient standard color card, and can also be an RGB three-primary color card.
  • the black and white camera is equipped with a light gray, gray, and dark gray three-gradient standard color card, and the color camera is equipped with an RGB three-primary color card for verifying the imaging effect.
  • the calibration of the imaging effect is achieved by providing a colorimetric card on the calibration piece 10.
  • the color card of the calibration piece 10 requires that the black-and-white camera be equipped with three gradient standard color cards of light gray, gray, and dark gray, thereby achieving the calibration of the imaging effect of the black-and-white camera.
  • the color card verification unit 202 includes a three-primary color card.
  • the color camera of this embodiment is equipped with an RGB three-primary color card, so as to realize the calibration of the imaging effect of the color camera.
  • the material of the plate body 30 includes aluminum alloy; and/or the roughness of the calibration surface 40 of the plate body 30 is less than a preset roughness threshold.
  • the calibration block in the visual inspection system includes an aluminum white substrate, such as an aluminum alloy material, a gradient calibration groove or protrusion, a gradient standard color card, a cylinder required for the movement of the calibration block, a slide rail 80, and a slider.
  • the preset roughness threshold can be Ra3.2, or other thresholds. This embodiment does not impose any restrictions on this.
  • the calibration block requires that the size of the groove or protrusion presents a periodic pattern and covers the measuring range of the measuring tool as much as possible.
  • the calibration block requires that the groove or protrusion is non-mirror, the surface is frosted, and the roughness is ⁇ Ra3.2, so as to obtain a better imaging effect.
  • the material of the plate body 30 includes aluminum alloy, and the roughness of the verification surface 40 of the plate body 30 is adjusted, so as to improve the imaging effect of the size verification parts with multiple gradient sizes and the color card verification part 202 with gradient grayscale values.
  • the present application also proposes a visual inspection method, wherein the visual inspection system includes a visual inspection device, a visual verification device, and a host computer, as shown in FIG1 , wherein the visual verification device includes a verification piece and a verification piece moving device, wherein the verification piece moving device includes a movably mounted mounting plate, wherein the mounting plate can be in a verification position in the movable travel of the mounting plate, wherein the verification position is within the detection range of the visual inspection device, and the verification piece is arranged on the mounting plate;
  • the flow chart of the first embodiment of the visual inspection method includes:
  • Step S10 the visual inspection device obtains an image of the verification piece and sends the image of the verification piece to the host computer;
  • Step S20 the host computer determines the systematic verification result of the visual inspection device according to the image of the verification object.
  • the visual verification device can be located on one side of the verification position.
  • the manufacturing execution system creates a verification task to trigger the visual system to enter the automatic verification mode or the detection equipment sets the automatic verification time to enter the verification mode
  • the host computer notifies the visual verification device to enter the verification mode.
  • the visual verification device moves the verification piece to the verification position for visual inspection through the verification piece moving device. Since the visual inspection device is used to collect the image of the inspection object located at the verification position, the visual inspection device can collect the image of the verification piece and send the collected verification piece to the host computer for image analysis.
  • the visual inspection system of this embodiment is adaptable to different application scenarios of visual inspection equipment.
  • the device itself can have an automatic calibration function according to the characteristics of the measured object, and can automatically realize online calibration of the visual system light source, camera accuracy, and algorithm stability accuracy.
  • the calibration parts are concentrated on the mounting plate, and the movement of the calibration parts is achieved by driving the mounting plate, so that full-automatic calibration is achieved in an automatic manner, thereby solving the problem of long calibration time and large production capacity loss caused by the operator's proficiency.
  • the verification piece moving device is used to drive the verification block to move to the verification position so that the light source of the visual inspection device illuminates the verification piece.
  • the verification piece moving device is used to move the verification piece under the light source for visual inspection when verification is required, so as to avoid affecting the normal operation of the production line.
  • the verification piece is automatically retracted.
  • the verification piece on the verification piece moving device is moved under the light source for visual inspection, thereby realizing automated visual inspection.
  • the check position is the position of visual inspection.
  • the visual inspection device includes a light source, a visual inspection component, a processing device and a control device.
  • the visual inspection component faces the check position and is used to collect the image of the product on the check position.
  • the light source provides light for the check position
  • the processing device is used to obtain the visual image
  • the control device is used to realize the workflow control of the visual inspection device on the production line.
  • the calibration piece when a system calibration is required through a calibration piece, the calibration piece is automatically moved to the calibration position, thereby achieving a fully automatic calibration of the visual inspection device.
  • This embodiment concentrates the verification parts on the mounting plate, and realizes the movement of the verification parts by driving the mounting plate, thereby realizing fully automatic verification in an automatic manner, thereby solving the problem that the verification time is long and the production capacity loss is large due to the influence of the operator's proficiency.
  • the verification piece includes a plurality of size verification parts with gradient-changing sizes and a color card verification part with gradient-changing grayscale values;
  • Step S10' the visual inspection device is used to obtain a first image of the size verification part and a second image of the color card verification part, and send the first image and the second image to the host computer;
  • Step S20' the host computer is used to determine the systematic verification result of the visual inspection device according to the first image and/or the second image.
  • a product-prototype calibration piece is designed and manually placed on the inspection position of the piece to be tested to match the actual production process detection posture. Then, a camera is used to obtain the dimensional information of the grooves, protrusions, etc. on the calibration piece to see if it is within a reasonable error range with the predetermined dimensional information, thereby achieving camera accuracy calibration.
  • This calibration method is only for camera accuracy calibration, which limits the calibration method.
  • the embodiment of the present application is provided with multiple dimension calibration parts with gradient size changes on the calibration piece, which effectively realizes the accuracy calibration within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is calibrated.
  • the linear offset is the linear error or the endpoint linearity. It is the maximum deviation of the straight line composed of the endpoints of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
  • it can calibrate the accuracy error caused by the distortion of the 2D camera lens, and on the basis of realizing the accuracy calibration, further perform the algorithm calibration, so as to realize the systematic calibration of the visual inspection device.
  • the product can be a battery cell or a battery pack, etc., or other types of products, which are not limited in this embodiment.
  • a battery cell is used as an example for explanation.
  • the visual inspection device can be a 2D camera, a 3D camera, a structural camera, a surface scanning camera or a line scanning camera and a light source, etc.
  • the visual inspection device faces the verification piece for image acquisition, and a light source is also provided to provide light to illuminate the verification piece, so that the visual inspection device can collect the image of the verification piece.
  • the verification piece can be placed on the transportation production line. When the visual inspection device detects the verification piece, the image of the verification piece is collected. It can also be set on the side of the transportation line. When verification is required, the verification piece is automatically placed on the conveyor line. It can also be moved to the detection position by a driving device. This embodiment does not limit this.
  • the visual inspection device includes a verification piece, which is used as a sample.
  • the visual inspection device can be systematically inspected by collecting images of the verification piece.
  • the verification piece and the schematic diagram of the verification part in the verification piece include a plurality of size verification parts with gradient changes in size and a color card verification part with gradient changes in grayscale values.
  • the size verification part can be a gradient verification groove or protrusion, or other forms of size verification parts.
  • the verification piece requires that the size of the groove or protrusion presents a periodic pattern and covers the measuring range of the measuring tool as much as possible.
  • the verification piece requires that the groove or protrusion is not a mirror surface, and the surface is frosted with a roughness of ⁇ Ra3.2.
  • this embodiment adds gradient changes in two-dimensional and three-dimensional dimensions, effectively realizes the accuracy calibration within the measuring range of 2D cameras and 3D cameras, ensures that the linear offset of the measuring tool is calibrated, and at the same time, it can calibrate the accuracy error caused by the distortion of the 2D camera lens.
  • the calibration piece requires no less than 5 grooves or protrusions with gradient changes, and at the same time satisfies 2D and 3D size gradient changes. It is suitable for accuracy calibration of the measuring range of 2D cameras and 3D camera measuring tools, and is suitable for linear offset analysis and calibration of 2D cameras and 3D camera measuring tools.
  • the first image is an image of a size verification part with multiple sizes changing in a gradient.
  • the verification piece can also be set on the product to obtain an image of the product, and the visual algorithm is verified based on the image of the product.
  • a visual inspection device is provided opposite the verification piece. When the verification piece is supplemented with light by a light source, the visual inspection device obtains an image of the size verification part on the verification piece. A systematic analysis is performed through the image of the size verification part to realize the detection of the visual inspection device.
  • the second image is an image of a color card verification part with a gradient grayscale value.
  • the first image and the second image can be one image or multiple separate images.
  • the first image and the second image of the corresponding area are collected by arranging visual inspection devices in different areas.
  • the image can be divided into regions to obtain the first image and the second image corresponding to the size verification parts with multiple sizes changing in a gradient and the color card verification part with a gradient grayscale value, thereby realizing visual inspection.
  • the verification piece can also be placed on the product to obtain an image of the product, and the visual algorithm can be verified based on the image of the product.
  • a visual inspection device is placed directly opposite the verification piece. When the verification piece is supplemented with light by a light source, the visual inspection device obtains an image of the size verification part on the verification piece, and a systematic analysis is performed through the image of the size verification part to realize the inspection of the visual inspection device.
  • the systematic verification results include visual accuracy verification results, imaging effect verification results and visual algorithm verification results, thereby achieving systematic verification of the visual inspection device.
  • multiple dimension verification parts with gradient size changes are provided on the verification part, which effectively realizes the accuracy verification within the measuring range of 2D camera and 3D camera measuring tools, and ensures that the linear offset of the measuring tool is verified.
  • the linear offset is the linear error or the end point linearity. It is the maximum deviation of the straight line composed of the end points of the entire measuring range, that is, the deviation between the measured curve and the ideal straight line.
  • the accuracy error caused by the distortion of the 2D camera lens can be verified, and on the basis of achieving the accuracy verification, the algorithm verification is further performed, so as to realize the systematic verification of the visual inspection device.
  • the various parameters and comparison results obtained are uploaded to the manufacturing execution system, and the manufacturing execution system compares the structural parameters again. If any result is NG, the manufacturing execution system locks the machine and prevents the detection system from producing. At the same time, the equipment alarms, and the staff needs to conduct system troubleshooting and adjustments based on the NG items to correct the visual detection errors in a timely manner. Ensure that the visual inspection system still has good accuracy after a long time or adjustment. For example, when an abnormality in visual accuracy is detected, the manufacturing execution system locks the machine, or when an abnormality occurs in the imaging effect or the visual algorithm, the machine is shut down for rectification, thereby improving the effective monitoring of production.
  • this embodiment promptly stops production for inspection when problems with visual accuracy, visual imaging, and visual algorithms on the production line are detected, thereby achieving effective management and control of production line monitoring.
  • the verification mode is determined to be ended, and the relevant production equipment is notified to enter the production mode.
  • the visual inspection device interacts with the upstream workstation to inform the upstream workstation to start unloading and enter the production mode, thereby realizing automated management of production.
  • execute S302 move the verification block to the verification position, take a picture with the camera, and perform picture analysis; S303: after completing the picture acquisition, the cylinder controls the verification block to return to its original position; S304: camera accuracy judgment:
  • Step S501 when the visual inspection device detects that there is no material on the verification position, it notifies the visual inspection device to move the verification piece to the verification position, and the verification position is within the detection range of the visual inspection device, so that the light source in the visual inspection device illuminates the verification piece.
  • the driving device may be a cylinder or other devices that can realize the driving function. This embodiment does not limit this. Taking the cylinder as an example, the visual inspection device confirms that there is no product at the check position through the perception of the sensor, controls the cylinder to extend, and moves the check piece to the waiting position.
  • This embodiment moves the verification piece to the verification position through a driving device without manual operation of the verification piece, thereby achieving fully automatic verification and solving the problem of long verification time and large production capacity loss due to the influence of operator proficiency.
  • Step S502 when the visual inspection device detects that there is material on the check position, it continues to inspect the current material on the check position until the target material leaves the check position, and then notifies the driving device in the visual inspection device to move the check piece to the check position so that the light source in the visual inspection device illuminates the check piece.
  • the target material is the last material in the current transportation process. Since it is detected that there is still material on the check position during the automatic check mode, the verification starts when the last product is detected.
  • the visual inspection device uses a sensor to determine whether there is material at the verification position. If there is material, the last product is inspected. If there is no material, the verification starts.
  • the visual inspection device of this embodiment uses a sensor to determine whether there is material at the check position. If there is material, the last product inspection is performed, thereby realizing fully automatic inspection and improving the efficiency of inspection.
  • the visual detection method further includes:
  • Step S601 When the visual inspection device detects the first image and/or the second image, the visual inspection device notifies the driving device in the visual verification device to move the verification piece back to its original position.
  • control cylinder is triggered to retract to the original position, and the verification piece is moved to the original position.
  • this embodiment automatically moves the verification piece back to its original position through a driving device without manual operation of the verification piece, thereby achieving fully automatic verification and solving the problem of long verification time and large production capacity loss that is easily affected by the proficiency of the operator.
  • the visual detection method further includes:
  • Step S701 when the system check result is normal, the host computer notifies the station controller to start conveying materials;
  • Step S702 When the system check result is abnormal, the host computer notifies each detection device to perform shutdown detection and issues an alarm.
  • the host computer controls the production line according to the systematic verification result.
  • the workstation controller is notified to start conveying materials, thereby improving the processing efficiency of the production line.
  • each detection equipment is notified to perform shutdown detection and an alarm is issued, thereby improving the effective monitoring of the production line.
  • the visual detection method further includes:
  • Step S801 the host computer performs visual accuracy verification according to the first image to obtain a visual accuracy verification result
  • Step S802 the host computer performs imaging effect verification according to the second image to obtain an imaging effect verification result
  • Step S803 When the visual accuracy verification result and the imaging effect verification result are both normal verification results, the host computer performs visual algorithm verification according to the target image to obtain a visual algorithm verification result;
  • Step S804 the host computer determines the systematic verification result of the visual inspection device according to the visual accuracy verification result, the imaging effect verification result and the visual algorithm verification result.
  • the visual accuracy verification can be used to verify the shooting accuracy of the visual detection device.
  • the size of the verification piece collected by the visual detection device can be compared with the size of the actual verification piece to obtain the visual accuracy verification result. For example, after analyzing the first image, the size of the size verification part on the verification piece is 10mm, but the size of the actual size verification part is 9mm. Therefore, the visual accuracy verification is achieved through the size verification part in the first image, and the accuracy verification within the measuring range of 2D cameras and 3D cameras is effectively achieved. Ensure that the linear offset of the measuring tool is verified, and at the same time, the accuracy error caused by the distortion of the 2D camera lens can be verified to achieve accuracy verification.
  • the color card verification part can be a colorimetric card
  • the colorimetric card can be a light gray, gray, and dark gray three-gradient standard color card, and can also be an RGB three-primary color card. It is required that the black and white camera is equipped with light gray, gray, and dark gray three-gradient standard color cards, and the color camera is equipped with an RGB three-primary color card for the verification of the imaging effect. For example, after analyzing the colorimetric card of the first image, the grayscale value of the colorimetric card on the verification piece is 50, but the grayscale value of the actual colorimetric card is 60, so that the imaging effect verification is achieved through the colorimetric card in the first image.
  • the visual algorithm verification is performed to achieve a systematic verification result of the visual inspection device.
  • This embodiment obtains the systematic verification result of the visual inspection device by comparing the detection value with the standard value, thereby realizing the systematic verification result of the visual inspection device through quantified data and improving the accuracy of the systematic verification of the visual inspection device.
  • the systematic verification result of the visual inspection device can also be determined based on the second image.
  • a colorimetric card is also provided on the verification piece. Since the size verification part can verify the visual accuracy and the colorimetric card can verify the imaging effect, the visual accuracy, imaging effect and visual algorithm can be verified at the same time, thereby realizing a systematic verification of the visual inspection device.
  • This embodiment acquires images through the size verification part on the verification piece to obtain visual accuracy verification results, detects the imaging effect through the colorimetric card on the verification piece, and simultaneously detects the visual algorithm, thereby achieving systematic verification of the visual inspection device.
  • the detected value when performing visual accuracy inspection, can be the measured value of the structural parameter, and the standard value can be the parameter value of the actual inspection object, so as to make a comparison and verify the visual accuracy.
  • the detected value when performing imaging effect inspection, can be the grayscale value of the colorimetric card, and the standard value can be the grayscale value of the actual inspection object, so as to make a comparison and verify the imaging effect.
  • the detected value when performing a visual algorithm, the detected value can be the measured value obtained by analyzing the structural parameters through the current visual algorithm, and the standard value can be the parameter value obtained by analyzing a good visual algorithm, so as to make a comparison and verify the visual algorithm.
  • This embodiment obtains the visual accuracy verification result by comparing the measured value corresponding to the structural parameter with the standard value, and obtains the imaging effect verification result by comparing the gray value of the colorimetric card with the standard value, thereby realizing the systematic verification of the visual inspection device through quantified data and improving the accuracy of the systematic verification.
  • the systemicity of the visual inspection device is determined based on the detection value and the standard value corresponding to the first image and the detection value and the standard value corresponding to the second image. Verify the results.
  • This embodiment compares the structural parameter detection values of the size verification part image with multiple sizes showing gradient changes in the first image with standard values to realize visual accuracy verification and visual algorithm verification at the same time, and compares the detection values of the color card verification part with grayscale values showing gradient changes in the second image with standard values to realize effectiveness verification and visual algorithm verification at the same time, thereby achieving a systematic verification result of the visual inspection device.
  • the visual accuracy verification result of the visual inspection device can be determined according to the measurement values corresponding to the structural parameters.
  • the structural parameters may be the size, depth, and thickness of the size verification part, and may also include other parameters, which are not limited in this embodiment.
  • the comparison is performed based on the structural parameters of the verification piece. Since the structural parameter value may be a specific numerical value, the difference between the measured value and the actual value can be obtained more accurately.
  • the size of the size verification part is taken as an example. In order to achieve visual accuracy detection, the image of the two-dimensional size verification part on the verification piece is analyzed to obtain the size of the size verification part with a length of 2 mm and a width of 1 mm, so that the visual accuracy is directly verified based on the measurement value analyzed in the image.
  • This embodiment obtains the visual accuracy verification result by comparing the measurement values corresponding to the structural parameters, thereby realizing the visual accuracy verification through quantified data and improving the accuracy of visual detection.
  • the first difference between the measured value corresponding to the structural parameter and the preset standard value can also be determined; based on the first difference, the visual accuracy verification result of the visual inspection device is determined.
  • the measured value of the structural parameter obtained by image analysis is consistent with the parameter value of the actual inspection object. It can be seen that the image collected by the current visual inspection device is the same as the parameter value of the actual inspection object. Therefore, the visual accuracy of the visual inspection device is normal.
  • This embodiment obtains the visual accuracy verification result by the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object, thereby effectively obtaining the error between the result of image analysis and the actual result, and more accurately obtaining the accuracy of visual detection.
  • the visual accuracy verification result of the visual inspection device is determined according to the first difference and the first parameter threshold range.
  • the first parameter threshold range is defined to determine whether the difference is within the allowable range. If the difference is within the first parameter threshold range, it is determined to be within the allowable range. If the difference is outside the first parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of allowable error to avoid misjudgment. For example, taking the parameter threshold range of less than 0.1mm as an example, through analysis of the image of the two-dimensional size verification part on the verification piece, it is obtained that the length of the size verification part is 2mm, and the length of the actual detection object is 2.5mm. The measured value of the structural parameter obtained by the image analysis differs from the parameter value of the actual detection object by 0.5mm, which exceeds the parameter threshold range. It can be seen that the visual accuracy of the visual inspection device is abnormal.
  • the parameter threshold range of less than 0.1mm is 2mm, and the length of the actual detection object is 2.03mm.
  • the measured value of the structural parameter obtained by the image analysis differs from the parameter value of the actual detection object by 0.03mm, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the visual accuracy of the visual inspection device.
  • step S801 includes:
  • Step S805 the host computer determines a first difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a preset standard value.
  • Step S806 When the first difference is greater than or equal to the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is abnormal.
  • Step S807 When the first difference is less than the first parameter threshold range, the host computer obtains a verification result that the visual accuracy of the visual inspection device is normal.
  • the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
  • This embodiment obtains the visual accuracy verification result by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with the comparison only by the difference, a certain threshold range is given, and the detection result is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual accuracy detection.
  • the method further includes:
  • Step S808 The host computer determines a first parameter threshold range according to a tolerance corresponding to the structural parameter.
  • the tolerance is the variation corresponding to each structural parameter, which is equal to the absolute value of the algebraic difference between the maximum limit and the minimum limit.
  • 1mm is the tolerance corresponding to the size parameter
  • 1mm2 is the tolerance corresponding to the size parameter.
  • T represents the tolerance corresponding to the structural parameter, i.e., camera accuracy verification:
  • the parameter threshold range corresponding to the size parameter is less than 0.1mm for comparison, so as to avoid the parameter threshold range corresponding to the area parameter being less than 1mm2 for comparison, thereby causing misjudgment.
  • this embodiment determines the parameter threshold range by corresponding structural parameters. Since different structural parameters correspond to different standards, the parameter threshold range is determined by the tolerance corresponding to the parameters, so that the parameter threshold range is compatible with the structural parameters, thereby improving the rationality of visual accuracy detection.
  • the visual detection method further includes:
  • Step S809 the host computer detects the first image through a target vision algorithm to obtain target standard values corresponding to the structural parameters.
  • Step S810 The host computer determines a second difference between a measurement value corresponding to a structural parameter of the size verification part in the first image and a target standard value.
  • Step S811 When the second difference is greater than or equal to the second parameter threshold range, the host computer obtains a verification result of an abnormality in the visual algorithm of the visual detection device.
  • Step S812 When the second difference is less than the second parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual inspection device is normal.
  • the host computer can determine the first visual algorithm verification result of the visual inspection device according to the measurement value corresponding to the structural parameter.
  • the measured value corresponding to the structural parameter is compared with the measured value obtained by the good visual analysis algorithm, so as to realize the verification of the visual algorithm.
  • the good visual analysis algorithm is used to calibrate the size verification part on the verification piece.
  • the measurement value obtained by analyzing the image of the two-dimensional size verification part is 1.8mm, thereby realizing the verification of the visual algorithm.
  • the measurement value of the size verification part obtained by analyzing the image of the two-dimensional size verification part on the verification piece is consistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece through a good visual analysis algorithm, it is determined that the current visual algorithm is normal; when the measurement value of the size verification part is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece through a good visual analysis algorithm, it is determined that the current visual algorithm is abnormal, thereby realizing the detection of the visual algorithm.
  • this embodiment can also verify the visual algorithm through the measurement values corresponding to the structural parameters, thereby achieving systematic visual verification and improving the comprehensiveness and effectiveness of production line monitoring.
  • the host computer can also determine a second difference between the measured value corresponding to the structural parameter and the target standard value; and determine the first visual algorithm verification result of the visual detection device based on the second difference.
  • the target standard value may be a measurement value obtained by detecting a good visual algorithm.
  • the difference between the measurement value corresponding to the structural parameter and the target standard value the difference between the measurement value of the structural parameter obtained by image analysis and the measurement value obtained by detecting the good visual algorithm is obtained.
  • the length of the dimension verification part is 2 mm.
  • the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm is 2.5 mm.
  • the measurement value of the structural parameter obtained by the image analysis differs from the parameter value of the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm by 0.5 mm.
  • the measurement value of the structural parameter obtained by the image analysis is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm. It can be seen that there is a difference in the detection results between the current visual algorithm and the good visual algorithm. Therefore, the current visual algorithm is abnormal.
  • the measurement value of the structural parameter obtained by image analysis is consistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece through a good visual analysis algorithm. It can be seen that the detection results of the current visual algorithm are the same as those of the good visual algorithm. Therefore, the current visual algorithm is normal.
  • This embodiment compares the measured values corresponding to the structural parameters with the measured values of the structural parameters analyzed by the normal visual detection algorithm, thereby obtaining the difference between the analysis results of the current visual algorithm and the analysis results detected by the normal visual detection algorithm, and thus obtaining the difference between the current visual algorithm and the normal visual detection algorithm, thereby realizing the verification of the visual algorithm.
  • the target visual algorithm is a good visual algorithm that has been verified.
  • the target visual algorithm is used to analyze the dimension verification part at the same time to obtain the target standard value corresponding to the structural parameter, so as to achieve comparison with the current measurement value.
  • the measurement value obtained by analyzing the image of the two-dimensional dimension verification part on the verification piece by the good visual analysis algorithm is 2mm.
  • the measurement value of 2mm is used as the target standard value, so that different visual algorithms are used for analysis based on the same analysis object, avoiding the use of different analysis objects for comparison, which affects the accuracy of the comparison result.
  • this embodiment analyzes the dimension verification part through the target visual algorithm to obtain the target standard value corresponding to the structural parameter, so that it can be compared with the measurement value corresponding to the structural parameter, so as to achieve the standard unification of the comparison between the current visual algorithm and the normal visual detection algorithm, and improve the accuracy of the visual algorithm verification.
  • the second parameter threshold range is defined to determine whether the difference is within the allowable range. If the difference is within the second parameter threshold range, it is determined to be within the allowable range. If the difference is outside the second parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of a certain allowable error to avoid misjudgment.
  • the second parameter threshold range can be T/10, where T represents the tolerance corresponding to the detection object, that is, the visual algorithm verification:
  • the image of the two-dimensional size verification part on the verification piece is analyzed to obtain a length of 2mm for the size verification part, and a length of 2.5mm is obtained through good visual algorithm detection.
  • the measured value of the structural parameter obtained by image analysis differs from the parameter value obtained by good visual algorithm detection by 0.5mm, which exceeds the parameter threshold range. It can be seen that the visual algorithm of the visual detection device is abnormal.
  • the length of the size verification part is 2mm, and the length obtained by detecting with a good visual algorithm is 2.03mm.
  • the measured value of the structural parameter obtained by image analysis differs from the parameter value obtained by detecting with a good visual algorithm by 0.03mm, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the visual algorithm of the visual inspection device.
  • the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
  • S801' move the product to the verification position and trigger the camera to collect product pictures
  • S802' pass the collected pictures to the image processing and analysis module, i.e., the visual inspection algorithm
  • S803' according to the output of the visual inspection algorithm results, the equipment compares with the set rules to determine whether the product is defective
  • S804' the results are uploaded to the Manufacturing Execution System (MES), and the Manufacturing Execution System automatically records the product status information based on the results, and the equipment performs preset actions based on the results.
  • MES Manufacturing Execution System
  • Manufacturing Execution System is an industrial production management system used to optimize and monitor the entire manufacturing process from raw materials to final products.
  • Manufacturing Execution System coordinates planning, execution, control and monitoring of various aspects of production activities by interacting with various equipment, systems and personnel. It is usually integrated with other information systems of the enterprise, such as Enterprise Resource Planning (ERP), Product Lifecycle Management (PLM), Supply Chain Management (SCM), etc., to achieve more efficient, flexible and visual production management.
  • ERP Enterprise Resource Planning
  • PLM Product Lifecycle Management
  • SCM Supply Chain Management
  • the first step of collecting pictures is normal, that is, the hardware such as the camera and light source work normally, the pictures obtained are stable. This part is designed with camera accuracy verification and imaging verification.
  • the normality of the visual algorithm affects the judgment of whether the product is defective.
  • the algorithm can be designed to determine whether the specifications need to be verified if they have changed.
  • the flow chart of visual algorithm verification is as follows: algorithm verification: S801": the picture in the algorithm verification library replaces the product picture currently captured by the camera; S802": the captured picture is passed into the image processing and analysis module, i.e., the visual inspection algorithm; S803": based on the output of the visual inspection algorithm result, the equipment is compared with the set specifications to determine whether the product is defective; S804": the inspection result is compared with the standard result to verify whether the algorithm and specification are normal based on whether they are within the standard range; S805": the verification result is uploaded to the manufacturing execution system, and the equipment executes the preset action based on the verification result; S806”: based on the number of pictures in the gallery N, the loop is traversed and executed N times.
  • the verification process is: according to the test results,
  • the original specifications were 10-11, and the current specifications are 10.5-11.
  • the original rules were determined when the standards were established, and the current rules are rules for reading the current device settings. The two are inconsistent, indicating that the device specifications have been maliciously modified and there are problems with the measurement system, thereby achieving verification of the visual algorithm.
  • This embodiment obtains the visual algorithm verification result by comparing the difference between the measured value corresponding to the structural parameter and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range, and further realizes the systematic verification of the visual detection device by comparison through specifications. Compared with comparison only through difference, by giving a certain threshold range, the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
  • step S802 includes:
  • Step S813 the host computer determines a third difference between the grayscale value of the color card verification part in the second image and the preset grayscale value.
  • Step S814 When the third difference is greater than or equal to the third parameter threshold range, the host computer determines a detection result that the imaging effect of the visual detection device is abnormal.
  • Step S815 When the third difference is less than the third parameter threshold range, the host computer determines a detection result that the imaging effect of the visual detection device is normal.
  • the gray value is an image representation concept of digital image processing technology.
  • the gray value refers to the brightness value of the pixel of the grayscale digital image, indicating the depth level of the color of the digital image.
  • the grayscale level is divided into 0 to 255, where white is 255 and black is 0.
  • the grayscale image can show different shades of any color, and even different colors at different brightness.
  • the comparison is based on the grayscale value of the colorimetric card. Since the grayscale value of the colorimetric card can be a specific value, the difference between the measured value and the actual value can be obtained more accurately.
  • the grayscale value of the colorimetric card on the verification piece is obtained to be 50, so that the imaging effect verification is directly performed according to the grayscale value analyzed in the image.
  • the imaging effect verification result is obtained by comparing the gray value of the color card, so that the imaging effect verification is realized through quantitative data, thereby improving the accuracy of imaging effect detection.
  • the preset grayscale value may be the grayscale value of the actual detection object, and image analysis is performed on the colorimetric card to obtain the difference between the corresponding measurement value and the preset standard value, thereby obtaining the measurement value of the colorimetric card obtained by image analysis and the grayscale value of the actual detection object.
  • the grayscale value of the colorimetric card on the calibration piece is 50
  • the grayscale value of the same position of the actual colorimetric card is 60.
  • the measurement value obtained by the image analysis differs from the parameter value of the actual detection object by 10, thereby obtaining that the current measurement value obtained by the image analysis is inconsistent with the parameter value of the actual detection object. It can be seen that the image captured by the current visual detection device is different from the actual detection object. Therefore, the imaging effect of the visual detection device is abnormal.
  • the grayscale value of the colorimetric card on the calibration piece is 50
  • the grayscale value of the same position on the actual colorimetric card is 50.
  • the measurement value obtained by image analysis is consistent with the parameter value of the actual detection object. It can be seen that the image captured by the current visual detection device is the same as the parameter value of the actual detection object. Therefore, the imaging effect of the visual detection device is normal.
  • This embodiment obtains the imaging effect verification result by the difference between the grayscale value and the grayscale value corresponding to the actual detection object, thereby effectively obtaining the error between the image analysis result and the actual result, and more accurately realizing the detection of the imaging effect.
  • the third parameter threshold range is defined to determine whether the grayscale value difference is within the allowable range. If the difference is within the third parameter threshold range, it is determined to be within the allowable range. If the difference is outside the third parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of a certain allowable error to avoid misjudgment.
  • the third parameter threshold range can be 10, that is, imaging effect verification:
  • the grayscale value of the colorimetric card on the calibration piece is 50, and the grayscale value of the same position on the actual colorimetric card is 55.
  • the measurement value obtained by the image analysis differs from the parameter value of the actual detection object by 5, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the imaging effect of the visual detection device.
  • the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
  • This embodiment obtains the imaging effect verification result by comparing the difference between the current grayscale value and the standard value corresponding to the actual detection object with the parameter threshold range. Compared with comparison only by difference, a certain threshold range is given and the detection result is considered abnormal only when it exceeds the range, thereby improving the accuracy of imaging effect detection.
  • the visual detection method further includes:
  • Step S816 The host computer detects the second image through a target vision algorithm to obtain a target grayscale value.
  • Step S817 the host computer determines a fourth difference between the grayscale value of the color card verification part in the second image and the target grayscale value.
  • Step S818 When the fourth difference is greater than or equal to the fourth parameter threshold range, the host computer obtains a verification result of an abnormality in the visual algorithm of the visual detection device.
  • Step S819 When the fourth difference is less than the fourth parameter threshold range, the host computer obtains a verification result that the visual algorithm of the visual inspection device is normal.
  • the grayscale value obtained by the current visual algorithm analysis is compared with the grayscale value obtained by the good visual analysis algorithm, so as to realize the verification of the visual algorithm.
  • the grayscale value of the colorimetric card on the verification piece is 50, and the grayscale value of the same position of the colorimetric card on the verification piece is calibrated as 60 by the good visual analysis algorithm, so as to realize the verification of the visual algorithm.
  • the measurement value of the size verification part obtained by analyzing the image of the two-dimensional size verification part on the verification part is consistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification part through a good visual analysis algorithm, it is determined that the current visual algorithm is normal; when the measurement value of the size verification part is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification part through a good visual analysis algorithm, it is determined that the current visual algorithm is abnormal, thereby realizing the detection of the visual algorithm.
  • this embodiment can also verify the visual algorithm, thereby achieving systematic visual verification and improving the comprehensiveness and effectiveness of production line monitoring.
  • the target grayscale value may be a measurement value obtained by detecting a good vision algorithm.
  • the difference between the grayscale value of the colorimetric card and the target standard value the difference between the measurement value obtained by image analysis and the measurement value obtained by detecting the good vision algorithm is obtained.
  • the grayscale value of the colorimetric card on the verification piece is 50
  • the grayscale value of the same position of the colorimetric card on the verification piece is 60 after calibration by the good vision analysis algorithm.
  • the measurement value obtained by image analysis and the measurement value obtained by analyzing the image of the colorimetric card on the verification piece by the good vision analysis algorithm differ by 10 in parameter value.
  • the measurement value obtained by image analysis is inconsistent with the measurement value obtained by analyzing the image of the two-dimensional size verification part on the verification piece by the good vision analysis algorithm. It can be seen that there is a difference in the detection results between the current vision algorithm and the good vision algorithm. Therefore, the current vision algorithm is abnormal.
  • the grayscale value of the colorimetric card on the calibration piece is 50.
  • the grayscale value of the same position of the colorimetric card on the calibration piece is calibrated to 50 by a good visual analysis algorithm.
  • the measurement value obtained by image analysis is consistent with the measurement value obtained by analyzing the colorimetric card on the calibration piece by a good visual analysis algorithm. It can be seen that the current visual algorithm has the same detection results as the good visual algorithm. Therefore, the current visual algorithm is normal.
  • This embodiment compares the grayscale value with the grayscale value analyzed by the normal visual detection algorithm to obtain the difference between the analysis result of the current visual algorithm and the analysis result detected by the normal visual detection algorithm, thereby obtaining the difference between the current visual algorithm and the normal visual detection algorithm, thereby realizing the verification of the visual algorithm.
  • the target vision algorithm is a good vision algorithm that has been calibrated.
  • the colorimetric card is analyzed by the target vision algorithm to obtain the target standard value corresponding to the colorimetric card, thereby realizing comparison with the current measurement value.
  • the grayscale value of the same position of the colorimetric card on the calibration piece is calibrated to 50 by a good vision analysis algorithm, and the grayscale value of 50 is used as the target standard value, so that different vision algorithms are used for analysis based on the same analysis object, avoiding the use of different analysis objects for comparison, which affects the accuracy of the comparison results.
  • this embodiment uses the target visual algorithm to analyze the color comparison card to obtain the target standard value corresponding to the color comparison card, which can be compared with the grayscale value obtained by the current visual algorithm analysis, thereby achieving the standard unification of the comparison between the current visual algorithm and the normal visual detection algorithm, and improving the accuracy of the visual algorithm verification.
  • the fourth parameter threshold range is defined to determine whether the grayscale value difference is within the allowable range. If the difference is within the fourth parameter threshold range, it is determined to be within the allowable range. If the difference is outside the fourth parameter threshold range, it is determined to be within the unallowable range, thereby providing a reasonable interval of a certain allowable error to avoid misjudgment.
  • the fourth parameter threshold range can be 10, that is, the visual algorithm verification:
  • the grayscale value of the colorimetric card on the calibration piece is 50
  • the grayscale value of the same position of the colorimetric card on the calibration piece calibrated by a good visual analysis algorithm is 55.
  • the measurement value obtained by image analysis differs from the parameter value obtained by detection through a good visual algorithm by 5, which does not exceed the parameter threshold range. It can be seen that there is no abnormality in the visual algorithm of the visual inspection device.
  • the parameter threshold range can be flexibly adjusted according to actual needs to improve the flexibility of precision detection.
  • This embodiment obtains the visual algorithm verification result by comparing the difference between the grayscale value corresponding to the current visual algorithm and the standard value corresponding to the normal visual detection algorithm with the parameter threshold range. Compared with comparison only by difference, a certain threshold range is given, and the visual algorithm is considered abnormal only when it exceeds this range, thereby improving the accuracy of visual algorithm verification.
  • the method further includes:
  • Step S820 the host computer obtains the first picture, the second picture, the third picture and the fourth picture with calibrated parameter values, wherein the parameter value of the first picture is in the first range, the parameter value of the second picture is in the second range, the parameter value of the third picture is in the third range, the parameter value of the third picture is in the fourth range, the first range is different from the second range, and the third range is different from the fourth range; an image verification library is established according to the first picture, the second picture, the third picture and the fourth picture.
  • the first picture can be a normal picture
  • the second picture can be a normal limit picture
  • the third picture can be an abnormal picture
  • the fourth picture can be an abnormal limit picture.
  • the product picture verification library needs to have NG products, NG limit samples, OK products, and OK limit samples.
  • Each defect of NG products and NG limit samples is not less than 3EA, and OK products and OK limit samples are not less than 3EA.
  • the pictures of typical defective products produced by production are collected, or typical defects are artificially created, and then the pictures are taken and stored by a camera, so as to realize the establishment of the verification library.
  • This embodiment uses a pre-established image verification library to detect the visual algorithm, which has a higher verification efficiency than directly comparing the verification results.
  • the host computer numbers the first picture, the second picture, the third picture, and the fourth picture; and establishes a picture verification library according to the numbered first picture, the second picture, the third picture, and the fourth picture.
  • the pictures are numbered and analyzed using a complete algorithm to obtain results that are set as standard values.
  • the numbering method can be through coding identification or other methods. This embodiment does not impose any restrictions on this.
  • the numbering method can be used to locate and track pictures, which facilitates gallery management.
  • the picture samples are managed by numbering, thereby achieving effective management of the picture verification library, but it is not convenient for subsequent adjustment and update of the picture verification library.
  • the method further includes:
  • Step S821 The host computer uses a target visual detection algorithm to evaluate the sample image to obtain a first image, a second image, a third image, and a fourth image with calibrated parameter values.
  • a perfect algorithm is used to analyze the images in the verification library to obtain the results, which are set as standard values.
  • the length of the structural parameters of image A obtained through a good visual algorithm analysis is 5 mm, which facilitates the verification of the visual algorithm.
  • This embodiment pre-evaluates the sampled images through a perfect visual detection algorithm, and uses the evaluated parameter values as standard values for subsequent comparisons to achieve verification of the visual algorithm.
  • step S803 includes:
  • Step S818' selecting a target image from the image verification library.
  • Step S819' perform image recognition on the target image through a visual detection device to obtain parameter values of the target image.
  • Step S820' comparing the parameter value with the calibration parameter value corresponding to the target image.
  • Step S821' when the difference between the parameter value and the calibration parameter value corresponding to the target image exceeds the fifth parameter threshold range, it is determined that the visual algorithm is abnormal.
  • the visual system performs algorithm verification.
  • the visual algorithm traverses the algorithm verification library and performs algorithm analysis. Then obtain the result parameters of the verification image. If the obtained result parameters are the same as the predetermined standard parameters or are within the reasonable error range of the predetermined standard parameters, it means that the algorithm has good accuracy.
  • Algorithm verification
  • Step S900 the manufacturing execution system creates a verification task, or the equipment sets an automatic verification time, triggering the visual inspection device to enter an automatic verification mode.
  • Step S901 the visual inspection device interacts with the upstream workstation to inform the upstream workstation to stop unloading and enter the verification mode.
  • Step S902 the visual inspection device determines whether there is material at the check position through a sensor
  • Step S903 If there is material, the last product test is performed. If there is no material, the verification is started.
  • Step S904 The visual inspection device confirms through the perception of the sensor that there is no product at the verification position, controls the cylinder to extend, and moves the verification piece to the waiting position.
  • Step S905 the camera performs imaging analysis on the size verification part on the verification piece to obtain the parameters of the size verification part, the camera performs precision verification to obtain the size parameters of the groove or protrusion, and the imaging effect verification obtains the grayscale value of the color card.
  • Step S906 after completing the acquisition of the verification piece image, trigger the control cylinder to retract to the original position and move the verification piece to the original position.
  • Step S907 compare the obtained structural parameters with the predetermined structural parameters. If the obtained structural parameters are the same as the predetermined structural parameters or are within the reasonable error range of the predetermined structural parameters, it means that the obtained groove or protrusion structural parameters are not distorted, the lens is not loose or out of focus, the structural parameters of the color card are not varied, the light source brightness, camera aperture, camera exposure, gain, etc.
  • the visual inspection device After the visual inspection device completes the accuracy and imaging verification results, the visual inspection device performs algorithm verification.
  • Step S908 the visual algorithm traverses the algorithm verification library, and obtains the result parameters of the verification image after algorithm analysis. If the obtained result parameters are the same as the predetermined standard parameters or are within the reasonable error range of the predetermined standard parameters, it means that the algorithm accuracy is good, and the algorithm verification is:
  • Step S909 upload the obtained parameters and comparison results to the manufacturing execution system, and the manufacturing execution system will compare the structural parameters again. If any result is NG, the manufacturing execution system will lock the machine and prevent the detection system from producing. At the same time, the equipment will alarm.
  • step S910 the staff needs to conduct system inspection and adjustment based on the NG items to correct the visual inspection errors in time, so as to ensure that the visual inspection system still has good accuracy after a long time or adjustment.
  • step S911 the visual inspection device interacts with the upstream workstation to inform the upstream workstation to start unloading and enter the production mode.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Pathology (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Mathematical Physics (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

一种视觉检测系统及方法,所述视觉检测系统包括视觉校验装置(100)、视觉检测装置(200)和上位机(300),其中,所述视觉校验装置(100)包括校验件(10)以及校验件移动装置(20),所述校验件移动装置(20)包括活动安装的安装板(50),在所述安装板(50)的活动行程上,所述安装板(50)能够处在校验位,所述校验位在视觉检测装置(200)的检测范围内,所述校验件(10)设于所述安装板(50);所述视觉检测装置(200),用于获得所述校验件(10)的图像,并将所述校验件(10)的图像发送至上位机(300);所述上位机(300),用于根据所述校验件(10)的图像确定所述视觉检测装置(200)的系统性校验结果。

Description

视觉检测系统及方法 技术领域
本申请涉及视觉检测技术领域。
背景技术
一般情况下,传统测量工具校验都由人工来操作的,除了操作麻烦和需要熟练的工人来操作,同时操作和分析都耗时较长,对拉线造成较大产能损失。
技术问题
解决现有的产线点检的方式校验时间过长。
技术解决方案
第一方面,本申请提供一种视觉检测系统,其中,所述视觉检测系统包括:
视觉校验装置,包括校验件以及校验件移动装置,所述校验件移动装置包括活动安装的安装板,在所述安装板的活动行程上,所述安装板能够处在校验位,所述校验位在视觉检测装置的检测范围内,所述校验件设于所述安装板;
视觉检测装置,用于获得所述校验件的图像,并将所述校验件的图像发送至上位机;
上位机,用于根据所述校验件的图像确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,在进行系统校验时,将校验件集中在安装板上,通过驱动安装板实现校验件的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
在一些实施例中,所述校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部;
所述视觉检测装置,还用于获得所述尺寸校验部的第一图像以及所述色卡校验部的第二图像,并将所述第一图像以及所述第二图像发送至上位机;
所述上位机,还用于根据所述第一图像和/或所述第二图像确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度,是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,并在实现精度校验的基础上,进一步进行算法校验,从而实现视觉检测装置的系统性校验。
在一些实施例中,所述校验件可拆卸安装于所述安装板。
本申请实施例的技术方案中,通过校验件安装板上可拆卸件实现校验件的快拆锁附方式,方便用于二次元或者更高精度测量系统的真值测量。
在一些实施例中,所述视觉校验装置还包括:
支撑底座;以及,
驱动装置,包括相对直线活动的固定部和活动部,所述固定部设于所述支撑底座,所述活动部与所述安装板连接。
本申请实施例的技术方案中,通过驱动的方式实现校验件的移动,从而实现视觉检测装置的全自动校验。
在一些实施例中,所述视觉校验装置还包括滑动导向结构,所述滑动导向结构包括相互滑动配合的滑轨和滑块,所述滑动导向结构包括相互滑动配合的滑轨和滑块,所述滑轨和所述滑块设于所述支撑底座与所述安装板之间。
本申请实施例的技术方案中,通过驱动装置驱动校验件安装板的情况下,通过滑动装置确定校验件安装板的移动轨迹,提高了校验件移动的精确性。
在一些实施例中,所述视觉校验装置还包括转接座,所述滑块设置两个,对应所述滑块设置两个;
其中相互配合的一组所述滑轨和滑块分设于所述支撑底座和所述转接座之间,另一组所述滑轨和滑块分设于所述安装板和所述转接座之间。
本申请实施例的技术方案中,通过多组滑动装置实现安装板的移动,实现安装板移动的精准控制。
在一些实施例中,所述校验件包括:
板主体,具有校验面;
多个尺寸校验部,沿直线方向间隔设于所述校验面上,多个所述尺寸校验部具有处在第一方向上的长度尺寸和处在第二方向上的宽度尺寸,多个所述尺寸校验部的长度尺寸呈梯度变化,和/或,多个所述尺寸校验部的宽度尺寸呈梯度变化,其中,所述第一方向与所述第二方向为水平面内相互垂直的方向。
本申请实施例的技术方案中,在校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度,是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,提高视觉检测的精度。
在一些实施例中,所述尺寸校验部包括形成在所述板本体上的凸起或者凹槽。
本申请实施例的技术方案中,获取校验件上的凹槽、凸起等尺寸信息与预定的尺寸信息是否在合理误差范围,达到相机精度校验。
在一些实施例中,多个所述尺寸校验部沿第三方向上的尺寸呈梯度变化。
本申请实施例的技术方案中,在校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验。
在一些实施例中,还包括设于所述板主体的校验面上的灰度值呈梯度变化的色卡校验部。
本申请实施例的技术方案中,通过校验件上设有比色卡,实现成像效果的校验,校验件的色卡要求黑白相机配备浅灰、灰色、深灰三个梯度标准色卡,从而实现黑白相机的成像效果的校验。
在一些实施例中,所述色卡校验部包括三原色色卡。
本申请实施例的技术方案中,彩色相机配备RGB三原色色卡,从而实现彩色相机成像效果的校验。
在一些实施例中,所述板主体的材质包括铝合金;和/或,
所述板主体的校验面的粗糙度小于预设粗糙度阈值。
本申请实施例的技术方案中,对板主体的材质板包括铝合金,以及板主体的校验面的粗糙度进行调整,从而提高多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部的成像效果。
第二方面,本申请还提供一种视觉检测方法,其中,视觉检测系统包括视觉检测装置、视觉校验装置以及上位机,所述视觉校验装置,包括校验件以及校验件移动装置,所述校验件移动装置包括活动安装的安装板,在所述安装板的活动行程上,所述安装板能够处在校验位,所述校验位在视觉检测装置的检测范围内,所述校验件设于所述安装板;
所述视觉检测方法包括:
所述视觉检测装置获得所述校验件的图像,并将所述校验件的图像发送至所述上位机;
所述上位机根据所述校验件的图像确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,在进行系统校验时,将校验件集中在安装板上,通过驱动安装板实现校验件的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
在一些实施例中,所述校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部,所述视觉检测方法还包括:
所述视觉检测装置获得所述尺寸校验部的第一图像以及所述色卡校验部的第二图像,并将所述第一图像以及所述第二图像发送至上位机;
所述上位机根据所述第一图像和/或所述第二图像确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度,是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,并在实现精度校验的基础上,进一步进行算法校验,从而实现视觉检测装置的系统性校验。
在一些实施例中,所述系统性校验结果包括视觉精度校验结果、成像效果的检测结果以及视觉算法校验结果,所述视觉检测方法还包括:
在所述视觉精度校验结果、成像效果的检测结果以及视觉算法校验结果中的任意一项出现异常结果的情况下,通知待检测设备停止工作。
本申请实施例的技术方案中,为了保证产线生产的安全性以及防止次品出厂,在检测到产线上的视觉精度、视觉成像以及视觉算法出现问题时,及时进行停产检测,实现产线监测的有效管控。
在一些实施例中,所述视觉检测方法还包括:
在所述系统性校验结果为正常结果的情况下,确定校验模式结束,并通知相关生产设备进入生产模式。
本申请实施例的技术方案中,由于在进行生产校验的过程中,避免出现校验中其他物料以及生产过程中的其他影响因素,需要对产线暂停输送物料,并进入校验模式,但是在校验结束需要尽快恢复生产,自动恢复到生产模式,从而提高产线的自动化管理。
在一些实施例中,所述视觉检测方法还包括:
所述上位机在接收到校验指令的情况下,发送校验指令至所述视觉检测装置;
所述视觉检测装置在接收到校验指令的情况下,通知工位控制器停止输送物料所述视觉检测装置。
本申请实施例的技术方案中,由于在进行生产校验的过程中,避免出现校验中其他物料以及生产过程中的其他影响因素,因此对产线暂停输送物料,从而提高校验的准确性。
在一些实施例中,所述视觉检测方法还包括:
所述视觉检测装置在检测到所述视觉检测装置检测的校验位上未存有物料的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移动至所述校验位,所述校验位在所述视觉检测装置的检测范围内;
本申请实施例的技术方案中,通过驱动装置将校验件移动至待测位,而无须人工进行校验件的操作,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
在一些实施例中,所述视觉检测方法还包括:
所述视觉检测装置在检测到所述视觉检测装置检测的校验位上存有物料的情况下,通知所述视觉检测装置继续对所述校验位上的当前物料进行检测,直至目标物料离开所述校验位的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移动至所述校验位,以使所述视觉检测装置中的光源照射所述校验件。
本申请实施例的技术方案中,视觉检测装置通过传感器判定待测位是否有料,如有料则进行最后一个产品检测,从而实现全自动校验,提高了校验的效率。
在一些实施例中,所述视觉检测方法还包括:
所述视觉检测装置在检测到第一图像和/或第二图像的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移回原位。
本申请实施例的技术方案中,在获取校验图片后,通过驱动装置自动将校验件移回原位,而无须人工进行校验件的操作,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
在一些实施例中,所述视觉检测方法还包括:
所述上位机在所述系统性校验结果为正常的情况下,通知工位控制器开始输送物料;
所述上位机在所述系统性校验结果为异常的情况下,通知各检测设备进行停机检测,并进行报警。
本申请实施例的技术方案中,上位机根据系统性校验结果对产线进行控制,在所述系统性校验结果为正常的情况下,通知工位控制器开始输送物料,从而提高产线的处理效率,在所述系统性校验结果为异常的情况下,通知各检测设备进行停机检测,并进行报警,从而提高产线的有效监控。
在一些实施例中,所述视觉检测方法还包括:
所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果;
所述上位机根据所述第二图像进行成像效果校验,得到成像效果校验结果;
所述上位机在所述视觉精度校验结果以及成像效果校验结果均为正常校验结果的情况下,根据目标图像进行视觉算法校验,得到视觉算法校验结果;
所述上位机根据所述视觉精度校验结果、成像效果校验结果以及视觉算法校验结果确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,通过校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,并在实现精度校验的基础上,进一步进行算法校验,从而实现视觉检测装置的系统性校验。
在一些实施例中,所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果,包括:
根据所述第一图像中的所述尺寸校验部的结构参数对应的测量值,确定所述视觉检测装置的视觉精度校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值的比较,得到视觉精度校验结果,从而通过量化的数据实现视觉精度的校验,提高视觉检测的准确性。
在一些实施例中,所述上位机根据所述结构参数对应的测量值,确定所述视觉检测装置的视觉精度校验结果,包括:
确定所述结构参数对应的测量值与预设标准值的第一差值;
根据所述第一差值,确定所述视觉检测装置的视觉精度校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与实际检测对象对应的标准值的差值,得到视觉精度校验结果,从而有效的得到图像分析的结果与实际结果之间的误差,更能准确的得到视觉检测的精度。
在一些实施例中,所述上位机根据所述第一差值,确定所述视觉检测装置的视觉精度校验结果,包括:
根据所述第一差值与第一参数阈值范围,确定所述视觉检测装置的视觉精度校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与实际检测对象对应的标准值的差值与参数阈值范围进行比较,得到视觉精度校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为检测结果异常,从而提高视觉精度检测的准确性。
在一些实施例中,所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果,包括:
所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与预设标准值的第一差值;
所述上位机在所述第一差值大于等于第一参数阈值范围的情况下,得到所述视觉检测装置的视觉精度异常的校验结果;所述上位机在所述第一差值小于第一参数阈值范围的情况下,得到所述视觉检测装置的视觉精度正常的校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与实际检测对象对应的标准值的差值与参数阈值范围进行比较,在未超过该范围才认为检测结果正常,从而提高视觉精度检测的准确性。
在一些实施例中,还包括:
所述上位机根据所述结构参数对应的公差确定第一参数阈值范围。
本申请实施例的技术方案中,在得到参数阈值范围之前,通过结构参数对应的确定参数阈值范围,由于不同的结构参数对应的标准也不一样,通过参数对应的公差确定参数阈值范围,使参数阈值范围与结构参数是相适应的,从而提高视觉精度检测的合理性。
在一些实施例中,所述视觉检测方法还包括:
所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与目标标准值的第二差值;
根据所述第二差值,确定所述视觉检测装置的第一视觉算法校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与正常视觉检测算法分析出的结构参数的测量值进行比较,从而得到当前视觉算法的分析结果与正常视觉检测算法检测出的分析结果的差异,因此得到当前视觉算法与正常视觉检测算法的差异,从而实现视觉算法的校验。
在一些实施例中,所述确定所述结构参数对应的测量值与目标结构参数对应的标准值的第二差值之前,还包括:
通过目标视觉算法对所述第一图像进行检测,得到结构参数对应的目标标准值。
本申请实施例的技术方案中,为了更有效得到当前视觉算法与正常视觉检测算法的差异,通过目标视觉算法对所述尺寸校验部进行分析,得到结构参数对应的目标标准值,从而可与结构参数对应的测量值进行比较,实现当前视觉算法与正常视觉检测算法对比的标准统一,提高了视觉算法校验的准确性。
在一些实施例中,所述根据所述第二差值,确定所述视觉检测装置的第一视觉算法校验结果,包括:
根据所述第二差值与第二参数阈值范围,确定所述视觉检测装置的第一视觉算法校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与正常视觉检测算法对应的标准值的差值与参数阈值范围进行比较,得到视觉算法校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为视觉算法异常,从而提高视觉算法校验的准确性。
在一些实施例中,所述视觉检测方法还包括:
所述上位机通过目标视觉算法对所述第一图像进行检测,得到结构参数对应的目标标准值;
所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与目标标准值的第二差值;
所述上位机在所述第二差值大于等于第二参数阈值范围的情况下,得到所述视觉检测装置的视觉算法异常的校验结果;所述上位机在所述第二差值小于第二参数阈值范围的情况下,得到所述视觉检测装置的视觉算法正常的校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与正常视觉检测算法对应的标准值的差值与参数阈值范围进行比较,得到视觉算法校验结果,从而提高视觉算法校验的准确性。
在一些实施例中,所述根据所述第二图像进行成像效果校验,得到成像效果校验结果,包括:
根据所述第二图像中所述色卡校验部的灰度值,得到成像效果校验结果。
本申请实施例的技术方案中,通过校验件上设有比色卡,在实现视觉精度的基础上,进一步实现成像效果的校验。
在一些实施例中,所述根据所述第二图像中的所述色卡校验部的灰度值,得到成像效果校验结果,包括:
确定所述灰度值与预设灰度值的第三差值;
根据所述第三差值,确定所述视觉检测装置成像效果的检测结果。
本申请实施例的技术方案中,通过灰度值与实际检测对象对应的灰度值的差值,得到成像效果校验结果,从而有效的得到图像分析的结果与实际结果之间的误差,更能准确的实现成像效果的检测。
在一些实施例中,所述根据所述第三差值,确定所述视觉检测装置成像效果的检测结果,包括:
根据所述第三差值与第三参数阈值范围,确定所述视觉检测装置成像效果的检测结果。
本申请实施例的技术方案中,通过当前灰度值与实际检测对象对应的标准值的差值与参数阈值范围进行比较,得到成像效果校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为检测结果异常,从而提高成像效果检测的准确性。
在一些实施例中,所述上位机根据所述第二图像进行成像效果校验,得到成像效果校验结果,包括:
所述上位机确定所述第二图像中所述色卡校验部的灰度值与预设灰度值的第三差值;
所述上位机在所述第三差值大于等于第三参数阈值范围的情况下,确定所述视觉检测装置的成像效果异常的检测结果;所述上位机在所述第三差值小于第三参数阈值范围的情况下,确定所述视觉检测装置的成像效果正常的检测结果。
本申请实施例的技术方案中,通过当前灰度值与实际检测对象对应的标准值的差值与参数阈值范围进行比较,得到成像效果校验结果,通过给出一定的阈值范围,在超过该范围才认为检测结果异常,从而提高成像效果检测的准确性。
在一些实施例中,所述视觉检测方法还包括:
根据所述第二图像中所述色卡校验部的灰度值,得到所述视觉检测装置的第二视觉算法校验结果。
本申请实施例的技术方案中,通过灰度值除了进行成像效果检测的同时,还可进行视觉算法的校验,从而实现系统性的视觉校验,提高了产线监测的全面性以及有效性。
在一些实施例中,所述根据所述第二图像中所述色卡校验部的灰度值,得到所述视觉检测装置的第二视觉算法校验结果,包括:
根据所述第二图像中所述色卡校验部的灰度值与目标灰度值的第四差值,得到所述视觉检测装置的第二视觉算法校验结果。
本申请实施例的技术方案中,通过灰度值与正常视觉检测算法分析出的灰度值进行比较,从而得到当前视觉算法的分析结果与正常视觉检测算法检测出的分析结果的差异,因此得到当前视觉算法与正常视觉检测算法的差异,从而实现视觉算法的校验。
在一些实施例中,所述根据所述第二图像中所述色卡校验部的灰度值与目标灰度值的第四差值,得到所述视觉检测装置的第二视觉算法校验结果之前,还包括:
通过目标视觉算法对所述第二图像进行检测,得到目标灰度值。
本申请实施例的技术方案中,为了更有效得到当前视觉算法与正常视觉检测算法的差异,通过目标视觉算法对所述比色卡进行分析,得到比色卡对应的目标标准值,从而可与当前视觉算法分析得到的灰度值进行比较,实现当前视觉算法与正常视觉检测算法对比的标准统一,提高了视觉算法校验的准确性。
在一些实施例中,所述根据所述第二图像中所述色卡校验部的灰度值与目标灰度值的第四差值,得到所述视觉检测装置的第二视觉算法校验结果,包括:
根据所述第四差值与第四参数阈值范围,确定所述视觉检测装置的第二视觉算法校验结果。
本申请实施例的技术方案中,通过当前视觉算法对应的灰度值与正常视觉检测算法对应的标准值的差值与参数阈值范围进行比较,得到视觉算法校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为视觉算法异常,从而提高视觉算法校验的准确性。
在一些实施例中,所述视觉检测方法还包括:
所述上位机通过目标视觉算法对所述第二图像进行检测,得到目标灰度值;
所述上位机确定所述第二图像中所述色卡校验部的灰度值与目标灰度值的第四差值;
所述上位机在所述第四差值大于等于第四参数阈值范围的情况下,得到所述视觉检测装置的视觉算法异常的校验结果;
所述上位机在所述第四差值小于第四参数阈值范围的情况下,得到所述视觉检测装置的视觉算法正常的校验结果。
本申请实施例的技术方案中,通过当前视觉算法对应的灰度值与正常视觉检测算法对应的标准值的差值与参数阈值范围进行比较,得到视觉算法校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为视觉算法异常,从而提高视觉算法校验的准确性。
在一些实施例中,所述视觉检测方法还包括:
根据所述第一图像对应的检测值与标准值,确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,通过检测值与标准值进行比较,得到视觉检测装置的系统性校验结果,从而通过量化的数据实现视觉检测装置的系统性校验结果,提高视觉检测装置的系统性校验的准确性。
在一些实施例中,所述视觉检测方法还包括:
根据所述第二图像对应的检测值与标准值,确定视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,通过结构参数对应的测量值与标准值的比较,得到视觉精度校验结果,以及通过比色卡的灰度值与标准值进行比较,得到成像效果校验结果,从而通过量化的数据实现视觉检测装置的系统性校验,提高系统性校验的准确性。
在一些实施例中,所述视觉检测方法还包括:
根据所述第一图像对应的检测值与标准值以及所述第二图像对应的检测值与标准值,确定所述视觉检测装置的系统性校验结果。
本申请实施例的技术方案中,同时通过多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部的图像,实现视觉精度校验以及成像效果校验,然后在视觉精度校验以及成像效果校验的基础上进行视觉算法的校验,从而实现视觉检测装置的系统性校验。
在一些实施例中,所述上位机根据目标图像进行视觉算法校验,得到视觉算法校验结果之前,还包括:
所述上位机获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片,其中,所述第一图片的参数值处于第一范围,第二图片的参数值处于第二范围,第三图片的参数值处于第三范围,第三图片的参数值处于第四范围,所述第一范围和第二范围不同,所述第三范围和第四范围不同;
根据所述第一图片、第二图片、第三图片以及第四图片建立图片校验库。
本申请实施例的技术方案中,通过预先建立的图片校验库进行视觉算法的检测,相比较于直接进行校验结果的比较,校验的效率更高。
在一些实施例中,所述上位机根据所述第一图片、第二图片、第三图片以及第四图片建立图片校验库,包括:
所述上位机对所述第一图片、第二图片、第三图片以及第四图片进行编号;
根据编号后的第一图片、第二图片、第三图片以及第四图片建立图片校验库。
本申请实施例的技术方案中,在建立图片校验库时,对图片样本通过编号的方式进行管理,从而实现图片校验库的有效管理,也不便于后续图片校验库的调整和更新。
在一些实施例中,所述获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片之前,还包括:
采用目标视觉检测算法对样本图像进行评估,得到经过标定参数值的第一图片、第二图片、第三图片以及第四图片。本申请实施例的技术方案中,通过完善的视觉检测算法预先对采样的图片进行评估,并将评估后的参数值作为后续比对的标准值,实现视觉算法的校验。
在一些实施例中,所述上位机根据目标图像进行视觉算法校验,得到视觉算法校验结果,包括:
所述上位机从所述图片校验库中选择目标图像;
通过所述视觉检测装置对所述目标图像进行图像识别,得到所述目标图像的参数值;
将所述参数值与所述目标图像对应的标定参数值进行比较;
将所述参数值与所述目标图像对应的标定参数值的差值超过第五参数阈值范围的情况下,确定视觉算法异常。
本申请实施例的技术方案中,通过完善的视觉检测算法检测的参数值与当前视觉算法检测的参数进行比对,根据比对结果实现视觉算法的校验,提高视觉算法校验的准确性。
有益效果
本申请实施例的技术方案中,在进行系统校验时,将校验件集中在安装板上,通过驱动安装板实现校验件的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
附图说明
图1为本申请一些实施例提出的视觉校验系统的结构示意图;
图2为本申请一些实施例提出的校验件的结构示意图;
图3为本申请一些实施例提出的视觉校验装置的结构示意图;
图4为本申请一些实施例提出的校验件的另一结构示意图;
图5为本申请一些实施例提出的视觉检测方法的第一流程示意图;
图6为本申请一些实施例提出的视觉检测方法的第二流程示意图;
图7为本申请一些实施例提出的视觉检测方法的第三流程示意图;
图8为本申请一些实施例提出的视觉检测的第一整体流程示意图;
图9为本申请一些实施例提出的视觉检测方法的第四流程示意图;
图10为本申请一些实施例提出的视觉检测方法的第五流程示意图;
图11为本申请一些实施例提出的视觉检测方法的第六流程示意图;
图12为本申请一些实施例提出的视觉检测方法的第七流程示意图;
图13为本申请一些实施例提出的视觉检测方法的第八流程示意图;
图14为本申请一些实施例提出的视觉检测方法的第九流程示意图;
图15为本申请一些实施例提出的视觉检测方法的第二整体流程示意图;
图16为本申请一些实施例提出的视觉检测方法的视觉算法检测流程示意图;
图17为本申请一些实施例提出的视觉检测方法的第十流程示意图;
图18为本申请一些实施例提出的视觉检测方法的第十一流程示意图;
图19为本申请一些实施例提出的视觉检测方法的第十二流程示意图;
图20为本申请一些实施例提出的视觉检测方法的第十三流程示意图;
图21为本申请一些实施例提出的视觉检测方法的第三整体流程示意图。
具体实施方式中的附图标号如下:
视觉校验装置100,视觉检测装置200,上位机300,校验件10,校验件移动装置20,尺寸校验部201,色卡校验部202,
板主体30,校验面40,安装板50,支撑底座60,驱动装置70、701、702、滑轨80、转接座90、高度限位块901、第一滑动限位块902以及第二滑动限位块903。
本发明的实施方式
下面将结合附图对本申请技术方案的实施例进行详细的描述。以下实施例仅用于更加清楚地说明本申请的技术方案,因此只作为示例,而不能以此来限制本申请的保护范围。
除非另有定义,本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同;本文中所使用的术语只是为了描述具体的实施例的目的,不是旨在于限制本申请;本申请的说明书和权利要求书及上述附图说明中的术语“包括”和“具有”以及它们的任何变形,意图在于覆盖不排他的包含。
在本申请实施例的描述中,技术术语“第一”“第二”等仅用于区别不同对象,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量、特定顺序或主次关系。在本申请实施例的描述中,“多个”的含义是两个以上, 除非另有明确具体的限定。
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。
在本申请实施例的描述中,术语“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。
在芯片制造产线上,设备点检是一种用于检查和评估制造设备状态以确保其正常运行和产品质量的过程。芯片制造产线上的设备点检通常要求更为严格和精细,因为芯片制造对设备的精度、稳定性和纯净度要求极高。
以下是在芯片制造产线上进行设备点检的一般步骤:清洁和准备:在进行点检之前,首先需要对设备进行清洁,并确保工作区域保持整洁和干净。此外,准备所需的点检工具、记录表格和文件。外观检查:对设备的外观进行仔细的检查,包括检查设备表面是否有损伤、腐蚀和污垢。确保设备的机械部件和接口连接牢固,防止松动或漏气现象。功能测试:对设备的功能进行测试,包括启动、运行和停止设备。检查设备是否按照预定参数和程序正常工作。确保所有功能都能够准确执行。温度和湿度控制:在芯片制造过程中,温度和湿度的精确控制非常重要。确保设备的温度和湿度控制系统正常运行,并符合制造要求。
传感器检查和校准:芯片制造设备通常配备大量的传感器,用于监测各种参数,如温度、压力和流量等。检查这些传感器的准确性,并进行校准和调整。检查和更换耗材:芯片制造设备通常使用各种耗材,如过滤器和密封件。检查这些耗材的状态,如果需要更换,及时进行更换,以确保设备正常运行并保持制造过程的纯净度。记录和报告:在点检过程中,记录检查结果、观察到的问题和采取的行动。及时报告任何发现的严重问题,并采取适当的纠正措施。
在芯片制造产线上,设备点检是非常重要的,它有助于确保设备的准确性、稳定性和可靠性,从而保证芯片制造过程的高质量和产品性能。定期的设备点检也是管理和维护芯片制造设备的一项关键任务,在一般情况下,可通过视觉系统结合点检块进行设备点检。
在芯片制造产线上,设备点检的时机通常基于以下几个因素:定期点检:定期点检是按照预定的时间间隔进行的,例如每天、每周或每月进行一次。这种点检可以确保设备的稳定性和可靠性,并及早发现潜在问题。预防性点检:预防性点检是在设备正常运行期间进行的检查,旨在预防可能会导致故障或损坏的问题。这种点检可以减少设备故障和停机时间,提高生产效率。偶发性点检:偶发性点检是在发生异常情况或设备出现问题时进行的检查。这种点检是为了及时识别和解决特定问题,并防止其进一步恶化。关键节点点检:关键节点点检是在芯片制造过程中的关键节点或重要步骤之前或之后进行的检查。这样可以确保设备在关键时刻的状态良好,并避免对产品质量产生负面影响。此外,还可以根据设备的历史记录、制造需求和运营经验来确定设备点检的时机。重要的是要实施一个合理的点检计划,以确保设备在关键时刻和关键步骤的稳定性和可靠性,并最大程度地减少生产中的风险和故障,一般情况下,制造执行系统创建校验任务触发视觉系统进行自动校验模式,还可通过设备设置自动校验时间进入校验模式。
对于产线校验,传统测量工具校验都由人工来操作的,除了操作麻烦和需要熟练的工人来操作,同时操作和分析都耗时较长,对拉线造成较大产能损失。
为了解决现有的校验方式耗时较长的技术问题,本申请实施例通过视觉校验装置,通过视觉校验装上的校验件移动装置,实现自动化校验,从而提高校验的效率。
本申请针对现有的校验方式耗时较长的技术问题,提出了一种视觉检测系统,如图1所示,视觉检测系统包括:
视觉校验装置100,包括校验件10以及校验件移动装置20,校验件移动装置20包括活动安装的安装板50,在安装板50的活动行程上,安装板50能够处在校验位,校验位在视觉检测装置200的检测范围内,校验件10设于安装板50;视觉检测装置200,用于获得校验件10的图像,并将校验件10的图像发送至上位机300;
上位机300,用于根据校验件10的图像确定视觉检测装置200的系统性校验结果。
在本实施例中,在电池制造的过程中,对电芯、模组、PACK质量监控越来越精细,因此在各个工序中都设有视觉检测系统,通过视觉检测系统进行质量监控,本实施例可应用于电芯、模组、PACK的各个工序环节中,只要涉及要视觉检测系统,均可同时本实施例实现自动化检测。以电芯完成焊接工序为例进行说明,在电芯完成焊接工序,将焊接后的电芯运输至下一工序,在运输焊接后的电芯的运输线上,布设有视觉检测装置200,视觉检测装置200用于对产线进行视觉监控。因此,在运输上具有视觉检测装置200的校验位,在焊接后的电芯在运输的过程中,达到校验位时,则视觉检测装置200可采集到焊接后的电芯的图像,并根据焊接后的电芯的图像进行数据分析,而本实施例在视觉检测系统进行检验模式的情况下,将视觉校验装置100上的校验件10移动至校验位,通过视觉检测系统对校验位的视觉检测,从而实现自动化检测,达到提高产线检测的效率的目的。
视觉校验装置100可位于校验位的一侧,在制造执行系统创建校验任务触发视觉系统进行自动校验模式或者检测设备设置自动校验时间进入校验模式,上位机300通知视觉校验装置100进行校验模式,视觉校验装置100通过校验件移动装置20将校验件10移动至校验位进行视觉检测,由于视觉检测装置200用于采集位于校验位的检测物的图像,因此,视觉检测装置200可采集到校验件10的图像,并将采集到的校验件10发送至上位机300进行图像分析,上位机300根据校验件10的图像进行系统性校验,得到系统性检验结果,其中,系统性检验结果包括视觉精度是否异常的校验结果、成像效果是否异常的校验结果以及视觉算法是否异常的校验结果。
本实施例的视觉检测系统适应不同视觉检测设备应用场景,装置本身能够根据测量对象的特点具有自动校验功能,可以自动的实现视觉系统光源、相机精度、算法稳定性准确性在线校验。
本申请实施例的技术方案中,将校验件10集中在安装板50上,通过驱动安装板50实现校验件10的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
在本实施例中,校验件移动装置20用于带动校验块移动至校验位,以使视觉检测装置200的光源照射校验件10。校验件移动装置20用于将校验件10在需要进行校验时,移动至光源下进行视觉检测,从而避免影响产线的正常运行,在不 需要进行校验时,将校验件10自动缩回,如图1所示的视觉校验装置100的结构示意图,在需要进行校验时,将校验件移动装置20上的校验件10移动至光源下进行视觉检测,从而实现自动化的视觉检测。
校验位为视觉检测的位置,视觉检测装置200包括光源、视觉检测部件、处理装置以及控制装置,视觉检测部件面对校验位,用于采集校验位上产品的图像,光源为校验位提供光线,处理装置用于获取视觉图像,控制装置用于实现产线上的视觉检测装置200的工作流程控制,通过对校验位布设视觉检测,从而实现产线的有效管控。
本实施例在需要通过校验件10进行系统校验时,将校验件10自动移动到校验位,从而视觉检测装置200的全自动校验。本实施例将校验件10集中在安装板50上,通过驱动安装板50实现校验件10的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
根据本申请的一些实施例,可选地,校验件10可拆卸安装于安装板50。
在本实施例中,校验件10与安装板50可通过锁扣的方式连接,还可通过其他的方式,本实施例对此不做限制,通过校验件10可拆卸安装于安装板50,因此,可根据实际检测需求更换安装板50上的校验件10,提高检测的灵活性。
本实施例通过校验件10安装板50上可拆卸件实现校验件10的快拆锁附方式,方便用于二次元或者更高精度测量系统的真值测量。
根据本申请的一些实施例,可选地,校验件10包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部;
视觉检测装置200,还用于获得尺寸校验部的第一图像以及色卡校验部的第二图像,并将第一图像以及第二图像发送至上位机300;
上位机300,还用于根据第一图像和/或第二图像确定视觉检测装置200的系统性校验结果。
如图2所示的校验件10以及校验件10中的校验部的示意图,校验部包括多个尺寸呈梯度变化的尺寸校验部201以及灰度值呈梯度变化的色卡校验部202,尺寸校验部可为梯度校验凹槽或凸起,还可为其他形式的尺寸校验部,校验件10要求凹槽或凸起尺寸呈现周期性规律,尽可能覆盖量具量程。校验件10要求凹槽或者凸起非镜面,表面为磨砂质感,粗糙度<Ra3.2。
在一般情况下,校验件10上的凹槽、凸起等尺寸信息只有深度尺寸有梯度变化,而宽度或者长度没有梯度变化,在2D相机的校验上存在一定偶然性,无法有效校验确认量具量程的线性偏移,无法发现镜头畸变带来精度影响,因此,本实施例增加了二维、三维尺寸的梯度变化,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,同时可以校验2D相机镜头因畸变导致精度误差。
在本实施例中,校验件10要求不少于5个梯度变化的凹槽或凸起,同时满足2维、三维尺寸梯度变化,适用于2D相机、3D相机量具量程的精度校验,适用于2D相机、3D相机量具的线性偏移分析校验。
在具体实现中,第一图像为采集到的多个尺寸呈梯度变化的尺寸校验部的图像,校验件10还可设在产品上,得到产品的图像,根据产品的图像实现视觉算法的校验。正对校验件10设有视觉检测装置200,通过光源给校验件10补光的情况下,视觉检测装置200获取到校验件10上尺寸校验部的图像,通过尺寸校验部的图像进行系统性分析,实现视觉检测装置200的检测,第二图像为采集到的灰度值呈梯度变化的色卡校验部的图像,第一图像和第二图像可为一张图像,还可为分开的多张图像,在为多张图像时,通过布设不同区域的视觉检测装置200采集到对应区域的第一图像和第二图像,在为一幅图像时,可对该图像进行区域划分,得到多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部对应的第一图像和第二图像,从而实现视觉检测。
校验件10还可设在产品上,得到产品的图像,根据产品的图像实现视觉算法的校验。正对校验件10设有视觉检测装置200,通过光源给校验件10补光的情况下,视觉检测装置200获取到校验件10上尺寸校验部的图像,通过尺寸校验部的图像进行系统性分析,实现视觉检测装置200的检测。
在本实施例中,系统性校验结果包括视觉精度校验结果、成像效果校验结果以及视觉算法校验结果,从而实现视觉检测装置200的系统性校验。
本实施例在校验件10上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度。是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,并在实现精度校验的基础上,进一步进行算法校验,从而实现视觉检测装置200的系统性校验。
根据本申请的一些实施例,可选地,如图3所示,视觉校验装置100还包括:
支撑底座60;以及,
驱动装置70,包括相对直线活动的固定部701和活动部702,固定部701设于支撑底座60,活动部702与安装板50连接。
固定部60用于固定驱动装置在支撑底座60上,固定部60可为固定件,还可为其他形式的固定部件,本实施例对此不做限制,驱动装置70可为气缸,还可为其他驱动装置,本实施例对此不做限制,活动部702可为气缸的伸缩杆,伸缩杆一端与固定件连接,另一端与安装板50连接,通过伸缩杆实现安装板50的移动,从而带动安装板50上的校验件10移动至校验位。
在本实施例中,驱动装置70并不直接驱动校验件10,而是驱动与校验件10连接的安装板50,通过驱动安装板50,从而实现校验件10的移动,安装板50通过可拆卸件连接校验件10,从而实现校验件10可根据需求进行更换,提高视觉检测的灵活性。
在具体实现中,以驱动装置70为气缸为例进行说明,气缸的一端与安装板50连接,安装板50上通过可拆卸件安装校验件10,在气缸接收到检测指令时,进行作动,将连接的安装板50移动至校验位,从而使校验件10自动移动至校验位,在气缸接收到检测完成指令时,进行缩回操作,将连接的校验件10安装板50移回原位,从而使校验件10自动移回原位。
驱动装置70还可直接与校验件10连接,在气缸接收到检测指令时,进行作动,将连接的校验件10移动至校验位,从 而使校验件10自动移动至校验位,在气缸接收到检测完成指令时,进行缩回操作,将连接的校验件10移回原位,从而使校验件10自动移回原位。
本申请实施例的技术方案中,通过驱动的方式实现校验件10的移动,从而实现视觉检测装置200的全自动校验。
根据本申请的一些实施例,可选地,视觉校验装置100还包括滑动导向结构,滑动导向结构包括相互滑动配合的滑轨80和滑块(图中未示出),滑轨80和滑块中,滑轨80和滑块设于支撑底座与安装板50之间,其中之一设于支撑底座60,另一设于安装板50。
在本实施例中,滑动导向结构与位于安装板50底部的滑动装置配合使用;滑动导向结构,用于使校验件10移动至校验位。滑块设在支撑底座60上,滑轨80在滑块上移动,滑轨80与安装板50配合使用,在驱动装置70驱动安装板50时,带动滑轨80在滑块移动,从而使安装板50上的校验件10移动到校验位。
本实施例通过驱动装置70驱动校验件10安装板50的情况下,通过滑动装置确定校验件10安装板50的移动轨迹,提高了校验件10移动的精确性。
根据本申请的一些实施例,可选地,视觉校验装置100还包括转接座90,滑轨设置两个,对应滑块设置两个;
其中相互配合的一组滑轨80和滑块分设于支撑底座60和转接座90之间,另一组滑轨80和滑块分设于安装板50和转接座之间。
在本实施例中,如图3所示,设置双轨,在驱动装置70靠近校验块的一侧设有第一套相互滑动配合的滑轨80和滑块,通过第一套的滑轨80和滑块控制校验块在第一移动范围内进行移动,通过远离校验块的一侧设有第二套相互滑动配合的滑轨80和滑块,通过第二套的滑轨80和滑块控制校验块在第二移动范围内进行移动,通过第一套相互滑动配合的滑轨80和滑块使校验块移动至校验位,通过第二套相互滑动配合的滑轨80和滑块使校验块可以缩回至支撑底座60。
本实施例通过多组滑动装置实现安装板50的移动,实现安装板50移动的精准控制。
转接座上还设有高度限位块901和第一滑动限位块902,高度限位块901用于限定滑动轨迹的高度,对安装板50垂直方向上的滑动范围进行限制,第一滑动限位块902用于限定滑轨在第一移动范围水平方向上的滑动范围。视觉校验装置100还包括第二滑动限位块903,第二滑动限位块903固定于支撑底座60,用于限定滑轨在第二移动范围水平方向上的滑动范围。
根据本申请的一些实施例,可选地,如图4所示,视觉检测的校验件10包括:
板主体30,具有校验面40;
多个尺寸校验部201,沿直线方向间隔设于校验面40上,多个尺寸校验部具有处在第一方向上的长度尺寸和处在第二方向上的宽度尺寸,多个尺寸校验部的长度尺寸呈梯度变化,和/或,多个尺寸校验部的宽度尺寸呈梯度变化,其中,第一方向与第二方向为水平面内相互垂直的方向。
在本实施例中,校验件10包括校验块,还可为其他形式的校验件10,本实施例对此不做限制,以校验块为例进行说明,第一方向可为沿着板主体30的水平方向,即x轴方向,第二方向可为沿着板主体30垂直方向,即y轴方向,还可为第一方向为沿着板主体30的垂直方向,第二方向沿着板主体30水平方向,本实施例对此不做限制。
在具体实现中,任意相邻的两个尺寸校验部中处在前侧的尺寸校验部的长度尺寸大于或者小于处在后侧的尺寸校验部的长度尺寸,和/或,任意相邻的两个尺寸校验部中处在前侧的尺寸校验部的宽度尺寸大于或者小于处在后侧的尺寸校验部的宽度尺寸,其中,第一方向与第二方向为水平面内相互垂直的方向,从而使长度或宽度尺寸呈线性变化,实现线性偏移的校验。
在多个尺寸校验部的间隔方向上,任意相邻的三个尺寸校验部中:处在前侧的相邻的两个尺寸校验部的长度尺寸变化量与处在后侧的相邻的两个尺寸校验部的长度尺寸变化量相同;和/或,处在前侧的相邻的两个尺寸校验部的宽度尺寸变化量与处在后侧的相邻的两个尺寸校验部的宽度尺寸变化量相同。从而使长度或宽度尺寸呈梯度变化,提高线性偏移的准确性。
在本实施例中,尺寸校验部与板主体30可为一体成型,还可为分体设置,本实施例对此不做限制。
本实施例在校验件10上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度,是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,提高视觉检测的精度。
根据本申请的一些实施例,可选地,尺寸校验部包括形成在板本体上的凸起或者凹槽。
本实施例中的尺寸校验部上设有凸起或者凹槽,因此,增加了二维、三维的基础上,进行视觉精度的校验,并且其尺寸呈梯度变化,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,同时可以校验2D相机镜头因畸变导致精度误差。
本实施例获取校验件10上的凹槽、凸起等尺寸信息与预定的尺寸信息是否在合理误差范围,达到相机精度校验。
根据本申请的一些实施例,可选地,多个尺寸校验部沿第三方向上的尺寸呈梯度变化,第三方向与第一方向和第二方向垂直。
在本实施例中,第三方向为沿板主体30的z轴方向,即尺寸校验部的z轴方向呈梯度变化。
本实施例在校验件10上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验。
根据本申请的一些实施例,可选地,还包括设于板主体30的校验面40上的灰度值呈梯度变化的色卡校验部202。
在本实施例中,色卡校验部202可为比色卡,还可为其他形式的色卡,本实施例对此不做限制,比色卡包括多个梯度的标准色卡,比色卡可为浅灰、灰色、深灰三个梯度标准色卡,还可为RGB三原色色卡,黑白相机配备浅灰、灰色、深灰三个梯度标准色卡,彩色相机配备RGB三原色色卡,用于成像效果的校验。
本实施例通过校验件10上设有比色卡,实现成像效果的校验,校验件10的色卡要求黑白相机配备浅灰、灰色、深灰三个梯度标准色卡,从而实现黑白相机的成像效果的校验。
根据本申请的一些实施例,可选地,色卡校验部202包括三原色色卡。
本实施例彩色相机配备RGB三原色色卡,从而实现彩色相机成像效果的校验。
根据本申请的一些实施例,可选地,板主体30的材质包括铝合金;和/或,板主体30的校验面40的粗糙度小于预设粗糙度阈值。
在本实施例中,视觉检测系统中的校验块包括铝白色基材,例如铝合金材质、梯度校验凹槽或凸起、梯度标准色卡、校验块运动所需气缸、滑轨80、滑块,预设粗糙度阈值可为Ra3.2,还可为其他阈值,本实施例对此不做限制,校验块要求凹槽或凸起尺寸呈现周期性规律,尽可能覆盖量具量程,并且校验块要求凹槽或者凸起非镜面,表面为磨砂质感,粗糙度<Ra3.2,从而得到更好的成像效果。
本实施例对板主体30的材质板包括铝合金,以及板主体30的校验面40的粗糙度进行调整,从而提高多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部202的成像效果。
本申请还提出了一种视觉检测方法,视觉检测系统包括视觉检测装置、视觉校验装置以及上位机,如图1所示,视觉校验装置,包括校验件以及校验件移动装置,校验件移动装置包括活动安装的安装板,在安装板的活动行程上,安装板能够处在校验位,校验位在视觉检测装置的检测范围内,校验件设于安装板;
如图5所示的视觉检测方法第一实施例的流程示意图,视觉检测方法包括:
步骤S10,视觉检测装置获得校验件的图像,并将校验件的图像发送至上位机;
步骤S20,上位机根据校验件的图像确定视觉检测装置的系统性校验结果。
需要说明的是,视觉校验装置可位于校验位的一侧,在制造执行系统创建校验任务触发视觉系统进行自动校验模式或者检测设备设置自动校验时间进入校验模式,上位机通知视觉校验装置进行校验模式,视觉校验装置通过校验件移动装置将校验件移动至校验位进行视觉检测,由于视觉检测装置用于采集位于校验位的检测物的图像,因此,视觉检测装置可采集到校验件的图像,并将采集到的校验件发送至上位机进行图像分析,上位机根据校验件的图像进行系统性校验,得到系统性检验结果,其中,系统性检验结果包括视觉精度是否异常的校验结果、成像效果是否异常的校验结果以及视觉算法是否异常的校验结果。
本实施例的视觉检测系统适应不同视觉检测设备应用场景,装置本身能够根据测量对象的特点具有自动校验功能,可以自动的实现视觉系统光源、相机精度、算法稳定性准确性在线校验。
本申请实施例的技术方案中,将校验件集中在安装板上,通过驱动安装板实现校验件的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
在本实施例中,校验件移动装置用于带动校验块移动至校验位,以使视觉检测装置的光源照射校验件。校验件移动装置用于将校验件在需要进行校验时,移动至光源下进行视觉检测,从而避免影响产线的正常运行,在不需要进行校验时,将校验件自动缩回,在需要进行校验时,将校验件移动装置上的校验件移动至光源下进行视觉检测,从而实现自动化的视觉检测。
校验位为视觉检测的位置,视觉检测装置包括光源、视觉检测部件、处理装置以及控制装置,视觉检测部件面对校验位,用于采集校验位上产品的图像,光源为校验位提供光线,处理装置用于获取视觉图像,控制装置用于实现产线上的视觉检测装置的工作流程控制,通过对校验位布设视觉检测,从而实现产线的有效管控。
本实施例在需要通过校验件进行系统校验时,将校验件自动移动到校验位,从而视觉检测装置的全自动校验。
本实施例将校验件集中在安装板上,通过驱动安装板实现校验件的移动,从而采用自动的方式,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
根据本申请的一些实施例,可选地,如图6所示的视觉检测方法第二实施例的流程示意图,校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部;
步骤S10',视觉检测装置用于获得尺寸校验部的第一图像以及色卡校验部的第二图像,并将第一图像以及第二图像发送至上位机;
步骤S20',上位机用于根据第一图像和/或第二图像确定视觉检测装置的系统性校验结果。
一般来说,通过设计产品仿型校验件,人工放置在待测件检测位上,匹配实际生产过程检测姿态,然后通过相机获取校验件上的凹槽、凸起等尺寸信息与预定的尺寸信息是否在合理误差范围,达到相机精度校验,这种校验方式仅针对相机精度校验,从而使校验方式受限。
为了解决现有的校验方式受限的技术问题,本申请实施例在校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度。是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,并在实现精度校验的基础上,进一步进行算法校验,从而实现视觉检测装置的系统性校验。
需要说明的是,为了便于对产线上的产品进行实时监控,通过视觉检测装置采集产线上的产品的图片,通过图片进行分析,得到产品的规格以及相关参数,例如产品的尺寸以及厚度等,从而实现产品的有效监控。其中,产品可为电池单体或电池包等,还可为其他类型的产品,本实施例对此不做限制,在本实施例中,以电池单体为例进行说明。在电池单体的生产加工的产线上设有多个检测位,检测位上设有视觉检测装置,视觉检测装置可为2D相机、3D相机、结构相机、面扫相机或者线扫相机以及光源等,视觉检测装置面对校验件进行图像采集,并在还设有光源,提供光线照射校验件,便于视觉检测装置采集到校验件的图像,其中,校验件可放置在运输的产线上,在视觉检测装置检测到校验件时,采集校验件的图像,还可设置在运输线侧,在需要进行校验时,自动将校验件放置在输送线上,还可为通过驱动装置将校验件移动到检测位上,本实施例对此不做限制。
视觉校验装置包括校验件,校验件用于作为取样品,通过采集校验件的图像实现视觉检测装置的系统性检测。如图2所示的校验件以及校验件中的校验部的示意图,校验部包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部,尺寸校验部可为梯度校验凹槽或凸起,还可为其他形式的尺寸校验部,校验件要求凹槽或凸起尺寸呈现周期性规律,尽可能覆盖量具量程。校验件要求凹槽或者凸起非镜面,表面为磨砂质感,粗糙度<Ra3.2。
在一般情况下,校验件上的凹槽、凸起等尺寸信息只有深度尺寸有梯度变化,而宽度或者长度没有梯度变化,在2D相机的校验上存在一定偶然性,无法有效校验确认量具量程的线性偏移,无法发现镜头畸变带来精度影响,因此,本实施例增加了二维、三维尺寸的梯度变化,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,同时可以校验2D相机镜头因畸变导致精度误差。
在本实施例中,校验件要求不少于5个梯度变化的凹槽或凸起,同时满足2维、三维尺寸梯度变化,适用于2D相机、3D相机量具量程的精度校验,适用于2D相机、3D相机量具的线性偏移分析校验。
在具体实现中,第一图像为采集到的多个尺寸呈梯度变化的尺寸校验部的图像,校验件还可设在产品上,得到产品的图像,根据产品的图像实现视觉算法的校验。正对校验件设有视觉检测装置,通过光源给校验件补光的情况下,视觉检测装置获取到校验件上尺寸校验部的图像,通过尺寸校验部的图像进行系统性分析,实现视觉检测装置的检测,第二图像为采集到的灰度值呈梯度变化的色卡校验部的图像,第一图像和第二图像可为一张图像,还可为分开的多张图像,在为多张图像时,通过布设不同区域的视觉检测装置采集到对应区域的第一图像和第二图像,在为一幅图像时,可对该图像进行区域划分,得到多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部对应的第一图像和第二图像,从而实现视觉检测。
校验件还可设在产品上,得到产品的图像,根据产品的图像实现视觉算法的校验。正对校验件设有视觉检测装置,通过光源给校验件补光的情况下,视觉检测装置获取到校验件上尺寸校验部的图像,通过尺寸校验部的图像进行系统性分析,实现视觉检测装置的检测。
在本实施例中,系统性校验结果包括视觉精度校验结果、成像效果校验结果以及视觉算法校验结果,从而实现视觉检测装置的系统性校验。
本实施例在校验件上设有多个尺寸呈梯度变化的尺寸校验部,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,线性偏移是线性误差或端点线性度。是衡量通过的整个量程范围的端点组成直线的最大偏差,即实测曲线与理想直线之间的偏差,同时可以校验2D相机镜头因畸变导致精度误差,并在实现精度校验的基础上,进一步进行算法校验,从而实现视觉检测装置的系统性校验。
需要说明的是,在视觉精度校验结果、成像效果的检测结果以及视觉算法校验结果中的任意一项出现异常结果的情况下,通知待检测设备停止工作。
在本实施例中,将获得的各项参数和比对结果上传制造执行系统,制造执行系统再次对结构参数进行比对,如任一结果NG,则制造执行系统锁机,杜绝检测系统进行生产。同时设备报警,此时工作人员需要依据NG项进行系统排查和调整,及时纠正视觉检测误差。保证视觉检测系统在长时间或调整后依然具有良好的精确性,例如在检测到视觉精度出现异常时,则制造执行系统锁机,或者在成像效果出现异常时,以及视觉算法出现异常时,进行停机整顿,从而提高了生产的有效监控。
本实施例为了保证产线生产的安全性以及防止次品出厂,在检测到产线上的视觉精度、视觉成像以及视觉算法出现问题时,及时进行停产检测,实现产线监测的有效管控。
在系统性校验结果为正常结果的情况下,确定校验模式结束,并通知相关生产设备进入生产模式。
在本实施例中,在视觉精度校验结果、成像效果的检测结果以及视觉算法校验结果均正常的情况下,视觉检测装置通过与上游工位交互,告知上游工位,开始下料,进入生产模式,从而实现生产的自动化管理。
本实施例由于在进行生产校验的过程中,避免出现校验中其他物料以及生产过程中的其他影响因素,需要对产线暂停输送物料,并进入校验模式,但是在校验结束需要尽快恢复生产,自动恢复到生产模式,从而提高产线的自动化管理。
根据本申请的一些实施例,可选地,如图7所示,视觉检测方法还包括:
步骤S401,上位机在接收到校验指令的情况下,发送校验指令至视觉检测装置;
步骤S402,视觉检测装置在接收到校验指令的情况下,通知工位控制器停止输送物料。
如图8所示的视觉检测的整体流程示意图,制造执行系统创建校验任务,或设备设置自动校验时间,触发视觉检测装置进行自动校验模式,视觉检测装置通过与上游工位交互,告知上游工位,停止下料,进入校验模式,具体流程为S301:判断校验位是否有料,否的情况下,执行S302:校验块移动至校验位,相机拍照获取图片,进行图片分析,S303:完成图片获取后,气缸控制校验块归原位;S304:相机精度判断:|测量值-标准值|<T/10,成像效果校验:|测量值-标准值|<10:如果均OK的情况下,执行S305:算法校验:|测量值-标准值|<T/10,如果均OK的情况下,执行S306:上传制造执行系统,视觉系统告知上游开始下料,进入生产模式,如果相机精度或者成效效果有一项没有通过,或者算法校验没有通过,则执行S308:上传制造执行系统,设备停机,报警,S309:工作人员进行系统排查异常,进行系统纠偏,并返回执行S302,如果校验位是否有料,则执行S307:进行产品检测,完成后进行校验。
本实施例由于在进行生产校验的过程中,避免出现校验中其他物料以及生产过程中的其他影响因素,因此对产线暂停输送物料,从而提高校验的准确性。
根据本申请的一些实施例,可选地,如图9所示,视觉检测方法还包括:
步骤S501,视觉检测装置在检测到校验位上未存有物料的情况下,通知视觉校验装置中的将校验件移动至校验位,校验位在视觉检测装置的检测范围内,以使视觉检测装置中的光源照射校验件。
在本实施例中,驱动装置可为气缸,还可为其他可实现驱动功能的装置,本实施例对此不做限制,以气缸为例进行说明,视觉检测装置通过传感器的感知,确认校验位无产品,控制气缸伸出,将校验件移动至待料位。
本实施例通过驱动装置将校验件移动至校验位,而无需人工进行校验件的操作,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
步骤S502,视觉检测装置检测到校验位上存有物料的情况下,继续对校验位上的当前物料进行检测,直至目标物料离开校验位的情况下,通知视觉校验装置中的驱动装置将校验件移动至校验位,以使视觉检测装置中的光源照射校验件。
在本实施例中,目标物料为当前运输过程中的最后一个物料,由于在进行自动校验模式时,检测到校验位上仍有物料的 情况下,为了将当前的流程完成,在检测到最后一个产品时,再开始校验,例如视觉检测装置通过传感器判定校验位是否有料,如有料则进行最后一个产品检测。如无物料,则开始进行校验。
本实施例视觉检测装置通过传感器判定校验位是否有料,如有料则进行最后一个产品检测,从而实现全自动校验,提高了校验的效率。
根据本申请的一些实施例,可选地,如图10所示,视觉检测方法还包括:
步骤S601,视觉检测装置在检测到第一图像和/或第二图像的情况下,通知视觉校验装置中的驱动装置将校验件移回原位。
在具体实现中,在完成校验件图片获取后,触发控制气缸缩回原位,将校验件移动原位。
本实施例在获取校验图片后,通过驱动装置自动将校验件移回原位,而无须人工进行校验件的操作,实现全自动校验,解决容易受操作人员熟练度的影响导致校验时长、产能损失大的问题。
根据本申请的一些实施例,可选地,如图11所示,视觉检测方法还包括:
步骤S701,上位机在系统性校验结果为正常的情况下,通知工位控制器开始输送物料;
步骤S702,上位机在系统性校验结果为异常的情况下,通知各检测设备进行停机检测,并进行报警。
本申请实施例的技术方案中,上位机根据系统性校验结果对产线进行控制,在系统性校验结果为正常的情况下,通知工位控制器开始输送物料,从而提高产线的处理效率,在系统性校验结果为异常的情况下,通知各检测设备进行停机检测,并进行报警,从而提高产线的有效监控。
根据本申请的一些实施例,可选地,如图12所示,视觉检测方法还包括:
步骤S801,上位机根据第一图像进行视觉精度校验,得到视觉精度校验结果;
步骤S802,上位机根据第二图像进行成像效果校验,得到成像效果校验结果;
步骤S803,上位机在视觉精度校验结果以及成像效果校验结果均为正常校验结果的情况下,根据目标图像进行视觉算法校验,得到视觉算法校验结果;
步骤S804,上位机根据视觉精度校验结果、成像效果校验结果以及视觉算法校验结果确定视觉检测装置的系统性校验结果。
在本实施例中,视觉精度校验可为校验视觉检测装置的拍摄精度,可将视觉检测装置采集到的校验件的尺寸与实际校验件的尺寸进行对比,从而得到视觉精度校验结果,例如在对第一图像进行分析后得到校验件上尺寸校验部的尺寸为10mm,但是实际尺寸校验部的尺寸为9mm,从而通过第一图像中的尺寸校验部实现视觉精度校验,有效实现2D相机、3D相机量具量程内的精度校验,确保量具线性偏移得到校验,同时可以校验2D相机镜头因畸变导致精度误差,实现精度校验。色卡校验部可为比色卡,比色卡可为浅灰、灰色、深灰三个梯度标准色卡,还可为RGB三原色色卡,要求黑白相机配备浅灰、灰色、深灰三个梯度标准色卡,彩色相机配备RGB三原色色卡,用于成像效果的校验。例如在对第一图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,但是实际比色卡的灰度值为60,从而通过第一图像中的比色卡实现成像效果校验。
其中,目标图像为从图校验库中调取的通过正常视觉算法已经经过标定的图像,还可为直接输入的通过正常视觉算法已经经过标定的图像,通过将当前视觉算法对目标图像进行识别,得到识别结果,再将识别结果与通过正常视觉算法已经经过标定的结果进行比较,从而确定当前视觉算法是否正常,
在视觉精度校验结果以及成像效果校验结果均为正常校验结果的情况下,进行视觉算法校验,从而实现视觉检测装置的系统性校验结果。
在本实施例中,还可根据第一图像对应的检测值与标准值,确定视觉检测装置的系统性校验结果。通过检测值与标准值的差异进行比较,实现视觉检测装置的系统性校验,例如在进行视觉精度检测时,检测值可为结构参数的测量值,标准值可为实际检测对象的参数值,从而进行比较,实现视觉精度的校验,在进行成像效果检测时,检测值可为比色卡的灰度值,标准值可为实际检测对象的灰度值,从而进行比较,实现成像效果的校验,在进行视觉算法时,检测值可为通过当前视觉算法对结构参数分析得到的测量值,标准值可为良好视觉算法分析得到的参数值,从而进行比较,实现视觉算法的校验。
本实施例通过检测值与标准值进行比较,得到视觉检测装置的系统性校验结果,从而通过量化的数据实现视觉检测装置的系统性校验结果,提高视觉检测装置的系统性校验的准确性。
在本实施例中,还可根据第二图像确定视觉检测装置的系统性校验结果。
在本实施例中,可通过在校验件上除了设置尺寸校验部的基础上,还设有比色卡,由于尺寸校验部可进行视觉精度的校验,比色卡可进行成像效果的校验,因此,可同时进行视觉精度、成像效果以及视觉算法的校验,从而实现视觉检测装置的系统性校验。
本实施例通过校验件上尺寸校验部进行图像采集,得到视觉精度校验结果,通过校验件上的比色卡进行成像效果的检测,同时进行视觉算法的检测,从而实现视觉检测装置的系统性校验。
可通过检测值与标准值的差异进行比较,实现视觉检测装置的系统性校验,例如在进行视觉精度检测时,检测值可为结构参数的测量值,标准值可为实际检测对象的参数值,从而进行比较,实现视觉精度的校验,在进行成像效果检测时,检测值可为比色卡的灰度值,标准值可为实际检测对象的灰度值,从而进行比较,实现成像效果的校验,在进行视觉算法时,检测值可为通过当前视觉算法对结构参数分析得到的测量值,标准值可为良好视觉算法分析得到的参数值,从而进行比较,实现视觉算法的校验。
本实施例通过结构参数对应的测量值与标准值的比较,得到视觉精度校验结果,以及通过比色卡的灰度值与标准值进行比较,得到成像效果校验结果,从而通过量化的数据实现视觉检测装置的系统性校验,提高系统性校验的准确性。
在具体实现中,根据第一图像对应的检测值与标准值以及第二图像对应的检测值与标准值,确定视觉检测装置的系统性 校验结果。
本实施例通过第一图像中多个尺寸呈梯度变化的尺寸校验部图像的结构参数检测值与标准值进行比较,实现视觉精度的校验的同时,进行视觉算法的校验,并通过第二图像中灰度值呈梯度变化的色卡校验部的检测值与标准值进行比较,实现成效效果校验的同时,进行视觉算法的校验,从而实现视觉检测装置的系统性校验结果。
在本实施例中,可根据结构参数对应的测量值,确定视觉检测装置的视觉精度校验结果。
在本实施例中,结构参数可为尺寸校验部的尺寸、深度以及厚度等,还可包括其他参数,本实施例对此不做限制,根据校验件的结构参数进行比较,由于结构参数值可为具体的数值,从而可更准确地得到测量值与实际值之间的差异,例如以尺寸校验部的尺寸为例进行说明,为了实现视觉精度的检测,通过校验件上的二维尺寸校验部的图像进行分析,得到长为2mm,宽为1mm的尺寸校验部的尺寸,从而直接根据图像中分析出的测量值进行视觉精度校验。
本实施例通过结构参数对应的测量值的比较,得到视觉精度校验结果,从而通过量化的数据实现视觉精度的校验,提高视觉检测的准确性。
为了得到视觉精度校验结果,还可确定结构参数对应的测量值与预设标准值的第一差值;根据第一差值,确定视觉检测装置的视觉精度校验结果。
在本实施例中,预设标准值可为实际检测对象的结构参数的数值,根据结构参数对应的测量值与预设标准值的差值,从而得到图像分析得到的结构参数的测量值与实际检测对象的参数值,例如通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,实际检测对象的长为2.5mm,则图像分析得到的结构参数的测量值与实际检测对象的参数值相差0.5mm,从而得到图像分析得到的结构参数的测量值与实际检测对象的参数值不一致,可见,当前视觉检测装置采集到的图像与实际的检测对象有差异,因此,视觉检测装置的视觉精度异常。
同理,在得到尺寸校验部的长为2mm,实际检测对象的长为2mm,则图像分析得到的结构参数的测量值与实际检测对象的参数值一致,可见,当前视觉检测装置采集到的图像与实际的检测对象的参数值相同,因此,视觉检测装置的视觉精度正常。
本实施例通过结构参数对应的测量值与实际检测对象对应的标准值的差值,得到视觉精度校验结果,从而有效的得到图像分析的结果与实际结果之间的误差,更能准确的得到视觉检测的精度。
在得到结构参数对应的测量值与预设标准值的第一差值之后,根据第一差值与第一参数阈值范围,确定视觉检测装置的视觉精度校验结果。
在本实施例中,第一参数阈值范围为确定差值是否在允许的范围内所定义的,差值在第一参数阈值范围则确定是允许的范围内,差值在第一参数阈值范围外,则确定差值处于不允许的范围内,从而提供一定的允许误差的合理区间,避免造成误判,例如以参数阈值范围为小于0.1mm为例进行说明,通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,实际检测对象的长为2.5mm,则图像分析得到的结构参数的测量值与实际检测对象的参数值相差0.5mm,则超过参数阈值范围,可知,视觉检测装置的视觉精度出现异常。
同理,以参数阈值范围为小于0.1mm为例进行说明,通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,实际检测对象的长为2.03mm,则图像分析得到的结构参数的测量值与实际检测对象的参数值相差0.03mm,未超过参数阈值范围,可知,视觉检测装置的视觉精度未出现异常。
在具体实现中,如图13所示,步骤S801包括:
步骤S805,上位机确定第一图像中的尺寸校验部的结构参数对应的测量值与预设标准值的第一差值。
步骤S806,上位机在第一差值大于等于第一参数阈值范围的情况下,得到视觉检测装置的视觉精度异常的校验结果。步骤S807,上位机在第一差值小于第一参数阈值范围的情况下,得到视觉检测装置的视觉精度正常的校验结果。
在本实施例中,还可根据实际需求对参数阈值范围进行灵活调整,提高精度检测的灵活性。
本实施例通过结构参数对应的测量值与实际检测对象对应的标准值的差值与参数阈值范围进行比较,得到视觉精度校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为检测结果异常,从而提高视觉精度检测的准确性。
根据本申请的一些实施例,可选地,还包括:
步骤S808,上位机根据结构参数对应的公差确定第一参数阈值范围。
在本实施例中,公差为每个结构参数对应的变动量,等于最大极限与最小极限代数差的绝对值,例如对于尺寸来说,以1mm为尺寸参数对应的公差,对于面积来说,以1mm2为尺寸参数对应的公差,由于在进行测量值与参数值进行对比时,如果参数阈值采用固定的公差进行比较,则会出现比对错误,第一参数阈值范围可为小于T/10,T表示结构参数对应的公差,即相机精度校验:|测量值-标准值|<T/10,例如在对结构参数中的尺寸进行时,图像分析得到的结构参数的测量值与实际检测对象的参数值相差0.03mm,则与尺寸参数对应的参数阈值范围为小于0.1mm进行比较,避免与面积参数对应的参数阈值范围为小于1mm2进行比较,从而造成判断失误的情况。
本实施例在得到参数阈值范围之前,通过结构参数对应的确定参数阈值范围,由于不同的结构参数对应的标准也不一样,通过参数对应的公差确定参数阈值范围,使参数阈值范围与结构参数是相适应的,从而提高视觉精度检测的合理性。
根据本申请的一些实施例,如图14所示,可选地,视觉检测方法还包括:
步骤S809,上位机通过目标视觉算法对第一图像进行检测,得到结构参数对应的目标标准值。
步骤S810,上位机确定第一图像中的尺寸校验部的结构参数对应的测量值与目标标准值的第二差值。
步骤S811,上位机在第二差值大于等于第二参数阈值范围的情况下,得到视觉检测装置的视觉算法异常的校验结果。
步骤S812,上位机在第二差值小于第二参数阈值范围的情况下,得到视觉检测装置的视觉算法正常的校验结果。
需要说明的是,上位机可根据结构参数对应的测量值,确定视觉检测装置的第一视觉算法校验结果。
在本实施例中,将结构参数对应的测量值与良好视觉分析算法得到的测量值进行比较,从而实现视觉算法的校验,例如通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,通过良好视觉分析算法校对校验件上的 二维尺寸校验部的图像进行分析得到的测量值1.8mm,从而实现视觉算法的校验。
在通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的测量值与通过良好视觉分析算法校对校验件上的二维尺寸校验部的图像进行分析得到的测量值一致时,则确定当前的视觉算法正常,得到尺寸校验部的测量值与通过良好视觉分析算法校对校验件上的二维尺寸校验部的图像进行分析得到的测量值不一致时,则确定当前的视觉算法异常,从而实现视觉算法的检测。
本实施例通过结构参数对应的测量值除了进行视觉精度检测的同时,还可进行视觉算法的校验,从而实现系统性的视觉校验,提高了产线监测的全面性以及有效性。
上位机还可确定结构参数对应的测量值与目标标准值的第二差值;根据第二差值,确定视觉检测装置的第一视觉算法校验结果。
在本实施例中,目标标准值可为通过良好视觉算法检测得到的测量值,根据结构参数对应的测量值与目标标准值的差值,从而得到图像分析得到的结构参数的测量值与良好视觉算法检测得到的测量值的差异,例如通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,通过良好视觉分析算法校对校验件上的二维尺寸校验部的图像进行分析得到的测量值为2.5mm,则图像分析得到的结构参数的测量值与通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值的参数值相差0.5mm,从而得到图像分析得到的结构参数的测量值与通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值不一致,可见,当前的视觉算法与良好的视觉算法的检测结果出现差异,因此,当前的视觉算法存在异常。
同理,在得到尺寸校验部的长为2mm,通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值为2mm,则图像分析得到的结构参数的测量值与通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值为一致,可见,当前的视觉算法与良好的视觉算法的检测结果相同,因此,当前的视觉算法正常。
本实施例通过结构参数对应的测量值与正常视觉检测算法分析出的结构参数的测量值进行比较,从而得到当前视觉算法的分析结果与正常视觉检测算法检测出的分析结果的差异,因此得到当前视觉算法与正常视觉检测算法的差异,从而实现视觉算法的校验。
在本实施例中,目标视觉算法为已经经过校验的良好的视觉算法,为了便于与当前视觉算法的测量值进行比较,同时通过目标视觉算法对尺寸校验部进行分析,得到结构参数对应的目标标准值,从而实现与当前测量值的比较,例如通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值为2mm,将该测量值为2mm作为目标标准值,从而基于同一分析对象采用不同的视觉算法进行分析,避免采用不同的分析对象进行比较,影响比较结果的准确性。本实施例为了更有效得到当前视觉算法与正常视觉检测算法的差异,通过目标视觉算法对尺寸校验部进行分析,得到结构参数对应的目标标准值,从而可与结构参数对应的测量值进行比较,实现当前视觉算法与正常视觉检测算法对比的标准统一,提高了视觉算法校验的准确性。
在本实施例中,第二参数阈值范围为确定差值是否在允许的范围内所定义的,差值在第二参数阈值范围则确定是允许的范围内,差值在第二参数阈值范围外,则确定差值处于不允许的范围内,从而提供一定的允许误差的合理区间,避免造成误判,第二参数阈值范围可为T/10,T表示检测对象对应的公差,即视觉算法校验:|测量值-标准值|<T/10,例如以参数阈值范围为小于0.1mm为例进行说明,通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,通过良好的视觉算法检测得到的长为2.5mm,则图像分析得到的结构参数的测量值与良好的视觉算法检测得到的参数值相差0.5mm,则超过参数阈值范围,可知,视觉检测装置的视觉算法出现异常。
同理,以参数阈值范围为小于0.1mm为例进行说明,通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的长为2mm,通过良好的视觉算法检测得到的长为2.03mm,则图像分析得到的结构参数的测量值与通过良好的视觉算法检测得到的参数值相差0.03mm,未超过参数阈值范围,可知,视觉检测装置的视觉算法未出现异常。
在具体实现中,还可根据实际需求对参数阈值范围进行灵活调整,提高精度检测的灵活性。
如图15所示的视觉系统校验的流程示意图,S801':将产品移动至校验位,触发相机采集产品图片;S802':将采集的图片传入图像处理分析模块即视觉检测算法;S803':依据视觉检测算法结果输出,设备与设置规则比对,判定产品是否为不良;S804':结果上传制造执行系统(Manufacturing Execution System,MES),制造执行系统依据结果自动记录产品状态信息,设备依据结果执行预设动作。
制造执行系统是一个工业生产管理系统,用于优化和监控从原材料到最终产品的整个制造过程。制造执行系统通过与各种设备、系统和人员交互来协调计划、执行、控制和监控生产活动的各个方面。它通常与企业的其他信息系统,如企业资源计划(Enterprise Resource Planning,ERP)、产品生命周期管理(product lifecycle management,PLM)、供应链管理系统(Supply Chain Management,SCM)等集成,以实现更高效、灵活和可视化的生产管理。
从流程可以看出,在生产过程中,如果第一步采集图片正常,即相机、光源等硬件正常工作,获取图片稳定。这一部分设计有相机精度校验、成像校验,视觉算法这一部分的正常影响到产品是否为不良的判定。可设计算法、判定规格是否变化需要校验。
如图16所示的视觉算法校验的流程示意图,算法校验:S801":算法校验库中图片替代当下相机采集产品图片;S802":将采集的图片传入图像处理分析模块,即视觉检测算法,S803":依据视觉检测算法结果输出,设备与设置规格比对,判定产品是否为不良;S804":将此次检测结果与标准结果进行比对校验,依据是否在标准范围内确定算法、规格是否正常;S805":校验结果上传制造执行系统,设备依据校验结果执行预设动作,S806":依据图库图片数量N,循环遍历执行N次。
从流程可以看出,算法校验图库是人为确定的,其结果是已知的,用已经确认完善的算法、标准规格检测,其结果即标准,那么算法校验时,检测已知结果的产品图片,其经算法、规格处理后,结果应该是一致的,如不一致,则算法是存在问题的,如表1所示的检测数据:
表1

校验过程为:根据检测结果判定,|测量值-标准值|<T/10,依据规格可知T=11-10=1,此时编号1、2、3的图片检测结果处于合理范围内,而编号4的检测结果偏差0.2,不在合理范围,故算法稳定性是NG的,测量系统存在问题。
根据规格校验,原规格10~11,现在规格10.5~11,其中,原规则是建立标准时确定的,现规则是读取当前设备设置的规则,两者不一致,说明设备规格被恶意修改,测量系统存在问题,从而实现视觉算法的校验。
本实施例通过结构参数对应的测量值与正常视觉检测算法对应的标准值的差值与参数阈值范围进行比较,得到视觉算法校验结果,以及通过规格进行比较,进一步实现视觉检测装置的系统性校验,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为视觉算法异常,从而提高视觉算法校验的准确性。
根据本申请的一些实施例,可选地,如图17所示,步骤S802,包括:
步骤S813,上位机确定第二图像中色卡校验部的灰度值与预设灰度值的第三差值。
步骤S814,上位机在第三差值大于等于第三参数阈值范围的情况下,确定视觉检测装置的成像效果异常的检测结果。
步骤S815,上位机在第三差值小于第三参数阈值范围的情况下,确定视觉检测装置的成像效果正常的检测结果。
在本实施例中,灰度值是一种数字图像处理技术的图像表述概念,灰度值是指灰度数字图像的像素的亮度值,表示数字图像颜色的深浅级别。灰度等级分为0到255,其中白色为255,黑色为0。灰度图像可以显示任何颜色的不同深浅,甚至可以是不同亮度上的不同颜色,根据比色卡的灰度值进行比较,由于比色卡的灰度值可为具体的数值,从而可更准确地得到测量值与实际值之间的差异,例如为了实现成像效果的校验,例如在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,从而直接根据图像中分析出的灰度值进行成像效果校验。
本实施例通过比色卡的灰度值,得到成像效果校验结果,从而通过量化的数据实现成像效果的校验,提高成像效果检测的准确性。
在本实施例中,预设灰度值可为实际检测对象的灰度值,对比色卡进行图像分析得到对应的测量值与预设标准值的差值,从而得到图像分析得到的比色卡的测量值与实际检测对象的灰度值,例如在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,实际比色卡相同位置的灰度值为60,则图像分析得到的测量值与实际检测对象的参数值相差10,从而得到图像分析得到当前测量值与实际检测对象的参数值不一致,可见,当前视觉检测装置采集到的图像与实际的检测对象有差异,因此,视觉检测装置的成像效果异常。
同理,在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,实际比色卡相同位置的灰度值为50,则图像分析得到测量值与实际检测对象的参数值一致,可见,当前视觉检测装置采集到的图像与实际的检测对象的参数值相同,因此,视觉检测装置的成像效果正常。
本实施例通过灰度值与实际检测对象对应的灰度值的差值,得到成像效果校验结果,从而有效的得到图像分析的结果与实际结果之间的误差,更能准确的实现成像效果的检测。
在本实施例中,第三参数阈值范围为确定灰度值的差值是否在允许的范围内所定义的,差值在第三参数阈值范围则确定是允许的范围内,差值在第三参数阈值范围外,则确定差值处于不允许的范围内,从而提供一定的允许误差的合理区间,避免造成误判,第三参数阈值范围可为10,即成像效果校验:|测量值-标准值|<10,例如以参数阈值范围为小于6为例进行说明,在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,实际比色卡相同位置的灰度值为60,则图像分析得到的测量值与实际检测对象的参数值相差10,则超过参数阈值范围,可知,视觉检测装置的成像效果出现异常。
同理,以参数阈值范围为小于6为例进行说明,在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,实际比色卡相同位置的灰度值为55,则图像分析得到的测量值与实际检测对象的参数值相差5,未超过参数阈值范围,可知,视觉检测装置的成像效果未出现异常。
在具体实现中,还可根据实际需求对参数阈值范围进行灵活调整,提高精度检测的灵活性。
本实施例通过当前灰度值与实际检测对象对应的标准值的差值与参数阈值范围进行比较,得到成像效果校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为检测结果异常,从而提高成像效果检测的准确性。
根据本申请的一些实施例,可选地,如图18所示,视觉检测方法还包括:
步骤S816,上位机通过目标视觉算法对第二图像进行检测,得到目标灰度值。
步骤S817,上位机确定第二图像中色卡校验部的灰度值与目标灰度值的第四差值。
步骤S818,上位机在第四差值大于等于第四参数阈值范围的情况下,得到视觉检测装置的视觉算法异常的校验结果。
步骤S819,上位机在第四差值小于第四参数阈值范围的情况下,得到视觉检测装置的视觉算法正常的校验结果。
在本实施例中,将通过当前视觉算法分析得到的灰度值与良好视觉分析算法得到的灰度值进行比较,从而实现视觉算法的校验,例如在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,通过良好视觉分析算法校对校验件上比色卡同一位置的灰度值为60,从而实现视觉算法的校验。
在通过校验件上的二维尺寸校验部的图像进行分析,得到尺寸校验部的测量值与通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值一致时,则确定当前的视觉算法正常,得到尺寸校验部的测量值与通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值不一致时,则确定当前的视觉算法异常,从而实现视觉算法的检测。
本实施例通过灰度值除了进行成像效果检测的同时,还可进行视觉算法的校验,从而实现系统性的视觉校验,提高了产线监测的全面性以及有效性。
在本实施例中,目标灰度值可为通过良好视觉算法检测得到的测量值,根据比色卡的灰度值与目标标准值的差值,从而得到图像分析得到的测量值与良好视觉算法检测得到的测量值的差异,例如在对第二图像的比色卡进行分析后得到校验件上比色卡的灰度值为50,通过良好视觉分析算法校对校验件上比色卡同一位置的灰度值为60,则图像分析得到的测量值与通过良好视觉分析算法对校验件上的比色卡的图像进行分析得到的测量值的参数值相差10,从而得到图像分析得到的测量值与通过良好视觉分析算法对校验件上的二维尺寸校验部的图像进行分析得到的测量值不一致,可见,当前的视觉算法与良好的视觉算法的检测结果出现差异,因此,当前的视觉算法存在异常。
同理,在对比色卡进行分析后得到校验件上比色卡的灰度值为50,通过良好视觉分析算法校对校验件上比色卡同一位置的灰度值为50,则图像分析得到的测量值与通过良好视觉分析算法对校验件上比色卡进行分析得到的测量值为一致,可见,当前的视觉算法与良好的视觉算法的检测结果相同,因此,当前的视觉算法正常。
本实施例通过灰度值与正常视觉检测算法分析出的灰度值进行比较,从而得到当前视觉算法的分析结果与正常视觉检测算法检测出的分析结果的差异,因此得到当前视觉算法与正常视觉检测算法的差异,从而实现视觉算法的校验。
在本实施例中,目标视觉算法为已经经过校验的良好的视觉算法,为了便于与当前视觉算法的测量值进行比较,同时通过目标视觉算法对比色卡进行分析,得到比色卡对应的目标标准值,从而实现与当前测量值的比较,例如通过良好视觉分析算法校对校验件上比色卡同一位置的灰度值为50,将该灰度值为50作为目标标准值,从而基于同一分析对象采用不同的视觉算法进行分析,避免采用不同的分析对象进行比较,影响比较结果的准确性。
本实施例为了更有效得到当前视觉算法与正常视觉检测算法的差异,通过目标视觉算法对比色卡进行分析,得到比色卡对应的目标标准值,从而可与当前视觉算法分析得到的灰度值进行比较,实现当前视觉算法与正常视觉检测算法对比的标准统一,提高了视觉算法校验的准确性。
在本实施例中,第四参数阈值范围为确定灰度值的差值是否在允许的范围内所定义的,差值在第四参数阈值范围则确定是允许的范围内,差值在第四参数阈值范围外,则确定差值处于不允许的范围内,从而提供一定的允许误差的合理区间,避免造成误判,第四参数阈值范围可为10,即视觉算法校验:|测量值-标准值|<10,例如以参数阈值范围为小于10为例进行说明,在对比色卡进行分析后得到校验件上比色卡的灰度值为50,通过良好视觉分析算法校对校验件上比色卡同一位置的灰度值为60,则图像分析得到的测量值与良好的视觉算法检测得到的参数值相差10,则超过参数阈值范围,可知,视觉检测装置的视觉算法出现异常。
同理,以参数阈值范围为小于10为例进行说明,在对比色卡进行分析后得到校验件上比色卡的灰度值为50,通过良好视觉分析算法校对校验件上比色卡同一位置的灰度值为55,则图像分析得到的测量值与通过良好的视觉算法检测得到的参数值相差5,未超过参数阈值范围,可知,视觉检测装置的视觉算法未出现异常。
在具体实现中,还可根据实际需求对参数阈值范围进行灵活调整,提高精度检测的灵活性。
本实施例通过当前视觉算法对应的灰度值与正常视觉检测算法对应的标准值的差值与参数阈值范围进行比较,得到视觉算法校验结果,相比较于仅通过差值进行比较,通过给出一定的阈值范围,在超过该范围才认为视觉算法异常,从而提高视觉算法校验的准确性。
根据本申请的一些实施例,可选地,如图19所示,步骤S803之前,还包括:
步骤S820,上位机获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片,其中,第一图片的参数值处于第一范围,第二图片的参数值处于第二范围,第三图片的参数值处于第三范围,第三图片的参数值处于第四范围,第一范围和第二范围不同,第三范围和第四范围不同;根据第一图片、第二图片、第三图片以及第四图片建立图片校验库。在本实施例中,第一图片可为正常图片,第二图片可为正常极限图片,第三图片可为异常图片,第四图片可为异常极限图片,产品图片校验库,需具备NG产品、NG极限样、OK产品、OK极限样,NG产品、NG极限样每一种缺陷不少于3EA,OK品、OK极限样不少于3EA,采用收集生产产生典型缺陷产品图片,或者人为制造典型缺陷,然后采用相机进行拍照存储图片,从而实现校验库的建立。
本实施例通过预先建立的图片校验库进行视觉算法的检测,相比较于直接进行校验结果的比较,校验的效率更高。
在具体实现中,上位机对第一图片、第二图片、第三图片以及第四图片进行编号;根据编号后的第一图片、第二图片、第三图片以及第四图片建立图片校验库。
在本实施例中,将图片进行编号,并用完善的算法进行图片分析,得出结果,设定为标准值,编号的方式可为通过编码标识的方式,还可通过其他方式,本实施例对此不做限制,通过编号的方式,可实现图片的定位和跟踪,便于进行图库管理。
本实施例在建立图片校验库时,对图片样本通过编号的方式进行管理,从而实现图片校验库的有效管理,也不便于后续图片校验库的调整和更新。
根据本申请的一些实施例,可选地,还包括:
步骤S821,上位机采用目标视觉检测算法对样本图像进行评估,得到经过标定参数值的第一图片、第二图片、第三图片以及第四图片。
在本实施例中,对校验库中的图片用完善的算法进行图片分析,得出结果,设定为标准值,例如对应图片A的经过良好的视觉算法分析得到结构参数中的长为5mm,从而便于进行视觉算法的校验。
本实施例通过完善的视觉检测算法预先对采样的图片进行评估,并将评估后的参数值作为后续比对的标准值,实现视觉算法的校验。
根据本申请的一些实施例,可选地,如图20所示,步骤S803,包括:
步骤S818',从图片校验库中选择目标图像。
步骤S819',通过视觉检测装置对目标图像进行图像识别,得到目标图像的参数值。
步骤S820',将参数值与目标图像对应的标定参数值进行比较。
步骤S821',将参数值与目标图像对应的标定参数值的差值超过第五参数阈值范围的情况下,确定视觉算法异常。
在本实施例中,视觉系统完成精度、成像校验结果后,视觉系统执行算法校验。视觉算法遍历算法校验图库,算法分析 后获取校验图片的结果参数。若获取的结果参数与预定的标准参数相同或者位于预定的标准参数的合理误差范围内,说明算法精确性良好,算法校验:|测量值-标准值|<T/10,其中T为检测对象公差。若获取的结果参数与预定的标准参数偏差较大,说明视觉算法存在算法参数、检测规格优化迭代或者人为违规变更等问题导致算法异常,算法处于失效工作状态,算法精确性异常。
根据本申请的一些实施例,如图21所示,提供具体实现方式:
步骤S900,制造执行系统创建校验任务,或设备设置自动校验时间,触发视觉检测装置进行自动校验模式。
步骤S901,视觉检测装置通过与上游工位交互,告知上游工位,停止下料,进入校验模式。
步骤S902,视觉检测装置通过传感器判定校验位是否有料;
步骤S903,有料则进行最后一个产品检测。如无物料,则开始进行校验。
步骤S904,视觉检测装置通过传感器的感知,确认校验位无产品,控制气缸伸出,将校验件移动至待料位。
步骤S905,相机对校验件上的尺寸校验部进行成像分析后获取尺寸校验部的参数,相机精度校验获取凹槽或者凸起的尺寸参数,成像效果校验获取色卡的灰度值。
步骤S906,完成校验件图片获取后,触发控制气缸缩回原位,将校验件移动原位。
步骤S907,将获得的结构参数与预定的结构参数进行比对,若获取的结构参数与预定的结构参数相同或者位于预定的结构参数的合理误差范围内,说明获取的凹槽或凸起结构参数没有发生畸变、镜头没有松动虚焦等,色卡的结构参数没有变异,光源亮度、相机光圈、相机曝光、增益等没有变异,相机的精度和成像质量好,相机与光源处于正常工作状态(相机精度校验:|测量值-标准值|<T/10,成像效果校验:|测量值-标准值|<10,其中T为检测对象公差);若获取的凹槽或凸起结构参数与预定的结构参数之间的偏差较大,说明获取的结构参数发生了畸变、或是镜头松动虚焦等,相机的精度变差,相机处于不正常的工作状态;若获取的色卡的灰度值与预定的灰度值之间的偏差较大,说明光源亮度、相机光圈、相机曝光、增益等产生变异,成像效果差,成像系统(相机、光源)处于异常工作状态,视觉检测装置完成精度、成像校验结果后,视觉检测装置执行算法校验。
步骤S908,视觉算法遍历算法校验图库,算法分析后获取校验图片的结果参数。若获取的结果参数与预定的标准参数相同或者位于预定的标准参数的合理误差范围内,说明算法精确性良好,算法校验:|测量值-标准值|<T/10,其中T为检测对象公差。若获取的结果参数与预定的标准参数偏差较大,说明视觉算法存在算法参数、检测规格优化迭代或者人为违规变更等问题导致算法异常,算法处于失效工作状态,算法精确性异常。
步骤S909,将获得的各项参数和比对结果上传制造执行系统,制造执行系统再次对结构参数进行比对,如任一结果NG,则制造执行系统锁机,杜绝检测系统进行生产。同时设备报警。
步骤S910,工作人员需要依据NG项进行系统排查和调整,及时纠正视觉检测误差。保证视觉检测系统在长时间或调整后依然具有良好的精确性。
步骤S911,视觉检测装置通过与上游工位交互,告知上游工位开始下料并进入生产模式。

Claims (26)

  1. 一种视觉检测系统,其中,所述视觉检测系统包括:
    视觉校验装置,包括校验件以及校验件移动装置,所述校验件移动装置包括活动安装的安装板,在所述安装板的活动行程上,所述安装板能够处在校验位,所述校验位在视觉检测装置的检测范围内,所述校验件设于所述安装板;
    视觉检测装置,用于获得所述校验件的图像,并将所述校验件的图像发送至上位机;
    上位机,用于根据所述校验件的图像确定所述视觉检测装置的系统性校验结果。
  2. 如权利要求1所述的视觉检测系统,其中,所述校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部;
    所述视觉检测装置,还用于获得所述尺寸校验部的第一图像以及所述色卡校验部的第二图像,并将所述第一图像以及所述第二图像发送至上位机;
    所述上位机,还用于根据所述第一图像和/或所述第二图像确定所述视觉检测装置的系统性校验结果。
  3. 如权利要求2所述的视觉检测系统,其中,所述视觉校验装置还包括:
    支撑底座;以及,
    驱动装置,包括相对直线活动的固定部和活动部,所述固定部设于所述支撑底座,所述活动部与所述安装板连接。
  4. 如权利要求3所述的视觉检测系统,其中,所述视觉校验装置还包括滑动导向结构,所述滑动导向结构包括相互滑动配合的滑轨和滑块,所述滑轨和所述滑块设于所述支撑底座与所述安装板之间。
  5. 如权利要求4所述的视觉检测系统,其中,所述视觉校验装置还包括转接座,所述滑轨设置两个,对应所述滑块设置两个;
    其中相互配合的一组所述滑轨和滑块分设于所述支撑底座和所述转接座之间,另一组所述滑轨和滑块分设于所述安装板和所述转接座之间。
  6. 如权利要求1所述的视觉检测系统,其中,所述校验件包括:
    板主体,具有校验面;
    多个尺寸校验部,沿直线方向间隔设于所述校验面上,多个所述尺寸校验部具有处在第一方向上的长度尺寸和处在第二方向上的宽度尺寸,多个所述尺寸校验部的长度尺寸呈梯度变化,和/或,多个所述尺寸校验部的宽度尺寸呈梯度变化,其中,所述第一方向与所述第二方向为水平面内相互垂直的方向。
  7. 如权利要求6所述的视觉检测系统,其中,所述尺寸校验部包括形成在所述板本体上的凸起或者凹槽。
  8. 如权利要求6所述的视觉检测系统,其中,多个所述尺寸校验部沿第三方向上的尺寸呈梯度变化,所述第三方向与所述第一方向和所述第二方向均垂直设置。
  9. 如权利要求6所述的视觉检测系统,其中,还包括设于所述板主体的校验面上的灰度值呈梯度变化的色卡校验部。
  10. 如权利要求6所述的视觉检测系统,其中,所述板主体的材质包括铝合金;和/或,
    所述板主体的校验面的粗糙度小于预设粗糙度阈值。
  11. 一种视觉检测方法,其中,视觉检测系统包括视觉检测装置、视觉校验装置以及上位机,所述视觉校验装置,包括校验件以及校验件移动装置,所述校验件移动装置包括活动安装的安装板,在所述安装板的活动行程上,所述安装板能够处在校验位,所述校验位在视觉检测装置的检测范围内,所述校验件设于所述安装板;
    所述视觉检测方法包括:
    所述视觉检测装置获得所述校验件的图像,并将所述校验件的图像发送至所述上位机;
    所述上位机根据所述校验件的图像确定所述视觉检测装置的系统性校验结果。
  12. 如权利要求11所述的视觉检测方法,其中,所述校验件包括多个尺寸呈梯度变化的尺寸校验部以及灰度值呈梯度变化的色卡校验部,所述视觉检测方法还包括:
    所述视觉检测装置获得所述尺寸校验部的第一图像以及所述色卡校验部的第二图像,并将所述第一图像以及所述第二图像发送至上位机;
    所述上位机根据所述第一图像和/或所述第二图像确定所述视觉检测装置的系统性校验结果。
  13. 如权利要求11所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述上位机在接收到校验指令的情况下,发送校验指令至所述视觉检测装置;
    所述视觉检测装置在接收到校验指令的情况下,通知工位控制器停止输送物料。
  14. 如权利要求13所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述视觉检测装置在检测到校验位上未存有物料的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移动至所述校验位,所述校验位在所述视觉检测装置的检测范围内;
    所述视觉检测装置检测到校验位上存有物料的情况下,继续对所述校验位上的当前物料进行检测,直至目标物料离开所述校验位的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移动至所述校验位。
  15. 如权利要求12所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述视觉检测装置在检测到第一图像和/或第二图像的情况下,通知所述视觉校验装置中的驱动装置将所述校验件移出所述校验位。
  16. 如权利要求11至15任一项所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述上位机在所述系统性校验结果为正常的情况下,通知工位控制器开始输送物料;
    所述上位机在所述系统性校验结果为异常的情况下,通知各检测设备进行停机检测,并进行报警。
  17. 如权利要求12所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果;
    所述上位机根据所述第二图像进行成像效果校验,得到成像效果校验结果;
    所述上位机在所述视觉精度校验结果以及成像效果校验结果均为正常校验结果的情况下,根据目标图像进行视觉算法校验,得到视觉算法校验结果;
    所述上位机根据所述视觉精度校验结果、成像效果校验结果以及视觉算法校验结果确定所述视觉检测装置的系统性校验结果。
  18. 如权利要求17所述的视觉检测方法,其中,所述上位机根据所述第一图像进行视觉精度校验,得到视觉精度校验结果,包括:
    所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与预设标准值的第一差值;
    所述上位机在所述第一差值大于等于第一参数阈值范围的情况下,得到所述视觉检测装置的视觉精度异常的校验结果;
    所述上位机在所述第一差值小于第一参数阈值范围的情况下,得到所述视觉检测装置的视觉精度正常的校验结果。
  19. 如权利要求18所述的视觉检测方法,其中,还包括:
    所述上位机根据所述结构参数对应的公差确定第一参数阈值范围。
  20. 如权利要求18所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述上位机通过目标视觉算法对所述第一图像进行检测,得到结构参数对应的目标标准值;
    所述上位机确定所述第一图像中的所述尺寸校验部的结构参数对应的测量值与目标标准值的第二差值;
    所述上位机在所述第二差值大于等于第二参数阈值范围的情况下,得到所述视觉检测装置的视觉算法异常的校验结果;
    所述上位机在所述第二差值小于第二参数阈值范围的情况下,得到所述视觉检测装置的视觉算法正常的校验结果。
  21. 如权利要求17所述的视觉检测方法,其中,所述上位机根据所述第二图像进行成像效果校验,得到成像效果校验结果,包括:
    所述上位机确定所述第二图像中所述色卡校验部的灰度值与预设灰度值的第三差值;
    所述上位机在所述第三差值大于等于第三参数阈值范围的情况下,确定所述视觉检测装置的成像效果异常的检测结果;
    所述上位机在所述第三差值小于第三参数阈值范围的情况下,确定所述视觉检测装置的成像效果正常的检测结果。
  22. 如权利要求11至21任一项所述的视觉检测方法,其中,所述视觉检测方法还包括:
    所述上位机通过目标视觉算法对所述第二图像进行检测,得到目标灰度值;
    所述上位机确定所述第二图像中所述色卡校验部的灰度值与目标灰度值的第四差值;
    所述上位机在所述第四差值大于等于第四参数阈值范围的情况下,得到所述视觉检测装置的视觉算法异常的校验结果;
    所述上位机在所述第四差值小于第四参数阈值范围的情况下,得到所述视觉检测装置的视觉算法正常的校验结果。
  23. 如权利要求17所述的视觉检测方法,其中,所述上位机根据目标图像进行视觉算法校验,得到视觉算法校验结果之前,还包括:
    所述上位机获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片,其中,所述第一图片的参数值处于第一范围,第二图片的参数值处于第二范围,第三图片的参数值处于第三范围,第三图片的参数值处于第四范围,所述第一范围和第二范围不同,所述第三范围和第四范围不同;
    所述上位机根据所述第一图片、第二图片、第三图片以及第四图片建立图片校验库。
  24. 如权利要求23所述的视觉检测方法,其中,所述上位机根据所述第一图片、第二图片、第三图片以及第四图片建立图片校验库,包括:
    所述上位机对所述第一图片、第二图片、第三图片以及第四图片进行编号;
    所述上位机根据编号后的第一图片、第二图片、第三图片以及第四图片建立图片校验库。
  25. 如权利要求23所述的视觉检测方法,其中,所述上位机获取经过标定参数值的第一图片、第二图片、第三图片以及第四图片之前,还包括:
    所述上位机采用目标视觉检测算法对样本图像进行评估,得到经过标定参数值的第一图片、第二图片、第三图片以及第四图片。
  26. 如权利要求23所述的视觉检测方法,其中,所述上位机根据目标图像进行视觉算法校验,得到视觉算法校验结果,包括:
    所述上位机从所述图片校验库中选择目标图像;
    所述上位机通过所述视觉检测装置对所述目标图像进行图像识别,得到所述目标图像的参数值;
    所述上位机将所述参数值与所述目标图像对应的标定参数值进行比较;
    所述上位机将所述参数值与所述目标图像对应的标定参数值的差值超过第五参数阈值范围的情况下,确定视觉算法异常。
PCT/CN2023/129428 2023-11-02 2023-11-02 视觉检测系统及方法 Pending WO2025091409A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/CN2023/129428 WO2025091409A1 (zh) 2023-11-02 2023-11-02 视觉检测系统及方法
EP23889858.9A EP4579173A4 (en) 2023-11-02 2023-11-02 Visual inspection system and method
CN202380060046.XA CN120265943A (zh) 2023-11-02 2023-11-02 视觉检测系统及方法
US18/433,462 US20250146951A1 (en) 2023-11-02 2024-02-06 Visual inspection system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2023/129428 WO2025091409A1 (zh) 2023-11-02 2023-11-02 视觉检测系统及方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/433,462 Continuation US20250146951A1 (en) 2023-11-02 2024-02-06 Visual inspection system and method

Publications (1)

Publication Number Publication Date
WO2025091409A1 true WO2025091409A1 (zh) 2025-05-08

Family

ID=95562167

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/129428 Pending WO2025091409A1 (zh) 2023-11-02 2023-11-02 视觉检测系统及方法

Country Status (4)

Country Link
US (1) US20250146951A1 (zh)
EP (1) EP4579173A4 (zh)
CN (1) CN120265943A (zh)
WO (1) WO2025091409A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN121568543A (zh) * 2026-01-21 2026-02-24 浙江轩田智能科技有限公司 一种kgd分选机高温转塔至常温转塔转运机构及转运方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07208924A (ja) * 1994-01-11 1995-08-11 Toshiba Corp 視覚認識装置の認識用光学系のキャリブレーション方法
CN115930784A (zh) * 2023-01-09 2023-04-07 广州市易鸿智能装备有限公司 一种视觉检测系统的点检方法
CN115984177A (zh) * 2022-12-01 2023-04-18 五邑大学 机器视觉检测装置及其控制方法、控制装置及存储介质
CN116124006A (zh) * 2023-04-19 2023-05-16 征图新视(江苏)科技股份有限公司 一种电池极片视觉检测系统的自动点检方法
CN116342599A (zh) * 2023-05-29 2023-06-27 宁德时代新能源科技股份有限公司 缺陷检测设备的点检方法、装置、设备和存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2595927B2 (ja) * 1992-07-07 1997-04-02 東洋紡績株式会社 シート状物色差検査装置
US9305366B2 (en) * 2012-08-08 2016-04-05 Jeffrey Stark Portable electronic apparatus, software and method for imaging and interpreting pressure and temperature indicating
JP6353766B2 (ja) * 2014-10-23 2018-07-04 株式会社プレックス 外観検査装置
US10399227B1 (en) * 2019-03-29 2019-09-03 Mujin, Inc. Method and control system for verifying and updating camera calibration for robot control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07208924A (ja) * 1994-01-11 1995-08-11 Toshiba Corp 視覚認識装置の認識用光学系のキャリブレーション方法
CN115984177A (zh) * 2022-12-01 2023-04-18 五邑大学 机器视觉检测装置及其控制方法、控制装置及存储介质
CN115930784A (zh) * 2023-01-09 2023-04-07 广州市易鸿智能装备有限公司 一种视觉检测系统的点检方法
CN116124006A (zh) * 2023-04-19 2023-05-16 征图新视(江苏)科技股份有限公司 一种电池极片视觉检测系统的自动点检方法
CN116342599A (zh) * 2023-05-29 2023-06-27 宁德时代新能源科技股份有限公司 缺陷检测设备的点检方法、装置、设备和存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4579173A4 *

Also Published As

Publication number Publication date
EP4579173A1 (en) 2025-07-02
CN120265943A (zh) 2025-07-04
EP4579173A4 (en) 2025-08-20
US20250146951A1 (en) 2025-05-08

Similar Documents

Publication Publication Date Title
US12001191B2 (en) Automated 360-degree dense point object inspection
US12254617B2 (en) Automated in-line object inspection
Cemenska et al. Automated in-process inspection system for AFP machines
EP3963414A2 (en) Automated 360-degree dense point object inspection
EP3102018B1 (en) Quality management device and method for controlling quality management device
US9743527B2 (en) Stencil programming and inspection using solder paste inspection system
EP3568665A1 (en) Surface height measurement system
CN116428984B (zh) 一种五金模具冲压加工智能检测系统
CN105574845A (zh) 一种多相机阵列烟标叠层数量测量方法及装置
CN118329777A (zh) 裸晶圆表面缺陷的检测方法、装置、终端设备及存储介质
JP2007096153A (ja) はんだペースト印刷システム
CN107110642A (zh) 用于在线视觉检查的参考系统
WO2025091409A1 (zh) 视觉检测系统及方法
Cemenska et al. AFP automated inspection system performance and expectations
CN120777999B (zh) 自动化调试标定系统和方法
KR20220044741A (ko) 웨이퍼 외관 검사 장치 및 방법
CN119438085A (zh) 电池检测系统及电池检测系统的点检方法
KR101991277B1 (ko) 마커를 이용한 자동차 부품 품질 보증 방법 및 장치
JP2012202957A (ja) 欠陥位置情報生成装置、欠陥確認システム及び欠陥位置情報生成方法
TW201522949A (zh) 影像資訊檢測方法
KR20130068737A (ko) 공구 매거진의 공구 상태 확인 장치 및 방법
KR102909092B1 (ko) 설비 진단을 위한 스테이지 마크를 이용한 설비 진단 시스템 및 이를 이용한 설비 진단 방법
KR20160067303A (ko) 실러 도포 품질 검사 장치 및 이를 이용한 실러 도포 품질 검사 방법
Cemenska et al. Automated in-process inspection system for AFP machines
TW202133114A (zh) 尺寸量測裝置及尺寸量測方法

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2023889858

Country of ref document: EP

Effective date: 20240531

WWE Wipo information: entry into national phase

Ref document number: 202380060046.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23889858

Country of ref document: EP

Kind code of ref document: A1

WWP Wipo information: published in national office

Ref document number: 2023889858

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 202380060046.X

Country of ref document: CN