WO2023097647A1 - Ccd相机标定系统、方法、装置、计算设备及存储介质 - Google Patents
Ccd相机标定系统、方法、装置、计算设备及存储介质 Download PDFInfo
- Publication number
- WO2023097647A1 WO2023097647A1 PCT/CN2021/135305 CN2021135305W WO2023097647A1 WO 2023097647 A1 WO2023097647 A1 WO 2023097647A1 CN 2021135305 W CN2021135305 W CN 2021135305W WO 2023097647 A1 WO2023097647 A1 WO 2023097647A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- calibration
- ccd camera
- image
- block
- verification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
- G06T2207/30208—Marker matrix
Definitions
- the present application relates to the technical field of equipment calibration, in particular to a CCD camera calibration system, method, device, computing equipment and storage medium.
- the calibration method for the CCD camera is usually to attach a detection label on the product, and when the product and the detection label move together, the CCD camera photographs the detection label and the product to obtain the CCD The transformation matrix of the camera.
- the embodiment of the present application provides a CCD camera calibration system, method, device, computing equipment and storage medium, which can solve the technical problem of measurement errors in the existing CCD camera calibration methods.
- the embodiment of the present application provides a CCD camera calibration system, and the CCD camera calibration system includes:
- a calibration assembly the calibration assembly is arranged on the transmission mechanism, the calibration assembly is provided with a plurality of calibration pattern units arranged along the length direction, the calibration pattern unit includes a first calibration block, and the first calibration block It includes positioning marks and a plurality of evenly arranged first calibration graphics;
- a CCD camera the CCD camera is used to photograph the calibration component to obtain a first image when the calibration component is running;
- a processing module the processing module is communicatively connected with the CCD camera, and the processing module is used to calculate a transformation matrix of internal and external parameters of the CCD camera according to the first image.
- the calibration component By setting the calibration component to run on the transmission mechanism and shooting the calibration graphics on the calibration component, the calibration of the CCD camera can be realized, and the actual product can be avoided for calibration, thereby avoiding the calibration result being affected by the product size error and improving the quality of the product. Accuracy of calibration results.
- the calibration result includes the included angle of the movement direction of the calibration components, which can overcome the influence of misalignment between the various coordinate systems in the static calibration method.
- the CCD camera calibration system also includes:
- the verification tape is used to replace the calibration component after obtaining the transformation matrix of the internal and external parameters of the CCD camera, and the verification tape is provided with a plurality of stripes distributed at equal intervals.
- the calibration results can be verified by setting a verification belt, which can improve the accuracy of the CCD camera calibration.
- the verification tape is a film sheet with a white base, and the stripes are black stripes.
- the calibration component includes a calibration tape, the calibration tape is a white base, and the color of the first calibration graphic is black.
- the first calibration graphic By setting the base color of the calibration component and the color of the first calibration graphic, the first calibration graphic can be accurately identified and the recognition accuracy of the first calibration graphic can be improved.
- the first calibration figure is a circle.
- the accuracy and reliability of calibration and subsequent measurement can be improved by providing uniformly arranged circular patterns on the calibration component.
- the marking pattern unit further includes a second marking block, and the second marking block is disposed on one side of the first marking block along the width direction of the marking assembly.
- the second calibration block is identified from the image to quickly and roughly locate, and after the second calibration block is identified, the adjacent first calibration block can be identified, thereby realizing the calibration process.
- the marking pattern unit includes a plurality of first marking blocks, and the multiple first marking blocks are arranged along the width direction of the marking assembly;
- the calibration assembly is configured to be separated into a plurality of sub-calibration sub-assemblies after the transmission mechanism is divided into strips, and each sub-calibration sub-assembly includes at least one first calibration block.
- a plurality of first calibration blocks are arranged in the width direction of the calibration assembly, so that after the transmission mechanism slitting the calibration assembly, the CCD camera arranged after the slitting position can also photograph at least one complete first calibration block, In this way, the calibration of the CCD camera after the striping position is realized.
- the embodiment of the present application provides a method for calibrating a CCD camera, the method for calibrating a CCD camera includes:
- the first image is an image obtained by shooting the calibration assembly when the calibration assembly is running on the transmission mechanism at a first operating speed by the CCD camera;
- the calibration coordinate system is based on the position of the positioning mark in the first image Sure;
- the transformation matrix of the internal and external parameters of the CCD camera after obtaining the transformation matrix of the internal and external parameters of the CCD camera according to the distance and the coordinate positions of each feature point in the first image in the calibration coordinate system, it also includes:
- the second image is an image obtained by the CCD camera shooting the verification tape when the calibration component is replaced with a verification tape and the verification tape is running at a second operating speed, and the verification tape A plurality of stripes distributed at equal intervals are arranged on it;
- the transformation matrix of the CCD camera is verified according to the measured spacing and the standard spacing between adjacent stripes.
- the calibration results can be verified by setting a verification belt, which can improve the accuracy of the CCD camera calibration.
- before acquiring the second image it also includes:
- the acquisition of the second image includes:
- the determining the measurement distance between adjacent stripes according to the position of the stripes in the second image and the transformation matrix includes:
- the measurement distance between adjacent stripes is calculated.
- the measurement distance between adjacent stripes in the captured second image can be calculated, and the calibration can be determined by comparing the measurement distance with the actual standard distance The precision of the result.
- the verification of the transformation matrix of the CCD camera according to the measured distance and the standard distance between adjacent stripes includes:
- the calibration pattern unit further includes a second calibration block, and the second calibration block is arranged on one side of the first calibration block along the width direction of the calibration component;
- the first marking block belonging to the same marking pattern unit is located according to the information of the second marking block in the first image.
- the second marking block is a rectangle.
- the second marking block is arranged in a rectangular pattern to facilitate identification.
- the first calibration figure is a circle
- the feature point is the center of the circle
- the first calibration graphic is set as a circle, which can quickly and accurately determine the position of the center of the circle and use it as a feature point. Compared with setting other shapes and fitting feature points, it can improve the accuracy and stability of feature points,
- the embodiment of the present application provides a CCD calibration device, and the CCD calibration device includes:
- the photographing module is used to obtain a first image, and the first image is an image obtained by photographing the calibration assembly when the CCD camera operates on the transmission mechanism at a first operating speed;
- An identification module configured to identify feature points in each of the first calibration figures belonging to the same first calibration block from the first image
- a positioning module configured to determine the coordinate positions of the feature points in each of the first calibration graphics belonging to the same first calibration block in the calibration coordinate system, and the calibration coordinate system is located in the first calibration coordinate system according to the positioning mark a position determination in the image;
- a calculation module configured to determine the distance between two adjacent feature points according to the positions of the feature points in each of the first calibration figures belonging to the same first calibration block;
- the calibration module is configured to obtain a transformation matrix of internal and external parameters of the CCD camera according to the distance and the coordinate positions of each feature point in the first image in the calibration coordinate system.
- an embodiment of the present application provides a computing device, the computing device including: a processor and a memory storing computer program instructions;
- an embodiment of the present application provides a computer storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above-mentioned CCD camera calibration method is implemented.
- the CCD camera calibration system sets the calibration component at the position where the coil is placed on the transmission mechanism, so that the calibration component can run on the conveyor belt of the transmission mechanism and control the calibration component on the transmission mechanism.
- the CCD camera can obtain the first image containing the positioning mark and a plurality of evenly arranged first calibration graphics by photographing the calibration pattern unit on the calibration component, and the transformation of the internal and external parameters of the CCD camera can be calculated according to the first image matrix.
- the transformation matrix of the internal and external parameters of the CCD camera can be obtained according to the first image and the first calibration graphics.
- Fig. 1 is a schematic structural diagram of a CCD camera calibration system provided by an embodiment of the present application
- Fig. 2 is a schematic structural view of the calibration assembly in the embodiment of Fig. 1;
- Fig. 3 is a schematic structural view of the verification tape in the embodiment of Fig. 1;
- Fig. 4 is a schematic flow chart of a CCD camera calibration method provided by an embodiment of the present application.
- FIG. 5 is a schematic flow chart of a CCD camera calibration method provided by another embodiment of the present application.
- FIG. 6 is a schematic flow chart of a CCD camera calibration method provided in another embodiment of the present application.
- Fig. 7 is a schematic flow chart of a CCD camera calibration method provided by another embodiment of the present application.
- Fig. 8 is a schematic flow chart of a CCD camera calibration method provided by another embodiment of the present application.
- Fig. 9 is a schematic flow chart of a CCD camera calibration method provided by another embodiment of the present application.
- FIG. 10 is a fitting curve diagram of distortion parameters of a CCD camera in an embodiment of the present application.
- FIG. 11 is a schematic structural view of a CCD calibration device provided by an embodiment of the present application.
- Fig. 12 is a schematic diagram of a hardware structure of a computing device provided by an embodiment of the present application. ;
- the existing CCD camera calibration method is usually to attach a detection label on the product, and when the product and the detection label move together, the detection label and the product are photographed by the CCD camera to obtain the transformation matrix of the CCD camera.
- the transformation matrix obtained by the CCD camera based on the product and the detection label is prone to measurement errors, resulting in large errors in the calibration results.
- the embodiments of the present application provide a CCD camera calibration system, method, device, computing equipment and storage medium. Firstly, the CCD camera calibration system provided by the embodiment of the present application will be introduced below.
- FIG. 1 shows a schematic structural diagram of a transmission mechanism and a CCD camera in a CCD camera calibration system provided by an embodiment of the present application.
- the CCD camera calibration system includes a transmission mechanism, a calibration component, a CCD camera 20 and a processing module (not shown).
- the calibration component can be disposed on the transmission mechanism.
- the marking assembly is provided with a plurality of marking pattern units 30 arranged along the length direction, and the marking pattern unit 30 includes a first marking block 31, which includes positioning representations and a plurality of uniformly arranged first marking figures 311.
- a transport mechanism may be a device used to transport products.
- the transmission mechanism may be a die-cutting machine or other transmission equipment, and the transmission mechanism is provided with a conveyor belt 10 .
- the calibration assembly can run on the conveyor belt 10 of the transmission mechanism, and the CCD camera 20 can photograph the calibration assembly when the calibration assembly is running on the conveyor belt 10 to obtain a corresponding first image.
- the processing module is connected in communication with the CCD camera 20, and the processing module can obtain the first image after the first image is captured by the CCD camera 20, and calculate the transformation matrix of the internal and external parameters of the CCD camera 20 according to the first image, thereby realizing the CCD camera 20. calibration.
- the processing module After the processing module acquires the first image, it can recognize the calibration pattern unit 30 from the first image, and according to the first calibration block 31 in the calibration pattern unit 30, it can determine the corresponding positioning mark 312 and a plurality of evenly arranged first Calibration graph 311 .
- the processing module can determine the corresponding calibration coordinate system according to the positioning mark 312, and calculate according to the coordinate positions of the multiple first calibration graphics 311 in the calibration coordinate system and the pixels corresponding to the multiple first calibration graphics 311 respectively, so as to obtain the CCD camera 20 transformation matrix of internal and external parameters.
- the calibration assembly can be made to run on the conveyor belt 10 of the transmission mechanism, and the CCD camera 20 can be arranged at a fixed position next to the transmission mechanism, and the fixed area on the transmission mechanism can be monitored.
- Shooting when the calibration component runs to the shooting area of the CCD camera 20 , the CCD camera 20 can shoot the calibration component to obtain a first image including the calibration pattern unit 30 .
- the first image includes a first calibration block 31, and the first calibration block 31 includes a positioning mark 312 and a plurality of first calibration graphics 311, and the positioning mark 312 can represent the running direction of the calibration component and the calibration coordinate system of the first calibration block 31 , the multiple first calibration graphics 311 are evenly arranged according to a preset arrangement.
- the processing module can determine the calibration coordinate system according to the positioning mark 312, and can determine the first image and the calibration coordinate system according to the pixels corresponding to the multiple first calibration graphics 311 in the first image and the coordinate positions originally corresponding to the multiple first calibration graphics 311 Corresponding relationship, so as to calculate the transformation matrix of the internal and external parameters of the CCD camera 20.
- the transformation matrix of the internal and external parameters of the CCD camera 20 can be obtained according to the first image and the preset coordinate position of the first calibration graphics 311, without the need to set the actual parameters on the transmission mechanism.
- the product can realize the calibration of the CCD camera 20, which avoids the influence of the calibration result by the size error of the product, and improves the accuracy of the calibration result.
- a plurality of CCD cameras 20 can be installed at different positions beside the transmission mechanism to photograph and detect different transmission areas on the transmission mechanism.
- Multiple CCD cameras 20 can make the calibration results of the CCD cameras 20 include the included angle of the movement direction of the calibration components by photographing the calibration components running on the transmission mechanism. Compared with the static calibration method, it can also overcome the influence of misalignment between the various coordinate systems under static calibration.
- the marking component may be configured as a band, ie the marking component may comprise a marking band.
- the calibration tape can be set according to the coil material. Specifically, the inner diameter of the calibration tape is consistent with the inner diameter of the actual product coil material of the transmission mechanism, and the length of the calibration component is longer than the transmission mechanism. The length of the tape so that the calibration tape can be placed in the conveyor where the coil is placed and run on the conveyor to cover the entire run of the conveyor.
- the marking tape is provided with a plurality of marking pattern units 30 arranged along the lengthwise direction, when the marking tape runs to cover the transport mechanism, the CCD camera 20 in each different position can be photographed in its shooting area containing at least A complete calibration of the first image of the pattern unit 30 and the calibration of the CCD camera 20 can be achieved, and when multiple cameras are provided, simultaneous calibration of multiple cameras can be achieved.
- the calibration component can also be directly attached to the conveyor belt 10 of the transmission mechanism.
- the CCD camera 20 can take pictures of the calibration components attached to the surface of the conveyor belt 10 .
- the CCD camera 20 is usually a line-scan camera, and when there is a large difference between the installation angle of the line-scan camera and the direction in which the product runs on the transmission mechanism, the processing module can also use each first image in the captured first image. Calibrate the figure 311 to determine the angle between the installation position of the CCD camera 20 and the product running direction of the transmission mechanism, so that when there is a large difference between the installation angle of the CCD camera 20 and the direction of product movement on the transmission mechanism, the calibration of the CCD camera 20 can still be realized .
- the calibration system for the CCD camera 20 may further include a verification tape.
- the verification tape is provided with a plurality of stripes 41 distributed at equal intervals.
- the verification tape can be used to replace the calibration Assemblies, when the verification tape is running on the transmission mechanism, the CCD camera 20 can photograph the stripes 41 on the verification tape, and calculate the measurement of the adjacent stripes 41 by using the calculated transformation matrix of internal and external parameters according to the captured image spacing.
- the standard spacing of adjacent stripes 41 is preset when making the verification tape, it can be determined whether the calculated transformation matrix of internal and external parameters has passed the verification according to the measurement spacing obtained by shooting calculation and the original standard spacing.
- the CCD camera 20 completes the calibration process.
- the transformation matrix of the parameters can calculate the measurement distance of adjacent stripes 41, and compare the measurement distance with the standard distance between the stripes to determine the accuracy of the calibration result of the CCD camera 20, so that the calibration of the CCD camera 20 can be carried out. verify.
- the above-mentioned verification tape may be made of a film with a white base, and the stripes 41 on the verification tape may be black stripes 41 .
- the CCD camera 20 captures the image of the verification tape, it can identify the white base and black stripes 41 in the image, thereby realizing the verification of the calibration process of the CCD camera 20 .
- the base color of the verification tape or the color of the stripes 41 can also be set to other colors, so that the base and the stripes 41 can be clearly identified in the captured image.
- the length of the verification belt can be set to be greater than the length of the passing roller of the transmission mechanism, and the verification belt needs to be attached to the surface of the conveyor belt 10 of the transmission mechanism.
- the above-mentioned marking component can be a white-based marking tape, and the color of the positioning mark 312 and the first marking pattern 311 in the first marking block 31 of the marking pattern unit 30 on the marking component can be set to black.
- setting the base and graphic colors of the marking component to white and black, respectively, can make the base and the first marking block 31 clearly distinguishable in the image captured by the CCD camera 20, so that according to the identified first marking Block 31 implements the calculation of the transformation matrix of the extrinsic and extrinsic parameters of the CCD camera 20 .
- the first calibration pattern may be set as a circle, that is, the calibration pattern unit includes a positioning mark and a plurality of evenly arranged circular patterns.
- each calibration pattern unit 30 on the calibration component can be set to not less than 100mm2, and the shape of the calibration pattern unit 30 can be set as a square or a rectangle.
- the distance between adjacent first calibration patterns 311 may be set to be no less than 0.05mm.
- each marking pattern unit 30 in the above marking assembly may further include a second marking block 32, and the second marking block 32 may be disposed on one side of the first marking block 31 along the width direction of the marking assembly. That is, each marking pattern unit 30 includes a first marking block 31 and a second marking block 32 arranged side by side along the width direction of the marking assembly. The second marking blocks 32 may be arranged in a rectangular pattern. After the first image including the first calibration block 31 and the second calibration block 32 is captured, the direction of the coordinate system can be quickly determined through the second calibration block 32 to achieve a rough positioning of the coordinates. After rough positioning, precise coordinate positioning can be achieved through the positioning marks 312 in the first calibration block 31 , and the transformation matrix of internal and external parameters can be calculated according to the pixel positions of each first calibration graphic 311 in the first calibration block 31 .
- each marking pattern unit 30 in the above-mentioned marking assembly may include a plurality of first marking blocks 31, and the multiple first marking blocks 31 may be arranged along the width direction of the marking assembly.
- the transmission mechanism may slitting the product during operation.
- the transmission mechanism can slitting the calibration assembly, so that After the calibration component is separated into multiple sub-calibration components, each sub-calibration component on each belt of the transmission mechanism contains at least one first calibration block 31 .
- the CCD camera 20 arranged after the striping position of the transmission mechanism can photograph the first calibration block 31 on the sub-calibration assembly, thereby realizing the calibration of the CCD camera 20 after the striping position of the transmission mechanism.
- two first calibration blocks 31 can be arranged along the width direction of the calibration assembly, and the two first calibration blocks 31 can be symmetrical along the axis of the calibration assembly , the distance between the two first calibration blocks 31 can be set to be no less than 20 mm.
- each marking pattern unit 30 may include two first marking blocks 31 and one second marking block 32, two first marking blocks 31 and one second marking block 32
- the marking components can be arranged along the width direction, and the second marking block 32 can be arranged between the two first marking blocks 31 .
- the second calibration block 32 can be separated into two parts, which are respectively located on the two sub-calibration assemblies. That is, the two sub-calibration components may respectively include a complete first calibration block 31 and a part of the second calibration block 32 .
- the processing module can also identify part of the second marking block 32 in the first image , in order to realize the fast positioning of the coordinates.
- the stripes 41 in the above-mentioned verification tape can be arranged as stripes 41 arranged along the width direction.
- the verification tape runs on the transmission mechanism, the verification tape is separated into a plurality of sub-verifications after passing through the slitting position of the transmission mechanism.
- the CCD camera 20 after the striping position of the transmission mechanism can also photograph the stripes 41 on the sub-verification tape, so as to realize the verification process of the CCD camera 20 calibration.
- FIG. 4 shows a schematic flowchart of a calibration method for a CCD camera provided by an embodiment of the present application.
- the CCD camera calibration method is applied to the CCD calibration device, and the CCD camera calibration method includes:
- the CCD calibration device can control the CCD camera to take pictures of the calibration components to obtain the first image. After determining the calibration coordinate system, determine the corresponding position of each feature point in the calibration coordinate system. Since the arrangement of each first calibration pattern in the same first calibration block is preset, the distance between the feature points of each first calibration pattern can also be determined according to the corresponding first calibration pattern. According to the positions of the feature points in each first calibration graph, the distance between every two adjacent feature points can be determined. In the captured first image, according to the coordinate position of the pixel corresponding to each first calibration figure in the calibration coordinate system, the coordinate position of the pixel corresponding to each feature point in the calibration coordinate system can be determined, thereby calculating each feature point The distance between pixels.
- the transformation matrix of the internal and external parameters of the CCD camera can be calculated.
- the transformation matrix of the internal and external parameters of the CCD camera can be obtained according to the first image and the preset coordinate position of the first calibration graphics.
- the calibration component may be set on the transmission mechanism, and run at a first running speed on the belt of the transmission mechanism.
- the device can control the CCD camera to shoot the calibration component when the calibration component is running, so as to obtain the first image.
- the first image captured by the CCD camera includes at least one first marking block, and each first marking block on the marking assembly includes a positioning mark and a plurality of first marking figures.
- the device may identify each first calibration pattern in the same first calibration block from the first image, and determine its corresponding feature point according to each first calibration pattern.
- the first calibration figure can be polygon, circle, ring, ellipse and so on.
- the corresponding feature points can be the center of gravity, circumcenter, orthocenter, center and side center of the triangle; when the first calibration figure is a circle, the corresponding feature points can be the center of the circle .
- the positioning mark can be a triangular pattern, and the device can locate the direction of the calibration coordinate system according to the pattern corresponding to the positioning mark in the first image.
- the device after the device determines the feature points corresponding to each first calibration pattern in the same first calibration block, it can determine the calibration in the first image according to the position of the positioning mark in the first calibration block in the first image. Coordinate System. After determining the calibration coordinate system, the device may determine the coordinate position of each feature point in the calibration coordinate system according to the corresponding pixel of each feature point in the first image. Wherein, the coordinate position of the feature point in the calibration coordinate system refers to the pixel coordinate of the feature point.
- the device may determine the distance between every two adjacent feature points after determining the coordinate positions of the feature points in the calibration coordinate system in each of the first calibration graphics belonging to the same first calibration block.
- multiple first calibration figures in the same first calibration block are preset, and after determining the coordinate position of each first calibration figure in the calibration coordinate system, any The spacing between the two first calibration graphics. For example, if a plurality of first calibration figures are arranged in an M*N array in the same first calibration block, two adjacent first calibration figures are determined according to the coordinate position of each first calibration figure in the calibration coordinate system. When the calibration graphics are located in the same row, the distance between two adjacent first calibration graphics can be determined as the column spacing. When it is determined that the two adjacent first calibration patterns are located in the same column, the distance between the two adjacent first calibration patterns can be determined as the row spacing.
- the device may determine the distance between two adjacent feature points according to the positions of the feature points in the first calibration graphics. For example, when the first calibration figure is a circle and the feature point is the center of the circle, for two adjacent circles in the same row, the distance between the two circle centers is the distance between the two circles and the distance between the two circles sum of radii.
- the device can determine the pixel distance between each feature point according to the corresponding pixel coordinates in the feature point calibration coordinate system . According to the arrangement of each first calibration graphic, the distance between each feature point can be determined. According to the spacing between each feature point and the pixel distance between each feature point, the transformation matrix of the internal and external parameters of the CCD camera can be calculated.
- the second image is an image obtained by shooting the verification tape by the CCD camera when the calibration component is replaced with a verification tape and the verification tape is running at a second operating speed, the
- the verification belt is provided with a plurality of stripes distributed at equal intervals;
- the device when the calibration component is running on the transmission mechanism at the first speed, the device can control the CCD camera to take pictures of the calibration component, and calculate the transformation matrix of the internal and external parameters of the CCD camera according to the first captured image.
- the calibration component on the transmission mechanism can be replaced with a verification tape, and when the verification tape is running on the transmission mechanism at the second operating speed, the CCD camera is controlled to photograph the verification tape, and The verification is carried out according to the second image taken to verify whether the transformation matrix of the CCD camera meets the accuracy requirement.
- the calibration component can be replaced with a verification tape, and a plurality of stripes distributed at equal intervals can be arranged on the verification tape.
- the device can control the CCD camera to photograph the verification tape to obtain a second image.
- the first running speed and the second running speed can be set to be the same, that is, the running speed of the calibration component and the verification tape on the transmission mechanism is the same In order to avoid pixel errors in the captured first image and the second image caused by the different running speeds of the calibration component and the verification belt on the transmission mechanism.
- the first running speed and the second running speed can be set to 3m/min.
- the apparatus may identify each stripe from the second image, and determine the corresponding pixel position of each stripe in the second image.
- the pixel distance between two adjacent stripes can be determined according to the pixel positions of two adjacent stripes. Through the transformation matrix obtained in the above calibration process and the pixel distance between two adjacent stripes, it can be calculated The measured spacing between two adjacent stripes.
- the device can directly obtain the standard interval, and compare the standard interval with the measured interval, To verify whether the transformation matrix of the internal and external parameters of the CCD camera meets the accuracy requirements.
- the above S520 may include:
- the device can determine the coordinate position of the pixel of each stripe in the calibration coordinate system according to the position of the stripe in the second image, and can determine the pixel distance between adjacent stripes according to the coordinate position of the pixel of each stripe, That is, the number of pixels, through the transformation matrix obtained by the above-mentioned CCD camera shooting calibration component, the pixel distance between adjacent stripes can be converted into the measurement distance between adjacent stripes.
- the device may determine the coordinate position of the pixel of each stripe in the calibration coordinate system according to the position of each stripe in the second image.
- the coordinate position is the pixel coordinate corresponding to each stripe.
- the device may determine the pixel distance between adjacent stripes according to the pixel coordinates corresponding to each stripe. It can be understood that the pixel distance between adjacent stripes may be the pixel distance between two adjacent sides of two stripes. The device may also determine the stripe feature points corresponding to each stripe, and the pixel distance between adjacent stripes may also be the pixel distance between two adjacent stripe feature points. After determining the pixel distance between adjacent stripes, according to the transformation matrix of the CCD camera, the measurement distance between adjacent stripes can be calculated according to the pixel distance between adjacent stripes.
- the above S530 may include:
- the device can obtain the calibration error according to the standard spacing and measurement spacing of adjacent stripes, and can verify the transformation matrix obtained by this calibration according to the calibration error and the preset error threshold. If the transformation matrix passes the verification, the calibration process is ended and the transformation matrix is stored. If the transformation matrix fails to pass the verification, a verification failure message will be sent to the user, and the CCD camera will be calibrated again. By setting the verification belt for secondary verification, the transformation matrix obtained by the calibration of the CCD camera can meet the accuracy requirements.
- the device After the device acquires the measured spacing and the standard spacing between each adjacent stripe, it can calculate the calibration error corresponding to each adjacent stripe.
- the calibration error may be the difference between the standard distance and the measured distance.
- the device may compare each calibration error with a preset error threshold, and determine whether each calibration error is greater than the preset error threshold.
- the device sequentially compares the multiple calibration errors with the preset error threshold, it can count each time a calibration error is determined to be greater than the preset error threshold, so as to count the number of calibration errors greater than the preset error threshold .
- the count value reaches the preset verification threshold, it means that the transformation matrix has large errors in multiple different positions, and the product cannot be calibrated accurately, and the device can determine that the transformation matrix calculated during the calibration process has not passed the verification.
- the device can confirm that the transformation matrix calculated in this calibration process has passed the verification.
- the device may also judge whether the transformation matrix passes the verification according to the number of calibration errors that are continuously greater than a preset error threshold. For example, when multiple consecutive calibration errors are greater than the preset error threshold, it may be determined whether the consecutive numbers reach the preset verification threshold. For example, when the preset error threshold is 0.05, it can be determined whether there are at least 4 consecutive calibration errors greater than the preset error threshold, and if there are at least 4 consecutive calibration errors greater than 0.05, it can be determined that the transformation matrix has not passed the verification.
- the above S510 may include:
- the device after the device captures the calibration component with the CCD camera and calculates the transformation matrix of the CCD camera, it can also calculate and generate the distortion parameter fitting curve of the CCD camera according to each feature point in the first image, and judge the distortion Fitting accuracy of the parametric fitted curve.
- the calibration component is replaced with a verification tape and a second image is taken for verification. If the fitting accuracy of the distortion parameter fitting curve does not meet the preset requirements, there is no need to replace the calibration component with a verification tape, and it can be directly determined that the transformation matrix does not meet the calibration accuracy requirements.
- the calibration component can be reset on the transmission mechanism, and the first image can be taken again for calibration. Before verification through the verification tape, the transformation matrix can be screened directly according to the fitting accuracy of the CCD camera distortion parameter fitting curve. Calibration accuracy requirements do not require an additional verification belt for verification, thereby reducing the number of verifications and improving verification efficiency.
- the device After the device determines the coordinate position of each feature point in the calibration coordinate system, it can determine the pixel coordinates corresponding to each feature point. Since the CCD camera is a line scan camera, different positions of the line scan camera correspond to different distortion parameters. According to the pixel coordinates corresponding to each feature point and the pixel distance between adjacent feature points, the distortion parameters corresponding to each position of the line scan camera can be determined.
- the device can generate multiple samples according to the distortion parameters corresponding to different positions in the CCD camera, and perform curve fitting according to the multiple samples to obtain the fitting curve between the position and the distortion parameters, which is the CCD camera's Distortion parameter fit curve.
- the fitting accuracy of the distortion parameter fitting curve can be determined according to the coordinate positions of each feature point in the calibration coordinate system in the first image and the distortion parameter fitting curve.
- the goodness of fit can be used to characterize the fitting accuracy of the distortion parameter fitting curve.
- the goodness-of-fit statistic is the coefficient of determination of the distortion parameter fitting curve.
- x1, x2, ... xn are coordinates of different positions of the CCD camera, respectively, and y1, y2, ... yn are distortion parameters corresponding to coordinates of different positions.
- the distortion parameter fitting curve of the CCD camera is obtained by curve fitting.
- the corresponding fitting prediction distortion parameter values are:
- the coefficient of determination of the distortion parameter fitting curve can be calculated according to the distortion parameter fitting curve and samples corresponding to each feature point.
- the fitting accuracy of the distortion parameter fitting curve can be compared with the preset accuracy threshold, and when the fitting accuracy reaches the preset accuracy threshold, it can be determined that The fitting degree of the distortion parameter fitting curve is relatively high, and the calibration component is replaced with a verification tape to carry out the verification process of CCD camera calibration.
- the preset accuracy threshold can be set to 0.95. After calculating the coefficient of determination of the distortion parameter fitting curve, it can be judged whether the coefficient of determination is greater than Preset accuracy threshold. When the coefficient of determination reaches a preset accuracy threshold, the calibration component can be replaced with a verification tape and the transformation matrix can be verified. If the coefficient of determination is less than the preset accuracy threshold, the verification process is not performed, and the CCD camera is re-calibrated.
- the distortion parameter fitting curve of the CCD camera can be generated according to the distortion parameter fitting of each position in each CCD camera, and the fitting accuracy can be calculated according to the fitting parameter fitting curve .
- two CCD cameras are selected from multiple CCD cameras, and the fitting accuracy of the distortion parameter fitting curves of the two CCD cameras are respectively calculated to be 0.9836 and 0.9683.
- the preset accuracy threshold is set to 0.95, the fitting accuracy of the distortion parameter fitting curves corresponding to the two CCD cameras is greater than the preset accuracy threshold, then it can be determined that the distortion parameter fitting curves of the two CCD cameras meet the accuracy requirements , you can further set the verification belt and take pictures of the verification belt through the CCD camera for verification.
- the above-mentioned calibration pattern unit may also include a second calibration block, and the second calibration block is arranged on the first calibration block along the width direction of the calibration assembly.
- One side; before S420, may also include:
- the device can quickly recognize the pattern of the second calibration block from the first image, and quickly determine the direction of the calibration coordinate system according to the pattern, so as to realize the rough positioning of the coordinates .
- the second calibration block can be set as a rectangular pattern, and the color of the pattern can be set as black. Compared with the first calibration block including positioning marks and multiple first calibration graphics, the device can more quickly identify the first calibration block from the first image. Two calibration blocks, so as to achieve fast and rough positioning.
- multiple positions next to the transmission mechanism can be respectively provided with multiple CCD cameras.
- the transmission mechanism can be controlled to stop running. At this time, the images captured by each CCD camera can be viewed separately, and it can be judged that the CCD has captured the image. Whether the image contains a complete calibration pattern unit, and whether the image captured by the CCD can identify the substrate and the first calibration block. For example, the device can pre-set the grayscale difference range between the base and the first calibration block.
- the device can identify the substrate and the first calibration block from the image, thereby realizing the calibration of the CCD camera. If the difference between the grayscale of the base and the grayscale of the first calibration block in the captured image is too small, it is necessary to adjust the base color of the calibration component or the pattern color of the first calibration block so that the grayscale of the base is consistent with the first calibration block.
- the difference between the gray levels satisfies the gray level difference range.
- the grayscale difference range may be set such that the difference between the grayscale of the base and the grayscale of the first calibration block is greater than 30, and the grayscale of the first calibration block is lower than the grayscale of the base.
- the present application also provides a specific implementation of a CCD calibration device. See the examples below.
- the CCD calibration device 1100 provided in the embodiment of the present application includes the following modules:
- An identification module 1102 configured to identify feature points in each of the first calibration graphics belonging to the same first calibration block from the first image
- the positioning module 1103 is configured to determine the coordinate positions of the feature points in each of the first calibration graphics belonging to the same first calibration block in the calibration coordinate system, and the calibration coordinate system is based on the positioning mark in the position determination in the first image;
- a calculation module 1104 configured to determine the distance between two adjacent feature points according to the positions of the feature points in each of the first calibration figures belonging to the same first calibration block;
- the calibration module 1105 is configured to obtain a transformation matrix of internal and external parameters of the CCD camera according to the distance and the coordinate positions of each feature point in the first image in the calibration coordinate system.
- the device can control the CCD camera to shoot the calibration components to obtain the first image, the device can identify the feature points of each first calibration pattern in the same first calibration block, and based on the same first calibration block in the After the positioning mark determines the calibration coordinate system, determine the corresponding position of each feature point in the calibration coordinate system. Since the distance between each first calibration pattern in the same first calibration block is preset, the distance between the feature points of each first calibration pattern can also be predetermined. According to the positions of the feature points in each first calibration graph, the distance between every two adjacent feature points can be determined.
- the coordinate position of the pixel corresponding to each feature point in the calibration coordinate system can be determined, thereby calculating each feature point The distance between pixels.
- the transformation matrix of the internal and external parameters of the CCD camera can be calculated.
- the above-mentioned CCD calibration device 1100 may also include:
- the second shooting module is used to acquire a second image, and the second image is obtained by photographing the verification tape by the CCD camera when the calibration component is replaced with a verification tape and the verification tape is running at a second speed.
- the image of the verification tape is provided with a plurality of stripes distributed at equal intervals;
- the second calculation module is used to determine the measurement distance between adjacent stripes according to the position of the stripes in the second image and the transformation matrix
- the verification module is configured to verify the transformation matrix of the CCD camera according to the measured distance and the standard distance between adjacent stripes.
- the above-mentioned second calculation module may also include:
- a coordinate unit configured to determine the coordinate position of the pixel of each stripe in the calibration coordinate system according to the position of the stripe in the second image
- the calculation unit is configured to calculate the measurement distance between adjacent stripes according to the coordinate positions of the pixels of each stripe in the calibration coordinate system and the transformation matrix.
- the above verification module may also include:
- the error unit is used to calculate and obtain the calibration error according to the standard distance between adjacent stripes and the measurement distance;
- a comparison unit configured to compare each calibration error with a preset error threshold
- a verification unit configured to determine that the transformation matrix fails the verification when the number of calibration errors greater than a preset error threshold among the calibration errors reaches a preset verification threshold.
- the CCD calibration device 1100 may also include:
- a fitting module configured to calculate and obtain a distortion parameter fitting curve of the CCD camera according to the coordinate positions of each feature point in the first image in the calibration coordinate system;
- the accuracy module is used to determine the fitting accuracy of the distortion parameter fitting curve according to the coordinate position of each feature point in the calibration coordinate system in the first image and the distortion parameter fitting curve;
- the above-mentioned second shooting module is further configured to acquire a second image when the fitting accuracy reaches a preset accuracy threshold.
- the above-mentioned calibration pattern unit may also include a second calibration block, the second calibration block is arranged on one side of the first calibration block along the width direction of the calibration assembly,
- the identification module 1102 is further configured to locate the first marking block belonging to the same marking pattern unit according to the information of the second marking block in the first image.
- the CCD calibration device 1000 provided in the embodiment of the present application can realize each step in the method embodiment shown in FIG. 4 to FIG. 9 , which will not be repeated here to avoid repetition.
- FIG. 12 shows a schematic diagram of a hardware structure of a computing device provided by an embodiment of the present application.
- the computing device may include a processor 1201 and a memory 1202 storing computer program instructions.
- the processor 1201 may include a central processing unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits in the embodiments of the present application.
- CPU central processing unit
- ASIC Application Specific Integrated Circuit
- Memory 1202 may include mass storage for data or instructions.
- memory 1202 may include a hard disk drive (Hard Disk Drive, HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (Universal Serial Bus, USB) drive or two or more Combinations of multiple of the above.
- Storage 1202 may include removable or non-removable (or fixed) media, where appropriate. Under appropriate circumstances, the storage 1202 can be inside or outside the comprehensive gateway disaster recovery device.
- memory 1202 is a non-volatile solid-state memory.
- Memory may include read only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices.
- ROM read only memory
- RAM random access memory
- magnetic disk storage media devices magnetic disk storage media devices
- optical storage media devices flash memory devices
- electrical, optical, or other physical/tangible memory storage devices include one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions, and when the software is executed (e.g., by one or multiple processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.
- the processor 1201 reads and executes the computer program instructions stored in the memory 1202 to implement any one of the CCD camera calibration methods in the above-mentioned embodiments.
- the computing device may also include a communication interface 1203 and a bus 1210 .
- a communication interface 1203 and a bus 1210 .
- a processor 1201 a memory 1202 , and a communication interface 1203 are connected through a bus 1210 to complete mutual communication.
- the communication interface 1203 is mainly used to realize the communication between various modules, devices, units and/or devices in the embodiments of the present application.
- Bus 1210 includes hardware, software, or both, and couples the components of the computing device to each other.
- the bus may include Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), HyperTransport (HT) interconnect, Industry Standard Architecture (ISA) Bus, Infiniband Interconnect, Low Pin Count (LPC) Bus, Memory Bus, Micro Channel Architecture (MCA) Bus, Peripheral Component Interconnect (PCI) Bus, PCI-Express (PCI-X) Bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or a combination of two or more of these.
- Bus 1210 may comprise one or more buses, where appropriate. Although the embodiments of this application describe and illustrate a particular bus, this application contemplates any suitable bus or interconnect.
- the computing device can be based on the above-mentioned embodiments, so as to implement the CCD camera calibration method and device described in conjunction with FIGS. 1 to 6 .
- the embodiments of the present application may provide a computer storage medium for implementation.
- Computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by the processor, any one of the CCD camera calibration methods in the above-mentioned embodiments can be achieved, and the same technical effect can be achieved.
- the above-mentioned computer-readable storage medium may include a non-transitory computer-readable storage medium, such as a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk. etc., are not limited here.
- the functional blocks shown in the above structural block diagrams may be implemented as hardware, software, firmware or a combination thereof.
- it When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like.
- ASIC application specific integrated circuit
- the elements of the present application are the programs or code segments employed to perform the required tasks.
- Programs or code segments can be stored in machine-readable media, or transmitted over transmission media or communication links by data signals carried in carrier waves.
- "Machine-readable medium" may include any medium that can store or transmit information.
- machine-readable media examples include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, and the like.
- Code segments may be downloaded via a computer network such as the Internet, an Intranet, or the like.
- processors may be, but are not limited to, general purpose processors, special purpose processors, application specific processors, or field programmable logic circuits. It can also be understood that each block in the block diagrams and/or flowcharts and combinations of blocks in the block diagrams and/or flowcharts can also be realized by dedicated hardware for performing specified functions or actions, or can be implemented by dedicated hardware and Combination of computer instructions to achieve.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Closed-Circuit Television Systems (AREA)
- Studio Devices (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (18)
- 一种CCD相机标定系统,其特征在于,所述CCD相机标定系统包括:传输机构;标定组件,所述标定组件设置于所述传输机构上,所述标定组件上设置有多个沿长度方向排列的标定图案单元,所述标定图案单元包括第一标定块,所述第一标定块内包括定位标识以及多个均匀排布的第一标定图形;CCD相机,所述CCD相机用于在所述标定组件运行时拍摄所述标定组件得到第一图像;处理模块,所述处理模块与所述CCD相机通信连接,所述处理模块用于根据所述第一图像计算得到所述CCD相机内外参数的变换矩阵。
- 根据权利要求1所述的CCD相机标定系统,其特征在于,所述CCD相机标定系统还包括:验证带,用于在得到所述CCD相机内外参数的变换矩阵之后,替换所述标定组件,所述验证带上设置有等间距分布的多个条纹。
- 根据权利要求2所述的CCD相机标定系统,其特征在于,所述验证带为白色基底的菲林片,所述条纹为黑色条纹。
- 根据权利要求1所述的CCD相机标定系统,其特征在于,所述标定组件包括标定带,所述标定带为白色基底,所述第一标定图形的颜色为黑色。
- 根据权利要求4所述的CCD相机标定系统,其特征在于,所述第一标定图形为圆形。
- 根据权利要求1所述的CCD相机标定系统,其特征在于,所述标定图案单元还包括第二标定块,所述第二标定块设置于所述第一标定块沿所述标定组件的幅宽方向的一侧。
- 根据权利要求1所述的CCD相机标定系统,其特征在于,所述标定图案单元包括多个第一标定块,所述多个第一标定块沿所述标定组件的幅宽方向排列;所述标定组件,用于在所述传输机构分条后,分离为多个子标定组件,且各个子标定组件包括至少一个第一标定块。
- 一种CCD相机标定方法,其特征在于,所述方法包括:获取第一图像,所述第一图像是CCD相机在标定组件以第一运行速率在传输机构上运行时,拍摄所述标定组件得到的图像;从所述第一图像中识别属于同一个所述第一标定块的各个所述第一标定图形中的特征点;确定属于同一个所述第一标定块的各个所述第一标定图形中的特征点在标定坐标系中的坐标位置,所述标定坐标系根据所述定位标识在所述第一图像中的位置确定;根据属于同一个所述第一标定块的各个所述第一标定图形中的特征点的位置,确定相邻两个所述特征点之间的间距;根据所述间距以及所述第一图像中各个特征点在标定坐标系中的坐标位置,得到所述CCD相机内外参数的变换矩阵。
- 根据权利要求8所述的CCD相机标定方法,其特征在于,所述根据所述间距以及所述第一图像中各个特征点在标定坐标系中的坐标位置,得到所述CCD相机内外参数的变换矩阵之后,还包括:获取第二图像,所述第二图像是在所述标定组件替换为验证带,所述验证带以第二运行速率运行时,所述CCD相机拍摄所述验证带得到的图像,所述验证带上设置有等间距分布的多个条纹;根据所述条纹在所述第二图像中的位置以及所述变换矩阵,确定相邻的条纹之间的测量间距;根据所述测量间距以及相邻的条纹之间的标准间距,验证所述CCD相机的变换矩阵。
- 根据权利要求9所述的CCD相机标定方法,其特征在于,所述获取第二图像之前,还包括:根据所述第一图像中各个特征点在标定坐标系中的坐标位置,计算得到所述CCD相机的畸变参数拟合曲线;根据所述第一图像中各个特征点在标定坐标系中的坐标位置以及所述畸变参数拟合曲线确定所述畸变参数拟合曲线的拟合精度;所述获取第二图像,包括:在所述拟合精度达到预设精度阈值时,获取第二图像。
- 根据权利要求9所述的CCD相机标定方法,其特征在于,所述根据所述条纹在所述第二图像中的位置以及所述变换矩阵,确定相邻的条纹之间的测量间距,包括:根据所述条纹在所述第二图像中的位置,确定各个条纹的像素在所述标定坐标系中的坐标位置;根据各个条纹的像素在所述标定坐标系中的坐标位置以及所述变换矩阵,计算得到相邻的条纹之间的测量间距。
- 根据权利要求9所述的CCD相机标定方法,其特征在于,所述根据所述测量间距以及相邻的条纹之间的标准间距,验证所述CCD相机的变换矩阵,包括:根据相邻的条纹之间的标准间距以及测量间距计算得到标定误差;将各个标定误差与预设误差阈值进行比较;在各个标定误差中大于预设误差阈值的标定误差数量达到预设验证阈值时,确定所述变换矩阵未通过验证。
- 根据权利要求8所述的CCD相机标定方法,其特征在于,所述标定图案单元还包括第二标定块,所述第二标定块设置于所述第一标定块沿所述标定组件的幅宽方向的一侧;所述从所述第一图像中识别属于同一个所述第一标定块的各个所述第一标定图形中的特征点之前,还包括:根据所述第二标定块在所述第一图像中的信息,定位属于同一个所述标定图案单元的第一标定块。
- 根据权利要求13所述的CCD相机标定方法,其特征在于,所述第二标定块为矩形。
- 根据权利要求8所述的CCD相机标定方法,其特征在于,所述第一标定图形为圆形,所述特征点为圆心。
- 一种CCD标定装置,其特征在于,所述CCD标定装置包括:拍摄模块,用于获取第一图像,所述第一图像是CCD相机在标定组件以第一运行速率在传输机构上运行时,拍摄所述标定组件得到的图像;识别模块,用于从所述第一图像中识别属于同一个所述第一标定块的各个所述第一标定图形中的特征点;定位模块,用于确定属于同一个所述第一标定块的各个所述第一标定图形中的特征点在标定坐标系中的坐标位置,所述标定坐标系根据所述定位标识在所述第一图像中的位置确定;计算模块,用于根据属于同一个所述第一标定块的各个所述第一标定图形中的特征点的位置,确定相邻两个所述特征点之间的间距;标定模块,用于根据所述间距以及所述第一图像中各个特征点在标定坐标系中的坐标位置,得到所述CCD相机内外参数的变换矩阵。
- 一种计算设备,其特征在于,所述设备包括:处理器以及存储有计算机程序指令的存储器;所述处理器执行所述计算机程序指令时实现如权利要求8-15中任一项所述的CCD相机标定方法。
- 一种计算机存储介质,其特征在于,所述计算机存储介质上存储有计算机程序指令,所述计算机程序指令被处理器执行时实现如权利要求8-15中任一项所述的CCD相机标定方法。
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202180096855.7A CN117157670B (zh) | 2021-12-03 | 2021-12-03 | Ccd相机标定系统、方法、装置、计算设备及存储介质 |
| EP21966074.3A EP4296952A4 (en) | 2021-12-03 | 2021-12-03 | Ccd camera calibration system, method and apparatus, computing device, and storage medium |
| JP2023555177A JP7653536B2 (ja) | 2021-12-03 | 2021-12-03 | Ccdカメラキャリブレーションシステム、方法、装置、コンピューティングデバイス及び記憶媒体 |
| KR1020237030659A KR20230144591A (ko) | 2021-12-03 | 2021-12-03 | Ccd 카메라 캘리브레이션 시스템, 방법, 장치, 컴퓨팅 디바이스 및 저장 매체 |
| PCT/CN2021/135305 WO2023097647A1 (zh) | 2021-12-03 | 2021-12-03 | Ccd相机标定系统、方法、装置、计算设备及存储介质 |
| US18/412,624 US20240153141A1 (en) | 2021-12-03 | 2024-01-15 | Ccd camera calibration system, method, computing device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2021/135305 WO2023097647A1 (zh) | 2021-12-03 | 2021-12-03 | Ccd相机标定系统、方法、装置、计算设备及存储介质 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/412,624 Continuation US20240153141A1 (en) | 2021-12-03 | 2024-01-15 | Ccd camera calibration system, method, computing device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023097647A1 true WO2023097647A1 (zh) | 2023-06-08 |
Family
ID=86611336
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/135305 Ceased WO2023097647A1 (zh) | 2021-12-03 | 2021-12-03 | Ccd相机标定系统、方法、装置、计算设备及存储介质 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20240153141A1 (zh) |
| EP (1) | EP4296952A4 (zh) |
| JP (1) | JP7653536B2 (zh) |
| KR (1) | KR20230144591A (zh) |
| CN (1) | CN117157670B (zh) |
| WO (1) | WO2023097647A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116527875A (zh) * | 2023-06-30 | 2023-08-01 | 钛玛科(北京)工业科技有限公司 | 线阵相机调试指示器及调试方法 |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4350278B1 (en) * | 2022-08-17 | 2025-03-05 | Contemporary Amperex Technology (Hong Kong) Limited | Calibration ruler, calibration method and apparatus, and detection method and apparatus |
| US20250252628A1 (en) * | 2024-02-07 | 2025-08-07 | Qualcomm Incorporated | Synchronizing image signal processor and image sensor configurations |
| KR20250136030A (ko) * | 2024-03-07 | 2025-09-16 | 서울대학교산학협력단 | 왜곡을 고려한 비편향된 원뿔 추정기를 이용한 카메라 캘리브레이션 알고리즘의 방법 및 장치 |
| CN117848403B (zh) * | 2024-03-08 | 2024-07-19 | 宁德时代新能源科技股份有限公司 | 标定件和使用标定件标定检测系统的方法 |
| CN119006614B (zh) * | 2024-10-23 | 2025-07-08 | 易思维(杭州)科技股份有限公司 | 一种针对运动待测物的相机外参实时获取方法 |
| CN119774352B (zh) * | 2024-12-09 | 2025-12-19 | 中电信人工智能科技(北京)有限公司 | 一种布匹的纠偏方法、装置、电子设备和存储介质 |
| CN120927255B (zh) * | 2025-10-13 | 2026-01-30 | 歌尔股份有限公司 | 流水线校准系统及流水线校准方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140104169A1 (en) * | 2011-05-04 | 2014-04-17 | Eberhard Karls Universitaet Teubingen | Method for Determining the Relative Position of an Object in an Area, and Optical Input System |
| CN108818536A (zh) * | 2018-07-12 | 2018-11-16 | 武汉库柏特科技有限公司 | 一种机器人手眼标定的在线偏移修正方法及装置 |
| CN109990698A (zh) * | 2017-12-29 | 2019-07-09 | 广州智信科技有限公司 | 快速标定装置及快速标定方法 |
| CN113506349A (zh) * | 2021-07-19 | 2021-10-15 | 江苏天楹机器人智能科技有限公司 | 一种垃圾分选机器人高精度手眼标定方法 |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3735344B2 (ja) * | 2002-12-27 | 2006-01-18 | オリンパス株式会社 | キャリブレーション装置、キャリブレーション方法、及びキャリブレーション用プログラム |
| US7889234B2 (en) * | 2008-01-10 | 2011-02-15 | Delphi Technologies, Inc. | Automatic calibration for camera lens distortion correction |
| US9734419B1 (en) * | 2008-12-30 | 2017-08-15 | Cognex Corporation | System and method for validating camera calibration in a vision system |
| US9019349B2 (en) * | 2009-07-31 | 2015-04-28 | Naturalpoint, Inc. | Automated collective camera calibration for motion capture |
| TWI520099B (zh) * | 2014-02-19 | 2016-02-01 | 鈺創科技股份有限公司 | 影像擷取系統的校正方法 |
| US10445898B2 (en) * | 2016-02-05 | 2019-10-15 | Sony Corporation | System and method for camera calibration by use of rotatable three-dimensional calibration object |
| US9965870B2 (en) * | 2016-03-29 | 2018-05-08 | Institut National D'optique | Camera calibration method using a calibration target |
| KR101818104B1 (ko) * | 2016-03-30 | 2018-01-12 | 한국과학기술원 | 카메라 및 카메라 캘리브레이션 방법 |
| EP3264359B1 (en) * | 2016-06-28 | 2025-02-19 | Dassault Systèmes | A computer-implemented method of calibrating a camera |
| EP3264360B1 (en) * | 2016-06-28 | 2025-01-22 | Dassault Systèmes | Dynamical camera calibration |
| WO2018173551A1 (ja) * | 2017-03-21 | 2018-09-27 | オリンパス株式会社 | 較正装置、較正方法、光学装置、撮影装置および投影装置 |
| CN106982370B (zh) * | 2017-05-03 | 2018-07-06 | 武汉科技大学 | 一种相机高精度校准标定板及实现校准的方法 |
| US10269140B2 (en) * | 2017-05-04 | 2019-04-23 | Second Spectrum, Inc. | Method and apparatus for automatic intrinsic camera calibration using images of a planar calibration pattern |
| US11039121B2 (en) * | 2017-06-20 | 2021-06-15 | Sony Interactive Entertainment Inc. | Calibration apparatus, chart for calibration, chart pattern generation apparatus, and calibration method |
| CN118840433A (zh) * | 2018-05-25 | 2024-10-25 | 派克赛斯有限责任公司 | 用于多相机放置的系统和方法 |
| CN109671123B (zh) * | 2019-01-31 | 2023-10-17 | 泉州华中科技大学智能制造研究院 | 一种基于单目视觉的鞋底喷胶设备及方法 |
| EP4071713B1 (en) * | 2019-12-30 | 2024-06-19 | Huawei Technologies Co., Ltd. | Parameter calibration method and apapratus |
| CN111402344A (zh) * | 2020-04-23 | 2020-07-10 | Oppo广东移动通信有限公司 | 标定方法、标定装置和非易失性计算机可读存储介质 |
| CN112396663B (zh) * | 2020-11-17 | 2021-09-14 | 南方电网电力科技股份有限公司 | 一种多深度相机的可视化标定方法、装置、设备和介质 |
| US11172193B1 (en) * | 2020-12-04 | 2021-11-09 | Argo AI, LLC | Method and system to calibrate camera devices of a vehicle vision system using a programmable calibration target device |
| CN113409403B (zh) * | 2021-06-29 | 2022-09-16 | 湖南泽塔科技有限公司 | 相机标定架、基于标定架的单幅图像相机标定方法及系统 |
-
2021
- 2021-12-03 KR KR1020237030659A patent/KR20230144591A/ko active Pending
- 2021-12-03 EP EP21966074.3A patent/EP4296952A4/en active Pending
- 2021-12-03 JP JP2023555177A patent/JP7653536B2/ja active Active
- 2021-12-03 CN CN202180096855.7A patent/CN117157670B/zh active Active
- 2021-12-03 WO PCT/CN2021/135305 patent/WO2023097647A1/zh not_active Ceased
-
2024
- 2024-01-15 US US18/412,624 patent/US20240153141A1/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140104169A1 (en) * | 2011-05-04 | 2014-04-17 | Eberhard Karls Universitaet Teubingen | Method for Determining the Relative Position of an Object in an Area, and Optical Input System |
| CN109990698A (zh) * | 2017-12-29 | 2019-07-09 | 广州智信科技有限公司 | 快速标定装置及快速标定方法 |
| CN108818536A (zh) * | 2018-07-12 | 2018-11-16 | 武汉库柏特科技有限公司 | 一种机器人手眼标定的在线偏移修正方法及装置 |
| CN113506349A (zh) * | 2021-07-19 | 2021-10-15 | 江苏天楹机器人智能科技有限公司 | 一种垃圾分选机器人高精度手眼标定方法 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4296952A4 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116527875A (zh) * | 2023-06-30 | 2023-08-01 | 钛玛科(北京)工业科技有限公司 | 线阵相机调试指示器及调试方法 |
| CN116527875B (zh) * | 2023-06-30 | 2023-08-29 | 钛玛科(北京)工业科技有限公司 | 线阵相机调试指示器及调试方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117157670B (zh) | 2026-02-17 |
| JP2024514755A (ja) | 2024-04-03 |
| US20240153141A1 (en) | 2024-05-09 |
| CN117157670A (zh) | 2023-12-01 |
| JP7653536B2 (ja) | 2025-03-28 |
| KR20230144591A (ko) | 2023-10-16 |
| EP4296952A4 (en) | 2024-08-21 |
| EP4296952A1 (en) | 2023-12-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2023097647A1 (zh) | Ccd相机标定系统、方法、装置、计算设备及存储介质 | |
| CN111047536B (zh) | Ccd图像矫正方法、装置、设备及存储介质 | |
| CN103279956B (zh) | 一种检测贴片机元器件定位精度的方法 | |
| CN101207833B (zh) | 数码相机镜头光心偏移的检测方法 | |
| CN105021127B (zh) | 一种贴片机的基准相机校正方法 | |
| US20150205088A1 (en) | Bevel-axial auto-focusing microscopic system and method thereof | |
| CN102853777A (zh) | 基于图像处理的制动间隙宽度测量方法和设备 | |
| CN117197070B (zh) | 检测方法、装置、设备及存储介质 | |
| Zhang et al. | A new algorithm for accurate and automatic chessboard corner detection | |
| CN114720473A (zh) | 基于机器视觉的车载屏幕背板的缺陷检测方法 | |
| CN110519508B (zh) | 一种在摄像模组自动调心过程中识别特征对象的方法 | |
| CN114240984B (zh) | 一种圆形标志点边缘提取方法及其应用 | |
| JP2014155063A (ja) | 解像度測定用チャート、解像度測定方法、カメラモジュールにおける位置調整方法およびカメラモジュールの製造方法 | |
| US12536686B2 (en) | Calibration method of apparatus installation parameter and related surveillance device | |
| CN117768767A (zh) | 一种线阵相机行频调节方法及系统 | |
| CN110349169B (zh) | 一种直线测量方法 | |
| CN112836726A (zh) | 一种基于视频信息的指针类仪表示数读取方法及装置 | |
| CN117433994A (zh) | 基于双工位的led载带高精度在线视觉检测系统及方法 | |
| CN115112296A (zh) | 一种稳定精度测试方法、系统、介质、设备及终端 | |
| CN114170318B (zh) | 图像处理方法、装置、系统、介质及电子设备 | |
| CN114757882B (zh) | 一种基于机器视觉的平面接口测量方法及装置 | |
| US10832073B2 (en) | Text resolution determinations via optical performance metrics | |
| US10511780B2 (en) | Detecting device, and method for controlling the same | |
| CN110148141A (zh) | 一种丝印滤光片小片检测计数方法及设备 | |
| CN116993725A (zh) | 一种柔性电路板智能贴片信息处理系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21966074 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 20237030659 Country of ref document: KR Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 1020237030659 Country of ref document: KR |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023555177 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2021966074 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2021966074 Country of ref document: EP Effective date: 20230919 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |