WO2020263055A1 - 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 - Google Patents
대상체의 3차원 형상을 결정하기 위한 장치 및 방법 Download PDFInfo
- Publication number
- WO2020263055A1 WO2020263055A1 PCT/KR2020/008462 KR2020008462W WO2020263055A1 WO 2020263055 A1 WO2020263055 A1 WO 2020263055A1 KR 2020008462 W KR2020008462 W KR 2020008462W WO 2020263055 A1 WO2020263055 A1 WO 2020263055A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- pattern
- processor
- angle
- phase
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/254—Projection of a pattern, viewing through a pattern, e.g. moiré
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/2433—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures for measuring outlines by shadow casting
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2509—Color coding
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2518—Projection by scanning of the object
- G01B11/2527—Projection by scanning of the object with phase change by in-plane movement of the patern
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/26—Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/26—Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes
- G01B11/27—Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes for testing the alignment of axes
- G01B11/272—Measuring arrangements characterised by the use of optical techniques for measuring angles or tapers; for testing the alignment of axes for testing the alignment of axes using photoelectric detection means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/30—Measuring arrangements characterised by the use of optical techniques for measuring roughness or irregularity of surfaces
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10P—GENERIC PROCESSES OR APPARATUS FOR THE MANUFACTURE OR TREATMENT OF DEVICES COVERED BY CLASS H10
- H10P74/00—Testing or measuring during manufacture or treatment of wafers, substrates or devices
- H10P74/20—Testing or measuring during manufacture or treatment of wafers, substrates or devices characterised by the properties tested or measured, e.g. structural or electrical properties
- H10P74/203—Structural properties, e.g. testing or measuring thicknesses, line widths, warpage, bond strengths or physical defects
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10P—GENERIC PROCESSES OR APPARATUS FOR THE MANUFACTURE OR TREATMENT OF DEVICES COVERED BY CLASS H10
- H10P74/00—Testing or measuring during manufacture or treatment of wafers, substrates or devices
- H10P74/27—Structural arrangements therefor
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B2210/00—Aspects not specifically covered by any group under G01B, e.g. of wheel alignment, caliper-like sensors
- G01B2210/56—Measuring geometric parameters of semiconductor structures, e.g. profile, critical dimensions or trench depth
Definitions
- the present disclosure relates to a technique for determining a three-dimensional shape of an object.
- an element may mean a component or a chipset used as a component in the overall electronic device such as an electric circuit and a semiconductor device.
- an element may mean a coil, a capacitor, a resistor, a transistor, a diode, or an LED.
- the device is not limited to the above-described example.
- an angle of an upper surface of the device with respect to a substrate may be inspected. This angle can be used to check whether there is no tilt between the device and the substrate. This is because if the device is disposed or mounted so that the lower surface of the device is in close contact with the substrate, or the device is disposed or mounted in an inclined state with respect to the substrate according to the coating state of the solder or solder ball applied to the substrate, it may cause a defect in the substrate .
- a method of irradiating the device with illumination and checking the inclination by using the position where the reflected light is formed may be used.
- this method requires a lot of space to measure the imaging position of the reflected light because the reflection angle changes significantly even if the device is inclined only at a small angle when the device is a mirror surface, and there may be a disadvantage that miniaturization of the inspection equipment becomes difficult. .
- structured light is irradiated on the device, and a diffraction pattern is formed by structured light in the air above the device, and the inclination is inspected through the phase change of the diffraction pattern.
- this method may have a disadvantage of generating a lot of noise because the diffraction pattern is formed in the air.
- the present disclosure provides a technique for determining a three-dimensional shape of an object.
- an apparatus for determining a three-dimensional shape of an object may be proposed.
- the device according to an aspect of the present disclosure may be a detachable second device that is coupled to a first device that determines a first three-dimensional shape of an object positioned on a reference plane, and determines an angle of an upper surface of the object with respect to the reference plane. have.
- the second device includes: a first light source for sequentially irradiating at least one first pattern light having a phase range; A beam splitter and at least one lens for changing an optical path of the at least one first patterned light so that light corresponding to each phase of the phase range is distributed to a partial area of the upper surface; A communication interface in communication with the first device; And a first processor electrically connected to the first light source and the communication interface, wherein the first processor comprises at least one generated by reflecting the at least one first pattern light from the first device and from the partial area. First information on the first reflected light may be obtained, and an angle of the upper surface with respect to the reference plane may be determined based on the first information.
- the first information includes information indicating a light amount value of each of the one or more first reflected light
- the first processor includes the one or more first reflected light from the light amount value of each of the one or more first reflected light.
- a phase value of each reflected light may be derived, and an angle of the image plane with respect to the reference plane may be determined based on the phase value.
- the second device further comprises a memory for storing association information indicating a relationship between an angle of the image plane with respect to the reference plane and a phase value of each of the at least one first reflected light, and the first processor May determine an angle of the image plane with respect to the reference plane based on the phase value and the related information.
- the first processor controls the communication interface to transmit second information indicating an angle of the top surface to the first device, and the second information includes the first device It may be used to determine the second 3D shape of the object by correcting the upper surface of the object represented by the 3D shape.
- the first processor controls the communication interface to obtain third information indicating the first three-dimensional shape of the object from the first device, and based on the angle of the top surface, the The second 3D shape of the object may be determined by correcting the upper surface of the object indicated by the first 3D shape.
- the first light source further irradiates monochromatic light
- the beam splitter and the at least one lens may change an optical path of the monochromatic light so that the monochromatic light reaches the upper surface
- the first processor controls the communication interface to obtain fourth information indicating a reflectance of the upper surface from the first device, and when the reflectance of the upper surface is greater than or equal to a preset reference reflectance, the The first light source may be controlled to sequentially irradiate one or more first pattern lights.
- each of the at least one first pattern light is a pattern generated by phase shifting a pattern light having a pattern in a first direction or a second direction perpendicular to the first direction by an integer multiple of a preset phase interval It can be light.
- the first device includes: at least one second light source for irradiating at least one second pattern light onto the object; An image sensor for capturing at least one second reflected light generated by reflecting the at least one first reflected light and the at least one second patterned light from the object; And determining the first 3D shape of the object based on the at least one first reflected light and the at least one second reflected light, and transmitting third information indicating the first 3D shape to the second device. It may include a second processor.
- a method for determining a three-dimensional shape of an object may be proposed.
- a method according to an aspect of the present disclosure is performed in a detachable second device coupled to a first device for determining a first three-dimensional shape of an object positioned on a reference plane, and determining an angle of an upper surface of the object with respect to the reference plane It can be a way to do it.
- the method according to the present disclosure includes, by a first light source, sequentially irradiating at least one first pattern light having a phase range; Changing, by a beam splitter and at least one lens, an optical path of the at least one first patterned light so that light corresponding to each phase of the phase range is distributed to a partial area of the upper surface; Obtaining, by a first processor, from the first device, first information on the at least one first reflected light generated by reflecting the at least one first pattern light from the partial area; And determining, by the first processor, an angle of the upper surface with respect to the reference surface based on the first information.
- the first information includes information indicating a light amount value of each of the one or more first reflected lights, and determining an angle of the top surface includes the first processor, the one or more first reflected lights. Deriving a phase value of each of the at least one first reflected light from each light quantity value; And determining, by the first processor, an angle of the upper surface with respect to the reference plane based on the phase value.
- the method according to the present disclosure further comprises the step of transmitting, by the first processor, second information indicating an angle of the top surface to the first device, wherein the second information is One device may be used to determine a second three-dimensional shape of the object by correcting an upper surface of the object represented by the first three-dimensional shape.
- the method according to the present disclosure includes the steps of: obtaining, by the first processor, third information indicating the first three-dimensional shape of the object from the first device; And determining, by the first processor, a second 3D shape of the object by correcting the top surface of the object indicated by the first 3D shape based on the angle of the top surface.
- determination of a three-dimensional shape of the object may be improved by efficiently measuring the inclination of the upper surface of the object using the amount of light reflected from the object (eg, a device). It can be checked whether the entire substrate mounting process is properly performed through the three-dimensional shape of the object.
- the inspection apparatus since the inclination of the object is not inspected based on the imaged position of the reflected light from the object, miniaturization of the inspection apparatus may be facilitated.
- a noise-resistant inspection may be performed.
- FIG. 1 is a diagram illustrating an apparatus 100 according to an embodiment of the present disclosure.
- FIG 2 is a diagram illustrating an operation process of the device 100 according to an embodiment of the present disclosure.
- FIG. 3 is a block diagram of an apparatus 100 according to an embodiment of the present disclosure.
- FIG. 4 is a diagram illustrating a process in which patterned light is irradiated onto an object according to an embodiment of the present disclosure.
- FIG 5 is a diagram illustrating a process in which reflected light passes through an aperture according to an embodiment of the present disclosure.
- FIG. 6 is a diagram illustrating a process in which reflected light passes through an aperture according to an embodiment of the present disclosure.
- FIG. 7 is a diagram illustrating a state of a pattern light irradiated from a pattern light source at an aperture according to an embodiment of the present disclosure.
- FIG. 8 is a diagram illustrating related information according to an embodiment of the present disclosure.
- FIG. 9 is a diagram illustrating a direction of a pattern of patterned light according to an embodiment of the present disclosure.
- FIG 10 is a diagram illustrating an inspection process using illumination light of the device 100 according to an embodiment of the present disclosure.
- FIG. 11 is a diagram illustrating a process of additionally irradiating white light by a pattern light source according to an embodiment of the present disclosure.
- FIG. 12 is a diagram illustrating an apparatus 1210 according to an embodiment of the present disclosure.
- FIG. 13 is a block diagram of an apparatus 1210 according to an embodiment of the present disclosure.
- FIG. 14 is a diagram showing an embodiment of a method 1700 of determining a three-dimensional shape of an object that can be performed by the apparatus 100 according to the present disclosure.
- 15 is a diagram illustrating an embodiment of a method 1800 of determining an angle of an object upper surface, which may be performed by the apparatus 1210 according to the present disclosure.
- A, B, and C As used herein, "A, B, and C,” “A, B, or C,” “A, B, and/or C” or “at least one of A, B, and C,” “A, B , Or at least one of C,” “at least one of A, B, and/or C,” “at least one selected from A, B, and C,” “at least one selected from A, B, or C,” “A An expression such as “at least one selected from B, and/or C” may mean each listed item or all possible combinations of the listed items.
- At least one selected from A and B is (1) at least one of A, (2) A, (3) B, (4) at least one of B, (5) at least one of A and B At least one of, (6) at least one of A and B, at least one of (7) B, and A, and (8) A and B may all be referred to.
- unit used in this document is a concept collectively referring to hardware components such as software or hardware components such as field-programmable gate arrays (FPGAs) and application specific integrated circuits (ASICs), and optical elements. Can be However, “unit” is not limited to hardware and software. The “unit” may be configured to be stored in an addressable storage medium, or may be configured to execute one or more processors. In one embodiment, “unit” refers to components such as software components, object-oriented software components, class components, and task components, and processors, functions, properties, procedures, subroutines, and programs. It can include segments of code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.
- a certain component eg, a first component
- another component eg, a second component
- the expression that the certain component is “connected” or “connected” to another component means that the certain component is In addition to being directly connected or connected to another component, it may mean that the device is connected or connected via a new other component (eg, a third component).
- a Cartesian coordinate system having an X axis, a Y axis, and a Z axis that are orthogonal to each other may be defined.
- expressions such as "X-axis direction”, “Y-axis direction”, and “Z-axis direction” of a Cartesian coordinate system are both sides of the Cartesian coordinate system where each axis extends unless specifically defined otherwise in the description. It can mean direction.
- the + sign in front of each axis direction may mean a positive direction, which is either direction of both directions extending in the corresponding axis direction
- the-sign in front of each axis direction is a sign that extends in the corresponding axis direction. It may mean a negative direction, which is the other of both directions.
- Direction indicators such as “upward” and “upward” used in this document are based on the positive Z-axis direction in the accompanying drawings, unless otherwise defined in the corresponding description, and “downward”, “lower”, etc.
- the direction indicator of means the opposite direction.
- a substrate is a plate or a container for mounting devices such as semiconductor chips and dies, and may serve as a connection path for electrical signals between devices and devices.
- the substrate may be used for fabricating an integrated circuit or the like, and may be made of a material such as silicon.
- the substrate may be a printed circuit board (PCB), and may be referred to as a wafer or the like according to embodiments.
- PCB printed circuit board
- FIG. 1 is a diagram illustrating an apparatus 100 according to an embodiment of the present disclosure.
- a technique for determining a three-dimensional shape of an object according to the present disclosure may be implemented with a device according to various embodiments.
- the apparatus 100 of the present disclosure may determine a three-dimensional shape of an object (eg, a device) using various inspection methods.
- the shape of an object may be a concept including both a shape in a three-dimensional space of an object and a color and texture of an object surface.
- the apparatus 100 may perform an inspection using patterned light and/or an inspection using coaxial deflectometry.
- the device 100 may further perform inspection using illumination light.
- the device 100 may include a pattern light irradiation unit 110, a deflectometry (DFM) unit 120, a measurement unit 130 and/or an illumination light irradiation unit 140.
- the illumination light irradiation unit 140 may be omitted.
- the pattern light irradiation unit 110 may irradiate pattern light toward an object in order to perform an inspection using pattern light.
- the DFM unit 120 may irradiate patterned light toward an object in order to perform an examination using a coaxial deflection measurement method.
- the measurement unit 130 may capture reflected light that is irradiated by the pattern light irradiation unit 110 and the DFM unit 120 and reflected from the object, and may determine a 3D shape of the object.
- the illumination light irradiation unit 140 may irradiate illumination light toward an object in order to perform an inspection using illumination light.
- the illumination light is reflected from the object and captured by the measurement unit 130, and may be used to determine a three-dimensional shape of the object. The specific operation and inspection method of each unit will be described later.
- the apparatus 100 may perform an inspection method using patterned light and/or an inspection method using a coaxial deflection measurement method.
- the device 100 may determine a 3D shape of the object based on the test result. The determined three-dimensional shape can be used to judge the suitability of the performed process. A process in which the device 100 performs an inspection using illumination light will be described later as an additional embodiment.
- one or more pattern light sources 210 may irradiate one or more pattern lights 212 toward an object located on the reference surface R.
- One or more pattern light sources 210 may belong to the pattern light irradiation unit 110.
- the one or more pattern light sources 210 may be disposed above the reference surface R to irradiate one or more pattern lights 212 toward the object along different optical axes.
- each of the one or more patterned light sources 210 may be disposed on a virtual circumference positioned above the reference surface R at intervals from each other.
- Each of the one or more patterned lights 212 may be reflected from the object.
- the phase of the patterned light 212 before and after reflection may be changed. That is, the reflected light 214 generated by reflecting the pattern light 212 onto the object may have a phase different from that of the corresponding pattern light 212.
- the image sensor 220 may capture each of the one or more reflected lights 214 generated by reflecting each of the one or more pattern lights 212.
- the image sensor 220 may belong to the measurement unit 130.
- the image sensor 220 may be disposed vertically above the area on the reference plane R in which the object is located, facing the object.
- the device 100 may obtain information about a phase of each of the one or more reflected lights 214 and a phase of each of the one or more patterned lights 212.
- the device 100 may determine a first 3D shape of the object based on a phase change from each of the one or more patterned lights 212 of each of the one or more reflected lights 214.
- the pattern light source 230 installed separately from the one or more pattern light sources 210 may sequentially irradiate the one or more pattern lights 232.
- the pattern light source 230 may belong to the DFM unit 120.
- Each of the one or more pattern lights 232 may have the same phase range (eg, 0 to 7 ⁇ /4).
- each of the one or more pattern lights 232 may be generated by phase shifting one pattern light within the above-described phase range by an integer multiple of a preset phase interval (eg, ⁇ /2). have.
- the one or more patterned light 232 may proceed to the beam splitter 240 through the lens 250 and/or other optical elements (eg, mirrors). In an embodiment, the patterned light 232 may proceed to the beam splitter 240 via the stop 252.
- the beam splitter 240 may reflect one or more patterned lights 232 to face the object.
- the beam splitter 240 and the one or more lenses 250 may include one or more pattern lights 232 so that light corresponding to each phase of the above-described phase range is distributed to and reaches a partial area A of the upper surface of the object. You can change the light path.
- light corresponding to one of the phase ranges (eg, 0 to 7 ⁇ /4) of the pattern light 232 corresponds to the above-described partial area (A).
- the optical path of light corresponding to each phase of the patterned light 232 may be changed (adjusted) so as to reach each point on the surface.
- the beam splitter 240 and one or more lenses 250 may be disposed on the optical path of the patterned light 232 so that the optical path can be changed.
- the beam splitter 240 and one or more lenses 250 may belong to the DFM unit 120.
- Each of the one or more patterned lights 232 whose optical path is changed (adjusted) may reach the object. Since light according to each phase is scattered and irradiated over the entire area A of the object, light corresponding to the average amount of light of the patterned light 232 may reach each point of the area A. Each of the one or more patterned light 232 reaching the partial region A may be reflected from the partial region A. Light from which the pattern light 232 is reflected (hereinafter, reflected light 234) may sequentially pass through the lens 250 and the beam splitter 240. In one embodiment, the reflected light 234 may pass through the aperture 262 and, if necessary, may pass through an additionally disposed lens 260 to reach the image sensor 220. The image sensor 220 may capture each of the at least one reflected light 234 that has arrived.
- the aperture stop 252 passes the pattern light 232 through the beam splitter 240, and the aperture stop 262 passes the reflected light 234 proceeding from the partial area A to the image sensor. Therefore, the light amount value of the reflected light 234 captured by the image sensor 220 may be determined according to the amount of light that passes through the aperture 252 and is reflected by a partial area A and passes through the aperture 262 again. .
- the light captured by the image sensor 220 is part of the phase range (eg, 3 ⁇ /4) of the above-described phase range (eg, 0 to 7 ⁇ /4) of the pattern light 232 initially irradiated. It may be light corresponding to /4 ⁇ 5 ⁇ /4). That is, the amount of light that is captured by the image sensor 220 passing through the aperture 262 may be changed according to the degree of inclination of the object upper surface to the partial area A with respect to the reference surface R. Using this principle, the degree of inclination of the reflective surface can be derived based on the amount of captured reflected light, which may be referred to as deflectometry in the present disclosure.
- the deflection measurement method is coaxial deflectometry. ) Can be called. The specific principle of the deflection measurement method will be described later.
- the apparatus 100 may determine an angle of an upper surface of the object with respect to the reference plane R based on the light amount value of each of the one or more reflected lights 234.
- the apparatus 100 may determine the second 3D shape by correcting the previously determined primary 3D shape using the determined angle of the upper surface. That is, the device 100 corrects the upper surface represented by the first three-dimensional shape using the information on the angle of the upper surface measured according to the deflection measurement method, and derives a new three-dimensional shape that is supplemented, that is, a second three-dimensional shape. I can.
- the correction may be performed by a method of overriding the angle of the upper surface represented by the first three-dimensional shape with the angle of the upper surface derived according to the deflection measurement method. In one embodiment, the correction may be performed by determining the average value of the angle of the top surface represented by the first 3D shape and the angle of the top surface derived according to the deflection measurement method as the angle of the top surface represented by the second 3D shape. have.
- the second three-dimensional shape is the final three-dimensional shape for an object and can be used to determine the suitability for a process such as mounting.
- the device 100 includes one or more pattern light sources 210, image sensors 220, pattern light sources 230, beam splitter 240, one or more lenses 250, one or more processors 310, and / Or may include one or more memories 320. In one embodiment, at least one of these components of the device 100 may be omitted, or another component may be added to the device 100. In one embodiment, additionally or alternatively, some components may be integrated and implemented, or may be implemented as a singular or plural entity. In the present disclosure, one or more processors may be referred to as a processor. The expression “processor” may mean a set of one or more processors, unless clearly expressed otherwise in context.
- one or more memories may be referred to as memories.
- the expression “memory” may mean a set of one or more memories, unless explicitly expressed differently in context.
- at least some of the components inside and outside the device 100 are bus, general purpose input/output (GPIO), serial peripheral interface (SPI), mobile industry processor interface (MIPI), and the like. It is connected to each other through the data and/or signals can be exchanged.
- GPIO general purpose input/output
- SPI serial peripheral interface
- MIPI mobile industry processor interface
- Each of the at least one pattern light source 210 may irradiate at least one pattern light 212 as described above.
- the pattern light source 210 may generate the pattern light 212 in various ways.
- the pattern of the patterned light 212 may be formed by a digital method or an analog method.
- liquid crystal transmission method using LCD Liquid Crystal Display
- liquid crystal reflection method using LCoS (Liquid Crystal on Silicon)
- mirror reflection using Digital Micromirror Device (DMD) or Digital Light Processing (DLP) There could be a way.
- DMD Digital Micromirror Device
- DLP Digital Light Processing
- there there may be a method of forming a pattern using a pattern such as a periodic pattern, a gradient pattern, and a grid pattern.
- each of the one or more pattern light sources 210 may be disposed above the reference surface R to irradiate the pattern light 212 along different optical axes.
- the four pattern light sources 210 may be disposed apart at intervals of about 90 degrees on the virtual circumference (4-way).
- the eight pattern light sources 210 may be disposed apart at an interval of about 45 degrees on the virtual circumference (8-way).
- each of the pattern light sources 210 may sequentially irradiate one or more pattern lights 212 phase-shifted to four buckets.
- each of the one or more pattern lights 212 may be generated by phase shifting one pattern light by an integer multiple of a preset phase interval (eg, ⁇ /2).
- a total of 32 (8 ⁇ 4) pattern lights 212 may be irradiated to the object. Accordingly, a total of 32 images are captured, and information on 32 phase changes may be used to determine the first 3D shape of the object.
- the image sensor 220 may capture one or more reflected light 214 and reflected light 234, respectively.
- the image sensor 220 may be implemented as a Charge Coupled Device (CCD) or Complimentary Metal Oxide Semiconductor (CMOS) sensor.
- CCD Charge Coupled Device
- CMOS Complimentary Metal Oxide Semiconductor
- the pattern light source 230 may generate and irradiate the pattern light 232 in various ways.
- each of the pattern light sources 230 may sequentially irradiate one or more pattern lights 232 phase-shifted to four buckets.
- pattern light 232 obtained by phase-shifting pattern light formed in one direction (hereinafter, referred to as w-axis direction) to four buckets, and pattern light formed in a direction perpendicular to the w-axis direction (hereinafter, referred to as v-axis direction) If the phase shifted pattern light 232 is used with 4 buckets, a total of 8 (4+4) pattern lights 232 may be sequentially irradiated. Accordingly, a total of eight images are captured and can be used to determine the angle of the top surface of the object.
- the beam splitter 240, one or more lenses 250, and/or other optical elements described above may be variously implemented by optical elements according to a method known in the art.
- the beam splitter 240 and/or one or more lenses 250 may be arranged to perform the optical path change of the patterned light 232 described above for a deflection measurement method.
- the processor 310 may adjust its position, arrangement, and related parameters so that the beam splitter 240 and/or one or more lenses 250 may change the corresponding optical path.
- the device 100 may also include the aperture 252 and the aperture 262 described above.
- the processor 310 may control at least one component of the device 100 connected to the processor 310 by driving software (eg, instructions, programs, etc.). In addition, the processor 310 may perform various operations related to the present disclosure, processing, data generation, and processing. Also, the processor 310 may load data or the like from the memory 320 or may store the data in the memory 320. In an embodiment, the processor 310 may determine the first 3D shape of the object based on a phase change from each of the one or more pattern lights 212 of each of the one or more reflected lights 214. In addition, the processor 310 may determine an angle of an upper surface of the object with respect to the reference plane R based on a light amount value of each of the one or more reflected light 234 according to a deflection measurement method. The processor 310 may determine the second (final) 3D shape by correcting the first 3D shape using the determined angle of the upper surface.
- driving software eg, instructions, programs, etc.
- the processor 310 may perform various operations related to the present disclosure, processing,
- the memory 320 may store various types of data. Data stored in the memory 320 is data acquired, processed, or used by at least one component of the device 100, and may include software (eg, instructions, programs, etc.). The memory 320 may include volatile and/or nonvolatile memory. In the present disclosure, commands or programs are software stored in the memory 320, and various functions are applied so that an operating system, an application, and/or an application for controlling the resources of the device 100 can utilize the resources of the device 100. It may include middleware and the like provided to. In one embodiment, the memory 320 may store instructions that cause the processor 310 to perform an operation when executed by the processor 310.
- the device 100 may further include a communication interface (not shown).
- the communication interface may perform wireless or wired communication between the device 100 and a server, or between the device 100 and another device.
- the communication interface is eMBB (enhanced mobile broadband), URLLC (Ultra Reliable Low-Latency Communications), MMTC (Massive Machine Type Communications), LTE (Long-Term Evolution), LTE-A (LTE Advance), NR ( New Radio), UMTS (Universal Mobile Telecommunications System), GSM (Global System for Mobile communications), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), WiBro (Wireless Broadband), WiFi (Wireless Fidelity), Bluetooth (Bluetooth ), Near Field Communication (NFC), Global Positioning System (GPS), or Global Navigation Satellite System (GNSS) can perform wireless communication.
- eMBB enhanced mobile broadband
- URLLC Ultra Reliable Low-Latency Communications
- MMTC Massive Machine Type Communications
- LTE Long-Term Evolution
- LTE-A LTE Advance
- the communication interface can perform wired communication according to methods such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), RS-232 (Recommended Standard-232), or POTS (Plain Old Telephone Service).
- the processor 310 may obtain information necessary to implement the technology according to the present disclosure from the server by controlling the communication interface.
- Information obtained from the server may be stored in the memory 320.
- the information obtained from the server may include information on a substrate or an object, information on a reference surface R, related information to be described later, and the like.
- 4 to 8 are diagrams for explaining the principle of the coaxial deflection measurement method described above.
- 4 is a diagram illustrating a process in which the patterned light 232 is irradiated onto an object according to an embodiment of the present disclosure.
- light corresponding to each phase in the corresponding phase range eg, 0 to 7 ⁇ ⁇ /4
- the optical path of each of the one or more pattern lights 232 may be changed.
- a description will be made based on one patterned light 232.
- the pattern light source 230 may irradiate the pattern light 232 corresponding to one phase range.
- Optical paths 410, 420, and 430 of light corresponding to any three phases within the above-described phase range are illustrated.
- Each light may be irradiated to a partial area A of an upper surface of the object through one or more lenses 250, apertures 252 and/or beam splitters 240.
- light corresponding to one phase may be scattered and irradiated over the entire area A. That is, the light 410 corresponding to one phase may be irradiated to reach each point on the surface corresponding to the partial area A.
- Light (420, 430, etc.) corresponding to different phases of the pattern light 232 may be irradiated to the object in the same manner. Accordingly, all light corresponding to each of the phases of the above-described phase range may be irradiated to one point of the partial area A on the object. For example, in the illustrated embodiment, the lights 410, 420, and 430 all reach each point of a partial area A on the object. Accordingly, light having an average amount of light of the patterned light 232 corresponding to the above-described phase range may be irradiated to the entire area A of the object.
- the reflected light 234 generated by reflecting the pattern light 232 from the partial area A may pass through the aperture 262 and be input to the image sensor 220.
- the object upper surface is inclined with respect to the reference surface R, only a part of the reflected light 234 may pass through the aperture 262.
- Some of the reflected light passing through the aperture 262 may correspond to a part of the phase range of the pattern light 232 irradiated from the pattern light source 230. As a result, an average amount of light of lights corresponding to this partial phase range may be captured by the image sensor 220.
- the angle of the top surface of the object with respect to the reference plane R may be 0 degrees. In this case, most of the light reflected from one point of the partial area A passes through the stop 262 and may be captured by the image sensor 220. That is, in the embodiment 440, light corresponding to the phase section indicated by A and A′ may be reflected from the partial region A, passed through the aperture 262, and input to the image sensor 220.
- the object may be inclined at an angle of 3 degrees with respect to the reference plane R.
- the object may be inclined at an angle of 3 degrees with respect to the reference plane R.
- only some of the light reflected from one point in the partial area A passes through the aperture 262 and may be captured by the image sensor 220.
- the phase range of the pattern light 232 passed by the aperture 252 is a section indicated by the straight line 451
- the phase range of the reflected light 234 passed by the aperture 262 is the section indicated by the line 452 May correspond to.
- light having an optical path passing through both the stop 252 and the stop 262 may be light corresponding to the phase section indicated by A and A′.
- the amount of reflected light 234 acquired by the image sensor 220 may be an average amount of light corresponding to the phase section indicated by A and A′.
- the object may be inclined at an angle of 5 degrees with respect to the reference plane R.
- most of the light reflected from one point of the partial area A may not pass through the stop 262. Accordingly, the image sensor 220 may not be able to capture the reflected light 234.
- the angle of the top surface of the object in the above-described embodiments 440, 450, and 460 may be an exemplary value selected for explanation.
- the amount of light input to the image sensor 220 may change according to the angle of the top surface of the object, passing through both the aperture 252 and the aperture 262.
- the device 100 may determine (derive) the angle of the top surface of the object.
- FIG 5 is a diagram illustrating a process in which the reflected light 234 passes through the stop 262 according to an embodiment of the present disclosure.
- the upper surface of the object may be inclined at a predetermined angle with respect to the reference surface R.
- the pattern light 232 having one phase range may be irradiated from the pattern light source 230 and distributed over a partial area A of the upper surface of the object to be irradiated. Since the top surface of the object is inclined, only a part of the reflected light 234 may pass through the aperture 262 and be input to the image sensor 220. Of the reflected light of the light (410, 420, 430, etc.) incident on the partial area (A), only the reflected light whose optical path proceeds within the range indicated by the thick solid line passes through the aperture 262 and is input to the image sensor 220. I can.
- Some of the reflected light input to the image sensor 220 may be that light corresponding to a partial range of the above-described phase range of the pattern light 232 is reflected from a partial area A on the object.
- the amount of reflected light 234 acquired by the image sensor 220 may be an average amount of light corresponding to the aforementioned partial range of the patterned light 232.
- FIG. 6 is a diagram illustrating a process in which the reflected light 234 passes through the diaphragm 262 according to an embodiment of the present disclosure.
- a portion A1 of the partial area A of the object upper surface may not be inclined with respect to the reference surface R, and the other portion A2 may be in an inclined state.
- Light reflected from the non-tilted point A1 may pass through the aperture 262 and be input to a corresponding point of the image sensor 220, as in the above-described embodiment 440 (thick solid line).
- the corresponding point of the image sensor 220 may receive an average amount of light irradiated from the pattern light source 230 corresponding to the above-described phase range.
- Light reflected from the inclined point A2 may be input to the image sensor 220 by passing only a part of the light reflected from the inclined point A2 through the aperture 262 (thick dotted line).
- the corresponding point of the image sensor 220 may receive an average amount of light of only light corresponding to a partial range of the above-described phase range irradiated by the pattern light source 230.
- the pattern of one pattern light 232 may have a period.
- the phase corresponding to one period is 2 ⁇
- the pattern of the pattern light may become brighter during the period from 0 to ⁇ /2, and the pattern of the pattern light becomes darker during the period from ⁇ /2 to 3 ⁇ /2.
- the pattern of the pattern light may become brighter again during the period of 3 ⁇ /2 to 2 ⁇ .
- the pattern light source 230 may irradiate the pattern light 232 having a phase range. This phase range can be appropriately set as needed.
- the phase range may be set so as not to be one period or a multiple of one period of the pattern. That is, the phase range may be set to a range other than the phase range corresponding to 0, 2 ⁇ , 4 ⁇ , ..., 2n ⁇ . This is because the light corresponding to the average amount of light of the pattern light 232 is irradiated to the partial area (A), so when a pattern light of a phase range that is a period or a multiple of a period is used, light corresponding to each phase of the pattern light Because these can all cancel each other out.
- the phase range may be set to be larger than a phase range corresponding to a half period of the pattern light and smaller than a phase range corresponding to one period of the pattern light.
- the phase range is set to be larger than the phase range corresponding to the (N+1/2) period of the pattern light (N is a natural number), and smaller than the phase range corresponding to the (N+1) period of the pattern light. I can.
- This phase range can be set when it is necessary to increase the total amount of light of the patterned light itself in order to facilitate measurement of the reflected light.
- Each of the one or more pattern lights 232 may be generated by phase shifting one pattern light corresponding to the above-described phase range by an integer multiple of a preset phase interval (eg, ⁇ /2). In an embodiment, the above-described phase interval may be set to a value greater than 0 and less than ⁇ .
- Each of the one or more pattern lights 232 may be referred to as a 0th bucket, a first bucket, a second bucket, and a third bucket, that is, four buckets.
- Each of the patterned light 232 generated by phase shifting may also have the above-described phase range ⁇ .
- each of the patterned light 232 has a phase range of 0 to ⁇ , a phase range of ⁇ /2 to ⁇ /2+ ⁇ , a phase range of ⁇ to ⁇ + ⁇ , and 3 ⁇ /2 to 3 ⁇ It may have a phase range of ⁇ /2+ ⁇ .
- the pattern light 232 for each bucket may appear like the illustrated pattern 710 at the stop 252.
- the area of the pattern light passing through the aperture 252 may be a circular shape 720, and accordingly, among the rectangular pattern light from the pattern light source 230, light corresponding to the corresponding circular area is Can be investigated.
- the device 100 may determine the angle of the top surface of the object using only the patterned light 232. However, by measuring the angle of the upper surface of the object using a plurality of patterned lights, various measurement errors such as errors according to the material of the upper surface of the object can be reduced.
- the total amount of light that the pattern light 232 has in the pattern light source 230 may be calculated as shown in the following equation.
- I o is a constant that determines the amplitude of the sine wave graph of the pattern of the pattern light 232, and I o may be a constant that determines the offset of the sine wave graph of the pattern.
- the apparatus 100 may determine an angle of the top surface of the object with respect to the reference plane R, based on the light amount value of each of the one or more reflected lights 234.
- the apparatus 100 may derive a phase value of the reflected light 234 from the light amount value of the reflected light 234 and determine an angle of an upper surface of the object by comparing the derived phase value with related information.
- the processor 310 may derive a phase value of each of the one or more reflected lights 234 from the light amount values of each of the one or more reflected lights 234.
- the light quantity value I n of the reflected light may be expressed as follows.
- Equation 3 may be summarized by substituting each phase shift amount ⁇ (t) into Equation 2.
- the image sensor 220 may capture light having an average amount of light corresponding to a partial range of the phase range of the pattern light 232.
- the light corresponding to a partial range may vary depending on the angle of the object upper surface and/or the pattern light 232 according to which bucket is irradiated. That is, even if the object is inclined at the same angle, the configuration of the light corresponding to the above-described partial range may vary depending on how much the irradiated pattern light 232 is phase-shifted.
- the amount of reflected light for each bucket may be I 1 , I 2 , I 3 , and I 4 described above.
- the light intensity values (I 1 , I 2 , I 3 , I 4 ) of each reflected light are values that can be measured by the image sensor 220.
- A, B and ⁇ can be derived using four equations for I 1 , I 2 , I 3 , and I 4 described above. Since there are three unknowns, at least three or more equations are required, and thus, measurement through three or more different pattern lights 232 may have to be performed at least three times. Accordingly, if Equation 3 is summarized, the following Equation 4 can be derived for the phase value ⁇ of the reflected light.
- phase values of the one or more reflected lights 234 may be derived from the light quantity values of the one or more reflected lights 234, respectively. This derivation process may be performed by the processor 310.
- the memory 320 of the device 100 may further store related information.
- the association information may indicate a relationship between an angle of an upper surface of the object with respect to the reference plane R and a phase value of the reflected light 234.
- the numerical value indicated by the illustrated related information is an exemplary value, and the value of the related information may be changed according to embodiments.
- the relationship between the phase value indicated by the related information and the inclined angle of the object may be databaseized through measurement and calculation and stored in the memory 220.
- the related information is the inclined angle of the object, the amount of reflected light of each bucket measured for each corresponding angle (I 1 , I 2 , I 3 , I 4 ), and the reflected light derived through the measured light amount value. It may include information on the phase value. For example, when the inclined angle of the object is 1 degree, the measured light intensity values (I 1 , I 2 , I 3 , I 4 ) of each bucket may be 239.50, 145.67, 132.41, and 226.34, respectively. The phase value derived through this light intensity value may be 37.02 degrees.
- the association information may also include values of A and B in Equation 3 above.
- the processor 310 may determine an angle of an upper surface of the object with respect to the reference plane R based on the phase value and related information of the reflected light 234.
- the processor 310 may determine the supplemented secondary (final) 3D shape by modifying the top surface represented by the primary 3D shape using the determined angle of the top surface.
- the pattern light sources 210 and 230 may generate pattern lights 212 and 232 having a pattern on a square surface.
- the pattern of the pattern lights 212 and 232 may be formed in the w axis direction or the v axis direction. have.
- each of the one or more pattern lights 212 and 232 may have a pattern in a w-axis direction or a v-axis direction perpendicular to the w-axis.
- the pattern direction of the pattern lights 212 and 232 may be set differently for each bucket.
- an error in determining a three-dimensional shape of an object may be reduced.
- FIG. 10 is a diagram illustrating an inspection process using illumination light of the device 100 according to an embodiment of the present disclosure. Some of the components of the above-described device 100 have been arbitrarily omitted.
- the device 100 may further perform an inspection using illumination light.
- the apparatus 100 may determine the first 3D shape of the object by additionally reflecting the test result using illumination light in addition to the test result using the pattern light described above.
- the device 100 may further include one or more illumination light sources 1010.
- the illumination light source 1010 may belong to the illumination light irradiation unit 140. Each of the illumination light sources 1010 may irradiate the illumination light 1020 toward an object located on the reference surface R.
- one illumination light source 1010 may be implemented in a form including a plurality of illumination light sources (eg, LED lights) arranged to be spaced apart from each other at a predetermined distance on the circumference. The circumference may be disposed parallel to the reference plane R.
- one illumination light source 1010 may be implemented as a single illumination light source having a cylindrical shape. Each of the illumination light sources 1010 may be disposed above the reference surface R to the object.
- Each of the illumination light sources 1010 may be arranged to irradiate illumination light to the object along an optical axis inclined at one or more angles (eg, 17 degrees, 40 degrees, 58 degrees, 70 degrees, etc.) with respect to the reference plane R. In one embodiment, a total of four illumination light sources 1010 may be used as shown.
- the illumination light may be light according to one or more wavelengths. In one embodiment, the illumination light may be red light, green light, or blue light.
- Each of the illumination light sources 1010 may be implemented as an RGB light source, and may include a red light source, a green light source, and/or a blue light source. In an embodiment, the illumination light source 1010 may simultaneously irradiate at least two light sources, and may irradiate white light by irradiating red, green, and blue light at the same time.
- the illumination light 1020 may be reflected from the object.
- the image sensor 220 may capture light from which the illumination light 1020 is reflected (hereinafter, reflected light 1030 ).
- the amount of light captured by the image sensor 220 may vary according to the angle at which the illumination light 1020 is irradiated to the object and the angle at which the reflected light 1030 is reflected from the object.
- the shape of the object may be determined based on the amount of light changed before and after reflection.
- the processor 310 may obtain a change in the amount of light from each of the at least one reflected light 1030 and each of the illumination light 1020 according to at least one wavelength.
- the processor 310 may determine the aforementioned primary 3D shape of the object based on the change in the amount of light.
- the processor 310 may determine the first 3D shape of the object using both the test result using pattern light and the test result using illumination light.
- the processor 310 is a phase change from each of the at least one pattern light 212 of each of the at least one reflected light 214 and each of the at least one reflected light 1030 from each of the illumination light 1020 according to at least one wavelength. Based on the change in the amount of light, the first 3D shape of the object may be determined.
- the processor 310 may determine the second (final) 3D shape of the object by modifying the corresponding primary 3D shape using the determined angle of the upper surface.
- the processor 310 may determine the second (final) 3D shape of the object by modifying the corresponding primary 3D shape using the determined angle of the upper surface.
- a total of 12 (4 ⁇ 3) illumination lights may be irradiated to the object.
- a total of 12 reflected lights may be captured by the image sensor 220 and may be used to determine the first 3D shape of the object.
- FIG. 11 is a diagram illustrating a process of additionally irradiating white light 1110 by the pattern light source 230 according to an embodiment of the present disclosure. Some of the components of the above-described device 100 have been arbitrarily omitted. In one embodiment, the pattern light source 230 of the device 100 may further irradiate the white light 1110, and determine a more accurate primary 3D shape of the object using information on the reflected light 1120. have.
- the pattern light source 230 may irradiate at least one monochromatic light of red light, green light, blue light, and white light, for example, white light 1120 ) Can be investigated.
- white illumination light without a pattern can be irradiated from the pattern light source 230.
- the white light 1120 may travel along an optical path similar to the pattern light 232 described above.
- the beam splitter 240 and one or more lenses 250 may change the optical path of the white light 1110 so that the white light 1110 reaches the upper surface of the object.
- the white light 1110 may travel to the beam splitter 240 through the lens 250, the stop 252, and other optical elements.
- the beam splitter 240 may change the optical path of the white light 1110 so that the white light 1110 faces the upper surface of the object.
- the white light 1110 may be reflected from the upper surface of the object. Depending on the shape of the object, the amount of white light 1110 may change before and after reflection. That is, the amount of white light 1110 and the amount of reflected light 1120 may be different.
- the reflected light 1120 may travel toward the beam splitter 240, and the beam splitter 240 may pass the reflected light 1120 through the image sensor 220.
- the image sensor 220 may capture the reflected light 1120.
- the processor 310 may determine the shape of the object based on the value of the amount of light changed before and after reflection. That is, the processor 310 may obtain a change in the amount of light from the white light 1110 of the reflected light 1120 and determine the first 3D shape of the object based on the change in the amount of light. In an embodiment, the processor 310 may determine the first 3D shape of the object using both the test result using pattern light and the test result using white light. In this case, the processor 310 is based on a phase change from each of the one or more pattern lights 212 of each of the one or more reflected lights 214 and a change in the amount of light from the white light 1110 of the reflected light 1120, The three-dimensional shape can be determined. Thereafter, as described above, the processor 310 may determine the second (final) 3D shape of the object by modifying the corresponding primary 3D shape using the determined angle of the upper surface.
- the apparatus 100 may determine a second 3D shape by performing an inspection using a coaxial deflection measurement method only when a preset criterion is satisfied, and otherwise, determine only the first 3D shape. This is to shorten the time required for the examination process by performing an additional examination on the upper surface of the object only when it is determined that it is necessary.
- the apparatus 100 may additionally perform an examination using a coaxial deflection measurement method on the object.
- the apparatus 100 may additionally perform an examination using the coaxial deflection measurement method.
- the apparatus 100 may additionally perform an examination using the coaxial deflection measurement method.
- the processor 310 may obtain light amount information of the white light 1110 from the pattern light source 230 and may obtain light amount information of the reflected light 1120 from the image sensor 220.
- the processor 310 may derive a reflectance of an upper surface of the object based on a change in the amount of light from the white light 1110 of the reflected light 1120.
- the processor 310 may control the pattern light source 230 to sequentially irradiate the above-described one or more pattern lights 232.
- information on a preset reference reflectance may be stored in the memory 320.
- the apparatus 100 may first perform an inspection using patterned light and then perform an inspection using a deflection measurement method. That is, the pattern light 212 may be irradiated first to capture the reflected light 214, and then the patterned light 232 may be irradiated to capture the reflected light 234. In one embodiment, inspection using illumination light may be performed prior to inspection using a deflection measurement method.
- the apparatus 100 determines a three-dimensional shape by imaging a reference plane R, an object, or a reference plane R and the object using patterned light, and then, using a deflection measurement method, the angle of the top surface of the object is determined. Can be derived.
- the upper surface of the object is a mirror surface, it is possible to check the reference surface R using patterned light, but it may be difficult to accurately restore the three-dimensional shape of the object, so based on the angle information of the object upper surface derived using the deflection measurement method. It is possible to accurately derive information on the top surface of the object and information on the 3D shape of the object compared to the reference plane R.
- the device 1210 is a device corresponding to the above-described DFM unit 120 and may determine an angle of an upper surface of an object located on the reference surface R. At least one component in the device 1210 can be implemented as a removable device and coupled to the device 1220. If the device 1210 is not coupled, a coaxial 2D light source may be attached to the location where it was coupled. The coaxial 2D light source may irradiate at least one monochromatic light selected from red light, green light, blue light, and white light. The coaxial 2D light source can be implemented through optical elements such as LEDs. By irradiating 2D monochromatic illumination through such a detachable device 1210 or a coaxial 2D light source, a more accurate 3D shape restoration may be performed depending on the object.
- the device 1220 may be a device including the pattern light irradiation unit 110, the measurement unit 130 and/or the illumination light irradiation unit 140 described above.
- the device 1220 may determine the aforementioned primary 3D shape of the object on the reference plane R.
- the device 1210 When the device 1210 is coupled to the device 1220, it may have a configuration similar to that of the device 100 described above.
- the combined device 1210 and the device 1220 may determine the aforementioned secondary (final) 3D shape of the object in the same manner as the device 100. That is, the device 1220 may determine the first 3D shape of the object by performing an examination using pattern light and/or an examination using illumination light, and the device 1210 may determine an angle of an upper surface of the object.
- the second 3D shape may be determined by modifying the first 3D shape of the object using the angle of the upper surface.
- the process of modifying and determining the second 3D shape may be performed by the device 1210 or the device 1220.
- the pattern light source 1230 of the device 1210 may sequentially irradiate one or more pattern lights 1232.
- the pattern light source 1230 and the pattern light 1232 may correspond to the pattern light source 230 and the pattern light 232 described above, respectively.
- each of the patterned light 1232 may have the same phase range.
- each of the pattern lights 1232 may be generated by phase shifting a pattern light having a pattern in a w-axis direction or a v-axis direction by an integer multiple of a preset phase interval.
- the beam splitter 1240 and one or more lenses 1250 may change an optical path of one or more pattern lights 1232.
- the beam splitter 1240 and one or more lenses 1250 may correspond to the aforementioned beam splitter 240 and one or more lenses 250, respectively.
- the beam splitter 1240 and the one or more lenses 1250 include light corresponding to each phase in the above-described phase range. ), it is possible to change the optical path of the one or more pattern lights 1232 to reach them.
- other necessary optical elements eg mirrors
- the patterned light 1232 may pass through the aperture 1252 before being input to the beam splitter 1240.
- One or more patterned lights 1232 may be reflected from a partial area A of the object.
- the light from which the pattern light 1232 is reflected (hereinafter, reflected light 1234) may be input to an image sensor of the device 1220 through a beam splitter 1240, an aperture 1262, other lenses 1260, and the like.
- This image sensor may correspond to the image sensor 220 described above.
- the device 1210 may obtain information 1270 on one or more reflected lights 1234 from the device 1220.
- the device 1210 may determine an angle of an upper surface of the object with respect to the reference plane R based on the information 1270.
- the process of determining the angle of the top surface may be the same as the process described in the apparatus 100 described above.
- the information 1270 may include information indicating a light amount value of each of the one or more reflected lights 1234.
- the device 1220 is a device including the pattern light irradiation unit 110, the measurement unit 130 and/or the illumination light irradiation unit 140 described above, and to perform an inspection using pattern light and/or illumination light.
- the device 1220 may include one or more pattern light sources (corresponding to the pattern light source 210), an image sensor (corresponding to the image sensor 220), and/or a processor (corresponding to the processor 310).
- the pattern light source may irradiate one or more pattern lights (corresponding to the pattern light 212) to the object.
- the image sensor may capture reflected light (corresponding to the reflected light 214) of the patterned light (corresponding to the patterned light 212 ).
- the image sensor may capture reflected light (corresponding to the reflected light 234) of the patterned light 1232.
- the processor may determine a primary 3D shape of the object based on the captured reflected light and transmit information indicating the determined primary 3D shape to the device 1210.
- the device 1210 includes a patterned light source 1230, a beam splitter 1240, one or more lenses 1250, a communication interface 1330, one or more processors 1310, and/or one or more memories 1320. It may include. In one embodiment, at least one of these components of the device 1210 may be omitted, or another component may be added to the device 1210. In one embodiment, additionally or alternatively, some components may be integrated and implemented, or may be implemented as a singular or plural entity.
- At least some of the components inside and outside the device 1210 are a bus, general purpose input/output (GPIO), serial peripheral interface (SPI), mobile industry processor interface (MIPI), and the like. They are connected to each other, and data and/or signals can be exchanged.
- GPIO general purpose input/output
- SPI serial peripheral interface
- MIPI mobile industry processor interface
- the pattern light source 1230, the beam splitter 1240, and one or more lenses 1250 may correspond to the above-described pattern light source 230, the beam splitter 240, and the one or more lenses 250, according to a deflection measurement method. The same or similar actions can be performed to perform the test.
- the communication interface 1330 may be implemented in a manner similar to the communication interface of the device 100 described above.
- the communication interface 1330 may be controlled by the processor 1310 to communicate with the device 1220.
- the communication interface 1330 may obtain information 1270 about one or more reflected lights 1234 from the device 1220.
- the processor 1310 may be implemented in a manner similar to the processor 310 of the apparatus 100 described above.
- the processor 1310 may control the communication interface 1330 to obtain information 1270 on one or more reflected lights 1234, and determine an angle of an upper surface of the object with respect to the reference plane R based on the information 1270. have.
- the processor 1310 of the device 1210 may derive a phase value of each of the one or more reflected lights 1234 from the light quantity values of each of the one or more reflected lights 1234.
- the processor 1310 may determine an angle of an upper surface of the object with respect to the reference plane R based on the derived phase value. This process may correspond to a process in which the processor 310 derives a phase value from the light quantity value of the reflected light 234 and determines the angle of the image surface from the phase value.
- the memory 1320 may store related information, similar to the memory 320, and the processor 1310 may determine an angle of the image surface based on the phase value and related information of each of the reflected light 1234. .
- the device 1210 may transmit information indicating the derived angle of the top surface to the device 1220 to allow the device 1220 to determine a second 3D shape.
- the processor 1310 may control the communication interface 1330 to transmit information indicating the derived angle of the top surface to the device 1220.
- the device 1220 may determine the first three-dimensional shape of the object through inspection using patterned light and/or illumination light.
- Corresponding information indicating the angle of the image surface may be used by the device 1220 to determine the second 3D shape by correcting (correcting) the upper surface of the object represented by the first 3D shape.
- the device 1210 may obtain information indicating the primary 3D shape of the object from the device 1220 and directly determine the 2nd 3D shape using this.
- the processor 1310 may control the communication interface 1330 to obtain information on the primary 3D shape of the object determined by the device 1220.
- the processor 1310 may determine the second 3D shape by correcting (correcting) the upper surface of the object represented by the first 3D shape based on the determined angle of the upper surface.
- the pattern light source 1230 may further irradiate white light, and the beam splitter 1240 and one or more lenses 1250 may change the optical path of the white light so that the white light reaches an upper surface of the object. This may correspond to irradiation of white light 1110 by the pattern light source 230 of the apparatus 100 described above. As described above, white light may be reflected from the top surface of the object. The device 1220 may capture the reflected light and determine a first 3D shape of the object based on a change in the amount of light of the reflected light from white light.
- the processor 1310 may control the communication interface 1330 to obtain information indicating a reflectance of an upper surface of the object from the device 1220.
- the processor 1310 may control the pattern light source 1230 to sequentially irradiate one or more pattern lights 1232. This may correspond to the control of the pattern light source 230 by the processor 310 of the above-described device 100 based on the reference reflectance.
- FIGS. 14 to 15 are diagrams showing an embodiment of methods that may be performed by the devices 100 and 1210 respectively according to the present disclosure.
- the methods according to the present disclosure may be computer-implemented methods.
- each step of the method or algorithm according to the present disclosure is described in a sequential order in the illustrated flowchart, each step may be performed in an order that may be arbitrarily combined by the present disclosure in addition to being performed sequentially.
- the description in accordance with this flowchart does not exclude making changes or modifications to the method or algorithm, and does not imply that any step is essential or desirable.
- at least some of the steps may be performed in parallel, repetitively or heuristically.
- at least some of the steps may be omitted or other steps may be added.
- FIG. 14 is a diagram showing an embodiment of a method 1700 of determining a three-dimensional shape of an object that can be performed by the apparatus 100 according to the present disclosure.
- the apparatus 100 according to the present disclosure may perform the method 1700 in determining a first three-dimensional shape (eg, a second three-dimensional shape) of an object positioned on a reference plane.
- a first three-dimensional shape eg, a second three-dimensional shape
- Step of sequentially irradiating the second pattern light (S1730), changing the optical path of the second pattern light so that light corresponding to each phase of the phase range is distributed to a partial area (S1740), and at least one second reflected light is Capturing (S1750) and/or determining a first 3D shape of the object based on at least one first reflected light and at least one second reflected light (S1760 ).
- one or more first light sources (eg, pattern light source 210) of the device 100 may irradiate one or more first pattern lights (eg, pattern light 212) onto an object.
- the image sensor 220 may capture one or more first reflected light (eg, reflected light 214) generated by reflecting one or more first pattern lights (eg, pattern light 212) from an object. .
- the second light source (eg, pattern light source 230) may sequentially irradiate one or more second pattern lights (eg, pattern light 232) having one phase range.
- the beam splitter 240 and the one or more lenses 250 distribute the light corresponding to each phase of the corresponding phase range to a partial area A of the object.
- the optical path of the pattern light 232 can be changed.
- the image sensor 220 receives at least one second reflected light (eg, reflected light 234) generated by reflecting at least one second pattern light (eg, pattern light 232) from a partial area A. You can capture it.
- step S1760 the processor 310 is based on one or more first reflected light (for example, reflected light 214) and one or more second reflected light (for example, reflected light 234), the first 3D shape of the object (for example, 2nd 3D shape) can be determined.
- the step of determining a first three-dimensional shape is performed by the processor 310 at least one first reflected light (eg, reflected light 214).
- a step of determining a second 3D shape (eg, a first 3D shape) of the object based on each of the phase changes from the pattern light (eg, the pattern light 212).
- the processor 310 derives a phase value of each of one or more second reflected lights (eg, reflected light 234) from the light quantity value of each of the one or more second reflected lights (eg, reflected light 234). It may include steps.
- the step S1760 may include determining, by the processor 310, an angle of the image plane with respect to the reference plane R based on the phase value.
- the processor 310 corrects the upper surface of the object represented by the second three-dimensional shape (for example, the first three-dimensional shape) based on the angle of the upper surface, so that the first three-dimensional shape (for example, : A second 3D shape) may be included.
- determining the angle of the image surface may include determining, by the processor 310, an angle of the image surface with respect to the reference plane R based on the corresponding phase value and related information.
- the device 100 may further include one or more third light sources (eg, illumination light source 1010).
- the processor 310 may include at least one first pattern light (eg, one or more first reflected lights (for example, reflected light 214)).
- the second It may include the step of determining a three-dimensional shape (eg, a first three-dimensional shape).
- the method 1700 includes: irradiating white light 1110 by a second light source (eg, patterned light source 230); Changing the optical path of the white light 1110 so that the white light 1110 reaches the upper surface of the beam splitter 240 and one or more lenses 250; And/or the image sensor 220 may further include capturing the fourth reflected light (eg, reflected light 1120) generated by reflecting the white light 1110 from the top surface.
- a second light source eg, patterned light source 230
- the image sensor 220 may further include capturing the fourth reflected light (eg, reflected light 1120) generated by reflecting the white light 1110 from the top surface.
- the step of determining the second three-dimensional shape comprises at least one first pattern of one or more first reflected lights (for example, reflected light 214). Based on the phase change from light (for example, pattern light 212) and the change in the amount of light from white light 1110 of fourth reflected light (for example, reflected light 1120), the second three-dimensional shape of the object (for example, It may include the step of determining the first three-dimensional shape).
- the method 1700 includes, by the processor 310, deriving a reflectance of the upper surface based on a change in the amount of light from the white light 1110 of the fourth reflected light (eg, reflected light 1120); And/or controlling a second light source (eg, pattern light source 230) to sequentially irradiate at least one second pattern light (eg, pattern light 232) when the reflectance of the upper surface is greater than or equal to a preset reference reflectance. It may further include.
- a second light source eg, pattern light source 230
- step S1810 is a diagram illustrating an embodiment of a method 1800 of determining an angle of an object upper surface, which may be performed by the apparatus 1210 according to the present disclosure.
- a first light source (eg, pattern light source 1230) may sequentially irradiate one or more first pattern lights (eg, pattern light 1232) having a phase range.
- the beam splitter for example, the beam splitter 1240
- one or more lenses for example, the lens 1250
- light corresponding to each phase of the corresponding phase range is transferred to a partial area A of the image surface.
- the optical path of one or more first pattern lights may be changed to reach the dispersion.
- the first processor (eg, the processor 1310) from the first device (eg, the device 1220), at least one first pattern light (eg, the pattern light 1232) is a partial area ( First information (eg, information 1270) about at least one first reflected light (eg, reflected light 1234) generated by being reflected from A) may be obtained.
- the first processor may determine an angle of the upper surface with respect to the reference plane R based on the first information (eg, the information 1270).
- the step of determining the angle of the top surface may be performed by the first processor (eg, the processor 1310), at least one first reflected light from the light intensity value of each of the one or more first reflected lights (eg, reflected light 1234). (Eg, reflected light 1234) deriving a phase value of each; And/or determining an angle of the image plane with respect to the reference plane R based on the derived phase value.
- the first processor eg, the processor 1310
- at least one first reflected light from the light intensity value of each of the one or more first reflected lights eg, reflected light 1234.
- the method 1800 includes the step of transmitting, by a first processor (eg, processor 1310), second information indicating an angle of the top surface to a first device (eg, device 1220). It may contain more.
- the second information is that the first device (eg, the device 1220) corrects the upper surface of the object represented by the first 3D shape (eg, the first 3D shape), Can be used to determine the second three-dimensional shape).
- a first processor e.g., processor 1310
- a first device e.g., device 1220
- the method 1800 includes the steps of further irradiating white light by a first light source (eg, pattern light source 1230); And/or the beam splitter (eg, the beam splitter 1240) and one or more lenses (eg, the lens 1250) may further include changing the optical path of the white light so that the white light reaches the upper surface.
- a first light source eg, pattern light source 1230
- the beam splitter eg, the beam splitter 1240
- one or more lenses eg, the lens 1250
- the method 1800 is that a first processor (e.g., processor 1310) controls the communication interface 1330 to indicate the reflectance of the top surface from the first device (e.g., device 1220). Obtaining fourth information; And/or controlling a first light source (eg, pattern light source 1230) to sequentially irradiate at least one first pattern light (eg, pattern light 1232) when the reflectance of the upper surface is greater than or equal to a preset reference reflectance. It may further include.
- a first processor e.g., processor 1310 controls the communication interface 1330 to indicate the reflectance of the top surface from the first device (e.g., device 1220).
- the software may be software for implementing the various embodiments of the present disclosure described above.
- the software may be inferred from various embodiments of the present disclosure by programmers in the art to which this disclosure belongs.
- software may be an instruction (eg, code or code segment) or a program that the device can read.
- the device is a device capable of operating according to a command called from a recording medium, and may be, for example, a computer.
- the device may be the devices 100 and 1210 according to embodiments of the present disclosure.
- the processor of the device may execute a called command, so that components of the device perform a function corresponding to the command.
- the processor may be one or more processors according to embodiments of the present disclosure.
- the recording medium may refer to any type of recording medium in which data is stored that can be read by a device.
- the recording medium may include, for example, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, or the like.
- the recording medium may be one or more memories.
- the recording medium may be implemented in a distributed form such as a computer system connected by a network.
- the software can be distributed, stored, and executed in a computer system or the like.
- the recording medium may be a non-transitory recording medium.
- the non-transitory recording medium refers to a tangible medium irrespective of whether data is semi-permanently or temporarily stored, and does not include a signal propagating in a transient manner.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Manufacturing & Machinery (AREA)
- Theoretical Computer Science (AREA)
- Immunology (AREA)
- Mathematical Optimization (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Algebra (AREA)
- Mathematical Analysis (AREA)
- Chemical & Material Sciences (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
Abstract
Description
Claims (13)
- 기준면 상에 위치한 대상체의 제1 3차원 형상을 결정하는 제1 장치에 결합되어, 상기 기준면에 대한 상기 대상체의 상면의 각도를 결정하는 탈착식 제2 장치에 있어서,한 위상 범위를 가지는 하나 이상의 제1 패턴광을 순차적으로 조사하는 제1 광원;상기 위상 범위의 각 위상에 대응하는 광이 상기 상면의 일부 영역에 분산하여 도달하도록, 상기 하나 이상의 제1 패턴광의 광로를 변경하는 빔 스플리터 및 하나 이상의 렌즈;상기 제1 장치와 통신하는 통신 인터페이스; 및상기 제1 광원 및 상기 통신 인터페이스와 전기적으로 연결된 제1 프로세서를 포함하고,상기 제1 프로세서는,상기 제1 장치로부터, 상기 하나 이상의 제1 패턴광이 상기 일부 영역으로부터 반사되어 생성된 하나 이상의 제1 반사광에 대한 제1 정보를 획득하고,상기 제1 정보에 기초하여, 상기 기준면에 대한 상기 상면의 각도를 결정하는, 제2 장치.
- 제1항에 있어서,상기 제1 정보는 상기 하나 이상의 제1 반사광 각각의 광량 값을 지시하는 정보를 포함하고,상기 제1 프로세서는,상기 하나 이상의 제1 반사광 각각의 광량 값으로부터 상기 하나 이상의 제1 반사광 각각의 위상 값을 도출하고,상기 위상 값에 기초하여, 상기 기준면에 대한 상기 상면의 각도를 결정하는, 제2 장치.
- 제2항에 있어서,상기 기준면에 대한 상기 상면의 각도 및 상기 하나 이상의 제1 반사광 각각의 위상 값 사이의 관계를 지시하는 연관 정보를 저장하는 메모리를 더 포함하고,상기 제1 프로세서는,상기 위상 값 및 상기 연관 정보에 기초하여, 상기 기준면에 대한 상기 상면의 각도를 결정하는, 제2 장치.
- 제1항에 있어서,상기 제1 프로세서는, 상기 통신 인터페이스를 제어하여 상기 상면의 각도를 지시하는 제2 정보를 상기 제1 장치로 전달하고,상기 제2 정보는, 상기 제1 장치가 상기 제1 3차원 형상이 나타내는 상기 대상체의 상면을 보정하여, 상기 대상체의 제2 3차원 형상을 결정하는 데에 사용되는, 제2 장치.
- 제1항에 있어서,상기 제1 프로세서는,상기 통신 인터페이스를 제어하여, 상기 제1 장치로부터 상기 대상체의 상기 제1 3차원 형상을 지시하는 제3 정보를 획득하고,상기 상면의 각도에 기초하여 상기 제1 3차원 형상이 나타내는 상기 대상체의 상면을 보정하여, 상기 대상체의 제2 3차원 형상을 결정하는, 제2 장치.
- 제1항에 있어서,상기 제1 광원은 단색광을 더 조사하고,상기 빔 스플리터 및 상기 하나 이상의 렌즈는 상기 단색광이 상기 상면에 도달하도록 상기 단색광의 광로를 변경하는, 제2 장치.
- 제6항에 있어서,상기 제1 프로세서는,상기 통신 인터페이스를 제어하여, 상기 제1 장치로부터 상기 상면의 반사율을 지시하는 제4 정보를 획득하고,상기 상면의 반사율이 미리 설정된 기준 반사율 이상인 경우, 상기 하나 이상의 제1 패턴광을 순차적으로 조사하도록 상기 제1 광원을 제어하는, 제2 장치.
- 제1항에 있어서,상기 하나 이상의 제1 패턴광 각각은, 제1 방향 또는 상기 제1 방향에 수직인 제2 방향으로의 패턴을 가지는 패턴광이 미리 설정된 위상 간격의 정수배로 위상 천이되어 생성된 패턴광인, 제2 장치.
- 제1항에 있어서,상기 제1 장치는,상기 대상체로 하나 이상의 제2 패턴광을 조사하는 하나 이상의 제2 광원;상기 하나 이상의 제1 반사광 및 상기 하나 이상의 제2 패턴광이 상기 대상체로부터 반사되어 생성된 하나 이상의 제2 반사광을 캡쳐하는 이미지 센서; 및상기 하나 이상의 제1 반사광 및 상기 하나 이상의 제2 반사광에 기초하여, 상기 대상체의 상기 제1 3차원 형상을 결정하고, 상기 제1 3차원 형상을 지시하는 제3 정보를 상기 제2 장치로 전달하는 제2 프로세서를 포함하는, 제2 장치.
- 기준면 상에 위치한 대상체의 제1 3차원 형상을 결정하는 제1 장치에 결합되는 탈착식 제2 장치에서 수행되는, 상기 기준면에 대한 상기 대상체의 상면의 각도를 결정하는 방법에 있어서,제1 광원이, 한 위상 범위를 가지는 하나 이상의 제1 패턴광을 순차적으로 조사하는 단계;빔 스플리터 및 하나 이상의 렌즈가, 상기 위상 범위의 각 위상에 대응하는 광이 상기 상면의 일부 영역에 분산하여 도달하도록, 상기 하나 이상의 제1 패턴광의 광로를 변경하는 단계;제1 프로세서가, 상기 제1 장치로부터, 상기 하나 이상의 제1 패턴광이 상기 일부 영역으로부터 반사되어 생성된 하나 이상의 제1 반사광에 대한 제1 정보를 획득하는 단계; 및상기 제1 프로세서가, 상기 제1 정보에 기초하여 상기 기준면에 대한 상기 상면의 각도를 결정하는 단계를 포함하는, 방법.
- 제10항에 있어서,상기 제1 정보는 상기 하나 이상의 제1 반사광 각각의 광량 값을 지시하는 정보를 포함하고,상기 상면의 각도를 결정하는 단계는,상기 제1 프로세서가, 상기 하나 이상의 제1 반사광 각각의 광량 값으로부터 상기 하나 이상의 제1 반사광 각각의 위상 값을 도출하는 단계; 및상기 제1 프로세서가, 상기 위상 값에 기초하여 상기 기준면에 대한 상기 상면의 각도를 결정하는 단계를 포함하는, 방법.
- 제10항에 있어서,상기 제1 프로세서가, 상기 상면의 각도를 지시하는 제2 정보를 상기 제1 장치로 전달하는 단계를 더 포함하고,상기 제2 정보는, 상기 제1 장치가 상기 제1 3차원 형상이 나타내는 상기 대상체의 상면을 보정하여, 상기 대상체의 제2 3차원 형상을 결정하는 데에 사용되는, 방법.
- 제10항에 있어서,상기 제1 프로세서가, 상기 제1 장치로부터 상기 대상체의 상기 제1 3차원 형상을 지시하는 제3 정보를 획득하는 단계; 및상기 제1 프로세서가, 상기 상면의 각도에 기초하여 상기 제1 3차원 형상이 나타내는 상기 대상체의 상면을 보정하여, 상기 대상체의 제2 3차원 형상을 결정하는 단계를 더 포함하는, 방법.
Priority Applications (7)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/623,498 US12146734B2 (en) | 2019-06-28 | 2020-06-29 | Apparatus and method for determining three-dimensional shape of object |
| EP24206879.9A EP4471371B1 (en) | 2019-06-28 | 2020-06-29 | Apparatus and method for determining three-dimensional shape of object |
| KR1020217042651A KR20220004771A (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
| KR1020247022302A KR102894125B1 (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
| CN202080047589.4A CN114051579B (zh) | 2019-06-28 | 2020-06-29 | 用于确定对象体的三维形象的装置及方法 |
| EP20833192.6A EP3992576B1 (en) | 2019-06-28 | 2020-06-29 | Device and method for determining three-dimensional shape of object |
| US18/898,318 US20250012565A1 (en) | 2019-06-28 | 2024-09-26 | Apparatus and method for determining three-dimensional shape of object |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20190077638 | 2019-06-28 | ||
| KR10-2019-0077638 | 2019-06-28 |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US17/623,498 A-371-Of-International US12146734B2 (en) | 2019-06-28 | 2020-06-29 | Apparatus and method for determining three-dimensional shape of object |
| US18/898,318 Continuation US20250012565A1 (en) | 2019-06-28 | 2024-09-26 | Apparatus and method for determining three-dimensional shape of object |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020263055A1 true WO2020263055A1 (ko) | 2020-12-30 |
Family
ID=74059932
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2020/008462 Ceased WO2020263055A1 (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
| PCT/KR2020/008461 Ceased WO2020263054A1 (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
| PCT/KR2020/008463 Ceased WO2020263056A1 (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2020/008461 Ceased WO2020263054A1 (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
| PCT/KR2020/008463 Ceased WO2020263056A1 (ko) | 2019-06-28 | 2020-06-29 | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 |
Country Status (5)
| Country | Link |
|---|---|
| US (5) | US12135204B2 (ko) |
| EP (6) | EP4471371B1 (ko) |
| KR (7) | KR20220017428A (ko) |
| CN (5) | CN114051579B (ko) |
| WO (3) | WO2020263055A1 (ko) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20240060616A (ko) * | 2021-09-19 | 2024-05-08 | 퀘드 테크놀러지즈 인터내셔날, 엘엘씨 | 재료 제거의 차동 계측을 위한 편향 측정 장치(deflectometry device for differential metrology of material removal) |
| EP4449103A1 (en) * | 2021-12-20 | 2024-10-23 | Scuola universitaria professionale della Svizzera italiana (SUPSI) | Apparatus for acquiring three-dimensional information of objects and surfaces for an artificial vision system for automatic optical inspection of the visual quality of an underlying object, in particular electronic assemblies, circuit boards and the like |
| CN117685902B (zh) * | 2023-12-12 | 2025-03-04 | 苏州大学 | 高反光物体表面重建方法、装置、系统及存储介质 |
| DE102024105881A1 (de) * | 2024-02-29 | 2025-09-04 | Fft Produktionssysteme Gmbh & Co. Kg | Optisches Messsystem und Verfahren zur Prüfung einer Werkstücktopografie |
| DE102024109540A1 (de) * | 2024-04-05 | 2025-10-09 | Isra Vision Gmbh | Verfahren und Vorrichtung zur Ermittlung der Ausrichtung einer Oberfläche eines Werkstücks sowie Verfahren zum Ausrichten einer Vorrichtung am Arbeitspunkt an der Oberfläche des Werkstücks |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010137637A1 (ja) * | 2009-05-27 | 2010-12-02 | 株式会社ニコン | 形状測定装置、形状測定方法、および、製造方法 |
| KR20110086222A (ko) * | 2010-01-22 | 2011-07-28 | 주식회사 고영테크놀러지 | 3차원 형상 측정장치 |
| US8064069B2 (en) * | 2006-04-05 | 2011-11-22 | Isra Surface Vision Gmbh | Method and system for measuring the shape of a reflective surface |
| US8224066B2 (en) * | 2007-05-29 | 2012-07-17 | Gerd Haeusler | Method and microscopy device for the deflectometric detection of local gradients and the three-dimensional shape of an object |
| US20130278723A1 (en) * | 2012-04-20 | 2013-10-24 | Test Research, Inc. | Three-dimensional measurement system and three-dimensional measurement method |
Family Cites Families (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4641972A (en) * | 1984-09-14 | 1987-02-10 | New York Institute Of Technology | Method and apparatus for surface profilometry |
| JPH01320430A (ja) * | 1988-06-21 | 1989-12-26 | Toyota Autom Loom Works Ltd | 光学式変位検出装置 |
| JPH10223168A (ja) * | 1997-02-12 | 1998-08-21 | Hitachi Ltd | 試料分析装置 |
| US7353954B1 (en) | 1998-07-08 | 2008-04-08 | Charles A. Lemaire | Tray flipper and method for parts inspection |
| JP2003017536A (ja) * | 2001-07-04 | 2003-01-17 | Nec Corp | パターン検査方法及び検査装置 |
| KR100612932B1 (ko) * | 2005-12-14 | 2006-08-14 | 주식회사 고영테크놀러지 | 3차원 형상 측정장치 및 방법 |
| US7830528B2 (en) * | 2005-12-14 | 2010-11-09 | Koh Young Technology, Inc. | 3D image measuring apparatus and method thereof |
| CN101011860A (zh) | 2006-02-01 | 2007-08-08 | 海迪斯联合股份公司 | 热熔性塑料管状零件的镜面焊接工具 |
| KR100708352B1 (ko) * | 2006-03-07 | 2007-04-18 | 한국과학기술원 | 모아레 원리의 2π 모호성과 위상천이 수단이 없도록실시되는 3차원 형상 측정장치 및 그 방법 |
| KR20080043047A (ko) * | 2006-11-13 | 2008-05-16 | 주식회사 고영테크놀러지 | 새도우 모아레를 이용한 3차원형상 측정장치 |
| US8115906B2 (en) | 2007-12-14 | 2012-02-14 | Nikon Corporation | Movable body system, pattern formation apparatus, exposure apparatus and measurement device, and device manufacturing method |
| CN103134446B (zh) | 2008-02-26 | 2017-03-01 | 株式会社高永科技 | 三维形状测量装置及测量方法 |
| JP5164002B2 (ja) * | 2008-02-29 | 2013-03-13 | 株式会社ブイ・テクノロジー | レーザ加工装置 |
| WO2009113528A1 (ja) * | 2008-03-11 | 2009-09-17 | 株式会社ニコン | 形状測定装置 |
| JP2010185692A (ja) * | 2009-02-10 | 2010-08-26 | Hitachi High-Technologies Corp | ディスク表面検査装置、その検査システム及びその検査方法 |
| JP2010192470A (ja) | 2009-02-13 | 2010-09-02 | Canon Inc | 計測装置、露光装置及びデバイスの製造方法 |
| DE102010064593A1 (de) | 2009-05-21 | 2015-07-30 | Koh Young Technology Inc. | Formmessgerät und -verfahren |
| KR101150755B1 (ko) | 2009-09-14 | 2012-06-14 | 이제선 | 영상촬영장치 |
| CN102803895B (zh) * | 2010-03-16 | 2015-04-01 | 株式会社尼康 | 高度测定方法、高度测定装置 |
| CN102052907B (zh) | 2010-11-18 | 2012-05-23 | 华中科技大学 | 一种基于投影莫尔原理的bga共面度测量系统 |
| JP5934996B2 (ja) | 2011-12-19 | 2016-06-15 | パナソニックIpマネジメント株式会社 | 三次元形状計測装置 |
| JP5640025B2 (ja) * | 2012-01-27 | 2014-12-10 | Ckd株式会社 | 三次元計測装置 |
| TWI460394B (zh) | 2012-07-20 | 2014-11-11 | Test Research Inc | 三維影像量測裝置 |
| JP6327917B2 (ja) * | 2014-04-11 | 2018-05-23 | 株式会社キーエンス | 形状測定装置、形状測定方法および形状測定プログラム |
| JP2016008941A (ja) * | 2014-06-26 | 2016-01-18 | 株式会社日立ハイテクノロジーズ | 欠陥観察方法及びその装置並びに欠陥検出装置 |
| EP3032241B1 (en) | 2014-12-11 | 2023-03-01 | X-Rite Europe GmbH | Method and apparatus for digitizing the appearance of a real material |
| KR101659302B1 (ko) | 2015-04-10 | 2016-09-23 | 주식회사 고영테크놀러지 | 3차원 형상 측정장치 |
| KR20160121716A (ko) | 2015-04-10 | 2016-10-20 | 한국교통대학교산학협력단 | 하이브리드 조명 기반 표면 검사 장치 |
| JP6574101B2 (ja) | 2015-04-17 | 2019-09-11 | オリンパス株式会社 | 内視鏡システム |
| KR101639227B1 (ko) * | 2015-06-08 | 2016-07-13 | 주식회사 고영테크놀러지 | 3차원 형상 측정장치 |
| JP6532325B2 (ja) * | 2015-07-09 | 2019-06-19 | キヤノン株式会社 | 被計測物の形状を計測する計測装置 |
| JP6109255B2 (ja) | 2015-07-14 | 2017-04-05 | Ckd株式会社 | 三次元計測装置 |
| JP6791631B2 (ja) | 2016-01-06 | 2020-11-25 | 株式会社サキコーポレーション | 画像生成方法及び検査装置 |
| WO2017119118A1 (ja) | 2016-01-08 | 2017-07-13 | オリンパス株式会社 | 標本形状測定方法及び標本形状測定装置 |
| KR102079181B1 (ko) | 2016-03-04 | 2020-02-19 | 주식회사 고영테크놀러지 | 패턴광 조사 장치 및 방법 |
| US10921118B2 (en) * | 2016-07-27 | 2021-02-16 | Vehicle Service Group, Llc | Hybrid 3D optical scanning system |
| US10036630B1 (en) | 2017-05-22 | 2018-07-31 | Asm Technology Singapore Pte Ltd | Three-dimensional imaging using a multi-phase projector |
-
2020
- 2020-06-29 EP EP24206879.9A patent/EP4471371B1/en active Active
- 2020-06-29 WO PCT/KR2020/008462 patent/WO2020263055A1/ko not_active Ceased
- 2020-06-29 EP EP24215144.7A patent/EP4488622A3/en active Pending
- 2020-06-29 US US17/623,508 patent/US12135204B2/en active Active
- 2020-06-29 KR KR1020217042655A patent/KR20220017428A/ko not_active Ceased
- 2020-06-29 US US17/623,498 patent/US12146734B2/en active Active
- 2020-06-29 CN CN202080047589.4A patent/CN114051579B/zh active Active
- 2020-06-29 KR KR1020267004280A patent/KR20260029414A/ko active Pending
- 2020-06-29 KR KR1020247022302A patent/KR102894125B1/ko active Active
- 2020-06-29 EP EP20833192.6A patent/EP3992576B1/en active Active
- 2020-06-29 KR KR1020217042651A patent/KR20220004771A/ko not_active Ceased
- 2020-06-29 CN CN202080047588.XA patent/CN114041039B/zh active Active
- 2020-06-29 WO PCT/KR2020/008461 patent/WO2020263054A1/ko not_active Ceased
- 2020-06-29 EP EP20832687.6A patent/EP3992575B1/en active Active
- 2020-06-29 EP EP24215317.9A patent/EP4492438A3/en active Pending
- 2020-06-29 KR KR1020217042645A patent/KR20220004770A/ko not_active Ceased
- 2020-06-29 EP EP20832482.2A patent/EP3992574B1/en active Active
- 2020-06-29 CN CN202411053934.1A patent/CN118758213A/zh active Pending
- 2020-06-29 KR KR1020247017199A patent/KR102928182B1/ko active Active
- 2020-06-29 CN CN202080047550.2A patent/CN114096800B/zh active Active
- 2020-06-29 KR KR1020247023939A patent/KR20240113986A/ko active Pending
- 2020-06-29 WO PCT/KR2020/008463 patent/WO2020263056A1/ko not_active Ceased
- 2020-06-29 CN CN202411588555.2A patent/CN119468980A/zh active Pending
- 2020-06-29 US US17/623,497 patent/US20220357149A1/en active Pending
-
2024
- 2024-09-26 US US18/898,318 patent/US20250012565A1/en active Pending
- 2024-10-09 US US18/910,749 patent/US20250027766A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8064069B2 (en) * | 2006-04-05 | 2011-11-22 | Isra Surface Vision Gmbh | Method and system for measuring the shape of a reflective surface |
| US8224066B2 (en) * | 2007-05-29 | 2012-07-17 | Gerd Haeusler | Method and microscopy device for the deflectometric detection of local gradients and the three-dimensional shape of an object |
| WO2010137637A1 (ja) * | 2009-05-27 | 2010-12-02 | 株式会社ニコン | 形状測定装置、形状測定方法、および、製造方法 |
| KR20110086222A (ko) * | 2010-01-22 | 2011-07-28 | 주식회사 고영테크놀러지 | 3차원 형상 측정장치 |
| US20130278723A1 (en) * | 2012-04-20 | 2013-10-24 | Test Research, Inc. | Three-dimensional measurement system and three-dimensional measurement method |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3992576A4 * |
Also Published As
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020263055A1 (ko) | 대상체의 3차원 형상을 결정하기 위한 장치 및 방법 | |
| KR101735403B1 (ko) | 검사 방법, 템플릿 기판 및 포커스 오프셋 방법 | |
| US8212869B2 (en) | Substrate inspection method, substrate inspection system and storage medium | |
| KR20110084703A (ko) | 기판 검사장치 | |
| WO2012050375A2 (ko) | 측정장치 및 이의 보정방법 | |
| WO2017183923A1 (ko) | 물품의 외관 검사장치 및 이를 이용한 물품의 외관 검사방법 | |
| CN111146105B (zh) | 一种缺陷检查的装置和方法 | |
| JP6160255B2 (ja) | 太陽電池セル検査装置および太陽電池セル検査装置の画像位置補正方法 | |
| KR20210018879A (ko) | 무 초점(Focus-less) 검사 장치 및 검사 방법 | |
| WO2020080758A1 (ko) | 검사를 위한 장치, 방법 및 명령을 기록한 기록 매체 | |
| KR102211600B1 (ko) | 무 초점(Focus-less) 검사 장치 및 검사 방법 | |
| CN223679090U (zh) | 一种缺陷检测设备 | |
| KR20230171804A (ko) | 정전척 표면 형상 검사 방법 및 장치 | |
| CN116625943A (zh) | 基于四目结构光的3d成像模组及3d成像方法 | |
| WO2021118315A1 (ko) | 테라헤르츠파를 이용한 검사 시스템 | |
| CN112838018A (zh) | 光学量测方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20833192 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 20217042651 Country of ref document: KR Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2020833192 Country of ref document: EP |
|
| WWG | Wipo information: grant in national office |
Ref document number: 202080047589.4 Country of ref document: CN |


