EP2394136A1 - Dispositif de mesure pour mesurer des déformations d'objet pouvant subir une déformation élastique - Google Patents
Dispositif de mesure pour mesurer des déformations d'objet pouvant subir une déformation élastiqueInfo
- Publication number
- EP2394136A1 EP2394136A1 EP10704096A EP10704096A EP2394136A1 EP 2394136 A1 EP2394136 A1 EP 2394136A1 EP 10704096 A EP10704096 A EP 10704096A EP 10704096 A EP10704096 A EP 10704096A EP 2394136 A1 EP2394136 A1 EP 2394136A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- code
- camera
- marking
- synchronization
- marker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 239000011159 matrix material Substances 0.000 claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 25
- 239000003550 marker Substances 0.000 claims description 37
- 238000005259 measurement Methods 0.000 claims description 22
- 230000008859 change Effects 0.000 claims description 16
- 238000000034 method Methods 0.000 claims description 12
- 230000009466 transformation Effects 0.000 claims description 12
- 230000001419 dependent effect Effects 0.000 claims description 11
- 230000003287 optical effect Effects 0.000 claims description 10
- 230000005489 elastic deformation Effects 0.000 claims description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 238000001514 detection method Methods 0.000 abstract description 6
- 238000006073 displacement reaction Methods 0.000 description 11
- 238000011161 development Methods 0.000 description 8
- 230000018109 developmental process Effects 0.000 description 8
- 238000005286 illumination Methods 0.000 description 6
- 238000013519 translation Methods 0.000 description 6
- 230000014616 translation Effects 0.000 description 6
- 238000005452 bending Methods 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000002349 favourable effect Effects 0.000 description 3
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 2
- 238000004026 adhesive bonding Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000000969 carrier Substances 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000010355 oscillation Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000003313 weakening effect Effects 0.000 description 2
- 241000282326 Felis catus Species 0.000 description 1
- 235000003332 Ilex aquifolium Nutrition 0.000 description 1
- 241000209027 Ilex aquifolium Species 0.000 description 1
- 229910000831 Steel Inorganic materials 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 239000011888 foil Substances 0.000 description 1
- 238000011065 in-situ storage Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 239000010959 steel Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/16—Measuring arrangements characterised by the use of optical techniques for measuring the deformation in a solid, e.g. optical strain gauge
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F03—MACHINES OR ENGINES FOR LIQUIDS; WIND, SPRING, OR WEIGHT MOTORS; PRODUCING MECHANICAL POWER OR A REACTIVE PROPULSIVE THRUST, NOT OTHERWISE PROVIDED FOR
- F03D—WIND MOTORS
- F03D17/00—Monitoring or testing of wind motors, e.g. diagnostics
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F05—INDEXING SCHEMES RELATING TO ENGINES OR PUMPS IN VARIOUS SUBCLASSES OF CLASSES F01-F04
- F05B—INDEXING SCHEME RELATING TO WIND, SPRING, WEIGHT, INERTIA OR LIKE MOTORS, TO MACHINES OR ENGINES FOR LIQUIDS COVERED BY SUBCLASSES F03B, F03D AND F03G
- F05B2260/00—Function
- F05B2260/80—Diagnostics
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F05—INDEXING SCHEMES RELATING TO ENGINES OR PUMPS IN VARIOUS SUBCLASSES OF CLASSES F01-F04
- F05B—INDEXING SCHEME RELATING TO WIND, SPRING, WEIGHT, INERTIA OR LIKE MOTORS, TO MACHINES OR ENGINES FOR LIQUIDS COVERED BY SUBCLASSES F03B, F03D AND F03G
- F05B2270/00—Control
- F05B2270/80—Devices generating input signals, e.g. transducers, sensors, cameras or strain gauges
- F05B2270/804—Optical devices
- F05B2270/8041—Cameras
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E10/00—Energy generation through renewable energy sources
- Y02E10/70—Wind energy
- Y02E10/72—Wind turbines with rotation axis in wind direction
Definitions
- the invention generally relates to the measurement of elastic deformations.
- the invention relates to the measurement of deformations of an object, such as an elongate carrier, such as a windmill blade or a wing.
- strain gauges In order to detect deformation of carrier elements, in particular strain gauges (DMS) are known.
- a device which comprises a camera and a light source, wherein the light source causes an illumination of the rotating component during operation, while the camera receives an image of the component during operation.
- a controller compares the images of the component to changes in the component
- the camera rotates with the component and provides images of at least one target portion of the component.
- the controller makes a comparison of the received images for detecting changes in the component. Because to verify a deformation the
- Marking must always be in the field of vision of the camera, the system is primarily suitable for detecting small deformations.
- WO 2004/038328 A2 is based on attaching one or more cameras to a first part of an aircraft structure and target objects to a second part of the aircraft structure to detect deformations of an element of an aircraft, the target objects in view of the one or more cameras lie. It will take a series of pictures and processed to determine the size and direction of movement of the target object (s).
- Wind turbine is directed through to a target object.
- the laser beam is recorded on the target object.
- the wind direction is determined.
- US 7377181 Bl describes a measuring system for the detection of stresses in test bodies. For this purpose, a marking pattern with coded markings is applied to a test body. Based on the coded markings, targets are identified by means of a camera. To determine material stresses, changes in the distance of the target marks are then determined on the basis of the camera images. This method is accordingly sensitive to stretching or compression, but relatively insensitive to bending.
- the invention is therefore based on the object to solve the above problems, especially for longer measuring distances.
- This object is solved by the subject matter of the independent claims.
- Advantageous embodiments and further developments of the invention are specified in the respective dependent claims.
- the invention provides a device for measuring deformations of an elastically deformable object, preferably an elongate support structure.
- This device comprises at least one optically detectable marking at a first longitudinal position along the elastically deformable object, and at least one electronic camera with an objective and a matrix sensor, wherein the lens of the camera is directed to the at least one optically detectable marker such that the marker is imaged onto the matrix sensor and the camera looks longitudinally along the elastically deformable object at the marker.
- the device for measuring deformations further comprises an image processing device to which the image data are supplied to the camera.
- Image processing device is set up to determine the position of the marking within the image field on the basis of an image recognition. It is also one
- Calculating device provided, which is adapted to determine a deviation of the position of the marking of at least one desired value and quantify.
- a method for measuring deformations of the elastically deformable object such as a support structure is performed, wherein at least one optically detectable mark at a first longitudinal position along the elastically deformable object, and at least one electronic camera with a
- Lens and a matrix sensor is used, the lens of the camera is directed to the at least one optically detectable marker, such that the marker is imaged on the matrix sensor and the camera looks at the marker (for example, in FIG.
- an image processing device Longitudinal direction along an object in the form of an elastically deformable support structure), wherein an image processing device, the image data to the camera are supplied, and wherein the image processing device performs an image recognition, so that the position of the marker within the image field is determined, and wherein by means of a computing device determines a deviation of the position of the marker of at least one target value and the position the marker within the image field is quantified.
- the invention allows a highly accurate detection of deformations of the elastically deformable object without strain gauges.
- the installation effort is considerably reduced, since a gluing of the strain gauge is eliminated.
- the camera is arranged at a second longitudinal position spaced from the first longitudinal position in the longitudinal direction.
- the camera it is also possible to arrange the camera outside the elastically deformable object.
- the camera preferably looks in the longitudinal direction along the object, such as in particular an elongate support structure on the marking. This can be done in a simple way by an arrangement in extension of
- Longitudinal direction of the support structure or by an optical deflecting element in the beam path, such as a mirror or a prism can be realized.
- cavities in the object by the marker is disposed within a cavity.
- Such cavities are especially with elongated support structures often present.
- various carriers such as tubular or bay-shaped carriers are hollow inside. It is then generally advisable to illuminate the marking by means of a lighting device.
- Markings provided at different distances from the camera are provided in the longitudinal direction, wherein the computing device is set up to determine and quantify a change in length or an uneven deformation of the support structure or another object on the basis of a comparison of the positions of the two markings.
- Such an uneven deformation can be done by measuring the deformation in two distances. If there is a normal deformation, such as a deflection, then both marks are on or near a setpoint curve. A deviation of the position of the markings from the curvature curve known from the structure can be caused for example by a kink or a local weakening of the structure. If such a deviation is detected, for example, a warning signal can be generated or the device can be switched off with the carrier or another elastically deformable object, or moved to a safe state.
- the invention will be described below with reference to the deformation of an elastically deformable carrier. The invention can equally be applied to other elastically deformable objects in the same way.
- Distinguishing features could be different "colors" (wavelengths of reflection) or mounting directions. The distinguishing features could also be combined. If different "colors" are used, they can be distinguished by a color camera or by different illuminations. An encoding of different markings can be achieved in an advantageous manner by one or more wavelength-selective filters, in particular color filters on the markings. Then, in different embodiments, the different markings with different wavelengths can be illuminated and selectively evaluated in a further development of the invention.
- a plurality of reflectors can be arranged one behind the other and viewed with the camera in an axis or at an angle, wherein the lateral and / or axial displacement is evaluated.
- a marking with at least two marking elements spaced laterally from the viewing direction is used, whereby a torsion of the elastic, elongate carrier structure is determined and quantified on the basis of a rotation of the marking elements in the image plane. Due to the torsion, the marking elements rotate about a pivot point in the image plane. The fulcrum does not have to lie within the image field itself. However, the torsion then still leads to a change in the angle of the path connecting the two elements.
- a suitable illumination of the marking can be realized by a laser by the laser is aligned parallel to the viewing direction of the camera on the marking.
- a cheap, space-saving option is, for example, to couple the laser by means of a beam splitter paraxial to the viewing direction of the camera. The coupling can also be done within the lens, or within the camera.
- the invention is used to determine deformations at longer distances.
- the length of the optical path between the matrix sensor and the marking can be at least 4 meters, preferably at least 6 meters. If the measuring device according to the invention is installed in the interior of a carrier structure, the distance between the marking and the camera, or more generally the length of the optical path along the longitudinal direction of the carrier structure in essentially only limited by the fact that the mark is shadowed by a deflection of the limiting walls.
- a control can be constructed, with which deformations of the support structure is counteracted.
- a control device is provided with a device according to the invention for measuring deformations, wherein the control device comprises an actuating device with at least one actuator, with which the elastic deformation is counteracted in response to the fact that the calculation device has quantified a deviation of the marking from a desired position , Adjustment may in particular be made dependent on the deformation exceeding or reaching a predefined limit value.
- an aerodynamic wing having a means for measuring deformations as described herein, and a rotor of a wind turbine, the rotor comprising such an aerodynamic wing. It is expedient to arrange at least the marking of the measuring device in the interior of the wing and to provide an active illumination of the mark.
- the camera can be housed in the wing, or rotor blade itself. But it also makes sense to arrange the camera in the rotor hub. Thus, electrical or electronic elements within the rotor blade can be avoided.
- the invention can also be used in the tower of the wind turbine, which carries the rotor.
- the invention can be used here in a particularly advantageous manner together with a control device as described above, wherein the actuator comprises an actuator for adjusting the angle of attack, and wherein the adjusting device changes the angle of attack of the rotor blade.
- the buoyancy of the wing may be changed by means of one or more actuators. This is especially thought of the flaps on the wings of an aircraft.
- the marking is attached at a defined distance to the support structure.
- the measuring device self-calibrating.
- the length of the optical path from the matrix sensor to the marking is determined by a transit time measurement of a light beam or by the size of a pattern projected onto the marking.
- a laser may project a grid onto the surface of the pattern.
- the distance from the camera can then be determined automatically by triangulation in a simple manner.
- it is also possible depending on the design of the marker based on the Size of the marking or the distance of marking elements in the image plane by triangulation to calibrate.
- the marking can be given by points or stripes or similar structures that contrast with the surroundings of the marking.
- vibrations of the support structure such as. measure about one wing directly.
- an image sequence is recorded and determined on the basis of the course determined by the individual images of the change in position of the marking of at least one of the parameters amplitude and frequency of the vibration by means of the computing device.
- the tag comprises a code in which a location information of the Position of the code is coded, wherein the computing means is adapted to decode the code and thus determine the location of the field of view of the camera on the object. On the basis of a so determined spatial displacement of the deformation can then be determined relative to a reference position. In particular, the location shift can be determined with subpixel resolution.
- the code may include the shape of a strip and / or dot pattern or any symbols such as characters, textures, color markers in which position data are encoded include. Is the information of the code by the
- Image processing device decoded is directly a location information ready, which provides the location of the image field on the coded object, preferably its center.
- the code thus represents a position code, preferably in two dimensions. If the carrier structure deforms, the location of the field of view of the camera moves over the code in accordance with the relative movement between the camera and the code due to the deformation.
- the determination of the position of the field of view based on the code in the field of view has the particular advantage that a large measuring range is achieved with simultaneously high measuring accuracy. Even with large deformations, the marker does not get out of sight of the camera, because new code elements in the field of view of
- Deedieren decoding the location information efficient or economical lighting can be provided which only illuminate the field of view of the camera or even only part of the face or Magnoliafekds the camera.
- the corresponding method for measuring deformations of an elastically deformable object, in particular an elastic, elongate support structure is accordingly based on at least one optically detectable marking at a first longitudinal position along the elastically deformable object, as well as at least one electronic camera with an objective and a matrix.
- the lens of the camera is directed to the at least one optically detectable marker, such that the marker is imaged on the matrix sensor and the camera looks at the marker, wherein an image processing device, the image data are supplied to the camera, and wherein the image processing device performs an image recognition, so that the position of the marker within the image field is determined, and wherein by means of a computing device determines a deviation of the position of the marker of at least one desired value and based on the Pos the mark within the image field is quantified, the mark comprising a code in which a location information of the
- Position of the code is coded, wherein the computing device decodes the code and thus determines the location of the field of view of the camera on the code
- a synchronization pattern such as a grid as an example, is preferably included.
- a code it is sufficient, a very small code detail with a light source, such as a ' collimated laser to illuminate and capture with a camera and then the intersection of the optical axis of the camera or a defined optical axis shifted point with the code and thus the shift to the grid origin, expressed in one discrete number of raster elements.
- location information in particular location coordinates are encoded in the code. These do not have to specify the location position in absolute units to a given reference point. Rather, a relative indication is sufficient. As a relative indication, therefore, in a very simple case, for example, a unique numbering of the code units, which may also be repeated cyclically, may suffice as location information. The number of each code unit then corresponds to a specific location on the object.
- the measuring accuracy is determined, among other things, by the precision of the raster detection. Particularly advantageous are therefore fast, preferably subpixel accurate Edge detectors as part of the image processing device.
- the measurement of the change in position of the pattern with respect to the reference position can then be carried out as follows by the measuring device and its correspondingly configured image processing and computing device:
- contours are approximated by digital lines, points of intersection of the grid lines are determined. These intersections are stored in ordered order in a matrix matrix, whereby intersections connected by digital links are stored in identical rows or columns of the matrix, unoccupied points are marked as open (disabled).
- Image processing device and the computing device at least partially or even completely integrated in the camera.
- the location information of the code it is not necessary for the location information of the code to correspond in absolute terms to the location position. Relative information is also sufficient if one Calibration is performed. However, it is also advantageous if it is known at which intervals along the code the location information is stored. In this case, directly from the decoding of the location information, the absolute amount of the lateral shift of the mark caused by a deformation of the support structure can be obtained. If, for example, it is known that the location information is stored at specific intervals, for example of one centimeter, the displacement of the pattern relative to the reference position can be achieved by simple
- Particularly suitable is a two-dimensional code. With such a code can improve the
- Measuring accuracy in a simple manner several independent measuring fields can be realized by e.g. with a second camera another position is determined. It is also possible to mount the code on a non-planar surface and to scan two spaced-apart areas at an angle to one another. In such a code as a marker, location information for the locations is then coded along two non-parallel, preferably perpendicular directions. Accordingly, by decoding the code from the image information by means of the image processing device, a shift relative to a reference position along two non-parallel axes can be obtained.
- Mark appropriate, a route, or in the case of a two-dimensional code an area with the marker to cover, which are so large that the shifts due to the elastic deformations to be measured within the distance, or area lie.
- part of the code in the image field particularly preferably also in the middle of the image, is visible.
- Location information is not limited to elastic deformations of objects. Rather, this embodiment of the invention is quite generally suitable for the detection and quantification of movements of objects in any direction.
- a device for measuring a change in position, in particular translation and rotation of an object which comprises an optically detectable code with code units applied to the object, in which a location information, preferably in the form of absolute or relative location coordinates, is coded is.
- a location information preferably in the form of absolute or relative location coordinates
- At least one camera with a matrix sensor is provided, with which the object or the code on the object can be detected.
- the measuring device in turn comprises an image processing and computing device.
- an assignment table is stored in which the geometric positions of at least some code units are stored at a reference position.
- the image processing device is, as described above, configured to recognize and decode the code, thereby associating the decoded location information with an image position.
- the computing device is set up to determine the transformation, preferably in the form of a principal axis transformation, which transfers the reference position according to the allocation table into the current position detected by the camera at which the code was decoded at the image position.
- transformation parameters describe the change in position of the object.
- the two-dimensional code has at least one, preferably all, of the following properties:
- the code comprises a pattern containing a synchronization synchronization code and a position-dependent code, position data encoded in fixed-size code units,
- the code comprises a pattern which comprises a synchronization code used for synchronization, this synchronization code being variable, being formed according to a previously known formation instruction and being distributed geometrically uniformly on the surface,
- the code comprises a pattern comprising a synchronization synchronization code, which comprises two variable components each for synchronization along two non-parallel directions on the surface,
- the code comprises a pattern which comprises a synchronization synchronization code which itself contains position-dependent data, preferably the least significant bit (s) of the coded position data,
- the code comprises a pattern which comprises a synchronization code used for the synchronization, the synchronization code being distributed geometrically uniformly over the pattern,
- the code comprises a pattern which contains a synchronization synchronization code which is at least twice the spatial frequency compared to the position-dependent code
- Position data are encoded in units of fixed size, the location information is not completely present in a code unit, with a complete decoding of the location information by detecting a field at most six times the size of a code unit, preferably at most four times the size of a code unit is possible.
- the code can be reduced according to a further development of the invention to code units having a size of at most 10 x 10, preferably at most 8 x 8, even of only 6 x 6 fields, each of the fields is a marker that a Represents bit.
- the code units may be considered as laterally spaced marker marker elements as described above.
- the code described above is optimized in terms of its information density.
- the code can be stably read with a suitably adapted decoding method even with a small field of optional form.
- the code is arranged at least partially on a surface arranged obliquely to the viewing direction, wherein the marking is arranged with the code that of the camera or of several Cameras are simultaneously detected at different distances along the longitudinal direction of the support structure arranged code elements in which location information is encoded.
- the code is applied to at least two mutually angled surfaces.
- the opposite to the viewing direction of the camera obliquely arranged code can have a grid which is equidistant, or even projection corrected.
- an assignment table of coordinates preferably three-dimensional coordinates are stored to location information of the code.
- the allocation table can, as will be described in more detail below, inter alia, by projection of a
- the invention can be used to provide the functionality of a support structure, such as a
- Rotor blades of a wind turbine to monitor, control and / or regulate. This can also be done in a forward-looking or extrapolating manner by comparing movement patterns measured by the computing device with stored movement patterns.
- movement patterns measured by the computing device An example is a vibration with still allowed, but aufschaukelnder amplitude.
- a suitable control such as by changing the angle of attack.
- Fig. 1 is a view of a rotor of a wind turbine with
- FIG. 5 shows a variant of the rotor of FIG. 1,
- FIG. 6 shows a video recording of the camera of the markings in the rotor blade of the example shown in FIG. 5,
- Fig. 9 shows an arrangement with a code with projection-corrected raster.
- Fig. 1 shows a wind turbine rotor 1 according to the invention with three wings 5.
- Each of the wings 5 forms an elastically deformable support structure.
- the rotor accommodates parts of a device for measuring deformation of the wings, the principle of which is explained below.
- the Task of the measuring device is now to measure the deflection of the wing 5 of the wind turbine in two axes.
- the device for measuring deformations is based on at least one optically detectable marking 7 at a first longitudinal position along the wing 5, and an electronic camera 9 with an objective 11 and a matrix sensor, wherein the lens 11 of the camera on the at least one optically detectable Marking is directed such that the mark 7 is imaged on the matrix sensor and the camera 9 in the longitudinal direction along the wing 5 looks at the mark 7, wherein the means for measuring deformations further comprises an image processing device which the image data of the camera and wherein the image processing device is set up to determine the position of the marking within the image field by means of an image recognition, wherein the device for measuring deformations additionally comprises a computing device which is set up, a deviation of the position of the marking from at least one nominal value determine and quantify.
- the image processing device and the computing device are not explicitly shown in FIG. 1. However, these devices can also be integrated in the camera 9, so that the camera 9 at an output already outputs the data of the deviation from the target position, for example, the position of the stationary rotor in calm.
- the camera is installed in the hub 3 of the rotor 1. This is beneficial to avoid electronic elements in the rotor blades.
- the rotor hub can be compared to the wings 5 easier shielded from lightning, so that the camera is protected from a lightning due to failure.
- the position of the marking 7 moves transversely with respect to the longitudinal axis of the wing, which also represents the viewing direction of the camera.
- the position of the image of the mark on the matrix sensor of the camera 9 shifts. If the distance of the camera 9 to the mark is known, the deformation at the location of the mark can be easily calculated from the displacement by means of the computing device.
- the distance of the matrix sensor of the camera 9 to the marking is preferably at least 4 meters, particularly preferably at least 6 meters, between the matrix sensor and the marking in order to be able to measure a bending of the blade with high accuracy.
- a control device can generally be provided with which the deformations can be counteracted.
- the control device comprises for this purpose, an adjusting device with at least one actuator, which is counteracted in response to the fact that the calculator a deviation of the mark from a desired position, in particular the exceeding of a limit value, the elastic deformation is counteracted.
- an actuator for adjusting the angle of attack of the blades 5 is used, so that the adjusting device changes the angle of attack of the rotor blade as a function of the measured deformation.
- Fig. 2 shows a cross section through the wing 5.
- the wing 5 comprises an upper shell 51 and a lower shell 52, between which a spar 54 is arranged.
- a shaft-shaped cavity 56 extends.
- the other intermediate spaces 55 and 57 may be hollow.
- at least the marking 7 of the measuring device is arranged in the interior of the blade 5.
- the marking in the spar 54 in the shaft-shaped cavity 56 is used in FIG. So that the camera 9 can detect the mark 7, an active illumination of the mark is provided.
- Housing 91 of the camera 9 LEDs 92 is provided, which objects along the line of sight of the camera, in installed state so along the longitudinal direction of the wing 5 illuminate.
- the marker In order to obtain a high contrast in the recorded images, it is then still favorable to form the marker as a reflector.
- FIG. 4 schematically shows a camera image 94 of the image sequence which is typically recorded continuously at the intended image repetition rate during operation. Recognizable in the camera image is the mark 7, which is shifted relative to the reference position 70. The camera 9 and the lighting is controlled or adjusted so that the light signal of the reflector controls the camera well, but preferably not overridden. There is a focal point determination of the reflector image. With the known properties of the lens of the camera, the deflection of the light spot relative to the reference position 70 in two directions is determined. In the case of a wing 5 represents the
- Reference position preferably the position of the mark 7 in calm, in which no significant forces except the moments caused by the dead weight act on the wing.
- FIG. 5 shows a variant of the rotor 1 from FIG. 1.
- two markings 7, 71 spaced apart from the camera 9 along the longitudinal direction of the blade are provided. Based on the position of these markers 7, 71, it is then also possible to determine and quantify an uneven deformation of the carrier structure.
- the markers 7, 71 may each comprise two or more marking elements spaced laterally from the viewing direction. Then, based on a rotation of the marking elements in the image plane, a torsion of the elastic, elongated support structure, or in the example of FIG. 5, a torsion of the wing 5 can be determined and quantified.
- FIG. 6 shows an image from the video sequence recorded by the camera 9 of the rotor 1 shown in FIG. 5.
- Each of the markers 7, 71 in the example illustrated in FIG. 6 comprises two laterally spaced marking elements.
- the marking elements 701, 702 of the marking 7 and the marking elements 704, 705 of the marking 71 are also arranged along mutually transverse, here in particular along mutually perpendicular lines.
- the marking elements have discrete properties, such as different color or shape. This is symbolized in Fig. 6 by the different filling of the here circular marking elements.
- An encoding of the various markings 7, 71 can also be advantageous by one or more wavelength-selective filters, such as in particular color filters on the markings.
- the different markings with different wavelengths can be illuminated and selectively selected at different times in a further development of the invention be evaluated. This can be particularly advantageous if more than two markers are used and are to be discriminated.
- the markers 7, 71, or their marking elements 701, 702 and 7004, 705 form as reflectors, so that a high image contrast in the viewing direction paraxial illumination, for example by light-emitting diodes or one or more lasers to achieve.
- the position of the markers 7, 71 is now derived from two reflector images. From the distance between the two reflector images can now also the mounting distance of
- Reflectors, or the markers 7, 71 measured to the camera and so the measuring arrangement are calibrated, since the real distance of the marking elements belonging to a mark 7, 71, 702, or 704, 705 is known.
- the distance of the marking elements 704, 705 is smaller than the distance of the marking elements 701, 702.
- the marking 71 is provided that the real distance is equal, thus further from the matrix sensor Camera removed.
- the following parameters can be used for the measuring device:
- the working distance, or the length of the optical path between sensor and marking is selected within a distance of about 40 meters.
- the measurement time is 16, 6 milliseconds corresponding to a refresh rate of 60 frames per second.
- Measurable are the large X-deflection, Y-deflection, rotation, distance of the marking, oscillation amplitude and oscillation frequency up to typically 20 Hertz.
- FIG. 7 shows an example of how, based on a comparison of the positions of the two markings, an uneven deformation of the carrier structure, in particular a non-uniform deflection of the vane 5, can be determined and quantified.
- Fig. 7 diagrams of the deflection .DELTA.x of the wing as a function of the distance D to the hub are shown.
- the marker 7 is located at the position dl and the marker 71 at the position d2.
- the solid curve shows an example of a normal, uniform deflection of an intact wing. If the wing has a kink, or for example also a crack, which leads to the weakening of the structure of the wing, there is an increased deflection behind the crack or kink. Such an exemplary deflection curve is shown in dashed lines. Accordingly, the ratio of the deflections .DELTA.x is greater here. Is based on the measurement data from the
- the bend can be measured in two distances. This makes it possible to check whether the wing is evenly bent, or whether there is a kink, because the two points are no longer on the curve known from the structure curve. It is also possible according to a further embodiment of the invention, in addition to or alternatively to a position determination of marking elements, to provide a marking in the form of a code in which location information is coded. This offers, inter alia, the advantage that the deformation of a carrier structure can always be determined on the basis of the imaged and decoded information relating to the image center or any other reference point in the image plane. This eliminates measurement errors that can be caused by distortion of the lens.
- the tag comprises a code in which location information of the local position of the code is coded, wherein the calculating means is adapted to decode the code and thus to determine the location of the field of view of the camera.
- Location information for the locations along two non-parallel, preferably vertical directions is encoded.
- a preferred code and its arrangement as marking in or on the support structure will be described in more detail.
- a camera 9 and one or more markings in the form of labein with the code are again arranged in a volume of the support structure.
- the label or labels are arranged not only on a single planar surface, but on at least two mutually angled surfaces or surface elements, for example on a curved surface.
- FIG. 8 An exemplary arrangement with obliquely facing surfaces 76, 77, which is provided with a mark in the form of a two-dimensional code, is shown in FIG. 8
- the grid can be equidistant or projection-corrected, so that the resolution and thus measurement accuracy for the directions considered is approximately constant.
- the raster width of the matrix or the raster of the code on the surface 76 which is essentially perpendicular to the viewing direction 95 of the camera 9, has a value a, while the raster width of the code is at an angle ⁇ to the viewing direction 95 the camera 9 standing surface 77 in the viewing direction by a value a / sin ( ⁇ ) is increased.
- the individual grids 710 represent individual bits of the code.
- the fields are formed differently contrasting depending on the bit value. For example Dark and light, or absorbing and reflecting fields can be used.
- the bit values are represented in FIG. 9 by different fillings of the grid fields. For example, the hatched fields may represent logical zeros and the non-hatched fields may represent logical ones or vice versa.
- the code can - in contrast to a simple raster - ensure an absolute reference point. It is possible to endlessly print or otherwise produce a suitable code by distributing the information two-dimensionally in a particular manner so that the global positioning can be fully calculated from a maximum of 4 6x6 grid environments.
- a two-dimensional code as is preferred for the invention is known from EP 1333402 A1.
- the arrangement of the code on a plurality of surfaces or surface elements that are at different distances from the camera, such as the exemplary arrangement of the surfaces 76, 77 is used according to the arrangement shown in Fig. 5 to detect a deformation along the line of sight.
- code units are decoded on a plurality of area elements arranged at different distances and their location information is evaluated. If there is a shift in the longitudinal direction, the location information at certain assigned image parts also change relative to one another. Instead of evaluating different image parts, it is also possible to use a plurality of cameras which detect different surface elements.
- Codes are applied to a plurality of faces arranged one behind the other in the viewing direction of the camera, so that nonlinear deformations can be detected with several measuring points, and / or to increase the measuring accuracy.
- a film (or similar structure) printed with such a code is now glued or otherwise secured to the object to be measured. Due to the special structure of the information arrangement phase and frequency of the local grid can be determined (similar to large 2D barcodes, FFT or chain processing). In this case, a code-internally used scrambling method can ensure a high local contour density.
- defined points P ⁇ (x, y, z) of the grid can be assigned 3D coordinates.
- This table can then be stored in the computing device for calculating the current position, or the deformation of the support structure.
- angles result from the central projection of the camera image through the aperture of the lens.
- angle ⁇ the displacement of the labeled object relative to a reference position can be output by matching by determining the parameters of a main axis transformation. Measurable are the
- Displacement vector (XO, YO, ZO) and the rotation in three angles ( ⁇ , ß ⁇ , ⁇ ).
- the reference position is not known, for example if the exact shape to which the grid has been stuck, or the distance of the code to the camera is not determined, the following can be carried out according to an embodiment of the invention:
- a point cloud or second grating is projected onto the screen from a known position (e.g., donated on the housing).
- a known position e.g., donated on the housing.
- a complementary color e.g. If the grid is printed in red, the laser creates its structure without contrast errors. The blue spectral range can then be used for the inspection. It will be apparent to those skilled in the art that there are many more possibilities for this.
- a calibration of both the distance, as well as the position of the surface can also be made on the basis of a comparison of the known grid width with the grid width detected in the camera.
- the two-dimensional code has the following characteristics: the code comprises a synchronization code serving synchronization and a position-dependent code, the position data being encoded in code units of fixed size.
- the synchronization code is variable and geometrically evenly distributed on the surface.
- the synchronization code also allows the synchronization in the X and Y directions by means of two variable components.
- the code comprises a synchronization code serving synchronization and a position-dependent code, the position data being encoded in code units of fixed size.
- the synchronization code is variable and geometrically evenly distributed on the surface.
- the synchronization code also allows the synchronization in the X and Y directions by means of two variable components.
- the code comprises a synchronization code serving synchronization and a position-dependent code, the position data being encoded in code units of fixed size.
- the synchronization code is variable and geometrically evenly distributed on the surface.
- the synchronization code also allows the synchronization in the X and Y directions by means of two variable components.
- Synchronization code variable such that it contains even position-dependent data, preferably the one or more least significant bits of the coded position data. It is also possible to use the only slowly changing must-significant bit.
- the synchronization code can be compared with at least twice the spatial frequency to the position-dependent code.
- the above embodiments relate to the, or the wings of a wind turbine.
- the invention can also be used in a corresponding manner for aircraft wings.
- it makes sense not to change the angle of attack of the wing depending on the deformation, as long as the wings are as usual in general, rigid.
- it is possible here to regulate the buoyancy by means of one or more rudders and flaps, such as the ailerons and spoilers or flaps.
- the attitude can be stabilized by a control device which controls the flaps and / or rudders by means of the measurement of the deflection and / or twisting of the wing.
- a measuring device can also advantageously be provided in the aircraft fuselage in order to be able to detect loads on the carrier structure here. It will be apparent to those skilled in the art that the invention is not limited to the embodiments described above, but can be varied in many ways. In particular, the invention can also be applied to other support structures and elastically deformable objects.
Landscapes
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Sustainable Development (AREA)
- Sustainable Energy (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
L'invention porte sur un dispositif de mesure de déformations d'une structure portante élastique, de grande longueur, qui comprend au moins un marquage, optiquement détectable, sur une première position longitudinale le long de la structure portante de grande longueur, ainsi qu'au moins une caméra électronique comportant un objectif et un capteur matriciel. L'objectif de la caméra est orienté sur le ou les marquages optiquement détectables de telle sorte que le marquage forme une image sur le capteur matriciel, et que la caméra regarde sur le marquage dans la direction longitudinale le long de la structure portante. Les données images de la caméra sont envoyées à un dispositif de traitement d'images, qui est configuré de façon, à l'aide d'une reconnaissance d'images, à déterminer la position du marquage à l'intérieur du champ image. À l'aide d'un dispositif de calcul, un écart de la position du marquage par rapport à au moins une valeur de consigne est déterminé et quantifié.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102009007938A DE102009007938A1 (de) | 2009-02-06 | 2009-02-06 | Messvorrichtung zum Messen von Verformungen elastisch verformbarer Objekte |
| PCT/EP2010/000738 WO2010089139A1 (fr) | 2009-02-06 | 2010-02-05 | Dispositif de mesure pour mesurer des déformations d'objet pouvant subir une déformation élastique |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP2394136A1 true EP2394136A1 (fr) | 2011-12-14 |
Family
ID=42106054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP10704096A Withdrawn EP2394136A1 (fr) | 2009-02-06 | 2010-02-05 | Dispositif de mesure pour mesurer des déformations d'objet pouvant subir une déformation élastique |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP2394136A1 (fr) |
| DE (1) | DE102009007938A1 (fr) |
| WO (1) | WO2010089139A1 (fr) |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102010023250A1 (de) | 2010-06-09 | 2011-12-15 | Baumer Innotec Ag | Messvorrichtung zum Messen von Verformungen elastisch verformbarer Objekte |
| DE102011016868B4 (de) | 2010-04-13 | 2013-05-16 | Baumer Innotec Ag | Messvorrichtung zum Messen von Verformungen elastisch verformbarer Objekte |
| EP2453136B1 (fr) | 2010-11-16 | 2013-07-24 | Baumer Innotec AG | Dispositif d'alignement pour un dispositif de mesure dans un rotor d'éolienne |
| EP2458322A1 (fr) * | 2010-11-25 | 2012-05-30 | Baumer Innotec AG | Dispositif et procédé de mesure de la déformation d'une lame de rotor lors d'une charge |
| EP2458206A1 (fr) * | 2010-11-25 | 2012-05-30 | Baumer Innotec AG | Dispositif et procédé de mesure de la déformation d'une pale de rotor lors d'une charge et compensation de l'erreur |
| US20110243730A1 (en) * | 2010-12-14 | 2011-10-06 | Eric David Eggleston | Systems and methods for determining deflection of a wind turbine shaft |
| DE102010055500A1 (de) * | 2010-12-22 | 2012-06-28 | Baumer Innotec Ag | Windkraftanlage mit Messvorrichtung zur Messung von Verformungen von Rotorblättern |
| EP2469223A1 (fr) * | 2010-12-27 | 2012-06-27 | Baumer Innotec AG | Dispositif et procédé de mesure de la déformation d'une lame de rotor lors d'une charge |
| DE102010056033A1 (de) * | 2010-12-27 | 2012-06-28 | Baumer Innotec Ag | Rotorblatt einer Windkraftanlage |
| DE102011011392B4 (de) | 2011-02-17 | 2012-10-25 | Ssb Wind Systems Gmbh & Co. Kg | Optische Messeinrichtung für die Verformung eines Rotorblattes einer Windkraftanlage |
| DE102011001268B4 (de) * | 2011-03-15 | 2014-10-23 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Kameraanordnung zum messen von deformationen eines schnell rotierenden objekts sowie rotor oder propeller mit einer solchen kameraanordnung |
| DE102011014480B3 (de) | 2011-03-19 | 2012-06-14 | Ssb Wind Systems Gmbh & Co. Kg | Sensoreinrichtung zur Messung von aerodynamischen Belastungen eines Rotorblattes einer Windkraftanlage |
| EP2511522A1 (fr) * | 2011-04-11 | 2012-10-17 | Baumer Innotec AG | Commande d'angle de lame pour une lame de rotor d'une éolienne |
| EP2511524A1 (fr) * | 2011-04-11 | 2012-10-17 | Baumer Innotec AG | Procédé et dispositif de surveillance d'une pale de rotor pour une éolienne |
| EP2530302B1 (fr) * | 2011-06-03 | 2014-04-30 | Wilic S.Àr.L | Éolienne et procédé de contrôle associé |
| DE102011083749B4 (de) * | 2011-09-29 | 2015-06-11 | Aktiebolaget Skf | Rotorblatt einer Windkraftanlage mit einer Vorrichtung zum Erfassen eines Abstandswertes und Verfahren zum Erfassen eines Abstandswertes |
| DE102011116551A1 (de) | 2011-10-21 | 2013-04-25 | Baumer Electric Ag | Verfahren zur Messung der Verformung eines Rotorblattes |
| DE102014213919A1 (de) * | 2014-07-17 | 2016-01-21 | Siemens Aktiengesellschaft | Verfahren und Prüfanordnung zur Bestimmung der Verformung eines Bauteils |
| EP3339640A1 (fr) | 2016-12-21 | 2018-06-27 | Vestas Wind Systems A/S | Procédé de commande pour éolienne |
| CN107701378B (zh) * | 2017-09-29 | 2019-09-27 | 上海电力设计院有限公司 | 一种风力发电机故障预警方法 |
| FR3075353B1 (fr) | 2017-12-14 | 2020-05-29 | Safran Aircraft Engines | Mesure non intrusive du calage d'une pale |
| GB2574064B (en) * | 2018-05-25 | 2020-05-27 | Imetrum Ltd | Motion encoder |
| DE102019113154A1 (de) | 2019-05-17 | 2020-11-19 | Schenck Rotec Gmbh | Verfahren und Vorrichtung zur Dehnungsmessung an einem fliehkraftbelasteten Körper |
| US20220389905A1 (en) | 2019-10-03 | 2022-12-08 | Syddansk Universitet | A method and a system for tracking motion of a blade |
| GB202009315D0 (en) | 2020-06-18 | 2020-08-05 | General Electric Renovables Espana Sl | A wind turbine blade measurement system and a method of improving accuracy of a wind turbine blade measurement system |
| CN116429003B (zh) * | 2023-04-03 | 2025-08-01 | 大连理工大学宁波研究院 | 一种基于单目视觉的防弯器结构形变实时测量方法及装置 |
| CN118961391B (zh) * | 2024-06-04 | 2025-07-18 | 东南大学 | 基于图像识别的高强线形材料大变形及Agt测量方法 |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4652917A (en) * | 1981-10-28 | 1987-03-24 | Honeywell Inc. | Remote attitude sensor using single camera and spiral patterns |
| WO2002057800A1 (fr) * | 2001-01-22 | 2002-07-25 | Sociedad Anónima De Instalaciones De Control | Ailette et anemometre a flexion |
| ATE408202T1 (de) | 2002-02-04 | 2008-09-15 | Baumer Optronic Gmbh | Redundanter zweidimensionaler code und decodierverfahren |
| GB2394543A (en) * | 2002-10-25 | 2004-04-28 | Univ Bristol | Positional measurement of a feature within an image |
| GB0514149D0 (en) * | 2005-07-09 | 2005-08-17 | Rolls Royce Plc | In-situ component monitoring |
| DE102006002708B4 (de) * | 2006-01-19 | 2007-12-06 | Siemens Ag | Rotor einer Windenergieanlage |
| US7377181B2 (en) * | 2006-03-10 | 2008-05-27 | Northrop Grumman Corporation | In-situ large area optical strain measurement using an encoded dot pattern |
| DK200700647A (en) * | 2007-04-30 | 2008-05-10 | Lm Glasfiber As | Measurement of geometric parameters for a wind turbine blade |
-
2009
- 2009-02-06 DE DE102009007938A patent/DE102009007938A1/de not_active Ceased
-
2010
- 2010-02-05 EP EP10704096A patent/EP2394136A1/fr not_active Withdrawn
- 2010-02-05 WO PCT/EP2010/000738 patent/WO2010089139A1/fr not_active Ceased
Non-Patent Citations (1)
| Title |
|---|
| See references of WO2010089139A1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| DE102009007938A1 (de) | 2010-08-19 |
| WO2010089139A1 (fr) | 2010-08-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2394136A1 (fr) | Dispositif de mesure pour mesurer des déformations d'objet pouvant subir une déformation élastique | |
| DE102011011392B4 (de) | Optische Messeinrichtung für die Verformung eines Rotorblattes einer Windkraftanlage | |
| DE102011016868B4 (de) | Messvorrichtung zum Messen von Verformungen elastisch verformbarer Objekte | |
| EP2040026B1 (fr) | Procédé et système de calibrage d'un appareil de mesure de la forme d'une surface réfléchissante | |
| DE69804128T2 (de) | Kontaktlose lage- und orientierungsmessung | |
| AT506110B1 (de) | Vorrichtung und verfahren zur erfassung von körpermassdaten und konturdaten | |
| DE69826753T2 (de) | Optischer Profilsensor | |
| EP0145745B1 (fr) | Installation pour determiner des erreurs d'alignement pour des arbres disposes les uns derriere les autres | |
| DE102011083749B4 (de) | Rotorblatt einer Windkraftanlage mit einer Vorrichtung zum Erfassen eines Abstandswertes und Verfahren zum Erfassen eines Abstandswertes | |
| DE102006031009B4 (de) | Verfahren und Vorrichtung zum Überwachen des Zustands von Strukturbauteilen | |
| DE102012220923B4 (de) | Messung einer faserrichtung eines kohlefaserwerkstoffes und herstellung eines objekts in kohlefaserverbundbauweise | |
| EP2449338B1 (fr) | Procédé et dispositif destinés à la détermination sans contact de l'épaisseur d'une bande de matériau avec correction du défaut d'alignement | |
| EP2133659B1 (fr) | Procédé et dispositif destinés à la détermination de la position d'un capteur | |
| DE102007029299A1 (de) | Optischer Sensor für Positionieraufgaben | |
| DE102014014386A1 (de) | Verfahren und Vorrichtung zum Bestimmen von Betriebsparametern einer Windkraftanlage | |
| EP2609395A1 (fr) | Capteur d'inclinaison pour un appareil et procédé de détermination de l'inclinaison d'un appareil | |
| EP3004851B1 (fr) | Procédé de détermination de la puissance de réfraction d'un objet transparent et dispositif correspondant | |
| DE102012001446B4 (de) | Anordnung und Verfahren zum Messen der Verformung einer Welle | |
| EP2715279B1 (fr) | Procédé et dispositif de contrôle de la géométrie des trains roulants d'un véhicule automobile | |
| DE102010023250A1 (de) | Messvorrichtung zum Messen von Verformungen elastisch verformbarer Objekte | |
| EP2458206A1 (fr) | Dispositif et procédé de mesure de la déformation d'une pale de rotor lors d'une charge et compensation de l'erreur | |
| DE202012010977U1 (de) | Messung einer Faserrichtung eines Kohlefaserwerkstoffes und Herstellung eines Objekts in Kohlefaserverbundbauweise | |
| DE102010021367A1 (de) | Optische Winkelmesseinrichtung | |
| EP3910314B1 (fr) | Procédé et dispositif d'analyse de l'interaction entre une surface d'un échantillon et un liquide | |
| DE102019008369B4 (de) | Verfahren zur Kalibrierung eines distanzmessenden Sensors eines Fahrzeugs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20110803 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
| DAX | Request for extension of the european patent (deleted) | ||
| 17Q | First examination report despatched |
Effective date: 20140124 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20140604 |