EP4479595A1 - Système de surveillance d'usure des dents pour excavateurs à roue-pelle - Google Patents

Système de surveillance d'usure des dents pour excavateurs à roue-pelle

Info

Publication number
EP4479595A1
EP4479595A1 EP22720454.2A EP22720454A EP4479595A1 EP 4479595 A1 EP4479595 A1 EP 4479595A1 EP 22720454 A EP22720454 A EP 22720454A EP 4479595 A1 EP4479595 A1 EP 4479595A1
Authority
EP
European Patent Office
Prior art keywords
bucket
image
teeth
wear
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP22720454.2A
Other languages
German (de)
English (en)
Inventor
Pradeep PRAJAPATI
Rohit Gupta
Stefan Ebert
Awadesh Kumar Tiwari
Wat KSHITIJ
Tushar Vaidya
Guido TRIEM
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koch Solutions GmbH
Original Assignee
Koch Solutions GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koch Solutions GmbH filed Critical Koch Solutions GmbH
Publication of EP4479595A1 publication Critical patent/EP4479595A1/fr
Pending legal-status Critical Current

Links

Classifications

    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F3/00—Dredgers; Soil-shifting machines
    • E02F3/04—Dredgers; Soil-shifting machines mechanically-driven
    • E02F3/18—Dredgers; Soil-shifting machines mechanically-driven with digging wheels turning round an axis, e.g. bucket-type wheels
    • E02F3/22—Component parts
    • E02F3/24—Digging wheels; Digging elements of wheels; Drives for wheels
    • E02F3/241—Digging wheels; Digging elements of wheels; Drives for wheels digging wheels
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/26—Indicating devices
    • E02F9/267—Diagnosing or detecting failure of vehicles
    • E—FIXED CONSTRUCTIONS
    • E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
    • E02F—DREDGING; SOIL-SHIFTING
    • E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
    • E02F9/28—Small metalwork for digging elements, e.g. teeth scraper bits
    • E02F9/2866—Small metalwork for digging elements, e.g. teeth scraper bits for rotating digging elements

Definitions

  • the invention relates to a monitoring system for monitoring the teeth of a bucket wheel excavator.
  • Bucket wheel excavators usually have teeth on the buckets to loosen the material, which is then transported away by the buckets. As a result, however, these teeth are subject to a very high degree of wear, which is all the greater the harder the material removed. Therefore, these teeth are very important for the removal of the material. On the other hand, complete wear of the teeth would lead to parts of the bucket wheel coming into direct contact with the solid material to be removed, which would damage them. Therefore, it is very important to replace the teeth in time. On the other hand, replacing the teeth naturally involves a downtime and thus a loss of production, so that the replacement is associated with high costs. This means that replacement should always be carried out as late as possible.
  • the teeth To make it easier to replace the teeth, they are often separably connected to the bucket wheel via sleeves. Furthermore, the teeth then have an area which is designed for fastening in the sleeve and another part which digs directly into the material to be conveyed as a wear area. In order to be able to remanufacture the teeth, it is necessary to replace them before the reusable part suffers irreversible damage.
  • One problem here is to automatically assign the recorded data to a specific state of wear. It is therefore the task of the invention to ensure this allocation.
  • the invention relates to a method for monitoring wear of teeth on a bucket wheel excavator.
  • the method comprising the steps of: a) Providing a bucket wheel with fully intact teeth, b) acquiring at least a first image and at least a first angular position of the bucket wheel, c) Determining the first bucket detected in the first image, d) cropping the first bucket in the first image, e) contour detection of the first bucket in the captured first image, f) detecting the tips of the teeth of the first bucket and detecting a first base point of the first bucket, g) determining a vector for each tooth from the first base point to the tip of the tooth in the first image, h) providing a model for a virtual bucket wheel with virtual teeth, i) Fitting the model to teeth with complete remaining life, j) further fitting the model so that the model matches the vectors determined in step g), k) operating the bucket wheel,
  • Step a) involves providing a bucket wheel with fully intact teeth, both a new bucket wheel and retrofitting on an existing bucket wheel after fitting with new teeth.
  • the status of the fully intact teeth is required as a starting point for the procedure to perform a subsequent analysis of the wear.
  • step b) Although it is possible in step b) to detect only one blade and consider it representative of all blades, it is preferable to detect all blades and thus all teeth.
  • Steps c) and d) restrict the image data to be analysed to the region of interest.
  • the adjacent buckets are also masked out.
  • the contour detection in step e) is done, for example, by a conversion to a 2-bit image, for example 1 component of the bucket including the teeth, 0 not component of the bucket.
  • the colour of the pixels can be used for the contour detection in step e).
  • edge detection can be performed directly. This is particularly preferred if only the bucket to be examined is in focus and the depth of field of the capturing camera is selected in such a way that no sharp edge can be captured for other objects captured with the camera.
  • the detection of the tips of the teeth in step f) is preferably done as an identification of the point of the contour which is furthest from the bottom of the bucket for each tooth.
  • the lowest point of the bucket on the underside, the side of the bucket opposite the teeth, is preferably selected as the reference point. This point is particularly suitable due to the position and usual symmetry of the bucket.
  • the model provided in step h) is preferably a 3D model.
  • the 3D model preferably consists of the bucket body, the teeth and the mounting elements that attach the teeth to the bucket body. This makes it possible to take variations into account when inserting the teeth into the mounting elements.
  • the model can also take into account different states of wear of the teeth. Furthermore, the model can also take into account deformations of the bucket body, if these are considered possible during operation.
  • step i) the wear of all teeth is first set to non-existent for the model, since completely intact teeth were provided in step a). Thus, a simple synchronicity between reality and model can be achieved.
  • step j) the model is now fitted to the vectors determined in step g). This creates a direct relationship between the real bucket and the virtual bucket in the model. This relationship can also be used as a constant for the further steps, so that the only remaining variable is the wear of the teeth.
  • the operation of the bucket wheel in step k) can be regarded as a continuous process, which is also preferably not interrupted for the subsequent steps.
  • the operation includes the mining of material, which causes the teeth to dig into the material to be mined and wear out in the process.
  • step I the first bucket with the teeth worn out by the operation in step k) is now detected in comparison with step b).
  • Steps m), n), o), p) and q) are analogous to steps c), d), e), f) and g) respectively.
  • the same algorithms are used.
  • step r only the wear is adjusted in the model, so there is only one degree of freedom per tooth.
  • this degree of freedom is between 100 % remaining service life and 0 % remaining service life.
  • the output is preferably in the form of a percentage value of the service life, particularly preferably with the information that a replacement should take place soon if the value falls below a first threshold value or the information that a replacement should take place immediately if the value falls below a second threshold value.
  • the last two information items can also be displayed in colour, for example in a graphical output (green - no replacement necessary; yellow - replacement soon; red - replacement immediately).
  • the steps b) to g) are performed for each bucket.
  • the adjustment in step j) is performed for all buckets.
  • the steps I) to s) are performed for each bucket.
  • a large number of images are taken and the appropriate images are assigned to the respective buckets using the determined or interpolated angular positions.
  • the acquisition of the first image in step b) as well as the acquisition of the second image and in step I) is taken place continuously.
  • the capture can take the form of a video from which the individual images are extracted. In this case, exactly those images are extracted that optimally depict a specific bucket due to the associated angular position.
  • the acquisition of the first image and the first angular position in step b) and the acquisition of the second image and the second angular position in step I) are each performed separately.
  • a video stream is received.
  • the control system either receives an angular position from a clinometer, whereby there is no temporal synchronicity between the two.
  • the system can request the angular position from a clinometer, for example, at regular intervals and then receive the angular position as a response, preferably with time information. For the times between two pieces of angular information, the angular position is linearly extrapolated from the available information.
  • the angular positions of the individual buckets are specified and these are given as a request to a clinometer.
  • the clinometer then triggers the acquisition of an image by a camera when the predefined angles are reached. This ensures that the images to be evaluated are always taken in the optimum position.
  • a disadvantage is the higher complexity of the acquisition system.
  • the images are captured on the opposite side of the removal side of the bucket wheel.
  • the buckets In the case of a rotational movement usual for mining, in which the buckets dig through the material from the bottom upwards, the buckets are thus captured with the teeth pointing downwards. This can make it advantageous to rotate the images before further processing so that the teeth of the buckets point upwards.
  • the contour detection in step e) and in step o) is pixel-based.
  • the assignment of the pixels to the bucket or to the background can be done, for example, via the colour relationship.
  • the shape of the bucket can be used as a rough grid to determine an average colour value of the bucket. An abrupt colour change starting from the centre of the bucket thus most likely indicates the edge of the bucket and thus the outer contour.
  • the acquisition of the first image in step b) and the acquisition of the second image in step I) is performed in such a way that the acquisition of the bucket is approximately perpendicular.
  • approximately perpendicular means that the imaginary line from the camera and the bucket passes through the axis of rotation of the bucket wheel or has a smallest distance to the axis of rotation of the bucket wheel, which is less than 20 %, preferably less than 10 %, of the diameter of the bucket wheel.
  • the detection of the tips of the teeth in step f) and step p) is performed by means of a neural network.
  • the neural network is a convolutional neural network.
  • the neural network is trained in a supervisor-supervised manner.
  • the neural network is trained in a supervisor-supervised manner. This is done in such a way that first an automatic recognition takes place and this is then checked by the supervisor and corrected if necessary. When sufficient recognition accuracy is achieved, i.e. no or only very little need for correction, the training is terminated.
  • the convolutional neural network is a region based convolutional neural network, especially fast convolutional neural network.
  • the further adjustment in step j) comprises in particular arranging the model in space for conversion into a two-dimensional image captured by a camera. This step ensures an exact alignment and distance between the camera and the blade to create a virtual two-dimensional image corresponding to a camera shot. This geometric relationship will also be the same for all subsequent captured images, so this adjustment only needs to be made the first time.
  • step j) comprises adjusting the position of the teeth relative to the bucket.
  • This step primarily takes into account a variation of the teeth during assembly, but above all also corresponds in the later analogue step r) due to wear.
  • steps I) to s) are performed and repeated during step k).
  • This embodiment is particularly preferred.
  • This allows the teeth to be monitored continuously or at predefined intervals during regular operation.
  • This also has the great advantage that a relatively large number of data points relating to the closing of the teeth are recorded, which in turn enables the remaining time to be predicted.
  • this also allows the wear to be recorded very precisely in terms of time, whereby, for example, inclusions in the material to be removed with a higher hardness, which leads to more abrasion, can be easily detected. As a result, such wear events can easily be calculated out of an averaged wear progression. It is also possible to detect a high current wear and thus shorten the prognosis compared to the time average and thus minimise the risk of damage to the bucket wheel due to completely worn teeth.
  • the model in step h) is a 3D model.
  • a first wear value and a second wear value are predetermined.
  • the first wear value recommends a replacement shortly for example, during the next inspection or relocation of the bucket wheel to another position or another planned interruption. This means that no additional interruption of the mining operation is necessary.
  • the second wear value recommends an immediate replacement. Of course, this involves an interruption of the operation and thus a loss of operating time, but this is necessary to protect the paddle wheel itself and must therefore be accepted.
  • For each tooth the wear determined in step r) is compared with the first wear value and the second wear value before step s). Since the wear is different for each tooth, each must be considered separately. An averaged consideration only makes sense insofar as there may be an increased urgency for replacement when a certain number of teeth exceed the first wear value.
  • step s) an exceeding of the first wear value or of the second wear value is also output.
  • step I) a plurality of second images is acquired.
  • the acquired second images are compared with a last stored and last evaluated image of the same bucket.
  • the second image with the smallest deviation from the last stored image is selected and used for steps m) to q).
  • the buckets will constantly show contamination, whereby the contamination usually changes with each rotation. If, for example, 20 images of the same bucket are captured during 20 consecutive rotations, the dirt build-up will most likely be different in each image.
  • the first image in step f) with new teeth captures a clean bucket, the next image will again have the highest similarity with at least the dirt. In the following check, the bucket with the least dirt will again show the best match, and so on.
  • Fig. 1 shows a bucket wheel 10 of a bucket wheel excavator for carrying out the method according to the invention.
  • the bucket wheel 10 usually has a fixed inner area 20 on which the bucket area 30 rotates.
  • the bucket area has a plurality of buckets with teeth not shown here.
  • the removed material 60 is transferred via a chute 80 onto a conveyor belt 70 and transported away.
  • the bucket wheel 10 has a camera 40 that captures images of the buckets 32.
  • Fig. 2 shows the flow chart of the method according to the invention.
  • the method has the following steps: a) Providing a bucket wheel with fully intact teeth, b) acquiring at least a first image and at least a first angular position of the bucket wheel, c) Determining the first bucket detected in the first image, d) cropping the first bucket in the first image, e) contour detection of the first bucket in the captured first image, f) detecting the tips of the teeth of the first bucket and detecting a first base point of the first bucket, g) determining a vector for each tooth from the first base point to the tip of the tooth in the first image, h) providing a model for a virtual bucket wheel with virtual teeth, i) Fitting the model to teeth with complete remaining life, j) further fitting the model so that the model matches the vectors determined in step g), k) operating the bucket wheel, l) acquiring at least a second image and at least a second angular position of the bucket wheel, m) determining the
  • step k the steps I) to s) are repeated continuously during to operation in step k).

Landscapes

  • Engineering & Computer Science (AREA)
  • Mining & Mineral Resources (AREA)
  • Civil Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Structural Engineering (AREA)
  • Mechanical Engineering (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

L'invention concerne un système de surveillance pour surveiller les dents d'un excavateur à roue-pelle.
EP22720454.2A 2022-02-17 2022-04-05 Système de surveillance d'usure des dents pour excavateurs à roue-pelle Pending EP4479595A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202231008369 2022-02-17
PCT/EP2022/058982 WO2023156027A1 (fr) 2022-02-17 2022-04-05 Système de surveillance d'usure des dents pour excavateurs à roue-pelle

Publications (1)

Publication Number Publication Date
EP4479595A1 true EP4479595A1 (fr) 2024-12-25

Family

ID=81454639

Family Applications (1)

Application Number Title Priority Date Filing Date
EP22720454.2A Pending EP4479595A1 (fr) 2022-02-17 2022-04-05 Système de surveillance d'usure des dents pour excavateurs à roue-pelle

Country Status (3)

Country Link
EP (1) EP4479595A1 (fr)
AU (1) AU2022441613A1 (fr)
WO (1) WO2023156027A1 (fr)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008045470A1 (de) * 2008-09-03 2010-03-04 Wirtgen Gmbh Verfahren zur Bestimmung des Verschleißzustandes
DE102017118914B4 (de) * 2017-08-18 2023-09-21 Flsmidth A/S System und Verfahren zur Bestimmung des Verschleißes abtragender Elemente an einem Schaufelradgerät
US20220307234A1 (en) * 2019-05-31 2022-09-29 Cqms Pty Ltd Ground engaging tool monitoring system

Also Published As

Publication number Publication date
WO2023156027A1 (fr) 2023-08-24
AU2022441613A1 (en) 2024-08-15

Similar Documents

Publication Publication Date Title
US20250198132A1 (en) Ground engaging tool monitoring system
US12331488B2 (en) Method, apparatus and system for monitoring a condition associated with operating heavy equipment such as a mining shovel or excavator
US9483820B2 (en) Method and system for detecting a damaged component of a machine
AU2016265876C1 (en) Method and apparatus for locating a wear part in an image of an operating implement
US11850631B2 (en) System and method for estimating damage to a shaker table screen using computer vision
CN110065790B (zh) 一种基于视觉算法的煤矿皮带转运机头堵塞检测方法
AU2003235679A1 (en) Conveyor belt inspection system and method
US7778445B2 (en) Method and system for the detection of removed objects in video images
JP6917757B2 (ja) 外観検査装置、表面処理システム、外観検査方法、プログラム、および投射材交換判断方法
JP7678118B2 (ja) 接地係合ツールの摩耗および喪失検出システムならびに方法
Pierleoni et al. A machine vision system for manual assembly line monitoring
RS62706B1 (sr) Sistem za određivanje istrošenosti skidajućih elemenata na uređaju sa rotorskim točkom
MX2024001753A (es) Sistema y metodo de deteccion de desgaste y perdida de herramienta de acoplamiento al suelo de maquina de trabajo.
US20210073962A1 (en) Method and system for detecting damage to a component
CN119429576A (zh) 一种残煤智能化处理系统及方法
EP4479595A1 (fr) Système de surveillance d'usure des dents pour excavateurs à roue-pelle
US11669956B2 (en) Ground engaging tool wear and loss detection system and method
US5844603A (en) Image data processing apparatus having functions of dividing the image data, and method of processing image data
US12270731B2 (en) Automated analysis and sorting of milling drum tools
CN115734839A (zh) 用于工件的减材加工的方法和加工设备
KR102587918B1 (ko) 봉제 불량 자동 검출 방법 및 시스템
AU2023293528A1 (en) Method and material removal system
EP4198885A1 (fr) Élaboration de rapports et visualisation d'égout
CN121589727B (zh) 一种抛丸设备控制方法及系统
CN120782697A (zh) 斗齿检测方法、装置、电子设备及计算机可读存储介质

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20240718

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20251010

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED